Commit Briefs

3acf37d3e8 ShadowCurse

fix(vsock): save state after sending a notification (feature/risc-v)

This is a fix for a fix introduced in #4796 The issue was in vsock device hanging after snapshot restoration due to the guest not being notified about the termination packet. But there was bug in the fix, maily we saved the vsock state before the notification was sent, thus discarding all modifications made to sent the notification. The reason original fix worked, is because we were only testing with 1 iteration of snap/restore. This way even though we lost synchronization with the guest in the event queue state, it worked fine once. But doing more iterations causes vsock to hang as before. This commit fixes the issue by storing vsock state after the notification is sent and modifies the vsock test to run multiple iterations of snap/restore. Signed-off-by: Egor Lazarchuk <yegorlz@amazon.co.uk>


5d762a8f52 ShadowCurse

chore: update too fast benches

Some benchmarks are very small and fast and this causes them to be unstable. We can still keep an eye on the performance with longer benches. Also increased number of runs and threshold. This should be fine as all tests still run in nanoseconds. Signed-off-by: Egor Lazarchuk <yegorlz@amazon.co.uk>


a4b3d932ce Pablo Barbáchano

tests: pass -vv option to pytest

This should help in cases where it truncates the output. E AssertionError: assert {'aes', 'asim...simdrdm', ...} [...] E Extra items in the left set: E 'fp' E 'asimdhp' E 'sha2' E 'ssbs' E 'asimd' E 'crc32'... E E ...Full output truncated (47 lines hidden), use '-vv' to show Signed-off-by: Pablo Barbáchano <pablob@amazon.com>


9d5dee362f Pablo Barbáchano

ci: drop support for guest kernel 4.14

Remove support for generating kernel 4.14 and tests. Signed-off-by: Pablo Barbáchano <pablob@amazon.com>


359d79d4cf Pablo Barbáchano

test: remove old boottime test

Removing these tests as we don't emit metrics from them and they are still using kernel 4.14. There is no point on preserving these tests as we have now track boot time in test_boottime.py Signed-off-by: Pablo Barbáchano <pablob@amazon.com>


24819a0d07 Pablo Barbáchano

fix(release): ensure debuginfo file contains debugging info

Seems recently Cargo defaulted to use `strip=debuginfo`. This inadvertently made our debuginfo files much smaller Fix the issue by using `strip=none` and add a test so that it breaks if this somehow changes again. Signed-off-by: Pablo Barbáchano <pablob@amazon.com>


0661dd7def Patrick Roy

build(deps): Bump the firecracker group across 1 directory with 7 updates

Bumps the firecracker group with 7 updates in the / directory: | Package | From | To | | --- | --- | --- | | [vm-memory](https://github.com/rust-vmm/vm-memory) | `0.14.1` | `0.15.0` | | [linux-loader](https://github.com/rust-vmm/linux-loader) | `0.11.0` | `0.12.0` | | [vhost](https://github.com/rust-vmm/vhost) | `0.11.0` | `0.12.0` | | [cc](https://github.com/rust-lang/cc-rs) | `1.1.18` | `1.1.19` | | [rustix](https://github.com/bytecodealliance/rustix) | `0.38.36` | `0.38.37` | | [toml_edit](https://github.com/toml-rs/toml) | `0.22.20` | `0.22.21` | | [unicode-ident](https://github.com/dtolnay/unicode-ident) | `1.0.12` | `1.0.13` | Updates `vm-memory` from 0.14.1 to 0.15.0 - [Release notes](https://github.com/rust-vmm/vm-memory/releases) - [Changelog](https://github.com/rust-vmm/vm-memory/blob/main/CHANGELOG.md) - [Commits](https://github.com/rust-vmm/vm-memory/compare/v0.14.1...v0.15.0) Updates `linux-loader` from 0.11.0 to 0.12.0 - [Release notes](https://github.com/rust-vmm/linux-loader/releases) - [Changelog](https://github.com/rust-vmm/linux-loader/blob/main/CHANGELOG.md) - [Commits](https://github.com/rust-vmm/linux-loader/compare/v0.11.0...v0.12.0) Updates `vhost` from 0.11.0 to 0.12.0 - [Release notes](https://github.com/rust-vmm/vhost/releases) - [Commits](https://github.com/rust-vmm/vhost/compare/vhost-v0.11.0...vhost-v0.12.0) Updates `cc` from 1.1.18 to 1.1.19 - [Release notes](https://github.com/rust-lang/cc-rs/releases) - [Changelog](https://github.com/rust-lang/cc-rs/blob/main/CHANGELOG.md) - [Commits](https://github.com/rust-lang/cc-rs/compare/cc-v1.1.18...cc-v1.1.19) Updates `rustix` from 0.38.36 to 0.38.37 - [Release notes](https://github.com/bytecodealliance/rustix/releases) - [Changelog](https://github.com/bytecodealliance/rustix/blob/main/CHANGELOG.md) - [Commits](https://github.com/bytecodealliance/rustix/compare/v0.38.36...v0.38.37) Updates `toml_edit` from 0.22.20 to 0.22.21 - [Commits](https://github.com/toml-rs/toml/compare/v0.22.20...v0.22.21) Updates `unicode-ident` from 1.0.12 to 1.0.13 - [Release notes](https://github.com/dtolnay/unicode-ident/releases) - [Commits](https://github.com/dtolnay/unicode-ident/compare/1.0.12...1.0.13) --- updated-dependencies: - dependency-name: vm-memory dependency-type: direct:production update-type: version-update:semver-minor dependency-group: firecracker - dependency-name: linux-loader dependency-type: direct:production update-type: version-update:semver-minor dependency-group: firecracker - dependency-name: vhost dependency-type: direct:production update-type: version-update:semver-minor dependency-group: firecracker - dependency-name: cc dependency-type: indirect update-type: version-update:semver-patch dependency-group: firecracker - dependency-name: rustix dependency-type: indirect update-type: version-update:semver-patch dependency-group: firecracker - dependency-name: toml_edit dependency-type: indirect update-type: version-update:semver-patch dependency-group: firecracker - dependency-name: unicode-ident dependency-type: indirect update-type: version-update:semver-patch dependency-group: firecracker ... Signed-off-by: dependabot[bot] <support@github.com>


f70a87fad2 Pablo Barbáchano

buildkite: make build steps unique

If we have more than one build step in a pipeline, Buildkite complains that they are not unique. fatal: Failed to upload and process pipeline: Pipeline upload rejected: The key "build_x86_64" has already been used by another step in this build We had a similar issue with shared build tarballs, so just reuse the tarball name as key. Fixes: 19e90517fa9f12b740ba41393dbd6a8352c270f7 Signed-off-by: Pablo Barbáchano <pablob@amazon.com>


474392d60c Pablo Barbáchano

buildkite: fix agents passed as a list instead of dict

19e90517fa9f12b740ba41393dbd6a8352c270f7 assumed the `agents` is a dict, which was true in all cases except in one pipeline. Fixes: 19e90517fa9f12b740ba41393dbd6a8352c270f7 Signed-off-by: Pablo Barbáchano <pablob@amazon.com>


15868c3da7 Patrick Roy

test: style: fix black ignoring `integration_test/build` directory

When `black` is passed multiple directories, it will try to look for `pyproject.toml` in the common ancestor of those paths. In our cases, since we pass it `tests`, `.buildkite` and `tools`, that would be the repository root. However, our pyproject.toml sits in `tests`, and thus the `exclude` rule it defines is ignored (and it is this `exclude` rules that overwrites the default behavior of excluding directories called `build`). Fix this by explicitly passing in a `--config` argument. Since `isort` does not support this argument, pass it in a quite ugly via by adding it to the pytest parameters. Fixes: 4f55e491ee3bd08c21cf15db06162f4b4afccb04 Signed-off-by: Patrick Roy <roypat@amazon.co.uk>


Branches























































































Tags

v1.17.0

v1.16.2

v1.16.1

Tree

.buildkite/
.cargo/
.dockerignorecommits | blame
.git-blame-ignore-revscommits | blame
.github/
.gitignorecommits | blame
.gitlintcommits | blame
.mailmapcommits | blame
.mdformat.tomlcommits | blame
.python-versioncommits | blame
CHANGELOG.mdcommits | blame
CHARTER.mdcommits | blame
CODE_OF_CONDUCT.mdcommits | blame
CONTRIBUTING.mdcommits | blame
CREDITS.mdcommits | blame
Cargo.lockcommits | blame
Cargo.tomlcommits | blame
DEPRECATED.mdcommits | blame
FAQ.mdcommits | blame
LICENSEcommits | blame
MAINTAINERS.mdcommits | blame
NOTICEcommits | blame
PGP-KEY.asccommits | blame
README.mdcommits | blame
SECURITY.mdcommits | blame
SPECIFICATION.mdcommits | blame
THIRD-PARTYcommits | blame
deny.tomlcommits | blame
docs/
pre-commit*commits | blame
resources/
rust-toolchain.tomlcommits | blame
rusty-hook.tomlcommits | blame
src/
tests/
tools/

README.md

<picture>
   <source media="(prefers-color-scheme: dark)" srcset="docs/images/fc_logo_full_transparent-bg_white-fg.png">
   <source media="(prefers-color-scheme: light)" srcset="docs/images/fc_logo_full_transparent-bg.png">
   <img alt="Firecracker Logo Title" width="750" src="docs/images/fc_logo_full_transparent-bg.png">
</picture>

Our mission is to enable secure, multi-tenant, minimal-overhead execution of
container and function workloads.

Read more about the Firecracker Charter [here](CHARTER.md).

## What is Firecracker?

Firecracker is an open source virtualization technology that is purpose-built
for creating and managing secure, multi-tenant container and function-based
services that provide serverless operational models. Firecracker runs workloads
in lightweight virtual machines, called microVMs, which combine the security and
isolation properties provided by hardware virtualization technology with the
speed and flexibility of containers.

## Overview

The main component of Firecracker is a virtual machine monitor (VMM) that uses
the Linux Kernel Virtual Machine (KVM) to create and run microVMs. Firecracker
has a minimalist design. It excludes unnecessary devices and guest-facing
functionality to reduce the memory footprint and attack surface area of each
microVM. This improves security, decreases the startup time, and increases
hardware utilization. Firecracker has also been integrated in container
runtimes, for example
[Kata Containers](https://github.com/kata-containers/kata-containers) and
[Flintlock](https://github.com/liquidmetal-dev/flintlock).

Firecracker was developed at Amazon Web Services to accelerate the speed and
efficiency of services like [AWS Lambda](https://aws.amazon.com/lambda/) and
[AWS Fargate](https://aws.amazon.com/fargate/). Firecracker is open sourced
under [Apache version 2.0](LICENSE).

To read more about Firecracker, check out
[firecracker-microvm.io](https://firecracker-microvm.github.io).

## Getting Started

To get started with Firecracker, download the latest
[release](https://github.com/firecracker-microvm/firecracker/releases) binaries
or build it from source.

You can build Firecracker on any Unix/Linux system that has Docker running (we
use a development container) and `bash` installed, as follows:

```bash
git clone https://github.com/firecracker-microvm/firecracker
cd firecracker
tools/devtool build
toolchain="$(uname -m)-unknown-linux-musl"
```

The Firecracker binary will be placed at
`build/cargo_target/${toolchain}/debug/firecracker`. For more information on
building, testing, and running Firecracker, go to the
[quickstart guide](docs/getting-started.md).

The overall security of Firecracker microVMs, including the ability to meet the
criteria for safe multi-tenant computing, depends on a well configured Linux
host operating system. A configuration that we believe meets this bar is
included in [the production host setup document](docs/prod-host-setup.md).

## Contributing

Firecracker is already running production workloads within AWS, but it's still
Day 1 on the journey guided by our [mission](CHARTER.md). There's a lot more to
build and we welcome all contributions.

To contribute to Firecracker, check out the development setup section in the
[getting started guide](docs/getting-started.md) and then the Firecracker
[contribution guidelines](CONTRIBUTING.md).

## Releases

New Firecracker versions are released via the GitHub repository
[releases](https://github.com/firecracker-microvm/firecracker/releases) page,
typically every two or three months. A history of changes is recorded in our
[changelog](CHANGELOG.md).

The Firecracker release policy is detailed [here](docs/RELEASE_POLICY.md).

## Design

Firecracker's overall architecture is described in
[the design document](docs/design.md).

## Features & Capabilities

Firecracker consists of a single micro Virtual Machine Manager process that
exposes an API endpoint to the host once started. The API is
[specified in OpenAPI format](src/firecracker/swagger/firecracker.yaml). Read
more about it in the [API docs](docs/api_requests).

The **API endpoint** can be used to:

- Configure the microvm by:
  - Setting the number of vCPUs (the default is 1).
  - Setting the memory size (the default is 128 MiB).
  - Configuring a [CPU template](docs/cpu_templates/cpu-templates.md).
- Add one or more network interfaces to the microVM.
- Add one or more read-write or read-only disks to the microVM, each represented
  by a file-backed block device.
- Trigger a block device re-scan while the guest is running. This enables the
  guest OS to pick up size changes to the block device's backing file.
- Change the backing file for a block device, before or after the guest boots.
- Configure rate limiters for virtio devices which can limit the bandwidth,
  operations per second, or both.
- Configure the logging and metric system.
- `[BETA]` Configure the data tree of the guest-facing metadata service. The
  service is only available to the guest if this resource is configured.
- Add a [vsock socket](docs/vsock.md) to the microVM.
- Add a [entropy device](docs/entropy.md) to the microVM.
- Start the microVM using a given kernel image, root file system, and boot
  arguments.
- \[x86_64 only\] Stop the microVM.

**Built-in Capabilities**:

- Demand fault paging and CPU oversubscription enabled by default.
- Advanced, thread-specific seccomp filters for enhanced security.
- [Jailer](docs/jailer.md) process for starting Firecracker in production
  scenarios; applies a cgroup/namespace isolation barrier and then drops
  privileges.

## Tested platforms

We test all combinations of:

| Instance  | Host OS & Kernel  | Guest Rootfs | Guest Kernel |
| :-------- | :---------------- | :----------- | :----------- |
| c5n.metal | al2    linux_5.10 | ubuntu 22.04 | linux_5.10   |
| m5n.metal | al2023 linux_6.1  |              | linux_6.1    |
| m6i.metal |                   |              |              |
| m6a.metal |                   |              |              |
| m6g.metal |                   |              |              |
| m7g.metal |                   |              |              |

## Known issues and Limitations

- The `pl031` RTC device on aarch64 does not support interrupts, so guest
  programs which use an RTC alarm (e.g. `hwclock`) will not work.

## Performance

Firecracker's performance characteristics are listed as part of the
[specification documentation](SPECIFICATION.md). All specifications are a part
of our commitment to supporting container and function workloads in serverless
operational models, and are therefore enforced via continuous integration
testing.

## Policy for Security Disclosures

The security of Firecracker is our top priority. If you suspect you have
uncovered a vulnerability, contact us privately, as outlined in our
[security policy document](SECURITY.md); we will immediately prioritize your
disclosure.

## FAQ & Contact

Frequently asked questions are collected in our [FAQ doc](FAQ.md).

You can get in touch with the Firecracker community in the following ways:

- Security-related issues, see our [security policy document](SECURITY.md).
- Chat with us on our
  [Slack workspace](https://join.slack.com/t/firecracker-microvm/shared_invite/zt-1zlb87h4z-NED1rBhVqOQ1ygBgT76wlg)
  _Note: most of the maintainers are on a European time zone._
- Open a GitHub issue in this repository.
- Email the maintainers at
  [firecracker-maintainers@amazon.com](mailto:firecracker-maintainers@amazon.com).

When communicating within the Firecracker community, please mind our
[code of conduct](CODE_OF_CONDUCT.md).