Commit Briefs

06874df836 Nikita Kalyazin

repro for using max devices on arm (repro/max_dev_arm)

!!! do not merge !!! This is to demonstrate an issue where if more than 64 devices are attached to a microVM on ARM, only 64 of them can be used.


27fb303f7f Patrick Roy

test: Use git_ab_test_with_binaries in tools/test_ab.py

Previously, test_ab.py was explicitly calling release.sh to build firecracker binaries. This was done because originally the first version of the script called out to `tools/devtool build`, to ensure maximal compatibility with older versions of firecracker (which might no longer compile in new dev containers). However, nowadays the entire ab_test.py script is run inside of docker, meaning we no longer get this benefit, so there is no difference between calling release.sh and using get_firecracker_binaries(), so just use the git_ab_test_with_binaries facilities introduced in this patch series. Signed-off-by: Patrick Roy <roypat@amazon.co.uk>


0fba769ff5 Patrick Roy

test: disable pylint's redefined-outer-name

This lint unilaterally forbids shadowing. However, this clashes with pytest fixtures in a great many places: To use a fixture a test function needs to have an argument that matches the fixture's name. However, if the fixture is defined in the same file as its usage, then this will trigger pylint's redfined-outer-name. Since this is a very common pattern, disable this lint. Signed-off-by: Patrick Roy <roypat@amazon.co.uk>


c44b0c63bd Patrick Roy

test: ab-ify test_vulnerabilities.py

These tests can fail due to external factors (microcode updates, AMI updates, etc), which would then block our PR CI until those get resolved. By using A/B-testing for our PR CI we avoid this, and get alerted to these changes out-of-band. Since A/B-Testing needs microvms compiled from different revisions, we need to change our fixture approach a bit. Instead of building microvms, it now provides factory methods that can be consumed by the A/B-test functions for building microvms from compiled firecracker binaries. These factory methods can then be composed to make them perform additional actions such as "restore from snapshot" or "make sure checker script is there". The condition that the A/B-Tests verify is "PR did not introduce a vulnerability". This is different from the "Result of vulnerability test did not change across PR" that might be more obviously associated with A/B-testing. However, this latter approach would not allow us to fix vulnerabilities (as it would block such PRs). Signed-off-by: Patrick Roy <roypat@amazon.co.uk>


d06bf461c4 Patrick Roy

test: Add support for A/B-Tests that need to compile old versions of FC

Needed for the vulnerability tests, as they need to run commands inside of microvms. Signed-off-by: Patrick Roy <roypat@amazon.co.uk>


38933bfe57 Patrick Roy

test: Add workspace_dir option to cargo_build.get_binaries

The vulnerabilities A/B-Tests will need to compile firecracker from an old revision, meaning we need to grab binaries from a different cargo workspace. Signed-off-by: Patrick Roy <roypat@amazon.co.uk>


f79d301794 Patrick Roy

test: A/B-ify spectre_meltdown_checker_on_host

Similar to test_cargo_audit, it can fail due to actions outside of our control. Signed-off-by: Patrick Roy <roypat@amazon.co.uk>


8297c8f3a5 Patrick Roy

test: A/B-ify test_cargo_audit

The test_cargo_audit test can fail due to new advisories being published on crates that firecracker already consumes. We already get notified of this because we do a nightly run that alerts us whenever any advisory for one of our dependencies exists. There is no need to do the same on PRs, as that means all development activities are blocked until the advisory is resolved (which might be non-trivial). Thus use A/B-testing in CI to only fail a PR if a newly introduced dependency has a pre-existing advisory (in which case we do not want to introduce the dependency). This is done by computing the set of warnings/vulnerabilities that currently affect the repository, and ensuring that there are no additions to this set (while subtractions, for example due to a PR removing a vulnerable dependency, are allowed). Signed-off-by: Patrick Roy <roypat@amazon.co.uk>


6cd8182ffc Patrick Roy

test: Add utility for running bash commands as A/B-tests

Running a bash command as an A/B-Test means testing that the output of the command is the same both before and after the PR. Signed-off-by: Patrick Roy <roypat@amazon.co.uk>


6141c2c86e sudanl0

ci(AB tests): move timeouts per test

Move the timeout per test, since we don't know a priori how many tests are going to run, depending on the supported host and guest kernels. Signed-off-by: Pablo Barbáchano <pablob@amazon.com>


Branches























































































Tags

v1.17.0

v1.16.2

v1.16.1

Tree

.buildkite/
.cargo/
.dockerignorecommits | blame
.git-blame-ignore-revscommits | blame
.github/
.gitignorecommits | blame
.gitlintcommits | blame
.mailmapcommits | blame
.mdlrccommits | blame
CHANGELOG.mdcommits | blame
CHARTER.mdcommits | blame
CODE_OF_CONDUCT.mdcommits | blame
CONTRIBUTING.mdcommits | blame
CREDITS.mdcommits | blame
Cargo.lockcommits | blame
Cargo.tomlcommits | blame
FAQ.mdcommits | blame
LICENSEcommits | blame
MAINTAINERS.mdcommits | blame
NOTICEcommits | blame
PGP-KEY.asccommits | blame
README.mdcommits | blame
SECURITY.mdcommits | blame
SPECIFICATION.mdcommits | blame
THIRD-PARTYcommits | blame
deny.tomlcommits | blame
docs/
pre-commit*commits | blame
resources/
rusty-hook.tomlcommits | blame
src/
tests/
tools/

README.md

<picture>
   <source media="(prefers-color-scheme: dark)" srcset="docs/images/fc_logo_full_transparent-bg_white-fg.png">
   <source media="(prefers-color-scheme: light)" srcset="docs/images/fc_logo_full_transparent-bg.png">
   <img alt="Firecracker Logo Title" width="750" src="docs/images/fc_logo_full_transparent-bg.png">
</picture>

Our mission is to enable secure, multi-tenant, minimal-overhead execution of
container and function workloads.

Read more about the Firecracker Charter [here](CHARTER.md).

## What is Firecracker?

Firecracker is an open source virtualization technology that is purpose-built
for creating and managing secure, multi-tenant container and function-based
services that provide serverless operational models. Firecracker runs workloads
in lightweight virtual machines, called microVMs, which combine the security and
isolation properties provided by hardware virtualization technology with the
speed and flexibility of containers.

## Overview

The main component of Firecracker is a virtual machine monitor (VMM) that uses
the Linux Kernel Virtual Machine (KVM) to create and run microVMs. Firecracker
has a minimalist design. It excludes unnecessary devices and guest-facing
functionality to reduce the memory footprint and attack surface area of each
microVM. This improves security, decreases the startup time, and increases
hardware utilization. Firecracker has also been integrated in container runtimes,
for example
[Kata Containers](https://github.com/kata-containers/documentation/wiki/Initial-release-of-Kata-Containers-with-Firecracker-support)
and [Weaveworks Ignite](https://github.com/weaveworks/ignite).

Firecracker was developed at Amazon Web Services to accelerate the speed and
efficiency of services like [AWS Lambda](https://aws.amazon.com/lambda/) and
[AWS Fargate](https://aws.amazon.com/fargate/). Firecracker is open
sourced under [Apache version 2.0](LICENSE).

To read more about Firecracker, check out
[firecracker-microvm.io](https://firecracker-microvm.github.io).

## Getting Started

To get started with Firecracker, download the latest
[release](https://github.com/firecracker-microvm/firecracker/releases) binaries
or build it from source.

You can build Firecracker on any Unix/Linux system that has Docker running
(we use a development container) and `bash` installed, as follows:

```bash
git clone https://github.com/firecracker-microvm/firecracker
cd firecracker
tools/devtool build
toolchain="$(uname -m)-unknown-linux-musl"
```

The Firecracker binary will be placed at
`build/cargo_target/${toolchain}/debug/firecracker`. For more information on
building, testing, and running Firecracker, go to the
[quickstart guide](docs/getting-started.md).

The overall security of Firecracker microVMs, including the ability to meet the
criteria for safe multi-tenant computing, depends on a well configured Linux
host operating system. A configuration that we believe meets this bar is
included in [the production host setup document](docs/prod-host-setup.md).

## Contributing

Firecracker is already running production workloads within AWS, but it's still
Day 1 on the journey guided by our [mission](CHARTER.md). There's a lot more to
build and we welcome all contributions.

To contribute to Firecracker, check out the development setup section in the
[getting started guide](docs/getting-started.md) and then the Firecracker
[contribution guidelines](CONTRIBUTING.md).

## Releases

New Firecracker versions are released via the GitHub repository
[releases](https://github.com/firecracker-microvm/firecracker/releases) page,
typically every two or three months. A history of changes is recorded in our
[changelog](CHANGELOG.md).

The Firecracker release policy is detailed [here](docs/RELEASE_POLICY.md).

## Design

Firecracker's overall architecture is described in
[the design document](docs/design.md).

## Features & Capabilities

Firecracker consists of a single micro Virtual Machine Manager process that
exposes an API endpoint to the host once started. The API is
[specified in OpenAPI format](src/api_server/swagger/firecracker.yaml). Read more
about it in the [API docs](docs/api_requests).

The **API endpoint** can be used to:

- Configure the microvm by:
  - Setting the number of vCPUs (the default is 1).
  - Setting the memory size (the default is 128 MiB).
  - Configuring a [CPU template](docs/cpu_templates/cpu-templates.md).
- Add one or more network interfaces to the microVM.
- Add one or more read-write or read-only disks to the microVM, each represented
  by a file-backed block device.
- Trigger a block device re-scan while the guest is running. This enables the
  guest OS to pick up size changes to the block device's backing file.
- Change the backing file for a block device, before or after the guest boots.
- Configure rate limiters for virtio devices which can limit the bandwidth,
  operations per second, or both.
- Configure the logging and metric system.
- `[BETA]` Configure the data tree of the guest-facing metadata service. The
  service is only available to the guest if this resource is configured.
- Add a [vsock socket](docs/vsock.md) to the microVM.
- Add a [entropy device](docs/entropy.md) to the microVM.
- Start the microVM using a given kernel image, root file system, and boot
  arguments.
- [x86_64 only] Stop the microVM.

**Built-in Capabilities**:

- Demand fault paging and CPU oversubscription enabled by default.
- Advanced, thread-specific seccomp filters for enhanced security.
- [Jailer](docs/jailer.md) process for starting Firecracker in production
  scenarios; applies a cgroup/namespace isolation barrier and then
  drops privileges.

## Tested platforms

We test all combinations of:

| Instance   | Host OS & Kernel   | Guest Rootfs   | Guest Kernel   |
| :--------- | :----------------- | :------------- | :------------- |
| m5d.metal  | al2    linux_4.1   | ubuntu 22.04   | linux_4.14     |
| m6i.metal  | al2    linux_5.10  |                | linux_5.10     |
| m6a.metal  | al2023 linux_6.1   |                |                |
| m6g.metal  |                    |                |                |
| c7g.metal  |                    |                |                |

## Known issues and Limitations

- The [SendCtrlAltDel](docs/api_requests/actions.md#sendctrlaltdel) API request
  is not supported for aarch64 enabled microVMs.
- If a CPU template is not used on x86_64, overwrites of `MSR_IA32_TSX_CTRL` MSR
  value will not be preserved after restoring from a snapshot.
- The `pl031` RTC device on aarch64 does not support interrupts, so guest
  programs which use an RTC alarm (e.g. `hwclock`) will not work.
- Issues and limitations related to snapshots are described in a [separate document](docs/snapshotting/snapshot-support.md#limitations).

## Performance

Firecracker's performance characteristics are listed as part of the
[specification documentation](SPECIFICATION.md). All specifications are a part
of our commitment to supporting container and function workloads in serverless
operational models, and are therefore enforced via continuous integration
testing.

## Policy for Security Disclosures

The security of Firecracker is our top priority. If you suspect you have
uncovered a vulnerability, contact us privately, as outlined in our
[security policy document](SECURITY.md); we will immediately prioritize
your disclosure.

## FAQ & Contact

Frequently asked questions are collected in our [FAQ doc](FAQ.md).

You can get in touch with the Firecracker community in the following ways:

- Security-related issues, see our [security policy document](SECURITY.md).
- Chat with us on our
  [Slack workspace](https://join.slack.com/t/firecracker-microvm/shared_invite/zt-1zlb87h4z-NED1rBhVqOQ1ygBgT76wlg)
  _Note: most of the maintainers are on a European time zone._
- Open a GitHub issue in this repository.
- Email the maintainers at
  [firecracker-maintainers@amazon.com](mailto:firecracker-maintainers@amazon.com).

When communicating within the Firecracker community, please mind our
[code of conduct](CODE_OF_CONDUCT.md).