Commit Briefs

c8993701cb Ilias Stamatis

tests: Add PCI bus topology tests (ilstam-hotplug-2)

Add a new test_pci_topology.py file with tests about the PCI topology when root ports are and are not provisioned. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>


6772497a70 Ilias Stamatis

tests: Add pcie_hotplug_ports test fixture

This will allow hot-plugging test to allocate the necessary number of ports using @pin_hotplug_ports(n). Signed-off-by: Ilias Stamatis <ilstam@amazon.com>


8825aa122e Ilias Stamatis

pci: Add unit tests for root port provisioning

Add unit tests for root port provisioning and move the mock PCI device out of test_next_device_bdf() to module scope so that other tests can use it. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>


3bb4366102 Ilias Stamatis

pci: Attach root ports to the primary PCI bus

Create the number of PCI root ports the user has requested and attach them to the primary PCI bus. The root ports are provisioned after the boot devices have been attached, so they take the root bus slots that follow them. Secondary bus numbers are handed out by port index rather than by the slot each port ended up in so they stay contiguous starting from 1. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>


544090930b Ilias Stamatis

api: Add a pcie_hotplug_ports machine configuration option

Add a machine-config option for the number of PCIe root ports to create. Each port accepts a single hot-plugged device, so this is the maximum number of devices that can be hot-plugged into the VM. Setting the option does not modify the PCI bus topology yet. The new option is stored in VmInfo, which is part of the snapshot so bump the snapshot version to 13.0.0. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>


60e0dacee1 Ilias Stamatis

pci: root_port: Add unit tests

Add unit tests that cover the root port's configuration header and PCI Express Capability, the Slot Control / Slot Status register semantics, hot-plug interrupt gating and the power-indicator-off acknowledgement. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>


9a3b9db7a7 Ilias Stamatis

pci: Add PCIe root port device model

Add a hot-plug capable PCIe root port model: a Type 1 header with a PCI Express Capability advertising a hot-plug capable slot, plus a one-vector MSI-X capability for delivering hot-plug events. This patch only defines the device model, no root ports are introduced in the topology yet. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>


3415e051e2 Ilias Stamatis

pci: Add Type 1 configuration header

PciConfiguration only supported Type 0 headers until now. Add new_type1() for PCI-to-PCI bridges such as PCIe root ports. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>


62ca6fc6b7 Ilias Stamatis

pci: Add PCI Express Capability structure

Introduce PciExpressCap modelling the PCI Express Capability along with a ctor for a root port device. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>


722e954d2e Ilias Stamatis

acpi: Add _OSC method to the host bridge to grant the OS PCIe HP control (ilstam-hotplug-1)

Add an _OSC method to the host bridge. This can be used by the OS to request it's granted control of certain capabilities (PCIe hotplug, power management events, etc). Otherwise the platform keeps control of them. Grant whatever the guest asks for by returning the capabilities buffer unchanged. Granting control of features Firecracker does not implement is harmless. The guest only drives a feature if it also finds the corresponding PCI capability. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>


Branches























































































Tags

v1.17.0

v1.16.2

v1.16.1

Tree

.buildkite/
.cargo/
.dockerignorecommits | blame
.git-blame-ignore-revscommits | blame
.github/
.gitignorecommits | blame
.gitlintcommits | blame
.mailmapcommits | blame
.mdformat.tomlcommits | blame
.python-versioncommits | blame
CHANGELOG.mdcommits | blame
CHARTER.mdcommits | blame
CODE_OF_CONDUCT.mdcommits | blame
CONTRIBUTING.mdcommits | blame
CREDITS.mdcommits | blame
Cargo.lockcommits | blame
Cargo.tomlcommits | blame
DEPRECATED.mdcommits | blame
FAQ.mdcommits | blame
LICENSEcommits | blame
MAINTAINERS.mdcommits | blame
NOTICEcommits | blame
PGP-KEY.asccommits | blame
README.mdcommits | blame
SECURITY.mdcommits | blame
SPECIFICATION.mdcommits | blame
THIRD-PARTYcommits | blame
deny.tomlcommits | blame
docs/
resources/
rust-toolchain.tomlcommits | blame
rustfmt.tomlcommits | blame
src/
tests/
tools/

README.md

<picture>
   <source media="(prefers-color-scheme: dark)" srcset="docs/images/fc_logo_full_transparent-bg_white-fg.png">
   <source media="(prefers-color-scheme: light)" srcset="docs/images/fc_logo_full_transparent-bg.png">
   <img alt="Firecracker Logo Title" width="750" src="docs/images/fc_logo_full_transparent-bg.png">
</picture>

Our mission is to enable secure, multi-tenant, minimal-overhead execution of
container and function workloads.

Read more about the Firecracker Charter [here](CHARTER.md).

## What is Firecracker?

Firecracker is an open source virtualization technology that is purpose-built
for creating and managing secure, multi-tenant container and function-based
services that provide serverless operational models. Firecracker runs workloads
in lightweight virtual machines, called microVMs, which combine the security and
isolation properties provided by hardware virtualization technology with the
speed and flexibility of containers.

## Overview

The main component of Firecracker is a virtual machine monitor (VMM) that uses
the Linux Kernel Virtual Machine (KVM) to create and run microVMs. Firecracker
has a minimalist design. It excludes unnecessary devices and guest-facing
functionality to reduce the memory footprint and attack surface area of each
microVM. This improves security, decreases the startup time, and increases
hardware utilization. Firecracker has also been integrated in container
runtimes, for example
[Kata Containers](https://github.com/kata-containers/kata-containers) and
[Flintlock](https://github.com/liquidmetal-dev/flintlock).

Firecracker was developed at Amazon Web Services to accelerate the speed and
efficiency of services like [AWS Lambda](https://aws.amazon.com/lambda/) and
[AWS Fargate](https://aws.amazon.com/fargate/). Firecracker is open sourced
under [Apache version 2.0](LICENSE).

To read more about Firecracker, check out
[firecracker-microvm.io](https://firecracker-microvm.github.io).

## Getting Started

To get started with Firecracker, download the latest
[release](https://github.com/firecracker-microvm/firecracker/releases) binaries
or build it from source.

You can build Firecracker on any Unix/Linux system that has Docker running (we
use a development container) and `bash` installed, as follows:

```bash
git clone https://github.com/firecracker-microvm/firecracker
cd firecracker
tools/devtool build
toolchain="$(uname -m)-unknown-linux-musl"
```

The Firecracker binary will be placed at
`build/cargo_target/${toolchain}/debug/firecracker`. For more information on
building, testing, and running Firecracker, go to the
[quickstart guide](docs/getting-started.md).

The overall security of Firecracker microVMs, including the ability to meet the
criteria for safe multi-tenant computing, depends on a well configured Linux
host operating system. A configuration that we believe meets this bar is
included in [the production host setup document](docs/prod-host-setup.md).

## Contributing

Firecracker is already running production workloads within AWS, but it's still
Day 1 on the journey guided by our [mission](CHARTER.md). There's a lot more to
build and we welcome all contributions.

To contribute to Firecracker, check out the development setup section in the
[getting started guide](docs/getting-started.md) and then the Firecracker
[contribution guidelines](CONTRIBUTING.md).

## Releases

New Firecracker versions are released via the GitHub repository
[releases](https://github.com/firecracker-microvm/firecracker/releases) page,
typically every two or three months. A history of changes is recorded in our
[changelog](CHANGELOG.md).

The Firecracker release policy is detailed [here](docs/RELEASE_POLICY.md).

## Design

Firecracker's overall architecture is described in
[the design document](docs/design.md).

## Features & Capabilities

Firecracker consists of a single micro Virtual Machine Manager process that
exposes an API endpoint to the host once started. The API is
[specified in OpenAPI format](src/firecracker/swagger/firecracker.yaml). Read
more about it in the [API docs](docs/api_requests).

The **API endpoint** can be used to:

- Configure the microvm by:
  - Setting the number of vCPUs (the default is 1).
  - Setting the memory size (the default is 128 MiB).
  - Configuring a [CPU template](docs/cpu_templates/cpu-templates.md).
- Add one or more network interfaces to the microVM.
- Add one or more read-write or read-only disks to the microVM, each represented
  by a file-backed block device.
- Trigger a block device re-scan while the guest is running. This enables the
  guest OS to pick up size changes to the block device's backing file.
- Change the backing file for a block device, before or after the guest boots.
- Configure rate limiters for virtio devices which can limit the bandwidth,
  operations per second, or both.
- Configure the logging and metric system.
- `[BETA]` Configure the data tree of the guest-facing metadata service. The
  service is only available to the guest if this resource is configured.
- Add a [vsock socket](docs/vsock.md) to the microVM.
- Add a [entropy device](docs/entropy.md) to the microVM.
- Add a [pmem device](docs/pmem.md) to the microVM.
- Configure and manage [memory hotplugging](docs/memory-hotplug.md).
- `[Developer Preview]` [Hot-plug and hot-unplug](docs/device-hotplug.md) virtio
  PCI devices while the VM is running.
- Start the microVM using a given kernel image, root file system, and boot
  arguments.
- [x86_64 only] Stop the microVM.

**Built-in Capabilities**:

- Demand fault paging and CPU oversubscription enabled by default.
- Advanced, thread-specific seccomp filters for enhanced security.
- [Jailer](docs/jailer.md) process for starting Firecracker in production
  scenarios; applies a cgroup/namespace isolation barrier and then drops
  privileges.

## Tested platforms

We test all combinations of:

| Instance                                    | Host OS & Kernel  | Guest Rootfs | Guest Kernel |
| :------------------------------------------ | :---------------- | :----------- | :----------- |
| m5n.metal (Intel Cascade Lake)              | al2 linux_5.10    | ubuntu 24.04 | linux_5.10   |
| m6i.metal (Intel Ice Lake)                  | al2023 linux_6.1  |              | linux_6.1    |
|                                             | al2023 linux_6.18 |              |              |
| m7i.metal-24xl (Intel Sapphire Rapids)      |                   |              |              |
| m7i.metal-48xl (Intel Sapphire Rapids)      |                   |              |              |
| **m8i.metal-48xl (Intel Granite Rapids)\*** |                   |              |              |
| **m8i.metal-96xl (Intel Granite Rapids)\*** |                   |              |              |
| m6a.metal (AMD Milan)                       |                   |              |              |
| m7a.metal-48xl (AMD Genoa)                  |                   |              |              |
| m6g.metal (Graviton 2)                      |                   |              |              |
| m7g.metal (Graviton 3)                      |                   |              |              |
| m8g.metal-24xl (Graviton 4)                 |                   |              |              |
| m8g.metal-48xl (Graviton 4)                 |                   |              |              |
| m9g.metal-48xl (Graviton 5)                 |                   |              |              |

**\***: We **only** support AWS EC2 8th Gen Intel (\*8i) instances using a 6.1
or 6.18 host kernel. This is due to poor kernel support for Granite Rapids CPUs
on 5.10.

## Known issues and Limitations

- The `pl031` RTC device on aarch64 does not support interrupts, so guest
  programs which use an RTC alarm (e.g. `hwclock`) will not work.

## Performance

Firecracker's performance characteristics are listed as part of the
[specification documentation](SPECIFICATION.md). All specifications are a part
of our commitment to supporting container and function workloads in serverless
operational models, and are therefore enforced via continuous integration
testing.

## Policy for Security Disclosures

The security of Firecracker is our top priority. If you suspect you have
uncovered a vulnerability, contact us privately, as outlined in our
[security policy document](SECURITY.md); we will immediately prioritize your
disclosure.

## FAQ & Contact

Frequently asked questions are collected in our [FAQ doc](FAQ.md).

You can get in touch with the Firecracker community in the following ways:

- Security-related issues, see our [security policy document](SECURITY.md).
- Chat with us on our
  [Slack workspace](https://join.slack.com/t/firecracker-microvm/shared_invite/zt-3v81btcpe-usCf8Qk7k1gUlSAEKKdYMg)
  _Note: most of the maintainers are on a European time zone._
- Open a GitHub issue in this repository.
- Email the maintainers at
  [firecracker-maintainers@amazon.com](mailto:firecracker-maintainers@amazon.com).

When communicating within the Firecracker community, please mind our
[code of conduct](CODE_OF_CONDUCT.md).