- Description:
- Firecracker with the chroot.dev fixes, branch chroot
- Last Change:
- Clone URL:
ssh://anon@got.v6.chroot.run/firecracker
- ED25519:
SHA256:7587EKj+viWIfWGzPGNqUFSdFEh83CZFaqnwaoNmcNc
Commit Briefs
CHANGELOG: Mention PCIe hotplug auto-discovery (ilstam-hotplug-4)
Add a new bullet point drawing attention to the new hotplug auto-discovery feature. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>
docs: Amend native PCIe hot-plug documentation
Now that Firecracker supports auto-discovery of hot-plugged devices amend the documentation to explain how the feature works. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>
test_hotplug: Test forced and graceful unplug (ilstam-hotplug-3)
Add new hotplugging test cases that cover: - a forced unplug, which drops the device without waiting for the guest, next to a graceful one, which does not - two unplug requests in a row, where a second Attention Button press would make the guest cancel the removal - plug and unplug requests issued while the VM is paused, which only the resumed guest can act on - unplugging devices that were hot-plugged before a snapshot, and a graceful unplug still pending when the snapshot is taken, which the restored VM has to complete - hot-plugging when no root ports are available Signed-off-by: Ilias Stamatis <ilstam@amazon.com>
tests: Remove manual bus rescan from PCIe hotplug tests
Without native PCIe hotplugging support all integration tests relied on manual bus rescanning from the guest. Now that PCIe auto-discovery works adjust all tests accordingly. Note that Linux's pciehp driver sleeps after a hot-plug and hot-unplug so the integration tests take that into account. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>
pci: Snapshot and restore PCIe root port state
Implement save/restore for root ports and add a unit test to test it. PciConfiguration::type0_from_state() doesn't seem to be specific to type 0 devices, so rename it to PciConfiguration::from_state(). Signed-off-by: Ilias Stamatis <ilstam@amazon.com>
pci: root_port: Add unit tests for graceful and forced hot-unplug
Cover the reporting of the guest acknowledgement, a forced removal expecting no acknowledgement, and a retried unplug request not pressing the Attention Button a second time. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>
pci: Implement graceful PCIe hot-unplug
Removing a device has so far been a surprise removal. The device simply went away with unpredictable consequences for the guest which could have still been using it. A previous commit added a 'force' option to unplug requests. Make 'graceful detach' be the default behaviour. When force is not set the guest is notified and Firecracker waits for a guest acknowledgement before removing the device. When force is set, then the device is removed immediately. In either case the DELETE request is non-blocking. Since the guest ack is delivered to a vCPU thread and the device removal needs to happen in the main thread, a new HotplugCompletion struct with an eventfd is introduced. A root port can use the eventfd to notify the main thread of device removal acknowledgements and the VMM thread processes the removals in its event loop. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>
api: Add a 'force' option to device hot-unplug
Make device DELETE take an optional body with a single 'force' flag. When not set, the detach is meant to be graceful; the guest is notified and Firecracker waits for a guest acknowledgement before removing the device. When force is set, then the device is removed immediately. In either case the DELETE request is non-blocking. The DELETE endpoints had no Swagger description at all, so document them along with the new body. Only the parsing and plumbing are done in this commit, graceful detach is not implemented yet, all unplugs are still in 'force' mode. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>
pci: Reject hot-unplug of devices not behind a root port
Removal has so far been allowed for any non-root device. However, for devices not behind a root port there's no way to notify the guest of an upcoming removal. Reject the unplug request in that case. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>
pci: Place hot-plugged devices behind PCIe root ports
Introduce a new PciPlacement enum describing whether a device must be plugged to the primary bus or to a root port / secondary bus. Place devices added after boot in a free root port slot rather than directly on the root bus, and signal the insertion so the guest can discover them. On removal signal the guest that the port slot is empty. This eliminate the need for manually re-scaning the PCI bus from inside the guest after hot-plugging a device. Note that attach_common() calls PciRootPort::plug() with hotplug=false, because that function is called on snapshot restore and we should not inject spurious notifications to the guest. In case of a real hotplug, hotplug_device() also calls PciRootPort::plug() with hotplug=true to actually inject the interrupt. Also note that the hot-detach is still not "graceful", i.e. the guest is not given the chance to react. Subsequent commits will introduce separate graceful/forced detach options. Signed-off-by: Ilias Stamatis <ilstam@amazon.com>
Branches
Tree
README.md
<picture>
<source media="(prefers-color-scheme: dark)" srcset="docs/images/fc_logo_full_transparent-bg_white-fg.png">
<source media="(prefers-color-scheme: light)" srcset="docs/images/fc_logo_full_transparent-bg.png">
<img alt="Firecracker Logo Title" width="750" src="docs/images/fc_logo_full_transparent-bg.png">
</picture>
Our mission is to enable secure, multi-tenant, minimal-overhead execution of
container and function workloads.
Read more about the Firecracker Charter [here](CHARTER.md).
## What is Firecracker?
Firecracker is an open source virtualization technology that is purpose-built
for creating and managing secure, multi-tenant container and function-based
services that provide serverless operational models. Firecracker runs workloads
in lightweight virtual machines, called microVMs, which combine the security and
isolation properties provided by hardware virtualization technology with the
speed and flexibility of containers.
## Overview
The main component of Firecracker is a virtual machine monitor (VMM) that uses
the Linux Kernel Virtual Machine (KVM) to create and run microVMs. Firecracker
has a minimalist design. It excludes unnecessary devices and guest-facing
functionality to reduce the memory footprint and attack surface area of each
microVM. This improves security, decreases the startup time, and increases
hardware utilization. Firecracker has also been integrated in container
runtimes, for example
[Kata Containers](https://github.com/kata-containers/kata-containers) and
[Flintlock](https://github.com/liquidmetal-dev/flintlock).
Firecracker was developed at Amazon Web Services to accelerate the speed and
efficiency of services like [AWS Lambda](https://aws.amazon.com/lambda/) and
[AWS Fargate](https://aws.amazon.com/fargate/). Firecracker is open sourced
under [Apache version 2.0](LICENSE).
To read more about Firecracker, check out
[firecracker-microvm.io](https://firecracker-microvm.github.io).
## Getting Started
To get started with Firecracker, download the latest
[release](https://github.com/firecracker-microvm/firecracker/releases) binaries
or build it from source.
You can build Firecracker on any Unix/Linux system that has Docker running (we
use a development container) and `bash` installed, as follows:
```bash
git clone https://github.com/firecracker-microvm/firecracker
cd firecracker
tools/devtool build
toolchain="$(uname -m)-unknown-linux-musl"
```
The Firecracker binary will be placed at
`build/cargo_target/${toolchain}/debug/firecracker`. For more information on
building, testing, and running Firecracker, go to the
[quickstart guide](docs/getting-started.md).
The overall security of Firecracker microVMs, including the ability to meet the
criteria for safe multi-tenant computing, depends on a well configured Linux
host operating system. A configuration that we believe meets this bar is
included in [the production host setup document](docs/prod-host-setup.md).
## Contributing
Firecracker is already running production workloads within AWS, but it's still
Day 1 on the journey guided by our [mission](CHARTER.md). There's a lot more to
build and we welcome all contributions.
To contribute to Firecracker, check out the development setup section in the
[getting started guide](docs/getting-started.md) and then the Firecracker
[contribution guidelines](CONTRIBUTING.md).
## Releases
New Firecracker versions are released via the GitHub repository
[releases](https://github.com/firecracker-microvm/firecracker/releases) page,
typically every two or three months. A history of changes is recorded in our
[changelog](CHANGELOG.md).
The Firecracker release policy is detailed [here](docs/RELEASE_POLICY.md).
## Design
Firecracker's overall architecture is described in
[the design document](docs/design.md).
## Features & Capabilities
Firecracker consists of a single micro Virtual Machine Manager process that
exposes an API endpoint to the host once started. The API is
[specified in OpenAPI format](src/firecracker/swagger/firecracker.yaml). Read
more about it in the [API docs](docs/api_requests).
The **API endpoint** can be used to:
- Configure the microvm by:
- Setting the number of vCPUs (the default is 1).
- Setting the memory size (the default is 128 MiB).
- Configuring a [CPU template](docs/cpu_templates/cpu-templates.md).
- Add one or more network interfaces to the microVM.
- Add one or more read-write or read-only disks to the microVM, each represented
by a file-backed block device.
- Trigger a block device re-scan while the guest is running. This enables the
guest OS to pick up size changes to the block device's backing file.
- Change the backing file for a block device, before or after the guest boots.
- Configure rate limiters for virtio devices which can limit the bandwidth,
operations per second, or both.
- Configure the logging and metric system.
- `[BETA]` Configure the data tree of the guest-facing metadata service. The
service is only available to the guest if this resource is configured.
- Add a [vsock socket](docs/vsock.md) to the microVM.
- Add a [entropy device](docs/entropy.md) to the microVM.
- Add a [pmem device](docs/pmem.md) to the microVM.
- Configure and manage [memory hotplugging](docs/memory-hotplug.md).
- `[Developer Preview]` [Hot-plug and hot-unplug](docs/device-hotplug.md) virtio
PCI devices while the VM is running.
- Start the microVM using a given kernel image, root file system, and boot
arguments.
- [x86_64 only] Stop the microVM.
**Built-in Capabilities**:
- Demand fault paging and CPU oversubscription enabled by default.
- Advanced, thread-specific seccomp filters for enhanced security.
- [Jailer](docs/jailer.md) process for starting Firecracker in production
scenarios; applies a cgroup/namespace isolation barrier and then drops
privileges.
## Tested platforms
We test all combinations of:
| Instance | Host OS & Kernel | Guest Rootfs | Guest Kernel |
| :------------------------------------------ | :---------------- | :----------- | :----------- |
| m5n.metal (Intel Cascade Lake) | al2 linux_5.10 | ubuntu 24.04 | linux_5.10 |
| m6i.metal (Intel Ice Lake) | al2023 linux_6.1 | | linux_6.1 |
| | al2023 linux_6.18 | | |
| m7i.metal-24xl (Intel Sapphire Rapids) | | | |
| m7i.metal-48xl (Intel Sapphire Rapids) | | | |
| **m8i.metal-48xl (Intel Granite Rapids)\*** | | | |
| **m8i.metal-96xl (Intel Granite Rapids)\*** | | | |
| m6a.metal (AMD Milan) | | | |
| m7a.metal-48xl (AMD Genoa) | | | |
| m6g.metal (Graviton 2) | | | |
| m7g.metal (Graviton 3) | | | |
| m8g.metal-24xl (Graviton 4) | | | |
| m8g.metal-48xl (Graviton 4) | | | |
| m9g.metal-48xl (Graviton 5) | | | |
**\***: We **only** support AWS EC2 8th Gen Intel (\*8i) instances using a 6.1
or 6.18 host kernel. This is due to poor kernel support for Granite Rapids CPUs
on 5.10.
## Known issues and Limitations
- The `pl031` RTC device on aarch64 does not support interrupts, so guest
programs which use an RTC alarm (e.g. `hwclock`) will not work.
## Performance
Firecracker's performance characteristics are listed as part of the
[specification documentation](SPECIFICATION.md). All specifications are a part
of our commitment to supporting container and function workloads in serverless
operational models, and are therefore enforced via continuous integration
testing.
## Policy for Security Disclosures
The security of Firecracker is our top priority. If you suspect you have
uncovered a vulnerability, contact us privately, as outlined in our
[security policy document](SECURITY.md); we will immediately prioritize your
disclosure.
## FAQ & Contact
Frequently asked questions are collected in our [FAQ doc](FAQ.md).
You can get in touch with the Firecracker community in the following ways:
- Security-related issues, see our [security policy document](SECURITY.md).
- Chat with us on our
[Slack workspace](https://join.slack.com/t/firecracker-microvm/shared_invite/zt-3v81btcpe-usCf8Qk7k1gUlSAEKKdYMg)
_Note: most of the maintainers are on a European time zone._
- Open a GitHub issue in this repository.
- Email the maintainers at
[firecracker-maintainers@amazon.com](mailto:firecracker-maintainers@amazon.com).
When communicating within the Firecracker community, please mind our
[code of conduct](CODE_OF_CONDUCT.md).