[lambda_foo]

Shout out to https://github.com/samuelkarp/runj which aims to provide OCI compatible runtime for FreeBSD jails. We are working on a Jails based sandbox implementation for running OCaml builds on FreeBSD, https://github.com/ocurrent/obuilder. If runj gets more support then it would be a good alternative to the various iocage/ezjail/etc solutions or the raw Jails implementation we have right now.

[amtamt]

Does this OCI compatibility also translate to be able to run kubernetes on FreeBSD?

[sofixa]

Not necessarily, Kubernetes also needs a ton of other things which are Linux kernel specific, like cgroups.

If you're just looking for an orchestrator capable of running FreeBSD jails, take a look at Nomad (Disclaimer: I work at HashiCorp, opinions my own, etc.)

[pjmlp]

cgroups are mapped into Jobs on Windows.

There could be a similar kind of mapping on FreeBSD.

[plagiarist]

Thank you for the suggestion, I'm interested in checking it out.

How does Nomad handle scaling? I'm thinking of a new project, I'd like to have the equivalent of HPA that easily scales to zero on custom metrics and a cluster autoscaler that can easily add heterogenous nodes as necessary. Even better if it can work with MacOS VMs.

[sofixa]

Nomad supports all sorts of architectures and OSes, including M-series CPUs and MacOS. It can also scale to a lot, 2 million containers being tested. [0]

In terms of autoscaling there's the Nomad Autoscaler[1][2] that is super flexible, can get metrics from a bunch of sources, do custom queries, and perform actions (everything is via plugins, so even if your current stack isn't already supported, it's easy to add) like add extra nodes or add more instances of jobs.

0 - https://www.hashicorp.com/c2m

1 - https://developer.hashicorp.com/nomad/tools/autoscaling

2 - https://github.com/hashicorp/nomad-autoscaler

[plagiarist]

That sounds a lot like what I am looking for. Thank you for the links to reading material!