HN user
My experience is that neither has a good UX for what I usually try to do with coding agents. The main problem I see is setup/teardown of the boxes and managing tools inside them.
I was part of a team that does the same thing. Arguably as a paid service, but source availability and meaningful attestation.
Service: https://www.privatemode.ai/ Code: https://github.com/edgelesssys/privatemode-public
Edgeless Systems | Software Engineer - Confidential Computing and AI | REMOTE (EU) - Office in Berlin & Bochum (GER) | Full-time
We are a team of ~20 people, building open source software to make confidential computing more usable. To achieve this we have built multiple products, most of which you can find on our Github page (https://github.com/edgelesssys/). You won't find our AI product there, best way to learn about it are the docs (https://docs.privatemode.ai/).
Our products span unusually far across the tech stack, starting at measured boot, through Kubernetes operators, finishing somewhere in our JavaScript frontend. We don't expect you to do all of it - these are just possibilities.
Tech stack: Go (mostly), Rust (some), JavaScript (some), Nix / NixOS, Kubernetes, Terraform, vLLM, AMD SEV-SNP, Intel TDX.
Website: https://www.edgeless.systems/ Contact: Apply via the posting on our careers page and please mention that you come from HN. Also feel free to email me via ob [at] edgeless.systems in case of any questions.
There are startups building solutions like PCC. They all leverage confidential computing to do so. Decentriq, Opaque, Anjuna, Edgeless Systems (multiple OSS projects) come to mind.
disclaimer: I work for one.
Apple's secure enclave docs also mention memory encryption. The PCC blogpost mentions that the server hardware is built on secure enclaves. And since they are claiming that even Apple can't access it, I am currently assuming that there will be memory encryption happening on the servers. At which point you have have the main ingredients of CC: memory encryption & remote attestation.
EDIT: and they mention SGX and Nitro. Other CC technologies :)
Constellation (a Kubernetes distro) [1] on Azure would give you this attestation feature. You could then run sth like HashiCorp's Vault in that cluster. You will know that all nodes of that cluster are in the state that you expect them to be through the attestation statement.
[1] https://github.com/edgelesssys/constellation
Disclaimer: I work for Edgeless Systems.
5mins later: WAIT, YOU FORGOT ALL THESE 20 RUNS!!!!