Apple Silicon M1 Chips and Docker

https://www.docker.com/blog/apple-silicon-m1-chips-and-docker/

by austinprete • 6 years ago

119 122 6 years ago

cosmotic• 6 years ago

This doesn't really clear up any of the questions I have.

Will docker running on ARM run docker containers from images built for x86? Will docker running on ARM be able to build images for x86?

dwaite• 6 years ago

Through QEMU

mistercorea6• 6 years ago

isnt that linux specific?

userbinator• 6 years ago

I wonder how long it will be until the Hackintosh community manages to boot macOS on a fully emulated ARM hardware.

There are already attempts in progress: https://news.ycombinator.com/item?id=25064593

mistercorea6• 6 years ago

Right. if it is building it's own linux kernel and build container it defeats the purpose of having a docker....

yjftsjthsd-h5• 6 years ago

Running docker containers on Darwin already required you to run a Linux kernel, though?

gilgoomesh2• 6 years ago

They mention using Apple's Hypervisor Framework. On Apple Silicon, this runs ARM64 programs only (Rosetta 2 is unavailable to programs running inside Apple's Hypervisor Framework).

https://developer.apple.com/documentation/apple_silicon/abou...

Unless they plan to run an emulator inside the Hypervisor Framework (a seemingly unnecessary effort since you could run the emulator without Hypervisor) this implies x86 containers will not work.

lights01232• 6 years ago

Docker for Mac already can build and run cross-arch containers: https://docs.docker.com/docker-for-mac/multi-arch/

And if you're on x86, you can run ARM containers with QEMU userspace emulation seamlessly after running

    docker run --rm --privileged docker/binfmt:a7996909642ee92942dcd6cff44b9b95f08dad64

The inverse would be extremely easy as well.

johnklos• 6 years ago

Answer your own question: Can Docker on ARM run x86? Can Docker on x86 run ARM?

If not, then why expect Apple ARM to run x86?

afandian3• 6 years ago

Apple ARM can run x86 under Rosetta 2. The question is whether that can happen under Docker.

DarmokJalad1701• 6 years ago

Can Docker on x86 run ARM

Yes. There are ways to set up Docker to seamlessly run arm containers on x86 using CPU emulation.

raverbashing2• 6 years ago

The question is: why even care?

Use an Arm image. For docker, it makes little to no difference

mistercorea6• 6 years ago

that mean you need to have an arm based server for deployment of your code / services.

yjftsjthsd-h5• 6 years ago

That requires that ARM images are available, which will take time and always have a disconnect. It also violates the idea of being able to run the exact same image on your laptop (ARM Mac) and in prod (x86 server).

ninkendo• 6 years ago

What are you going to deploy that ARM image to?

olliej2• 6 years ago

No. That's what they said: you will build for your deployment architecture, just as you would today with the arm aws systems. The virtualization is that: virtualization. It isn't emulation for that you need Qemu or similar.

joemaller1• 6 years ago

If Docker can run on Raspberry Pi's ARM chips, it can run on Mac ARM chips. I expect we'll see this working very soon after the new Macs start to arrive.

mistercorea6• 6 years ago

but you cant run x86 containers... https://blog.alexellis.io/5-things-docker-rpi/

lights01232• 6 years ago

By default, but one

    sudo apt install qemu-user-static
    # or
    docker run --rm --privileged aptman/qus -s -- -p    # (every reboot)

away and you can. It'll be slow, but it'll work.

afandian3• 6 years ago

Docker is architecture specific though. The meaningful question is whether it can run the same docker images as it did on the previous Mac hardware or not.

paxys7• 6 years ago

Docker uses Linux-specific containerization technology, so getting it to run on MacOS and Windows is a completely different beast of a problem.

happymellon5• 6 years ago

Docker runs in a Linux VM if you use Windows or Mac,and nothing will change that here.

The "different beast" is just some go wrappers.

lsllc• 6 years ago

Sounds a bit like Docker is at a loss. Caught between a closed source OS (rock) and an architecture change (hard place).

Ideally, they could leverage Rosetta2 to run x64 containers under macOS on Apple Silicon ... but I guess Apple isn't playing ball (because otherwise they would have probably announced it at WWDC).

At this point I see an Apple Silicon based Mac is just a consumer device, I don't think I'm going to be able to use it in anger for development work at the moment (other than for Mac consumer apps).

Not really sure what Apple have to lose here ... but if Macs with Apple Silicon are not a viable dev platform for "mainstream" containers, then that's going to drive developers to Linux (or Windows).

afandian3• 6 years ago

There's an ironic parallel in Docker referring to software as "content".

tasogare2• 6 years ago

Wait until parents refer their childs as DLC.

easton• 6 years ago

I think Apple didn’t want to support x86 emulation at all, and made Rosetta 2 purely AOT compilation (which you can’t really do with virtual machines). It makes it so they don’t have to deal with having x86 VMs available but super slow making people think that Apple Silicon is slow (even if that’s untrue), and that’s kind of the growing pain that Microsoft is going through at the moment with Windows on ARM.

anyfoo2• 6 years ago

Rosetta 2 purely AOT? Where did you get that idea from?

xenadu022• 6 years ago

Automatic translation of a hypervisor, guest kernel, and guest userspace is a far different level of difficulty than translating a userspace application.

Saying "didn't want to support" implies that one can "just" repurpose binary translation with a few build settings. You're off by several orders of magnitude.

crb0022• 6 years ago

AWS Graviton 2 ARM instances are more cost effective for most server loads. This is a gateway to saving a lot of cloud spend.

noelherrick• 6 years ago

I agree with you, but there's probably already been some pressure with people wanting to use Raspberry PIs/other ARM-based boards for K8s clusters. I wonder where that tipping point will come.

Anandtech's benchmarks: https://www.anandtech.com/show/15578/cloud-clash-amazon-grav... Here's a tweet about one company's experience: https://twitter.com/lizthegrey/status/1314618333140971521

mrtksn5• 6 years ago

At this point I see an Apple Silicon based Mac is just a consumer device

Not everyone runs Docker or similar to do their work.

If it turns out that Apple’s performance claims are true, I don’t see people easily letting it go, a snappy machine is a serious advantage. After all, we are in this deep trouble because of the endless layers of abstraction, so I don’t see it getting any speedier anytime soon for the status quo.

Amazing blank sheets could open on this news M1 macs.

The performance claims are substantial, it could mean 3000$ snappiness at 1000$. A bit like making cheap DSLR and now everyone is a professional photographer, making room for new tools for the new comers.

Mac prices are the gatekeeper for the Apple dev ecosystem in the developing world or students from low income background because most will try to get the best bang for their limited bucks. Maybe it’s possible to unlock it?

nl• 6 years ago

If Docker performance on Mac was a disincentive for using it, then people would have abandoned it because of the hypervisor instead of container architecture.

lowdose• 6 years ago

Mac prices are the gatekeeper for the Apple dev ecosystem in the developing world or students from low income background

Isn't the yearly $199 developers fee a greater gatekeeper by design for people with a low income from participating in Apples ecosystem?

pjmlp• 6 years ago

I have been coding for 30+ years, and am yet to run Docker in anger.

And by the looks of it, when I finally get to do some project with it, the language specific runtime tools like Project Tye for .NET would already have replaced it.

happymellon5• 6 years ago

Not sure what you are talking about, I do all sorts of Docker stuff on ARM (home lab Pi's and Graviton2 for work).

This is actually going to make it easier for me, as more ARM base images will get created.

hda111• 6 years ago

Docker Desktop is closed source on all platform it supports. It’s one of the reasons I don’t like to use it even on Windows. There is no way to report bugs (no one from dev team replies to it), and no bug fixes from the community are possible. When using containers nowadays I would keep everything open source, like LXC/LXD, Cri-O, Podman. All run perfectly fine on the Linux kernel that comes with Windows. Apple has to do something similar to WSL to make devs happy.

offtop53• 6 years ago

Can we give them a full month to sort this out ?

I want x64 docker on Arm , as this could also be massive for server power consumption. But things take time . If your some wiz kid who can crack this puzzle you’ll have a billion dollar startup within 6 months

As someone who’s published on the App Store , having a single binary run on IPhone , IPad and Mac is a much much bigger deal than most of you realize .

crb0022• 6 years ago

I don't want x86 Docker on ARM.

coding1232• 6 years ago

... so what, so no one else should be allowed to want it?

vbezhenar2• 6 years ago

What the point of docker if you can't just run single binary everywhere? That was its promise, right?

tw04• 6 years ago

Why? I would expect the user experience to suffer on one or both. MS already went down this path and the end result were apps that made compromises to try being usable on both platforms.

tpetry2• 6 years ago

And if some startup is doing it, i know enough companies who will instantly buy a better docker for mac solution if it does have better filesystem performance. Accessing the macs filesystem from the docker container is really slow, there are some solution (e.g. docker-sync) but they all stop working after some time.

hakre• 6 years ago

Is Apple still offering options that such kind of software could actually be developed by non-apple on _their_ system?

aparashk2• 6 years ago

What is the x64 on ARM opportunity in a bit more detail? What would drive a billion dollar valuation for such a business?

I would have thought that anything of lasting interest would be available in source code and thus ported to run natively on ARM...

offtop53• 6 years ago

Because years , if not decades of legacy server code could be ran on Arm without re-writing anything.

An EC2 rival could run the same processes using 30% of the power. Plus as ARM tends to run on much smaller devices, you could theoretically save tons of physical space with data centers.

hartator• 6 years ago

How many screw ups are we going to give Docker?

It has been since July that you can have developer kits for Apple Silicon. This should not have been a surprise.

tln• 6 years ago

I don't think this counts. The developer transition kit machines didn't support virtualization, aiui.

speg• 6 years ago

Gosh, it never occurred to me that the reason the UI was so bloated and slow was because it is using electron!

Why couldn’t they just write a quick set of native panels and call it a day? Sigh.

paxys7• 6 years ago

I use Docker for Mac every day and didn't even know there was a GUI.

Eric_WVGG• 6 years ago

Sigh. It was the first thing that occurred to me.

mistercorea6• 6 years ago

didnt they said they have faster browser rendering speed on M1?

justinsaccount• 6 years ago

Maybe building containers for one operating system and architecture from a completely different operating system and architecture is not the best idea.

paxys7• 6 years ago

How do you think people write and compile software for any embedded or other low-powered architecture out there? The vast majority of hardware in use around the world today isn't desktop class, and emulation works just fine for building on those.

tonyarkles• 6 years ago

Cross compilers are nowhere near the same as Docker on ARM Mac building x86 Linux containers. The biggest difference: no one expects you to be able to run your MIPS binary on the machine you built it on.

Edit: although sometimes you can through qemu.

hebetude• 6 years ago

Developer transition kit has been around for a while. Docker just found out they needed to buy those?

pilif2• 6 years ago

The DTK’s CPU lacked features that would have been required for docker to start working on their port

jannes• 6 years ago

The DTK was running an old iPad chip (without virtualisation support) instead of the new M1 chip (with virtualisation support).

trixie_• 6 years ago

Is this the beginning of application compatibility issues with M1?

Shank• 6 years ago

The really perplexing thing to me here is that Docker Desktop...was featured on stage at the Apple event. How? Did Apple just hack it together and get it working? Was it just fake? Was Docker involved at all?

I feel like it was implied that Apple was doing the hard work here, but now it looks more like nobody was doing the work, and showing it off working was a hat trick?

paxys7• 6 years ago

FYI "hat trick" has an entirely different meaning

moondev6• 6 years ago

https://i.imgur.com/bQb1grM.png

Makes you wonder what else was "simulated" during the demo?

kristianp• 6 years ago

From that image, the docker server could have been running in a Linux VM, and docker desktop connecting to that.

EDIT: change "was" to "could have been".

coding1232• 6 years ago

I think there are two questions I have:

Will I be able to build/run x86 (64bit) docker containers?

Will I be able to build/run ARM containers (and without "switching" something)?

moondev6• 6 years ago

Apple's "demo" showed Docker for mac running, complete with containers. https://i.imgur.com/bQb1grM.png

Docker here is saying their "for mac" application dependencies are not even all working yet.

Unless I am missing something - Apple's Docker on silicon demo was fabricated?

jjcm• 6 years ago

Docker is likely saying that it doesn’t natively run on ARM yet. Apple’s demo was likely using Rosetta. That said this is all speculation at this point. We’ll know tomorrow.

moondev6• 6 years ago

A Linux virtual machine is required to run Docker on macOS.

Linux containers need a Linux kernel to function.

ytch• 6 years ago

Docker on Mac needs hypervisor, but Apple says Rosetta 2 doesn't support x86 hypervisor [1]. Therefore it is not possible right now.

[1] https://developer.apple.com/documentation/apple_silicon/abou...

paxys7• 6 years ago

That screenshot shows a full Linux VM running on the machine using Parallels. That VM then has Docker running inside it. Docker for Mac isn't involved at all.

moondev6• 6 years ago

Look again - Docker for Mac control panel is clearly visible and "running" behind the VM window.

digianarchist• 6 years ago

Does docker-machine work? That’s what I’ve been using on my Ryzentosh.

paxys7• 6 years ago

Here's how I expect things to go with Docker on Apple Silicon:

- Rosetta 2 will not be involved at all

- They will recompile the CLI, daemon and other parts of Docker Desktop natively for arm64 (but this has a dependency on the Go toolchain)

- There will likely be a bunch of bugs or general inconsistencies in the new Mac Hypervisor (their dev hardware didn't even support virtualization), so it's unlikely that Docker's Hyperkit will just work out of the box on M1

- The above will take till mid-2021 at the earliest, but should hopefully release along with more "pro" Mac hardware

- Once it is ready, you should be able to cross-compile and run x86_64 containers on new Macs, considering Docker Desktop will still automatically use QEMU to do the emulation. I expect running native arm64 containers will still be better though.

TL;DR - don't buy the current lineup of Apple Silicon machines just yet for serious Docker work.

Disclaimer: These are all just guesses

sjtindell• 6 years ago

Your mention of “pro” makes me wonder - isn’t one of Apple’s big pushes to sell to professional designers, photographers, etc.? Don’t they realize that some huge percentage of engineers and tech workers use their macs? That’s a whole segment that quite literally builds and runs all the platforms where macs are advertised or talked about...where is the “pro” MacBook targeted at that segment? With advanced virtualization, strong dev tools, whatever. You would buy so much loyalty and word of mouth from people who set the standard for technology. Heck, who actually write the standards of technology.

tpetry2• 6 years ago

They are aware of it, thats the reason why the 15 inch macbook pro for example does not have apple silicon yet. They released the consumer hardware now so everyone has 1 year to port their tools to apple silicon until the bigger (more professionell) machines arrive.

jurip• 6 years ago

The showed Xcode multiple times during the M1 Mac release event and boasted about compile times so yeah, I'm pretty certain they do realize it.

thamer• 6 years ago

Both Electron and Go were referenced in the article but without links, so I went looking for them to understand how far along this work was. From the pages linked below it seems like with virtualization is the real challenge.

Here is a post saying that the latest beta release of Electron supports Apple Silicon: https://www.electronjs.org/blog/apple-silicon

And the GitHub issue tracking Go on AS, which mentions that support is coming in version 1.16 scheduled for release on Feb 1st 2021: https://github.com/golang/go/issues/38485

iends• 6 years ago

You don't need to wait for Go version 1.16, you can use gotip and compile for AS right now.

Electron 11 was released today and supports AS, but it is listed as experimental.

Would love to see an experimental docker for mac soon.

fulafel• 6 years ago

The virtualization apps for mac/win seem to be a big distraction for them and muddy their product image. Trying to hide ISA differences in the next version would be a logical continuation of this track of course... Maybe they should pivot to the WebAssembly direction thay the founder was talking about before.

neurostimulant• 6 years ago

Along with this, we have technical dependencies upstream of us that need to make changes prior to making a new version of Docker Desktop GA. We rely on things like Go for the backend of Docker Desktop and Electron for the Docker Dashboard to view your Desktop content. We know these projects are hard at work getting ready for M1 chips, and we are watching them closely.

The only time I used docker mac ui is to change some docker machine config. If electron is a blocker then I think they can release the beta version without the ui and their users will hardly notice.

Traubenfuchs• 6 years ago

Apple messed up by not engaging and assissting relevant software vendors with this change in time...

jaChEWAg• 6 years ago

Given there is a bunch of software that is still incompatible to run on the new chip, what are all the benchmarks actually testing? I'm not disregarding the fact that the chip is fast but I'm just curious

maxekman• 6 years ago

I would not be surprised if we will soon see a pretty big shift towards ARM on the server/cloud side as well.

Apple Silicon M1 Chips and Docker

Related Stories