CI for the Debian Linux kernel team

https://www.decadent.org.uk/ben/blog/ci-for-the-debian-kernel-team.html

by pabs3 • 4 years ago

58 9 4 years ago

decadent.org.uk

mthld• 4 years ago

It’s been a while since I didn’t visited a website not mobile-ready… Hopefully reader-mode works as expected.

maccard3• 4 years ago

Salsa's shared CI runners seem to be about 10 times slower than that, so it is completely unfeasible to even one full build in CI.

I maintain the CI&D pipeline for my ~3 million LOC c++ project (plus a handful of non c++ components for online services), and this hits hard. None of the existing services are designed for building large projects, and all really require custom work to maintain.

It's really quite painful and a big barrier to adoption of modern best practices. I would love it if there were services we could utilise to speed up these builds (like a hosted networked ccache, preferably one that runs on Windows too for us).

gjvc3• 4 years ago

IncrediBuild / https://www.incredibuild.com/free-trial

maccard3• 4 years ago

An incredubuild build farm is certainly a solution, but definitely not an out of the box solution, and it requires some pretty serious cash. Off the top of my head, an agent license is $1500/year, plus $300 per seat (including each of your build requesters). If you're on Windows you also have to pay the windows server per core licensing

It doesn't "burst" like cloud (so you pay annual licensing on your peak usage), and your build system needs to support it. It's almost certainly going to be cheaper (and likely easier to manage) to use the fattest server you can find over incredibuild.

That said, if you are in an office with 10/100Gb cabling, and money is no object, giving developers an 8 core i9, backing them up with incredibuild and local linking is an incredible workflow to provide.

Havoc• 4 years ago

The linux package also takes a lot of resources to build; around 80 minutes on the fastest PC I have at home

I was under the impression some of the bigger kernel teams have access to large amounts of cloud power. Is that only at kernel upstream level (rather than the distro's kernel team)?

CI for the Debian Linux kernel team

Related Stories