HN user

droelf

363 karma

I am Wolf, and involved with conda-forge and conda since a couple years now. So involved that I became the founder of prefix.dev where we are building `pixi` (pixi.sh) as the ultimate package manager / developer tool.

Posts42
Comments79
View on HN
prefix.dev 1mo ago

Local first and portable CI with Pixi

droelf
2pts1
prefix-dev.github.io 3mo ago

Book on building your own package manager in Rust

droelf
2pts0
prefix.dev 4mo ago

Packaging AI/ML Models as Conda Packages

droelf
1pts0
prefix.dev 4mo ago

Pixi GUI: modern alternative to Anaconda Navigator

droelf
12pts0
prefix.dev 5mo ago

Flickzeug: a Rust crate for applying messy real-world patches

droelf
2pts0
prefix.dev 9mo ago

Pixi: Reproducible Package Management for Robotics

droelf
46pts19
blog.jupyter.org 1y ago

Interactive C/C++ in the browser with WASM and JupyterLite

droelf
6pts0
prefix.dev 1y ago

Making compiled software relocatable: How Conda handles hardcoded paths

droelf
11pts0
prefix.dev 1y ago

S3 support for Conda packages in Pixi

droelf
4pts0
prefix.dev 1y ago

Pixi global: install dev tools declaratively

droelf
5pts0
prefix.dev 1y ago

WASM and Conda: Revolutionizing Scientific Computing in the Browser

droelf
5pts0
prefix.dev 1y ago

Pixi – rust-based package manager for reproducible scientific workflows

droelf
24pts5
twitter.com 1y ago

Pixi-pdf – make research PDFs reproducible and "executable"

droelf
5pts0
prefix.dev 2y ago

50x faster conda environment solving with "sharded" repodata

droelf
5pts0
prefix.dev 2y ago

Reasons to Switch from Conda to Pixi

droelf
4pts0
prefix.dev 2y ago

Adopting `uv` into `pixi` for a fast conda and pip experience

droelf
11pts2
prefix.dev 2y ago

Py-rattler, Rust based Python library to create conda environments fast

droelf
7pts0
prefix.dev 2y ago

Rip – Rust crate to resolve and install Python packages

droelf
135pts36
cfp.packaging-con.org 2y ago

The PackagingCon schedule is published

droelf
2pts0
prefix.dev 2y ago

Pixi – solving dependency hell with Rust

droelf
13pts0
prefix.dev 2y ago

A new memory-safe SAT solver for package management in Rust (port of libsolv)

droelf
9pts0
packaging-con.org 2y ago

PackagingCon – A conference only for software package management

droelf
189pts155
prefix.dev 3y ago

Rattler-build: a relocatable binary package builder

droelf
9pts0
prefix.dev 3y ago

Show HN: Package Management in the Cloud with Prefix.dev

droelf
18pts0
prefix.dev 3y ago

Thoughts on upper bounds for Python dependencies – conda-forge vs. PyPI

droelf
2pts1
pretalx.com 4y ago

PackagingCon Happening Tomorrow

droelf
5pts2
packaging-con.org 4y ago

Talks for PackagingCon Are Published

droelf
6pts0
packaging-con.org 4y ago

Packaging Con 2021: a conference for package management devs and communities

droelf
108pts38
medium.com 6y ago

Scikit-Geometry

droelf
2pts0
wolfv.github.io 6y ago

Ipywidgets Get Drag'n'drop Support

droelf
1pts0

I think for a small configuration TOML might be fine. Where it breaks down in my opinion is in larger configuration files. It just becomes pretty unreadable.

Think about a Github Action being written in TOML ... would probably not look great!

We've been working on Pixi, which uses Conda packages. You can control versions precisely and also easily build your own software into a package to ship it. Would be curious to chat if it could be useful as an alternative to `mise`.

We've been building `pixi` and more specifically "pixi global" as a replacement for homebrew, but based on Conda packages. It creates a single virtual environment per globally installed tool (deduplication works by hard-linking) and then links out the binaries from the isolated environments to a single place.

It's written in Rust and quite fast: https://pixi.sh

I think this is really cool. We're tackling this problem from the other side by building `pixi` (pixi.sh) which bundles project / package management with a task runner so that any CI should be as simple as `pixi run test` and easy to execute locally or in the cloud.

Thanks for bringing up conda. We're definitely trying to paint this vision as well with `pixi` (https://pixi.sh) - which is a modern package manager, written in Rust, but using the Conda ecosystem under the hood.

It follows more of a project based approach, comes with lockfiles and a lightweight task system. But we're building it up for much bigger tasks as well (`pixi build` will be a bit like Bazel for cross-platform, cross-language software building tasks).

While I agree that conda has many short-comings, the fundamental packages are alright and there is a huge community keeping the fully open source (conda-forge) distribution running nicely.

We've been working on all the shortcomings in `pixi`: pixi.sh

It's very fast, comes with lockfiles and a project-based approach. Also comes with a `global` mode where you can install tools into sandboxed environments.

Cool that this space is getting more attention - I just came from the reproducible builds summit in Hamburg. We're working on similar low level build system tools with rattler-build and pixi. Would love to have a chat and potentially figure out if collaboration is possible.

We're working on rattler-build (https://github.com/prefix-dev/rattler-build/) - which is a build system inspired by Apko / conda-build and uses YAML files to statically define dependencies. It works really well with pixi (our package manager) but also any other conda compatible package managers (mamba, conda).

And it has Windows support, of course. It can also be used to build your own distribution (e.g. here is one for a bunch of Rust utilities: https://github.com/wolfv/rust-forge)

That is a valid criticism. Although I personally have seen Spack come up mostly in HPC workloads which is a bit more specialized. There are many disciplines that might not need the "full power" of something like Spack (e.g. source builds) but just need to setup some computational tooling for computational biology research, physics, etc.

Resolvo (the SAT solver here) has been really good for us. It helped make some conda-forge bots up to 10x faster than the previous C-based solver (libsolv) while being memory safe.

The specific bot tests went from taking 60 minutes to ~6 minutes which is quite remarkable.

We'll build some features sooner or later on the repository side that are going to be interesting for enterprise customers.

But we have a strong and true commitment to open source. A non-open-source package manager would definitely not work for our community!