nikisweeting

and the US famously never subsidizes any of its industries...

If you want an $18 DIY / open hardware version of this using an LED cube off amazon & WLED, here you go: https://github.com/pirate/led-cube-agent-monitor

Strong disagree, I use tools like DeepWiki, Mintlify, Cubic daily to analyze complex codebases. Their diagrams on PRs and generated docs have made it much easier to quickly drop into a complex codebase and understand how it works / make meaningful changes. Especially DeepWiki's diagrams + interactive "Deep Research" / Codemap feature are amazing at building flow diagrams to answer specific questions.

I recently did a complete rewrite of our browser driver codebase by deeply analyzing playwright, puppeteer, selenium, and the chromium source code, relying heavily on auto generated diagrams to decide which parts to read myself / dive deeper on. Yes they occasionally leave things out if the underlying codebase hides the complexity or has no docs, but they're great for thoroughly documented mature codebases.

I have never seen anyone pull off seccomp nested sandboxing of Chrome in Docker before, if you manage to figure it out please let me know!

Singlefile supports scoped recursive crawls too: https://github.com/gildas-lormeau/single-file-cli#:~:text=an...

I highly recommend reading the singlefile source or https://archiveweb.page/ to see how they handle closed shadow DOMs, cross-origin iframes, websockets, media urls, deduping large assets, etc.

Docker is designed to be undetectable by default, the best way I have found is to set env IN_DOCKER=True manually in your Dockerfile + check that there is no $DISPLAY configured + that you're on linux. Usually if all/most of those are true you can safely add --no-sandbox --disable-setuid-sandbox --disable-dev-shm-usage etc. all the docker-specific flags. Thats what we do in https://github.com/ArchiveBox/ArchiveBox/blob/dev/Dockerfile...

https://github.com/archiveteam/grab-site or browsertrix may be easier to use for some, it's what was used to save a lot of the data.gov stuff before it got taken down.

--no-sandbox is needed in docker, maybe they assume it will mostly run in docker?

I just added this to Lima recently, hopefully the macOS container machines support it too: https://github.com/lima-vm/lima/pull/4866

Very curious if they're implementing browser driving themselves or using an off-the-shelf library like stagehand, browser-use, etc. to drive the DOM. Hopefully they open source it if it's in Swift.

A11y-tree alone is not enough for many sites because lots of auth stuff happens in OOPIF frames that need special handling/stitching/interactive element filtering.

There's also the issues of many captchas around auth stuff being implemented using canvas elements (that are hard to instrument for browser agents without relying on CUA). Can their on-device 3B model really handle accurate CUA driving? I guess we'll see...

Sending 5 marketing emails with no unsubscribe link is not "operating in good faith", that's a blatant CAN-SPAM violation and could be used in a textbook explaining UX dark patterns.

I don't care what country they are from if after 15 years they cant figure out how to make a camera that doesn't reset its clock every time you recharge it.

Good riddance, GoPro squandered their market lead for many years and shipped bafflingly mediocre software that seemed to add more bugs with every generation.

I hope Insta360, DJI, and many more competitors spring up out of their ashes. Assuming fast microsd cards for writes, how much DDR RAM do they really need to buffer videos during recording? 4gb? 8gb?

Has anyone made something like this for jazz, classical, or hip-hop? The closest I know of are:

- https://www.music-map.com/ - https://everynoise.com/ - https://chartmetric.com/ - https://musicroamer.com/ - http://davidmckinney.com/app

But they're all kind of generic, I would love to see something more genre-specific with additional historic context and personality.

Historically tracking "which tab is in the foreground" has been impossible via CDP.

Libraries like Playwright and even Google's own puppeteer resorted to hacks like forcing users to foreground pages manually, or pretending "last opened == foreground".

After writing brittle state sync logic and workarounds for the last 2 years I got tired of dealing around this issue, so I contributed a fix upstream into Chromium!

Nice, I've been trying to learn assembly myself recently and built a little REPL to play around with it directly https://github.com/pirate/assembly-repl

But I've struggled with the IO parts, it seems every system is so different, it's hard to live without LLVM-IR as the middle layer abstracting away compiler and target differences.

Or even better: https://zfsbootmenu.org/

Oh nice, I just implemented something like this for installing from any package manager uv-style https://abxpkg.archivebox.io/, but I haven't added a "search" command yet, I should add that!

I've been excitedly following the development of Plain for a while now, it's so cool to see so many of the rough edges in Django get fixed in a nice comprehensive solution.

Great job Dave Gaeddert!

I'm saddened to see some of the other comments saying it's slop, he was working on this long before vibecoding became common! I think there's a lot of really good design decisions and I hope people don't write it off just because he's trying the "for agents" marketing approach lately.

You're off by at least 3 orders of magnitude, anodization is like 1,000x~5,000x thicker (5~25µm) than the natural oxide coating (~5nm).

Yes but anodization implies thickness around ~5–25 micrometers (µm) for aluminum. The natural oxide coating is ~2-5 nanometers (1,000–5,000× less thick).

gotta add vector search! that's the main benefit of these tools imo

I want to be able to search abstract concepts like "package" or "download" or "jazz" and see everything vaguely related like emojidb does.

We can definitely make harder evals, the problem is a good eval set is indistinguishable from good training data / market edge, so no one is incentivized to share their best eval sets publicly.

My friend is building something similar to Little Snitch but specialized for sandboxing agents / monitoring their traffic / building rulesets to restrict traffic by "learning" from good runs. https://greywall.io/

Curious who else is working on stuff like this / what other solutions exist that are like "Little Snitch" for agent network + filesystem calls.

This is so cool, just bookmarked it next to https://emojidb.org/ which is what I've been using in the past for vector-based emoji search.

Note pnpm does not have this flag yet, please upvote this issue if you want it added: https://github.com/pnpm/pnpm/issues/11224

Currently pnpm only supports setting this option via persistent config file, not per-run.

I always mispell it stenography by accident, just commenting so I can find this awesome post in search later when I inevitably type it wrong!

I believe the full docs are here: https://github.com/tursodatabase/turso/blob/main/docs/manual...

I have found this as well, FTSE5 is convenient to have as an option, but it's not as versatile as postgres or sonic or other full-text search solutions.

Does anyone have any other favorite modern bloom-filter-based search solutions that dont need to store copies of all the documents in the search db? Ideally something that can run in WASM too so we can ship a tiny search index to the browser. I found https://github.com/tinysearch/tinysearch but haven't tried it yet.

Surprised no one has mentioned Turso yet!

They recently landed multi-writer support for their rust SQLite re-implementation, which is personally the biggest issue I've had with using SQLite for high concurrency applications.

`PRAGMA journal_mode = 'mvcc';`

https://docs.turso.tech/tursodb/concurrent-writes

Very excited to see if SQLite responds by adding native support, I'm hoping competition here will spur improvements on both sides.