HN user
erik -at- erikwickstrom -dot- com
Thanks for releasing this! How do you handle DDL queries? Are table changes synchronized to the Iceberg table automatically?
Also, I recently started looking into olake[0] to serve the same purpose. What would you say differentiates Streambed?
How does Lakebase compare to Ducklake[0]?
I’ve had very good experience with it last year. I used it at large scale with data that had been in iceberg previously and it worked flawlessly. It’s only improved since. Highly recommend.
Simon Willison wrote a good post about Dan Woods’ work on “Autoresearching Apple's "LLM in a Flash" to run Qwen 397B locally”.
I use them both depending on which feels more natural for the task, often within the same project. The interop is easy and very high performance thanks to Apache Arrow: `df = duckdb.sql(sql).pl()` and `result = duckdb.sql("SELECT * FROM df")`.
Link to the lectures?
Data inlining is also currently limited to only the DuckDB catalog (ie it doesn't work with Postgres cataglogs)[0]. It's improving very quickly though and I'm sure this will be expanded soon.
[0] https://ducklake.select/docs/stable/duckdb/advanced_features...
This looks really useful! Am I correct that there isn’t an S3 compatible API, just the “fetch” API?
Being able to set an S3 client’s endpoint to proxy traffic straight through this would be quite useful.
I’ve started using Granian[0] recently with good results.
I've used SikuliX[0] in the past for similar purposes. Unfortunately the author hasn't had much time to maintain it recently.
I've always wished that there was an option to whitelist certain area codes. I've had the same number for 20 years, and now live in a different part of the country. I get very little spam from local area codes -- but a ton spoofing my phone number's area code. Sending all calls all those calls to voicemail while continuing to ring for local would be the right balance (kids' school, doctors office, etc...).
I thought my ThermoWorks Signal had a dead/defective battery after trying to charge it on a standard USB power adapter. Device booted up and and functioned fine, except the battery wouldn't charge. Plugged it into the provided adapter and it started charging again.
Thanks for the PSA, I'll be sure to get that adapter off my kitchen counter right away!
I’ve been meaning to find time to get ruff-lap working on Doom Emacs side by side with pyright. Is anyone who’s already managed to get it working willing to share their config?
How about the Relational API[0] or the new PySpark compatible API[1] added in this release?
[0] https://duckdb.org/docs/archive/0.8.1/api/python/relational_... [1] https://github.com/duckdb/duckdb/pull/8083
I'd love something like dd-wrt but for these cloud cameras. I have some Arlo cameras that I'd love to re-flash and run without the cloud service.
After stumbling upon this, I’ve been obsessively looking for an excuse to drill a well[0].
Perhaps as a profit center to the tea industry. Most tea bags contain the grades of tea that can't be sold in the more expensive loose leaf form. Basically leaf fragments and dust. That material would otherwise be a waste product.
I’ve been using it to great effect for the last year or so. It really is a breath of fresh air. In my case, I’m using a Django backend, but there are lots of successful folks using other backend stacks as well so choose what you know best.
The book is a really quick and easy read. It’s pretty eye opening how productive, and effective, htmx can be with so little magic.
Ideally you’d used Parquet or ORC if querying from Athena/Trino/Presto. Since they are columnar formats you will enjoy considerably faster queues and lower query costs for most query patterns other than “select *…” since the query engine can just retrieve the columns needed for your query instead of the entire row.
I was experimenting with the Warp terminal for the first time last week. It includes a similar feature. I was pretty impressed with how well it worked.
I just tried polars for this first time this week. I ported a data pipeline from pandas and I was blown away by the performance yield. Function went from a 60 min runtime with pandas to ~1:30 in polars!
I’ve been using pandas for years and had no issues picking up the syntax. Can’t recommend giving it a try enough.
I recently inherited a codebase that uses Pony ORM[0]. Might be worth taking a look if you want your interactions to look as similar to vanilla python expressions as possible.
One of the features I like in ES that I haven’t seen in alternatives is “Percolate queries” (queries where you feed the service a document and it returns a list of queries that you’ve indexed that would match that document - basically inverting the whole process).
Does anyone know of any alternatives that support this use case?
https://www.elastic.co/guide/en/elasticsearch/reference/mast...
Does anyone have any comparable experience using FTS in DuckDB?
I’ve been using hammerspoon for several years and it has really become integral to my workflow.
You may want to check out the extension package spacehammer[0]. It includes a bunch of workflows and shortcuts that I’ve found extremely useful.
Interestingly (for me at least), it’s authored in Fennel [1], a lisp that compiles to lua. I actually found spacehammer originally when I was working on converting my personal hammerspoon config to Fennel.
According to the README, this also works with DDG and some other search engines.
RabbitMQ is a more natural alternative to SQS than Kafka I’d say. Redis can also be leveraged as a message broker depending on your needs.
That’s interesting. Can you go into a little more detail as to how non-tech contributors are participating?
I like Ken Forkish’s “Flour Water Salt Yeast: The Fundamentals of Artisan Bread and Pizza”