HN user

exergy

9 karma
Posts1
Comments336
View on HN

A managed iceberg service, marketed as a new S3 bucket type.

I thought AWS was dropping the ball on Open Table Formats, but this one is a smart move and a direct shot fired at Databricks with Delta.

Simply by making it the default for software engineers wanting a big data table on S3

there is Ibis[0] as a fairly mature package. They recently adopted duckdb as the default execution engine and it can give you a nice python dataframe API ontop of duckdb, with hot-swappability towards heavier engines.

With tools like this providing a comprehensive python API and the ability to always fall back to raw SQL, i am not sure DuckDB devs should focus on the python API at all beyond basic (to_table, from_table) features.

Impressive progress and a real chance to shake up the data tool market, but still a way to go: There is is still much to do especially on large table formats (iceberg/delta) and memory management when running on bigger boxes on cloud. Eg the elusive "Failed to allocate ..." bug[1] is an inhibitor to the claim that big data is dead[2]. As it is, we tried and abandoned DuckDB as a cheaper replacement for some databricks batch jobs.

[0] https://github.com/ibis-project/ibis [1] https://github.com/duckdb/duckdb/issues/12667, https://github.com/duckdb/duckdb/issues/9880, https://github.com/duckdb/duckdb/issues/12528 [2] https://motherduck.com/blog/big-data-is-dead/

DuckDB 0.9 3 years ago

We use duckdb-wasm as an in-browser telemetry store for an IoT use case. beats the performance of other data stores in your browser and much simpler than manually wrangling arrays

DuckDB also has potential for IoT/embedded use cases as a data buffer with its compression and efficient reads, instead of just sqlite. but for that it needs to free up disk after expiring data

Ah, no, I have the opposite problem!

For instance, musicians one really likes, one projects them into images of saints. Then they're out their putting selfies on, sharing insipid quotes or just generally seeking validation, and the mirage crumbles a bit.

Rubbish drivel. It's a trend nowadays for people to write longform articles purporting to lay bare some great truths but really are just an excuse for the author to regurgitate some recent things they read. It really rubs me the wrong way.

First of all, the unnecessary mention of "mostly white male". I'm So. Bloody. Tired of this trope being injected into every article at every opportunity. I get it. Life unfair. Move on. It's like how every NYT comment section will mention Trump within the first two comments. Give it a rest already!

Then, the vague-at-best connections between minimal art and Minimalism as a response to the excesses of Boomers. It's really not that complicated. Grow up in a house of hoarders, and you're well on your way to embracing minimalism.

Lastly, this whole "Your bedroom might be cleaner, but the world stays bad". Yeah! Minimalism doesn't promise world peace! It's just a way to make your own life more manageable and sane!

Just because a piece is longform doesn't mean it's good. Reading this article was a terrible waste of my time.

Mainly laziness and entertainment. If I was indeed buying one tomorrow, I'd spend a lot more time reading people's experiences on Reddit, for instance. But just for watching tech reviews while I eat dinner or something, I sure wish there were programmers out there making videos for that audience.

Exactly. I'm constantly needled by the fact that there isn't a single Youtube reviewer who is a full-time programmer. Or at least someone not in the "creative" domains. At least none of the big names are. It's always Nvidia this and Premiere Pro rendering times that and SD card slot whatever.

Fine, but where are the people who will spend ten minutes talking about the different keyboard options they considered for their daily driver? Where are the people who have to read code for a living and will openly mock 16:9 with it's pathetic vertical space? Talking about how easy it is to dual boot Linux on the machine?

If anyone knows of such reviewers, please drop a link below. I'm sick of wathching MKBHD.

I wouldn't care as much if it didn't constantly become harder and harder to find other like-minded people. People don't seem to enjoy not having their phones out, not photographing everything, not optimising relentlessly. The world of today is wearisome.

Exactly. And that's why the UK is especially stupid with units. At least in the US they are consistently idiotic with Fahrenheit and Miles and BTUs and so on. In the UK, they understand what a kilogram is, but measure weight in stones anyway. Fucking stones! And then this thing with yards and miles.

Utterly hopeless.

Abuse is a heavily loaded word, and as an aside, I hate the cheapening of language in modern times. Assault is another that's getting cheapened. Someone bluntly telling another "you're dead wrong" isn't abuse IMO.

But to your main point, I've seen my share of the polite leading the polite. If there is a general level of competence, fine, work can still proceed. But often, workplaces need an asshole who will voice their opinion in blunt language. There are moments when diplomacy causes, at best, avoidable delays, but at worst completely fucked projects.

Yeah I know. People bring up r/science and the history subreddits all the time. And you're right, they do stick to the topic. The trouble is that they're both very siloed. If you don't like those topics all the time, you have to go elsewhere. Hence my comment on signal to noise.

Totally agree about the no humour thing on HN though.

Couldn't disagree more. If I want fun, I'd watch some comedian on YouTube, way higher quality. If I wanted serious discussion, Reddit has too much noise for the signal that it does offer.

The Reddit of today is about posting the "funniest" screenshots from Twitter, things like blackpeopletwitter, whitepeopletwitter, murderedbywords and so on.

Yep.

Much as I rail against the overly pedantic nature of many, many comments here, this place is a veritable treasure trove compared to Reddit.

On Reddit, every single fucking thread gets derailed by shitty puns, basement-tier humour or a one-liner with all the nuance of a tweet. Doesn't matter how sombre a topic, some dickhead is going to make an oh-so-clever quip and legions of fellow dickheads will line up to suck his dick and upvote it to the top.

Even when there are substantive comments, the replies to those comments rarely make for useful reading.

"Take my upvote and fuck off"

"Nice"

"Mom's spaghetti"

"/r/Suicidebywords" on a comment about dick sizes

... and on and on

Not to mention the fact that Reddit's recent algorithms upvote the shittiest content to the front page to begin with. I mean, /r/dankmemes? /r/memeeconomy? /r/wholesome memes? Fuck outta here with that shit.

There are exceptions, of course. /r/financialindependence comes to mind. But overall, it's become an out of control shitshow that I visit ever less frequently.

So yeah, thank god for HN.

No to Chrome 7 years ago

To avoid deep binges into youtube. First of all, youtube thumbnails are cancer anyway, so blocking them is one step towards a Lower Information Diet. And the first step to being able to quit any addictions to youtube.

A dictionary? I mean, that's neat and all, but not all that useful is it? I might check the weather once a day, tops. This is better solved by having a widget on my smartphone. Same for the dictionary, and same for short google searches too (Firefox Focus).

I had a twinge of hope that this might have been more of an introduction to using the terminal effectively on Linux for diagnoses.

I'm new to Linux, and every time I have an issue and find a thread addressing it, they ask for me to run a whole bunch of commands and paste a bunch of logs. I'm happy to do that, don't get me wrong, but I rarely have the faintest idea of what it is that I'm typing in.

Moreover, I think of it like how I think of clothes. You dress well not just for yourself but also as a mark of respect to those whom you're about to meet. Properly typed posts convey similar respect.

Also, sorry to invoke the slippery slope argument, but otherwise what's stopping us from devolving all the way back to scriptura continua?

[dead] 7 years ago

How does one read something like this and walk around with any hope for our species? It's not even just the fact that people like him exist, it's the fact that they have the power. Perhaps humanity is a mistake and we all deserve what's coming our way. Let's hope the iPhone 12 makes up for it.

[dead] 7 years ago

Pedantry taken to its logical limit. Just another day here on HN.

I will counter by saying that, functionally, there is little difference. What is at stake is our means of feeding ourselves. Our means of getting enough drinking water for all of us. For some stability and order and for their not to be anarchy. For having the remotest signs of biodiversity around.

If, a thousand years hence, there are still humans around, who gives a shit. Because what will have been lost is so grave in magnitude, and so unnecessary, that it would be a shame to even call it life.

The reason for this storm in a teacup is that useful posts such as this one get derailed by fruitless discussions about the words themselves or arguing about things that don't matter.

At any rate, my take is that it's an excellent move by the Guardian, and I hope NYT also follows suit and starts calling it climate crisis. Our challenges are SO huge that it's difficult to be hyperbolic enough at all. EVERY single biomarker that you can think of is off the chart perilously.

We are wreaking absolute havoc on every single system critical in supporting life, and it I'm all for terming it in as alarmist a tone as necessary.