hcoyote

You're probably looking for seastar, the underlying library used in products like Scylla and Redpanda.

Matt Risinger (austin-based homebuilder) did a freeze comparison between copper, pex, and sharkbite fittings some time back. It was pretty interesting.

At this point, I'd probably go for PEX-A (compression band) over PEX-B (the crimp style) because of the risk of getting the crimp not completely correct.

https://www.youtube.com/watch?v=OOeBJ8mDr8Q

Mine was The Moon is a Harsh Mistress, read around the same age (took me awhile to get through SiaSL).

The ideas around TANSTAAFL were what really drove me to believe in the value of hard work and being wary of the easy path to "success".

I used to work at a vertically-focused web search engine and ran the operational side of the crawler.

Also missing from this discussion would be a mechanism to rate limit (and determine adequate rate limits, based on your error rates) the crawl.

Also, detecting that you've been blocked and backing off so as not to further hammer the site you're crawling with requests. Related:

IP management is an issue here as well: lots of places just carte blanche block whole ranges from crawling activity. And will you be honoring robots.txt or not?

Be prepared for people to block you in new and stupid ways: once got blocked from hitting the site's name servers to even do lookups against them. They blackholed our packets. So what should have been a ~500ms DNS query at each http request turned into a 15s pause while the DNS request timed out ... eventually this stacked up across all threads, backing the overall crawling infrastructure to deadlock.

The Wayback Machine architecture is probably a good, public implementation of a large scale crawling mechanism. This post[1] about it may be a bit dated, but it's probably still accurate.

[1] http://highscalability.com/blog/2014/5/19/a-short-on-how-the...

Probably the first thing to do is find a copy of Lawrence Chang's Handbook of Spoken Mathematics (also referenced in a previous HN post: https://news.ycombinator.com/item?id=10284052)

This has been great for helping me figure out what to even call various symbols so I can then go look up what they actually intend you to do.

What, specifically, is preventing the conversion? I've converted hundreds of TBytes to Parquet (including moving away from that HIVE ACID stuff).

Similarly, certain books show up multiple times, once for each version. It would be great if those were consolidated to the latest version of the book.

An example of this is when you search for Hadoop. You'll find all 4 editions of Tom White's book show up in the top 10 listing.

I don't have a problem with their pricing decisions. It works for some people, it doesn't work for others.

I was just noting that the pricing mirrors what I've seen in the photo/art book world.

The book took 8 years to make. He died in Oct 2011. He probably knew about it.

Honestly, this cost is on par with other book-based photographic collections from small, bespoke printing companies (Such as Lodima Press). The real question is how many copies did they run. This will determine whether or not the cost is justified for the value you get from it.

As an example, a few years ago, I purchased a copy of Edward Weston's "Life Work" from Lodima when it was released. I think I paid ~$150 for it. They're now selling it for $1000 per copy because they have a limited number left.

If Apple printed thousands and thousands of these, then I doubt the cost is justified. But if it was a limited run, say less than a few thousand? Seems appropriate to me.

This idea was presented at Usenix LISA a few years back.

"Two-Person Control Administration: Preventing Administation Faults through Duplication" by Shaya Potter, Steve Bellovin, and Jason Nieh

https://www.usenix.org/conference/lisa-09/two-person-control...

The video isn't there for some reason, but the paper and audio of the presentation are.

It's not that far off when you consider replacing just light switches with Z-wave switches in a 2000-2500sq ft home. Figure there's probably 25-30 light switches in a house that size. You're looking at about $900-$1200 worth of equipment just to control just whole room lighting. If you went the Phillips Hue route, as an example, you'd easily approach that with 2-3 rooms worth of light bulbs.

Add in control of individual outlets, motion sensing, thermal controls, security ... it adds up pretty quick, even for homes of the "middle class".