HN user

zheng

939 karma

realglitch@gmail.com

Posts18
Comments259
View on HN

Most systems I know which require this just do at-least once on the sending side and dedupe on the receiving side. If you build this into your framework, to applications you have exactly-once barring unbounded partitions and the like.

Not sure why this is being downvoted, it's actually a good question. If all of your VM's are idle, you would want your host CPU to idle as well, although my guess is this doesn't happen in things like Xen, VMWare, etc.

Just wanted to say thank you for hlld/bloomd! At my old company we were looking into uses for them just because the idea and footprint was so cool. We had a couple ideas for hlld and the overhead was so small that we could basically add it to our servers for free.

From the about page

We figured pretty much everybody knows JavaScript

Even with the implied "everybody" being "everybody that would be interested in joining our site", this is a poor assumption. Not everyone is a ninja-rockstar web developer. In fact, some of the best content on HN comes from people who most likely don't know JS. I get the idea for the site, but the description seems very naive.

(FWIW, I do know JS)

People are like, ‘Andrew, what could be next?’ And it’s like, ‘Oh. Done.’ We have a mechanical bull. Game-changer. Innovate.

“We don't call it an after-party. We call it after-hours.”

Waaaay too close to the Poe's Law line, I can't tell if this guy thinks this is for real or if he knows it's ridiculous and is just trying to cash in on demand.

What would be really cool is if this list of genres was open-sourced somewhere. I can see Netflix not wanting that, but it would really save time for however many hackers read this article and decide they want the same data.

A general thanks to aphyr for exploring all of these kinds of issues in distributed datastores at a level where someone without a lot of database knowledge can understand and reason through. If anyone hasn't read his Jepsen series and is interested in these kinds of things, it is well worth a read.

Of course, I wouldn't read it if you store very important data in any of the datastores he talks about, you might be scared to learn how your system actually operates =).

P.S. - The Spanner link is broken, you have some invisible character being added to the end, gets encoded to %E2%80%8E

How exactly is it lying? Microsoft did pay a $100k bounty to a hacker. The HN headline just leaves out extra details (what the bounty was for), but doesn't change the meaning at all. Am I missing something?

Impermium (https://www.impermium.com) - Redwood City, CA

Impermium is a leader in web security, protecting against account compromise, counterfeit registrations, and malicious activity. We generate a real-time risk profile for user activity, enabling sites to take immediate, proactive action against abuse.

On the engineering side, we are primarily a Python shop, although we use the Hadoop ecosystem extensively so there is some Java and we're playing around with Scala. We are a small company of about 15 who are easy-going and super fun to be around.

We're hiring for a couple positions right now, including:

* Senior Data Mining Research Engineer - We need someone who can go from a conversation about stochastic gradient boosting distributed decision trees to a prototype and from a prototype to a fast, scalable, and robust production model.

* Senior Software Engineer - You are an experienced, knowledgable developer who has a breadth of experience and can jump in and ship code on the first day. Experience with big data is a plus.

You can view the actual postings (https://impermium.com/who-we-are/jobs/index). If either of them seem interesting, feel free to send me an email (realglitch@gmail.com).

I think this is huge for CS grads, and I would add to not overlook a blog/SO as it can really showcase your ability to discuss and explain technical topics. I can never write a blog post because every time I try I end up with an outline for a 9-part series explaining everything I've ever learned tangentially related to <topic>, but SO gave me the focus needed to showcase some of my communication abilities. I know that helped me at least get noticed by companies.

This is pretty tech-specific. In many other fields, unpaid internships are seen as a good deal, mostly because their are so few of them and so many applicants. A friend of mine who recently converted an (unpaid) internship to a job in DC worked really hard just to land the internship. At the same time, he was learning the job but in no way provided the same benefit to his employer as a tech intern does.

Thanks, while I think the pronunciation is lame and confusing, I grow tired of explaining to people that it is actually correct, they aren't called "trys" or "treys".

Thanks a lot for the reply, one of my favorite things about HN is getting questions answered by the authors of the tool in question. After reading more, your decision to not post those benchmarks is a smart one. I get where you're coming from with regards to it being hard to make a performance comparison to protobufs, it makes sense now. If/when I need to reach for some serialization I'll certainly try out Cap'n Proto.

I don't have any of these issues, but your description of how you used the 1st gen Kindle is hilarious. Thanks for an unexpected laugh.

The claims on this site are pretty impressive, but I have close to zero knowledge of the history here, so can someone comment on how many grains of salt this should be taken with? Otherwise, this looks pretty cool. Something that beats protobufs in overall speed could be really helpful depending on the application.

TBH, I don't think you're in the wrong here, but expecting someone who has already brought something to your attention to file a "bug report" against your personal website is a bit arrogant.

Impermium (https://www.impermium.com) - Redwood City, CA

Impermium is a leader in web security, protecting against account compromise, counterfeit registrations, and malicious activity. We generate a real-time risk profile for user activity, enabling sites to take immediate, proactive action against abuse.

On the engineering side, we are primarily a Python shop, although we use the Hadoop ecosystem extensively so there is some Java and we're playing around with Scala. We are a small company of about 15 who are easy-going and super fun to be around.

We're hiring for a couple positions right now, including:

* Senior Data Mining Research Engineer - We need someone who can go from a conversation about stochastic gradient boosting distributed decision trees to a prototype and from a prototype to a fast, scalable, and robust production model.

* Senior Software Engineer - You are an experienced, knowledgable developer who has a breadth of experience and can jump in and ship code on the first day. Experience with big data is a plus.

* UX Design Lead - You'll be leading our creative design and our user interaction from conception into production. We're particularly looking for designers who have a vision for big data visualizations.

You can view the actual postings (https://impermium.com/who-we-are/jobs/index). If any of them seem interesting, feel free to send me an email (realglitch@gmail.com).

This really does appeal to me, but I wish it didn't rely on Cassandra. That's a heavy dependency if you would otherwise have no java in your stack which many mail servers probably wouldn't. It's certainly an interesting departure from flat files or standard databases though.

Note that this post is from 2011, making it much less interesting that he has pictures of a fully assembled Sea Shadow, given that it was scrapped in 2012. Before I saw the date, I was getting ready to put on my tinfoil cap...