That's going to be interesting to see if others follow this as an anchor or buy more into the hype. Regardless it's still a large multiple of earnings...
HN user
artwr
Data Engineer
https://github.com/artwr/ https://twitter.com/awiedmer
Turns out I was wrong :)
Anthropic definitely needed money to continue to compete. That should relieve short-term pressure to go IPO in a possibly crowded field (SpaceX, OpenAI, ...).
Not surprising mostly from a Demand + Willingness to Pay in the US...
That's patently false in my dialect at the very least...
But also true that we have some strong local accents, and that people no matter their level should feel encouraged to at least try to speak French. It's the best way to learn.
https://fr.wikipedia.org/wiki/Tr%C3%A9ma_en_fran%C3%A7ais Some adjectives: aiguë, exiguë... (though a bunch are more commonly written with it on the ü instead) Some proper names: Gaël, Gwenaël, Ismaël
Them be fighting words! But as a native French speaker, I wholeheartedly agree that it is a tricky language. But there is so much pleasure in speaking it that I miss in English sometimes. Fabrice Lucchini (an actor) is speaking about the language of Louis-Ferdinand Céline (an author from last century): https://www.youtube.com/watch?v=ZHrkC3vaqB8 Even if you do not speak French, I hope the passion comes through.
Thanks for the pointer, I hadn't.
I think there is a couple of interesting things. First, it's still somewhat orthogonal to the High context versus Low context cultures (see the Culture Map), as in you can have people with more ask versus guess culture in either communication contexts from my observations (at least among some low to mid context cultures, I don't have a lot of experience with very high context cultures).
Another way to think about it is that it's a lot more local than the broader culture of a country, down to the family level, and you can see this in the US as many commenters have reported where they grew up in various different places in the ask vs guess spectrum.
Finally, the US work environment is generally very "Ask"-leaning, in particular in Silicon Valley and it can take a significant amount of time to recognize where you have been raised on this spectrum versus what is required of you to be effective at work.
I found a good discussion that I keep referring to on Jean Hsu's blog: https://jeanhsu.substack.com/p/ask-vs-guess-culture and https://jeanhsu.substack.com/p/bridging-the-ask-vs-guess-cul...
It's been quite illuminating for people in multicultural teams...
NDV = Number of distinct values. Here partitioning on high cardinality columns, essentially.
My list would probably be: 1. The Linux Kernel 2. FFmpeg 3. The Apache HTTP Server 4. qemu 5. GNU Emacs 6. Hadoop 7. TeX 8. Postgres
I know that's true, but I find that the images on my Pixel are starting to have a bit of an eery feel, with some of the details looking more and more like AI generated images. I'd give back a bit of the quality for more "natural" looking images.
You're right but commercial leases for offices are usually multi year and larger companies usually sign longer leases (20, 30 years or more). They can be costly, though not impossible to wind down.
So for those large companies, the sunken cost is larger.
I'll let parent elaborate more on the intent, but the way I interpreted it was : Saying that a startup will fail (i.e. being a naysayer) and being right about that is the most likely outcome due to the current "success" distribution (most businesses/startups fail).
Also the most memorable ones are when people were dismissive but ultimately wrong about the viability of the business (like the "dropbox" comment).
Agreed.
To be fair, I doubt Maestro will take off like Airflow did.
Airflow filled a void of an easier orchestrator for Big Data with a prettier UI than the competitors of the time (Oozie, Luigi), implementing some UX patterns which had been tested at scale at Facebook with data swarm.
The field is quite a bit more crowded now.
Sounds like a really good move by Databricks, in particular because a lot of the main platforms had implementations of catalogs to the Iceberg Spec, and several vendors, Snowflake included was starting to support Iceberg as an external Table format.
I have similar questions about the future of Delta Lake, but not really about the future of Iceberg, that's what the Apache Foundation is for after all. There are enough large enterprise players relying on this (Apple, Netflix, ...) to keep the project going for a while.
It really seems like criticizing Sam is the new hot thing to do, with tons of people jumping on the bandwagon. Whether it's hiring a voice actor who sounds like ScarJo, having non-disparagement clauses in separation agreements (something basically all big companies and institutions tend to do), being associated with a crypto project (Worldcoin), "lying" to OpenAI board members, etc. No one is perfect, and when you are put under a microscope, just about anyone can look bad in the wrong light.
True, but it's hard to start something as big as OpenAI and not warrant a little scrutiny. At least, I think there is plenty of public interest here, in particular because of the chosen mission statement for the company.
Ultimately, I ask myself, is my life better because Sam was born and did what he did? And the answer is 1,000 times "yes!" because the introduction of ChatGPT changed so much and enabled so much creation and learning for me personally.
Which is a very reasonable position, but is the fact that your life is better negate concerns that applications of ChatGPT may actually make other people's lives worse? And that the lack of transparency around conflicts of interest raises reasonable concerns about both judgement and the ability of the organization to deliver on its mission?
Oh could you expand briefly on what the stack looks like to accomplish this? Or do you have a write up on a blog/site you could share?
Not the original poster but:
> It’s an organization created by a national government. Why? What about this requires the power of "government?"
Budget mostly. I don't think the power of government is strictly required. There are some private organizations which try to take care of the commons (Hiya, Mozilla!), but it's still by and far had to fund. Why not use public funding for this?
Contributor agreements are about to get way more parsimonious and annoying.
Why? I don't think the project necessarily needs to be owned by the organization, right? In which case, nothing changes to the contribution model.
Nation states use software and knowledge of zero days to commit espionage against each other. He can't be serious with this.
That's true, but it's not as if there was no tension there. Significant backdoors could have impacts on the economy of some nations which are therefore incentivized to keep things running smoothly. You can play offense and defense at the same time.
One of the other question is whether you have to delete all data / close your account 60 days after you transfer out without fee: https://twitter.com/QuinnyPig/status/1765102310563500521
Probably obeying the letter of the European Data Act, but obviously not great if true.
I live in the bay area, but yes a main is $15-25+ and anything fancy can go to ~$50. You need to add 9-10% sales tax + 15-20% tip.
That's pretty pricey.
Not denegrating French innovation here at all, I just don't think the rigid ENA/Ecole Polytechnique elites are practical or competent in understanding how to exploit and build on great ideas by their countrymen. I don't disagree that these schools still need to evolve a bit, but you'd be surprised at how much they've already moved in that area. I know multiple people from Polytechnique are heavily involved in entrepreneurship and/or AI.
Both the ACM [0] and IEEE [1] have published Codes of Ethics, but I agree they have little teeth.
[0] https://www.acm.org/code-of-ethics [1] https://www.ieee.org/about/corporate/governance/p7-8.html
Funny in my FAANG, it can be the reverse :)
Infrastructure as code is not the norm. Most tools are UI-focused. It's the equivalent of setting up your infra via the AWS UI. Version Control is not a first class concept
Of course, I may have worked in all of the wrong places but all but one of the places I've worked for the past ten years had source control for data pipelines or the ability to setup via config/source control code as opposed to UIs.
- Prod/Staging/Dev environments are not the norm
Fairly true, though in some cases, staging/dev has a bit more footprint/investment required than for backend or frontend development.
DRY and component re-use is exceedingly difficult (how many times did you walk into a meeting where 3 people had 3 different definitions of the same metric?)
That's a hard one and I agree that's where a lot of opportunity is. There are several efforts to get at a more semantic layer / metric catalog where the people who care about the metrics can agree on the definition, but that's more of an organizational issue, not a data engineering issue.
Proper data modeling to ensure you can more easily reuse the metric as needed is also core here.
- API Interfaces are rarely explicitly defined, and fickle when they are (the hot name for this nowadays is "data contracts")
That's another hard issue. The way I see it, it's still going to be a mix between nicely defined contracts and much looser logging that the DE still has to try to shape into something useful, sometimes even successfully.
- unit/integration/acceptance testing is not as nearly as ubiquitous as it is in software
I take a slight issue with ubiquitous. The amount of software (from paid vendors no less) I have interacted with which does not have proper acceptance/integration testing is just plain sad.
I was indeed counting from the declaration of independence and was trying to round to the nearest natural fractions, but you are technically correct, which is the best kind of correct.
Closer to a fourth, but still impressive.
There is a bit of a bias to this.
Higher salaries will get disclosed more, because if I get an offer below my current salary, then I can disclose and at the very least get a match or refuse the offer. At a lower salary, there is a higher probability that the offer is higher, and my current salary does not matter.
I believe that people more rarely accept a downgrade in salary, so the probably of acceptance is also conditioned on the current salary. What this means is that the effect is biased and probably non-linear, but I wouldn't qualify it as non effect.
I will second this. The national labs are definitely some of the places who know what to do with research software engineers and treat them right for the most part. The Computer Systems Engineers and Software Engineers I had the chance to meet at LBNL had a decent amount of autonomy and were very good.
`your_task.override(task_id="your_generated_name")` not working for you?