Groq kept delivering so their valuation has effectively gone up.
A year ago it wasn't clear if they'd stay competitive but it seems they are.
HN user
Been here for more than a decade.
Its been quiet a journey!
From wordpress to ai by way of hustling and a PhD!
Professional experience in hpc, publishing, wet lab biology, optical physics, startups, medicine, compilers and AI.
Groq kept delivering so their valuation has effectively gone up.
A year ago it wasn't clear if they'd stay competitive but it seems they are.
> if groq and cerebras combined
There isn't to be shared between the two techs, Groq's hardware is a like a railgun that installs all the weights into the optimal location before firing off an inference. Cerebras computer engineering more convention requiring the same data movement that GPUs struggle with optimizing.
Suspect Groq is complementary/superior to nvidia's GPUs, while it is unclear what Cerebras brings other then maybe some deals with TSMC.
The author's laundry list of fixes are already formally done, most of things the author wants to treat as fraud are already treated as fraud.
Yeah we generally don’t give those permissions to agent based coding tools.
Typically running something like git would be an opt in permission.
Yo what’s the next hype cycle that smart folks like us should be working on?
Yeah, specially in STEM.
Despite posturing by some academic administrators, most folks have no social agenda for a country they recently immigrated to.
Imagine actually wanting to work at Amazon
Indie dev turning profit first year is part of the typically success story for indie devs.
It looks very adhoc
So ideally the ml network would solve the problem end to end but these authors seem to be using a network for only one step of their otherwise classic image processing pipeline
lol these guys aren’t vcs
Term sheets from vcs increasingly include a “don’t do an ico”
No because these cuts do nothing to address fraud.
In the immediate it seems to have cut short the next generation of scientists leaving more of the entrenched old hands.
Traitorous eight would have been cooler
Hmm, but was the reconquista really a capitalist venture?
This investment makes no sense because ai is supposed to take us into a post scarcity society?
I did speak to folks on the North Vietnamese side. I kinda found it really interesting.
They read these stories of escape as emblematic of the southern government’s cowardice rather than heroism. In some ways these are stories of active military deserting their posts.
It was no surprise to these North Vietnamese patriots that they triumphed.
The real problem is that MDPI occasionally hosts more legitimate work.
What if they just charged Apple users 30% more?
You’re repeating the type and hoping it doesn’t change when you really just wanted the value.
Can we direct link to the actual chat site?
Mermaid doesn't scale beyond simple plots try https://perfetto.dev/ which can ingest basic csvs
“exotic” signal representation without much practical utility despite the fact that they have been around the signal and image processing community for more than 30 years now.
Maybe they aren't that good? Maxwell's equations got a lot better when they dumped them, same thing with the few uses in video game physics/camera tracing.Yeah but you need to port the SIMD before shipping anyways?
So if you're doing incremental stuff might as well stub out the calls with "not implemented", and start filling them in.
Struggling with the use case.
It seems like this is when you have the source or the libs but choose to mix x86 and arm?
It would seem if you have the source etc you should just bite the bullet and port everything.
I think semi analysis commented that they have pipelines instead of batches[1].
So every clock cycle you're doing useful work rather than loading up people into batches. And thats why the arch will probably win for inference, for training you're basically competing with software eco system and silicon density. AKA NVIDIA can give TSMC more money to get more ALUs on the die.
I think other places have attempted dataflow (FPGA etc) but they all basically had buffers (due to non-determinism in networks stack and even ram). SambaNova seems indistinguishable from an FPGA with a few clock cycles difference. I think they blew their shot with a Series D ($600 million???) where they made more of the same old. Maybe Intel will buy them to augment Altera? Looks like chasing parity with existing strategies.
I buy the Groq hype because its something different, certainly the public demo helped. HN is about the future.
[1] https://www.semianalysis.com/p/groq-inference-tokenomics-spe...
Well I've been using the groq public api, and its approx. the rates claimed.
Economics and costs are hard to predict. For example, Groq is not using HBM chips. So probably the cards are a lot easier to source.
Its not clear what the capacity of these systems are in terms of total users, or even tokens per second. Then you factor in cost. Then you realize all vendors will match a competitors pricing. Then you realize Groq doesn't sell chips.
¯\_(ツ)_/¯
The only thing you have is the public API to benchmark against: https://artificialanalysis.ai/
8 year old unicorn++ with a public demo sounds credible?
Samba is on gen 4 silicon and still lagging, somebody over there is doing something wrong
This misses the context.
A war between the two countries caused the death
Also the bug was known, and more of a limitation that required the system to be power cycled (and this unit wasn't).
easier to color graph if you have like 4 registers :-)
Appears it takes an LLM running on the fastest computers in the world to read lisp