HN user
My new favorite new passtime with frontier LLMs, keep telling them "I just ate a [non-food object]". Eventually it gets stuck in a loop of telling me to call 911, unlock my front door, and lay on the floor in case I lose consciousness.
I'm running qwen 3.6 27b at 8bit quantization and 262k context. It takes 53gb of vram on my system.
The connection does not look standard so probably need to find some kind of OEM interposer card, which would allow you to connect some slimSAS cables that in turn connect to pcie adapter cards.
You'd need at least threadripper cpu/motherboard to handle that many pcie slots/lanes.
Not to mention that a baseboard like that is not going to work with a standard ATX power supply, so you'd have to provide your own power solution.
If that doesn't sound fun to you, you're probably better off buying Claude tokens.
This is from the USA site:
https://www.ebay.com/itm/157742745616
It's always a gamble buying used electric but per the description, fully decked out server with 256gb vram.
Though at 2U it is going to sound like a 747 taking off from your office.
4x A100s with the baseboard for $9k (USD).
https://www.ebay.com/itm/336632412718
Buy one and let me use it when you're sleeping.
sticker price is 7899.
It's not even worth it at that point.
You can get a used enterprise grade SXM baseboard with 4-8 V100/A100 GPUs off eBay at a similar price. That will even get you actual HMB ram and NVlink. Along with 10x the AI performance, assuming you don't care about your electricity bill of course.
Try looking into Ryzen AI Max 395. AMD made a CPU/GPU soc with unified memory specifically for ai inference. Can buy mini PCs with up to 128gb ram.
America innovates, China replicates, Europe regulates.
I applied for a founding engineer with a startup though a "who's hiring" post. Had 3-4 rounds of interviews, met founders, did a project with them. I had competing offers and ultimately didn't work out. But it was a positive experience.
Apple briefly was selling Mac studio with 512 GB of unified ram, meaning all that was available as vram.
They are likely including xAI and the massive training costs that entails in order to make it sound like all their ventures are losing money.
Since Twitter is now part of SpaceX, does that mean Twitter is classified as a common carrier too? Can Twitter no longer refuse to allow certain individuals use their platform?
Honest question here.
Apple wants to vertically integrate. Their AI strategy until recently was to develop their own LLM models that were small enough to run on device. But massive scaling is what makes LLMs so powerful, so all their internal models were terrible and unusable.
Basically they bet that compute efficient LLMs were the future. That bet was wrong and the opposite came true.
I believe in science.
I pray to science every day to deliver us from this heretical reign of RFK jr.
It's the new pattern you see from this kind of reporting. Innocuous beginning, omit the middle context, then mentioning the end reaction.
"Young mathmatics professor buys cabin in Montana, then gets arrested by FBI!"
"Austrian born artist wants to make Germany better, then the UK firebombs Dresden!"
concrete and cement production are quite bad.
Modern concrete construction uses iron rebar liberally. That means every concrete structure built today will crack and crumble in a few hundred years at most, as the iron absorbs oxygen, it swells from the rust. Which is a shame, roman concrete buildings without rebar will still be standing 1000s of years from now.
The pendulum is in full swing. Soon it will be ban worthy offense to suggest there are more than two genders.
Though I am morbidly enjoying the irony of seeing those on the left suddenly discover an interest in free speech, and those on the right discover their love for campaigning to get people deplatformed.
To actually implement firearm detection your 3d printer would need to have the ability to reverse engineer the 3d solid model from g-code, then compare that solid model to a list of banned objects.
Some argue that THC in cannabis actually works similarly because when herbivores regularly ingest it, they become lethargic and lazy, causing them struggle to survive in the world. Kinda like my roommate.
Those gigantic clinical trials (some of the largest RCTs ever conducted) didn't detect this issue because of its extreme rarity.
You assume good faith on their part. These studies are run by the same companies that stand to make billions based off the study outcomes. For example we know now when a toddler died in the Moderna covid RTC of cardiac arrest after vaccination they reportedly covered it up and didn't report it.
This all is starting to sound a lot like what happened with vioxx. Where an increase in heart problems was detected in RTC but covered up. Vioxx would go on to cause an estimated 50000 deaths from heart attack.
2040 HN:
"Ask HN: How do you prevent ad-injection in my brain implant?"
Russia, China, Brazil, India -- all have similar censorship systems but Americans don't find it as troubling because those countries aren't part of the same shared cultural identity known as "The West".
Many Americans see Europe's DSA as a framework to allow the implemention of China style state censorship system.
Car depend infrastructure is amazing to families. A mom can take her children to the grocery store in a car in relative safety without worrying about mentally ill homeless people on the subway.
Back when CRISPER was the new hot thing in science people talked about engineering invasive species to have gene drives such that they could only produce male offspring. Eventually there would be no females and the population would disappear.
Doesn't look like it ever got of the ground though.
Apparently Grokipedia give you the option to highlight that section of the text and click "this is wrong" and it will update the text or tell you why not. I don't have a account but someone should try and report back what it does.
Some interesting comparisons I found between Wikipedia and grok. These are the intro paragraphs.
Grokipedia:
The Biden–Ukraine controversy pertains to allegations that U.S. Vice President Joe Biden conditioned $1 billion in loan guarantees on the Ukrainian government's dismissal of Prosecutor General Viktor Shokin in March 2016, purportedly to obstruct an ongoing investigation into Burisma Holdings, the Ukrainian energy firm where Biden's son, Robert Hunter Biden, served as a board member receiving substantial compensation since May 2014.[1][2] Shokin, whose office had pursued corruption charges against Burisma's founder Mykola Zlochevsky—including probes into illicit asset acquisition and bribery—publicly stated that his removal derailed these efforts, coinciding with Hunter Biden's role amid the company's efforts to mitigate regulatory pressures.[2][3]
Wikipedia:
The Biden–Ukraine conspiracy theory is a series of false allegations that Joe Biden, while he was vice president of the United States, improperly withheld a loan guarantee and took a bribe to pressure Ukraine into firing prosecutor general Viktor Shokin to prevent a corruption investigation of Ukrainian gas company Burisma and to protect his son Hunter Biden, who was on the Burisma board.[1] As part of efforts by Donald Trump[2] and his campaign in the Trump–Ukraine scandal, which led to Trump's first impeachment, these falsehoods were spread in an attempt to damage Joe Biden's reputation and chances during the 2020 presidential campaign, and later in an effort to impeach him.[3]
Grokipedia:
Gamergate was a grassroots online movement that emerged in August 2014, primarily focused on exposing conflicts of interest and lack of transparency in video game journalism, initiated by a blog post detailing the romantic involvement of indie developer Zoë Quinn with journalists who covered her work without disclosure.[1] The controversy began when Eron Gjoni, Quinn's ex-boyfriend, published "The Zoe Post," accusing her of infidelity with multiple individuals, including Kotaku journalist Nathan Grayson, whose article on Quinn's game Depression Quest omitted any mention of their prior personal contact.[2] This revelation highlighted broader patterns of undisclosed relationships and coordinated industry practices, such as private mailing lists among journalists, fueling demands for ethical reforms like mandatory disclosure policies.
Wikipedia:
Gamergate or GamerGate (GG)[1] was a loosely organized misogynistic online harassment campaign motivated by a right-wing backlash against feminism, diversity, and progressivism in video game culture.[2][3][4] It was conducted using the hashtag "#Gamergate" primarily in 2014 and 2015.[a] Gamergate targeted women in the video game industry, most notably feminist media critic Anita Sarkeesian and video game developers Zoë Quinn and Brianna Wu.[b]
Google went so far as to scan people's private google drives for copies of the documentary 'plandemic' and delete them.
There is also no direct evidence that smoking causes lung cancer. There are no randomized controlled trials to establishing smoking is the cause. Nor could we ever feasibly run one. All we know is there is very strongly correlation.