HN user
While I think that local LLMs are the future, i think these setups are insane. You shouldn't be trying to push the SOTA, most people underestimate how much you can get out of small LLMs.
Why ask FABLE 5000 to "summarize this email thread" when a tiny model can do the job?
Sure Codex3000 can oneshot your backlog, but why not use a subsidized subscription to do it for now? We're clearly not at the peak of these model's capabilities yet.
I tried making one, but I couldn't make through the camera position tracking bit, software was super unintuitive. Very interested in gaming applications for this tech, but still waiting for it to be more approachable from a layman's point of view.
Nice UI
They use a gamescope[1] session to achieve this. You could potentially do the same on dekstop, but it's painful.
Yeah, but no. Proton is the best thing that happened to Linux gaming, but sometimes it's still not good enough to get full Windows-like experience.
HDR still doesn't work properly, there are no codecs (Atmos, DTS:X) for my surround system, latest nvidia driver broke Microsoft Flight Sim and other games on wayland. The list goes on.
And as for Copilot - I'm sure I'll be able to rip it out, just like the other crap MS forcefully pushes on people.
Yeah I guess the card companies will adapt somehow as well (in fact there's a follow-up video on how to discourage this technique [1]), but there's still a huge market for "vintage" cards and packs that will be affected.
A CT technian has figured out a way to look inside a TCG booster pack and identify rare cards inside without opening it.
This potentially could change the whole collectable market, since you could fish for expensive rares and dump the "dud" packs back on the market.
https://github.com/element-hq/ess-starter-edition-core
They ship a k8s operator that deploys Synapse, will try that later. Supposedly it's free up to 200 users. But it seems like there's 0 documentation past the README.
A reminder of how centralized and dependent the whole industry has become on GH, which is ironic, considering that git itself is designed to be decentralized.
Good opportunity to think about mirroring your repos somewhere else like Gitea or Gitlab.
Actually recognizing people posting is something that i dearly miss. Now you barely even notice the usernames.
Because that wasn't the deal.
Nobody complained when YT was monopolizing online video because it was convenient and free and then they proceed to bait and switch us into paying.
Screw them, I won't pay out of principle.
Because it wasn't the deal when they were consolidating the all online video content into themselves. And then once they've gotten "too big to fail", the greed rolled in.
They bait and switched us.
Youtube killed private video hosting. Reddit killed small thematic php-bb forums.
If people knew that they'd eventually do that, none of these platforms would be as big as they are today.
Forget the numbers, just knowing that CEO is not fucking me over to build a second vacation home is Aspen would be enough for me.
Everyone at Oxide makes $201,227 USD, regardless of location.
Man I would love to work for a company like that. I don't know why more people don't set their startups like that.
Great video from Asianometry on this topic: https://www.youtube.com/watch?v=cxrkC-pMH_s
Hate to be that guy, but did we?
Sure it looks different, but I'm still dragging windows on a virtual desktop.
You'd think there would be some innovation. For example I've always dreamed of a scrolling-timeline-like interaction with desktop, where your activities would scroll to the side when you switch to the new one and then you'd be able to "scrub back in time" to see what you were doing before.
And yet if I post my CV as a "Linux Systems Administrator" I will get zero replies on LinkedIn. I wish this wasn't the case though.
What we need is a resurgence of specialty forums, but there's no good modern forum engine around, at least I'm not aware of one.
https://github.com/oobabooga/text-generation-webui/
Works on all platforms, but runs much better on Linux.
Running this in Docker on my 2080Ti, can barely fit 13B-4bit models into 11G of VRAM, but it works fine, produces around 10-15 tokens/second most of the time. It also has an API, that you can use with something like LangChain.
Supports multiple ways to run the models, purely with CUDA (I think AMD support is coming too) or on CPU with llama.cpp (also possible to offload part of the model to GPU VRAM, but the performance is still nowhere near CUDA).
Don't expect open-source models to perform as well as ChatGPT though, they're still pretty limited in comparison. Good place to get the models is TheBloke's page - https://huggingface.co/TheBloke. Tom converts popular LLM builds into multiple formats that you can use with textgen and he's a pillar of local LLM community.
I'm still learning how to fine-tune/train LoRAs, it's pretty finicky, but promising, I'd like to be able to feed personal data into the model and have it reliably answer questions.
In my opinion, these developments are way more exciting than whatever OpenAI is doing. No way I'm pushing my chatlogs into some corp datacenter, but running locally and storing checkpoints safely would achieve my end-goal of having it "impersonate" myself on the web.
Cheers, I'm never donating ever again.
I'd love to hear what Facebook defines as "open" and "democratic".
I understand the unwillingness to attach your brand to whatever porn that inevitably comes out of making it available for everybody, but maybe don't use such big words then.
On the flip side, these days you can download UE or Unity for free and make your own game. Not even from scratch, just throw together a bunch of free assets and have at it.
And it's getting easier and easier, just search Steam for "meme-games". Game development is more democratized than it has ever been.
Look what happened to music production, how easy it is to start with all the free DAWs and cheap hardware. I believe game development is going down the same road, as tools are getting more approachable for newbies, we're going to see an even bigger explosion of indies.
Man I can't wait to retire in 30 years, the games are going to be sick.
sudo tcpdump -i en0 -n -l dst host 8.8.8.8 $(for a in $(curl -s https://raw.githubusercontent.com/berthubert/googerteller/main/goog-prefixes.txt); do echo or dst net $a; done) | while read; do tput bel; done
I wish they'd just un-screw the page ranking algorithm. The quality of search has been steadily going down for quite a while now due to spam getting better and better at SEO.
I'm hopeful for this feature, but I'm not sure how scalable it can prove to be, to help manually rank pages for myriad of topics.
Looks cool, hard to tell if worth considering there's no info on price.
Yeah it fits perfectly.
I self-host everything but my email.
Hosting email is just too much. Big providers just treat you as guilty of spam, unless proven otherwise. Just too many hoops to jump through.
As much as I'm a fan of Alex after watching his previous docs, I'm not buying into Facebook world, just to watch this.
Hoping someone would dump this on trackers somehow.
Oh that's actually great, ot's just I've been burned before by German retailers with "English International" on ISO keyboards.
I might go do some shopping then. Say hello to Linus btw, his video has done marvels to deservedly promote your product.
I wish they'd ship US ANSI keyboard in Europe, I would totally pick one up.