arilotter

remove the "change" button for areas until you have it lol i was trying so hard to find startups in rio kkkk

My company was using Iroh for a production distributed ML training system & we LOVED it. The team was incredibly responsive even before we hooked up with an enterprise support contract, they're incredibly knowledgeable and the library itself worked amazingly. ++ to this lib. would use again over libp2p anytime.

This title is moderately clickbait-y and comes with a subtle implication that Rust might be getting removed from the kernel. IMO it should be changed to "Rust in the kernel is no longer experimental"

Hi - Psyche developer here. Happy to answer any/all questions about the project :)

iroh's stuff is great but their local peer discovery can't work in a browser, since it uses an mdns-like protocol to do it

big ++ for iroh - using it for a project at work, it's evolving really nicely, has reliable holepunching, and the team is super responsive and happy to dig thru gigs of logs to find a bug :)

It's unlikely you can. They're generally only willing to set up corporate deals to sell data in massive bulk. You could buy a domain name, set up a decently real looking website with a corpo looking email, then go to any broker like https://www.acxiom.com/customer-data/ (not affiliated, first one i found on google) and do the whole corporate dance of signing a contract to get what you want.

I learned recently that Charlieplexing is kind of like the discrete version of the Radon Transform: https://en.wikipedia.org/wiki/Radon_transform

you could absolutely use DisTrO for federated learning. The DeMo optimizer on its own doesn't solve the adverserial aspects of training on local-only data, nor does it solve tensor parallelism across devices, so you're still limited to only what fits on your local GPUs, but it does enable distributed data parallelism over the internet at a bandwidth orders of magnitude lower than before.

This specific model is only trained on 100 billion tokens, so it's not SOTA by any means, but we've got designs on larger training runs later :)

Are you planning to eventually do a SETI@home style thing where anyone can join?

That's one of the goals of the stuff we're working on right now, I personally hope we can make it work!

What was Durk Kingma's involvement in DisTrO?

As a co-author on the paper, we brought him in to bounce some ideas off of & have him validate DeMo's design and implementation to ensure we weren't hallucinating these results.

Yo! I'm on the team at Nous that built this tech, happy to answer any questions :)

That's not something that DisTrO solves, but there's plenty of research in that area! See https://arxiv.org/abs/2301.11913 , https://arxiv.org/abs/2206.01288 , https://arxiv.org/abs/2304.11277 etc :)

we're excited to drop the paper & code and let you run the code for yourself to see otherwise !! coming in the next couple months :)

We're excited about the potential and want to find other folks also excited about it that are interested in working for/with us to build things on the foundations of DisTrO! Plus also it's so cool and mind boggling to us that we wanted to share the hype a little bit, it was hard not being able to tell anyone we were working on it

Paper & code in the next couple months. We're workin on em :)

We're pretty confident it's not a fluke, and paper + code are the next step, within a couple months. It's not "synchronize every step", but it's "do something every step".

We double and triple and quadruple checked our results, to make sure that we are in fact getting results like this while only doing our thing every step, and it really keeps holding up.

Don't trust our word for it, though, you'll see when the paper comes out :)

I can confirm this is not a projected related to Nous Research in any way, just an unfortunate naming collision

i remember making this joke a decade ago on the tonymacx86 forums, lots of people did it for the lulz

you can! you can also run it on a real iOS device using this tech. it's explicitly documented in the repo :)

Anecdotally, I get Instagram ads for "buy mdma online" all day, every day.

(I work at Nous) it's Anthropic's Claude 3 Opus! Working around rejections is always tricky, and you gotta juggle getting responses to interesting queries with not breaking Anthropic's ToS

cigarette yummy...

It's a number in a database that's assigned an "owner". Some NFTs can be controlled by a central authority, kind of like your bank account, and some of them are totally decentralized and can only be modified/traded if you, the owner, wills it so.

Someone can associate some data with that unique number, if they want.

AFAIK they are using a reverse-engineered Apple binary that does the real iMessage - and since Apple doesn't update apps outside of iOS updates, Apple can't, in theory, patch it without also breaking iMessage on older iPhones.

Beeper Mini does not MITM messages - it's a reverse engineering of how iMessage works, and runs entirely on-device, without putting messages thru Beeper's servers. It talks directly to Apple and pretends to be an iPhone.

You're thinking of Beeper Cloud, which does iMessage thru a Mac Mini in the cloud.

oh my god I just spend the last 6 months building something exactly like this as an internal tool because i couldn't find ANYTHING open-source that was remotely powerful enouhh for what i needed. this fits basically every single use case i had, i would only have to write a custom storage format to make data git-trackable.

i'm gonna go cry now.

please don't tell me this has been out for a while and i missed it.

Yes, but only for the stress it causes me in thinking really really hard all day and then being exhausted at night, which i think is not unique to a computers career. I don't regret it in that it's an incredibly high paying job with very low social barriers to entry.

I built a p2p-only mostly-decentralized OSS crypto trading app a-la runescape or steam or diablo trading :)

https://github.com/arilotter/vaportrade https://vaportrade.net/

Built one of these with my dad when I was about 8, and this was one of the things that got me bitten by the "working with computers" bug.