yvbbrjdr

We actually profiled one of the models, and saw that the last GeMM, which is completely memory bound, is taking a lot of time, which reduces the token speed by a lot.

I see! Do you know what's causing the slowdown for ollama? They should be using the same backend..

Hi, author here. I crowd-sourced the devices for benchmarking from my friends. It just happened that none of my friend has this device.

Hi, author here. I crowd-sourced the devices for benchmarking from my friends. It just happened that one of my friend has this device.

We use DeepSeek v3 in prod. Works even better than GPT-4o.

Join the Discord server to see Athena in action! https://discord.gg/X38GnhdTH8

Yes. What I'm targeting is the mass population, and I really need to figure out a way to solve this dilemma.

Under the hood, we used Argon2i algorithm to derive the secret key from an arbitrary-long password string. We used the term "password" because that's what ordinary people will understand (like, zip uses the same term for their secret keys). In practice, people should choose password that's long enough to prevent brute forcing, just like picking a password for your online accounts.

It's a good idea to use a public key system. But it really confuses new users who has never used PKI before. Nevertheless, we have a key exchange feature built into the app that allows 2 parties to negotiate a shared secret using X25519, for advanced users.

Wow! This project seems to do exactly what ours does right now.. with an even better UI/UX.. but they don't seem to support any kind of nonce'ed and key'ed encryption?

For some reason it's no longer on the App Store anywhere.

Interesting project! But yeah it requires little effort to detect

Yes! I'm right now creating a steganography scheme with an NLP model.

We've actually tried implementing a browser extension before. The problem is ordinary people just don't use browser extensions..

Thanks for your advice! However, there are several problems with self hosted platforms in China.

1. People are unaware of their existence due to those projects being very technical and hard to deploy/join. They also don't have a good client on mobile platforms. People will trade their privacy for all the convenience, say, WeChat brings, because all of their contacts are already using WeChat. It's hard to convince people to change to use your matrix server. 2. Cloud services are also monitored by the government. There are programs running in the background inside VPSes that monitors all processes in your server. 3. If you want to host a website, you have to register it with a state agency, so if there are any contents on your website that the government doesn't like, your website will be shut down and you'll be held responsible.

As of the walled garden Apple created, I heard that EU has passed a law mandating Apple to allow third-party app stores. It'll be very interesting to see what'll happen in the future.

Go bears!

Does ZeroTier support UDP broadcasting? If so it works.

It doesn't use the Internet, but it does send broadcasts to your local network for discovery.

Probably should have used higher-level functions. Maybe next time :). I don't think I can change the protocol and break compatibility at this time lol.

The crypto_kx functions seem to generate 2 symmetric keys for 2 directions. That creates complications in the code and that's why I didn't use it initially..

Yes! Apart from the desktop version, you can even run the mobile app on your M1 Mac.

No :). I might charge the app for like $0.99 in the future.

- It's mainly me and some friends that does non-code stuff. No companies involved at this moment. - No cloud service is used. Your app doesn't connect to the Internet. See the privacy policy. - :) will post screenshots when I have time.

Will fix the typo!

Great advice. Thanks!

I'm not sure why it didn't work on your machine.. It works on mine..

It's possible that the iPad failed to bind to the discovery port. It should show you a banner when that happens. Did it?

No :) iOS wouldn't let apps do this.

Sry! New to HN here. I posted it right before bedtime and didn't know a lot of people would be interested :).

Just lazy and not having the time to do this yet. Making a screenshot work with the webpage takes a lot of effort.

APK will be signed soon! I just didn't have the bandwidth to generate a keypair :).

I've done my research and also found a lot of similar stuff. They are all not as convenient as AirDrop, so I wanted to make a thing that's close enough.

Thx for your report! Yeah it's a known issue on iOS that it takes a long time to process videos.. especially long ones..

Sry about the spelling. Will fix it soon!

Yeah I've also done my research and found a lot of similar stuff. The problem with this particular one is it requires Internet* to work. I don't feel good about WebRTC and having to share my public IP address for such a task.

Also, it requires you to open a webpage every time you use it. I'd really like the user experience of AirDrop that you need to do nothing to receive files. So I made LANDrop a daemon-like stuff.

* It has a mode that you can save the page offline, but that doesn't work with iOS.