votick

first time i’ve found a fellow manitoban on HN greetings !

I can’t use it on mobile looks like which is annoying as we’ve had touch screen phones for almost 20yrs now, the good thing is at least I care enough im annoyed I can’t use it. I’d imagine you’ll get a lot more sharing if mobile works

I thought this was a "your mom is compatible with everyone" joke

This seems completely reasonable pre revenue and I’ve no doubt they make an ai app that 1000x’s everyone’s investment using the best ai technology and algorithms and maybe even some better data. hard to know tho for sure sometimes they lose money sometimes they won’t lose money but ai big and I think ai stay big so more ai

I'll plug my own attempt at doing this a few years ago, https://www.youtube.com/watch?v=H8w0eFXaXjI

The moment I received my first packet on a cut-up wired headset I used as a transceiver makeshift tenceiver it felt like something clicked and I just began to understand more how the universe works. I recommend projects of this type and wish more folks did it.

This is clean, nice work!

Hey HN, this is a lil side project I've been working on.

I've ran a ML hosting platform (banana.dev) last few yrs.

Not being able to get GPUs has stressed me out a lot. So took a crack at solving it.

This is a super alpha product, please don't trust it with sensitive workloads or production applications yet. Down to chat if you'd like to use this at scale!

Would love honest feedback, and feel free to AMA! -kyle

Oh neat, I'm coincidentally trying to setup tier rn.

Bit stuck in progress following Vercel template here https://vercel.com/templates/next.js/tier

But I've already built out my own stripe usage-based billing app b4, and it sucks way more to debug that, so I get what you're trying to do here.

I tried to implement the TCP/IP protocol of internet from scratch + radio transceiver

https://kyle.af/internet-from-scratch

author here:

hey HN, we use used to run an ML consultancy for a year that helped companies build & host models in prod. We learned how tedious & expensive it was to host ML. Customer models had to run on a fleet of always-on GPUs that would often get <10% utilization, which felt like a big money sink.

Over time we built infrastructure to improve GPU utilization. Six months ago we made a pivot to focus solely on productizing this infra into a hosting platform for ML teams to use that would remove the pain of deployment and reduce the cost of hosting models.

We deploy on A100 GPUs, and you pay per second of inference. If you aren’t running inferences you pay nothing. Couple points to clarify: Yes, the models are actually cold-booted, we aren’t just running them in the background. We boot models faster due to how we manage OS memory. Yes, there is still cold-boot time, it’s not instant but it’s significantly faster (e.g., 15 seconds instead of 10 minutes for some transformers like GPTJ).

Lastly, model quality is not lost on Banana because we aren’t doing traditional weight quantization or network pruning which makes networks smaller/faster but sacrifices quality. You can think of Banana more as a compiler + hosting platform. We break down your code to run faster on GPUs.

Try it out and let us know what you think!

Hey all,

We're building toward a GPT3 level moment in computer vision, and here's our V0 (demo video linked).

It's called Carrot. Request access here: https://banana-dev.typeform.com/carrot

We are starting with a Visual Question-Answer model, and plan to expand its capabilities to be increasingly general purpose over time as we build in common CV features and upscale the quantity of parameters.

This is a hybrid of vision and language models, which can extract semantic meaning from images and query against it using natural English. This v0 runs on 13B parameters, with 18B and 34B model iterations coming in the pipeline.

The API is in beta, so jump into the waitlist linked above to get early access.

I'm pretty bullish on this trend.

Relevant project (mine): https://audiblogs.com (lets you listen to any blog posts in your podcast player. It's like Audible for blogs.)

Really cool! I remember back in 2012 playing competitive drawing games on iPad but it was critiqued by humans. I wonder if this could open the door to a new more competitive genre.

https://audiblogs.com

Let's you listen to any web article in your podcast player

Honestly we don't have plans around making $ figured out. It started as a side project, and I feel the first step is to figure out if we built something valuable. If there's significant demand, we'll think of ways to monetize.

Could you elaborate on whats missing from Pocket? And 2) Is there anything on your mind we could add to make audiblogs 10x better for you?

we actually work on youtube already! If you go to youtube and click the extension, we convert the video to audio :)

What were the main things that weren't good enough? We can keep improving on them now.

And def thinking about firefox support, thanks for the input.