HN user

yousifa

196 karma

Yousif Astarabadi, founder @ TalkTastic.com Email: yousif at talktastic.com

Posts8
Comments120
View on HN

On the coreml side this is likely because the neural engine supports fp16 and offloading some/all layers to ANE significantly increases inference time and power usage when running models. You can inspect in the Xcode profiler to see what is running on each part of the device at what precision.

RIP legend. Not sure that I would be where I am today without Kevin being an inspiration and hero to me growing up.

If the startup has failed, it is highly unlikely that you would be able to get any $ from them. Even if you go after the founders personally, they likely don't have any cash and it will be a waste of time. If the company is still operating and has cash in the bank, 1000% you should go after them -- payroll is the first thing on the preference stack that gets paid when shutting down.

I will add, the fasting from food and water is the easy part. The more important fast is fasting from everything that is bad -- cursing, backbiting, lying, etc -- and from your own desires. All these things are things you shouldn't do anyway, but this is a time to refresh commitment to not doing those things.

As the Quran says: "Oh, you who believe! Fasting is prescribed to you as it was prescribed to those before you, that you may learn piety and righteousness" [Quran 2:183]

we're currently using gpt-3.5 and gpt-4 for the LLMs. We'll be adding support for more models under the hood in the future depending on the prompt / use cases.

We’re experimenting and trying to do everything with the cheapest, smallest models we can, because ultimately we want to do it all on device

I highly recommend spending a couple hundred extra bucks and getting the macbook pro instead of the Air.

The Air has no fans and will throttle cpu extensively under medium - heavy usage. You will feel this and it is quite frustrating.

I also recommend you get at least 16GB RAM. I own a 2019 Mac Pro and my M1 16" MBP blows it out of this universe on every metric.

Docker runs fine, but you will need to add --Platform flag on some images to set the build platform as it will attempt to build for ARM if available. Other than that, it shouldn't require anything different.

Initial feedback:

1) Simplify the UI. Center the typing area and make it auto selected so I can type without having to click on it. 2) There is too much text. Just let me type without reading. 3) It seems like it requires full length questions to get good results. Focus on getting the same results with just a few words by inferring the question.