troysk

ScreenRecord.in: https://screenrecord.in I have worked remotely for most of my career and have found screen recording a useful tool to share ideas or ask questions. I liked the UX of Loom but always wondered if one could do it without installing any app. Turns out you can! Given today's browsers especially on desktops one can do a lot of things. ScreenRecord.in can record screen, webcam, mic and system audio if the browser supports them. Chrome has the best compatibility. All recording are stored in local storage I am figuring out what features to add.

posted some details at https://news.ycombinator.com/item?id=45150761. happy to answer any additional queries you may have.

don't get the $5 ones, they are probably just presence detector or at best distance detector and probably work on 24Ghz. Get the 60Ghz for breathing, heart rate, posture etc.

Unfortunately no. But fortunately, it isn't something new I have built. I use a Seed Studio sensor MR60BHA2 which has an ESP32 which sends the data to Home Assistant through ESPHome. Once it is in Home Assistant you can do automations and notifications. I mostly use it for elderly care. I have another DFRobot C1001 sensor but waiting for ESPHome to add support for it. It has fall detection also which is why I am planning to replace it. They are fairly accurate; ~90%; has been my experience. They work better when mounted on ceiling and have a cone like coverage.

I do it using MMWave sensor, 60Ghz one. Want to have more of them but installation is a pain as these need to be mounted on ceiling so WiFi based sensor would be awesome!

The post seems like a paid job as Engineer.ai rebranded to Builder.ai when they were accused of faking AI

https://analyticsindiamag.com/ai-features/sachin-duggal-spea...

https://www.wsj.com/articles/ai-startup-boom-raises-question...

https://techcrunch.com/2019/11/25/engineer-ai-launches-its-b...

I find the web(HTML/CSS) the most open format for sharing. PDFs are hard to be consumed on smaller devices and much harder to be read by machines. I am working on a feature at Jaunt.com to convert PDFs to HTML. It shows up as reader mode icon. Please try it out and see if it is good enough. I personally think we need to do much better job. https://jaunt.com

+1! Most LLMs can already output Mathpix markdown. I prompt it to do so and it gives the code and this use a rendering library to show the scalable and selectable equations. No wonder facebook nougat also uses it. Good stuff!

both openai and claude vision models are able do that for me. It is more expensive than tesseract which can run on cpu but I assume it will become similarly cheap in the near future with open models and as AI becomes ubiquitous.

Segmenting at lower resolution and then using them at higher resolution using resolution multipliers don't work as other items bleed in. FastSAM paper has some interesting ideas on doing this with CNNs which I guess SAM2 have superseded. However, the complication in the pipeline is not worth the result as I find vision LLMs are able to do almost the same task within the same OCR prompt.

How to segment the document without LLM?

I prefer to do all of this in 1 step with an LLM with a good prompt and few shots.

With so many passes with images, the costs/time will be high with ViT being slower.

nougat, donut are OSS. There are no OSS vision models but we will soon have them. MathPix API are also not OSS and I found them expensive compared to vision models.

Mathpix Markdown however is awesome and I ask LLMs to use that to denote formulas as latex is tricky to render in HTML because of things not matching. I don't know latex well so haven't gone deeper on it.

Maybe you could try extracting the text also using some pdf text extraction and use that also to compare. Might help fix numbers which tesseract gets wrong sometimes.

In my experience, this works well but doesn't scale to all kinds of documents. For scientific papers; it can't render formulas. meta's nougat is the best model to do that. For invoices and records; donut works better. Both these models will fail in some cases so you end up running LLM to fix the issues. Even with that LLM won't be able to do tables and charts justice, as the details were lost during OCR process (bold/italic/other nuances). I feel these might also be "classical" methods. I have found vision models to be much better as they have the original document/image. Having prompts which are clear helps but still you won't get 100% results as they tend to venture off on their paths. I believe that can be fixed using fine tuning but no good vision model provides fine tuning for images. Google Gemini seems to have the feature but I haven't tried it. Few shots prompting helps keep the LLM from hallucinating, prompt injection and helps adhering to the format requested.

Jaunt Labs | Full-Time | Full-stack engineer | REMOTE

Jaunt Labs is in the process of disrupting the professional content sharing landscape, focusing on documents, presentations, and more. Currently in our alpha launch phase, our momentum is building rapidly. Plus, our founders come with a track record, having successfully built and sold a startup in a similar domain. We aspire to become the platform which democratises knowledge and discussions around it.

We're actively seeking full-stack engineers to join our distributed team. With Django at our core, we're building scalable apps that can handle the demands of our network. On the frontend, it's all about ES6, no frameworks required.

Here's the structure: while autonomy is key, we touch base a few times weekly, typically around 9AM PST. You'll need at least an hour or two of overlap during these meetings.

Why consider us? Beyond the exciting work we're doing, you'll be part of a cohesive team, tackling challenges collaboratively and driving real change.

Interested in being part of our journey? Drop us a line about why you would like to join us at troy [at] jauntlabs.com or reach out directly to our founder at jon [at] jauntlabs.com. Let's build something remarkable together.

Your posts are awesome! They helped me get started on my journey. Thanks!

Bluetooth repeaters - BLE to WiFI so I can use them in Home Assistant

Button Bot - SwitchBot alternative

Wifi Calling Bell - Relay control calling bell with auto shut-off

Cameras - Uses ESPEye and ESP32 Cam, low res, low latency and does NOT hang Standing Desk - Turns on and off linear actuators

Water controllers - Relays attached to solenoids to automate my plants drip-watering and turn on sprinklers

PIR Sensors - A bit noisy, still not satisfied with performance

RF Transmitter - To replay RF signals

RF Receiver - To receive RF signals

The BLE Repeater has been really useful as it has helped me make many BLE devices available in Home Assistant making automations easy. The nRF connect app has been really helpful to make this happen.

Rate limits are present in chat apps to prevent the service from being abused. Notification tools don't have that.

Why use Slack? Slack has rate limits and one will not get the notifications when something real goes down as there will be 100s of messages overloading Slack API.

Thanks for RailsCasts Ryan! A few days back I read a thread on how ruby/rails is losing junior devs because of the complexity/can of worms docs of Rails 7. I believe it is because we are missing high quality content like RailsCasts today.

Genius! I have scheduled emails to be sent exactly 1 day, 2 day... later so that it goes at similar times, never did I think to separate out the time part and generalise it for the user. Blindspot removed, thanks.

ESP32 are great! The best use case for me is using them as bluetooth repeaters. I use ESPHome and its configs for most devices. For some ble devices, I use nrglogger on my Android to reverse engineer the commands and then feed that into an ESPHome config. It has helped to connect many devices which don't have WiFi anywhere in the house.

The code to content ratio is low, I hope this gets refactored on the lines of https://levelup.gitconnected.com/how-to-use-tailwind-css-the....

One can customize the scaffolding generators to output layouts/pages in the designs which one prefers. This supercharges your development especially if most of the work is CRUD like apps. https://github.com/rails/rails/tree/main/railties/lib/rails/...

We did that, not our first rodeo. It was a new system being used in Shanghai, good luck finding credible realtime information about China. The host should have let us know. The tip is obvious to anyone who travels overseas.

I had booked an airbnb in Shanghai. On reaching the destination the host said we had to get police verification. She took us to the police station where the police said we cannot stay with her as she doesn't have the required permits. We were in a country where we didn't know the language and airbnb declined to help us as they didn't have any people on ground or provide alternate accommodation. We got the refund but he spend way more to get alternate accommodation.

I was not allowed to even post a review.

If you have taken AstraZeneca, try and get some blood and hypertension tests done. Blood clots can be managed with anti-coagulants like rivaroxaban, your doctor will advice based on the tests.

Post AZ, mini strokes start occurring for some. Mini strokes are hard to notice if you aren't post 60. Many strokes don't kill, but they kill the life of you.

Based on the sample set of 1 personally known and 8 indirect.

In a world where Science has become like religion which can't be questioned; use Science and the limited data you have.

Adding a few more to the list; Twitch, dribbble, hulu, zendesk, airBnB, Square, Kickstarter, Heroku, Coinbase, Soundcloud, cookpad, slideshare.

I guess, if you choose Rails, there is more chance you will build something beyond MVP as you get to focus on what you build not how.

It is definitely magical! So many hours saved trying to find the right responsive break points for those particular card UIs.

The homepage has multiple animated examples showing the use of utility class spamming.