djsamseng

I found it relevant and actually just the information I was looking for. Having a highly recommended model behind the tool makes it worth further investigation.

My guess: In the reference frame where the particle is not moving, the sun would be either a) moving (with a perpendicular component) and be ever so slightly moving toward the particle or b) not moving but a third body would be, moving both the sun and the particle at different “strengths” (different mass and distance, different time dilation) thus the particle and the sun would appear to move closer to each other. That means in either case (sun in the middle or particle in the middle) the third body moving closer must make it look like the particle and sun are gravitationally pulling each other. If we then shift reference frame back to the third body being stationary and the particle and sun moving, we should see that. It would be really cool if we could simulate this to test it but I believe that would require solving the 3 body problem.

If the sun is on my left, doesn’t that mean time moves a bit slower on my left and the slowdown on the left means I’ve traveled less on my left side? Thus I turn left toward the sun.

“Their brains… look like small walnuts inside their skull… There's so much atrophy that happens with an alcohol soaked brain chronically that I would say that's, you know, far and away, the most common source of brain damage” - Dr. Matthew Macdouglas head neurosurgeon at Neurolink on the Huberman podcast starting at 1:40:00

Your understanding is correct. The key detail is that the author used an M1 Max and H100 for their testing.

M1 Max: FP16 hardware support, FP8 and Bfloat16 emulated in software (via dequantization)

H100: FP16 and FP8 hardware support

which I ran both on a MacBook Pro M1 Max and a rented H100 SXM GPU

Hello from Siem Reap, Cambodia! Awesome to see a fellow tech enthusiast from Cambodia.

I actually found Facebook’s translations pretty good (better than Google Translate for things longer than a sentence). From my understanding of Khmer, Khmer is a bit more verbose and context dependent, hence LLMs in Khmer would be a big help understand those nuances.

In the inverse case (LLMs generating khmer from English) I heard from locals that it sounds formal and “robotic” which I found quite interesting.

Yes! This one works. Thank you so much!

How did you get access to HTGAA? I’ve really wanted to take this course but all of the videos and resources seem locked

Awesome! This is a huge opportunity to help a lot of people (clients, subcontractors and builders). A lot of money and time is wasted by the current inefficiencies. We gave takeoff construction plan parsing a go in 2022-2023 but couldn’t get the AI part to work well enough (and still haven’t been able to even with the latest ViT/ CLIP models). There was a lot of interest though!

- You’re right, data is very hard to come by. I’m curious, how do you plan to get around this? Outsourcing human labeling? We found it to be a very difficult task.

- The subcontractors and local construction companies we talked to were overwhelming excited about the idea.

- It’s entire people’s jobs to get this done and done correctly. They sit on site holding the pdfs in their hands, manually counting and calculating. You bet a lot of mistakes occur. They would absolutely love to have a digital assistant for this.

- Some of them (especially managers and owners) are quite technical and are using software such as BlueBeam and other CAD software to make these calculations. It’s quite manual currently, but gives great insight into a better solution. This led us to having the user manually select the symbol they wanted counted (which ML struggled to get right). Just getting the part counts (and highlighting them in the pdf) was a huge help!

- Impressive you got square footage calculations correct! In our experience, there was way too much variation between architects (and multistep dimension labeling) which made it hard (even for humans) to get right. How has your model generalized OOD thus far?

- Are you planning to integrate voice? Many of the subcontractors we worked with are very low tech. They usually talk with their clients in person, on the phone, or maybe text. But they don’t use email or their smart phones for much.

I will be following your work! I have friends who would love to use this once it passes the human threshold.

There's also the field theory of electricity: https://youtube.com/watch?v=bHIhgxav9LY

It’s an eye opening alternative explanation to the electrons flowing like a chain theory of this article.

Check if your site has any manual actions against it. https://support.google.com/webmasters/answer/9044175?sjid=11....

They might be trying to create toxic back links to their domains and if those domains 301 to your domain, I believe this can negatively impact the SEO of your domain (from what I read). If so you can try to disavow them https://support.google.com/webmasters/answer/2648487?hl=en

So I click around, using the UI over and over, until I finally cannot give myself any more splinters.

I’d take this with a grain of salt (pun intended). There’s a lot of bugs that you cannot reproduce without certain permissions or a particular environment. Let alone the race conditions or user setup. In my experience, most bugs would not have been uncovered using this brute force approach. A few tests using your understanding of the code and critical thinking goes a lot further in my opinion.

Come to Siem Reap, Cambodia. Start your day with a sunrise walk to the gym ($40/month). Grab an omelette and coffee for $3. Head home by 9am before it gets too hot. Work/learn/read/nap in the AC until 5pm. Take a sunset bike ride through the temples of Angkor Wat. Grab dinner downtown at the open breeze restaurants while people watching ($2-3 for a healthy meat and vegetable stir fry, $1 for pancakes, $2 for fried rice). Grab some drinks ($1) and play billiards with some friends. Head home to your modest 1 bedroom apartment for the night ($300/month). Not to mention the locals are really friendly here and if you’re in to helping out in some of your free time, you will be greatly valued and appreciated!

There’s a few other expenses and some cons of living here but some research and YouTube videos will help you figure out if it’s right for you. And of course you can ask me :)

I would say “hey, I’ve proven to be a critical part of this company since the beginning and I’d like a seat at the table to take this company to the finish line.” Then ask for 5-10% equity in addition to your salary.

I’d also say £40k was way too low. I’d guess the founders have significantly higher upside. It would be worth asking for transparency in order to determine fair compensation.

Thanks for the link! I’ve been trying to figure out how to buy/make a Raman spectrometer for cheap (currently in a third world country too!). Have you built one yet? I’m having trouble finding the lenses needed (mostly because of my lack of knowledge). Any chance you know what to use?

Laser ($40): https://a.co/d/0wjNGBz

Diffraction grating ($12): https://a.co/d/6bpO8xm

Laser focusing lens: Not found

Fluorescence collection lens: Not found

Focusing lens: Not found

Collimating lenses: Not found

Thanks for sharing this! I didn’t know about these terms before. Every consider writing a blog post/tutorial on your knowledge of human speech in spectrograms? This is much more digestible than most of what’s out there

Agreed theoretically however if I gave you two spectrograms, would you be able to tell which one is clear speech and which one is garbled? I’d bet we’d be able to come up with one that wouldn’t pass the sniff test.

If you know of any implementations that can look at a spectrogram and say “hey there’s peaks at 150hz, 220hz and 300hz with standard deviations of 5hz, 7hz, and 10hz, decreasing in frequency over time thus this is a deep voice saying ‘ay’” and get it right every time I’d be really interested in seeing it (besides neural networks)

Unfortunately I think the answer is “we don’t know” we have loads of techniques (ex: band pass filter) and hypotheses (ex: harmonic frequencies and timbre) but we haven’t been able to implement them perfectly which seems to be why deep learning has worked so well.

Personally I hypothesize that the reason it’s so hard is that the sources are intermixed sharing frequencies so isolating to certain frequencies doesn’t isolate a speaker. We’d need something like beam forming to know how much amplitude of each frequency to extract. I’d also hypothesize that humans, while able to focus on a directional source, also cannot “extract” clean signal either (imagine someone talking while a pan crashes on the floor - it completely drowns out what the person said)

This is a pretty good introductory primer. https://medium.com/analytics-vidhya/understanding-the-mel-sp...

1. STFT (get frequencies from the audio signal)

2. Log scale/ decibel scale (since we hear on the log scale)

3. Optionally convert to the Mel scale (filters to how humans hear)

Happy to answer any questions

x = “I hate apples, I only drink _”

keys = key_weights * x

query = query_weights * x

values = value_weights * what_to_look_at

For self attention, what_to_look_at = x

For regular attention, where_to_look_at could be a database, memory or anything else.

So in this example if we’re trying to predict the second “apple” the first “apples” is very helpful. If we’re predicting “juice” then we’d use one head of self-attention to look at the first “apples” and a second head to also look at the second “apple”

That’s my understanding at least

With you on this one.

I started noticing thoughts that were so negative/depressive that I was actually aware of how irrational it was. For example things are actually quite good but my mind is in the dumps. So called Automatic Negative Thoughts (ants).

Since then been trying to reprogram my brain. Force those thoughts out of my head. Start singing randomly. It’s hard and I’m not always successful but I’ve definitely noticed a big improvement overall.

Hopefully this helps you too!

Just make sure you include a way for the rest of us non founders to donate to the cause!

Time to start building a neural net to invalidate patent trolls.

Recursive grep: For every time you know you’ve written that code before but can’t remember the exact syntax. Filters out known build directories that would otherwise make it slow (moddify this to your personal use case).

https://github.com/djsamseng/cheat_sheet/blob/main/grep_for_...

#!/bin/bash

if [ $# -eq 0 ] then echo "Usage: ./grep_for_text.sh \"text to find\" /path/to/folder --include=*.{cpp,h}" exit fi

text=$1 location=$2

# Remove $1 and $2 to pass remaining arguments as $@ shift shift

result=$(grep -Ril "$text" "$location" \ $@ \ --exclude-dir=node_modules --exclude-dir=build --exclude-dir=env --exclude-dir=lib \ --exclude-dir=.data --exclude-dir=.git --exclude-dir=data --exclude-dir=include \ --exclude-dir=__pycache__ --exclude-dir=.cache --exclude-dir=docs \ --exclude-dir=share --exclude-dir=odas --exclude-dir=dependencies \ --exclude-dir=assets)

echo "$result"

A huge congratulations to everyone at Meta on a major accomplishment! This is the way of the future. It’s now an enjoyable experience. I look forward to the day where I can use this as a product. Again a huge congratulations to everyone who was behind this.

A possible solution? Would love to hear any feedback - please shoot this down with any flaws you find!

What if we had a centralized certificate authority that verified a person? Imagine you walk up to the DMV and get a private key (password). When you go to a website you generate a public key and send it to the website you visit. That website uses the public key it received to send a message to the certificate authority to verify you (true/false). Now Instagram knows you are real, but are you faking? I claim to be "First Last" to Instagram. Instagram encrypts "First Last" using the public key and sends it to the certificate authority. If the certificate authority is able to decode "First Last" using the private key then it returns (true/false).

Could we extend this to solve user privacy? What if users said "Track me all you want as long as you don't know who I am". Websites can still serve targeted ads but users get the privacy that you are incognito. Instagram now knows your name but they also want to be able to identify you across the internet. So Instagram could also ask the certificate authority for a "personId" that identifies the person across the internet. But now you say, wait now Instagram knows my name and all my activity through my "personId". This is where the Engineers come in. We would have to make any code or action that connects "personId" to a human _illegal_. You write the code, you go to jail. This burden would only fall on websites that ask for someone's human identifiers (name, address, common geolocations, etc.). But that code isn't needed anyway! There is no reason to store "personId" and "First Last" together because you can always get a "personId" when the user gives the public key to the website. So if someone ever writes that code / uses that data query it's punishable by law.

So now we have 1. Every website knows it's users are real 2. Every website can know a user is who they say they are 3. Every website can track unique visitors and their internet activity (while not knowing who they actually are) 4. Every user is completely "anonymous". Yes the information could get out, but only temporarily because any code (even a news article or blog) that contains this connection is illegal.

Also want to second this. The team behind the code is much more important than the code itself.

SOCAS?

Does this identify with you at all?

- You’re checking out everyone else’s PRs and requesting changes for all the bugs you find. The few times you don’t a major outage occurs.

- Everyone’s asking you for help all the time. You actually find a way to “help” all of them but really you’re just solving their problems for them

- You say you love your job, but really it’s not like what it used to be. You’re no longer excited to be woken up at 2am to fix an outage.

- You never aimed to be here, doing this, working here. But here you are and this is now your baby.

Your baby has grown up. As long as you are here the stress will eat at you. But can I encourage you that a better life awaits you. Change will be hard, but what is waiting for you on the other side is so much better. But it takes humility, humility that “project x” will go on without you (definitely not as smoothly but others will step up to the plate). Humility to try something new where you are in the bottom 10% working your way up once again. It will feel like you’re giving up all the hard work you’ve put in, giving up what makes you king of the hill, but it’s worth it. It’s worth it because life isn’t about being king, but about the journey. Welcome to a life of freedom, of learning something new every day, of waking up each morning and diving into whatever is on your heart to discover.

Find something better.

Don’t quit social media. Don’t restrict yourself by setting rules you’ll break a few days later. Why? Because it doesn’t work.

Life can be and will be about what you are passionate about.

So sure go ahead and enjoy wasting time on the internet. But after 15-30 minutes when it’s no longer enjoyable but rather you are seeking that enjoyment you first had, get up and try something new. It might be awful (so one and done), but it also might be amazing. It might just become the activity you wake up excited to do every day that social media/web scrolling doesn’t even compare to.

If it makes anyone feel better my creativity peaks at about doing paint by number. Somehow I got a 92 (98.6 percentile)