HN user

cafed00d

495 karma

[ my public key: https://keybase.io/cafed00d; my proof: https://keybase.io/cafed00d/sigs/UxoW_PSvm9hEa-ZeqiNPeicOmLwuV9ZAjFyydVfqR0k ]

Posts3
Comments140
View on HN

Open with multiple browsers (safari vs chrome) to get more "accurate + glanceable" rankings.

Its using WebGPU as a proxy to estimate system resource. Chrome tends to leverage as much resources (Compute + Memory) as the OS makes available. Safari tends to be more efficient.

Maybe this was obvious to everyone else. But its worth re-iterating for those of us skimmers of HN :)

To me, AI hype seems to be the most tangible/real hype in a decade.

Ever since mobile & cloud era at their peaks in 2012 or 2014, we’ve had Crypto, AR, VR, and now AI.

I have some pocket change bitcoin, ethereum, played around for 2 minutes on my dust-gathering Oculus & Vision Pro; but man, oh man! Am I hooked to ChatGpt or what!

It’s truly remarkably useful!

You just can’t get this type of thing in one click before.

For example, here’s my latest engineering productivity boosting query: “when using a cfg file on the cmd line what does "@" as a prefix do?”

How do you think about core business logic (or at least, _significant_ business logic) being embedded within prompts like here: https://github.com/langmanus/langmanus/blob/main/src/prompts...

Do you think or worry about not-being able to test these things? (Or is that just me :))

Details: I ack/understand this comes from a dependency (ReAct agents); not directly langmanus.

But, still, curious what the community/hn-tech thinks of testability, veracity, potentially conflicting or overlapping instructions across agents, etc, wrt “prompts” as sources of logic. Ack its a general practice with LLMs.

Jevons paradox 1 year ago

Absolutely! Even for inference! The SOTA models for all commercial purposes need to run on a consumer’s device.

Running either Grok2 or DeepSeek or even Llama405b requires nearly 400-500gb of memory.

Buying a tinybox with enough gpu memory costs $15k-25k. Or equivalently the same if you build your own.

A distributed Mac cluster costs about the same, if not more, if you’re buying 2-3 M2 Ultra each with 192gb of memory.

So people are absolutely constrained by price/supply here. Every engineer, analyst, scientist would be far more untethered by rules & regulations or policies & terms-of-service nitty gritties if they can trust that LLM they use is completely local, without-telemetry or tracking and is licensed fairly for commercial use (perhaps this excludes llama).

Not a lot of people can afford $15k-30k in spending for a computer (that can run this sota llms). But you can a billion will buy one when it’s $1k

It could be much worse: how many projects simply die because they’re locked away in a corporate basement because some corporate attorney decided it’s “too risky to leak IP”

Despite all the layoffs & black founding fathers debacles Google as an institution has had recently, it still has the systems in place to let passionate engineering projects see the light of day.

That’s really cool!

I’m on an H1B visa since 2017. I extended in 2021 and again in 2023 (thanks to approved I-140). But my visa stamp in my passport is from 2017 which expired in 2020. I haven’t made efforts to get another stamp mainly because of the pandemic in 2020 and long appointment backlogs thereafter.

Is there a necessity to always keep a valid visa stamp in my passport? Apart from the ease of travel are there any other reasons to always keep a current visa stamp in my passport? I do have all valid I-797 documents of status and have kept my status current all the time.

Nobody cares 2 years ago

The 12 years or so I have lived in America I have observed that people always keep the door open for those walking behind them. Always. Everywhere. DC, Boston, LA, New York, Seattle, Cupertino, everywhere.

Nobody cares about anything. Somebody cares about something. Everybody cares about everything.

I think the truth is somewhere in the middle. This makes me optimistic. At least, its nice that people care to hold doors open : )

New iMac with M4 2 years ago

Or please tell me how to use the magic mouse while it's charging? Am I just holding it wrong?

is that really a deal-breaking decision to buy an iMac? Yeah, sure, I agree it's super silly design that they put the port under the mouse; but c'mon, does it really matter?

As far as I can tell, I have never had to explain to my 61 year old Indian mother how to use a Mac as much as I have had to debug every little thing on Windows PCs. Macs & Apple products _truly_ do "just work"

More than a majority of a software engineer’s time is spent on bug triage, reproducing bugs, simulating constituents in a test, and debugging fixes.

Doesn’t matter what the computer becomes — AI, AGI or God-incarnate — there’s always a role between that and the end-user. That role today is called software engineer. Tomorrow, it’ll be whatever whatever. Perhaps paid the same or less or more. Doesn’t matter.

There’s always an intermediary to deal with the shit.

Hmm, I wonder if that’s the roles priests & the clergy have been playing all this while. Except, maybe humanity is the shit God (as an end user) has to deal with

I cannot agree more! Fish shell is the absolute best! I think I may have switched over to it in 2017 _because_ of Julia's blog. And it has been a boon for my productivity.

I set up a whole dotfiles tracking system and periodically keep making backups of the config. Fish has been sole system that has travelled with me to different machines, different companies, running on Macs, running on Linux, running on personal laptops, iMacs, and so so many different versions/instances of workstations on the server in docker, in aws etc etc.

I worked at Amazon in 2017 and we had a whole "developer environment" system built off of Apollo and my Fish config fit right in with the company-defaults for various build systems, log systems, metrics yada yada. I wrote myself a ton of nice aliases, new functions, new scripts.

I moved to Apple in 2019 and brought my Fish config over (sans any Amazon-specific things of course) and all my customizations have ported over nicely. They play well with all the Apple-y unique configs this company now gives its engineers.

Fish has been snappy & delightful.

I guess one could argue zsh could work just as well and has the benefit of being compatible with native bash syntax. But I found zsh and its ilk (oh my zsh) too slow tbh. They're nothing --and I mean zilch, nada-- compared to the speed of Fish. Fish w/ Bass (love the puns in the fish community, btw) accomplishes much of the backward compatibility needs with bash or bash-like syntax; while still performing at the snappy speeds of Fish.

Love Fish! Love Julia's notes! Ahh life is just perfect sometimes!

While we're fanboying over Julia, here's a picture of the time I made myself a t-shirt from Julia's zines of Recurse Center's values: https://x.com/b0rk/status/876571293491109889

He could visit all the apps in the world from Facebook, Instagram, YouTube to Spotify on the web, right? Of course, he cannot use Friendster or Tumblr or Vine — all great iPad 4 era apps but can you really blame Apple for those apps _not_ existing anymore? — So I wouldn’t say “there’s nothing he could do with it”

Well if your argument is: “a perfectly good 10 year old iPad is held hostage by Apple because they don’t provide side loading” then isn’t that the same case with your perfectly good 10 year old Toyota? Or 10 year old Target Toaster oven or 10 year old Samsung fridge?

I think we will live in a strange world if we start demanding our refrigerators allow side loading YouTube.

Reading the comments is convincing enough to believe there is no viable business to be built on the mobile web. It's great technology, sure; but not a great business. Mobile web apps won't pay the bills for people who build them. It seems worth everyone's time to have those mobile web devs instead build native apps. Ergo, Apple's "dips" are justified costs of doing business.

Why can’t a business be built solely without giving Apple a dime? The web is free — as in freedom and as in gratis. It has a developer tools system funded by hundreds of companies, developers and community members.

There’s hardly any order of dipping, if any.

Why doesn’t the web compete away Apple’s “dips”?

I 100% agree. I'm no Musk stan; in fact, it irks me this dude has so much money & power that he wields for personal benefit (i.e. buys twitter and shuts down @elonjet) and yet acts like he's relatable to the middle class.

But if there's anything he's proven it's that he can ship product. Tesla cars are phenomenal. xAI looks exactly like what Tesla looked like in 2010. Far too futuristic & optimistic timelines that peers & laypersons would characterize as fluffy grandiose snake-oil.

But I bet they will ship. And it won't be fluffy nor snake-oil.

How does one decide what constitutes "basic"? Is a password-manager a "basic" feature? If so, then is "Passwords.app" bundled by Microsoft into Windows an unfair advantage because of distribution when compared to "1Password.app"? Ok, then, can Microsoft make a button called "Passwords" in their "Settings.app" and that qualifies as a non-competitive "basic" "Settings" feature?

There are only two acceptable solutions to this problem:

1. No error message. Just recover the cached message.

2. The message is deleted

There’s a world we live in where ahem-ahem a certain design focused company would’ve done it this way.

Ultimately, it’s the responsibility of the Mail app to make a decision on whether to recover the cached message or not. It’s those engineers & designers who built that damn cache in the first place. And the server too.

Let _them_ deal with the consequences of messages existing in one but not the other. It’s not the user’s job to care.

That’s a bit too cynical. I agree the nefarious data guzzler of an ad machine is siphoning up that voice data but hey if that’s all they wanted they had Google Fi/Voice etc.

This definitely seems like a Google building products people will love. Let’s just hope they don’t kill it in 2 days/weeks/months/years

Calculus has never gone out of style ;)

Todays ML frameworks grapple with the problem of “jacobian-vector products” & “vector-jacobian product” as a consequence of understanding the interplay between gradients & derivative; and the application of the “chain rule”. All of those 3 concepts are fundamentally understood by being proficient in calculus.

While I’m being the hype-man for calculus I don’t mean to say proficiency in linear algebra or statistics is in any “less necessary” or “less useful” or “less challenging” or “less..” in any way.

I’m merely stating that, historically, calculus has been the unique branch of study for engineering. Statistics has always found value in many fields — business, finance, government policy etc.

Sure Linear algebra is one of those unique fields too — I kinda like to think of it as “algebra” in general and perhaps its utility has flowed in tandem with calculus. Idk. I haven’t thought super hard about it.

I agree a hundred percent that domain knowledge is the single most dominant influence to problem solving expertise.

You’re right it’s a total guess. It’s based on my experience in the field.

My strong “opinion” here comes from an observation that while calculus may have been a required subject of study in awarding engineering degrees, the reality is, people didn’t really study it. They just brushed through a couple of pages and wrote a few tests/exams.

In America there’s plethora of expert software engineers who opt for a bachelors degree in computer science that is a BA not a BS.

I think that’s complete totally reasonable thing to do if you don’t want to grind out the physics and calculus courses. They are super hard after all. And let’s face it, all of the _useful to humanity_ work in software doesn’t require expertise in physics or calculus, at least until now.

With AI going forward it’s hard to say. If more of the jobs shift over to model building then yes perhaps a back to basics approach of calculus proficiency could be required.

Yeah computer science went through this weird offshoot for 30-40 years where calculus was simply taught because of tradition.

It was not really necessary through all of the app developers eras. In fact, it’s so much so the case that many software engineers graduating from 2000-2015 or so work as software engineers without a degree in BS. Rather, they could drop the physics & calculus grind and opt for a BA in computer science. They then went on to become proficient software engineers in the industry.

It’s only after the recent advances of AI around 2012/2015 did a proficiency in calculus become crucial to software engineering again.

I mean, there’s a whole rabbit hole of knowledge on the reason why ML frameworks deal with calculating vector-Jacobian or Jacobian-vector products. Appreciating that and their relation to gradient is necessary to design & debug frameworks like PyTorch or MLX.

Sure, I will concede that a sans-calculus training (BA in Computer Science) can still be sufficiently useful to working as an ML engineer in data analytics, api/services/framework design, infrastructure, systems engineering, and perhaps even inference engineering. But I bet all those people will need to be proficient in calculus the more they have to deal with debugging models.

Calculus, because all of engineering depends critically on the modeling of real world phenomena using ordinary or partial differential equations.

I don’t mean to disregard other branches of math — of course they’re useful — but calculus stands out in specific _applicability_ to engineering.

Literally every single branch of engineering. All o then. Petrochemical engineering to Biotech. They all use calculus as a fundamental block of study.

Discovering new drugs using Pk/Pd modeling is driven by modeling then drug<->pathogen repo as cycles using Lotka models.

Im not saying engineers dont need to learn stats or arithmetic. IMO those are more fundamental to _all_ fields, janitors or physicians or any field really. But calculus is fundamental to engineering alone.

Perhaps, a begrudging exception I can make is its applications in Finance.

But every other field where people build rockets, cars, airplanes, drugs, or ai robots, you’d need proficiency in calculus just as much as you’d need proficiency in writing or proficiency in arithmetic.

I always likened "engineers"[1] to "people who are proficient in calculus"; and "computers"[1] to "people who are proficient at calculations".

There was brief sidestep from late 1980s to early 2010s (~2012) where the term "software engineer" came into vogue and completely ran orthogonal to "proficiency in calculus". I mean, literally 99% of software engineers never learned calculus!

But it's nice to see that ever since ~2015 or so (and perhaps even going forward) proficiency in calculus is rising to the fore. We call those "software engineers" "ML Engineers" nowadays, ehh fine by me. And all those "computers" are not people anymore -- looks like carefully arranged sand (silicon) in metal took over.

I wonder if it's just a matter of time before the carefully-arranged-sand-in-metal form factor will take over the "engineer" role too. One of those Tesla/Figure robots becomes "proficient at calculus" and "proficient at calculations" better than "people".

Reference: [1]: I took the terms "engineer" and "computer" literally out of the movie "Hidden Figures" https://en.wikipedia.org/wiki/Hidden_Figures#Plot

It looks like ever since humankind learned calculus there was an enormous benefit to applying it in the engineering of rockets, aeroplanes, bridges, houses, and eventually "the careful arrangement of sand (silicon)". Literally every one of those jobs required learning calculus at school and applying calculus at work.

I like to think back to 2011 and paraphrase what people were saying: "Is anyone seriously using gpu hardware to write nl translation software at the moment?"

"No, we should be use cheap commodity abundantly available cpus and orchestrate then behind cloud magic to write our nl translation apps"

or maybe "no we should build purpose built high performance computing hardware to write our nl translation apps"

Or perhaps in the early 70s "is anyone seriously considering personal computer hardware to ...". "no, we should just buy IBM mainframes ..."

I don't know. Im probably super biased. I like the idea of all this training work breaking the shackles of cloud/mainframe/servers/off-end-user-device and migrating to run on peoples devices. It feels "democratic".

The wall socket in your house is completely your property too. Yet, you don’t have a right to demand the socket company to put a semiconductor chip in it, along with the installation of an OS, along with an App Store and tools that allow you to download Netflix directly from their own App Store.

Like I said: they’re not buying a simple rearrangement of atoms. Heck they’re free to dunk those atoms they paid for into baby oil. Nobody cares.

Nobody is entitled to dictate what _software_ should be on the device. If end-users have the right to _software_ then that right cannot be selectively applied in the case of phone or laptops: it should fairly applied in all cases: including your refrigerator. Why doesn’t the government compel Samsung to enable Spotify & third party App Stores on those devices?

There is technology that goes into ensuring an app runs on a device — the dynamic linked libraries being present, the compilers adapted to the specific instruction set shipped on that device’s chip, the algorithms, ci/cd pipelines, that go into ensuring all that language design, debugger tools, profiling and performance tools, and then the online infrastructure to support things like backups, iCloud, cross-device sync, device to device transfers on upgrades/new phone purchases. Yeesh the details!

“Afford to provide basic development tools” is a conniving way to put it. Forcing a company via legislation to fund, and develop tools is more like what’s happening.

What’s happening here is a couple of greedy app developers want to skimp out on paying for the nitty gritty details of making a customer experience actually work.

So, yeah, pardon me for inaccurately categorizing them all as “server costs” — I definitely misused that word — but there’s no way in hell you can expect all of the other tech to come for free or even at a price that the _developers demand the tool maker to set_

All this litigation, back-and-forth is going to tarnish the user experience.