HN user

rmbyrro

3,760 karma
Posts8
Comments1,843
View on HN

I agree with you for some kinds of images, but not all.

LLMs are the best PDF-to-markdown converters, in my experience. I have a CLI that converts PDF to PNG, then run a background agent to "read" each PNG and write it down as markdown; it works flawlessly even for complex math formulas, it can "translate" complex charts, graphs, and tables into words.

It's slow and arguably expensive compared to traditional OCR, but very effective and precise.

That study seems to be confounding factors and rushing to a questionable conclusion.

A very plausible explanation for the adenoma detection rate to have gone down is simply that its prevalence went down among the population in the second three-month period.

This was not a randomized trial. Concluding that "AI usage degrades physicians' skills" is questionable at the very least.

[dead] 8 months ago

What's the value of something that has no utility and is not linked to anything useful or valuable?

I think this is analogous to diseases and vaccines. You don't immunize a child by exposing it to the pathogen, but to a modified version of it that poses no threat to their health, but still allows their immune system to recognize and produce anti bodies.

The same applies to teaching "street smarts" to kids. You don't do it by throwing them in a hostile environment where they'll be prey to hostile people without having any defenses built up first.

Empirical research [1] [2] shows that your worry is unfounded.

[1] Homeschooled Children’s Social Skills: https://files.eric.ed.gov/fulltext/ED573486.pdf

[2] Homeschooling and the Question of Socialization Revisited: https://www.stetson.edu/artsci/psychology/media/medlin-socia...

Edit: if I had to bet (don't know any research), schools nowadays are the main producers of intolerance, with the indoctrination and teaching kids to only respect civil discourse, ideas and opinions if they agree with the mainstream world model.

I think many Apple users, especially people in the software industry, would prefer Apple software to be open source. It's not that they don't care, it's just that Apple quality is superior in multiple ways (hardware and software).

And it's not a coincidence that their software is closed. They can command ridiculously high margins and continue to invest in high quality products.

exactly, connect AI to our existing digital lives

I think we do need to build new interfaces, though. The existing ones were designed for humans to use, either GUIs for end-users, or APIs for developers. But LLMs have very different reasoning patterns. They even make mistakes in different ways.

What I've experienced in practice connecting LLMs to existing APIs is that LLMs fail miserably with the interfaces, but simply "translating" the interface in a way that is easier for them to "understand" solves the issue.

The LLMs seem to have their own idea of how they want to do something

exactly! what I'm experiencing is that prompt engineering has its limitations and comes with inconsistency issues...

by designing the tool from scratch tailored to LLMs, we can make the interface match what their "own idea of how to do" that particular task, which is more reliable and scalable

Integrations between LLMs and real-world services are challenging because all our current interfaces were designed for humans.

While developing tools for LLMs, my team [1] and I came to the realization that we need a new engineering discipline. One that cares for the "machine experience", for building interfaces that are tailored to LLMs, having their 'preferences' and quirks in mind.

The LLM has to be seen as a consumer. A user itself.

We need a new breed of engineers dedicated to what we may call 'Machine Experience (MX) Engineering', just as we have UX Engineering, for instance.

[1] https://arcade.dev

if we jump across imaginary moral bars some people set up

Aren't you you the one setting up imaginary moral bars for what kinds of features a car should or should not have? And for what people should or shouldn't want in a car?

Aren't you the one believing "we're only allowed to combat human extinction" if we jump across your imaginary moral bars?

be creative in any kind of technical assessment

some people think SWE is about "logic". it is, in part, but the "engineering" in software is much more of an art than it is in other branches, like construction

the current sota AI is great at logic and terrible in creativity and actual engineering. if the technical assessment is not designed for you to show your creative engineering side, do it yourself, do more than you were asked, think about what would be relevant to that company in terms of engineering creativity and offer that

that's the best way I know of showing you're a real engineer, not an LLM operator, it's worked well for me in the job search process

good luck!

try using LangChain and you'll get countless examples of bad abstractions

started working with it this week for a new project

gosh, it's so painful and unintuitive... I find myself digging deep into their code multiple times a day to understand how I'm supposed to use their interfaces

the possibility of error is a requirement for AGI

the same foundation that makes the binary model of computation so reliable is what also makes it unsuitable to solving complex problems with any level of autonomy

in order to reach autonomy and handle complexity, the computational model foundation must accept errors

because the real world is not binary