HN user

ragle

154 karma
Posts0
Comments48
View on HN
No posts found.

This reminds me of a nightmare I had in college one semester when I was taking 18 credit hours and consulting part time.

I'd been up for days and had been cramming for a computer architecture exam when I basically passed out.

I had this very visceral nightmare where I was a compiler and the C code was coming faster than I could translate to ASM. I kept trying to escape but it was like I was locked into the work in this never-ending grinding cycle I couldn't escape from. The dream went on for what felt like hours until I woke up drenched in sweat.

Hopefully these neurons aren't satisfying whatever sufficiency threshold delimits consciousness. Approaching some weird ethical territory in any case for sure.

I think a lot of people have projects like this going at the moment, but I'm working on a deterministic (i.e. code / data persistence) layer that sits between agents and helps orchestrate their work.

Basically an API wrapping a cyclic graph where rules govern the state transitions / graph traversal (i.e. rules around handing off work between agents and the associated review, rollback and human intervention escalation logic).

It's mostly just to teach myself about multiagent patterns and what blend of "agentic autonomy" and deterministic / human governance gets the best results with the current set of (Anthropic) tools available.

I don't really know what I'm doing w.r.t AI, but having 15 years of industry SWE experience (high-availability distributed systems and full-stack web dev) on top of a fairly-solid CS education I feel like I know what the results of a working system should be and I'm learning a lot about the AI pieces as I go through trial and error.

Generally it feels like there are lots of ways the next generation of AI-assisted coding workflows could work best (beyond just "AI helps write code", I mean) and the results will be as much about the tooling built around the AI bits as it will be the improvements in models / AI bits themselves (barring a theoretical breakthrough in the space).

Trying to figure out what my personal dev workflow will look like in the middle of this evolving landscape is what led to this project, very much a scratch my own itch thing.

I hate it, but I'm actually counting on this and how it affects my future earning potential as part of my early(ish) retirement plan!

I do use them, and I also still do some personal projects and such by hand to stay sharp.

Just: they can't mint any more "pre-AI" computer scientists.

A few outliers might get it and bang their head on problems the old way (which is what, IMO, yields the problem-solving skills that actually matter) but between:

* Not being able to mint any more "pre-AI" junior hires

And, even if we could:

* Great migration / Covid era overhiring and the corrective layoffs -> hiring freezes and few open junior reqs

* Either AI or executives' misunderstandings of it and/or use of it as cover for "optimization" - combined with the Nth wave of offshoring we're in at the moment -> US hiring freezes and few open junior reqs

* Jobs and tasks junior hires used to cut their teeth on to learn systems, processes, etc. being automated by AI / RPA -> "don't need junior engineers"

The upstream "junior" source for talent our industry needs has been crippled both quantitatively and qualitatively.

We're a few years away from a _massive_ talent crunch IMO. My bank account can't wait!

Yes, yes. It's analogous to our wizzardly greybeard ancestors prophesying that youngsters' inability to write ASM and compile it in their heads would bring end of days, or insert your similar story from the 90s or 2000s here (or printing press, or whatever).

Order of "dumbing down" effect in a space that one way or another always eventually demands the sort of functional intelligence that only rigorous, hard work on hard problems can yield feels completely different, though?

Just my $0.02, I could be wrong.

My experience has been almost the opposite.

Typing isn't the fun part of it for me. It's a necessary evil to realize a solution.

The fun part of being an engineer for me is figuring out how it all should work and fit together. Once that's done - I already basically have all of the code for the solution in my head - I've just got to get it out through my fingers and slog through all the little ways it isn't quite right, doesn't satisfy x or y best practice, needs to be reshaped to accommodate some legacy thing it has to integrate that is utterly uninteresting to me, etc.

In the old model, I'd enjoy the first few hours or days of working on something as I was designing it in my mind, figuring out how it was all going to work. Then would come the boring part. Toiling for days or weeks to actually get all the code just so and closing that long-tail gap from 90% done (and all interesting problems solved) to 100% done (and all frustrating minutia resolved).

AI has dramatically reduced the amount of time the unsatisfying latter part of a given effort lasts for me. As someone with high-functioning ADD, I'm able to stay in the "stimulation zone" of _thinking_ about the hard / enjoyable part of the problem and let AI do (50-70%, depending on domain / accuracy) of the "typing toil".

Really good prompts that specify _exactly_ what I want (in technical terms) are important and I still have to re-shape, clean up, correct things - but it's vastly different than it was before AI.

I'm seeing on the horizon an ability to materialize solutions as quickly as I can think / articulate - and that to me is very exciting.

I will say that I am ruthlessly pragmatic in my approach to development, focusing on the most direct solution to meet the need. For those that obsesses over beautiful, elegant code - personalizing their work as a reflection of their soul / identity or whatever, I can see how AI would suck all the joy from the process. Engineering vs. art, basically. AI art sucks and I expect that's as true for code as it is for anything else.

Perhaps he and other true geniuses can understand things transcendently. Not so for me. My thoughts are serialized and obviously countable.

You needn't be a genius. Go on a few vipassana meditation retreats and your perception of all this may shift a bit.

any kind of theorem or idea communicated to another mathematician needs to be serialized into language which would make it computable

Hence the suggestion by all mystical traditions that truth can only be experienced, not explained.

It may be possible for an AI to have access to the same experiences of consciousness that humans have (around thought, that make human expressions of thought what they are) - but we will first need to understand the parts of the mind / body that facilitate this and replicate them (or a sufficient subset of them) such that AI can use them as part of its computational substrate.

Likewise. I was 2-3 days into testing positive and had a fever that could not be controlled by maximum strength OTC antipyretics, awful cough producing glue-like greyish globs, headache, blood oxygen consistently 2-3% below typical for me, extreme fatigue.

~48 hours after beginning Paxlovid I felt almost back to normal. spO2 returned to typical wake / sleep levels, lungs clearing, little fatigue, etc.

Based on how sick I was when I started treatment, if historical patterns of recovery from respiratory illness are any indication I would have expected an additional ~9-14 days of tapering symptoms at minimum.

Instead I was basically totally normal again after ~5-6 days.

If I get COVID again I will absolutely ask for Paxlovid.

This makes sense. I've mostly been successful doing these sorts of things as well and really appreciate the way it saves me some typing (even in cases where I only keep 40-80% of what it writes, this is still a huge savings).

It's when I try to give it a clear, logical specification for a full feature and expect it to write everything that's required to deliver that feature (or the entirety of slightly-more-than-non-trivial personal project) that it falls over.

I've experimented trying to get it to do this (for features or personal projects that require maybe 200-400 LOC) mostly just to see what the limitations of the tool are.

Interestingly, I hit a wall with GPT-4 on a ~300 LOC personal project that o3-mini-high was able to overcome. So, as you'd expect - the models are getting better. Pushing my use case only a little bit further with a few more enhancements, however, o3-mini-high similarly fell over in precisely the same ways as GPT-4, only a bit worse in the volume and severity of errors.

The improvement between GPT-4 and o3-mini-high felt nominally incremental (which I guess is what they're claiming it offers).

Just to say: having seen similar small bumps in capability over the last few years of model releases, I tend to agree with other posters that it feels like we'll need something revolutionary to deliver on a lot of the hype being sold at the moment. I don't think current LLM models / approaches are going to cut it.

I wonder about this too - and also wonder what the difference of order is between the historical shifts you mention and the one we're seeing now (or will see soon).

Is it 10 times the "abstracting away complexity and understanding"? 100, 1000, [...]?

This seems important.

There must be some threshold beyond which (assuming most new developers are learning using these tools) fundamental ability to understand how the machine works and thus ability to "dive in and figure things out" when something goes wrong is pretty much completely lost.

In a similar situation at my workplace.

What models are you using that you feel comfortable trusting it to understand and operate on 10-20k LOC?

Using the latest and greatest from OpenAI, I've seen output become unreliable with as little as ~300 LOC on a pretty simple personal project. It will drop features as new ones are added, make obvious mistakes, refuse to follow instructions no matter how many different ways I try to tell it to fix a bug, etc.

Tried taking those 300 LOC (generated by o3-mini-high) to cursor and didn't fare much better with the variety of models it offers.

I haven't tried OpenAI's APIs yet - I think I read that they accommodate quite a bit more context than the web interface.

I do find OpenAI's web-based offerings extremely useful for generating short 50-200 LOC support scripts, generating boilerplate, creating short single-purpose functions, etc.

Anything beyond this just hasn't worked all that well for me. Maybe I just need better or different tools though?

The other side of this challenge is that the "technology" is mostly irrelevant for above-average applicants with solid CS chops.

I apply for lots of jobs featuring technologies I haven't used (beyond toy personal projects or something in college) because I have a long history of picking up new tools and being productive in weeks or months at most - because I understand the underlying semantics of the tool regardless of its presentation, syntax, etc.

Keyword scanners (and humans focused on keywords) are unable to hire me for roles where I haven't used the technology (much) before - and I guess that's fine and well as I am indistinguishable on paper from someone who doesn't know what they're doing.

Just presenting it as another part of the challenge of both finding good people and for good people finding good jobs.

I haven't used the remarkable but I bought a screen protector for my iPad that's intended to yield a paper-like writing and drawing experience when using the Apple pencil. It gets pretty close I think.

N.B. if you go this route you'd need to replace the Apple pencil tips a bit more regularly than you otherwise would given the rougher surface you're "writing" on.

I want to share a personal anecdote, as I recently spent quite a bit of time deciding whether or not to leave Mac OS for linux (Manjaro) this year for my personal computing needs - primarily because of gaming. Ultimately, I did make the switch. Several years back, Apple broke most of my steam library with Catalina. I wasn't a serious gamer, but I had a lot of nostalgic games from the aughts and early 2010s that ran great (pre-Catalina) on my top-of-the-line mid-2015 retina MBP.

I finally retired that machine this year and bought a higher-end gaming pc for less than half of what it would cost me to get a less-than-the-best Apple Silicon MBP.

Yeah, it's heavy. Battery life isn't great. But my phone has replaced so much of my mobile computing needs that I don't really need to take a laptop with me when I'm traveling unless it's for work, in which case I'll have my company-issued machine with me anyway.

I never thought I'd leave MacOS for Linux - but I recently got back into gaming and basically wasn't willing to spend $4k+ on a machine I couldn't game on when all of my personal project needs, etc. can be attended to on a cheaper gaming laptop.

The fact that Apple Silicon is an absolute beast, graphically, made it all worse somehow. Like having a Ferrari in your garage that you aren't allowed to drive - only pay for and look at.

Am I Apple's target demographic? Apart from being a developer - probably not. I don't do a lot of multimedia stuff (at least, I don't do anything that isn't adequately served by a PC with a solid GPU). Because I grew up on linux I'm right at home there with all of my non-work dev / geek / fun stuff and that probably makes me an outlier.

Apple's success clearly speaks for their business savvy - and, there's now a number of chinks in my (previously 100%) Apple loyalty across my wide array of gadgetry (several Apple TVs and one each for me and my wife of: laptop, ipad, iphone, watch, airpods). After a disappointing battery experience with my airpods - I replaced them with some excellent-sounding soundcore buds. My apple watch needs to be replaced soon and I'll probably get a Garmin (again - battery life and consistent failure to capture VO2 max on outdoor runs, other frustrations). I enjoy VR gaming and plan to upgrade from a quest 2 to a quest 3 instead of buying a vision pro. What's next to go in my Apple line-up? I don't know but I've become much more open to shopping around for non-Apple tech than I was in, say, 2016 when it seemed to me that nothing else could compete with Apple.

I wonder how true this is for Apple's "geek core" of tech professionals, and how much of it is just my unique little anecdote? And, in any case - does Apple care? They've cornered the market for both the technical-artistic and "luxury" class. Plenty of meat on those bones without worrying about the geeky whims of the pesky few that are open to (and capable of) something like abandoning Mac OS for Linux.

Still, it was sad to give up my Mac OS personal computing environment. I love Apple - but for what I care about, Apple just doesn't seem to love me. We'll always have our iOS time together I guess, for now anyway.

  *  $3500 price tag
  *  2D / "Arcade" games support (lol)
I'm a buyer 3-4 generations in if price comes down significantly and I can replace my monitors with it. The seamless use with a mac for work will be really nice - but isn't worth $3500 to me for a gen 1 device / experience.

For now, I'm probably just going to get a Quest 3 when it drops this September. In terms of a virtual work environment - immersed is _almost_ there on a Quest 2. Maybe Quest 3 will be the ticket to a compelling experience. If not, well... I still have my library of dozens of VR games to make it worth $600 (or w/e).

Still, excited to see what Apple does with this platform over the next five or so years. The "macbook air" version of this a few years down the road will probably be more my speed!

Anecdotal: the app "One Sec" broke my twitter habit over the course of a few weeks.

Via iOS' automations feature the app allows you to configure a per-app waiting period during which you can decide you don't actually want to open whatever app you've tried to open.

Very grateful for this tool.

I can only speculate - but I'm really curious.

Looks like they may have launched a hypersonic missle that reached speeds of ~Mach 10[1], and the US (publicly, at least) seems to be lagging behind China and Russia in Hypersonic R&D - at least as of 2019[2].

How long would it take for a missile traveling at Mach 10 to reach a point where a high-altitude EMP attack[3] would cripple the west coast of the US?

Is that time longer than it would take for aircraft to return to a place where they could land? If NORAD spots a bogey moving that fast, is the rule right now just... everything stops until we understand what's happening?

Would love for someone who knows about hypersonics, NK missle capabilities, EMP attacks, etc. generally to say more.

[1] https://www.reuters.com/world/asia-pacific/nkorea-launches-p...

[2] https://www.defensenews.com/naval/the-drift/2019/11/15/dont-...

[3] https://spectrum.ieee.org/one-atmospheric-nuclear-explosion-...

"Car Guys vs. Bean Counters: The Battle For the Soul of American Business"[1] by Bob Lutz tells this story really well, from Lutz' vantage point trying to salvage General Motors from the clutches of an army of MBAs.

There's a decent summary of the book (and the general problem) in the 2012 Time article "Driven off the Road by MBAs"[2] as well.

[1] https://www.amazon.com/Car-Guys-vs-Bean-Counters-ebook/dp/B0...

[2] http://content.time.com/time/magazine/article/0,9171,2081930...

Whether or not we are in a bubble is increasingly the wrong question to be asking in an age where failure for sufficiently-large institutions is no longer permitted.

The question used to be pretty simple: "has a sufficient portion of the market been priced out to the extent that demand collapses"?

As we've seen in equities / derivatives (and increasingly, commodity) markets - the answer to that question is now perpetually "lol, number go up" because large investment banks have essentially infinite access to free money and will be bailed out if they get in trouble.

On a long enough timeline the end result of this is that more and more Americans write their rent checks to institutional investors. [1]

Sure, many Americans own their homes now (or have a nice cushion of equity). But what happens as wage growth continues to stay relatively flat while cost of living rises dramatically and folks need money for medical bills or their kid's college tuition (or w/e)? They sell and become renters.

There's a pretty bleak future for American housing absent regulation in this space.

[1] https://www.theatlantic.com/technology/archive/2019/02/singl...

I can totally understand that sentiment.

I don't know about you, but for me the obvious way in which politicians and other powerful sorts have abused and perverted religious devices (and systems of control) to achieve their own ends has left a really bad taste in my mouth generally w.r.t anything "control-y' about religion.

The religious motivation behind control in monasteries is something different, though (at least when uncorrupted by politics and power).

Monasteries are, by design, very controlled environments. That's _exactly_ what they are supposed to be.

A place where you can safely get lost in ecstatic bliss, altered states of consciousness and the sometimes-difficult psychological territory of self discovery that typically follows these experiences.

The guard rails are put there by people who have travelled the road before and know what the pitfalls are.

For anyone curious about that (from a Christian monastery context):

* Cloud of Unknowing (Anonymous)

* The Dark Night of the Soul (St. John of the Cross)

* The Interior Castle (Teresa of Ávila)

Similar material exists for guiding e.g. Buddhist monks through the sort of territory that comes up when people spend a lot of time alone in contemplation (The Visuddhimagga, The Vimuttimagga in the Theravada tradition, The Tibetan Book of the Dead in the Vajrayana tradition).

Shamanic traditions likewise have very strict schedules of diet and spiritual preparation before aspirants can consume psychedelics - and ceremonies are (traditionally) performed under exquisitely controlled conditions.

Incidentally - westerners who play with meditative technologies or "psychedelic" therapies absent a regular, working relationship with a guide who know the territory do so at their own peril, IMO.

Thousands of years of contemplative and meditative practice have yielded independently arising systems in many different cultures which call for a controlled environment where a practitioner is surrounded by peers who know what to do, and more importantly what _not_ to do when things get a bit weird.

That's JUST for the individual practitioner.

Now add another layer for "things that can go wrong when trying to manage / lead a large community of people doing these things together".

Many mystical traditions (particularly eastern ones) solve this problem by having rules about how long monks and abbots can stay in one place.

Here, we see some western solutions to the common problems of community governance (at least: the sorts of problems one was likely to encounter at the time).

I've meandered really widely around the point! :)

Really I just wanted to call out that there is a valid (within the context of the goals of spiritual practice) use for a very controlled environment that should be considered separately from the common understanding of "religious control" (i.e. the powerful and political abusing religious devices to exert control over the masses).

Right.

For a very good (but not exceptional) developer, I wonder if ending up "out on the street" would be a reasonable expectation if something like this became truly widespread.

If companies like Google were no longer able to filter false positives __at Google scale__ using their current hiring practice, I wonder how long it would take to decide that the next best thing is to contract some tunable number of N contractors for K positions where N >> K and only keep the best M (K <= M << N) of them. (I expect a company like Google to occasionally keep more than K because they can't afford to throw away rockstars if they get a great cohort).

So, even if you're pretty good - if you aren't better than the bottom x% of your cohort (or some other aggregate measure) - you're out. Stack ranking for C2H, basically.

There are cryptocurrencies like monero whose primary purpose is to facilitate transactions between wallets that cannot be observed (I think).

If they've traded into that currency somewhere, how does one know where that money pops back up - on however many exchanges, under however many identities, in however many amounts, over whatever period of time they drip it back in?

I'm reminded of a paper I read a while back about deanonymizing VPN traffic if you have sufficient observability of nodes in the overall network and something else I can't remember at the moment.

Seems different though. The time they could take to drip money back in to the visible network (for conversion to fiat or appreciation in a "visible" coin) feels like a factor.

edit - heh, just now seeing the article you posted about the FBI's team explicitly mentions a case like this with Monero.

Apologies in advance for the wall of text, but this is a topic that has occupied a considerable portion of my attention for nearly 25 years. :)

If any of what I share here is helpful for someone, it will be well worth drifting significantly off topic and perhaps over-sharing my personal experience.

That said, my experience is my own - other people's mileage may vary depending on their background and personal makeup. Trust your intuition (and your doctor / therapist if you have one)!

From your comments below (about being able to notice yourself out of existence), it sounds to me like you experienced both udayabbaya-nana (knowledge of arising and passing away) and bhanga-nana (knowledge of dissolution), as well as the other dukkha-nanas (knowledges of suffering) that follow [1].

It also sounds like you are familiar with the Zen analogs for these Theravada terms - sharing them here mostly for other readers.

These are well-known and understood phenomena, at least in Buddhism. Some modern yogis refer to this territory as the "Dark Night", a term borrowed from St. John of the Cross' work describing the experiences from a mystical Christian perspective[2].

The Atlantic had a good piece on this (touching on some relevant research at Brown) several years back [3].

I went through something similar to what you've described here with meditation, and similar to what many others have described here with psychedelics.

It took years of searching, research and growth for me to process and integrate these experiences and return to both a stable, consistent meditative practice and enjoyable / helpful use of psychedelics, including cannabis (which gave me panic attacks for many, many years).

For anyone who is in similar territory but wishes they could continue exploring: Bhajan / Kirtan [4] (example [5]) and Yoga Asana were both incredibly helpful for me, as was a-melodious chanting of various mantra and stotra.

Coming at the problem as a programmer with some understanding of machine learning - I looked at chanting practices as training data for my own biological neural network. A way to re-wire my relationship with meditation / spiritual practices / ego death.

The transition from my atheistic Buddhist practice to a sort of mystical pluralist practice that integrates many traditions was an interesting one, for sure.

I stopped seeing "god" as an absurd, surely-non-existent (for everyone) personal entity and began recognizing "gods" as undeniably-existing (for me) hybrids of:

* helpful anthropomorphic representations of key truths

* helpful anthropomorphic representations for lawful phenomena

* at the highest level: helpful conceptual placeholders for things that are completely impossible for me to describe

As a former atheist, I slowly became more and more comfortable with this framework. I think this was a combination of having grown up in a religious environment; having mystical experiences, searching for answers and finding documentation (independently arising in many different traditions) that closely mirrored my experiences; and feeling like there was tremendous mind-shaping power in a shared subconscious framework transmitted through trance-inducing chants practiced by millions of people over many centuries.

Like many, I would encounter truths through various mystical experiences and find great relief - only to fall back into unhelpful habitual patterns later. A daily relationship with one's personal Gods (in whatever form they take for you) is a very powerful psychological anchor for remaining tethered to truths discovered through mystical experience.

Lectures by Ram Dass[6], talks by Mooji[7] and dharma talks from many different teachers at Dharma Seed [8] also helped considerably.

I have some conjectures rattling around in my mind about _some_ manifestations of mental illness having _some_ of their roots in the territory of ego death (or close brushes with it). Many of us live in a society where all of our basic needs are met and there is ample time for introspection. Moreover, many of us fill a good deal of our non-introspective free time with music, cinema and television which has been shaped (directly or indirectly) by artists and thinkers under the influence of mind-expanding drugs, leading to further introspection (at least this was the case for me and many of my peers).

That is, I don't think someone necessarily needs to even be a yogi to wander into Dukkha-nana territory. Though, to be sure, the proliferation of superficial "mindfullness" practices will add to the aforementioned dog pile of causes and conditions for initial "spiritual awakenings" (for lack of a better term).

I'd love to share my entire journey and more thoughts on this (including 8 years living and traveling in Asia, trying to find answers). One day!

Lastly: if you find yourself in this territory and things are really bad, there are resources available to you! Check out: https://spiritualcrisisnetwork.uk.

Shenzen Young also has really helpful advice about when it's time to seek help from a medical professional: https://www.youtube.com/watch?v=BQ5B70ac_9M

==

[1] http://www.buddhanet.net/knowledg.htm

[2](pdf) - http://www.carmelitemonks.org/Vocation/DarkNight-StJohnofthe...

[3] https://www.theatlantic.com/health/archive/2014/06/the-dark-...

[4] https://en.wikipedia.org/wiki/Kirtan

[5] https://www.youtube.com/watch?v=YBso7TPtvJU

[6] https://beherenownetwork.com/category/ram-dass/

[7] https://podcasts.apple.com/us/podcast/satsang-with-mooji/id1...

[8] https://dharmaseed.org/talks/

I don't get what introvert has to do with focus.

A common object of attention for Samatha (one-pointed concentration / tranquility) practice is a Mandala or Kasina.

The copy on the site and the mandala-like art the app generates leads me to believe the author hopes people can use the app for this (or a non-Buddhist equivalent concentration practice).

I just did a 10 minute session. It's excellent for this purpose!