gwoolhurme

it feels that way... these sort of garbage articles coming out are really frustrating.

Yeah? That is an opinion I don’t share but you are free to have it.

Fully agree that’s kind of my point though. It’s a very tall order for some people. Like the OP

To his defense, that is how it’s marketed. That this new model can reason.

I am sympathetic to that however this is also a company that consistently promises the moon. Their CEO recently put out a blog post about AGI in a few “thousand days”. They clearly do have a hype issue and it’s fine to point that out.

SWE management won’t be a thing either. Hopefully you can find another job.

Then quit now. Go find another job. Why do you feel that way? Give me something substantial instead of this.

Damn honestly why is this downvoted at all. Very anecdotal but I tried out the new o1-preview available to me, and it did not produce anything noticeably better for my domain. To claim this is “reasoning” to me seems infuriating

As others pointed out he seems to be talking more about about automation which... sure that's a fine discussion to have, but what bugged me more than anything is the overselling of Waymo/FSD. I understand a lot of this is also on a spectrum but it seems a bit irresponsible of Karpathy not to mention crashes Waymo has faced or other problems FSD systems have faced. It's not just an issue of scaling up, sensors, etc. There is more engineering work that needs to be put in clearly. It's fine to bring it up in his example of reactions to economical forces, but let's be completely honest about the whole thing.

It's not a god given right, but I worked really hard to get to where I am in life my visa is tied to my profession and I have a feeling it's going a way soon. Which means my visa might go away soon. I've gone from contemplate suicide to how to carry on. What you might think is awesomeness is dread for others. Just to point out there are 2 sides to this coin.

As someone who bounces back and forth between I will be okay to anxiety that I am doomed. I have no idea how to prepare for this future...

I actually don’t know what I should do. How I should prepare, what the future holds for me or us. I worked really hard to get where I am and it feels like it’s going to all crumble soon, and people who are more positive about things tell me either UBI will somehow fix things, and humans will persuade what they want or that we will all be in pain together so I won’t be alone. That doesn’t help. It’s given me actual nightmares.

I don't think the above comment disagrees that much with you. As far as paintings and poems go those are also pulling off of patterns that humans naturally have given off too right? An LLM is a bit more than a stochastic parrot sure, but it's also a large part of how it functions. The real surprise, or maybe not a surprise, is how formulaic everything is.

I can only see brutality personally. I’m not prepared. Once I lose my way of making a living I think it’s done basically. Time will tell, but it’s never been kind before, why now?

That's fair and I hope that is the case. That might even be fun, and I mean I actually have a lot of fun with gpt-4 now. My bigger complaint there then is that you need more money to be competitive in this industry now? Until LLMs become smaller more efficient? Like back in university the best student was a Russian immigrant who learned back in Moscow on pen and paper, no compiler to mostly handhold.

Every time I see these articles I get more and more worried about my employability to be frank... with no backup plan and way too much time poured into learning software engineering. It's not looking good gang.

I think it's even more interesting that the required amount of energy to do that high computational work isn't that high. Evolution has been working on it for a long time, and some things are really inefficient but overall it does an OK job at making squishy machines.

Yes. We need copyright... we need to rework it for digital stuff, however if you are an artist, writer, musician, programmer. You should have credit for the work you put out in some way no?

I see these posts popup every now and then. I admittedly don't use GPT4 or chatGPT that often, but I don't notice that much of a difference. Is it possible you try to give it harder and harder tasks and it is failing at them instead of the easier tasks it solved when you used it before? Is it possible it is just scaled back due to over use? Is that possible? It could be a dumb dumb question. In my experience even a few weeks ago, for Swift and Kotlin I found that the outputs of chatgpt and gpt4 are comparably similar and sometimes useless without a good amount of human intervention.

I don't feel that way personally... I have Nth level anxiety, maybe even N+1 level anxiety about losing my job to AI. Maybe in the future whoever comes next can enjoy things, but this literally keeps me up at night. With talks of extinction, job loss, etc. I feel like I wish I wasn't alive at this time.

Oh god so my background is CE/ECE stuff and you managed to trigger me. I don't want to be rude... just bluntly saying you triggered me. Doing something really small for A/D D/A with 8bit and not worrying much about resolution and data loss is one thing. For something massive scale the problem is a lot less trivial and a lot more mathematical.

Yeah they do all the time. I remember in my parallel computing course where we got to use our 800 core test PC back in grad school where people were running simulations of different weather patterns and climate change. Earthquake simulations and what not. A lot of that can be done taking advantage of all of those cores. Academia specifically heavily uses these to get closer to the "physics" with clear discrete limitations

I think that is his point. At most places I've worked at in my almost 15 years of experience, a senior title is not a title based on time but based on goal setting. Some places do that better than others for sure, but it's not just a magic you hit 7 years now you are a senior. A senior engineer in 3 years??? That's a SWE who is still taking baby steps in my experience.

You misunderstood what so many people here wrote with even more snark and a bad quote. It could and probably will replace my job and I have no contingency plan in place leaving me at great risk. That’s a given it seems. What isn’t is giving an estimate on a dollar amount and of time. Especially with any scientific rigor. The tool in the link is silly and that is what everyone is talking about. Perhaps you should try to be less bias reading the comments here.

That seems to also miss the intentionality that goes into some things in the kernel as well… I understand now you mean when a feedback of LLMs are improved on. I guess fair enough there, no idea if that will work till we see it. However I think the problem of a Unix-like kernel is a lot less trivial due to the human intentionality that goes into some choices as well as bit-banging optimization.

This seems sloppy too. Is this based on anything scientifically rigorous? Where I live even startups will take on less profit for a quarter to train new graduates who have never touched an IDE on purpose. The point of training a junior isn’t to be immediately competitive. It’s to take over your job as you move on to other roles.

What? Nobody is defending their jobs here. It’s explaining how non-trivial this is. What is the point of your comment? If you wanted pure token to money amount and are too lazy to calculate it your self use the tool in the link. That’s not how the real world even with an LLM will work. Let’s assume the LLM writes everything, even gpt4 won’t get everything in 1 go now. Requirements of software are hard to put into pure English… why write this snarky message. Adds nothing to the conversation.

It’s that good in your experience? Enough that it is close to writing something as nice as the Linux Kernel we have now? How close is close? Reading comments like these makes me feel like I’m swallowing crazy pills. It legitimately makes me feel like I’m using it wrong. I do Android and iOS native development and some IoT and it gives me really wrong code very often. To the point that I don’t see much difference between chatgpt and gpt4. But you say it’s close to just “write me a unix-like kernel”

Is this that hard of a tool? Why is it a package? Seems like something someone with a few lines of code could do. OpenAI is transparent and fairly open about pricing per token… it seems like it’s just adding bloat.

The entire premise of this thing is wrong too because what if you need to regenerate something? Which even with the mighty gpt4? Still happens a lot… It’s almost akin to me asking a co-worker how fast he types and calculating how much of his salary it is for him to generate code based on that without any other factors. Also pointed out but why is this even a package? It seems like the definition of bloat when this should have just been a blog post tool or something. It’s all completely unnecessary and seems to try and cash in on hype.