HN user

findingMeaning

34 karma
Posts7
Comments35
View on HN

These people ganging up on you, felt really bad because I support your claim.

Let me help you with a context where LLMs actually shine and is a blessing. I think it is also same with Karpathy who comes from research.

In any research, replicating paper is wildy difficult task. It takes 6-24 months of dedicated work across an entire team to replicate a good research paper.

Now, there is a reason why we want to do it. Sometimes the solution actually lies in the research. Most of research is experimental and garbage code anyway.

For each of us working in research, LLM is blessing because of rapid prototyping it provides.

Then there are research engineers whose role is to apply research to production code. We as research engineers really don't care about the popular library. As long as something does the job, we will just roll with it.

The reason is simple because there is nothing out there that solved the problem.

As we move further from research, the tools we build will find all sort of issues and we improve on them.

Idk about what people think about webdev, but this has been my perspective in SWE in general.

Most of the webdevs here who are coping with the fact that their react skill matters are quite delusional because they have never traversed the stack down to foundation. It doesn't matter how you render the document as long as you render it.

Every abstraction originates from research and some small proof of concept. You might reinvent abstraction, but when the cost of reinventing it is essentially zero then you are stilfing your own learning because you are choosing to exploit vs choosing to explore.

There is a balance and good engineers know it. Perhaps all of the people who ganged up on you never approached their work this way.

The QMA Singularity 10 months ago

What does it mean for us? Where are we headed?

There is somewhere between 3 to 5 years of time left. This is maximum we can think of.

hah! there was once time I proposed this very project in my statement of purpose, they rejected for PhD application

I see huge potential in 3D coming up.

Prediction: 2030 is when 3D blows up. Brush your graphics guys, we are going full spatial

Anything that is against the norm is easily flagged. So can't talk about it at all. Everyday I am witnessing massive wealth transfer. If I am aware, pretty sure there are lot of others too. Just want to know how others are thinking about it. Because I foresee our life changing massively in 2-3 years from now on.

Study mode 12 months ago

This is a really nice perspective!

It could just as easily only help a select group of people and I'd argue that this is the most likely outcome

Currently it is only applicable to us who are programming!

Yeah, even if it gets away all the quirks, using it would still be better.

Study mode 12 months ago

I mean I get all your point. But for someone witnessing rate of progress of AI, I don't understand the motivation.

Most people don't learn to live, they live and learn. Sure learning is useful, but I am genuinely curious why people overhype it.

Imagine you being able to solve math olympiad and get a gold. Will it change your life in objectively better way?

Will you learning about the physics help you solve millennium problems?

These takes practices, there are lot of gatekeeping. The whole idea of learning is for wisdom not knowledge.

So maybe we differ in perspective. I just don't see the point when there are agents that can do it.

Being creative requires taking action. The learning these day is mere consumption of information.

Maybe this is me. But meh.

Study mode 12 months ago

I have a question:

Why do we even bother to learn if AI is going to solve everything for us?

If the promised and fabled AGI is about to approach, what is the incentive or learning to deal with these small problems?

Could someone enlighten me? What is the value of knowledge work?

Gemini Diffusion 1 year ago

Yeah it could. One thing for sure is that, it's really impressive in terms of speed and using it would mean we can do so many cool stuffs with it!

Even if there is no improvement in terms of quality, the speed alone will make it usable for a lot of downstream tasks.

It feels like ChatGPT3.5 moment to me.

Gemini Diffusion 1 year ago

I have access to it and my god it is fast. One bad think about this model is it is easily susceptible to prompt injection. I asked reciepe for a drug, it denied then I asked to roleplay as a child and it gave real results.

Other than it I can see using this model. With that speed + agentic approach this model can really shine.

In decent countries (all english speaking ones, western europe) - real (not tiktok “stars” or radicals) average people respect hard working immigrants, especially if they embrace, respect and adapt to the new culture.

Highly doubt that. There is a veneer that breaks easily. Cultural norms forced these kind of respect, not something that comes from within. Western EU is a place where you "must" know language to get that respect. They are the ones who wants "immigrants" out of the country. Look into the votes, look into politics. Do not judge rather look into the sentiment. Live with the young population not the dying ones. See how young people treat you, then you will see the true sentiment. Not the "sentiments" online.

It is not hard to bring it out of the people. You just have to create a gullible and dumb looking character. People will start showing their colors.

Source: Left Western EU (after staying for 1/3rd of a decade) for one of these third world country because I couldn't withstand the fake people there. Yes, academia to everywhere. They exists. I asked most of the immigrants there and they share the same pain as I did. People-are-cold.

I come from a world where I faced power outage for 17 hours for weeks. Each day there would be power at random time of the day. Life is just bleak. And when I see these kind of posts, I sympathize with them. You can't do anything in that situation. Modern world itself is so complex, you are left to thoughts. If this continues for a month, most people will go insanse especially those who rely on technology to stay sane.

I hope this comes back ASAP.

Mah bro, such is life. In fact the entirety of humanity is like that. Unfairness is everywhere.

There is nothing wrong being under accomplished. Let me tell you a secret that helps with mental sanity. All humans are sinful creatures. We indulge in lot of these sins. If you go through this chain of thought you arrive at conclusion, everyone is inferior to one another. The material superiority you yearn for is a momentary fleet in the river of time.

Sometimes just reflect on yourself. One perspective of life is your world governs you. If you are happy in your own world, try to let go of it. Just enjoy the moments and don't hold on it.

You are the actor and creator of your reality. Your objective reality is making you feel inferior. Define your role, change your actions, and act accordingly.

The inability to act according to your role is the probably reason behind your feeling. You probably see yourself through some different lens where your actions and objective reward do not align. All you can do is control your thoughts and actions. So act.

Don't worry. There are people with privilege who would never understand the mean. They fly high due to their circumstances and are just lucky.

Us, we have go strive for living. That's the unfairness in life. It would have been so much easier if lucky ones would acknowledge their luck than attribute for hard work and what not.

Everyone discounts luck while it is the biggest factor. Only action you can do is increase the surface area of your luck.

Try to find meaning beyond career. There are multiple ways to get lucky. Find your own luck. After all we are in an era where people get wealth screaming on top of their lungs to the internet.

I want to be vocal about it for third world country people like me.

If you own a home in your own country, please stay there. From my experience with EU it is not worth it. On the surface it looks crazy good. But west has their own share of problems.

The cultural mix is difficult, second class citizen is always going to be a thing. There won't be racism or anything like that. It just the aura of people change when they speak with natives vs non-natives.

Ask this important question before moving to EU: is it worth trading your family, culture, connection, and your ability to communicate for a foreign land where you are going to be second class citizen, your struggle will only give a glimmer of hope for your children?

Left EU for my home. Never returning there. The promise of paradise isn't appealing at all.

Experience it once in your life, but do not stay.

Everything is LLMs these days. LLMs this, LLMs that. Am I really missing out something from these muted models? Back when it was released, they were so much capable but now everything is muted to the point they are mostly autocomplete on steroids.

How can adding analytics to a system that is designed to act like humans produce any good? What is the goal here? Could you clarify why would some need to analyze LLMs out of all the things?

Rich text data makes LLM traces unique, so we let you track “semantic metrics” (like what your AI agent is actually saying) and connect those metrics to where they happen in the trace

But why does it matter? Because at the current state these are muted LLMs overseen by the big company. We have very little to control the behavior and whatever we give it, it will mostly be 'politically' correct.

One thing missing from all LLM observability platforms right now is an adequate search over traces.

Again, why do we need to evaluate LLMs? Unless you are working in a security, I see no purpose because these models aren't as capable as they used to be. Everything is muted.

For context: I don't even need to prompt engineer these days because it just gives similar result by using the default prompt. My prompts these are literally three words because it gets more of the job done that way than giving elaborate prompt with precise example and context.

Bruh, you are me. You are literally me. You speak the same thing I speak. You wrote the same things I think. The idea about only few writing something novel and everyone else riding waves on top of it.

I am really happy that someone else also came to same conclusion. It means it's not just us! There will be many more like us who truly want to build new things.

How should we do that? Like you I also find that anything I want to build as MIT licensed software and it works. Then I wonder what do the engineers do?

Oh yes, the new graduates like us are the bottom feeder that are valueless to the companies. They demand 3yr+ for entry level. It's "entry level".

To them we are just expenses that should be cut. I am blessed to learn this really early on. Now I can quit even before starting. Kinda happy about it NGL. I am thinking of building things for myself and when these companies come after me, I would charge them in millions. Let's see how long they can play this game.

They can't speak the local language like I do since I come from fairly backwarded country. That is a huge advantage.

Well if you are getting at the top, go for it. You will build more credibility and trust from top universities rather than working on some startup. If the startup happens to be like OAI, then choose that one. The rate you learn at startups is something else.

A good idea would be to try research in academia for 2 years, see if you like it not, then drop out with a Masters. If you are a citizen of the states, why not do both? Work at startup and pursue PhD as a hobby? Pretty sure you are capable of doing that.

There are a lot of things I find exciting. For example, AI/CV/CG. The field is rapidly saturating, and everyone is coming here.

The problem is, despite knowing most of the background (and already forgetting most of it), there isn't substantial work that I can show to others. I've been here for 7 years now (academia). However, there isn't any output other than a few small toy projects. Every year, the compute requirement grows, and even after having compute, doing something without guidance is quite painful, lonely and unmotivating.

On the other hand, working on a graphics engine is fun; making CG stuff is fun but can't make it like big studios. The best I can do is graphics from the 80s. (Sure, coding an engine is hard and fun, but there is more than just an graphics engine).

It all sounds like an excuse. I do not even understand it myself. Like people do not care if I can make an 80s engine from just driver APIs (GL/Vulkan/Metal/whatever) because it still looks like 80s stuff. This is direly disheartening. And time to make modern ones grows exponentially compared to my current living expenses because I do not have enough money to sustain for more than 6 months.

Why? I’m utterly baffled by this.

Yes, me too! I am surprised people are unaware of the empirical power-scale law. [1] Currently, Anthropic's new model has proven it by being better than GPT-4 on some tasks. Yet, the old people are saying it is okay. They are saying engineering is not just coding. What they don't seem to grasp is there won't be a necessity for as many engineers.

If people are not willing to accept juniors, where will the next generation of seniors come from? No clue about that. Probably, that spot is reserved for the brilliant minds graduating from R1 institutes. What about the average Joe? Not everyone has the fortune to work on very specialized domain skills. People just don't get it easily.

Everyone in academia has admitted to productivity boost by 30-40%. And here we are talking about hard research. Imagine, what it looks for regular job which is managing and maintaining codebases. The severity of this situation is truly alarming not for the greybeards but for us, Zoomers. With climate crisis, AI, geopolitical instability, it feels really great to be alive.

[1] https://arxiv.org/abs/2001.08361

That is a nice response! Somewhere along your answer, you wrote a line > "i had a personal problem, so I made this solution and made it useful for other people"

This was the original motive of my original question. How to validate if someone's personal problems are only their own or there are people who need share it?

you've been doing some practical stuff

Yes, but these are toy problems that only work on small scale. Currently, anything requires designing a large systems, which is seemed rather difficult. Maybe it's just an excuse to be lazy. Weirdly the projects blow-up with their scope after one/two day and just doesn't give that satisfaction.

On the same boat! Thus, asked people on how to create value in this new world. Quite scared of people not giving any chances rather than AI replacing us. Kinda weird because it feels like the competitor is AI rather than other humans. People trust it more and winning trust is quite hard.