What would be the right path to learn AI?

https://news.ycombinator.com/item?id=41633487

by unrequited • 2 years ago

13 9 2 years ago

news.ycombinator.com

I haven’t been keeping up with AI stuff except for trying out chat clients like ChatGPT and others. I’m a software engineer working in infra systems. I would like to pick up now that things in AI have gotten real. What would be the right path to learn AI/ML stuff? I’m someone who prefers ground up learning from fundamentals and building something using that knowledge. Any recommendations would be appreciated. Thanks.

chris_engel• 2 years ago

Well, it depends whats your cup of tea in terms of learning. There area a LOT of courses on Udemy on that topic (if you prefer learning from videos).

I would recommend looking around on HuggingFace altough I found it a bit intimidating at the beginning. The place is just HUGE and they assume some knowledge.

I would also recommend creating a platform user on OpenAI and/or Anthropic and look up their docs. The accounts there are free but if you put a few dollars in there, you can actually make requests against their APIs which is the most simple way of playing around with LLMs imho.

Here are some topics you could do some research about:

- Foundation models (e.g., GPT, BERT, T5)

- Transformer architecture

- Natural Language Processing (NLP) basics

- Prompt engineering

- Fine-tuning and transfer learning

- Ethical considerations in AI

- AI safety and alignment

- Large Language Models (LLMs)

- Generative models for images (e.g., DALL-E, Stable Diffusion)

- AI frameworks and libraries (e.g., TensorFlow, PyTorch, Hugging Face)

- AI APIs and integration (also frameworks to build with AI like LangChain/ LangGraph)

- Vector databases and embeddings

- RAG

- Reinforcement Learning from Human Feedback (RLHF)

- AI model evaluation and benchmarking

- AI-assisted coding and code generation

wruza• 2 years ago

This may be interesting https://news.ycombinator.com/item?id=38385257

bjourne• 2 years ago

This q has been asked so much already. Write an xor network from scratch in numpy. Then write one for mnist. Then cifar10/100. Then one rnn for text gen. Then you know more fundamentals than most practitioners.

karlzt• 2 years ago

I copied and pasted your question on FastGPT[0]:

Here is a suggested path to learn AI/ML fundamentals as a software engineer:

    Start with the basics of machine learning:
        Learn the core concepts of supervised, unsupervised, and reinforcement learning.
        Understand the key algorithms like linear regression, logistic regression, decision trees, random forests, etc.
        Get familiar with common evaluation metrics like accuracy, precision, recall, F1-score.

    Dive into deep learning:
        Learn the fundamentals of neural networks, including architectures like feedforward, convolutional, and recurrent neural networks.
        Understand the training process, loss functions, activation functions, and optimization techniques.
        Explore popular deep learning frameworks like TensorFlow, PyTorch, or Keras.

    Learn about data preprocessing and feature engineering:
        Understand how to handle missing data, outliers, and noisy data.
        Explore techniques for feature selection, dimensionality reduction, and data normalization.

    Practice implementing ML/DL models:
        Work through tutorials and build simple projects using the concepts you've learned.
        Try applying ML/DL to real-world datasets and problems in your domain.
        Participate in online coding challenges and competitions like Kaggle.

    Expand your knowledge:
        Learn about advanced topics like transfer learning, generative models, and reinforcement learning.
        Stay up-to-date with the latest research and trends in the AI/ML field.
        Consider taking online courses or pursuing a relevant certification.

    Develop practical skills:
        Learn how to deploy and monitor ML/DL models in production.
        Understand the challenges of scaling and optimizing AI systems.
        Familiarize yourself with tools for data visualization, model interpretation, and MLOps.

The key is to start with the fundamentals, build practical experience, and continuously expand your knowledge. I'd recommend using a combination of online resources, textbooks, and hands-on projects to solidify your understanding of AI/ML. Feel free to let me know if you have any other questions! "

[0] https://kagi.com/fastgpt?cf-turnstile-response=&query=%09Wha....

codingwagie• 2 years ago

Waste of time, just get good at using LLMs via api

notnotrishi• 2 years ago

'AI/ML stuff' is a lot and if you don't know what interests you yet I'd recommend developing an intuition for all things ML/AI and building small ML models first:

1. Spend 6h going through this video: https://www.youtube.com/watch?v=1vkb7BCMQd0

2. Go through Google's intro to ML crash course and pre-reqs: https://developers.google.com/machine-learning/crash-course/...

3. Refer to other videos on Youtube (3B1B and StatQuest are couple of my favs) as you go through no 2 above

Spend about a month on the above and then see what you really want to dig into next. There could be a few different ways after the above, but one way is speedrunning through 1st sem coursework of any top ML grad school program

tikkun• 2 years ago

See here https://news.ycombinator.com/item?id=36195527

nineteen999• 2 years ago

Have you considered asking an LLM? You have around a ~50% chance of getting a correct answer.

7373737373• 2 years ago

Andrej Karpathy's "Neural Networks: Zero to Hero" course https://karpathy.ai/zero-to-hero.html

What would be the right path to learn AI?

Related Stories