michaelnny

An honest question, what’s the news on Wordpress episode? Didn’t follow the topic

One important aspect of the success of AlphaGo and its successor is the game environment is closed domain, and has a stable reward function. With this we can guide the agent to do MCTS search and planning for the best move in every state.

However, such reward system is not available for LLM in an open domain setting.

Wow, this is a great idea!!! Seriously!

The company I work for try to add AI/LLM on everything, instead of trying to improve/fix the underlying problem, they now just add the magic AI and everything is “perfect” now.

As an ML engineer and AI developer, I don’t see the real value at all, not to mention the added cost of using LLM

Maybe they have no idea what’s the difference between “scraping” and “mining”? I mean for non-tech people, these are just buzzwords…

I looked at the supposed “research” article, there’s nothing to read except few charts to show off the “improvements” over current models. No discussion of the training method or dataset whatsoever.

If I remember correctly, the last decent research paper the company published was probably the InstructGPT paper.

I’m curious where did you get this information?

I thought this was a joke at first, but then realized it totally made sense ;)

This there any sources on the closed model you just mentioned? Also, what do you mean “into a Python equivalent?

Anyone know how to use GraphRAG to build the knowledge graph on a large collection of private documents, where some might have complex structure (tables, links to other docs), and the content or terms in one document could be related to other documents as well?

I’ve deleted my reddit account earlier this year and I have no regret. Reddit has turned into something that’s unusable for me.

This is an interesting and well-timed, as I’m in the need to learn more about centralized logging and monitoring for my job.

I’m also wondering how does Uber handle structured logging

In case anyone is interested, we have a very simple notebook which try to trick GPT-4o to reveal the structure of the prompt/response related to function calling, and it's located at:

https://github.com/michaelnny/Llama3-FunctionCalling/blob/ma...

I'm wondering if the tensor parallel settings have any impact on the performance. My naive guess is yes but not sure.

According to the article: """ AMD Configuration: Tensor parallelism set to 1 (tp=1), since we can fit the entire model Mixtral 8x7B in a single MI300X’s 192GB of VRAM.

NVIDIA Configuration: Tensor parallelism set to 2 (tp=2), which is required to fit Mixtral 8x7B in two H100’s 80GB VRAM. """

Sorry forgot to change repo visibility, it's now public

Sorry forgot to change repo visibility, it's now public

Hi, just want to state that we would really appreciate if you can give us some advice or suggestions on this question!

Just to clarify, I mean I won't try to use vim to write the code.

I definitely recommend people to try the CS50 course.

I enjoyed the CS50 course few years ago, where they talked about how to build native apps with React Native.

I remember the professor/lecturer was using vim to write the code, no IDE whatsoever! That’s was very cool but I don’t think I’ll ever try it.

I think the main problem is the way we turn the raw mathematics symbols or equations into tokens, and these suboptimal tokenization may decreases the performance

I once worked at a company that put a large logo with the company name on their office building. They used the Microsoft YaHei font, and didn’t have the permission or license, so they got contacted by the Microsoft representatives. I’m not sure if they sued the company, but at the end the company I work for did pay some money to settle the case. That was about 10 years ago.

Although I don’t know Go programming language, I do appreciate people making stuff using as minimal dependencies as possible. I’m glad that I’m not the only one who has this habit.

Agreed, I still prefer to write my own CSS than using tools like Tailwind.

Yes I agree with you on that. However not every author can negotiate with the publisher to get the permission to offer the ebook for free on their own website (I got rejected on the idea).

I guess if you’re a famous one then you can probably get that , but now for average people?

This is really frustrating, because as an author you can’t offer your own book on your own website for free, while on some third party websites it’s already been downloaded thousands of times.

From my experience as an author of a tech book, the ebook is pirated even before the official publication date, the authors only have access to the ebooks fees days after the publication date. That’s why I’ll never write a book again.

https://link.springer.com/book/10.1007/978-1-4842-9606-6

First time author here, made quite mistakes both in the book and the process of writing it, and my biggest mistake is choosing the incompetent publisher.

I’m not looking to make money from writing books, my original plan was to write another tech book about LLM after the first one, however after my experience with the first book, I’ll probably never write another book!

The same applies to SAP

Thanks this makes sense, do you have any suggestions on how to handle the routing of hundreds if not thousands of individuals apps efficiently?