hedgehog0

I love “Becoming Steve Jobs” much more than the official biography.

they sometimes include some sort of alternate way of applying (to avoid the bots)

This looks interesting, could you please elaborate? Do you mean like on social networks?

https://archive.ph/GlWNS

Thank you for your suggestions!

Originally I was more interested in ML/DL theory and mech interp, so you can see I was more into theory. Recently, I am also curious and leaning towards learning more about how to build products with foundational models, such as LLM; for instance, recently I got the "LLM's Engineer Handbook [1]".

If you want to work with ML you likely need the PhD + get lucky.

I do am interested in doing PhD in theoretical computer science, but I'm not too sure about AI PhD as I heard many (not-so-good) things about it.

If you are interested on it because of AI, it's better to focus on LLMs and more NLP related fields.

Do you have any recomenndations that you have gone through that you think are helpful?

[1] https://www.oreilly.com/library/view/llm-engineers-handbook/...

Thank you for posting this! It's really informative to read...

Out of curiosity, for people who have do projects in both Django and Ruby on Rails, which one would you prefer and why?

I learned Python more than 10 years ago, but later chose Rails to be my first web framework to learn, as I also wanted to learn more about Ruby, hence the question.

De Wolf's note is also one of the standards right now, and more up-to-date than the QC&QI book: https://arxiv.org/abs/1907.09415

Thank you for your reply. In your other comment, you mention that you know Ruby relatively well. Would you recommend learning Ruby along side with Rails (i.e., learning Ruby in/with Rails), if I have some experience with other languages, such as Java, Python, C/C++, Lisp, and so on?

Also are there any Ruby AI libraries that you would recommend? Thanks!

If you're doing AI stuff, any Python framework will be best.

I understand that AI stuff now is mainly Python. But is it possible to connect Rails with some Python program/service, is this one of the purpose of microservices?

Congrats OP and it looks really nice! Out of curiosity, may I ask what’s ur tech stack for developing this software? I’m also an aspiring app developer :) Thank you!

Thank you for the Mozilla AI guide, it's really useful! I knew some of Justine's work and they are really cool.

May I ask how small? From what I see on r/localllama, it seems that at least 3B and 7B ones are starting to be useful? Also I cannot use CUDA or modern AMD cards..

I see Lisp I upvote ;)

For the curious, Daniel Friedman and Anurag Mendhekar wrote a book called “The Little Learner”: https://www.thelittlelearner.com/

Thank you for the introduction, really glad to learn about this!

Wow, that sounds interesting! What do you think of traditional recommendation system algorithms vs AI-powered recommendations?

Thank you for the recommendations! In fact I also read his article [0] yesterday, which was somewhat related to my questions.

[0] https://blog.codinghorror.com/building-a-computer-the-google...

Do you have any recommendations and/or suggestions, homelab subreddit seems to recommend things like Dell R720.

Remember the “enterprise” nonsense is babble if you have a team who can think and operate outside the box.

I am quite new to sysadmin, security, servers, networking, and so on.

Do you have any recommendations of materials (like books or videos) for these kinds of topics, e.g. how to optimize hardware

About that, I am waiting for the quad core version to arrive. I liked it so much I bought another unit that I will use just for Nextcloud in RAID. > I am amazed by the zimablade performance especially as it is a very low specs machine theoretically. Never tried the zimaboard but I have no reasons to do it.

Thanks! Then I will consider buying one for myself!

Yes, we were moving these hosting services to a mid-tower "server" (actually a normal PC with linux). Thermals surely were better handled due to the size of the build but from my personal experience you can add some thermal solutions to NUCs and get the same / better results. Note that the mid-tower build I am talking about would be considered low spec nowadays (I don't remember exactly the specs but it was surely pre-2019).

No problem, thank you for the clarifications!

To give you a practical example, you can try > https://view.tcsenpai.com/feed/popular (invidious instance hosted on the Jetson Xavier) > https://swing.tunnelsenpai.win/#/ (hosted on the ZimaBlade) > In my opinion, while being way cheaper, the ZimaBlade obliterates the Jetson Xavier (which btw is forced to run at 20w vs 6w and must use Ubuntu 18.04 with a 5. something kernel)

Fun examples!

Why would you use home-grade "servers" when a startup has access to a variety of cheap cloud solutions? What business market segment in a server space would these mini PCs occupy?

This is more of a hypothetical question. From simple use, the Beelink SER5 I have seems to have better performance than my 13-year-old Macbook Pro, so I was curious about the upper bound / limits of little machines like it.

May I ask what you mean by "a variety of cheap cloud solutions", do you refer to services such as DigitalOcean's Droplet and/or similar products?

I am using a ZimaBlade (2 cores, 16gb DDR3L RAM) as my cloud server, and an old Nvidia Jetson NX (very outdated ARM CPU with negligible GPU power) as my email server. I also run a bunch of frontends and apps on both. They work flawlessly.

How do you like the ZimaBlade and NVDA Jetson? I actually want to get these two, and have been consider going with ZimaBlade or ZimaBoard...

I want to have a Jetson for LLM purpose, but after checking the specs, I don't think it would be powerful enough though...

...... we were in the process of moving a bunch of hosting services on a mid-tower server which actually was less powerful than nowadays NUCs

Do you mean you are moving these hosting services to a mid-tower server (English is not my first language, so to is easier for me to understand than on). Would you say that even if they are not more powerful from performance perspective, but they offer some server-specific functionalities that NUCs don't, such as better thermals?

Thank you for the reply! Do you mean the Estonia e-residency? If you got one, may I ask what your experience with it has been? I have always been thinking about it.

May I ask which countries in east Europe would you consider to be good and convenient, esp for foreigners (non-EU)? When I visited Budapest I like it there, but don’t know much about the tech scene.

Also, what would you say about the advantages of hosting yourself, compared to say fly.io or similar services? For instance Docker or container seems to “the way” right now? I’m relatively new to web dev…

Thank you for your input! I always considered a Raspberry Pi, though I bought an Arduino first last night……

With sufficient and appropriate configs, how many users do you think a Pi can serve at the same time, say, with Rails or Django?

I also agree with you on that many things were not invented or appeared during those early time, and C (or Common Lisp) was common choices than say Ruby or Python.

Thank you for the story! I will look into more history.

I’m a math grad student and want to play with LLMs as well, so I have been thinking about getting a 3060 or 3090, due to budget. However, I’m using a MacBook Pro from 2011, thus not very convenient for these kinds of things.

What do you think the lowest budget or spending that I should have, given my “requirement”? Or would you say that vast.ai or similar websites would suffice?

Sounds interesting. May I ask what do you do with SBCL? Like what kind of business.

mflatt FTW!

Any any suggestions or recommendations for learning these rules? Either for future business or current personal finance management?