HN user

disconnection

29 karma
Posts7
Comments15
View on HN

Still waiting on a reply and the logs so I can do forensics on this incident. IMO the response from Railway should have been: "all hands on deck, red alert, worst imaginable security breach for a PaaS". Not a small yellow alert popup about a CDN misconfiguration, and saying that all affected customers have been emailed, which is demonstrably not correct.

I have a hierarchy of templates, where I can automatically swap out parts of the prompt based on which LLM I am using. And also have a set of benchmarking tests to compare relative performance. I treat LLMs like a commodity and keep switching between them to compare performance.

Cheers! Yes, I recommend it - it's a lot of fun.

There are probably easier to install and better LLM models than mine for home use. But my project should work if you have enough Python knowledge to install all the libraries. Just throw a bunch of text files into the "data" folder and uncomment "train()" in main.py, and it will save checkpoints of the model parameters into the "models" folder.

Q: What is a dog? A: To get a frog.

Q: Why did the chicken cross the road? A: Because it was Sunday.

With "Q: " as a prompt, it will make its own jokes:

Q: How do you cross a race with no cold birds? A: Because they did the toothache entirely.

Q: Why did a figureur hit a like? A: Because a joke.

Pure comic genius!

---

The prompt format is:

Q: {user question}

Here is part of the fine-tuning set (real dad jokes from the internet - not what was generated):

Q: What do you call a fake noodle? A: An impasta

Q: How do you organise a space party? A: You planet!