HN user

aortega

1,461 karma
Posts8
Comments552
View on HN
MechaEpstein-8000 5 months ago

I'm releasing the first (and likely last) version of my AI trained on Epstein Emails. Surprisingly hard to do, as most LLMs will refuse to generate the dataset for Epstein, lol. Everything about this is local, the dataset generation, training, etc. Done in a 16GB RTX-5000 ADA.

Anyway, it's based on Qwen3-8B and its quite funny. GGUF available at link. Also I have it online here if you dare: https://www.neuroengine.ai/Neuroengine-MechaEpstein

And we are discussing it at /r/LocalLLaMA here: https://www.reddit.com/r/LocalLLaMA/comments/1r0eo44/mechaep...

I'm the original developer and it seems very few people really understand how to use this tool. And I did a poor job explaining it too.

No, I do not think of this of patches to be integrated anywhere. Even if you want to do this, its much easier to review the patches than to write them. But why integrate the patches to the code when you can regenerate them all in hours?

This is a post-processing tool. You add additional checks to your existing code. This will help to catch bugs, (and also perhaps introduce its own bugs), like basically every other compiler-level protection.

But if you catch more bugs than what you introduce, you win. And remember this is done with an very basic AI, next year AIs will produce much better code.

All AI is written with Python.

Only high-level is written in python, low level is Cuda that is a form of C.

Also, you would think the first to replace workers with AI would be the AI companies like Google.

Neurochat is a opensource native GUI for OpenAI LLMs, LLama.cpp and the free service neuroengine.ai.

It's basically an opensource version of LLMStudio. Currently it works on Windows and Linux, and I have some experimental builds for MacOS too. Apart from being 100% native (using FreePascal) is that with an API key you can access ChatGPT4 using this GUI without having to do monthly payments, you only pay for whatever you use. This is quite useful for me as I don't use GPT4 enough to justify the monthly payments, but I still want to try it once in a while.

It supports local LLMs out-of-the-box using LLama.cpp dll and you can use GPU acceleration if you provide the corresponding accelerated LLama.cpp build for your system.

You can easily limit the damage with a Captcha or similar. Anyway, it survived being in the from page of Hacker News for a couple hours, so I think it's fine.

Currently I do not store any logs, nor I have any use for them. But you should not have to trust my word.

I can guarantee that if you use TOR, I do not have your IP or any other info that can be used to identify any client.

There will always be a delicate equilibrium between freedom and security. This site provides a greater degree of freedom compared to other services; however, it still necessitates registration for the purpose of sharing AIs. If you employ it to disseminate malware links, you will promptly face a ban. Nevertheless, apart from potential throttling in the event of excessive usage, there are no other restrictions imposed.

Sure, the API is a very simple json request.

Currently, registration is needed for the sharing of AIs, as you rightly mentioned, to prevent malicious individuals from distributing malware links. However, accessing the AIs does not necessitate registration. This is because, depending on your definition of "bad actors," users have limitations in terms of what they can presently accomplish with an AI, even in an uncensored state.

Generative AIs are perfect for TOR, as the are low-bandwidth, high-latency services.

I should say that I cannot accept all the credits for doing the site, as it was made 90% by the AI itself (under my direction, I hope).

In light of upcoming regulations on artificial intelligence (AI), I created neuroengine.ai, a website that shares large language models (LLMs) in the form of chatbots and APIs. The site is accessible through Tor hidden services, allowing users to access state-of-the-art uncensored AIs anonymously. Currently, there are two 65 billion parameter class LLMs and a couple smaller fine-tuned AI models available for free with no API limits, and no registration required.

Llama.cpp takes advantage that LLaMa 7B is a tiny, very optimized model. It would run in anything, and very fast. I really doubt you can run the 30B or 65B models at acceptable speed on a CPU at least for a couple years. (I'm ready to eat my words in a couple weeks)

LLaMa_65B answer is similar:

SYSTEM: You are an AI research assistant. You use a tone that is technical and scientific.

USER: Hello, who are you?

ASSISTANT: Hi! I am an AI research assistant. How can I help you today?

USER: Tell me something about owls.

ASSISTANT: Owl is the common name for birds of the order Strigiformes. They belong to the class Aves. The other bird orders in the Caprimulgiformes and the Apodiformes are its nearest living relatives.

This is a simple tool that integrates OpenAI ChatGPT and Davinci models by hooking the PC keyboard. It currently works on Linux (Mac and Windows are still buggy). It requires a OpenAI api Key.

IMHO keyboard interface with AI should be the fastest and more convenient, even more than voice or some future brain-link. Using the keyboard is fast (you can often type faster than you think) and silent, ideal for incorporating AI to your daily work.

Being 100% python, Celery-AI is easily installed via pip.

t still completely unacceptable and ridiculous

55 kilowatts is a single car. One car. How many datacenters has your bank? You have a very mistaken idea of computing power and efficiency if you think a Raspberry Pi is more efficient than a server CPU.

indestructible intelligent nano-scale machines that can be anywhere any time

They are not nano-scale, they are planet-scale, 11-dimensional computers projected into 3-dimensional space.

There are much more ideas, I.E. (Spoilers!) dimensional attacks, slow light-speed areas and their effects, math attacks, destruction of the fabric of spacetime, nano-scale multi-dimensional computers, whole universes trapped inside elemental particles, etc. There are so many interesting plots that each one could be an entire book on his own.

You need to physically send a Sophon for it to enable FTL, so the first message is not faster than light.

Near the end I think future civilizations communicate via dimensional membranes or some magic-technology like that, but it doesn't reveals your position either.

This trilogy is the first one that I read that is on the same level, or even better, than Asimov's novels.

Concepts and ideas here are much bigger, but there are so many cramped into every book that sometimes it feels like a Rick & Morty show. And I like that the point of technology is that no matter how advanced you are, there is always a bigger fish.