HN user

ixaxaar

276 karma
Posts10
Comments80
View on HN

Okay so regardless of the model, platforms provide attestation from end to end that nothing is being logged from either input or output, including at the firmware and OS level to the extent that the customers have proof of the data never being saved. AFAIK, both GPUs and TPUs support this.

From a third-world perspective, it feels like American politics being injected into the developer domain because of some previous biases that Americans had. Which is sad for a community that claims to be global.

Or maybe he was searching for "structure", the way Grothendieck was - in pure math, in systems biology, in complex networks (e.g. civilizations, culture, occult) and in individual behaviors

These are effectively identical to outsourcing your product to someone like Infosys.

But in my experience, the user has to be better than an Infosys employee to know how to convey the task to the LLM and then verify iteratively.

So more like an experienced engg outsourcing work to a service company engg.

Ah so like NIM is a set of microservices on top of various models, and this is another set of microservices using NIM microservices to do large scale OCR?

and that too integrated with prometheus, 160GB VRAM requirement and so on?

Looks like this is targeted for enterprises or maybe governments etc trying to digitalize at scale.

Hey guys, I built this large list of healthcare datasets from last year when I spent some time in researching and downloading them to try out various things (AI).

Hope this is useful to someone!

So a kind of lack of empathy? Do these guys have this image of "autists" and are basically filtering for them, cause this criteria seems to be favoring oppositional defiance disorder.

I mention this specifically because I remember mark andreseen comment something similar in lex fridman's podcast, something along the lines of getting "those creative people" together to build on ai.

I wrote a part of the kernel (uitron) for Toshiba SSDs that went into macbooks around 2013 on kate. It was my first and favorite editor :D

  Location: India
  Remote: Yes
  Willing to relocate: Yes
  Technologies: Python, Scala, terraform, k8s, scikit-learn, pytorch, transformers
  Résumé/CV: https://github.com/ixaxaar
  Email: ixaxaar at geniusrise dot . ai
I've built early stage startup teams, starting at 4-5, and taking them to 40-50. I can handle pretty much all forms of tech work - management, backend, frontend, devops, data engg, data sci, AI/ML

Some interesting links: https://github.com/geniusrise - containerized inference servers for LLMs etc (like NVIDIA NIM) https://github.com/ixaxaar/pytorch-dnc - reverse-engineered implementation of deepmind's DNC, SAM & SDNC http://monoid.space - pure math and theorem prover tutorial

Any org? Would, for example, openai be included in your definition of "any org"?

Look, "in principle" stuff is not how the real world works. AFAIK, hacks happen mostly because of carelessness. No one cares because no one cares if they care (and the compensations etc reflect that). I know enough such cases in fintech (forget about other verticals), which are mostly stupid like wrong RBAC, open firewall, AWS keys taken by roommate etc and not public of course.

Hey I did, and sorry for the self promo,

Please check out https://github.com/geniusrise - tool for running llms and other stuff, behaves like docker compose, works with whatever is supported by underlying engines:

Huggingface - MPS, cuda VLLM - cuda, ROCm llama.cpp, whisper.cpp - cuda, mps, rocm

Also coming up integration with spark (TorchDistributor), kafka and airflow.