tingletech

it works quite will for me in llama.cpp, but I get more like 20% to 40% speedup on tokens per second. I generally use

  spec-type = draft-mtp,ngram-mod
  spec-draft-n-max = 4

I thought they got like a logit mask that removes illegal next tokens, at least in llama.cpp and GBNF.

depending on the age of the children, could it be designed this way for people who are not allowed to access the internet generally, but their parents will let them have the app installed for vacation?

The comments are not showing up for me now, but when they were still showing for anonymous users, there was a link to https://commoncrawl.org. I've been sort of worried about letting agents hit websites, I wonder if a fetch_url agent tool could be made to look in common crawl first before hitting the web for it?

I had just never heard of it before, I didn't realize it was well know. I was quoting from it's specification.

In the context of the title of the hn submission, I read “RAG Context” as “the retrieved content injected into the context window” .... "read" read /rε d/ not /riːd/

So when an agent does "cat file.txt" that's RAG to you?

No, that might be "RAG Context" though.

I read “RAG Context” as “the retrieved content injected into the context window”

"Standard ML is a functional programming language, in the sense that the full power of mathematical functions is present." From a Pdf linked on the repo (I didn't know what Standard ML was, I was hoping for a mark up language)

I just googled it a second ago https://martinfowler.com/articles/codemods-api-refactoring.h...

Google ships a local LLM with chrome browser nowadays. Don't they also provide the weights for the LLM built into iOS and MacOS?

You could also produce special purpose applications this way, say to provide access to the online library catalog, or a run a gopher client for use in a public terminal lab. Telnetting to a unix account running some sort of restricted shell was how these often worked.

A sibling comment I can't reply to asks if you can do with with unix permissions.

These were really intended for anonymous guest access, or at least often used for this purpose. You couldn't do the same things with the file permissions systems at the time.

When I was an undergraduate biology student in 1991 a suitemate told me I should go to some desk in some building over by Muir and get an account on the VAX. There were strange rooms all over campus that were open 24/7 and were loaded with green and amber screen terminals with integrated keyboards. Lots of sessions for CS lectures were held in these rooms and there was always interesting notes on the white boards (most rooms still had black boards or green boards, but think the chalk was too dusty so these rooms usually had the white boards.

Once I saw an instruction that was circled with an arrow pointing to is that said:

  man man
  man -k -or- apropos

I just typed `man man` in a terminal on my Mac, and luckily its still there.

I do think it pays to be nice to the model. When the context window is running out I like to ask "please summarize what went well and what didn't work in this session. How could the user be more helpful?"

that article seems to suggest 20TB total over the dozen deployments in prod.

Why would a model know that one washes cars at a car wash? We don't clean our bodies at the body wash or clean the kitchen at the kitchen wash.

When I was about 4 years old, this was the first movie I saw in a theater, it was a double feature with fantasia. Next time I remember going to a theater when my parents took me and a friend out of kindergarten to see Star Wars on opening day.

isn't sound a time series? I guess it's not usually 64-bit doubles.

is that no longer true?

I don't think it has had a BSD license this century, Sleepy Cat was selling licenses in the 90s before Oracle bought them.

I wholeheartedly agree with these, and I think point 1 is a real danger.

An ai system can't lie, and it can't deliberately ignore your directions. The current frontier class does not have a model of the world or their action -- they live in a world of words. Scolding them or arguing with them has no point other than to scramble the context window.

I do think zoomorphizing them might be useful. These poor little buggers, living as ghosts in the machine, are pretty confused sometimes, but their motives are purely autoregressive.

It's who the dead heads follow around now.

I agree that anthropomorphizing is a real risk with LLMs, but what about zoomorphizing? Can feel bad for LLMs without attributing them human emotions/motivations/reasoning?

When ATMs first came out, they were mostly still only at the branch because they were big machines. I remember in the late 70s/early 80s, if you got a steady check (like social security or a paycheck from a steady job) you could cash them at the liquor store. The liquor store would even run my Dad a tab, and he would pay it off when he cashed the check. On paydays he would not be the only one doing that, they must have had to get a lot of cash on hand.

Cool. I just learned of compass and straight edge calculations from this video on doubling a cube https://www.youtube.com/watch?v=96LbF8nn05c from Ben Syversen's channel a couple of months ago

I can tell by the em dashes

XML and HTML are SGMLs

I think it's the latter

wrapping z39.50?

When I worked for Bill Atkinson's sister, Dr. Kathy Atkinson, at UCR in high school, I was involved in a DMSO leak. Dr. A. was a microbiologist, but botanists worked upstairs. I guess DMSO is used a lot in botany, and they let an experiment boil over and DMSO got into the HVAC air return and then into the whole building. Smelled like garlic, and I turned bright pink. We had to evacuate. I also tasted garlic for a day or so. Nowadays you have to be 18 to get a job in a UC Lab.

You could get DMSO and ketamine at the vet supply store back then in the 80s. I heard of people ingesting acid via DMSO in that time frame, but it could have been an urban legend. It was a horse area and DMSO was used with horses to get stuff deep into their legs or something like that.

I think they literally coined and defined the term over 25 years ago.