Probably drawing an analogy to how causal pretrained models go through stages of understanding language, words -> grammar -> meaning. Gwen mentions this experience when training character level RNNs. https://gwern.net/scaling-hypothesis#why-does-pretraining-wo...
HN user
remontoire
Watching geohot code a general matrix multiply algorithm from 0.9 GFLOPS and optimising it to 100 glops by only tinkering with cache locality, it makes me wonder how much effort should be put into single threaded performance before ever thinking about multi threading
I think it's because you want to be able to predict the next token using only 1 token or the whole context window (and any size inbetween). So, you end up getting n different losses for each text snippet (where n is the size of the context window).
If i'm wrong, can someone correct here, would be useful to know.
So the reason he thinks this is because GM and ford have announced more "models".
At no point has the limiting factor been the number of models. The limiting factor is and will be battery cell supply.
This article makes no mention of legacy OEMs making any attempt at solving their supply constraints.
It looks like you're right for the most part. Literals are supported if you use https://github.com/vseloved/rutils. If your cl-edn actually works then a combo of rutils and cl-edn could bring most of the value I found in clojure to common lisp.
I've used fset and cl21. The problem is that once you start using those you no longer are able to use libraries. Data structures have to be built into core.
The common lisp community has rejected reader macros for interop reasons the last time I checked (in the case of cl21)
Even the docs for fset doesn't show the use of data literals. it does things like (set) and (isetq s2 (set 'c 1 "foo" 'a 'c))
This pretty much proves my point. it's not fun typing (set 'c 1 "foo" 'a 'c) instead of #{'c 1 "foo" 'a 'c}. It's also not possible to put those on the wire (easily) for communication between common lisp processes. Breaking the whole point of homoiconicity.
There is more to collections than lists. You can have instances of empty collections, some of which have literal support ([], {}, and ()). Thus there can be no sentinel empty collection value.
Probably my favorite feature over common lisp. Combined with comma (,) being treated as whitespace (ie, use comma if you want to but you don't have to), makes typing out data structures in clojure a much more enjoyable process than other languages.
This ease of typing out data structures also extends to edn (clojure's version of json)
This is definitely not an actual solution. It's a first order solution to a non-first order problem.
Do you remember what this used to say? https://www.who.int/emergencies/diseases/novel-coronavirus-2...
You're not disagreeing with them then. You are disagreeing with the point of the quote.
His whole comment is a quote from the movie
I suspect that the company would get a visit from the secret service
This argument doesn't hold anymore now that there are threading macros.
(-> ((have you written) lisp before) ?)
Does: reset!(caret-location nil)
Make more sense to you?
Maybe you would like OO style?
(-> caret-location (reset! nil))
Roll-out is standard my dude. So is testing at drag strips. Next you're going to point out that a tesla accelerating on the beach gets to 60mph in 11 seconds and therefore Elon is lying.
https://www.caranddriver.com/features/a30085446/acceleration...
What an unbelievably privileged thing to say.
let?
Pretty disappointing to see the reaction this has received in this thread.
Crabs in a bucket
Not much if Toyota can't compete on price. Range has not been an issue since 2015, and the marginal increase in consumer demand won't go up much if a $150k 500 mile electric hits the market.
The real issue for electric is that a 300 mile electric costs more than $35k because the world wide battery production capacity is limited.
If solid state batteries are easier to produce and the price comes down faster than lithium ion then there might be a crossover point by 2030. Until then, this probably means cooler high end sports cars (formula E?)
what does YADIW mean?
New construction is more needed?
I would be remiss if I didn't mention something from clojurescript land that accomplishes something similar: https://github.com/tonsky/datascript
Datascript allows you to write datalog queries in ClojureScript(and JavaScript) that operate on a b+ tree maintained by the library. It includes first class relationships and unique keys.
Do you remember what else happend that day at Fukushima? 15k people died from the tsunami. Yet people could not tell you anything about the tsunami except that it caused problems at the reactor.
I 100% prefer the US pushing it's agenda over China.
Totally agree, no one has ever been inspired by this man!
In fact, he has actively put spaceflight back 50 years by making everyone disinterested in going to mars.
What we need are more people in suits who give us made up numbers.
This is great. Always amazing where clojure can put a repl
I find it more than a little surprising that no one here has an issue with google starting an AI lab in China. Instead all I see pointed out are the motives of the author.