HN user

a1k0n

1,974 karma

the obfuscated C donut guy.

https://www.a1k0n.net/

Posts20
Comments302
View on HN
kywch.github.io 6mo ago

Scaffolding to Superhuman: How Curriculum Learning Solved 2048 and Tetris

a1k0n
150pts33
www.a1k0n.net 7mo ago

Pure Silicon Demo Coding: No CPU, No Memory, Just 4k Gates

a1k0n
429pts73
www.a1k0n.net 1y ago

From ASCII to ASIC: Porting donut.c to a tiny slice of silicon

a1k0n
162pts25
www.a1k0n.net 5y ago

Localization with ceiling lights for fast indoor autonomous racing (2021)

a1k0n
9pts0
www.jezzamon.com 7y ago

An Interactive Introduction to Fourier Transforms

a1k0n
230pts22
www.a1k0n.net 7y ago

Fast line-following robots

a1k0n
207pts26
www.a1k0n.net 9y ago

3D rendering on an Arduboy

a1k0n
4pts0
erikbern.com 9y ago

When machine learning matters

a1k0n
2pts1
www.cs.cmu.edu 10y ago

The GlEnd of Zelda(): Automatic 3Dification of NES Games

a1k0n
1pts0
ascii.textfiles.com 10y ago

A Cabinet of Infocom Curiousities

a1k0n
15pts2
buildnewgames.com 13y ago

Simulating Natural Systems in a Web Browser

a1k0n
1pts0
www.kickstarter.com 13y ago

Learn (just enough) to make (almost) anything

a1k0n
1pts0
www.adafruit.com 13y ago

How we built a Super Nintendo out of a wireless keyboard

a1k0n
4pts0
countercomplex.blogspot.com 14y ago

Algorithmic symphonies from one line of code

a1k0n
204pts36
a1k0n.net 14y ago

My weeknight project: HTML5 Tron with AI

a1k0n
5pts0
www.pagetable.com 15y ago

The story of 15 Second Copy for the C-64 (Mike Pall's followup to FCopy)

a1k0n
6pts1
a1k0n.net 15y ago

Yahoo Logo ASCII Animation in six lines of C

a1k0n
4pts0
rossum.posterous.com 15y ago

8GB MicroSD Atari 810 disk drive, built to scale

a1k0n
127pts9
ai-contest.com 15y ago

Google AI Challenge final rankings released

a1k0n
9pts0
cdsmith.wordpress.com 16y ago

ICFP Contest Retrospective

a1k0n
2pts0

Yes, it has to in fact. If you have zero context to attend to in a transformer, and you try to predict the first token, you effectively are multiplying a zero-vector by the attention head, making all tokens equally likely in the final softmax (unless the lm_head has a bias, but at least in GPT it does not).

So the <|beginning of text|> token, with no context before it, learns to predict the first-token-in-a-document distribution. That's not quite the same as predicting nothing at all.

For finding interesting Ethereum addresses on the GPU (uses SHA3 instead of MD5) there's a tool called profanity.

Amusingly the tool was archived by the author years ago, and just last year a stupid bug in the random initialization code was found (32 bytes of state initialized with ~31 bits of entropy), leading to ~millions of $ in stolen ETH by exploiters.

If anyone has an idea why the TIA’s designers used LFSRs for this stuff, I’d love to hear about it.

I'm guessing because a counter would have ripple carry (i.e. five extra gate delays when rolling over from 111111 to 000000) or need extra gates for carry lookahead and an LFSR is constant-delay.

Yeah, that one wasn't too hard but it's nice to have it to check your work. I didn't go into it in the post, but the real power of SymPy is its cse() function, which I used to do all the common subexpression elimination for the integer math version at the bottom.

after updating to Catalina I was suddenly unable to edit my own ~/.ssh/config. I still can't figure out why not. I could rename it and make a copy, though, and the old one shows this:

-rw-r--r--@ 1 aaaaaaa staff 2571 Sep 15 2017 config~

com.apple.finder.copy.source.checksum#N 4

com.apple.metadata:_kTimeMachineNewestSnapshot 50

com.apple.metadata:_kTimeMachineOldestSnapshot 50

that file remains read-only to me. what is going on?

I'm aware of one paper which tries to fit a local polynomial model to the lateral dynamics, and they have a different model for different positions on the track (it requires really good localization to work): https://arxiv.org/abs/1610.06534

I had some of the vehicle parameters as part of my EKF for a while, but it led to some instabilities in the control.

The main problem is that it's really hard to know what the car's instantaneous lateral velocity is. I think the best you can do is check the difference of velocity*gyro yaw rate and lateral accelerometer measurement to get a noisy lateral acceleration measurement, and that can tell you how well your tires are hooking up. I might try fitting a least-squares model on the fly with something like that.

Nice! Are you doing probabilistic roll-outs, iLQR, or SQP, or what? What does your model look like? I've been struggling with this -- not sure how complex the tire dynamics model needs to be, for instance; do you need the whole Pacejka magic formula or is tanh() good enough?

Yes, that's the current state of the car. It's constantly fighting for traction; there are some lower-level control systems trying to maintain yaw rate (which automatically does things like counter-steering in a drift). I'll get to that in a future post.

I think just adding a simple low-pass filter on your distance measurements and tracking the derivative for PD control would cure that problem. Try it!