HN user

michaf

140 karma
Posts0
Comments64
View on HN
No posts found.

Is there such a license? Or any license with special clauses for LLMs? Is it enforcable? Could someone 'poison' an LLM training run with injecting just one such licensed document? I am genuinely curious about what levers exist (or are conceivable) to protect your own IP from becoming LLM training data, if regular copyright does not qualify.

If you restart the session and enter

  > echo test1 | md5
it will output another random 'hash' each time. But within one session it knows that md5 should produce the same output. Running
  > echo test1 | md5
multiple times, or even
  > VAR1="test1"; echo $VAR1 | md5
produces the same output for me within the same session, while
  > echo test2 | md5
results in a different, but also session-consistent hash.

I just told it that it had a directory containing the GPT-3 model weights. I'll assume the files contain some imagined gibberish, but what if not? ...

  > ls -lh 
  -rw-rw-r-- 1 username username 125M Jun  5  2020 model.ckpt-0.data-00000-of-00001
  -rw-rw-r-- 1 username username 787K Jun  5  2020 model.ckpt-0.index
  -rw-rw-r-- 1 username username 2.4M Jun  5  2020 model.ckpt-0.meta
Mastering Stratego 4 years ago

Quite interesting that it will make subtle errors in its otherwise reasonable-looking answer, e.g. "kipedwaia" has two "a"s; "kawipieda", "kipedwaia" and "pwakieida" have only two "i"s.

I have seen reports that it will happily hallucinate a plausible but wrong answer to all sorts of different prompts, intermixed with many mostly correct answers. It's interesting to think about how to place trust in such a system.

Your comment brings focus to the question of why reviewers agree to do these unpaid reviews in the first place. I assume your comment is in jest, and you were fully aware of the unpaid nature of the work. But what was your motivation to do it anyway and spend 2000 hours on it?

This way you would trade in a null-byte-terminated variable length string for essentially a null-bit-terminated variable length number (plus the remaining string). I am not convinced that this actually would be much safer.

I wonder if Netflix would have to spin off their in-house productions once they reach $25B revenue. Or, if they don't, if the mobile platform providers could change their business models into similar subscription services to avoid the break-up.

The article mentions pooling layers as one source for the high frequency patterns. Jeffrey Hinton recently introduced capsule networks (https://news.ycombinator.com/item?id=15609402), in part because he wants to get rid of pooling layers. Maybe this approach is effective to counter (at least visually indistinguishable) adversarial examples.

edit: ok, someone already tested it, and it does not seem to help that much: https://github.com/jaesik817/adv_attack_capsnet

Thinkpad X62 9 years ago

While I really like my x230, the touchpad is practically unusable for me. It's just too small (or too jerky, if you use a large scaling factor). And while I have the higher quality IPS panel, it's still just 1366x768. Just give me the x230 with a bigger touchpad and a nice HD display, and I am happy (maybe x260/x270 would work? ...).

I was locked out of my AWS account for about 2 years due to loosing my 2FA authenticator on my phone. But had no open bills and didn't really care about it, so I did not try to gain back access.

Until last week, when I decided that I need to use the account again. I simply clicked the recovery link on their 2FA login form. Had to enter my account details and my phone number. Within 15 minutes (as stated on the website) a member of their service team called me. I explained the situation (lost 2FA app). Not a problem, the service agent told me. He then sent me an e-mail (to my AWS-associated mail address) with some random characters, which I had to read back to him. After that he simply removed 2FA, and I was able to log in with my username/password. For me the experience was quite pleasant, but had someone else have access to my e-mail account and knew my AWS username/password, he might have been able to take over my account, bypassing 2FA. I don't quite know how to feel about that.

EDIT: Ok, this probably only works if your phone number is also already associated with your account. So an attacker additionally would need access to my phone number, making things quite a bit more secure in my view.