HN user

seccode

24 karma

Please delete my account moderators, thank you so much! -Sam Clymer

Posts12
Comments38
View on HN

Methodology for comparison: train zstd dictionary on enwik9. Then build my dictionary as most common words in enwik9. Mine does 13% better because of the way I discovered how you can generate dictionary replacement symbols

I used the z-score. How can you claim that the digits of pi are random, yet a random forest classifier predicted better than the distribution probability. Your claim implicitly means "there is no structure." The hard thing to understand is that the classifier didn't see the test set, so what structure did it learn? At the very least this is an interesting question

[dead] 2 years ago

This doesn't _break_ sha256, just opens the door to breaking sha256 with machine learning

Also, I am testing different ranges of digits other than first 10,000, but the problem with other ranges is that the distribution of digits is highly imbalanced and the model is not showing statistical significance, but models have a harder time when the distribution of classes is not 50/50, so I think its not quite fair to evaluate the model on these ranges.

So why do you think the first 10,000 digits are somewhat predictable?

The issue is not with getting the digits, the issue is with running a large model for larger digit ranges. I tried running with 10,000,000 digits and haven't gotten a prediction yet.

I don't think you're correct that the z-score is not being interpreted correctly. I haven't been able to find research demonstrating any non-randomness in pi, so without that we have nothing to compare it to.

I don't have the resources to try this unfortunately. I highly encourage somebody to try. But with more digits you may have to change the model.

I tested on the dickens dataset (Charles Dickens novels). This algorithm works well on English text. I do not expect it to be any better than zstd at binary data. I haven't tried code.

It does used zstd. My algorithm is a preprocessing step for zstd.

Hi Hacker News,

My name is Sam and I made a search engine that uses either Bing or ChatGPT, based on whichever is more suitable for your search. You can also type "b " or "c " before your search to force it to use either one.

I will be obtaining keypush.com as well, but I just wanted to share my initial version with you all. Would love to hear any feedback that you have.