HN user

sean_pedersen

365 karma

https://seanpedersen.github.io/

Posts41
Comments74
View on HN
solo.digger.lol 1mo ago

Show HN: Digger Solo – Local AI File Explorer

sean_pedersen
5pts0
seanpedersen.github.io 4mo ago

AI Safety Farce

sean_pedersen
27pts4
seanpedersen.github.io 9mo ago

Digital Security for Everyone

sean_pedersen
2pts0
github.com 11mo ago

YouTube Transcription MCP Server

sean_pedersen
1pts0
seanpedersen.github.io 11mo ago

Popping the AGI Bubble

sean_pedersen
5pts0
solo.digger.lol 1y ago

Show HN: Digger Solo – Semantic Search and Maps for Local Files

sean_pedersen
2pts0
solo.digger.lol 1y ago

Show HN: Digger Solo – Semantic File Search and Maps

sean_pedersen
1pts0
seanpedersen.github.io 1y ago

Zipf's Law

sean_pedersen
1pts0
seanpedersen.github.io 1y ago

Semantic Complexity Gap in CLIP Text Encoders

sean_pedersen
2pts0
seanpedersen.github.io 1y ago

Sparse Distributed Representations for Neural Embeddings

sean_pedersen
2pts0
seanpedersen.github.io 1y ago

The Structure of Neural Embeddings

sean_pedersen
74pts4
www.youtube.com 1y ago

The Math Behind Alien Signals [video]

sean_pedersen
2pts0
seanpedersen.github.io 1y ago

Digital Uncertainty

sean_pedersen
2pts0
github.com 1y ago

Show HN: VibeShuffle – A smart shuffle CLI music player

sean_pedersen
1pts0
exa.ai 2y ago

Exa.ai: Superknowledge

sean_pedersen
1pts0
seanpedersen.github.io 2y ago

Overcoming the limits of current LLMs

sean_pedersen
119pts106
github.com 2y ago

Perplexica: Open-source Perplexity alternative

sean_pedersen
378pts83
math.ucr.edu 2y ago

Surprises in Logic: Chaitin's incompleteness theorem

sean_pedersen
1pts0
ravn.substack.com 3y ago

Evolutionary (Organization) Development

sean_pedersen
1pts0
github.com 3y ago

I invented two proofs for the Collatz Conjecture

sean_pedersen
2pts9
news.ycombinator.com 3y ago

Help: I solved the Collatz Problem, what do I do now?

sean_pedersen
2pts3
blog.neotree.uber.space 5y ago

Kolmogorov Complexity: Extensions and Applications

sean_pedersen
107pts33
github.com 5y ago

HyperTag 0.6.3: Knowledge Management for Humans Using Machine Learning and Tags

sean_pedersen
2pts0
blog.neotree.uber.space 5y ago

FOSS replacing Google, Twitter, Spotify, Signal, GitHub and Co

sean_pedersen
2pts0
blog.neotree.uber.space 5y ago

Why I will not finish my Bachelor Degree in Computer Science

sean_pedersen
1pts4
blog.neotree.uber.space 5y ago

HyperTag: File Organization Made for Humans

sean_pedersen
2pts0
news.ycombinator.com 5y ago

Ask HN: Why isn't email spam solved using Proof of Work yet?

sean_pedersen
23pts54
github.com 5y ago

Show HN: HyperTag 0.5.0 – Semantic Search for Images Using Text Queries

sean_pedersen
1pts1
news.ycombinator.com 5y ago

HyperTag 0.4.3 – Introducing Semantic Search for Text Documents (yes, even PDF)

sean_pedersen
8pts1
github.com 5y ago

Show HN: HyperTag – File management made easy using tags

sean_pedersen
3pts1

"Any attempt to build AI generated content (deep fake) detection systems is flawed, since the outputs of such a system may be used to train an even better fake data generator. This leads to an equilibrium state of digital uncertainty: nothing in the digital realm can be deemed as real anymore - only as digital. I do not care if a digital artifact is human or AI made - I only care if it is useful to me. Useful content is on point, factual and at best surprising (teaches something new)." - https://seanpedersen.github.io/posts/digital-uncertainty/

I am working on a visual search & exploration engine: https://digger.lol

The goal is to create beautiful and useful maps of interesting data, empowering the user to explore more intuitively guided by semantic similarity. No user data needs to be tracked for this to work, the data speaks for itself.

This roughly works by translating semantic (visual or textual) similarity into spatial proximity. Diggers major features are: semantic mapping, text search and image search. The text and image search works bidirectionally, allowing to search for images (e.g. product images) using text and for text (e.g. books) using images.

I agree in that a perfectly consistent dataset won't completely stop statistical language models from hallucinating but it will reduce it. I think it is established that data quality is more important than quantity. Bullshit in -> bullshit out, so a focus on data quality is good and needed IMO.

I am also saying LMs output should cite sources and give confidence scores (which reflects how much the output is in or out of the training distrtibution).

I wrote up this blog post in 30 mins, that's why it reads a little rough. I could not find explicit research on the impact of contradicting training data, only on the general need for high-quality training data.

May be it is a pipe dream to drastically improve on hallucinations by curating a self-consistent data set but I am still interested in how much it actually impacts the quality of the final model.

I described one possible way to create such a self-consistent data set in this very blog post.

"That inverse doesn’t exist." That is my new math contribution apparently then. I am happy to explain my proof.

I can inverse f(x)=f(x+1) easily as g(x)=f(x)-1 since g(f(x)) = x do you understand my functional inversion approach now better?