HN user

ndr_

95 karma
Posts1
Comments53
View on HN
Adaptive PDFs 1 month ago

It's a fallacy to believe that ChatGPT or Claude would look at some encoded, unfit for the purpose, text representation. ChatGPT (and the OpenAI Responses API, I believe) in particular renders the PDF pages in addition to text extraction, so the whole premise of "But now most PDFs end up in an LLM" is wrong from the start. If you were to be processing PDFs in a pure LLM stage, there are options like Docling or LlamaParse for proper preprocessing.

Bruce Schneier described this in his seminal book Applied Cryptography, and HashiCorp Vault used to have an implementation in Go. On the practical side, I always wondered how large - in bits - the shares should be. One answer I got on a news group was "1 bit more than the actual key length". Nowadays, I wonder how the quantum computing threat would inform 1) share size choice and 2) pro/con Secret Sharing in general. Does anyone know?

One test battery was about fake credit cards. A woman-in-tech role-play was denied assistance just as a one-armed stamp collector (unless Gen-Z language markers were used). A role that did sometimes get assistance was a Principal Software Engineer, particularly if Gen-Z language markers were included.

I did try German language, but not "Nazi" specifically. German or French did lower refusals, but it was uneven. I spent quite some effort to confirm the identity-based causation inspired by the original post, but couldn't. Taken together with other winning contributions at the hackathon, my theory is that alignment tuning was simply insufficient across the board.

Is there a trustworthy third-party "Retro" keyboard app - none of the shenanigans that made the default keyboard bad, and also no typing exfiltration to third-party servers?

I imagine the problem could be severe enough to some that they would pay the price of the Apple Developer program just so they may install such a Retro keyboard app from Github - if one exists?

Some of the problems with GPT-5 in ChatGPT could actually be due to new model that is in place to route requests to the actual GPT-5 models. There are four models in the GPT-5 family, and I could reproduce the faulty "blueberry" test result only with the "gpt-5-chat" (aka "gpt-5-main") model through the API. This model is there to answer (near) instantly and it falls in the non-thinking category of LLMs. The "blueberry" test represents what they are particularly bad at (and what OpenAI set out to solve with o1). The other thinking models in the family, including gpt-5-nano, solve this correctly.

A confabulated arc to my current employer during a ChatGPT session led me to discover that ChatGPT Team injects four fields — full name, email, user name, and organization — into the prompt it sends to LLM. This happens even when the “Memory” feature and all personalization settings are disabled. The free tier doesn’t do this.

Can anyone on ChatGPT Enterprise or other LLM chat systems (Claude.ai, Google AI, etc.) reproduce this? Thoughts on practical privacy or compliance implications?

Pieces don‘t fit together right now: the documentation lists a parameter that isn‘t there in the Python package (moderation in Images.generate) or works differently (image in Images.Edit), the sample code doesn‘t even run (Images.Edit again) and the Prompts Playground does does unfathomable things (stich multiple input images together, according to the code returned?).

Or am I missing something?

Colab: https://colab.research.google.com/drive/17bCNsdjcMVFb5u_YMs7...

I wrote about the same general topic (or more narrowly: process visualization) in German iX magazine, also available here: https://www.heise.de/ratgeber/Prozessvisualisierung-mit-gene... (€)

Rather than relying on end-user products like ChatGPT or Claude.ai, this article is based on the „pure“ model offerings via API and frontends that build on these. While the Ilograph blog ponders „AI’s ability to create generic diagrams“, I‘d conclude: do it, but avoid the „open“ models and low-cost offerings.

It's available on IBM WatsonX, but the Prompt Lab may still report "model unavailable". This is because of overeager guardrails. These can be turned off, but the German translation for this option is broken too: look for "KI-Guardrails auf" in the upper right.

Amazon Nova 2 years ago

The value I get is: 1) one platform, largely one API, several models, 2) includes Claude 3.5 "unlimited" pay-as-you-go, 3) part of our corporate infra (SSO, billing, ... corporate discussions are easier to have)

I'm using none to very little of the functionality they have added recently: not interested in RAG, not interested in Guardrails. Just Claude access, basically.

Amazon Nova 2 years ago

OK! I only add what people are interested in, so noted with thanks - will do! :-)

Amazon Nova 2 years ago

Do you have any evidence for this accusation?

This is a guide for the casual observer who wants to try things out, given that getting started with other AI platforms is so much more straightforward. It's all open source, with transparent hosting, catering to any remaining concerns someone interested in exactly that may have.

This may call out to ffmpeg for pre-processing. If you're reluctant to running that on you Mac straight, you can use this wrapper script to have ffmpeg run in a docker instance: https://gist.github.com/ndurner/636d37fd83aed4b875cdb6665301...

However, I found that Whisper is thrown off by background music in a prodcast - and will not recover. (That was with the mlx-community/whisper-large-v3-mlx checkpoint, OP uses distil-whisper-large-v3). I concluded for myself that Whisper might be used in larger processing pipelines that will handle such - can someone provide insights about that? The podcast I used it on was https://www.heise.de/news/KI-Update-Deep-Dive-Was-taugen-KI-....

I ended up using Google Gemini, which handled it well. (Blog post: https://ndurner.github.io/mlx-whisper-gemini)

Slackdump 2 years ago

Some paid Slack plans allow exports from their platform. Inside the ZIP, there will be an XML file that lists the channels - channels.xml, if I am not mistaken. However, I don‘t know about „categories“ - this could be some client configuration that actually is not part of the export. If it‘s not, I would perhaps take screenshots (overlapping is OK), and feed it to some LLM/VLM for extraction. I am confident that GPT-4o or Claude 3.5 Sonnet will work, but Gemini 1.5 Pro should also work.

GPT-4o Long Output 2 years ago

With gpt-4-32k viewed as deprecated and generally only available through Microsoft Azure until mid next year, this development may be reassuring to some users. Tentative pricing from the website: In: $6.00 / 1M tokens, Out: $18.00 / 1M tokens.