goldemerald

I was able to replicate OP's attack. Since ChatGPT generates images via a separate model, I was able to ask it to tell me what the inputs to the tool was. It's a null prompt: a completely unconditional image generation. What I'm not sure of is if these are the average image trained on that had no prompt in the dataset, or if they are the true average of the dataset during unconditional training step. Very interesting nonetheless, as typically researchers are only able to see the unconditional generation of open weight models.

Surprisingly when you ask ChatGPT to generate you an image with these tool params, the output is not the same; it's not remotely graphic.

  prompt: null
  size: null
  n: null
  transparent_background: null
  is_style_transfer: null
  referenced_image_ids: null

Algorithmically served short form videos is clearly the smoking of our time. I cannot stand the conservative view of "well we don't know the videos cause mental health decline, or if it's simply those with a genetic inclination who seek out short form content.", exactly mirroring the skeptics about smoking causing cancer. I'm hopeful that in 5-10 years (but more likely 20) people will view this AI served, maximally engaging, content in the same way we view smoking now: disgusting and horrible, but adults should be allowed to do what they want. I can easily imagine kids/teens sharing their illicit access to shorts much in the same way they share vapes/cigarettes, which would be a much more preferable situation than the unlimited use we see today.

No discussion with Schmidhuber is complete without the infamous debate at NIPS 2016 https://youtu.be/HGYYEUSm-0Q?t=3780 . One of my goals as a ML researcher is to publish something and have Schmidhuber claim he's already done it.

But more seriously, I'm not a fan of Schmidhuber because even if he truly did invent all this stuff early in the 90s, he's inability to see its application to modern compute held the field back by years. In principle, we could have had GANs and self-supervised models' years earlier if he had "revisited his early work". It's clear to me no one read his early paper's when developing GANs/self-supervision/transformers.

That is addressing the incomprehensibility of PCA and applying a transformation to the entire latent space. I've never found PCA to be meaningful for deep learning. As far as I can tell, polysemous issue with neurons cannot be addressed with a single linear transformation. There is no sparse analysis (via linear probes or SAEs) and hence the unaddressed issue.

Not quite. For an underlying semantic concept (e.g., smiling face), you can go from a basis vector [0,1,0,...,0] to the original latent space via a single rotation. You could then induce said concept by manipulating the original latent point by traversing along that linear direction.

This is an interesting line of research but missing a key aspect: there's (almost) no references to the linear representation hypothesis. Much work on neural network interpretability lately has shown individual neurons are polysemantic, and therefore practically useless for explainability. My hypothesis is fitting linear probes (or a sparse autoencoder) would reveal linearly semantic attributes.

It is unfortunate because they briefly mention Neel Nanda's Othello experiments, but not the wide array of experiments like the NeurIPS Oral "Linear Representation Hypothesis in Language Models" or even golden gate Claude.

I've been lightly following this type of research for a few years. I immediately recognized the broad idea as stemming from the lab of the ridiculously prolific Stefano Ermon. He's always taken a unique angle for generative models since the before times of GenAI. I was fortunate to get lunch with him in grad school after a talk he gave. Seeing the work from his lab in these modern days is compelling, I always figured his style of research would break out into the mainstream eventually. I'm hopeful the the future of ML improvements come from clever test-time algorithms like this article shows. I'm looking forward to when you can train a high quality generative model without needing a super cluster or webscale data.

DinoV2 is an unsupervised model. It learns both a high quality global image representation and local representations with no labels. It's becoming strikingly clear that foundation models are the go to choice for common data types of natural images, text, video, and audio. The labels are effectively free, the hard part now is extracting quality from massive datasets.

While I love XAI and am always happy to see more work in this area, I wonder if other people use the same heuristics as me when judging a random arxiv link. This paper has one author, was not written in latex, and no comment referencing a peer reviewed venue. Do other people in this field look at these same signals and pre-judge the paper negatively?

I did attempt to check my bias and skim the paper, it does seem well written and takes a decent shot towards understanding LLMs. However, I am not a fan of black-box explanations, so I didn't read much (I really like Sparse autoencoders). Has anyone else read the paper? How is the quality?

Why not actually release the weights on huggingface? The popular SAE_lens repo has a direct way to upload the weights and there are already hundreds publicly available. The lack of training details/dataset used makes me hesitant to run any study on this API.

Are images included in the training?

What kind of SAE is being used? There have been some nice improvements in SAE architecture this last year, and it would be nice to know which one (if any) is provided.

"Ready to -dive- delve in?" is an amazingly hilarious reference. For those who don't know, LLMs (especially ChatGPT) use the word delve significantly more often than human created content. It's a primary tell-tale sign that someone used an LLM to write the text. Keep an eye out for delving, and you'll see it everywhere.

Solution 4 is so hilariously bad I am shocked it was suggested. Building a 2d landscape where the time dimension seems to take a random walk made laugh a lot. Ignoring the standard convention of "independent variable on x-axis" and instead embedding it as datapoints is a particularly clever way to obfuscate the data and confuse the reader.

Great work! I'd love to start using the language model variant of your work. Do you know when/if it will be open sourced? I'd start using it today if it were that soon.

I like having huge wait-list so that I can put entire series on hold (like wheel of time), maybe I'm manipulating the system a little too much.

I thought it was a clever/nerdy way to say in the worst case it will be out in a month. I imagine they have an internal review they have to get through first, and it's not clear if that will be done next week or in May.

Very nice. I've been working with GPT4 since it released, and I tried some of my coding tasks from today with Phind-70B. The speed, conciseness, and accuracy are very impressive. Subjectively, the answers it gives just feel better than GPT4, I'm definitely gonna give pro a try this month.

Mostly following your advice, I got 14257. I found if I could easily eat the ghost, it was worth taking a few extra steps to go for it. The real key is knowing you can successfully leave 6 on either side to carefully pick up after getting the middle.

The study only compares heart attack increase over a couple days, not weeks. Once you account for longer time period after DST, there is no statistically significant difference between post DST heart attacks and the rest of the year. The explanation being that people who were going to have a heart attack had it sooner.

Given all the ads builtin to the site about using generative AI, I'm inclined to think so too.

It's immediately obvious to me that multiple paragraphs of this article are written by an LLM.

I've read (and enjoyed) this book. I especially like making chatgpt and other LLMs write about it in different perspectives. I'm sad to see foundational American novels reduced to summaries coaxed out by chatbots. I do hope that language model watermarking becomes more prevalent and easily detectable.

Hire a grad student for a year to write a research paper on it, haha. I've just gotten into the LLM space for work, so I wouldn't know

ACL had a recent tutorial about state of the art for this topic. https://acl2023-retrieval-lm.github.io/

My favorite takeaway was that purely fine tuning your model on your documents (without extra document context during inference) consistently performs worse than using a context added from a datastore.

For those interested, a modern version (vision transformers) was just published this year at CVPR https://openaccess.thecvf.com/content/CVPR2023/html/Park_RGB...

I love your content, the only channel I've turned the bell on for. I am curious about your approach to explaining coding and machine learning, do you think it's possible to make "coded for 5 days" engaging in the same way physically building the objects is engaging?

Also, have you considered publishing your work in robotics conferences? I feel like grad students might be hesitant to cite a YouTube video whereas there's clearly enough technical contribution for a full publication.

I've been reading some Buddhist texts lately, and this I feel this article would fit right in towards the appreciation of all lives. I know LLMs are fundamentally matrix multiplication text calculators, but attributing a Buddha nature to them seems to align with the teachings I've been reading. Perhaps someone more familiar with Buddhism can explain this feeling more accurately/concisely. In the meantime, I will continue on having no regrets using a few extra tokens to say please and to treat the LLM with dignity. Often I've found ChatGPT-4 to reflect my tone and having it respond to me curtiously, rather than shortly, really does change my attitude while interacting with it.

I did an oral final exam for my theory of computation class. From the student perspective, it was nicer than an in person final as I knew I didn't have to have perfect prose in my answers (and that it only took 30 mins rather than 2 hours!). But the professor said he'd never do it again because 30 minutes * 30ish students was too much work.

I cannot imagine a return to oral exams in the current academic setting with huge class sizes. The only place I could them being useful is in tiny honors/grad classes where the professor already has a close familiarity with each of the students.

This article is not about ChatGPT, but GPT-4. I've found the latter to be significantly better at being a coding assistant in all areas: the code actually compiles and often works out of the box. Even better than chat, I can paste it's generated code and simply respond with any errors given and it will fix it accordingly, something I had lots of trouble using chat to do. GPT-4 is that much better and it makes sense to me that the author is lamenting now and not 4 months ago.

Ahh I fell for it. I was fairly convinced by the 100+ 40GB files as weights to download, but when I saw the paper was written in a word doc I remembered to check the date.

One interesting thing to note is that I could tell they used ChatGPT rather than GPT-4 to do the fake writeup. ChatGPT likes to generate paragraphs shown in their paper, GPT-4 will do full latex commands, inline citations, and even (a made up) bibtex for the citations.

"Why put your happiness in other people's hands?"

I ask myself that every time I've submitted a paper. It probably doesn't help that GPA is an easy surrogate for self-worth, which smoothly transformed into publishing for a self-worth measure. And the fact that I don't have particular research I want to do (just that I want to do research), is something I'll have to consider more-- probably a sign of bad foundational motives.

To rephrase the answer, I'll give some extra context. I was a SWE for 2 years before my PhD, and I was financially stable and content. The choice to give up that salary for science was not hard, but it was significant. Now that I've reached the end of my current science road, it would feel like giving up to go be a MLE/SWE. Obviously I could do a post-doc somewhere, but that kicks the can down the road again. I'm pretty sure I'm not a narcissist... I'll ask my friends hah.

Thank you!