qumpis

I may never understand what harness means - it's used in so many contexts

What happens if we don't add any moments matching objective? e.g. at train time just fit a diffusion model that predicts the target given any pair of timesteps (t, t')? Why is moment matching critical here?

Also regarding linearity, why is it inflexible? It seems quite convenient that a simple linear interpolation is used for reconstruction, besides, even in DDIM, the directions towards the final target changes at each step as the images become less noisy. In standard diffusion models or even flow matching, denoising is always equal to the prediction of the original data + direction from current timestep to the timestep t'. Just to be clear, it is intuitive that such models are inferior in few-step generations since they don't optimise for test time efficiency (in terms of the tradeoff of quality vs compute), but it's unclear what inflexibility exists there beyond this limitation.

Clearly there's no expected benefit in quality if all timesteps are used in denoising?

Fascinating article. I wonder what made her do the steps in finding what's "different" with her, and most of all, why the need to fix it arose. Is it to "fit in", understandably? It somehow felt alien to me, and this shows my ignorance on the topic, that people lacking in empathy department would attempt to understand the reasons and act "good" towards others even if this feeling is only understood intellectually.

Yes it makes sense a bit. Many popular convents operate on 3x3 kernels. But the number of channel increases per layer. This, coupled with the fact that the receptive field increases per layer and allows convnets to essentially see the whole image relatively early in model's depth (esp. coupled with pooling operations which increase the receptive field rapidly), makes this intuition questionable. Transformers on the other hand, operate on attention which allows them to weight each patch dynamically, but it's clear to me that this allows them to attend to all parts of the image in a way different from convnets.

Convolutions are bad at long range spatial dependencies? What makes you say that - any chance you have a reference?

I haven't seen RL with decision trees! it sounds really interesting. Any classic results worth looking into?

Toll noticable only back in those days or even in the future?

Was it more productive, objectively speaking, than being consistent and not dealing with the constant drainage due to severely lacking sleep?

Can you give some example usecases of your application? I wonder how it scales to complex (in terms of structure) information processing, e.g. digesting scientific topics

So therapy is not effective as per the paper. This seems like an astounding conclusion. Has anyone read the paper in detail and has a deeper opinion?

How does this differ from RNNs and their gating mechanism?

From the glance of it, the paper looks very polished. Combine this with the fact that arxiv is invite-only, your prediction might not come about

How big and random were these "few extras"?

I've got good results with white noise, not sure if that's something that would work for you. And of course I didn't suggest that this eliminates other distractions.

Why not put these earbuds in the office?

"Ar5iv" does a pretty good job from my experience

A bit surprising to hear that you weren't swimming in offers to hire you all the time. Any idea why that was? Maybe you're somewhat picky about the job and responsibilities that come with it?

Slightly related but sparsity-inducing activation function Relu is often used in neural networks

I don't remember the exact tweet, but here's one discussion [1]. I guess something changed in the mean time.

[1]_https://www.reddit.com/r/Amd/comments/140uct5/geohot_giving_...

Didn't they abandon development of AMD related software?

Why did you start the blog? Was the reason to stand out or something else?

To me the acceleration of the touchpad of macbooks feels unnatural, even after prolonged used. And this is coming from a linux user on an XPS. It's so rare to find this opinion being shared though.

Maybe OP doesn't travel a lot. Or is a taxi driver :)

That's an interesting morning routine. Why do you do so (do you work in 'measurement' industry?)?

Sorry to hear that. I guess you experienced major setbacks in your life this year?

Looks great. Is this also coming to vscode? Also, the answer might be an obvious 'no', given a lack of features compared to vscode, but is it coming to pycharm?

I'm an introvert but completely isolating from the team and having professional-only meetings is draining too draining for me.

Doesn't adhd just exacerbate the problem, but isn't the real cause? Like I will sometimes avoid some tasks because they highlight my insecurities

I'll try then! Last I remember they had some weird variable loading policy: even under small cell executions there'd be noticable delay before variables got 'refreshed', even when lazy loading was configured. Maybe only a problem on my end though.

Pycharm's notebook debugger is top notch, but their notebook implementation is, imo, clunky and slow.