HN user

czr

1,315 karma
Posts2
Comments103
View on HN

hack to switch to light mode, if you don't want to do it systemwide (paste into console):

    Array.from(document.styleSheets).forEach(ss => Array.from(ss.rules).forEach((ssr,i) => {if (ssr.cssText && ssr.cssText.includes("dark")) {ssr.parentStyleSheet.deleteRule(i)}}))

he hasn't worked on YOLO, only NLP. YOLO is another example of a well-known, successful researcher (Joseph Redmon) writing an informal paper

haven't read paper yet, but this is a silly demo. "turn 10% of pixels black" is not a good baseline, should use nearest-neighbor interp (or something) to fill holes in the "sparse" video for fair comparison. also, you can clearly see in hd video that it's temporally unstable ("shimmering"), which is the same problem nvidia has with dlss since forever; need to build temporal smoothing in or users will hate it.

problem is most likely that your initialization are bad (see e.g. https://openreview.net/pdf?id=H1gsz30cKX for explanation). make sure to use variance scaling, taking activation into account (relu cuts variance by half). probably you need to multiply all initial kernel weights by 2. make sure that initial prediction of model before training is same order of magnitude as typical target, not saturated to zero or other extreme value. batchnorm and skip connections can also ease problems of bad initialization, so worth trying.

good start op. a good next step is add in temporal context (previous frame information) so model may resolve ambiguous cases. see e.g. breakdown of comma.ai openpilot model here (from their twitter, [0]), or the karpathy talk as well.

also, when presenting results, prefer to include a longer demo or sub-demos that show strengths and failure cases, and move to the top of the post rather than bottom imo. for a given reader, implementation details are either confusing and uninteresting (if not subject-matter expert) or predictable and uninteresting (if an expert, you've seen many similar before); audience for implementation details is very small number of people who want to sit down and replicate or check your work. but demos / analysis is always novel and interesting to anyone, so lead with that :)

[0] https://medium.com/@chengyao.shen/decoding-comma-ai-openpilo...

for those interested in the different ml methods attempted for the challenge, many of the top kagglers in this contest posted rundowns of their solution [0].

for those interested in kuronet [1] and the competition alex gave a presentation here (en, [2]) as did tarin (ja, [3]).

for those interested in classical japanese literature, you can see the tools they've built here [4]. tarin is also very active on twitter [5].

[0] https://www.kaggle.com/c/kuzushiji-recognition/discussion

[1] https://arxiv.org/pdf/1910.09433.pdf

[2] https://youtu.be/e2-mVBvygm8?t=1428

[3] https://youtu.be/e2-mVBvygm8?t=537

[4] https://mp.ex.nii.ac.jp/kuronet/

[5] https://twitter.com/tkasasagi

messed around with the 2stem model for a bit and it's reasonably good. I think phonicmind is still a bit better - phonicmind tends to err on the side of keeping too much, while the 2stem model tries to isolate aggressively and often damages the vocal as a result (distorting words by losing some harmonics, or losing quiet words entirely)

example:

https://files.catbox.moe/wjruiv.mp3 (phonicmind)

https://files.catbox.moe/uuzot3.mp3 (spleeter 2stem)

you can hear spleeter does better at actually taking out the bass drums, but phonicmind never loses or distorts any part of the vocal, while 2stem occasionally sounds like singing is through metal tube (harmonics are missing). will try to read instructions more carefully and see if there's some way to fix.

Agreed. I think this is an instance of:

It is only by harsh experience that we learn which principles take priority over which other principles; as mere words they all sound equally persuasive.

does anyone have more information on this? only reference I can find is that blog post; I can't find the specific section of the linked specs that discusses such a utility

I've stumbled across the "Image Streaming" notion before, on those same few websites. Is there any third-party support for the idea? Such as a published study, slatestarcodex-style book review, or (at this point) a few redditors claiming "it worked for me"...

It unfortunately sets off my BS radar in full:

* Most references to the technique appears to originate from a book called "The Einstein Factor: A Proven New Method for Increasing Your Intelligence", by the same Win Wenger as you linked above.

* Win Wenger is always written as "Win Wenger, Ph.D", but I can find exactly one paper from him on Google scholar [0], written solo, written well after he was already publishing books [1].

* The "Reinhart Study" cited by the book is listed on this website [2] with the heading "Reviewers have found that this study was statistically inadequate. Further and better studies are requested, please contact wwenger101@aol.com".

* The author of that not-published paper is listed as "Charles P. Reinert, Ph.D., Dep't of Chemistry/Physics" (not psychology).

* Other works attributed to Win Wenger on that same site are very obviously nuts [3], containing such gems as "It is unclear at this point whether anyone in fractile theory or in interference pattern physics has noticed yet the relationship between these two fields, each of which by itself is and will be totally transforming our understanding of our world and of ourselves within the next decade or so."

In short, Win Wenger appears to be someone without any actual credibility who is nevertheless attempting vainly to forge it. And I can't find any actually credible references to this technique working.

[0] https://onlinelibrary.wiley.com/doi/abs/10.1002/j.2162-6057....

[1] https://www.amazon.com/gp/product/0931865018/ref=dbs_a_def_r...

[2] http://www.geniusbydesign.com/other/windocs/reinert/rein_1.s...

[3] http://www.geniusbydesign.com/other/windocs/physics.shtml

The video is captioned if you want. But the TL;DW is that there's an ethical spectrum of security content; on one end is sketchy content that has little educational value - like, say, a tutorial on how to make a phishing page - and on the other end is educational content that could be applied maliciously but isn't intended that way - like a general web programming tutorial (or a DefCon talk). YouTube seems justified in demonetizing or removing the former type of content, but the difference between these two types is not always obvious if you don't have a security background, and so it's expected that there will be some false positives / negatives in YouTube's filtering. In practice, educational content (from LiveOverflow, for example, and from the other security channels he knows) hasn't been banned, and the few false-positive bans appear to have been reverted quickly, so it seems like this is largely a non-issue. If YouTube actually starts blocking educational security content, and not being responsive to appeals, then this would worth being upset about, but right now it seems like a non-issue.

(Note that YouTube has plenty of other problems; I'm just summarizing LiveOverflow's take on this particular controversy)