HN user

stdbrouw

4,892 karma

Developer and data scientist in the news industry. I blog over at http://debrouwere.org

[ my public key: https://keybase.io/debrouwere; my proof: https://keybase.io/debrouwere/sigs/Cnr9GaJGcojfjdLSHpSlDuKmoGDIspELZlN-7yq1pVY ]

Posts10
Comments1,282
View on HN

One aspect is perhaps that simple things aren't necessarily cheap. One Laptop per Child struggled to get costs down, whereas a mass market solar panel is not self-serviceable but at their current cost, who cares. Even in the developed world, you get noticeably more bang for your buck if you buy a cheap, basic car than if you buy a cargo bike that could replace it, because of the fierce competition and huge economies of scale for cars. Touch screens are cheaper than seven segment displays. And so on. (Not a snub on the Open Source Low Tech community, their designs look great!)

Yes, ggplot2 is lovely to work with for complex graphs. Whereas a classic plotting library will have one function to create a bar graph, another to create a line graph, etc., in ggplot instead you can stack layers, each with different properties, variables, shapes, data-dependent colors, scales, whatever you want. It also makes it easy to create grids of similar graphs.

OTOH, motion sickness is often called "car sickness" for a reason, people who suffer from it only sometimes suffer on a bus, and rarely if ever on a train or a plane, so I'm not sure I would agree that "all transportation and tourism related businesses" are impacted. Also, doesn't dimenhydrinate work for your wife or kids?

Phenomenal author indeed. "Capital", a novel about the financial crisis and bankers on the hedonic treadmill, is wonderful too. Too bad either Lanchester or his publisher has beef with Amazon, most of his work is not available as an ebook.

"The boy who cried wolf" is a story about false positives, so if that's what you want to avoid then you want to get close to 100% specificity, and accept that there are many things that the tool will not catch. If, as you propose, the tool would mainly be used to create a low confidence list of potential problems that will be further reviewed by a human, then casting a wide net and calibrating for high sensitivity instead does make sense.

Before Netflix was a thing, I sometimes tried to have conversations with people about "gee, it's a bit annoying that my only options to watch a movie is to buy an expensive dvd that I will watch once, or to pirate it" and the most common response was complete befuddlement, they simply could not comprehend that someone might not want to pirate things if they could, they could not comprehend that besides being illegal it was also just... wrong. Not absolutely evil, for sure, but still something that maybe you might want to avoid doing. Now that you can just pay 10-20 euro for a streaming service, most of them have switched over, so, yeah, service does matter, but a lack of risk or consequences on the one hand and vague notions about actors and directors (and soccer players) already being rich enough as it is, were enough to convince very many people that piracy was a victimless crime.

You just have to go along with the idea that skin provides no indication of meatiness and that the two aliens are Ford Prefect types, then the short film lands just fine.

The AITA comparison seems apt insofar as chatbots function as a second opinion. You're consciously or subconsciously looking for an outside perspective that might differ from that of your friends, provided to you by a computer that doesn't need to care about your feelings, unlike a friend. If the chatbot ends up mimicking what (not very close) friends do, you might falsely conclude that two very different kinds of sources have converged on the same answer, whereas you are really just getting two flavors of the same diplomatic interaction.

My subjective impression is that 5 years ago AITA was actually quite wholesome and the top comments tended to be insightful. The shift towards "set boundaries, always choose yourself, you don't owe anybody anything" seems fairly recent.

I read the Norwegian article that was linked, and it isn't actually similar: you would only have to pay taxes on food you've grown on your balcony (and mean to consume yourself) if you are a farmer, are growing it during regular working hours, and have an insanely huge balcony.

Another thing that makes home construction a bit different in this regard is that you could claim to build a house for yourself, live in it for a bit, and then sell it on a couple of years later. That'd be an easy way to avoid or evade taxes. Not so easy with lettuce -- once you've eaten it, you've eaten it.

I get the impression that most desktop users enable zram or zswap to get a little bit more out of their RAM but there is never any real worry about OOM, not regularly anyway, so then (according to the principles laid out in the article) it shouldn't matter much.

On my workstation, I run statistical simulations in R which can be wasteful with memory and cause a lot of transient memory pressure, and for that scenario I do like that zswap works alongside regular swap. Especially when combined with the advice from https://makedebianfunagainandlearnhowtodoothercoolstufftoo.c... to wake up kswapd early, it really does seem to make a difference.

It doesn't really need any config on most distros, no.

That said, if you want it to behave at its best when OOM, it does help to tweak vm.swappiness, vm.watermark_scale_factor, vm.min_free_kbytes, vm.page-cluster and a couple of other parameters.

See e.g.

https://makedebianfunagainandlearnhowtodoothercoolstufftoo.c...

https://documentation.suse.com/sles/15-SP7/html/SLES-all/cha...

I don't know of any good statistics script for zswap, I use the script below as a custom waybar module:

  #!/bin/bash
  stored_pages="$(cat /sys/kernel/debug/zswap/stored_pages)"
  pool_total_size="$(cat /sys/kernel/debug/zswap/pool_total_size)"
  compressed_size_mib="$((pool_total_size / 1024 / 1024))"
  compressed_size_gib="$((pool_total_size / 1024 / 1024 / 1024))"
  compressed_size_mib_remainder="$((compressed_size_mib * 10 / 1024 - compressed_size_gib * 10))"
  uncompressed_size="$((stored_pages * 4096))"
  uncompressed_size_mib="$((uncompressed_size / 1024 / 1024))"
  uncompressed_size_gib="$((uncompressed_size / 1024 / 1024 / 1024))"
  uncompressed_size_mib_remainder="$((uncompressed_size_mib * 10 / 1024 - uncompressed_size_gib * 10))"
  ratio="$((100 * uncompressed_size / (pool_total_size + 1)))"
  echo "$compressed_size_gib.$compressed_size_mib_remainder"

You don't have to pay VAT on things you fix for yourself, because you don't pay yourself at all. This is in fact a kind of (legal) tax avoidance, but not (illegal) tax evasion. Given the cost of housing, being able to build your own house or even just doing small fixes here and there, leads to a big increase in perceived income. The tradies I know can afford whatever kind of car they want, whatever kind of holiday experience, and they live in a nice home. Mind you, they typically work 50h+ a week so there's that.

Of course, the parent may also have been referring to getting clients to pay in cash and not putting anything on the books, at the expense of getting barely any pension in the end, but that's not how I read it. This is getting somewhat less common because people are more likely than 20 years ago to get a loan from a bank to pay for renovation work, and the bank will want to see invoices.

Doesn't this argument hinge on equivocating between two different definitions of aversion, though? I'm averse to bananas, but that doesn't mean I think it's immoral to eat them. The moral dimension kicks in if somebody else had to ride that stationary bike for you, because then you'd be wasting their time on frivolities.

One of the things I like most about CachyOS is that the configuration is all just in text files, one of the things I like least is that I am never quite sure whether to modify the systemd unit settings that are usually in /usr/lib somewhere, the app settings in /etc or the personal configs in ~/.config. For packages that I am unfamiliar with, I usually end up trying all three locations until I notice that my changes seem to stick.

The installer also completely broke the Windows partition that came with the workstation even though I was planning on dual booting, but oh well, no great loss there.

Other than that, there are some small conveniences and apps that I miss from MacOS (the mac calendar and mail apps are just so nice!) but the Niri window manager is just so amazing that at this point I don't think there's anything that could make me switch back.

Cute and thus worthy of an upvote, but whenever I see scientists or economists refer to first or second order effects it pertains to things that are subsequent to each other in time, or at least intended vs. ancillary. I don't think anyone except for a Stafford "the purpose of a system is what it does" Beer acolyte would designate new demand of pill bottles as the first order effect of a new medication.

It's just something that statisticians have observed across many fields: you theorize about how potentially huge a particular interaction effect or knock-on effect could be relative to the main effect, you read about the Jevons Paradox and intuitively feel that it can explain so much of the world today... and then you get the data and it just almost never does. No reason why it couldn't, just empirically it rarely happens.

The thing about second order effects is that they are almost never larger than the first order effect.

Furthermore, GLP-1 users report having fewer cravings or just reduced appetite in general, whereas what you describe would require some sort of "calorie reduction pill" which would allow people to lose weight without altering their relationship to food. But that pill does not exist.

(Generalized) linear models have a straightforward probabilistic interpretation -- E(Y|X) -- which I don't think is true of total least squares. So it's more of an engineering solution to the problem, and in statistics you'd be more likely to go for other methods such as regression calibration to deal with measurement error in the independent variables.

Do you still feel the same way if the froiznok method is an ANOVA table of a linear regression, with a log-transformed outcome? Should I reference Fisher, Galton, Newton, the first person to log transform an outcome in a regression analysis, the first person to log transform the particular outcome used in your paper, the R developers, and Gauss and Markov for showing that under certain conditions OLS is the best linear unbiased estimator? And then a couple of references about the importance of quantitative analysis in general? Because that is the level of detail I’m seeing :-)

The idea that references in a scientific paper should be plentiful but aren't really that important, is a consequence of a previous technological revolution: the internet.

You'll find a lot of papers from, say, the '70s, with a grand total of maybe 10 references, all of them to crucial prior work, and if those references don't say what the author claims they should say (e.g. that the particular method that is employed is valid), then chances are that the current paper is weaker than it seems, or even invalid, and so it is extremely important to check those references.

Then the internet came along, scientists started padding their work with easily found but barely relevant references and journal editors started requiring that even "the earth is round" should be well-referenced. The result is that peer reviewers feel that asking them to check the references is akin to asking them to do a spell check. Fair enough, I agree, I usually can't be bothered to do many or any citation checks when I am asked to do peer review, but it's good to remember that this in itself is an indication of a perverted system, which we just all ignored -- at our peril -- until LLM hallucinations upset the status quo.

Arguably Spark solves a problem that does not exist anymore: single node performance with tools like DuckDB and Polars is so good that there’s no need for more complex orchestration anymore, and these tools are sufficiently user-friendly that there is little point to switching to Pandas for smaller datasets.

In the US income from a hobby can just be added to your personal filing [1] and in Belgium, where I live, there is a similar arrangement for "diverse sources of income" [2]. If you do start a business, in the European Union you're exempt from filing VAT if your yearly revenue is below a certain amount [3]. Europe has also been pretty aggressive in getting rid of licensing requirements for various occupations and trades, certainly a photographer wouldn't need a license here.

I think the trouble you faced, resulted from being at the edge of these kinds of simple systems that do exist -- big enough to need to set up a business, but small enough that hiring an accountant or spending time to familiarize yourself with the legal requirements was out of proportion to the expected revenue. That's unfortunate, of course, but doesn't necessarily reflect on the amount of red tape that exists in general in a country.

[1] https://www.irs.gov/newsroom/heres-how-to-tell-the-differenc...

[2] https://www.vlaanderen.be/economie-en-ondernemen/een-eigen-z...

[3] https://europa.eu/youreurope/business/taxation/vat/vat-exemp...