imcoconut

I agree completely. Also definitions matter. Currently in the US one of the leading causes of death, if not the leasing cause, is opiods which the CDC classifies as “accidental overdose”. The healthiest people in the US are probably abusing opiods at lower rates and therefore less likely to die from the leading cause of “accidental death”. The study is from sweden but just pointing out that the assumption they make is flawed - “we should not expect a relationship between fitness and accidental death”.

I thought your anecdote and commentary were relevant and extremely thought-provoking.

The person you're responding to here was clearly emotionally triggered by your anecdote. I wouldn't spend too much time trying "convince" them that what you wrote is true.

it's pretty simple but on various consulting jobs I've had to build SQL databases sometimes with lot's of tables with lot's of columns. Sometimes we switch from on prem to cloud, or vice versa or switch from postgres to sql server, etc. I have this toolkit that automates a lot of the tedious stuff. it allows me to take pandas dataframes and do the following:

- auto detect and convert column types

- save as a parquet file in a folder

- then autogenerate a sqlalchemy table/metadata file in python for all tables with sensible defaults for column types (e.g. 2x the longest string in a column for varchar)

- build the db and all tables

- load data from the files into the tables

this makes it really easy to bootstrap the entire db from a folder of parquet files for testing with sqlite and then makes it easy to move to prod on postgres/sqlserver etc. Before I go to prod i still have to add constraints and keys and indexes but that doesn't take too long. and for dev/testing the data's not too big so performance doesn't really suffer from lack of keys/constraints then we can use something like alembic on the big sqlalchemy tables definition file to do db migrations.

it's kind of like this: https://github.com/agronholm/sqlacodegen but solving an inverse problem.

basically it bootstraps the db and schemas and gets me like 95% of the way there. my quality of life is better with it.

This looks awesome. I'd be super interested in testing this out and providing feedback on it. I'm going to make an account and is there an email/link to submit feedback as I use it?

As far as I’m concerned Bayer and Monsanto are like evil incarnate

Especially so when they were a subsidiary of IG Farben.

The company had ties in the 1920s to the liberal German People's Party and was accused by the Nazis of being an "international capitalist Jewish company".[8] A decade later, it was a Nazi Party donor and, after the Nazi takeover of Germany in 1933, a major government contractor, providing significant material for the German war effort. Throughout that decade it purged itself of its Jewish employees; the remainder left in 1938.[9] Described as "the most notorious German industrial concern during the Third Reich"[10] in the 1940s the company relied on slave labour from concentration camps, including 30,000 from Auschwitz,[11] and was involved in medical experiments on inmates at both Auschwitz and the Mauthausen concentration camp.[12][13] One of its subsidiaries supplied the poison gas, Zyklon B, that killed over one million people in gas chambers during the Holocaust.[b][15]

The Allies seized the company at the end of the war in 1945[a] and the US authorities put its directors on trial. Held from 1947 to 1948 as one of the subsequent Nuremberg trials, the IG Farben trial saw 23 IG Farben directors tried for war crimes and 13 convicted.[16]

https://en.wikipedia.org/wiki/IG_Farben

Not drag and drop but for a 100% python solution h2o wave is pretty cool. It has a focus on data-based dashboards but can be used to pretty easily create very good looking frontends for all sorts of applications. And you never have to leave python (whether that's a pro or a con is up for debate :))

https://wave.h2o.ai/docs/getting-started

He has been saying exactly this for many years and has lead many efforts to improve both the implementation and API via projects like arrow and pyarrow.

Also, pandas was purpose built for a pretty specific domain of financial timeseries and cross-sectional data analysis at a time when the python ecosystem was much younger and very different from today.

It's not his fault it became so wildly successful! (actually it was - it's a great piece of sofware :))

im a big fan of loguru.

Mito looks awesome.

Just want to say that I respect the fact that you built this library, are offering it open source, for free, and want the telemetry on. You are up front and open about it.

Sometimes I think people can get a little entitled with all the work someone else puts in to a project they want to use (not accusing GP of this, speaking generally). As you said, under the license anyone is more than welcome to fork, modify and open source. Yay open source indeed :)

I completely agree with you

Why are you so confident?

It seems a fair number of experts have well justified doubts based on studies of already deployed lower energy radiation.

https://blogs.scientificamerican.com/observations/we-have-no...

Citing this large body of research, more than 240 scientists who have published peer-reviewed research on the biologic and health effects of nonionizing electromagnetic fields (EMF) signed the International EMF Scientist Appeal, which calls for stronger exposure limits. The appeal makes the following assertions:

“Numerous recent scientific publications have shown that EMF affects living organisms at levels well below most international and national guidelines. Effects include increased cancer risk, cellular stress, increase in harmful free radicals, genetic damages, structural and functional changes of the reproductive system, learning and memory deficits, neurological disorders, and negative impacts on general well-being in humans. Damage goes well beyond the human race, as there is growing evidence of harmful effects to both plant and animal life.”

The scientists who signed this appeal arguably constitute the majority of experts on the effects of nonionizing radiation. They have published more than 2,000 papers and letters on EMF in professional journals.

The World Health Organization's International Agency for Research on Cancer (IARC) classified RFR as "possibly carcinogenic to humans" in 2011. Last year, a $30 million study conducted by the U.S. National Toxicology Program (NTP) found “clear evidence” that two years of exposure to cell phone RFR increased cancer in male rats and damaged DNA in rats and mice of both sexes. The Ramazzini Institute in Italy replicated the key finding of the NTP using a different carrier frequency and much weaker exposure to cell phone radiation over the life of the rats.

Since 5G is a new technology, there is no research on health effects, so we are “flying blind” to quote a U.S. senator. However, we have considerable evidence about the harmful effects of 2G and 3G. Little is known the effects of exposure to 4G, a 10-year-old technology, because governments have been remiss in funding this research. Meanwhile, we are seeing increases in certain types of head and neck tumors in tumor registries, which may be at least partially attributable to the proliferation of cell phone radiation. These increases are consistent with results from case-control studies of tumor risk in heavy cell phone users.

This looks amazing, and very timely.

Any chance you have a mirror on gitlab (or github)?

You're not necessarily wrong that the causes of the increases in prices for things like healthcare, etc. are due to policy issues, among other things. But you can kind of make that argument for any good or service - that that the increase in the price of x is a "specific industry/policy issue" and not a "monetary issue".

That doesn't negate the fact that people are still paying higher prices. If the fed is mandated with controlling the increase in prices then it is still upon them to address it, no? The fact that monetary policy is not a primary cause of the good/service specific inflation is irrelevant.

This is robinhood's fault.

He's not wrong that instant (or same day) settlement would be better than T+2, but there were plenty of other brokers that did not restrict trading. This was a liquidity issue for robinhood. This is a risk you run being a "cool startup that moves fast and breaks things" in the arena of securities trading. Additionally, Some of the bugs they've experienced are absurd in the context of a broker that potentially houses people's entire liquid net worth, including a bug that reversed the direction of trades - "oh you meant to sell those shares? whoops!"[0].

Why choose robinhood when the alternatives include some of the most well capitalized institutions in the world, eg JP Morgan or Bank of America Merrill Lynch - they have literal trillions in assets each and neither has these issues. I appreciate that robinhood pioneered zero commission trades, but that has been largely adopted by the industry at this point. From my standpoint I only see risks versus their peers and precisely zero benefits.

I implore everyone here to stay far away from robinhood.

[0] https://www.nytimes.com/2021/02/02/technology/robinhood-ceo-...

This is robinhood's fault.

He's not wrong that instant (or same day) settlement would be better than T+2, but there were plenty of other brokers who did not restrict trading. This was a liquidity issue for robinhood. This is a risk you run being a "cool startup that moves fast and breaks things" in the arena of securities trading. Additionally, Some of the bugs they've experienced are absurd in the context of a broker that potentially houses people's entire liquid net worth, including a bug that reversed the direction of trades - "oh you meant to *sell* those shares? whoops!"[0].

Why choose robinhood when the alternatives include some of the most well capitalized institutions in the world, eg JP Morgan or Bank of America Merrill Lynch - they have literal trillions in assets each and neither these issues. I appreciate that robinhood pioneered zero commission trades, but that has been largely adopted by the industry at this point. From my standpoint I only see risks versus their peers and precisely zero benefits.

I implore everyone here to stay far away from robinhood.

[0] https://www.nytimes.com/2021/02/02/technology/robinhood-ceo-...

I don't know for sure but I don't think there needs to be a chinese firewall between the two like at banks. Banks investment banking and advisory divsiions have access to insider information by the nature of their work, which is why the chinese firewall exists between them and the sales and trading desk. Citadel is a hedge fund, however that uses only public information (presumptively, as otherwise would be illegal) so i don't think there's a reason why they would need to be firewalled off. Also Citadel does use Citadel Securities for execution.

Additionally, they're both owned (mostly) by Ken, who is know for being a bit "detailed" (to put it nicely) when it comes to his businesses. He almost certainly has live second by second pnl updates for all parts of all of his business, he almost certainly was the one who made the decision to invest 1.4+ bn into Melvin, and he almost certainly knows that retail flow (esp robhinood) is a huge part of citadel securities business.

Honestly I think reddit has some grounds for a case here, but IANAL.

Awesome list, thanks a lot. Upstract is a particularly cool new aggregator that I think I'll be checking a lot going forward.

No reason you cant still use airflow for the orchestration/depenendecy management/scheduling. And for the processing and storage - Pandas and sqlite.

Also would highly highly recommend looking into kedro (which has airflow integration, or you could just run your pipelines with crontab)

Do you believe there have been any right wing terrorists in the US in the last few decades?

fstrings and datclasses changed my life. thank you :)

I see, thanks for the correction. I agree with your hot take.

I see, thanks for the correction. I thought the I guess if they wholly owned the company then legally they should be allowed to transfer the cash/profits, generally speaking. But if there was ongoing prosecution and they did it specifically to avoid having to actually pay the 8.3bn bill being stuck with the company then that definitely sounds illegal. If they transferred the profits to personal accounts then they should still be personally liable for all of it.

Correct. I do believe what they did was quite evil, and they should be disgorged of all profits - and if that bankrupts them then all the better. While 8.3bn is still not the 11bn they made in profits, it's still significantly more than 225mn. The headline is misleading.

I think the point dumpsterdiver is making is that determining what is falsifiable or not is context/time dependent. As our understanding of reality changes over time so does our definition of what can be falsifiable.

do have the link(s) for that Boeing thread?

same

It's true. Have you read the book "What is Life?" By Schrodinger? He discusses the very concept you're talking about as he speculates on the physical substrate of genetic information (which was discovered to be DNA not long after the book was published).

Assuming the ultimate purpose for the hack is a crypto scam shows a complete lack of imagination.

If the quoted $700k loss was a glitch, is robinhood in any way liable here?

you might find the books I linked in this post helpful:

https://news.ycombinator.com/item?id=16929156

There are a few different types of roles in the quant world, and number of different types of funds:

alph/signal research: apply quantitative methods to come up with profitable trading ideas and strategies. This is kind of like "Data Science" coming from tech - finding the insight in the data

quant development: build the infrastructure for the data and strategies. This is kind of like "Data Engineering" coming from tech - a lot of ETL and general development work.

portfolio analytics/execution: figure out how to combine different alpha ideals into a portfolio that can be traded. Involves trading and monitoring the live portfolios.

risk management: Thinks of all the possible "risks" the portfolio can be exposed to and ensure they're properly addressed/hedged/accounted for.

This is a broad generalization which can vary greatly from place to place. Typically the smaller funds will have more blurred lines and lots of roles that involve doing multiple of the listed above. At the larger funds, the roles will typically be more well defined and segmented.

Lot's of quant funds are happy to hire people with no finance/trading background if they're strong enough in other key areas. A lot of the "finance" specific stuff can be picked up on the job. Also ML is quite in demand right now.