james_woods

Citing an article from MIT Sloan Management Review:

"But there’s no clear evidence that these mandates improve financial performance. A recent study of S&P 500 companies that was conducted by University of Pittsburgh researchers found that executives are “using RTO mandates to reassert control over employees and blame employees as a scapegoat for bad firm performance.” Those policies result in “significant declines in employees’ job satisfaction but no significant changes in financial performance or firm values,” they concluded." (https://sloanreview.mit.edu/article/return-to-office-mandate...)

HELLO HAMBINI FANS AND WELCOME

(from the post) Tableau is checking to see if the host has changed. This can happen all the time in the cloud, for example GCP has a live migration feature that keeps you going even if the underlying hardware fails. Also, restarting a VM is not guaranteed to boot up on the same host. The problem: Support cannot reset the license count, until you have reached the limit (max of 3 activations), i.e. participated in a lottery and hit the jackpot by locking up your system: https://kb.tableau.com/articles/issue/error-tableau-server-i...

If you stop buying animal products that lowers the demand for them, so it has long-term effects, donating $100 is a short-term effect.

SQL was not made for programmers alone. It has been invented also for not so technical people so that verboseness and overhead is part of the deal.

When Ray and I were designing Sequel in 1974, we thought that the predominant use of the language would be for ad-hoc queries by planners and other professionals whose domain of expertise was not primarily data- base management. We wanted the language to be simple enough that ordinary people could ‘‘walk up and use it’’ with a minimum of training.

https://ieeexplore.ieee.org/document/6359709

What about aerodynamics? https://www.swissside.com/blogs/news/back-to-the-wind-tunnel

Nice! Btw: Is there a list with projects that got done due to the pandemic? :)

If I have to report transaction (aka money) then yes. I need to update already emitted results. If it's just a log-based metric for internal use then no.

What I would like to have is a choice - and Apache Beam for example lets you choose this.

Taken from [0] If you wanted to use the information above to make decisions, it could often be wrong. Let's say you want to wait for it to be correct; how long do you wait?

I know how long I want to wait, 30 minutes in one of my cases as I know that I've seen 95% of the important data by then. In the streaming world there is _always_ late data so being able to tell what should happen when the rest (5%) arrives is crucial for me.

This differs from use-case to use-case for me and being able to configure this and handling out-of-order data at scale is key for me when selecting a framework for stream processing. Apache Beam and Apache Flink do this very well.

Taken from [1]: Apache Beam has some other approach where you use both and there is some magical timeout and it only works for windows or something and blah blah blah... If any of you all know the details, drop me a note. It obviously only works when you window your data as it needs to fit in memory. The event-time and system-time concept from Beam and Flink are very similar, also the watermark approach. Thank you for sharing the links, For me it is now clearer where the difference lies between differential-dataflow and stream-processing frameworks (which also offer SQL and even ACID conformity!). I'm using Beam/Flink in production and missing out on one of these mentioned points is a deal-breaker for me.

Where and how in dataflow is late data being handled? How can I configure in which ways refinements relate? These questions are the standard "What Where When How" I want to answer and put into code when dealing with streaming data. I was not able to find this in the documentation, but I only spent a few minutes scanning it.

https://www.oreilly.com/radar/the-world-beyond-batch-streami...

https://www.oreilly.com/radar/the-world-beyond-batch-streami...

Also "Materialize" seems not to support needed features like tumbling windows (yet) when dealing with streaming data in SQL: https://arxiv.org/abs/1905.12133

Additionally "Materialize" states in their doc: State is all in totally volatile memory; if materialized dies, so too does all of the data. - this is not true for example for Apache Flink which stores its state in systems like RocksDB.

Having SideInputs or seeds is pretty neat, imagine you have two tables of several TiBs or larger. This is also something that "Materialize" currently lacks: Streaming sources must receive all of their data from the stream itself; there is no way to “seed” a streaming source with static data.

I am using Apache Airflow since a couple of years now and the biggest improvement was the addition of the Kubernetes Operator. You basically keep a vanilla Airflow installation and the custom code is encapsulated and tested in containers. This simplifies it a lot.

„and for settlers trying to persuade Indians to abandon tribal lands that these newcomers wished to inhabit.„

Ah - they persuaded them. What a lovely euphemism.

Why not simply use a VPN?