turk-

Story for those who didn't see it: https://intuitiveexplanations.com/tech/replit/

It's not clear what the value add of this is vs OSS DIY Spark + Iceberg?

Free option is already available through OSS Spark/super low cost EMR. What's your value add over those?

Apache Nifi and Accumulo do come to mind, both out of NSA.

Buy the dip!

No idea. Time will tell but a high number of mutations is not ideal.

Yes. And there is a small possibility that something even worse happens for those previously infected/vaccinated called antibody-dependent enhancement (ADE). ADE occurs when the antibodies generated during an immune response recognize and bind to a pathogen, but they are unable to prevent infection. Instead, these antibodies act as a “Trojan horse,” allowing the pathogen to get into cells and exacerbate the immune response.

The worst case with a new covid strain would be if people who were vaccinated by a previous vaccine or infected by an older strain experience antibody-dependent enhancement after being infected with the new strain. This is where the body recognized the new strain as the old and starts producing anti-bodies. These anti-bodies actually assist the new strain in infecting your cells, making the disease worse.

ADE has not been detected with any covid strains/vaccines so its not something to worry about for now but who knows what may happen in the future. I've been keeping my eye out for any news of ADE with any of these new strains.

Certain viruses like dengue fever can be much worse if you had previously caught a different strain due to ADE.

https://www.chop.edu/centers-programs/vaccine-education-cent...

I don’t understand what capability you are saying Databricks lacks. This capability is literally the entire premise of the Data Lakehouse. With Snowflake you need to export data out/or pipe data over jdbc/odbc to an external tool. With Databricks you can use SQL for data warehousing and when you need you can work with that same data using python to train an ML model without piping data out over jdbc (using the spark engine). One security model, one dataset, multiple use cases (AI/ML/BI/SQL) on one platform.

Here is the thing with the lakehouse though, you have flexibility and don’t need to use multiple engines to achieve the lakehouse vision. Databricks has all the security features a redshift / snowflake does so you can secure databases and tables rather than s3 buckets. It does get more complex if you want to introduce multiple engines but at least you have the option to make that trade off if you want to.

If you want simplicity, you can limit your engine to Databricks. You can also use JDBC/ODBC with Databricks if you want to use other tools that don’t support the delta format/parquet but piping data over JDBC/ODBC doesn’t scale with any tool to large datasets. Databricks has all the capabilities of big query/snowflake/redshift but none of those tools support python/r/scala. Their engines need to be rewritten from the ground up in order to do so.

With a datawarehouse, you can only interface with your data in SQL. With big query and snowflake, your data is locked away in a proprietary format not accessible by other compute platforms. You need to export/copy your data to a different system to train an ML model in python or R.

With the lakehouse, you can use python, R and Scala, (not just SQL) to interface with your data. You can use multiple compute engines (spark, Databricks, presto) so you are not locked into one compute engine.

I recall being a junior programmer, and wishing I could talk to my MySQL database in python code to do some processing that was difficult to express in SQL, that day is finally here.

Interesting. I've always wondered why tomatoes in the US taste like shit. Why is there a trade off between high yield and taste? Is there not a high yield + great taste variety?

This comment doesn't make any sense. I don't see how Cloudflare publishing the source code to their own hosted s3 service would help prevent lockin when an open source alternative to s3 is out there with hdfs. While s3 is a proprietary system, Any programs you write to operate against s3 can also easily be migrated to other object stores (Azure ADLS, Google Object store) with relative ease.

The thing that keeps people locked into s3 are egress/bandwidth cost. Until Cloudflare came along, no hosted object store (Google,Azure, including self hosted HDFS onprem or in the cloud) had economical bandwidth/egress costs.

No it wouldn't, no executive at any company would risk federal time and money laundering charges if it was made illegal.

What you're describing entrepreneurship. I'd imagine pretty much every entrepreneur realizes they have an extremely low probability of success, but some people prefer the thrill of the hunt to the feeling of being a cog in the wheel job at large corporation.

Spark/Databricks + Delta lake would be a good solution for combining streaming and batch analytics. MemSQL is good for low latency streaming.

Seems like a straightforward case for small claims court against KitSplit. You just have to sell the judge on a very straightforward case. The thing about not getting fucked over in situations like this is having the intestinal fortitude to bully companies like KitSplit into making it right for you. You'll probably get compensated by them by blogging about it but you probably could have just muscled them to give you your $4.5k in small claims court.

Globalization is the cause of inequality. Technology just facilitates it. Capitalism leads to a concentration of wealth in the hands of a few and periods of globalization have resulted in high levels of inequality. Inequality today is comparable to the levels during the gilded age and there was no IT back in the 1870's.

"Talented tech followers in the process who are willing to work for him in exchange for prestige and a lower salary"

To be fair these engineers are taking a lower salary but are getting paid really well in terms of stock options.

Interesting, I've never heard of kdb. Probably because the pricing is absurd from the little research that I have done so far:

http://quant.stackexchange.com/questions/3156/is-there-any-t...

$25k for 2 core setup is a little crazy. They should definitely add a free tier if they want more adoption and more people investigating their tech. Spark is open source and free.

"The Drug War doesn't have a sound moral basis"

Drug War is immoral because drug laws almost exclusively enforced on the poor and minorities. Big banks getting away with funneling money to cartels is the heart of why the drug war is immoral!!

hmm I wonder who could be doing this.

https://www.techdirt.com/articles/20140518/17433327281/cisco...

Policies that prohibit discussion of Salary are illegal.

http://www.npr.org/2014/04/13/301989789/pay-secrecy-policies...

This completely false. Five countries neighboring Syria - Lebanon, Jordan, Turkey, Iraq and Egypt - host 97% of the refugees. Turkey, Lebanon and Jordan have taken in 3 million refugees.

Egypt and Iraq have another 200,000 are much poorer than Turkey, Lebanon and Jordan and have taken in 200,000 which is more than all of Europe combined.

Qatar, Saudi Arabia, Kuwait, and UAE refuse to take in refugees in large numbers. They are also known for horrible human rights abuses. It would be foolish to attempt to go to these countries as a refugee.

When you are a working on a side project 10-15 hours a week and need to integrate payments, being able to integrate stripe in a few hours is a game changer. Imagine having only 10-15 hours a week to work on something but spending 40 hours just on payments.

This seems like more of a gripe about life in general, capitalism and 80/20 rule.

https://en.wikipedia.org/wiki/Pareto_principle

No. They are increasing from 50% of 6% to 50% of all deferrals. So the maximum before was like $540 if you put in $18,000. Now its $9000.

"Retirement readiness is an important part of overall financial wellness, so beginning Jan. 1, 2016, we’ll increase the company’s 401(k) match from 50 percent of the first 6 percent that employees defer, to 50 percent of all regular deferrals."

Unions have their purpose but mainly serve unskilled labor. It has a lot to do with the nature of the work. Similar to the reason why lawyers, doctors, architects and accountants don't have labor unions. Unions also tend to be anti-technology as technology tends to automate peoples jobs.

Collective bargaining has little to offer white collar workers.

The additional utility offered by collective bargaining for programmers is probably not larger than the negative utility of having to pay a middleman army of union organizers, employees and lawyers.

How is Uber's 50b valuation rubbish? You do realize all the private unicorn tech companies put together are still worth less than Microsoft right?

How does he know Chrome is transmitting ALL conversations that it hears? His arguments aren't valid:

"(Ok, so how does it know to start listening just before I’m about to say ‘Ok, Google?’)"

This could easily be achieved offline.

The same argument could be made for Siri, a wiretapping device which you carry with you all the time. In fact wiretapping your phone would be much more effective then wiretapping a computer browser application.

Before making such accusations he should present some solid data, like network traffic from an idle chrome application during conversations (with and without saying "Okay Google"). If an idle chrome application was always transmitting data to google, he would have a solid argument.

They're valued at 1.6 billon. Pretty successful if you ask me.

http://blogs.wsj.com/digits/2015/01/14/big-data-startup-mong...

I work as an Engineer at a VC backed ($20m from two rounds) product company in the US. We used outsourced Engineers for most of our developers. We are located not located in Silicon Valley but some of our VC's are from the valley.

Our founder & CTO has experience with co-founding another successful startup ($25-$50 million in revenue) with an outsourced engineering team, which I also and many of our team members also worked at.

The engineers we have employed in Kiev are very good. However, working with outsourced engineers is still very challenging. One of the things that allows us to be successful is our experience with it and what we've learned from our mistakes at our previous company. I wouldn't recommend it for your average company.