HN user

jtagx

43 karma
Posts17
Comments14
View on HN
flink.apache.org 5y ago

Scaling Apache Flink Automatically with Reactive Mode

jtagx
2pts0
flink.apache.org 5y ago

Apache Flink 1.12 with a batch execution mode in DataStream API, K8s HA released

jtagx
8pts0
flink.apache.org 6y ago

Apache Flink Serialization: Comparison of Kryo,Avro,Thrift,Protobuf and Internal

jtagx
2pts0
flink.apache.org 6y ago

Apache Flink 1.10 Announced: Kubernetes, Hive Integration, Full TPC-DS, PyFlink

jtagx
18pts1
flink.apache.org 6y ago

Apache Flink 1.9.0 Released

jtagx
15pts0
flink.apache.org 7y ago

Deep-Dive into Apache Flink's Network Stack: Credit-Based Flow Control (Low Lat)

jtagx
14pts0
data-artisans.com 7y ago

Introducing Serializable ACID Transactions on Streaming Data

jtagx
13pts1
flink.apache.org 9y ago

Apache Flink 1.3.0 released with incremental checkpointing,retractions in SQL,

jtagx
3pts0
flink.apache.org 9y ago

From Streams to Tables and Back Again: An Update on Apache Flink's Table&SQL API

jtagx
4pts0
data-artisans.com 10y ago

Apache Flink vs. Apache Storm and Why I Left Twitter to Work on Flink

jtagx
21pts2
data-artisans.com 10y ago

Extending the Yahoo Streaming Benchm and Winning Twitter Hackweek with Apache Flink

jtagx
7pts0
www.elastic.co 10y ago

Building Real-Time Dashboards with Apache Flink, Elasticsearch, and Kibana

jtagx
6pts0
flink.apache.org 10y ago

Off-heap Memory in Apache Flink and the curious JIT compiler

jtagx
30pts4
flink.apache.org 11y ago

Apache Flink 0.9 released: Exactly-once for streaming, new libraries and more

jtagx
10pts0
data-artisans.com 11y ago

Factorizing a 28 billion elements matrix with Apache Flink

jtagx
10pts1
flink.apache.org 11y ago

Meet Flink, the Apache Software Foundation's Newest Top-Level Project

jtagx
6pts1
stratosphere.eu 12y ago

Stratosphere 0.4 Released with Iterations, YARN and more

jtagx
2pts0

Ververica | Product Manager, DevOps, Junior/Senior Engineers, Technical Writer | Full Time | Berlin, Germany or EU Remote | https://www.ververica.com/careers

We are the original creators of Apache Flink, the open-source unified batch/stream processing system that powers applications in all types of companies, from tech giants like Alibaba, Amazon, or Netflix, to traditional enterprises like banks or telcos. We contribute heavily to Apache Flink while building enterprise-grade products on top of Flink.

Overview of the most notable new features (in my opinion):

- Improved Memory Management and Configuration

- Reworked job submission (allowing things like Zeppelin or other interactive notebooks)

- Native Kubernetes integration (there's now multiple ways to submit Flink to K8s)

- Hive integration: Use your Hive tables, UDFs etc. in Flink SQL

- Full TPC-DS coverage for batch: this basically means Flink supports a lot of SQL syntax

- PyFlink supports user defined functions (based on Apache Beam's portability framework). This makes Flink's Python support really strong

... there are many more features in the announcement (1200 tickets were resolved)

For some reason, Google also marks "Google Alerts" notifications as spam. They contain spammy search results, but the email comes from Google. At least they are consequent in not white-listing their own services :)

Great post detailing how Flink is managing data within the JVM and implementing internal operators (hashing, sorting, ..) working with that serialized data. I also like the performance analysis in the post.