Top all-time · #3368
Ververica
Company blog · data-artisans.com/blogsystemsdata
Ververica is the company blog at data-artisans.com, writing about systems and data. Since 2015, 23 different Hacker News readers have linked it 56 times, most often “Extending the Yahoo Streaming Benchm and Winning Twitter Hackweek with Apache Flink”. No feed was found, so read it on the site itself.
Too few sampled comments (12) to say how often HN recommends it.?
Why HN links it
HN commenters link data Artisans blog posts as references on Apache Flink, including exactly-once state semantics, Apache Beam, transactional streaming, and streaming benchmarks. Some comments are job postings.
Summarised by Claude from a sample of 12 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
The original creators of Apache Flink. Ververica delivers enterprise stream processing with 2x faster performance, 40% lower TCO, and sub-10ms latency.
Most-linked posts?
- Extending the Yahoo Streaming Benchm and Winning Twitter Hackweek with Apache Flink4 people · 4 mentions · first linked 2016-02-02
- On Designing a Stream Processing Benchmark3 people · 3 mentions · first linked 2017-07-27
- Why Apache Beam? A Data Artisans Perspective2 people · 3 mentions · first linked 2016-05-04
- /careers2 people · 3 mentions · first linked 2016-05-03
- The Curious Case of the Broken Benchmark: Apache Flink vs. Databricks Runtime2 people · 2 mentions · first linked 2017-12-15
- Factorizing a 28 billion elements matrix with Apache Flink2 people · 2 mentions · first linked 2015-01-27
- Introducing Serializable ACID Transactions on Streaming Data2 people · 2 mentions · first linked 2018-09-04
What Hacker News says?
data Artisans | ONSITE (Berlin, Germany) and REMOTE Hiring Process: Application, Phone interview, and On-site interview What: Data processing, Big Data data Artisans is building the next-generation platform for programming data-intensive applications. We are tackling some of the biggest technical challenges in big data and data streaming today. We love open sourcing our code, and working together with the open sourc…
Comment linking /careers
on “Ask HN: Who is hiring? (November 2016)”Submitted Drivetribe’s Modern Take on CQRS with Apache Flink as a story · 83 points
HN discussiondata Artisans | ONSITE (Berlin, Germany) and REMOTE Hiring Process: Application, Phone interview, and On-site interview What: Data processing, Big Data data Artisans is building the next-generation platform for programming data-intensive applications. We are tackling some of the biggest technical challenges in big data and data streaming today. We love open sourcing our code, and working together with the open sourc…
Comment linking /careers
on “Ask HN: Who is hiring? (June 2016)”Submitted Apache Flink vs. Apache Storm and Why I Left Twitter to Work on Flink as a story · 21 points
HN discussiondata Artisans | ONSITE (Berlin, Germany) Hiring Process: application, remote interview, on-site interview. data Artisans is building the next-generation platform for programming data-intensive applications. We are tackling some of the biggest technical challenges in big data and data streaming today. We love open sourcing our code, and working together with the open source community that has formed around Apache Fli…
Comment linking /careers
on “Ask HN: Who is hiring? (May 2016)”Submitted An Application Manager for Stream Processing and Apache Flink as a story · 15 points
HN discussionCounting views/impressions in combination with Apache Kafka sounds like the ideal use case for a stream processor like Apache Flink. It supports very large state which can be managed off-hand. This should enable you to count the exact number of unique views in real time with exactly once semantics. Here is a blog post on large scale counting with more details. It also includes a comparison with other streaming techn…
Comment linking /blog/extending-the-yahoo-streaming-benchmark
on “View Counting at Reddit”Submitted The Curious Case of the Broken Benchmark: Apache Flink vs. Databricks Runtime as a story · 14 points
HN discussionThis is pretty cool stuff. I have been working with Apache Flink where the computational model is exactly once (which is still hugely useful) but it still comes with caveats about duplicate messages downstream, which makes writing to downstream db or having multiple flink processes tricky. Often times this is done by windowing data and producing complete snapshots of that window (i.e. you need to keep all the state…
Comment linking /blog/drivetribe-cqrs-apache-flink
on “Exactly-once Semantics: How Kafka Does it”Submitted Introducing Serializable ACID Transactions on Streaming Data as a story · 13 points
HN discussionNote that this proposal is being back not only by Google, but also Cloudera, Data Artisans, Talend, Cask, PayPal, ... Some other posts on the announcement: http://googlecloudplatform.blogspot.com/2016/01/Dataflow-and... http://blog.cloudera.com/blog/2016/01/spark-dataflow-joins-g... http://data-artisans.com/dataflow-proposed-as-apache-incubat... http://blog.cask.co/2016/01/cask-anticipates-googles-dataflo...
Comment linking /dataflow-proposed-as-apache-incubator-project/
on “Google proposes its Dataflow batch/stream tech to the Apache Incubator”Submitted Serializable ACID Transactions on Streaming Data as a story · 12 points
HN discussionTrue. In most streaming systems, exactly-once refers to the state that is maintained and controlled by the streaming system. For that, Flink can guarantee such semantics. That state can also be exposed externally, see for example here: http://data-artisans.com/extending-the-yahoo-streaming-bench... For interactions (writes) with external systems, you need transactional integration. There is WIP to do this for transa…
Comment linking /extending-the-yahoo-streaming-benchmark/
on “Announcing Apache Flink 1.0.0”Submitted RBEA: Scalable Real-Time Analytics at King with Apache Flink as a story · 12 points
HN discussionHere: https://yahooeng.tumblr.com/post/135321837876/benchmarking-s... http://data-artisans.com/extending-the-yahoo-streaming-bench...
Comment linking /extending-the-yahoo-streaming-benchmark/
on “Announcing Apache Flink 1.0.0”Submitted On Designing a Stream Processing Benchmark as a story · 10 points
HN discussionGoogle's take: https://cloud.google.com/blog/big-data/2016/05/why-apache-be... Data Artisan's take: http://data-artisans.com/why-apache-beam/
Comment linking /why-apache-beam/
on “What Is Apache Beam and How Is It Used?”Submitted Apache Flink at MediaMath: Rescaling Stateful Applications in Production as a story · 10 points
HN discussion"data Artisans Streaming Ledger [...] [extends] Apache Flink [...] to perform serializable transactions from multiple streams across shared tables and multiple rows of each table." [1] This sounds like a hybrid approach if you need streaming to handle the speed and volume of data, but still want to use ACID on a small subset of events. LMAX [2] architecture may be another approach to consider for your application. […
Comment linking /wp-content/uploads/2018/08/2018-08-31-dA-Streaming-Ledger-whitepaper.pdf
on “Introducing Serializable ACID Transactions on Streaming Data”Submitted Factorizing a 28 billion elements matrix with Apache Flink as a story · 10 points
HN discussionData artisan's take: http://data-artisans.com/why-apache-beam/
Comment linking /why-apache-beam/
on “Why Apache Beam? A Google Perspective”Submitted Queryable State in Apache Flink 1.2.0: An Overview and Demo as a story · 8 points
HN discussionhttps://data-artisans.com/blog/dellemc-launches-open-source-...
Comment linking /blog/dellemc-launches-open-source-pravega-complete-apache-flink-connector
on “Pravega: Storage Reimagined for a Streaming World”Submitted Session Windowing in Flink as a story · 8 points
HN discussionSubmitted How to factorize a 700 GB matrix with Apache Flink (full story) as a story · 8 points
HN discussionSubmitted Extending the Yahoo Streaming Benchm and Winning Twitter Hackweek with Apache Flink as a story · 7 points
HN discussionSubmitted Running Apache Flink Everywhere: Flink on DC/OS and Apache Mesos as a story · 5 points
HN discussionSubmitted Why Apache Beam? A Data Artisans Perspective as a story · 5 points
HN discussionSubmitted On Designing a Stream Processing Benchmark as a story · 4 points
HN discussionSubmitted What to consider when defining a cluster size in Apache Flink as a story · 3 points
HN discussion
