Chronosphere launches with $11M Series A to build scalable monitoring tool

https://techcrunch.com/2019/11/05/chronosphere-launches-with-11m-series-a-to-build-scalable-cloud-native-monitoring-tool/

by roskilli • 7 years ago

120 35 7 years ago

techcrunch.com

carty76ers• 7 years ago

Chronoshere, a startup from two ex-Uber engineers, who helped create the open source M3 monitoring project to handle Uber-level scale, officially launched today with the goal of building a commercial company on top of the open source project.

I recall a thread here from 2-3 weeks ago about how “Uber-scale” wasn’t really Uber scale, and that most of these publicized “Uber-scale” projects ended up getting canned internally. Any insider insight to this M3 project?

roskilli6• 7 years ago

Rob, co-founder and M3DB creator here, Uber collected billions of metric samples and we had tens of billions of metrics in M3 at Uber. Netflix for reference has not published any numbers higher than single digit billions of time series. The system has run in production for several years now at Uber now. That's my thoughts on the matter, hah.

bradhe2• 7 years ago

New Relic touts collecting trillions of data points per day.

keenr• 7 years ago

It just seems another clone of datadog

im_down_w_otp• 7 years ago

The marketplace for DaaS (dashboards as a service) is really big.

roskilli6• 7 years ago

Hey Rob a co-founder and M3DB creator here, more than happy to answer any queries anyone might have. We're committed on continuing M3 being 100% apache 2 licensed, clustering and all other M3 features included. We're focused on providing reliable metrics hosting at scale.

wizardsOfOz• 7 years ago

Congrats Rob! Great to see you guys weren’t just good indoor soccer players ;). The M3DB architecture doc was a good read

roskilli6• 7 years ago

Haha TY for the kind words, I had to stop playing years ago now unfortunately with family commitments - also I mainly enjoyed playing on a team than actually developing real soccer skills (which I relied on others in the team to pull me upwards, heh)

airocker3• 7 years ago

What I am not getting from my superficial knowledge is that why is Prometheus getting so much traction over elastic search. Elastic search claims to be as good for metrics and events. The ES database itself is more advanced with eventual consistency and search capability. It can do log analytics and it can be backend to tracing tool like Jaeger. Why so much investment in Prometheus. Disclaimer: I have not used Prometheus too much myself.

richieartoul• 7 years ago

I think you'd be very hard pressed to scale an Elasticsearch cluster to 10s of millions of writes/s without breaking the bank (and even if you had a pile of money to light on fire I don't think an Elasticsearch cluster with the number of nodes you'd require to support that would work very well).

Elasticsearch is a great piece of technology and its very versatile which makes it a great fit for a lot of problems (Uber, where M3 was developed, is a heavy consumer of Elasticsearch for logging purposes for example), but for the types of metrics workloads and scale that M3/Prometheus were designed for Elasticsearch simply wouldn't work.

airocker3• 7 years ago

Es is very efficient with metrics especially in recent releases.

slovenlyrobot• 7 years ago

At their core these systems are basically specialized column stores, they have complete different read/write patterns to something like ES. The basic query unit for example is always going to be the scan, I'm not even aware of any monitoring system with some kind of secondary index capability. ES supports a bunch of nice result aggregation stuff on top of Lucene, whereas these systems are primarily /built for/ this use case

roskilli6• 7 years ago

What's interesting about some of the more modern monitoring systems like M3 and Prometheus is that they have a reverse index on top of the column store entries to very quickly find the relevant metrics for a multi-dimensional query.

In fact M3 uses FST index segments, a common Apache Lucene segment which is used by ElasticSearch, for secondary index metric name and dimension full-text search capabilities: https://github.com/m3db/m3/tree/master/src/m3ninx/index/segm...

airocker3• 7 years ago

Is there a resource to learn about this more? Also, a general introduction about how to design indexes depending on read/write patterns?

stampedes• 7 years ago

elasticsearch is the one thing i've worked with that i've had to learn to pretend i know nothing about. you do not want to get labeled the expert on that thing. it's nice and finicky.

er, crap, i've outed myself

jayp• 7 years ago

Congrats on the launch Rob and Martin. M3 is an amazing product which I had the privilege to use at Uber. Wish you two the best for your journey ahead!

samarabbas• 7 years ago

Congrats Martin and Rob on the launch. M3 is one of the best tools I used at Uber. Something which just works. I'm sure you guys will be successful as I first hand witnessed the value it brings to an organization.

aa109• 7 years ago

Really enjoyed using M3 at Uber. Great to see you guys continuing to support the open source community!

crablar• 7 years ago

We did a few shows with Rob about monitoring and time series: https://softwareengineeringdaily.com/2019/08/21/time-series-... https://softwareengineeringdaily.com/2019/02/12/ubers-monito...

reubenbond• 7 years ago

Congrats on the launch!

Metrics monitoring is hugely useful for figuring out what's going wrong (or right...) and where - especially when you can slice and dice by dimensions/tags. Microsoft (where I work) uses lots of metrics internally, for every sevice. It's nice to see M3/Chronosphere making this kind of thing more affordable and widely accessible.

smithclay• 7 years ago

Congrats on the launch, Chronosphere is joining a fast-growing club of monitoring (and related) spinoffs from large Bay Area tech companies:

Uber -> Chronosphere Google -> Lightstep Facebook -> Honeycomb Twitter -> Buoyant (and Zipkin, OSS)

devchix• 7 years ago

Splunk kool-aid drinker here; pardon my ignorant question, but why not just use Splunk?

Actually I think my real question is, why are there such a proliferation of these monitoring/logging/visualization -AAS startups? Who are the target customers, in terms of spends?

pram• 7 years ago

The most obvious answer is most of the new alternatives are open source and “free” while Splunk isn’t.

bradhe2• 7 years ago

There weren’t any tools available on the market that could handle Uber’s scaling requirements

This isn't a problem that you can build a business around.

Edit: Ah, I get it. This is like a Mesosphere play--they're shepherding the M3 technology in the open source ecosystem and offering a commercial version. That makes more sense.

sciurus3• 7 years ago

The technical details of their software are described in https://eng.uber.com/m3/

This looks like a competitor to Cortex (https://www.cncf.io/blog/2018/12/18/cortex-a-multi-tenant-ho...).

bboreham• 7 years ago

They took a different path on the ”never build your own database” question.

valyala• 7 years ago

Another viable player that took the path similar to M3DB is VictoriaMetrics [1]. This allowed implementing various features [2] and optimizations [3] without the need to negotiate their integration into upstream Prometheus. Such negotiations can stuck forever. [4]

[1] https://github.com/VictoriaMetrics/VictoriaMetrics/

[2] https://github.com/VictoriaMetrics/VictoriaMetrics/wiki/Exte...

[3] https://medium.com/@valyala/measuring-vertical-scalability-f...

[4] https://github.com/prometheus/prometheus/issues/3746

fnordsensei• 7 years ago

Is the name inspired by the building in C&C Red Alert by any chance?

https://cnc.fandom.com/wiki/Chronosphere_(Red_Alert_3)

That’s my personal reference to the word, but searching around a bit, it seems that it was registered as a trademark by a medical company already in 1991, 5 years before Red Alert.

https://trademark.trademarkia.com/chronosphere-74147725.html

hnarn• 7 years ago

One thing that I often miss when reading about this stuff is benchmarks. So it's faster than Prometheus? Prove it. So it's faster than Postgres, or TimescaleDB? Prove it.

It should be trivial, and the fact that it's not there and what you find instead is terms like "Uber-scale" is slightly worrying.

I'm not trying to take anything away from the achievements made here by the guys at Uber, but anyone seriously considering using this in production would probably need a better contrastive comparison between alternatives.

roskilli6• 7 years ago

It's not raw speed or raw performance on a single node that M3DB is optimized for, it's for a reliable scale out story when you have a considerable number of instances required to collect the raw data you operate on (organizations of certain size/complexity run into this, not just a handful of organizations/companies).

Benchmarks tend to favor the authors and are frequently game-ified, look at GPU benchmarks like 3DMark that frequently had manufacturers release optimizations that were really only utilized in specific benchmarks.

Chronosphere launches with $11M Series A to build scalable monitoring tool

Related Stories