Aggregating events in Graphite over time

http://obfuscurity.com/2012/04/Unhelpful-Graphite-Tip-1

by craigkerstiens • 14 years ago

17 4 14 years ago

tbh2• 14 years ago

For exactly this reason, Metricfire keeps different aggregate views of the data. Observations is one view. Graphite throws too much away, leading to this sort of, admittedly pretty clever, hacking about with multiple functions.

obfuscurity_2• 14 years ago

I don't follow. Graphite doesn't "throw anything away". You define your own retention policy and Graphite follows it. You're free to maintain 1-second resolution for 50 years, if you have the storage capacity for it. But that isn't what this article is about.

The example covers a particular metric use-case for annotation-style details, and how to extract a meaningful aggregate from what is otherwise contextual data. Personally I love that Graphite lets me "hack about" with multiple functions. But I'm a data whore, YMMV. ;-)

tbh2• 14 years ago

Perhaps "throw away" is the wrong phrasing. The aggregates are always averages, no absolute counts. After a rollup, the maximum of some value will no longer be the maximum - it'll be the average of a bunch of maximums. There's no type information with which one can maintain this, and no observation/sum counting. For 'data whore' people like you and I, this should matter. :) (or at least, it does to me)

The article seems to be about trying to get an approximation of observation count data out of Graphite, which doesn't really store that.

Aggregating events in Graphite over time

Related Stories