Data-Parallel Actors: A Programming Model for Scalable Query Serving Systems

https://www.micahlerner.com/2022/06/04/data-parallel-actors-a-programming-model-for-scalable-query-serving-systems.html

by greghn • 4 years ago

89 4 4 years ago

micahlerner.com

ianandrich• 4 years ago

Anyone interested in data meshes should give the paper itself a read.

The primitives developed for the system are incredibly flexible and potentially worth knowing about.

OnlyMortal• 4 years ago

Based on personal experience as an enterprise near-line NAS developer for a well known company - you may be using our laptop - serialisation doesn’t scale well.

It’s easy to code, naturally, but if you’re saving large objects your performance will tail off over time as the volume of data increases.

Wins I’ve seen and coded myself have been in reducing the iops.

randomopining• 4 years ago

You’re saying serialization for immutable objects?

jmalicki• 4 years ago

Serialization vs. what... Throwing away data?

I mean yes, saving more to disk is slower than not saving it, computing more is slower than not computing anything... Or are you making a more subtle point?

Data-Parallel Actors: A Programming Model for Scalable Query Serving Systems

Related Stories