Using Postgres Arrays in Django

http://craigkerstiens.com/2012/11/06/django-and-arrays/

by g3orge • 14 years ago

54 9 14 years ago

I'm curious about the performance characteristic of Postgres arrays and how to decide when to use an array versus when to use a many-to-many join.

For instance, I have an app with a "project" with users that have different roles (owners and members). Right now, I'm modeling that with a join table that contains the role information. Would those be better as arrays? (I'm inclined to think not.)

Alternatively, I also have a messaging system in place, where the recipients probably would be better modeled with an array.

Anyway, this is great information, and it gives another, nice tool in the quiver. Thanks!

tghw• 14 years ago

Arrays are useful when order matters. Traditionally, in SQL, you would have to have an `order` field, which takes a bit of overhead to keep correctly ordered. For example, if you wanted to swap two items, you'd need a transaction around it to prevent race conditions. Likewise, deleting an item requires updating the `order` field of each item after the deleted one. With an array, the order is inherent in the structure.

cbsmith3• 14 years ago

Really you should never have a toss up between a many-to-many join and an array in your schema. The right place to use an array would be a case where you were dealing with a one-to-many join with a trivial entity that probably shouldn't be an entity.

That said, arrays are also terribly useful in computation. There are lots of vector operations that really don't make sense on a result set, but that PostgreSQL can compute very efficiently if presented with an array.

cbsmith3• 14 years ago

To clarify: I'd think using arrays for mapping out roles to users is probably a bad idea. That's really a relation. On the messaging side, you could make a case for the id's of the users being rolled up in to the message, but that assumes that you don't track anything about the messages on a per-recipient basis (like, "delivered, received, received time, etc.).

netghost• 14 years ago

Arrays in postgres are incredibly useful for some things. For instance if you use gist or gin index (I forget which), you can do fast intersection queries on arrays.

This is really useful if you want to do something like get all the posts with a certain set of tags: `select posts.tags && ARRAY['postgres', 'arrays']`.

It's also useful for implementing things like materialized paths if you're modeling hierarchies, or adjacency lists if you're modeling graphs I suppose.

Of course all of this could be done with small join tables, but the array intersection / set syntax gives you some nice tools.

ismarc• 14 years ago

I rarely use postgres arrays as an actual storage type, but have used them frequently in results (there are aggregation functions to turn multiple rows into an array). The common use is something like pulling a user's info and roles in a single query with the roles from the many to many relationship aggregated to an array, so the result is one row per user and only requires one trip to the db.. The other common use is similar to above, but for handing off to a stored procedure of some sort. I haven't found a use for it as a stored column type, however.

waterside81• 14 years ago

This looks like one of those "sometimes it's better, sometimes it's not" features. If you're using the Django admin, then the many-to-many relationship would be preferable because it's a better way to manage lists. If you're not and you're just storing lists of simple data, then this might be better. YMMV.

cbsmith3• 14 years ago

Didn't we just have a post of this? http://www.niwi.be/2012/10/07/postgresql-array-fields-with-d...

thanatos519• 14 years ago

A very sensible implementation, but the syntax tastes clunky and exposes the SQL data type.

Instead of letting the SQL leak into my code, as in texts = ArrayField(dbtype="text", dimension=2) I want to write text = models.TextField() ''.Array(dimension=2) so can't djorm_pgarray.fields (or any other array-supporting ORM magic) add Array() to the Field base class?

Using Postgres Arrays in Django

Related Stories