Django EAV 2 – Entity-Attribute-Value Storage for Django

by Siegmeyer • 8 years ago

26 17 8 years ago

theomega• 8 years ago

Can somebody explain a usecase for this?

ailox• 8 years ago

This can be useful whenever you need additional models w/ attributes that are not known in advance. For example you may want to allow your users to create a mask where they can enter data based on their own structure. e.g. google forms or strapi https://strapi.io/demo

girzel2• 8 years ago

I had to resort to Wikipedia before this even made sense[1].

Apparently it's a technique for efficiently storing small subsets of potentially enormous/variable/unknown attributes on objects.

Instead of a SQL table with 500 columns for all potential attributes (most of them NULL for most rows), you have a SQL table with three columns: the object in question, the attribute in question, and the attribute value. The first two columns are pointers to two other tables: a table of objects (PKs and other basic data), and a table of all the allowable attributes.

I can see how it's useful, in certain circumstances.

[1] https://en.wikipedia.org/wiki/Entity%E2%80%93attribute%E2%80...

lsaferite• 8 years ago

A situation that exists in Magento and causes numerous performance issues.

girzel2• 8 years ago

Come to think of it, several years ago I had to migrate a website from Wordpress (I think it was Wordpress) to Django. The Wordpress database schema was nothing but EAV tables: Every damn thing had all of its attributes listed in a separate table, and object retrieval traversed several tables each time.

I suppose this was necessary or at least useful for a general-use web framework like Wordpress, where no one knows what kinds of attributes various users will want to create, and therefore table _columns_ are stored as table _data_, and no one ever has to do any migration.

But it was dog-slow. The switch to Django halved the number of tables in the site, and the whole thing went about three times as fast (plenty of other reasons for that, though).

Granted, now I have to do Django migrations rather than Wordpress web-console manipulation, but as someone said in a different post, Django migrations aren't that hard these days.

esaym• 8 years ago

Its an (anti) pattern for those that don't really know SQL: https://www.slideshare.net/billkarwin/sql-antipatterns-strik...

acjohnson55• 8 years ago

That's not at all true. Obviously the pattern can be misused but your own link mentions that it may be appropriate when the attributes need to be flexible or dynamic.

ivan_ah2• 8 years ago

This is very useful if you want to ship new features without constantly changing DB tables by adding new fields to models.

Example scenario:

- Year 0: ship v1.0 of software with EAV table in place

- Year 1: a few months later you need to store some extra attributes for a feature, so you change the code to look for these attributes if they are available, and ship updates v1.1, v1.2, v1.2.3-experimentA, etc. none of which require DB migrations.

Like @lsaferite says, this is not super efficient as it requires an extra DB lookup when retrieving each object, but hey... features! (and less stressful software updates, since migrations will never break the system)

Using an EAV table also allows you to ship special features only for specific clients (e.g. special integrations that apply to only certain users or custom builds).

- Year 2: When shipping v2.0 you can convert all the attributes from successful feature experiments into "real" model attributes (field) and ship the v2.0 data model, possibly still keeping the EAV table around for v2.1, v2.2, etc.

I think it's a nice pattern since it puts all the "DB migration risk" into a few big chunks (less upgrade paths to test), but these days Django migrations have gotten so civilized that there is less need for this...

antsar• 8 years ago

I’ve used the EAV pattern to allow users to add “custom fields” to an object.

The application has Person objects, who work for a Department. Lets say one department wants to record their employees’ shirt size, while another department wants to record their employees’ favorite color. Then, next week, they decide to also track their favorite brand of beer.

EAV allows department administrators to set this up on-the-fly without any development or database migrations.

Another way to tackle the same problem (used by Drupal, for example) is to actually modify the database schema at runtime, creating/modifying tables whenever your users want to change how the application behaves.

alexandernst• 8 years ago

Or just use JSONField, because that’s exactly the reason why it exists.

ivan_ah2• 8 years ago

Yep, it's essentially the same thing. I guess EAV approach was the old way from before JSONField days.

In both cases the cost of this flexibility and migration-less data model extensibility is extra code paths and guards to check if these "optional" attributes are present or not. Spaghetti code anyone?

Zodd3• 8 years ago

JSONField is not always available and is not equivalent to EAV.

dplgk• 8 years ago

In what situation is JSONField not available but other third-party modules are?

dexterbt1• 8 years ago

This is an example of the Inner-platform effect.

https://en.m.wikipedia.org/wiki/Inner-platform_effect

Zodd3• 8 years ago

That's an overgeneralisation. EAV is used in certain situations to solve one specific problem. It's not general-purpose and should not be used as one.

Django EAV 2 – Entity-Attribute-Value Storage for Django

Related Stories