Labeling would definitely be a key feature set especially if it's heavily integrating with email service providers like gmail. What were you thinking of building it in?
I've been working on something similar in the past year and I'm considering bringing it back.