I use taskwarrior in combination with taskwiki and occasional taskwarrior-tui usage. Taskwiki allows me to store arbitrary notes in markdown files while keeping the relevant tasks list auto-generated and synchronized with data in the task tracker. It works really well together.
[0] https://github.com/GothenburgBitFactory/taskwarrior