Ask HN: How to make the most of a slow job? 12 years ago
Try to improve the situation. Software development is all about team work, and skills and experience in developing the development are appreciated. If you can tell in your CV that I made this and that improvement, I would consider it a great plus. CS degree also sounds like a good idea (I'm in Finland, don't know about scene there).
If it does not work out, you can always look for a new place.