Ask HN: Why if visitors return, site does not grow

I have a blog in blogger that has a very attractive subject, and it shows in the returning visits, but for some reason as the days go by the total number of visitors does not grow that much, has anyone have an idea why? How come is this even mathematically possible?