Private vs Public Beta

My partner and I are ready to launch a beta version of our startup. The thing is, this has taken a lot longer than expected, and we want to get this out there as soon as possible.

My question is, what are the pro's and con's of a private or public beta? Why do people advise against public betas?