What are the core differences between a public and private cloud?

In web infrastructure when should a growing business choose AWS or Google Cloud (public) vs setting up their own dedicated private server infrastructure?