What is the core difference between public and private companies?

When a business goes public on the stock exchange what changes regarding its ownership financial reporting transparency and who can invest in it?