There are all kinds of reasons the government would want to keep records for businesses:
Publicly traded companies are required to file a Form 10-K which gives financial information for the year. Non-profit companies must file Form 990 with their financial information.