There is a perception that audit report is important only for publicly held companies not for privately held companies.Is it correct?

I don't think so. Effective  audit reports are important for any company.

Private companies do also have stakeholders like owners and bankers. These companies also need to follow the laws of the land like taxation, zakat etc. The private companies audit report is also relied upon by prospective clients. I hope this makes my point.