What do you think that makes hiring managers believe that a person with a PMP Certification will make a good project manager?

Those with a certification follow a structured framework and have incorporated knowledge from past experience from others, and that is an advantage.

Its always better to hire a person with good understanding of science of project management. PMP makes aware of process and different knowledge areas that a manager should know instead of knowing only art of project management.