Any process that decreases the rate, frequency or extent of the enlargement or overgrowth of all or part of the heart due to an increase in size (not length) of individual cardiac muscle fibers, without cell division. [ GOC:BHF GOC:tb GOC:dph ]