David Stevens, CEO for the Mortgage Bankers Association had been frustrated at the general public outrage