"It's unfortunate because we've lost that faith and trust in that agency," Candice Hanson, COO of Sherburne State Bank, said.