A 57-year-old out-of-state man was rescued after he was swept off a pier in South Haven on Friday.