Richardson served in the United States Army Reserves for six years. He and his wife, Carol, have three children together: Leanne, Paul, and Daniel. They also have five grandchildren: Hannah, Hughie, Henry, Luke, and Annie.
Richardson and his wife, Carol, are the owners of Morning Star Publications, Inc., which publishes the Laurel Star, Seaford Star, and Salisbury Star. Additionally, they publish biannual magazines for five local chambers of commerce and numerous specialty publications.
Senator Richardson served as President of the Western Sussex Citizens for Life and is a member of the Greater Seaford Chamber of Commerce and Seaford Kiwanis Club.