Taylor grew up in Dallas swimming for the Dallas Athletic Club and Highland Park High School. As a swimmer at Texas A&M, he won every event he entered at the 1942 and 1943 SWC meets. He held the SWC 220-yard freestyle record from 1943-1953. After serving in the U.S. Air Force during WWII, he worked for many years with the Texas Parks and Wildlife Department.