Born in Seattle, he quarterbacked to become an All-American for Roosevelt High School in Seattle from 1976-80. He was a three-year letterman as a wide receiver at University of Washington. Pattison was drafted by the Los Angeles Raiders in the 1985 National Football League draft. He ended up playing five years in the NFL with the Los Angeles Raiders, Los Angeles Rams, and New Orleans Saints before retiring in 1988.