Patterson played four seasons with the Ball State University Cardinals, playing in 41 total games and starting 28 times. In his collegiate career, he recorded 189 total tackles and had six interceptions. In his senior season, he had 23 kick returns and averaged 25.7 yards.
Patterson was signed as an undrafted free agent by the New England Patriots in 2015 and has been on the Indianapolis Colts, St. Louis Rams, and Cleveland Browns' practice squads. Originally signed with the club in January, 2018, but was put on the suspended list on May 20, 2018. Re-signed on January 4th, 2019.