Baker was a three-time letterman in both baseball and football and was an Associated Press All-America honorable mention pick in 1964 for football. Also in 1964, Baker received All-Ivy first team honors, AP first All-Ivy team, and ECAC All-East team accolades. He was awarded the Pop Warner MVP award in 1964. Baker held the current school record in highest average gain per kick-off return (52.7 yards), season (35.1 yards) and career (27.7 yards). As a senior in 1964, Cornell led the nation in kickoff return average (27.1 yards). In baseball, he played third base, center field, shortstop, and second base. His highest percentage batting average was .232 (1965).
