Brown was named to the Pro Bowl a total of nine times and helped the Giants win the NFL Championship in 1956.
Following the 1965 season, Brown retired, suffering from chronic phlebitis. He became the Giants' assistant offensive line coach in 1966 and was promoted to offensive line coach in 1969. He remained with the Giants organization in the scouting department for many years.
In 1999, he was ranked number 57 on The Sporting News' list of the 100 Greatest Football Players.