Kelly is one of the few football players to have a race horse named after him. "Wildcat Kelly" was a gelding pacer in the stable of Yellow and Black farms of Hamilton, a partnership of Dill (Pickles) Southwick, a former quarterback for the Hamilton Tigers, and businessmen Bruce Woodward and George Ridpath. (Yellow and Black were the colours of the Tiger Cats.) As of 1970, the six-year-old "Wildcat Kelly" had won $14,000 in its lifetime.
Kelly was inducted into the Canadian Football Hall of Fame in 1992. He spent his entire post-football life in Hamilton, Ontario, Canada, first as a teacher with the Hamilton Board of Education, and later as a Recreations Officer with the Hamilton-Wentworth Detention Centre, where he was regarded as a gentle giant and a gentleman. He was a frequent guest on Tiger Cat alumni days and was asked to speak on many occasions. His speeches were often dominated by a spiritual appreciation and gratitude for the wonderful life and opportunities he had been given. He continued to live in Hamilton until his death in 2016. Ellison Kelly is survived by five children, Claudette, Jude, Claire, Karen, & Jerald