At the time of his death, Khumalo served on various Premier Soccer League subcommittees, including the National First Division, competitions and compliance subcommittees.
Khumalo, who was also a prominent businessman in the former QwaQwa homeland and a Free State ANC official, died at a local hospital around 8pm on Tuesday.
His brother and former Boxing South Africa chief executive Bafana Khumalo said: "I can confirm that Jabu has passed on Tuesday. We are devastated as a family. He was such a wonderful person who was passionate about his soccer, business and politics.
"He always wanted to make a meaningful contribution in the community. We still have to meet as a family to make arrangements for the burial."
Speaking on behalf of the PSL, chairman Irvin Khoza said: "Jabu was a 'what you see is what you get' person. Even if he did not agree with you, Jabu was a great debater. The debate could be how fierce, he would always abide by the resolution.
"Jabuwasafootball personthroughand through. We will always remember him for all his contributions and sacrifices in making a massive contribution in the PSL. In this world, we are here to create and live memories. We are going to miss memories that he created (and) his laughter.
"The man came from a family with a strong value system. Condolences to his family. He was a great soldier of football," Khoza said.
Mamelodi Sundowns official Alex "Goldfingers" Shakoane said: "I still can't believe Jabu is gone. We formed the Public Relations Council along with him and Louis Tshakoane."
Jomo Cosmos boss Jomo Sono also paid tribute to Khumalo, saying: "He will always be remembered for his love of the game. Our condolences go to his family."