In 1985 he took up a teaching position in Tembisa, Gauteng at the Ikusasa Senior Secondary School, where he headed the Social Studies department from 1985 until 1990. Additionally, he was a founder member and national leader of NEUSA (National Education Union of South Africa). In 1990 he was elected Assistant General Secretary of the newly formed SADTU (South African Democratic Teachers Union), and in 1995 became General Secretary, a position he held until 2009. During this period, SADTU grew in membership from 30,000 to a quarter of a million.

During this time he was increasingly active in Education International (EI) – with 30 million affiliated members worldwide; and served as President from 2004-9, when he was also a member of the Global Unions Council.

In 2009, the Minister was released by SADTU and COSATU to apply to stand for election to Parliament on the ANC list. As a Member of Parliament, he served as Chair of the Portfolio Committee on International Relations and Cooperation, during which time he participated in several study tours and overseas missions focusing on human rights.

In November 2010, the President appointed him to the post of Deputy Minister of Rural Development and Land Reform, where he was given responsibilities including: restitution claims, gender issues, HRD and communications. A year later, in October 2011, the President appointed him Minister of Public Works.