Delegates from all nine provinces, as well as the three leagues, began casting their ballots after midnight.
Meanwhile, the ANC says voting has not yet been concluded contradicting earlier reports. It says some delegates still have to vote.
The Independent Electoral Commission (IEC) officials are now counting the 4 776 votes.
The results could be released Monday afternoon.
Click below to watch videos: