The winners were unrecognisable from the team that struggled in the group stage as they displayed sharpness and desire not previously evident.
He added: "We will go into the game quietly believing that we can cause an upset, but knowing that we will have to play very, very well because this is a good Egyptian team and they will have massive support".
The stunning elimination marked Egypt's worst-ever performance as hosts.
While more than 98 percent of the support will be rooting for the Pharaohs, Bafana are one of the popular sides in this tournament, and neutrals will be vying for them.
It's also the second major surprise of this edition after Morocco lost to Benin on penalties on Friday.
They take on South Africa on Saturday night, with current holders Cameroon set to kick off earlier than them against Nigeria.
South Africa's coach Stuart Baxter attends a press conference at the Cairo International stadium in the capital, on July 5, 2019, on the eve of the 2019 Africa Cup of Nations (CAN) top 16 match between Egypt and South Africa.
Egypt started the match strongly and threatened through the likes of Mohamed Salah and Mahmoud "Trezeguet" Hassan. "We give opposition too much respect and I fear what we are going to do against Egypt", Baloyi was quoted by Sowetan.
Lively attacking midfielder Percy Tau proved a handful for defenders, with his twists and turns unsettling them.
The forward twice tested goalkeeper Ahmed El Shenawy with powerful left-footed shots.
Midway through the first half the Pharaohs created their first clear chance, with a counter attack gifting Hassan a sight of goal with only Ronwen Williams to beat, but he directed his low shot straight at the Bafana Bafana 'keeper.
South Africa captain Thulani Hlatshwayo headed just wide as he darted on to a free-kick with 20 minutes remaining.
Kevin Spacey lawsuit dropped by accuser over groping
The young man who alleges Kevin Spacey groped him in a Nantucket bar in 2016 has dropped his civil suit against the actor . Defense attorneys questioned why the accuser erased certain text messages from the phone before turning it over to police.