"A bit bittersweet. My first game in the Champions League, a double deflection and it goes in off me for the victor", Sainsbury told Optus Sport's Mark Schwarzer.
But England captain Kane came to the rescue with a predatory equaliser before heading the crucial last-gasp victor with the aid of a deflection off PSV's Trent Sainsbury.
"Now is to be focused on Saturday but talking about Champions League is about being focused on Inter Milan".
But the north London club are now just three points behind second-placed Inter and have their fate back in their own hands.
Instead, Kane's goals in the 78th and 89th minutes gave the English team a glimmer of hope of a top-two finish in Group B with matches still to come at home to Inter Milan and away to Barcelona.
Iin the final moments of regular time, another Kane header took one deflection in the box off a PSV defender before deflecting again off Sainsbury - and beating the wrong-footed keeper. We did everything, everybody was fighting for the result. And in the end we won'.
Their vulnerability from set-pieces was again exposed as De Jong, who scored PSV's late equaliser in Eindhoven a fortnight ago, out-jumped everyone and planted a firm header into the corner from Gaston Pereiro's corner.
"It was completely unfair, the (score), during the game because to concede so early increased their belief".
Striker Kane finally levelled the contest when he fired home after being teed up by substitute Fernando Llorente.
Asked if he thought his team need to improve against Inter, Pochettino said: "I always want more from the team".
Here, we use Opta data to dig a little deeper into Tottenham's Premier League form to see what the underlying causes of Pochettino's unhappiness could be.
Despite only managing a single point from their first three matches, Tottenham Hotspur still have a slim chance of making it into the knockout phase of the Champions League.