Bunny Shaw gave us an early lead at a sun-drenched Joie Stadium, but Spurs levelled before half-time through Cathinka Tandberg.
Visiting attackers Matilda Vinberg and Jess Naz then scored in the second half to take all three points back to London.
Following Chelsea’s goalless draw at Liverpool on Saturday, City had the chance to reclaim the top spot in the WSL, but instead the result brought our brilliant 18-game unbeaten home league record to an end.
Speaking to Sky Sports, Knaak said: “Right now, it hurts a lot.”
“There’s big frustration. We know that’s part of football, that’s part of a season.
“Sometimes you have setbacks to then restart, get better again. So we’re going to use this, even though it hurts now.”
Knaak wore the armband against Spurs in the absence of captain Alex Greenwood, who is currently out with an ankle injury.
The German defender says the opportunity to captain City is a huge source of pride, and pointed to leadership qualities throughout the squad.
“It means a lot [to be captain],” she said. “It’s a very big honour.
“I’m happy to help Alex out here. I’m trying my best to lead the team and I know we have a lot of big leaders, good leaders in the team.
“We’re supporting each other.”