Conor Townsend believes the two early goals Spurs scored at the start of the second half killed the contest.
Danger men Harry Kane and Son Heung-Min were both on target for the hosts at the Tottenham Hotspur Stadium, with the two strikes just four minutes apart.
And the full-back was disappointed to see his side concede “silly goals” on Sunday afternoon as Albion returned home empty-handed.
Conor said: “There were a couple of lapses in concentration in the second half.
“They’ve got very good players who can punish you, and they did. It’s disappointing because we got in at half-time having defended well and created a few chances ourselves.
“But they got a couple of goals early after the break and killed the game and that was disappointing because we’d kept them quiet until that point.
“We’re not giving in and we work hard all week on the training ground but we need to do that on the pitch now.
“There’s been promising signs with some of the things we’ve been doing but we’re letting ourselves down with silly goals and we’ll be working hard to do that for the next game.
“We can work on things during the week, but we’ve got to improve because games are running out and we need points.
“It’s good that we’re creating chances against a big team like this. It is pleasing but defensively, as a team, clean sheets are what’s going to keep us up.
“We need to win points from every game now and we need to go into next Sunday confident and take the positives from today into that game to kick-start the rest of the season for us.
“We’re not quitting yet and there’s still chances for us to go on a run.”
