Woking had a good chance to take the lead after six minutes when Steve Ferguson latched on to a long ball but fired wide from close range.
Eight minutes later, Woking keeper Ashley Bayes came to their rescue when a Rovers free-kick was flicked on by Grayson and Bayes collected the loose ball before Scott Morgan could capitalize.
Forest Green took the lead in the 21st minute when Martin Foster's ball into the penalty area was picked up by Rogers and he fired the ball into the right-hand corner of the net.
Nine minutes from half time, Ian Simpemba went on a darting run and cut inside before unleashing a 25-yard drive which Rovers keeper Steve Perrin superbly tipped behind.
From the resulting corner, Amos Foyewa's acrobatic effort looked to be going in, but Rogers got back on to the goal-line to clear.
Woking were given a penalty when captain Neil Smith smashed a ball into the home box, which hit Steve Jenkins who was less than two yards away and had no chance of getting out of the way of the ball.
Referee Hollick pointed straight to the spot, despite the ball hitting the top of Jenkin's shoulder. From this golden opportunity, Ian Selley scored from the spot.
Despite the setback, Rovers deservedly took the lead ten minutes into the second half when Foster's sweeping ball forward found Steve Brodie, who drilled the ball low into the right-hand corner of the net.
Woking felt they should have been on level terms 12 minutes later when a ball into the Rovers box found Foyewa in acres of space, but his shot clipped the side of the right post and went behind.
In a second mistake by the referee, Denny Ingram, who had earlier been booked brought down Raphael Nade, and looked as though he would receive his second yellow card.
Instead he got just a talking to, which incensed Cards boss Glenn Cockerill, who was then sent off for dissent.
Woking were awarded a bizarre corner three minutes from time when Nixon Ajoge 's shot looked deflected off his own player, only for the referee to award a corner instead of a goal-kick.
They scored when the corner was not cleared by the home defence and Jon Boardman pounced to earn his side a point.