Rovers failed to make it two wins in a row at the Mem losing 1-2 to Stevenage.
A powerful strike from Chris Whelpdale secured all three points for Teddy Sheringham's side after Matty Taylor cancelled out Steven Schumacher's early goal.
Darrell Clarke made two changes to the side that lost to Crawley Town on Saturday handing latest recruit Paris Cowan-Hall his debut at the expense of Cristian Montano and Tom Lockyer came in to replace Mark McChrystal.
Rovers started the game on the back foot as Lee Brown turned Ronnie Henry's cross behind for a corner which eventually fell to the feet of Steven Schumacher who drove his shot low into the bottom corner of the net past Lee Nicholls.
Seemingly stunned by going behind so early on Rovers took a while to adjust themselves before battling back in the game. With 15 minutes on the clock the home side had their first real chance as Matty Taylor took the ball well on his chest, turned and got a shot off but couldn't hit the target under heavy pressure from Fraser Franks.
Moments later the Stevenage keeper was called into action for the first time as Billy Bodin found space to cut inside from the Rovers right and struck a curled effort with his left foot forcing a good diving save from Chris Day.
After going behind it was all Rovers, Lee Brown was allowed time and space to run down the left flank and Tom Parkes picked him out with a superb ball which set him free in the penalty area. Brown steadied himself before finding Jermaine Easter who saw his shot blocked by Fraser Franks.
Seconds later latest signing Paris Cowan-Hall had his first real effort in the game as he picked up the ball on the left before his shot got blocked again in the penalty area falling to Matty Taylor who was denied by Day.
For all their attacking intent Rovers finally got themselves level just past the half hour mark. Paris Cowan-Hall picked up on the left hand side before playing an inch perfect pass into the path of Matty Taylor who sprung the offside trap, composed himself before lashing the ball past Chris Day to make it 1-1.
Stevenage improved once the game went level but failed to test Nicholls but at the other end of the pitch Matty Taylor set the ball for Chris Lines to strike but his shot cannoned off of Michael Tonge.
Darrell Clarke's side started the second half well as Stuart Sinclair was fouled by Steven Schumacher to give Rovers a chance from a set piece. Chris Lines free kick was cleared to the Lee Brown on the edge of the box who struck the ball with power but into the arms of Chris Day in the Boro goal.
Boro had a rare chance inside the hour mark as a Steven Schumacher free kick was hit straight into the arms of Lee Nicholls.
However it was Stevenage who took the lead for the second time in the game as Steven Schumacher laid the ball off for Chris Welpdale who let fly from range with a thunderbolt of a strike that beat Lee Nicholls.
Darrell Clarke decided to changes things up just past the hour mark replacing Paris Cowan-Hall and Jermaine Easter with Cristian Montano and Ellis Harrison who was instantly involved getting a head on a Chris Lines free kick but his effort clipped the top of the crossbar on it's way behind for a Stevenage goal kick.
Rovers tried hard to get back into the game restricting the visitors to long range efforts as substitute Charlie Lee twice tried from range but failed to hit the target.
The home side had a series of free kicks in the closing stages but Cristian Montano saw his effort blocked before Lee Brown fired a shot over from the edge of the penalty area.
Up next for Rovers is the trip to St James Park to take on South West rivals Exeter City.
Rovers: Nicholls; J. Clarke (Leadbitter - 78), Lockyer, Parkes, Brown; Cowan-Hall (Montano - 65), Sinclair, Lines (C), Bodin; Taylor, Easter (Harrison - 65).
Unused Substitutes: Mildenhall (GK), McChrystal, Mansell, O. Clarke.
Stevenage: Day; Franks, Whelpdale (Gnanduillet - 90), Schumacher (Conlon - 90+), Matt, Pett, Tonge, Welles, Henry (C), Ogilvie, Kennedy (Lee - 72).
Unused Substitutes: Voss (GK), McCombe, Hughes, Gorman.