The only other pub on St. Mary's Street is Prohibition, previously Bar 10 and Bar Coast. It's therefore possible that the Gemstone, selling its namesake Stones Bitter [1], was a previous incarnation of Prohibition. However, we suspect it might have been here at the end of the same row that Prohibition is on.

Possible location of Gemstone, St. Mary's Street. (c) googlemaps.
1. Ale of Two Cities, CAMRA (1989).