The rather derelict looking building on the corner of Prince Street and Royal Oak Avenue was at one point a Seaman's Mission & Instutue, and more recently an evangelilcal church of some kind. It was damaged during the war and seems to now be some kind of Frankenstein's monster of architecture with an odd modern frontage. The rather more together-looking (but still, frankly, unattractive!) building to the left is Prince House.
Edit to add: (19 June 2022): Know Your Place has just tweeted some amazing photos of the chapel interior (here's some more) that have just been added to the Community Layer on their incredibly useful website.
GPS Coordinates:
51.44995, -2.59668
Location: Canon's Marsh