It comes down to knowing the many small neighborhoods that gave birth to Vigo. Bouzas down by the waterfront is a place that pilgrims following the coastal path will cross. The barrio around the Co-Cathedral, Alameda park (and parts uphill from it), and the neighborhood around Plaza de La Constitución are all nice and lively.
If you are near the Municipal Albergue in the neighborhood known as Berbés you need only follow the path uphill.
The issues with pilgrims poor view of Vigo is because of the arrows, and the injustice they do to seeing the best parts. Vigo is not alone in this respect (I’m looking at you Sahagún) but it is the most extreme version.
It is also a 45 minute boat ride to the Cies Islands (a national park), which are worth the visit even on foul weather days. This can be hard to plan because you need to do so a few weeks in advance but if anybody is interested in how it is done I can write up some instructions.