There is a train/bus combo from Bayonne to Saint-Jean. Maybe the train goes all of the way now, but when I took it last summer, a landslide had covered part of the tracks, so the train ran partway, and then they switched us to a bus. The ticket costs only a few euros, six if I remember correctly.