During Hay Festival, colourful flags stand in the gardens in front of Hay Castle, and the courtyard, which is usually home only to the 'wall of books' self-service bookshop, fills up with food stalls catering for the hordes of visitors which the annual literary festival brings to Hay-on-Wye.