The Girls of the Abbey School by Elsie J. Oxenham

The third book in the series picks up immediately from 'The Abbey Girls', Dick, arguably the most annoying character in British school story literature, discovers the old church beneath the Abbey. Despite his attempts to keep his explorations secret, his rummaging enables Jen, Joan, and Joy to discover a mysterious cache of long-hidden jewels.