It pains me to agree with Fauxohontas, but it works.
Our post office system also runs a bank - NS&I. It is the main profit for the Royal Mail. It is limited - savings, mainly, with cash withdrawals over the counter only. No cheques, no card, but a good rate of interest, tax free.