Yes. The government actually owns a bank, NS&I, that offers a special account "premium bonds" that effectively pays interest in the form of winnings from a lottery which make it tax free.