It's pretty unusual to say "coloured people" here in the UK, too. I usually phrase it something like "people who aren't white", clumsy though that is.