[dghlsakjg]

Not only idiomatic, it is part of the accepted definition of 'only' in Websters and OED.

It is perfectly acceptable to use only to refer to a select group.