Select numbers calling through in priority mode on Android 5.0 topic

I've got a Nexus 5 on Lollipop. At night, I've got it so it will be completely silent and vibrate free by using Priority mode. My alarm will still ring through though.

What I'd like is for specific contacts to be able to call through but no one else. Is this possible?

TIA