Where does /etc/hosts.allow and etc/hosts.deny come into play here? They accept hostnames so you should be able to cut out everything that isn't iprimus.