Yes. You can manage this on the Admin Dashboard. 

Navigate to the setting page 

Click “View Details” then select the ones you want to opt-out of. (You will be able to un-check their names once you want them back to be matched)