How do you have RelaySelection configured on the clients? Manual or Automatic?
You don’t mention the OS in question, but given the use of Ansible can I assume Linux? If this is the case, you need to stop the client BEFORE you modify the settings manually or the client will rewrite the settings when it shuts down as part of the restart process. Windows doesn’t behave that way.
There are several Settings that deal with the Relays