Hi Dom,
Please see the article.
When you undeploy a policy that you previously deployed to an OU or a security group, Client Security deletes the GPO that it created for the OU or security group deployment.
When you undeploy or delete a policy that was deployed to a registry file, the console shows the change to the policy but Client Security does not delete the registry file.
Deploying and undeploying policies
Joyce
Please remember to mark the replies as answers if they help and unmark them if they provide no help. If you have feedback for TechNet Subscriber Support, contact tnmff@microsoft.com.