Simple registry key delete not working

(imported comment written by SergioBenavides)

This is the simplest way, just replace with your own path:

dos reg delete “HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Microsoft\Active Setup\Installed Components\VPNFavorites” /f