(imported comment written by murtasma91)
I generally remove all add/remove related actions for manual groups after about 1 - 2 months. It really depends on your envrioment and how many operators you have. In our envrioment we have over 250 console operators and 40+ sites so I have to be somewhat agressive with my cleanup because actions pile up quickly in our deployment.