It became more about them and less about the greater good, the primary purpose of them being the Charmed Ones. While it's fair for them to want their lives back after saving the world from evil ...