We had the same issue at first. But we found if you go under the admin tools section there is a place to delete all users.

Thanks @Jonathan
It was a bit confusing since I was thinking in terms of the owner having quick access to all their groups data, but I understand the difference in GetMyGroups now. It's a call on the profile and not on the group.