Hiding users in a specific group

Hello,

Let’s say we have 2 groups of users, first one is “all-users” which contains all users (no surprise) and the second one is “celebrities”. All users in “celebrities” are also in the “all-users” group.
What I’m trying to accomplish is listing “all-users” except “celebrities”.
I’ve experimented with lots of permissions, policies and such but no luck, if user has access to “all-users”, they will see all of them including “celebrities” even if I particularly add negative policies for it.

I would appreciate some help if anyone has done something similar.

Thanks in advance.