Fine Grained Permissons - Administration of a single Group


I would like to manage users within a group without having access to the users into the whole realm. An admin should be able to manage only users into that one group they have access to.

Currently I am testing the Fine Grained Permissions, but seems like once I give to my group the client role ‘manage-users’ automatically the admin has access to all users into the realm.

Is it possible to create such an Admin who can create and manage users only concerning a specific Group, not the whole realm?