Is there a way to evaluate keycloak authz policies without hitting the keycloak server per request

I am using keycloak (v15.0.2) adapter for spring boot to achieve RBAC in one of my projects. I observed that the adapter makes a rest call to authorization server per request for policy evaluation. Is there a way to avoid this extra network call?