How to modify social login cancel behavior?

Hi guys, I currently set up social login on a WordPress site and I have set the kc_idp_hint for the auth URL so it goes straight to the social login page. However if I press cancel, it doesn’t bring me back to the WordPress website. Instead, it brings me to the Keycloak login form. Is there a way to fix that behavior? Thank you very much!