More than Default Scopes on Identity Provider

I am making a tool that relies quite a bit on a third party. I have found how to login with that third party IDP, and how to pull the keys from keycloak once a user is logged in via said IDP. The issue however is in that I dont want to require all the scopes as not all users will require all scopes.

Based on the fact that the field is called default scopes, I assume that there is a way to set more than just those scopes and make the user re-login (and Ideally force that particular IDP on re-login), but I cant find it anywhere. Does anyone know if its possible, and if it is where the documentation is on it?