LDAP failed connection blocks login

I have set Keycloak to use LDAP & the normal user + password, but when the external LDAP is not there, the connection fails and it blocks also the user + password users to connect (also any request that is trying to check the user/pass).
Is there a solution to not block the other login when the LDAP is not there?