Disabling LDAP signin does not disable LDAP mode in the user settings

I disabled LDAP signin through the admin page but then the page /profile/account is still in LDAP mode and hides the user account password setting form.

Some options are unavailable for LDAP accounts

I tried gitlab-ctl reconfigure twice. Maybe cause by the template caches?