Fix ingress-nginx upgrades

What does this MR do and why?

Fix ingress-nginx upgrades

Increase helmRelease upgrade timeout, and decrease ingress-nginx pods terminationGracePeriodSeconds to fasten upgrades

Pods will wait 60s for connections to close by themselves, then it will start to close connections.

We also add a nodeSelector to only install controllers only on control plane nodes, otherwise it may take a wile to upgrade them successively on large deployments

See https://kubernetes.github.io/ingress-nginx/user-guide/nginx-configuration/configmap/#worker-shutdown-timeout

And https://github.com/kubernetes/ingress-nginx/blob/8ca27e7ee902ec6b77c7cfb1749254cdbab36c24/charts/ingress-nginx/values.yaml#L933-L938

Related reference(s)

Closes #1344 (closed)