Discrepancies inside defconfig
I've just found some discrepancy and some missing things inside our defconfig, which could result in a weird latency behaviour for switch.
On line 4 CONFIG_NO_HZ=y is defined. Otherwise on line 70, there's CONFIG_HZ_1000=y which means the HZ is set to 1000. Proven by Google Pixel devices, the second option improves response time of our device. So you should keep just one and not both.
Line 68 and 69 is also weird, does the Tegra support SMT ? (Hyperthreading)
Then I have seen CONFIG_ENERGY_MODEL=y on line 85, does the Tegra even have an EAS energy model ? Couldn't find one yet at the device tree, which would be important for EAS. With an energy model you can generate by the ARM LISA tool you could even do some energy aware scheduling on switch in combination with schedutil governor instead of ondemand.