Allow partition manager to increase the partition number by 1 and create a new batch of partitions

We would like to create the next batch of partitions and switch to use the new partitions without enabling the feature flag ci_partitioning_automation