Changes to enforce keyset based pagination

What does this MR do and why?

Solves #427008 (closed) ..

!150482 (merged) We had to revert the earlier MR since it got merged before breaking change timeline

As per discussion #427008 (comment 1875437205) We are not removing offset pagination but enforcing keyset pagination in case the api request involves returning records more than 50000