spec loader FAILS when there are more than 10000 tables
### Describe the bug As the initial step while running permifrost is to load the spec file and check that all entities exist in snowflake, in case we have large database this fails. As `SHOW TABLES` command over all databases is a really wide search and we have a lot of tables in BACKUP db which we do not want to get rid of immediately hence, while validating the table names mentioned in the spec file we have been facing this issue - `Checking that all entities in the spec file are defined in Snowflake snowflake.connector.errors.ProgrammingError: 090153 (22000): The result set size exceeded the max number of rows(10000) supported for SHOW statements. Use LIMIT option to limit result set to a smaller number.` ### Steps To Reproduce Have one Database with more than 10k tables and try to run permifrost dry run command ### Expected behavior We should be able to validate if the table or database or schema exists without having to run SHOW command on all of it ### Screenshots and log output If applicable, add screenshots or log output to help explain your problem. ![Screen_Shot_2022-08-02_at_3.50.27_PM](/uploads/b4fe0dd1da7530d6dce099e323731a72/Screen_Shot_2022-08-02_at_3.50.27_PM.png) **The output of `permifrost --version`:** ``` permifrost, version 0.14.0 ``` **The operating system you're using:** ``` Mac OS Monterey ``` **The output of `python --version`:** ``` Python 3.7.4 ``` ### Additional context Add any other context about the problem here.
issue