feat: queryPreprocessing in logicalRestore + support inline SQL in any queryPreprocessing (#407)

Description

• support queryPreprocessing in logicalRestore
• add inline SQL processing to snapshot jobs (logicalSnapshot, physicalSnapshot) as well

Related issue

#407 (closed)

Examples

retrieval:
    jobs:
        - logicalRestore
        - logicalSnapshot
    spec:
        logicalRestore:
            options:
                queryPreprocessing:
                    queryPath: ""
                    maxParallelWorkers: 2
                    inline: |
                      CREATE ROLE tony;
                      CREATE ROLE mary;
        logicalSnapshot:
            options:
                dataPatching:
                    queryPreprocessing:
                        inline: |
                            CREATE ROLE snapshotUser;

Checklist

• MR description has been reviewed
• MR changes are functionally tested
• MR does NOT have text changes OR there are text changes and they have been reviewed
• MR does NOT have API/CLI changes OR there are API/CLI changes and they have been reviewed
• MR does NOT have UI changes OR there are UI changes and they have been reviewed

Closes #407 (closed)

engine/configs/config.example.logical_generic.yml

@@ -288,6 +288,18 @@ retrieval:
         #   database2:
         #   databaseN:
 
+        # It is possible to define pre-processing SQL queries. For example, "/tmp/scripts/sql".
+        # Default: empty string (no pre-processing defined).
+        queryPreprocessing:
+          # Path to SQL pre-processing queries. Default: empty string (no pre-processing defined).
+          queryPath: ""
+
+          # Worker limit for parallel queries. Parallelization doesn't work for inline SQL queries.
+          maxParallelWorkers: 2
+
+          # Inline SQL. Queries run after scripts placed in 'queryPath'.
+          inline: ""
+
     logicalSnapshot:
       options:
         # Adjust PostgreSQL configuration
@@ -308,6 +320,9 @@ retrieval:
             # Worker limit for parallel queries.
             maxParallelWorkers: 2
 
+            # Inline SQL. Queries run after scripts placed in 'queryPath'.
+            inline: ""
+
 cloning:
   # Host that will be specified in database connection info for all clones
   # Use public IP address if database connections are allowed from outside