Skip to content

Add Bulk Imports API to view user initiated imports

What does this MR do?

This MR adds new Group Migration (Bulk Import) API in order to allow changes to Group Migration feature (https://docs.gitlab.com/ee/user/group/import/) UI (#285577 (closed)) to show more details back to the user so they get a better understanding on the import progress.

4 GET endpoints for an authenticated user:

  • Bulk Import API to view all user initiated imports
  • Entities API to view all imports' entities. Each entity represent a group or a project (only groups are supported now, projects to be added later)
  • View individual import's information and entities
  • Entities include failures information (in order to show user more granular detail in the UI, why it failed)

Mentions #331568 (closed)

Migrations output

Up

== 20210629153519 AddIndexToBulkImportEntitiesOnBulkImportIdAndStatus: migrating 
-- transaction_open?()
   -> 0.0000s
-- index_exists?(:bulk_import_entities, [:bulk_import_id, :status], {:name=>"index_bulk_import_entities_on_bulk_import_id_and_status", :algorithm=>:concurrently})
   -> 0.0046s
-- execute("SET statement_timeout TO 0")
   -> 0.0006s
-- add_index(:bulk_import_entities, [:bulk_import_id, :status], {:name=>"index_bulk_import_entities_on_bulk_import_id_and_status", :algorithm=>:concurrently})
   -> 0.0081s
-- execute("RESET ALL")
   -> 0.0005s
-- transaction_open?()
   -> 0.0000s
-- indexes(:bulk_import_entities)
   -> 0.0025s
-- remove_index(:bulk_import_entities, {:algorithm=>:concurrently, :name=>"index_bulk_import_entities_on_bulk_import_id"})
   -> 0.0053s
== 20210629153519 AddIndexToBulkImportEntitiesOnBulkImportIdAndStatus: migrated (0.0240s) 

Down

== 20210629153519 AddIndexToBulkImportEntitiesOnBulkImportIdAndStatus: reverting 
-- transaction_open?()
   -> 0.0000s
-- indexes(:bulk_import_entities)
   -> 0.0034s
-- execute("SET statement_timeout TO 0")
   -> 0.0009s
-- remove_index(:bulk_import_entities, {:algorithm=>:concurrently, :name=>"index_bulk_import_entities_on_bulk_import_id_and_status"})
   -> 0.0041s
-- execute("RESET ALL")
   -> 0.0012s
-- transaction_open?()
   -> 0.0000s
-- index_exists?(:bulk_import_entities, :bulk_import_id, {:name=>"index_bulk_import_entities_on_bulk_import_id", :algorithm=>:concurrently})
   -> 0.0018s
-- add_index(:bulk_import_entities, :bulk_import_id, {:name=>"index_bulk_import_entities_on_bulk_import_id", :algorithm=>:concurrently})
   -> 0.0047s
== 20210629153519 AddIndexToBulkImportEntitiesOnBulkImportIdAndStatus: reverted (0.0188s) 

Screenshots (strongly suggested)

Does this MR meet the acceptance criteria?

Conformity

Availability and Testing

Security

Does this MR contain changes to processing or storing of credentials or tokens, authorization and authentication methods or other items described in the security review guidelines? If not, then delete this Security section.

  • Label as security and @ mention @gitlab-com/gl-security/appsec
  • The MR includes necessary changes to maintain consistency between UI, API, email, or other methods
  • Security reports checked/validated by a reviewer from the AppSec team
Edited by George Koltsov

Merge request reports