Crawler User Interface

Many tasks related to the insertion of data are still too cumbersome. In order to make the workflow more convenient we want to integrate a webinterface view for tasks related to this.

Aktivities that shall be possible with that view are:

• should inform about new files that are available
• trigger the insertion of file objects (loadFiles)
• trigger the insertion of data records using the crawler
• the view should inform about inconsistencies that prevent insertion
• the view should inform about updates that are done
• the view should allow to treat the renaming of files (e.g. files were moved from one folder to another)
• shows that data files were already processed and are ready for insertion [optional/advanced]
• jobs that are triggered show progress during the run
• data that is inserted is inserted with the credentials of the triggering user.

First step will be the implementation of a progress notification.