Libraries

The “Libraries” section is used to download custom libraries in .jar format to extend the functionality of the system. Libraries can be used to:

• Add custom data processing function.

• Extend workflows: add new service tasks for different events.

• Add custom pipeline segments.

• Add other custom code.

Library files can contain descriptions of objects of the same or different types. For example, a single jar file can include a description of a PostgreSQL database crawler and a custom data cleansing function.

Further, the description of the required object will be added to the system using the library wizard in the corresponding section: the description of the PostgreSQL database crawler - in the “Crawlers” section when adding a new crawler, the description of the cleansing function - in the “Data Quality” section when creating a new function.

Adding New Library

To add a library:

1. Click “Add Library” in the upper-right corner of the section (Figure 1).

2. This will open a pop-up for loading a new library (Figure 2).

3. To load a library, click Select file and select the necessary file with the .jar extension.

   • If the wrong file is loaded - point the cursor at the file name, and the “Remove file” button will appear on the right.

   • If you uploaded a file with an invalid extension, the system will display an error and will not let you save the library. In this case, press Cancel or choose another file with the .jar extension.

   • For successful downloading, the file must not exceed 2GB (Internet Explorer and Mozilla Firefox browsers). Google Chrome and Opera allow downloading files more than 4Gb.

4. In the Version field, enter the version number of the library file.

5. In the Description field, enter a short description of the library to be added.

6. Click the Load button. If you want to stop loading - press Cancel button.

7. As a result, a new library will be loaded to the table. Uploading large files may take longer.

Libraries are detected immediately after loading, and do not require a system restart.

Figure 1. “Libraries” section and “Add Library” button

Figure 2. New library loading pop-up

Libraries List Setup

To sort libraries, use filters:

• By file name. Click the “Filter” button located on the right side of the File name column. In the empty field, enter the name by which you want to filter the existing files. Click “Apply”.

• By version. Click the “Filter” button located on the right side of the Version column. Enable the Show only last versions checkbox. As a result, the list will be grouped into a shorter one with only the most recently added file versions remaining.

To delete a library from the table:

• Hover the cursor over the required line.

• In the left part of the line, set the flag. If necessary, select several lines with the flag.

• As a result of the action, the “Add Library” button in the upper right corner will change to the Delete button.

• Click the delete button and confirm (or cancel) the action.

To download a library file:

• Hover the cursor over the required line.

• A button Download will be displayed on the right side of the line.

• Press the button. As a result, the file will be automatically downloaded to your device.