The “Libraries” section is used to download custom libraries in .jar format to extend the functionality of the system. Libraries can be used to:
Add custom data processing function.
Extend workflows: add new service tasks for different events.
Add custom pipeline segments.
Add other custom code.
Library files can contain descriptions of objects of the same or different types. For example, a single jar file can include a description of a PostgreSQL database crawler and a custom data cleansing function.
Further, the description of the required object will be added to the system using the library wizard in the corresponding section: the description of the PostgreSQL database crawler - in the “Crawlers” section when adding a new crawler, the description of the cleansing function - in the “Data Quality” section when creating a new function.
Adding New Library¶
To add a library:
This will open a pop-up for loading a new library (Figure 2).
To load a library, click Select file and select the necessary file with the .jar extension.
If you uploaded a file with an invalid extension, the system will display an error and will not let you save the library. In this case, press Cancel or choose another file with the .jar extension.
For successful downloading, the file must not exceed 2GB (Internet Explorer and Mozilla Firefox browsers). Google Chrome and Opera allow downloading files more than 4Gb.
In the Version field, enter the version number of the library file.
In the Description field, enter a short description of the library to be added.
Click the Load button. If you want to stop loading - press Cancel button.
As a result, a new library will be loaded to the table. Uploading large files may take longer.
Libraries are detected immediately after loading, and do not require a system restart.
Figure 1. “Libraries” section and “Add Library” button
Figure 2. New library loading pop-up
Libraries List Setup¶
To sort libraries, use filters:
By version. Click the “Filter” button located on the right side of the Version column. Enable the Show only last versions checkbox. As a result, the list will be grouped into a shorter one with only the most recently added file versions remaining.
To delete a library from the table:
Hover the cursor over the required line.
In the left part of the line, set the flag. If necessary, select several lines with the flag.
Click the delete button and confirm (or cancel) the action.
To download a library file: