Advanced Mode of Creating Rules

Data Quality section. Data administrator interface

Contents

Creating Quality Rules

Before you start:

  • Make sure that draft mode is enabled and draft is selected.
  • Make sure that the advanced mode is enabled.
  • Make sure that the “Quality rules” tab is active in the “Data quality” section.

To create a quality rule:

  1. Click the “Create rule” button located on the right side of the rules table header.
  2. The action will open a drawer with the settings for the new rule.
  3. Fill in the main properties:
    • Name. Logical name of the rule.
    • Display name. Name that will be displayed to users.
    • Description (optional). Additional information about the quality rule.
    • Run condition. The condition under which the quality rule will be triggered.
    • For which source systems to apply. Defines, for the data of which sources the rule will be applied.
    • Function. Select the data processing function (standard, composite or custom function can be selected).
  4. Enable the validation mode if you want the quality rule to work in this mode.
  5. Fill in the validation settings:
    • Create from. Outgoing logical port, on the basis of which the quality error will be created.
    • Severity. The priority level of the created error, which will affect the formation of statistics on the registry and help prioritize the processing of errors. With the “Set value” checkbox: select the required critical value from the list. With the “Select port” checkbox: if the function has an outgoing logical port that sends critical data, you can use that port.
    • Message. “Set value” checkbox: used for a text description of the error. “Select port” checkbox: used to select the outgoing string port as the error message.
    • Category. If specified manually, contains a text description of the error category. Similarly with the message text, you can specify the available outgoing string port. Used to search for records by error category.
  6. Enable the enrichment mode if you want the quality rule to work in this mode.
  7. Fill in the enrichment settings:
    • On behalf of which source system to save. The source system on behalf of which the enriched data will be saved. The source systems are compared by weight when enriching. If the enrichment of an already existing record is performed, the source system from which the enrichment is performed shall have a weight equal to or greater than the source system on behalf of which the record was originally saved. If the enrichment result is transferred on behalf of a source system with a smaller weight, the record from that source system will not be produced because the larger weight wins.
  8. The Used in model object section contains information about entities/lookup entities and their attributes to which the current rule applies. The first column shows the name of the entity/lookup entity, the second column shows the attributes that use incoming ports, and the third column - attributes that use outgoing ports.
  9. Save changes. Click the “Save” button located in the upper right corner of the drawer.
  10. Go to the Set of rules tab to create a set of rules.
  11. Go to the Assignments tab to assign quality rules.
  12. After all the data has been entered and saved, publish the draft:
    • Click the “Publish” button at the bottom of the “Data model” list.
    • In the window that opens, select the publication method: simple or publication with priority. Simple publication is used if the quality rules have either not been changed by other users, or have changed insignificantly during the period of working on the draft. If you try to publish a draft after significant changes, some conflicts in the quality rules may result in an error and stop publication. Publishing with priority ignores any previous changes and overwrites the quality rules.
    • Confirm the selection.

Properties of a new quality rule

Figure 1. Properties of a new quality rule

Cloning Quality Rule

To clone a rule:

  1. Go to the Quality Rules tab.
  2. In the list of quality rules, find the required rule.
  3. Click the button on the right side of the cloned rule line.
  4. This will bring up a drawer with settings for the rule.
  5. Fill in the Name field (logical name of the rule).
  6. If necessary, edit the properties of the quality rule.
    • Save the changes. Click the “Save” button located in the upper right corner of the drawer.
  7. After all data has been entered and saved, publish the draft.

Editing Quality Rule

Editing is available for each tab in the “Data Quality” section. Editing rules created in simple mode is also available.

To edit a rule:

  1. Go to the Quality Rules tab.
  2. Select the required line in the list.
    • This will open a drawer. Some fields, such as the logical name, will be unavailable for change.
    • Make your changes.
    • Save the changes. Click the “Save” button located in the upper right corner of the drawer.
  3. After all the data has been entered and saved, publish the draft.

Deleting Quality Rule

Deletion is available for each tab in the “Data Quality” section.

In the Quality rules tab:

  1. In the list of rules, select the required rules with a checkbox.
  2. The “Create rule” button will change to the “Delete rule” button. Click this button.
  3. Confirm the action.
  4. After all the data has been entered and saved, publish the draft.