Logo
6.7.0-SE

Quick Start

  • How to Add New Data
    • Creating Data Model
      • Via User Interface
      • Via XML
    • Adding Users to System
    • Adding New Data
      • Via User Interface
      • Via REST API
    • Data Search
      • Search for Certain Record
      • Search for Several Records by Common Criteria
  • How to Check Data
    • Duplicate Records View
      • Via Data Re-index Operation
    • Creating Quality Rules
      • Simple mode
      • Advanced mode
      • Displaying Data quality Errors
    • How to Make Your Own Data Processing Function
    • Workflow Setup
    • Running Workflow
      • Workflow Lifecycle
      • Workflow Example: Creating New Request
        • Creating Workflow Manually
        • Editing Workflow
    • Search for Task
  • How to Maintain System
    • Creating Data Reindexing Operation
      • Additional Actions with the Operations
    • Configuring System Parameters
    • Configuring Pipelines for Various System Functions
      • Reindexing Relations
      • Data Matching While Saving Record Changes
      • Publishing Record Draft According to Workflows
    • Audit of User Actions

Data Steward

  • Getting Started with “Main” Section
  • Record Search
    • “Search” Field
      • Terms of Use
    • System Search Criteria
      • Selecting Сriteria
      • Actual for Period of Time
      • “Created at” and “Updated at”
      • Active/Inactive Records
      • Records From Source Systems
      • Search Through Record Drafts
      • Search for Favorites
    • Attribute Values Criteria
    • Relations Search Criteria
    • Data Quality Criteria
      • Records With Errors Only
      • Records With No Errors Only
    • Search Results Table
      • Selecting & Sorting Records
      • Search Table Configs
      • Displaying Hierarchical Lookup Entities
    • Saving Frequent Search Queries
      • Saving Query
      • Deleting Query
  • Operations with Single Records
    • Creating Record
      • Concept of Record Card
      • Creating New Record
      • Configuring Parent Node of Hierarchical Lookup Entity
    • Creating Relations
    • Relation Graph
    • Editing/Deleting Record
      • Editing Record
      • Deleting Record
    • Comparing Record Draft With Published Version
    • Record History
    • Record Quality Errors
      • Processing Error
  • Batch Operations with Records
    • Batch Operation of Deleting Records
    • Batch Operation of Exporting Records to Excel
    • Data Import from Excel
    • Description of XLSX File Format
      • Main Entity/Lookup Entity Sheet
      • List of Complex Attributes
      • List of Relations
      • Additional Info
        • Searching Records by System Attributes
        • Importing Records with Multiple Validity Periods
  • Work with Tasks
    • Searching Tasks
      • Tasks Available to Current User
    • Assigning Tasks
      • Assigning to Current User
      • Assigning to Another User
    • Processing Tasks
    • Run Process Manually
    • Viewing Process
    • Task Search Criteria
      • ID (Identifier)
      • Title
      • Created Date
      • Completed Date
      • Process display name
      • Assignee
      • Candidate users
      • Candidate groups
      • Object ID
      • Namespace
  • Work with Duplicates
    • General Info
      • Viewing Duplicates in Record Card
    • Duplicates Search
    • Comparing & Merging Duplicates
      • Viewing Cluster Content
      • Comparing Duplicates
      • Merging Duplicates

Data Administrator

  • Data Model
    • Creating Entity/Lookup Entity
      • Creating New Entity / Simple Lookup Entity
      • Creating Hierarchical Lookup Entity
      • Cloning Data Model Objects
      • Deleting Data Model Objects
      • Grouping Data Model Objects
    • “Settings” Tab
      • Advanced Settings
      • Generating External Key
    • “Attributes” Tab
      • General Information
        • Entity Attribute Types
        • Lookup Entity Attribute Types
      • Morphology-Based Search Setup
      • Entering Data by Mask
      • Creating Simple/Array Attributes
        • Creating Simple Attribute
        • Creating Array Attribute
      • Creating Complex Attribute
      • Creating Code Attribute
        • Features of Code Attributes
      • Editing, Copying, and Deleting Attributes
      • Attribute Types
        • Additional Fields
        • Filtration and Value Insertion Settings
    • “Relations” Tab
      • Creating Relation
    • “Consolidation” Tab
    • “Layout” Tab
      • Attribute Group Setup
      • All Groups Setup
      • Individual Attribute Setup
    • Creating Nested Object
      • Creating New Object
      • Copying Object
      • Deleting Object
      • Main Features
    • Data Model Properties
    • Comparing Data Model Versions
      • Comparing Previously Published Versions
      • Comparing Draft and Last Published Version
  • Data Model Components
    • Work with Source Systems
      • Creating Source System
      • Editing Source System
    • Work with Units of Measurement
      • Creating Unit
      • Editing Unit
    • Work with Enumerations
      • Creating Enumeration
      • Editing Enumeration
    • Data Model Import/Export
      • Model Import
      • Model Export
      • Import/Export Features
  • Matching Mechanisms
    • Matching Mechanisms
      • Launch of Matching Rules
    • Matching Tables
      • Creating Table
      • Deleting Table
    • Creating Matching Rules
      • Creating Rule
      • Deleting Rule
    • Matching Rule Sets
      • Creating Set
      • Deleting Set
    • Assigning Matching Rules
      • Rule Assignment
      • Canceling Assignment
    • Comparing Matching Model Versions
      • Comparing Previously Published Versions
      • Comparing Draft and Last Published Version
  • Quality Rules
    • Simple Mode of Creating Rules
      • Simple Mode of Creating Rules
        • Creating Quality Rules
        • Displaying Data quality Errors
        • Changing Order of Rule Sets Execution
        • Editing Quality Rule
        • Deleting Quality Rule
      • Validation Rules Creation Wizard
      • Enrichment Rules Creation Wizard
    • Advanced Mode of Creating Rules
      • Advanced Mode of Creating Rules
        • Creating Quality Rules
        • Cloning Quality Rule
        • Editing Quality Rule
        • Deleting Quality Rule
        • Displaying Data Quality Errors
      • Quality Rule Sets
        • Creating Set
        • Editing Set
        • Deleting Set
      • Assigning Quality Rules
        • Creating Assignment
        • Editing Assignment
        • Deleting Assignment
      • Execution Phases
        • How Execution Phases Work
        • Adding Phase
      • Quality Categories
        • Description
        • Creating Category
    • Data Processing Functions
      • General Info
      • Test Run
      • Composite Functions
      • Function Processing Modes
      • Adding Custom Function
      • Function Group Setup
    • Comparing Quality Model Versions
      • Comparing Previously Published Versions
      • Comparing Draft and Last Published Version
    • Switching Modes
  • Workflows
    • Creating Workflow
      • Creating New Process
      • Workflow Variables Assignment
    • Diagram Editor
    • Settings Panel
      • General Settings
      • Advanced Settings
        • “User Task” General Settings
        • “User Task” Advanced Settings
        • “Service Task” General Settings
        • “Service Task” Advanced Settings
    • Event Executors
    • Comparing Workflow Model Versions
      • Comparing Previously Published Versions
      • Comparing Draft and Last Published Version
    • Example of Workflow for Approving Changes
      • Preparing Workflow

System Administrator

  • Users
    • Creating/Editing User Accounts
      • Creating Account
      • Editing Account
        • Limitations:
    • User Account Properties
    • Assigning Labels to User Accounts
    • Additional Parameters of User Accounts
  • Roles
    • Creating/Deleting Roles
      • Creating Role
      • Editing Role
      • Deleting Role
    • System Rights
      • Types of Rights
      • Resources for Rights
        • Entities/Lookup Entities
        • System Rights
        • Workflows
    • Assigning Labels to Roles
    • Additional Parameters of Roles
    • Configuring Role for Guest Access
  • Security Labels
    • General Info
      • Assigning Securiry Labels
    • Security Labels Setup
      • Creating Security Labels
      • Security Label Properties
  • Operations
    • Creating/Editing Operations
      • Cloning Operations
      • Sorting Operations
      • Using Tags
    • Additional Actions with Operations
      • Operation Launch
      • Import/Export of Operations
    • Operation Parameters
      • Data Reindexing Operation (reindexDataJob)
      • Data Exporting Operation (exportDataJob)
    • Data Mapping
      • Data export mapping
  • Audit Logs
    • Navigation Bar
    • Column Setup
    • Sorting Log
    • Exporting Log Data
  • Libraries
    • Adding New Library
    • Libraries List Setup
  • System Parameters
    • General Info
    • Editing Parameters
    • Background Operations
    • Import/Export of Parameters
  • Pipelines
    • General Info
      • Creating Pipeline
      • Editing Pipeline
      • Search for Pipeline segments
      • Pipeline Segment Types
    • DQ Execution Phase Setup
      • General Info
      • Pipeline Configuration
    • Pipeline Examples
      • Creating/Updating Relations Pipeline
        • Main Pipeline to Create/Update Relations
      • Data Matching Pipelines
        • When Saving Record Changes
        • When Deleting Record
        • When Forming Clusters of Requested Record
        • When Batch Saving Record Changes
        • When Batch Deleting Records
      • Data Quality Pipelines
        • Quality Rules Execution
        • When Saving Record Changes
        • Forming Quality Rule Errors for Records

About System

  • System Installation
    • System Installation with Docker
      • Preparing for Installation
      • Installing with Docker
      • Custom Installation with Docker Compose
  • System Update
    • System Update with Docker
      • Updating System with Internet Access
  • System Overview
    • About Unidata System
      • Main System Functions
    • License
      • License Limits
    • Logging In
      • First Login
      • Changing Current Password
      • Login Error
      • Password Reset
      • Ending Session
      • Changing Language
    • Account Settings
      • Changing Password
    • Modular Architecture
      • List of Modules
      • Frontend Modules Usage
    • Notifications
      • System Messages and Tooltips
    • Main UI elements
      • Navigation Panel
      • Workspace
    • Security Model Overview
      • Basic Terms of Security Model
      • Concept of Working with Security Model
    • Goals of Different User Groups
      • Data Steward
      • Data Administrator
      • System Administrator
    • Browser Hotkeys
      • All Supported Browsers
      • Chrome
      • Mozilla Firefox, Opera
      • Internet Explorer
      • Windows Hotkeys
  • Unidata Theory
    • Concept of Draft Mode
      • Main Features
      • Enabling Draft Mode
      • Publishing Draft
    • Workflow Concept
      • General Info
      • Workflow Modeling
      • Example of Usage
    • Quality Rules Concept
      • Data Processing Functions
      • Quality Rule Modes
    • How Quality Rules Work
      • Example of Usage
    • Data Model Concept
    • Searching Duplicates Concept
      • Example of Usage
    • Work on Projects
      • General Steps
      • Quality Rules
      • Workflows
    • Basic Terms
  • Release Notes
    • Unidata Enterprise Edition
    • Unidata Standart Edition
    • Unidata Community Edition
    • Known Problems

System Integration

  • Working with REST API
    • Using REST API
      • How to Work with Unidata REST API
      • Data Types Description
        • Model of Entities / Lookup Entities
        • Units of Measurement
        • Enumerations
        • Source Systems
    • Data Structure
      • Part “entities”
        • Part “lookups”
        • Part “nesteds”
        • Part “entitiesGroup”
        • Part “relations”
    • Data Quality Model
      • Functions
      • Function Groups
      • Quality Rules
      • Rule Sets
      • Assignments
    • Matching Model
      • Algorithms
      • Matching Tables
      • Matching Rules
      • Rule Sets
      • Assignments
  • Configuration & Logging
    • Configuration Location in Docker
    • Backend Configuration
    • Frontend Configuration
    • Logs
  • Enabling & Configuring Email Notification
    • Yandex Mail Setup
    • Google Mail Setup
  • Custom Cleanse Functions
  • System Customization
    • User Exits
    • Third-party Methods of Generating ExternalId
Unidata
  • »
  • Work with Duplicates »
  • Duplicates Search

Duplicates Search¶

To find duplicates of the necessary records:

  1. Click image7 “Add Criteria” and select the criteria you want to search for. Several criteria are available to choose (Figure 1):

    • ID. Search by the identifier of the etalon record. You can select if the value exists or not, as well as input a value in the text field: “Exact Value”, “Starts with”, “Contains”, “Similar to” and refine the criteria equal to “=” or unequal to “!=” (e.g. Contains or Does not contain the number “889”). Multiple criteria selection is available, in which case the “OR” logic is applied.

    • Rule name. Search by matching rules (drop-down list).

    • Set name. Search by rulesets (drop-down list).

    • Namespace. Search by location of records (entities/lookup entities) or a certain space (for example, the “Countries” lookup entity). Search by certain entity/lookup entity records (one or more) is also available.

  2. Click the “Search” button.

  3. As a result of the action, a table with found clusters of duplicate records will be displayed on the screen. Columns of the table display information about the number of found records in clusters and by which rules or sets of rules the clusters are formed (Figure 1).

  4. If necessary, you can save the search query by clicking image4.

Tip

It is possible to switch between the criteria with the keyboard arrows. Select a criterion by pressing Enter. After selecting the criteria, move to the criteria line: press Esc. To switch to the next element press Tab

Table with clusters and added search criteria

Figure 1. Table with clusters and added search criteria.

Next Previous

© Copyright 2023, Unidata LLC.

This page uses Google Analytics to collect statistics. You can disable it by blocking the JavaScript coming from www.google-analytics.com.
Language
Russian English
Versions
6.7.0-SE
6.7.0-EE
6.7.0-CE