Help Center
  • Home
  • Getting Started
    • Register with oAuth
    • Register with Email + Password
  • Formulas
    • Formulas
  • Migration Templates
    • Migration Templates
    • Setting up the Template
    • Magic ID
    • Running the Template
  • seeding
    • Summary
    • Data Types
    • Configuration
  • Jobs
    • Job Management
    • Migrate
    • Multi-Object
    • Upload
    • Mapping
    • Query
    • Preview
    • History
    • Retry
    • Rollback
    • Run Remaining
    • Wildcard Names
  • Formatting
    • Dataimporter Formatting
    • Replace Null Values
    • Deduplicate
    • Filter Data
    • Sample Data
    • Automation Control
  • Schedule
    • Schedule
    • Hour
    • Day
    • Month
    • Flow
  • Integrations
    • View Integrations
    • Database
      • Azure SQL Database
      • Heroku Postgres
      • MySQL
      • PostgreSQL
      • SQL Server
    • Storage
      • Dropbox
      • Google Drive
      • Google Sheets
      • OneDrive
      • S3
      • SFTP
      • SharePoint
  • Account Management
    • Billing
    • Access
    • Teams
    • Notifications
  • Security
    • Dataimporter Security
    • IP Addresses
    • Data Storage
    • Customer Managed Storage
    • Single Sign-On with Azure AD
    • Single Sign-On with Okta
    • Bring your own Key
  • Changelog
Powered by GitBook
On this page
  1. Formatting

Deduplicate

PreviousReplace Null ValuesNextFilter Data

Last updated 1 year ago

Select this option when you want to remove duplicates from your source data. You will be able to define the field(s) that you want Dataimporter to look at, when considering whether records are duplicates or not:

By selecting multiple fields, Dataimporter will check both columns, and only when both columns match, will records be considered duplicates.

Dataimporter will always perform an exact match when looking at removing duplicates e.g. 'Acme Account' and 'acme account' will not be considered duplicates.