How to remove duplicate customer rows from a CSV
Learn how to identify duplicate customer records in a supplier catalog, remove safe repeats, and keep rows that contain different account details.
Your supplier catalog has the same customer listed more than once, and you need to clean it up before importing or sharing the file. The tricky part is knowing whether two rows are true duplicates or separate accounts that happen to share a name.
Start by choosing what makes a customer record unique. Then remove only the rows that meet that rule. The CSV Editor can help you sort, find, edit, and remove duplicate rows in your browser.
Find and remove duplicate customer rows
- Make a copy of the original CSV so you can go back if a row is removed by mistake. Open the copy in the CSV Editor.
- Read the column headings and decide which fields identify a customer. A customer ID is usually stronger than a name. An email address may work if each customer has one unique address. A company name alone may not be enough if the supplier lists branches or departments separately.
- Sort the catalog by your chosen identifier, such as customer ID or email. Look at neighboring rows to see whether the same value appears more than once. Use search to check specific names or IDs when the file is large.
- Compare the matching rows before removing anything. Check other fields, including address, account number, contact name, and status. If the rows match across all relevant fields, use the editor's remove-duplicates feature to clear the repeat.
- Review the edited rows, save or export a new copy, and reopen that copy. Check a few customer records and compare the row count with your original to make sure the result makes sense.
Do not treat every repeated name as an error. Keep the original file until the cleaned catalog has passed a quick review and any import that depends on it has worked.
What the matching rows mean
Every field is the same
These are likely accidental duplicate rows. If the customer ID, contact details, address, and other relevant values are identical, keeping one copy is usually safe. Remove the extra row and check whether the same exact duplicate appears elsewhere in the catalog.
The name matches, but an ID or address differs
This may be two customers with similar names, separate branches, or two accounts for the same organization. Keep both until you confirm how the supplier defines a customer. Ask the supplier which identifier is authoritative if the distinction affects billing, shipping, or account access.
The email or ID matches, but other details differ
This may be a stale record, a recent update, or an error in the catalog. Do not automatically keep the first row or the last row. Compare dates or status fields if available, and confirm which address or contact is current before deleting a record.
Values look the same but do not sort together
Extra spaces or inconsistent capitalization can make values appear different to a computer. For example, ACME Supply and ACME Supply may look alike but contain different text. Inspect the original values carefully before correcting them, and use a consistent rule for the whole column.
How to fix duplicates safely
- Keep a backup copy. Work on a duplicate of the supplier file, not the only copy. Save the cleaned result under a different name so you can compare it with the original.
- Choose one duplicate rule. Decide whether a duplicate means the same customer ID, the same email, or an exact match across all fields. Write down the rule before removing rows. A name-only match can merge separate people or locations.
- Check blanks before matching. Several rows with an empty customer ID are not necessarily duplicates just because that field is blank. Use another reliable field to review those records, or ask the supplier for missing identifiers.
- Review conflicting details manually. If two rows share an identifier but contain different addresses or contacts, compare the full records. Keep both temporarily if you cannot establish which one is current. Removing a potentially valid account can cause a failed order or misdirected shipment.
- Correct formatting consistently. If spaces or capitalization are the only difference, apply the supplier's preferred format consistently and then check the rows again. Be cautious about changing IDs, email addresses, or other fields that may be case-sensitive or used by another system.
- Verify the cleaned file. Reopen the saved copy, search for a few IDs you checked, and inspect the row count. If the supplier requires a particular CSV layout, make sure the column names and order are unchanged before importing it.
Why a duplicate can be hard to spot
A CSV file stores values in rows and columns, but a customer record can include commas, quotation marks, and line breaks inside a field. For example, a company name or address may contain a comma. Do not try to remove duplicates by splitting the file manually at commas, because that can shift data into the wrong columns. Open the CSV in an editor that understands the format and compare complete rows.
Also check how the supplier treats identifiers. Some catalogs use one customer ID for an organization and separate location codes for each branch. In that case, the pair of fields, not the customer ID alone, may define a unique record.
The CSV Editor runs in your browser, and the file stays on your device.
