How to Remove Duplicates in Excel & CSV (Safely)
Remove duplicate rows and values in Excel and CSV files without losing data — find them first, use the right built-in tool, and export a clean file automatically when you need to do it at scale.
Founder of ARCED Foundation, ARCED International, and Solutions of Things Lab (SoTLab). Built FolderManifest to help teams protect file integrity and stay audit-ready.
Quick Answer
In Excel, use Data → Remove Duplicates. In a CSV, open it in a spreadsheet and do the same, or use sort file.csv | uniq. To keep originals, use UNIQUE. Always find the duplicates first and back up. To export a cleaned file or dedupe across many files, the FolderManifest desktop app does it in two clicks.
Find Before You Remove
The most common data-loss mistake is deleting duplicates you never actually looked at. Before removing anything, highlight the duplicates so you can confirm which column and which values are affected. The free Spreadsheet Duplicate Finder does this in one drag, or follow how to find duplicate values in a CSV and how to find duplicates in Excel.
Remove Duplicates in Excel
- Make a copy of the sheet (right-click the tab → Move or Copy).
- Select your data, including the header row.
- Go to the Data tab and click Remove Duplicates.
- Tick the columns that define a duplicate, then click OK.
Excel keeps the first occurrence and deletes the rest, then reports how many duplicates were removed.
Remove Duplicate Rows in a CSV
You have three practical options for a CSV:
- Spreadsheet: open the CSV in Excel or Google Sheets and use Remove Duplicates.
- Command line (macOS/Linux): deduplicate identical rows with a single command.
- Desktop app: export a cleaned CSV automatically (covered below).
sort yourfile.csv | uniq > cleaned.csvNote that sort | uniq removes only fully identical rows and reorders the file; it will not dedupe on a single column.
Remove but Keep Originals (UNIQUE)
If you want a deduplicated copy without touching the source data, use the UNIQUE function. In Excel 365 and Google Sheets, =UNIQUE(A2:C) outputs the rows with duplicates removed into a new range, leaving the original list intact for reference.
Export a Cleaned File Automatically
Built-in tools work one file at a time and one click at a time. When you regularly clean lists — or need to dedupe across dozens of exports — the FolderManifest desktop app finds duplicate values, lets you remove or merge duplicate rows, and exports a cleaned, deduplicated file. It runs offline on your own machine, handles unlimited rows, and can dedupe across many spreadsheets at once — the steps the free browser tool intentionally leaves to the desktop app.
- Export cleaned file: get a deduplicated copy in one click.
- Remove or merge rows: resolve duplicates in place automatically.
- Across many files: dedupe a whole folder of CSVs or workbooks at once.
How to Remove Duplicates Safely
The 4-step rule
- Back up the original file first.
- Find and review the duplicates before removing.
- Remove, keeping one copy of each.
- Re-check that the duplicates are gone and the row count makes sense.
Frequently Asked Questions
How do I remove duplicates in Excel?
Select your data including headers, go to the Data tab, and click Remove Duplicates. Back up first.
How do I remove duplicate rows from a CSV?
Open it in a spreadsheet and use Remove Duplicates, run sort file.csv | uniq, or export a cleaned CSV with a desktop tool.
How do I remove duplicates but keep one copy?
Remove Duplicates keeps the first occurrence; to keep originals untouched, use =UNIQUE().
How do I remove duplicates across multiple files?
Use the FolderManifest desktop app, which dedupes across many CSV or Excel files at once and exports cleaned copies.
Clean Your Data the Safe Way
Find the duplicates first — free and private — then clean and export with the desktop app.