CSV Deduplicator
Find and remove duplicate rows in a CSV, comparing whole rows or just the columns you choose, like email. The first occurrence is kept. All local to your browser.
- Use it as often as you like
- Private by design
- Compare by chosen columns
- First row is kept
- Runs on your device. Files are never uploaded.
- Free and unlimited. No sign-up, no watermark.
CSV deduplicator in three steps
No account, no email, no waiting for an upload.
- STEP 01
Add your CSV
Paste text or open a file.
- STEP 02
Choose how to compare
Leave 'Compare by columns' empty to compare entire rows, or name columns such as email. Optionally ignore case and edge spaces.
- STEP 03
Copy the cleaned CSV
The note says how many duplicates were removed and how many rows remain.
What CSV deduplicator does, and what it doesn't
We'd rather tell you up front than surprise you after the download.
What you get
- Whole-row or column-basedMatch on every column, or on a key like email or customer ID.
- Case-insensitive optionTreat Ada@Example.com and ada@example.com as the same.
- Ignore edge spacesOn by default, so a stray space does not hide a duplicate.
- First occurrence winsThe earliest row is kept and later repeats are dropped, so order is preserved.
- Clear summarySee the number of duplicates removed, or a message that none were found.
Good to know
- Exact matching onlyNear-duplicates such as 'Jon' and 'John' are not merged. Only identical values (after your case and space settings) count.
- No merging of fieldsA later row with extra information is dropped, not combined with the first.
- In-memoryVery large files use your device's memory. Split them with the CSV splitter if needed.
Your data never leave your device
The tool runs inside your browser instead of on our servers, so there is nothing to upload, store or delete afterwards.
Typical online tool upload
Your file travels over the internet, sits on someone else's computer for a while, and you wait for the upload and the download.
Mediaextractr no upload
The tool loads into your browser once, then works on your file locally. Nothing is sent, so nothing can leak.
When people use CSV deduplicator
Clean a mailing list
Remove repeated email addresses before an import.
Tidy merged exports
After merging CSV files, remove overlap.
Deduplicate orders or SKUs
Keep one row per ID.
Prepare reports
Count unique customers instead of rows.
Mediaextractr vs typical upload tools
| MediaextractrPrivate | Typical upload tools | |
|---|---|---|
| Your file is uploaded | Never | Yes |
| Sign-up needed | No | Often, after a few files |
| Daily file limit | None | Often 1–2 free files |
| Watermark | Never | Sometimes |
| Wait for upload & download | No | Yes |
| Speed on very large files | Depends on your device | Depends on their servers |
Choosing what makes a duplicate
With nothing in 'Compare by columns', two rows are duplicates only if every cell matches. That is the safest setting. If you name columns, only those cells are compared, and the rest of the row is ignored when deciding.
For contacts, comparing the email column alone is usually the right call. For transactions, you may need a combination such as customer, date and amount.
Before you deduplicate
Take a few precautions:
- Normalize case and spacing, or leave the default trimming on.
- Keep a copy of the original in case you need the removed rows.
- Sort first with the CSV sorter if you want the most recent row to come first, since the first match is the one kept.
- For plain text lists, use Remove duplicate lines.
Counting what you removed
The note reports how many duplicates were removed and how many rows are left. Compare the removed count with your expectation: a number far larger than expected means the chosen columns are not unique keys. Try adding another column, such as a date, to the comparison, or compare entire rows.
Questions, answered
How do I remove duplicates from a CSV?
Paste the CSV, leave the column box empty to compare whole rows, and copy the result.
Can I deduplicate by email only?
Yes. Type the column name, such as email, in 'Compare by columns'.
Which duplicate is kept?
The first one. Later repeats are removed.
Is it safe to deduplicate a customer list here?
Yes. Matching runs in your browser tab. The list is not uploaded or stored.
Is matching case-sensitive?
By default yes. Turn on 'Ignore upper/lower case' to match regardless of case.
Does deduplicating work on mobile?
Yes, in current mobile browsers, within the memory of the device.