Data and JSON tools Free · No sign-up · No upload

CSV Deduplicator

Find and remove duplicate rows in a CSV, comparing whole rows or just the columns you choose, like email. The first occurrence is kept. All local to your browser.

  • Use it as often as you like
  • Private by design
  • Compare by chosen columns
  • First row is kept
Your data
Leave empty to compare whole rows, or list columns like "email"
  • Runs on your device. Files are never uploaded.
  • Free and unlimited. No sign-up, no watermark.
Private: processed in your browserNo upload waitIN: CSV → OUT: CSV
How was CSV deduplicator?
How it works

CSV deduplicator in three steps

No account, no email, no waiting for an upload.

  1. STEP 01

    Add your CSV

    Paste text or open a file.

  2. STEP 02

    Choose how to compare

    Leave 'Compare by columns' empty to compare entire rows, or name columns such as email. Optionally ignore case and edge spaces.

  3. STEP 03

    Copy the cleaned CSV

    The note says how many duplicates were removed and how many rows remain.

What you get

What CSV deduplicator does, and what it doesn't

We'd rather tell you up front than surprise you after the download.

What you get

  • Whole-row or column-basedMatch on every column, or on a key like email or customer ID.
  • Case-insensitive optionTreat Ada@Example.com and ada@example.com as the same.
  • Ignore edge spacesOn by default, so a stray space does not hide a duplicate.
  • First occurrence winsThe earliest row is kept and later repeats are dropped, so order is preserved.
  • Clear summarySee the number of duplicates removed, or a message that none were found.

Good to know

  • Exact matching onlyNear-duplicates such as 'Jon' and 'John' are not merged. Only identical values (after your case and space settings) count.
  • No merging of fieldsA later row with extra information is dropped, not combined with the first.
  • In-memoryVery large files use your device's memory. Split them with the CSV splitter if needed.
Private by design

Your data never leave your device

The tool runs inside your browser instead of on our servers, so there is nothing to upload, store or delete afterwards.

Typical online tool upload

Your device→Their server→Your device

Your file travels over the internet, sits on someone else's computer for a while, and you wait for the upload and the download.

Mediaextractr no upload

Your device does all the work

The tool loads into your browser once, then works on your file locally. Nothing is sent, so nothing can leak.

Made for real work

When people use CSV deduplicator

Clean a mailing list

Remove repeated email addresses before an import.

Tidy merged exports

After merging CSV files, remove overlap.

Deduplicate orders or SKUs

Keep one row per ID.

Prepare reports

Count unique customers instead of rows.

Compare

Mediaextractr vs typical upload tools

MediaextractrPrivateTypical upload tools
Your file is uploadedNeverYes
Sign-up neededNoOften, after a few files
Daily file limitNoneOften 1–2 free files
WatermarkNeverSometimes
Wait for upload & downloadNoYes
Speed on very large filesDepends on your deviceDepends on their servers

Choosing what makes a duplicate

With nothing in 'Compare by columns', two rows are duplicates only if every cell matches. That is the safest setting. If you name columns, only those cells are compared, and the rest of the row is ignored when deciding.

For contacts, comparing the email column alone is usually the right call. For transactions, you may need a combination such as customer, date and amount.

Before you deduplicate

Take a few precautions:

  • Normalize case and spacing, or leave the default trimming on.
  • Keep a copy of the original in case you need the removed rows.
  • Sort first with the CSV sorter if you want the most recent row to come first, since the first match is the one kept.
  • For plain text lists, use Remove duplicate lines.

Counting what you removed

The note reports how many duplicates were removed and how many rows are left. Compare the removed count with your expectation: a number far larger than expected means the chosen columns are not unique keys. Try adding another column, such as a date, to the comparison, or compare entire rows.

FAQ

Questions, answered

How do I remove duplicates from a CSV?

Paste the CSV, leave the column box empty to compare whole rows, and copy the result.

Can I deduplicate by email only?

Yes. Type the column name, such as email, in 'Compare by columns'.

Which duplicate is kept?

The first one. Later repeats are removed.

Is it safe to deduplicate a customer list here?

Yes. Matching runs in your browser tab. The list is not uploaded or stored.

Is matching case-sensitive?

By default yes. Turn on 'Ignore upper/lower case' to match regardless of case.

Does deduplicating work on mobile?

Yes, in current mobile browsers, within the memory of the device.