Skip to content
toolsdocks

Clean CSV data and remove duplicate rows

Clean a CSV or Excel sheet: trim spaces, remove empty rows and duplicates, and set case, booleans and numbers per column, with every change counted.

Runs on your device
Loading tool…

How to use

  1. Open a file.
  2. Choose global steps (trim, remove empty rows, dedupe on selected columns) and per-column rules.
  3. Review the change summary and download.

Worked example

Five order rows: 00101, 00102 and 00101 again for ann@example.com, then 00103 twice (once written “ BO@example.com ”). Whole-row matching removes 2 rows and keeps 00101, 00102 and 00103. Matching on Email alone removes 3 rows, including order 00102, a different transaction.

Supported formats and limits

InputCSV, TSV, XLSX, XLS, ODS
OutputCSV, XLSX
EngineColumn-wise cleaning pipeline with change log

Limitations

  • Only the first sheet of a workbook is cleaned unless you choose another.
  • Removing rows that look alike can delete genuine repeat transactions; check the Removed rows tab before downloading.

Questions

Can I review the duplicate rows before removing them?

Yes. The Removed rows tab lists every removed row with its original row number and the row it duplicates, for example “Duplicate of row 1”. Your file is not changed; the download is a new file.

Does it match whole rows or selected columns?

Whole rows by default. Tick one or more columns to match on those only. The first occurrence is kept, and by default matching ignores case and extra spaces.

In what order are the steps applied?

Trim and collapse spaces, then per-column case, boolean and number rules, then empty-row removal, blank filling, duplicate removal and finally empty-column removal. Duplicates are therefore found after trimming.

Will IDs with leading zeros be changed?

Not unless you apply a number rule to that column. Values are kept as text, and the suggested rules skip columns made only of plain digits.

Guides

Privacy

Runs on your device. Files and text are processed in this browser tab and are not uploaded.

See the privacy policy for how toolsdocks handles data.