Remove duplicate lines from text with various matching options
Runs locally · Nothing uploaded
An online text deduplicator for removing repeated lines from multi-line text. It compares line by line and keeps the first occurrence of each item, which makes it handy for cleaning a column copied from Excel, repeated log entries, SQL IN lists, keyword lists and survey options. You can ignore case, leading and trailing spaces and empty lines, sort the result alphabetically afterwards, and see the original line count, unique count and removed count in real time. Everything runs locally in your browser and no data is uploaded.
It compares line by line: each line is one item and only the first occurrence is kept. To deduplicate values separated by commas or semicolons, replace the separators with line breaks first.
No, not by default. The first position of each item is preserved; the order only changes if you enable sort after dedupe.
Yes. Select the column in Excel and copy it in — each cell becomes one line. Copy the result back into Excel, or download the .txt and import it.
Ignoring case treats “Apple” and “apple” as the same item. Trimming spaces removes leading and trailing spaces from each line before comparing; spaces in the middle are preserved. You can enable both.
No. All comparisons run locally in your browser. Nothing is uploaded or stored, and the data disappears when you close the page.