Duplicate line remover
Paste a list and get it back with every repeated line removed. Keeps the first of each. Free, private — nothing leaves your device.
Your list without duplicate lines will appear here.Related tools
Remove line breaks
Remove line breaks from text and join it into one paragraph, or keep paragraphs. Private, in your browser.
Compare text
Compare two texts and see every added and removed line. Ignore case or whitespace, nothing is uploaded.
Change text case
Change text to uppercase, lowercase, title case, camelCase, snake_case and more. Private, in your browser.
More related tools
Everything you need to remove duplicate lines
Keeps the first of each line
Removes repeats and leaves your remaining lines in their original order.
Match case or ignore it
Choose whether Apple and apple count as the same line.
Live and instant
The result updates as you paste or change an option, with a count of what was removed.
Spaces and empty lines
Optionally ignore stray spaces at line ends and drop blank lines in the same pass.
100% private
Runs entirely in your browser. Nothing you paste is uploaded or stored.
Copy or download
Grab the result to your clipboard, or download it as a .txt file.
Remove duplicate lines in three steps
- 1
Paste your list
Paste text with one item per line, such as a list of emails, keywords, URLs or log lines.
- 2
Choose how lines are compared
By default only exact matches count as duplicates. Turn off Match case to treat Apple and apple as the same line, ignore spaces at line ends, or drop empty lines.
- 3
Copy or download the result
The first copy of every line stays, in its original order. Copy the result with one click, or download it as a .txt file.
Built for lists that picked up repeats
Exports, merged lists and logs often repeat the same line. PixelTools removes the repeats in your browser, with no upload and no account needed.
Email and contact lists
Clean a pasted mailing list so each address appears once.
Keyword and URL lists
Dedupe a keyword export or a list of URLs before importing it somewhere.
Logs and config files
Collapse repeated log lines or duplicate entries in a plain-text config.
Spreadsheet columns
Copy a column from a sheet, remove the repeats, and paste the unique values back.
Frequently asked questions
How do I remove duplicate lines from text?
+
Paste your text into the box above. Repeated lines are dropped straight away and the unique lines appear in the second box, ready to copy. No button to press.
Which copy of a duplicate line is kept?
+
The first one. Every later copy is removed, and the remaining lines keep their original order, so the list is not sorted or shuffled.
Does it treat uppercase and lowercase as different lines?
+
By default yes, so Apple and apple are both kept. Turn off Match case to treat them as the same line; the first spelling is the one that stays.
Why are two lines that look identical not removed?
+
Usually a trailing space or tab differs between them. Turn on Ignore spaces at line ends and they will be treated as the same line.
Can it remove empty lines too?
+
Yes. Turn on Remove empty lines to drop every blank line. With it off, a run of blank lines is reduced to a single blank line like any other duplicate.
Is my text uploaded anywhere?
+
No. Everything runs in your browser, so nothing you paste is sent to a server.
Try the duplicate line remover now
Free, no account needed.