Skip to main content
PixelTools

Duplicate line remover

Paste a list and get it back with every repeated line removed. Keeps the first of each. Free, private — nothing leaves your device.

0 characters
Unique lines0 characters
Your list without duplicate lines will appear here.

Everything you need to remove duplicate lines

Keeps the first of each line

Removes repeats and leaves your remaining lines in their original order.

Match case or ignore it

Choose whether Apple and apple count as the same line.

Live and instant

The result updates as you paste or change an option, with a count of what was removed.

Spaces and empty lines

Optionally ignore stray spaces at line ends and drop blank lines in the same pass.

100% private

Runs entirely in your browser. Nothing you paste is uploaded or stored.

Copy or download

Grab the result to your clipboard, or download it as a .txt file.

Remove duplicate lines in three steps

  1. 1

    Paste your list

    Paste text with one item per line, such as a list of emails, keywords, URLs or log lines.

  2. 2

    Choose how lines are compared

    By default only exact matches count as duplicates. Turn off Match case to treat Apple and apple as the same line, ignore spaces at line ends, or drop empty lines.

  3. 3

    Copy or download the result

    The first copy of every line stays, in its original order. Copy the result with one click, or download it as a .txt file.

Built for lists that picked up repeats

Exports, merged lists and logs often repeat the same line. PixelTools removes the repeats in your browser, with no upload and no account needed.

Email and contact lists

Clean a pasted mailing list so each address appears once.

Keyword and URL lists

Dedupe a keyword export or a list of URLs before importing it somewhere.

Logs and config files

Collapse repeated log lines or duplicate entries in a plain-text config.

Spreadsheet columns

Copy a column from a sheet, remove the repeats, and paste the unique values back.

Frequently asked questions

How do I remove duplicate lines from text?

+

Paste your text into the box above. Repeated lines are dropped straight away and the unique lines appear in the second box, ready to copy. No button to press.

Which copy of a duplicate line is kept?

+

The first one. Every later copy is removed, and the remaining lines keep their original order, so the list is not sorted or shuffled.

Does it treat uppercase and lowercase as different lines?

+

By default yes, so Apple and apple are both kept. Turn off Match case to treat them as the same line; the first spelling is the one that stays.

Why are two lines that look identical not removed?

+

Usually a trailing space or tab differs between them. Turn on Ignore spaces at line ends and they will be treated as the same line.

Can it remove empty lines too?

+

Yes. Turn on Remove empty lines to drop every blank line. With it off, a run of blank lines is reduced to a single blank line like any other duplicate.

Is my text uploaded anywhere?

+

No. Everything runs in your browser, so nothing you paste is sent to a server.

Try the duplicate line remover now

Free, no account needed.