Remove Duplicate Lines

Removes duplicate lines from a list — with optional sorting and order reversal in the same pass. Paste a list, get each entry once, in the order you choose.

How to use

1. Paste the list, one item per line.
2. Deduplicate — the first occurrence of each line survives.
3. Sort or reverse if a particular order helps.
4. Copy the cleaned list.

When you actually need this

• Merging email or contact lists from several sources without repeats.
• Cleaning keyword and tag lists that accumulated duplicates.
• Reducing exported logs or IDs to their unique values.
• Comparing two lists by sorting both and eyeballing the diff.

What counts as a duplicate

Duplicates are exact: case and invisible whitespace both matter, so "Apple", "apple" and "apple " are three different lines until you normalise them — run the whitespace cleaner (and case converter if appropriate) first, then dedupe. Unsorted deduplication keeps first occurrences in original order, which matters for ranked lists. Sorting is by character code: numbers as text order 1, 10, 2 rather than numerically — pad with zeros if numeric order matters. The line count before and after tells you how many duplicates you had — occasionally the most informative number in the whole exercise.

Related tools

FAQ

How does Remove Duplicate Lines count characters with spaces and emoji?

It reports both a count with spaces and one without, so you can match whichever rule your form uses. Emoji and other characters outside the basic range are counted as a single visible character rather than as the two code units JavaScript stores internally.

Does Remove Duplicate Lines work for languages other than English?

Yes. Korean, Japanese, Chinese, Hindi, Arabic and accented European text are all handled correctly. Word counting splits on whitespace, so for Chinese and Japanese the character count is the more meaningful figure.

Is my text saved anywhere?

No. Everything runs in the page itself and nothing is transmitted or stored — you can paste a draft, a contract or private notes without it leaving your device.