Which copy of a repeated line is kept?

By default the first one, so the list keeps its original order. Choose “Last copy” to keep each line where it last appears instead, which is useful when later entries are more up to date.

Does it change my lines?

No. Options like “Ignore upper/lower case” and “Ignore extra spaces” only decide which lines count as the same; the line that is kept is shown exactly as you wrote it. Turn on “Trim spaces in the result” if you also want leading and trailing spaces removed.

How does sorting work?

Alphabetically, ignoring case and accents, with numbers in natural order, so “item 2” comes before “item 10”. Sorting happens after duplicates are removed.

Free text tool

Remove Duplicate Lines

Remove repeated lines from lists of URLs, keywords or emails, ignoring case or spacing, then sort what's left.

Treat as the same line

Ignore upper/lower caseIgnore extra spacesRemove empty linesTrim spaces in the result

Keep

Sort

Your lines9 lines

Unique lines5 lines

https://example.com/pricing
https://example.com/blog/seo-checklist
https://example.com/Blog/SEO-Checklist
https://example.com/contact
https://example.com/about

3 duplicate lines removed1 empty line dropped

De-duplicate any list

Paste a list with one item per line, such as URLs from a crawl, keywords from several exports or email addresses, and get each item once. The counter shows how many duplicates and empty lines were removed. The list is processed in your browser and never uploaded.

Good to know

URLs that differ only in case may be different pages. Leave “Ignore upper/lower case” off for URL lists unless you know the site treats them the same.
A line ending with a space looks the same as one without. “Ignore extra spaces” is on by default for that reason.
Use “Use as input” to run another pass, for example to sort the cleaned list.

Frequently asked questions

Which copy of a repeated line is kept?: By default the first one, so the list keeps its original order. Choose “Last copy” to keep each line where it last appears instead, which is useful when later entries are more up to date.
Does it change my lines?: No. Options like “Ignore upper/lower case” and “Ignore extra spaces” only decide which lines count as the same; the line that is kept is shown exactly as you wrote it. Turn on “Trim spaces in the result” if you also want leading and trailing spaces removed.
How does sorting work?: Alphabetically, ignoring case and accents, with numbers in natural order, so “item 2” comes before “item 10”. Sorting happens after duplicates are removed.