What happens to URLs without a protocol?
HTTPS is added to plain domains before validation and deduplication. Only valid HTTP and HTTPS addresses are kept.
URL List Deduplicator
Clean a multiline URL list, add HTTPS where needed, ignore blank lines, and remove duplicates.
URL cleanup Deduplication
Online URL list deduplicator
The URL list deduplicator removes repeated addresses and normalizes plain domains to HTTPS. Paste a multiline list to ignore blank lines, count duplicates and invalid entries, and create a cleaned list that you can copy or download. Use it to organize bookmarks, search results, research sources, and website shortcuts.
How to deduplicate a URL list
- Paste your addresses into the input box, with one URL on each line.
- Review the counts for valid, duplicate, and invalid URLs.
- Copy the cleaned list or download it as a TXT file.
URL deduplication FAQ
Does deduplication remove URL parameters or fragments?
No. Query parameters and URL fragments are preserved because they may point to different content. Only identical normalized URLs are merged.