Removing duplicate strings/words(not lines) using RegEx(notepad++)

Question

I would like to know a way to remove duplicate words or strings in a text file(not lines) using notepad++ regex find tool.

I only saw ways to remove duplicate lines using TextFx and that is not what i am looking for.

Example -

123 / 789 123 / 321

Removing 123 would result in

123 / 789 / 321

So what exactly are you looking for? Do you mean duplicates like "It's the the mailman!" (duplicate the) or "The cat chased the dog" (duplicate the with intervening words) , or "banana" (duplicate na)? Or something else? — Tim Pietzcker
– Tim Pietzcker, Commented Jan 13, 2013 at 10:11
Use this RE \b(\w+)(?:\s+\1\b)+ Courtesy of [StackExchange][1] [1]: superuser.com/questions/454046/… — Muhammad Nasir Shamshad
– Muhammad Nasir Shamshad, Commented Aug 19, 2015 at 10:35

Andrew Cheong · Accepted Answer · 2013-01-13 19:03:50Z

4

I'm not familiar with Notepad++, but assuming it uses standard syntax, replace

\b(\w+)\b([\w\W]*)\b\1\b

with

$1$2

edited Jan 13, 2013 at 19:03

answered Jan 13, 2013 at 9:47

Andrew Cheong

30.4k17 gold badges103 silver badges173 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

nhahtdh Over a year ago

There is no lookahead in your code. You probably mean backreference.

Andrew Cheong Over a year ago

Oops. Thanks. It was late. In fact I meant to offer a lookahead-based solution, but then I remembered reading somewhere that NPP doesn't support lookaheads, wrote a different solution, and forgot to change the description.

Collectives™ on Stack Overflow

Removing duplicate strings/words(not lines) using RegEx(notepad++)

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related