How do I get a list of unique tokens?

[tiago]

Sometimes I am given the option to use EditPad Pro to overcome this limitation, but this is just a nightmare when it comes to script operations that need full automation as they take hours to go.

What I need is to get this

Code: Select all

this is not unique

THIS is UNIQUE

this is not unique

this is not unique

THIS too!

this is not unique[code]

into

[code]
THIS is UNIQUE
THIS too!
[code]

Please advise.