How to compare two blocks of text, to Test for copied content?

[ksinclair]

I am looking for a tool that can compare two blocks of text
to see if they are the 'same' or different/unique content.
Is there such a tool? There must be.

Second question, how does google do this comparison?
How do they know when two pages have duplicate content?
Ideally, I want a tool that works equivalently to google's tool.

Thanks

 

[amplify]

For your first question, there is a tool for checking plagiarism. It's called CopyScape and can be found at: http://www.copyscape.com/

I don't understand your second question though. Sorry I couldn't be of more assistance.

 

[ksinclair]

I will try out copyscape. But copyscape is for text that is on a web page, I believe? What I want is to compare to blocks of text; maybe text I have just created in my word processor, for example.

 

[hina]

To compare two blocks of text:
Try a diff tool, there are some for Windows:
http://www.google.com/search?q=diff+windows

But I am sure that's not how Google detects "duplicate content". Their algorithm must be more sophisticated.

 

[amplify]

I believe you need CopyScape Premium to search blocks of text only.

It can be found: http://www.copyscape.com/signup.php?pro=1&o=f

 

[domaindot]

I am looking for a tool that can compare two blocks of text
to see if they are the 'same' or different/unique content.
Is there such a tool? There must be.

Copyscape is there, like amplify said. You can always build your own tool.

Second question, how does google do this comparison?
How do they know when two pages have duplicate content?
Ideally, I want a tool that works equivalently to google's tool.

Thanks

Google does much more than mere textual comparison. They analyze the sets for related words/phrases (LSA). They also do contextual analysis of the sets.

 

[amplify]

Google does much more than mere textual comparison. They analyze the sets for related words/phrases (LSA). They also do contextual analysis of the sets.

Do you mind to elaborate on that? It's way over my head.

 

[domaindot]

http://en.wikipedia.org/wiki/Latent_semantic_analysis

http://www.unl.edu/sbehrend/html/sbsite/StudyQuestions/ContextualAnalysis.html


Layman's language: you can build a tool like Google's algorithm (we're not talking about search here) for text comparison, but it will take a lot of time and effort.

There is always Copyscape.

 

[mannoo2005]

You can use this free tool: http://www.plagium.com

 

[ksinclair]

You can use this free tool: http://www.plagium.com

i dont understand it. a lot of colored boxes. I did a test
of content that is likely to be unique but it gave a lot of results.
maybe its not unique or is it searching every word input,
as 'or' for each word? it shoudl search it as a whole,
as a set string.

 

[mannoo2005]

when you put the text, it searches it and compares it to what found, to see its unique percentage (which is red circles). So, it's very useful if you purchased any content or articles, to see if it's spinned from other or original content.

 

[copper]

Just go to Google and type in "duplicate content checker".

Here is one...
http://www.dupecop.com/compare-spun-articles.php