Thursday, September 24, 2009

Major new version: Claim highlighting now phrase-based and done in the client

We've just done a major new upgrade to Dispute Finder.

The bad news: You'll have to upgrade your firefox extension.

The good news: It's much better and marks a lot more stuff.


Previously, the way that Dispute Finder worked was that the users used our search interface to mark snippets on the web that made a disputed claim. As you browsed the web, the Firefox extension would check whether the page you were looking at had been marked with a disputed claim, and let you know.

In the new version, the marking is instead done inside the Firefox extension. The Firefox extension downloads a list of phrases that are known to indicate disputed claims, and highlights them when it seems them on pages that you browse.

The advantage of this new approach is that, once a paraphrase of a disputed claim has been entered into our database, it will be highlighted everywhere it appears on the web - including on web pages that have only just been created - very important for news.

The current marking algorithm is rather dumb - it just looks for exact phrases. In the near future we plan to extend this to a more sophisticated natural language processing algorithm that takes account of the context in which phrases are being used and does not require that a phrase be used exactly.


Try it out. We'd be interested to hear what you think :-))