Evalueserve
  • About
  • Blog
  • Careers
  • mind+machine™
Contact Us
  • Analytics
      • Analytics Overview
      • Marketing & Digital Analytics
      • Sales Analytics
      • Supply Chain & Operations Analytics
      • Pricing & Revenue Management
      • Customer Insights
      • IP & Innovation Analytics
      • Risk & Compliance Analytics
  • Knowledge Services
      • Marketing, Sales & Strategy
      • Marketing and Sales Enablement
      • Strategy Research Support
      • Procurement
      • Procurement Intelligence
      • Innovation Intelligence & IP Solutions
      • IPR&D Intelligence
      • IPR&D Search
      • IP Prosecution Services
      • (Eco)Toxicology Consulting Service
      • Professional Services
      • Rapid Research Support
      • Knowledge Management & Transformation
      • Market and Strategic Intelligence
      • Design and Production Support
      • Deals, M&A, and Corporate Finance Support
      • Scaling Data Assets
      • Financial Services
      • Risk & Compliance
      • Investment Banking Support
      • Corporate Banking Support
      • Commercial Banking Support
      • Global Markets Research
      • Index & Quant Solutions
      • Investment Management
      • Life Sciences & Healthcare
      • Biopharmaceuticals, Medical Products & Healthcare
      • Datacrest
  • Service Design Consulting
  • Digital Platforms
      • Insightsfirst
      • Researchstream
      • Spreadsmart
      • Insightloupe
      • Usecasehub
      • Datacrest
      • Pitchready
      • Researchscaler
      • Navigator
      • Publishwise
      • AnalyticsApps
      • Compsbuilder
  • Industries
      • Financial Services
      • Corporate & Investment Banking

      • Capital Markets

      • Investment Management

      • Retail & Commercial Banking

      • Risk & Compliance

      • Manufacturing
      • Automotive

      • Consumer Packaged Goods

      • Engineering

      • Energy

      • Chemicals

      • Life Sciences & Healthcare
      • Bio-Pharmaceuticals

      • Medical Products

      • Healthcare

      • Technology Media & Telecommunications
      • Telecommunications & Media

      • Hardware & Software

      • The Internet of Things

      • Professional Services
      • Consultancy

      • Legal

      • Taxation, Auditing & Accountancy

      • Services
      • Retail

      • Freight & Logistics

      • Utilities

      • Non-Profit Organizations

  • Resources
      • Case Studies
      • Blog
      • White Papers
      • Evalueserve in the News
      • Industry Insights
      • COVID-19 Disruption Insights
      • Events
  • Analytics
      • Analytics Overview
      • Marketing & Digital Analytics
      • Sales Analytics
      • Supply Chain & Operations Analytics
      • Pricing & Revenue Management
      • Customer Insights
      • IP & Innovation Analytics
      • Risk & Compliance Analytics
  • Knowledge Services
      • Marketing, Sales & Strategy
      • Marketing and Sales Enablement
      • Strategy Research Support
      • Procurement
      • Procurement Intelligence
      • Innovation Intelligence & IP Solutions
      • IPR&D Intelligence
      • IPR&D Search
      • IP Prosecution Services
      • (Eco)Toxicology Consulting Service
      • Professional Services
      • Rapid Research Support
      • Knowledge Management & Transformation
      • Market and Strategic Intelligence
      • Design and Production Support
      • Deals, M&A, and Corporate Finance Support
      • Scaling Data Assets
      • Financial Services
      • Risk & Compliance
      • Investment Banking Support
      • Corporate Banking Support
      • Commercial Banking Support
      • Global Markets Research
      • Index & Quant Solutions
      • Investment Management
      • Life Sciences & Healthcare
      • Biopharmaceuticals, Medical Products & Healthcare
      • Datacrest
  • Service Design Consulting
  • Digital Platforms
      • Insightsfirst
      • Researchstream
      • Spreadsmart
      • Insightloupe
      • Usecasehub
      • Datacrest
      • Pitchready
      • Researchscaler
      • Navigator
      • Publishwise
      • AnalyticsApps
      • Compsbuilder
  • Industries
      • Financial Services
      • Corporate & Investment Banking
      • Capital Markets
      • Investment Management
      • Retail & Commercial Banking
      • Risk & Compliance
      • Manufacturing
      • Automotive
      • Consumer Packaged Goods
      • Engineering
      • Energy
      • Chemicals
      • Life Sciences & Healthcare
      • Bio-Pharmaceuticals
      • Medical Products
      • Healthcare
      • Technology Media & Telecommunications
      • Telecommunications & Media
      • Hardware & Software
      • The Internet of Things
      • Professional Services
      • Consultancy
      • Legal
      • Taxation, Auditing & Accountancy
      • Services
      • Retail
      • Freight & Logistics
      • Utilities
      • Non-Profit Organizations
  • Resources
      • Case Studies
      • Blog
      • White Papers
      • Evalueserve in the News
      • Industry Insights
      • COVID-19 Disruption Insights
      • Events
  • Home > 
  • Evalueserve Blog > 
  • IPR&D Information Adventurers Blog > 
  • What is a good IP and R&D search?
    Part 3: The searcher’s dilemma
IPR&D Information Adventurers Blog

What is a good IP and R&D search?
Part 3: The searcher’s dilemma

Jun 20, 2018 • Urs Dommann & Ashutosh Pande

Get ready – it’s time for a solid theoretical framework that helps us to discuss and later measure the quality of patent search! To do this, I’d like to introduce Ashutosh Pande, a key member of our team at Evalueserve IPR&D who is passionate about high-quality patent search, using artificial intelligence, and other service improvements internally at Evalueserve. Ashutosh has researched these topics for several years now and has been working with a core team on questions such as: how to define a good patent search, and how to ensure that we can deliver a great patent search service that flows into related processes. It’s a great pleasure to write this post together with him!

Everyday example – doing an internet search

Let’s start with a generic example to understand what we call the searcher’s dilemma. Assume you are visiting a new city and its dinner time. You want to try some authentic local food, in a pleasant atmosphere in a comfortably-sized restaurant. So, you search on your favorite search engine to find a nearby restaurant that also has good reviews and matches all your criteria. Off you go...

On reflection, in finding a suitable restaurant, you really want the search engine to do three things:

  1. Give me a list of ALL the authentic local restaurants in the city (and not miss out any that fit your criteria).
  2. Give me ONLY authentic local restaurants as an output (and no other restaurants, e.g. international chains).
  3. Present the information in such a way that it is easy for you to assess the facts and choose one.

Our daily experience shows that the process of searching for a restaurant – or anything else – on the internet is far from perfect. The reality is that we get a long list of results with some potentially good hits on the first page, lost among many less relevant options and with some real treasures missing. There is also a huge variety of sources – some less valid and reliable than others, although it can be difficult to tell which!

The patent search or technology landscape example, although of course very different, can share some of these characteristics. Our thinking on high-quality search in an intellectual property or research & development environment is quite similar. As a customer of such a project, e.g. a freedom to operate search, you need a very similar output:

  1. Ideally, a list of ALL relevant patent hits or non-patent literature (i.e. documents) – one measurement criteria of this could be the percentage of the relevant documents provided out of the entire search universe (termed RECALL).
  2. Plus, a list of ONLY relevant documents – which can be measured as a percentage of which documents provided are relevant (termed PRECISION).1
  3. Presented in such a way that next step in the analysis is straightforward

In patent searching and technology landscapes, the good news is that all of this is possible. An experienced information professional can find most of the relevant documents with very high precision, and present the results in a suitable way for the IP or R&D end-user.

So what is the ‘searcher’s dilemma?’

When we say above that this is possible, then we are ignoring the fact that to achieve high recall and precision, resources need to be allocated to the search.

And here lies the ‘searcher’s dilemma’ – you can maximise recall (finding all documents) but only by putting in effort (either time spent, better database used, more experienced searcher hired, etc.) or paying in the form of low precision (accept irrelevant documents in the output, or ‘noise’).

The upshot: in the daily routine, missing some relevant documents is part of every searcher’s life.

This is best illustrated by looking at United States Patent and Trademarks Office (USPTO) and the European Patent Office (EPO) where you will certainly find some of the best patent searchers in the world, but inevitably, resources are limited. A considerable proportion of granted patents are, or could be, successfully challenged in post-grant oppositions or validity procedures, as by investing more resources additional prior art is identified.

In the case of parallel search in our earlier post, high recall resulted from over 20 patent search companies working on a pilot, leading to potentially-lower precision, but also greater effort in harmonizing and understanding the results.

Coming up …

Over the next few posts we will discuss the questions this raises:

  • What can we learn from simple economics and market price to understand that quality requirement (and recall, precision, output) varies by use case – why can the market price for different types of searches be 500, 5,000, or 50,000 USD?
  • Although difficult to measure, why does Evalueserve aim to measure recall and define output quality? We believe it is ultimately the key to quantifying search quality!
  • High precision and recall are important factors and we will dissect these concepts and go into detail on how to maximize them by looking at the typical errors that lead to lower values.
  • What other factors are important for search quality? We will introduce such concepts.

You may ask why we are so passionate about a business where it seems impossible to deliver perfection? Well, we both feel that this is exactly why it is one of the most interesting fields to work in these days, with huge opportunities for individuals and companies with a clear view on high-quality patent search or patent landscapes. At the end of the day, we do so to help meet our client’s challenges in a complex, transforming, and imperfect, world!

The next time you visit a city and want to find a good restaurant we hope you find the one you will have a great evening and enjoy the food – and thinking about search quality.

TALK TO AN EXPERT

 

1 For those interested in more detail now, we recommend checking out Wikipedia for more general discussion, or blogs on data science; or look out for a paper that we will soon publish on this topic.

  • Urs Dommann

    Urs Dommann

    Business Unit Head,
    IP and R&D Solutions

  • Urs Dommann, who heads up IP and R&D Solutions at Evalueserve, is passionate about improving knowledge processes and data science to optimize quality in patent search, and is a regular speaker on this topic at IP Service World. Urs and his team created the Information Adventures blog after recognizing that moving through the complex world of data and information in IP or R&D is like venturing high into the mountains or other seemingly uncharted territory – something he loves to do in the Swiss Alps near Zurich where he lives. He’s enjoying using the blog to share theories, insights about IP and R&D, and starting a conversation as a basis of exploring – together with clients – new paths to success.

  • Ashutosh Pande

    Ashutosh Pande

    Vice President,
    IP and R&D Solutions

  • Ashutosh Pande is an expert in intellectual property, mathematics, data analytics, and data science. He’s the Vice President at Evalueserve’s IP and R&D Solutions responsible for doing and managing research around IP and R&D research services, aimed at improving their outputs for customers. He’s realized that to find the simplicity in anything, you just need to continually break down the complex ‘big picture’ into ever-simpler component parts, and search out the commonalities. Via the Information Adventurers blog – and in collaboration it’s with readers – Ashutosh looks forward to honing his own thought processes about challenges in IP and R&D research, and creating knowledge that will impact the industry.

Don’t hesitate, get in touch with Urs & Ashutosh.

Latest posts

  • Blog Post

    Competitive Intelligence Spotlight: Smriti Singh

    Discover More
  • Blog Post

    Competitive Intelligence: 11 Tools You Should be Using

    Discover More

Follow us on

  • Service Design Consulting

    • Service Design Consulting Overview
  • Knowledge Services

    • Knowledge Services Overview
    • Marketing, Sales, & Strategy
    • Innovation Intelligence & IP Solutions
    • Professional Services
    • Financial Services
    • Life Sciences & Healthcare
  • Analytics

    • Analytics Overview
    • Marketing & Digital Analytics
    • Sales Analytics
    • Supply Chain & Operations Analytics
    • Pricing & Revenue Management
    • Customer Insights
    • IP & Innovation Analytics
    • Risk & Compliance Analytics
  • Digital Platforms

    • Digital Platforms Overview
    • Datacrest
    • Pitchready
    • Researchstream
    • Spreadsmart
    • Usecasehub
    • Insightloupe
    • Insightsfirst
    • Researchscaler
    • Navigator
    • Publishwise
    • AnalyticsApps
    • Compsbuilder
  • Industries

    • Financial Services
    • Manufacturing
    • Life Sciences & Healthcare
    • Technology Media & Telecommunications
    • Professional Services
    • Services
  • Resources

    • Blog
    • Case Studies
    • White Papers
    • Industry Insights
    • Events
    • Competitive Intelligence
    • Financial Spreading
    • Demand Forecasting
  • About Evalueserve

    • About Us
    • Evalueserve Team
    • mind+machine™
    • Stories That Connect Us
  • Careers at Evalueserve

    • Careers
  • Press Center

    • News
  • Contact Evalueserve

    • Talk to one of our experts
    • Office locations
© 2021 Evalueserve. All rights reserved.
  • Imprint
  • Privacy Policy
  • Cookie Policy
  • Terms of Use
  • Corporate Governance
  • Site Map
  • Email Marketing Guidelines