Event Summary “Using AI to Power Insights and the Business” Basel, September 2023

 

 

 

The one-day meeting in Basel on “Using AI to Power Insights and the Business” had been much anticipated.  It allowed us to deep-dive into the topic of AI in a more intimate setting following the discussions from the conference in June. AI in drug development seems almost like news from yesterday, but AI in business insight so far had less headline space. Can AI bring more than efficiencies? Can AI even help to find your killer insight?

Here is groupH’s pick of the key messages.

AI, for now, is “just another ‘person’ at the table”

To cut a long story short: there is much potential for AI as an assistant for specific uses but, generally, while it still has its flaws, the majority of presenters strike a somewhat cautionary note not to over rely on AI at this point.

The fact that AI (only) mimics human behaviour, is being trained for plausibility and not for truth, occasionally makes things up and is unable to explain exactly how it functions and where its information is coming from does not make a case for giving AI a senior role at the table. It would not for any human with the same traits.

AI is not yet ready – the audience is not yet ready

There is widespread experimentation with AI.  In the main, individuals are using their personal versus their company logins and industry can only count a small number of experts. Perhaps the phase of ‘shock’ has passed, but before AI is being accepted as the new normal there is a phase of ongoing reorientation.

In Social Media Listening (SML), for example, AI is being trained to be more subtle and nuanced.  However, it is not yet ready to frame a narrative within the context of research, opportunities and threats as Stephan Lebrat, Global MR Director at Takeda points out. And English language models currently dominate over other languages.

DALL-E 3 has just been made available by OpenAI as a generative visual art platform that integrates with ChatGPT and is meant to understand context better than its predecessor. https://openai.com/dall-e-3

A glimpse into the future of AI for agencies and industry?

Current AI language models make it possible to create artificial respondents whose responses to questions are difficult to keep apart from real respondents as Gemma McConnell from Day One Strategy explains. These AI respondents may be able to help with gaining an initial understanding of healthcare environments across therapy areas and indications at a much lower cost and much faster than undertaking PMR. This may be particularly helpful in conducting mock interviews preceding patient research; it may be particularly useful in rare diseases, where PMR is generally more challenging. At the moment, however, ChatGPT patient responses have a more generic feel to them and it is not known on which data they are based.

AI assisted desk research and first pass analysis of text, recordings and images helps agencies to become more efficient. An example of how AI is being used today for coding of data (e.g. for open ended questions) is the text analysis tool Caplena, https://caplena.com/en/. Researcher time spent with coding has been reduced by 46 – 67% according to Stephen Potts from Purdie Pascoe in a case study describing the adoption and implementation process.

Industry may be able to find a new purpose for existing data sets that support internal hypotheses generation but wants to make sure that its data is not training external models.

The personality profile of bots is typically highly agreeable and low in neuroticism as Paula Coyle from Blueprint Partnership explains. This may have an application in QC of demand forecast survey responses. In a self-funded study, the Mini-IPIP was used as a validated tool to segment physicians into under-, over- and accurate-estimators of their own prescribing. In the future it is thinkable that AI combined with behavioural science tools may allow to offer a more elegant and accurate calibration approach compared to traditional blanket calibration.

Fenna Gloggner from Idorsia Pharmaceuticals explained how Idorsia built its own internal ChatGPT model, an example also described by Ana Maria Aguirre Arteta, Global Governance Director at Novartis.

What we won’t forget from the conference

  • Can AI bring currently more than efficiencies to business insight? No. Not really. But in large, data-heavy studies AI may become routinely used in the mid- to long-term, under the watchful eye of human intelligence (HI).
  • Can AI help to find your killer insight? No. Not directly. But it may support making hypothesis and help analysis through consistent coding of transcripts.
  • Gemma McConnell’s synthetic patient animation – close to indistinguishable from the real patient. Offering the mining of existing data repositories to supplement research with real patients.
  • How will industry benefit from AI? Presented case studies describing efficiency gains far outweigh those hinting at insight quality gains from AI. Overall project value delivered by an agency remains driven mainly by HI for the foreseeable future.
  • It may be too early at this point to count on efficiencies offered by AI before the technology is fully trusted by all stakeholders, However, over time these efficiencies are likely to materialise and may spur some competition among agencies to pass on some of these efficiency gains.
  • The sigh of relief that ~80% of doctors were found being able to accurately estimate their own level of prescribing for a known product for the week after the question was asked (!) as Paula Coyle from Blueprint Partnership explained.

By Erik Holzinger, groupH, London

 

Data Collection, Analysis and Communication Masterclass – Part 2

 

 

Friday, 29 September 2023 at 13:00 UK (14:00 CET)

Register here

Okke has created many business solutions, set up centers of excellence around the globe and trained many researchers and clients on advanced analytical techniques. He is a client facing statistician as he believes that direct work with client is the best way to fully understand and advise on research and analytics. He has been always fascinated in the process of gathering in-depth understanding of human thinking in relation to questionnaire content improvements for various measurements. Previously he was a chief research officer at Synovate, Ipsos and PSL group. He holds a master’s degree in Psychological Methods and Techniques of Research (University of Amsterdam).

Demand studies frequently use conjoint models as we illustrated during our Webinar #1 back in March. This makes total sense, as it’s a very insightful way of analysing the impact of multiple attributes which are shown at the same time. However, there are a number of different conjoint methods at our disposal, all with their respective strengths and weaknesses. We therefore have to decide which method is most suitable in which situation.

Please join us for Webinar #2 of this series, which will shine a light on this dilemma by offering some guidance for each method.
We welcome back Okke Engelsma from Cerner Enviza, who, during his 20 years in the UK has trained many researchers and clients on advanced analytical techniques. Okke was previously chief research officer at Synovate, Ipsos and PSL group. He holds a masters in Psychological Methods and Techniques of Research (University of Amsterdam).
There will be ample time for cross industry, peer-to-pear discussions during this session.

This session is for both, sponsors and market researchers and those more and less experienced with demand modelling.

Any questions just get in touch:

generalmanager@ephmra.org

erik.holzinger@grouph.com