With so many businesses experimenting with AI, why are so few rolling it out at scale in production? eDiscovery giant Consilio uniquely tackles the “AI Trust Gap” that’s creating AI adoption challenges, through a melding of the old and new.
A substantial execution challenge has arrived with the broad Generative AI access that has swept the globe since 2022. While most organizations and professionals driving mission-critical outcomes see GenAI’s potential, they are also largely still early in how to effectively harness it.
We see this in a recent global survey of legal services professionals: while 90% of respondents confirmed they are experimenting with AI, only 10% have adopted it in substantial production manners. A lack of trust and experience in AI to deliver quality results are key factors in this lack of adoption. This trend also extends across other industries, as applying AI to work that requires a high degree of accuracy takes a very high level of care.
Consilio, the largest global provider of tech-enabled legal services, has found a unique way to tackle this trust gap to get the most from AI as it evolves. The company, which offers eDiscovery, document review, flexible talent solutions and legal transformation services, is no stranger to AI, with over a decade of experience and millions of documents processed using GenAI’s precursor, machine learning analytics that in legal services are called Technology Assisted Review (TAR).
The approach Consilio has found is to pair seasoned subject matter experts with the technology even after it is deployed – going beyond model building to the hands-on execution of AI-driven work. They call this process “iterative prompting,” and it has generated market-leading quality and efficiency for clients. In highly nuanced fields like eDiscovery, where sifting the right documents from a stack of millions is a nuanced, specialized skillset, the company has found that applying subject matter expertise to the custom, innovative models the team deploys successfully mitigates the very broadly known issues AI has with hallucinations and other inaccuracies.
Guiding Consilio’s “multi-model validation” process which employs multiple AI models to validate each others’ output, these “AI Guide” subject matter experts are how Consilio is able to deliver trustworthy AI performance.
“Guided AI Review” is the first product Consilio launched using this expertise-driven approach. The product has delivered industry-leading ‘precision’ and ‘recall,’ which translates into higher quality AI output. Consilio has over 500 advisors trained on this, and a total of 250 million documents have been analyzed across all its analytics engagements.
Across all industries, the success Consilio has seen placing hands-on subject matter experts in the middle of GenAI activity bears insights. Given the known gaps in AI that will continue for some time, and given how the technology will continue to shift radically, expert-led AI creates important learning and validation for organizations as they continue to learn.
Find out more about DAVOS 2025 Campaign
