A B Vijay Kumar
Apr 22, 2024

Hi Vikas - normally if it is a generic question and if its not in the documents, and if the LLM can answer that it will answer (if its already pretrained on that topic). If its totally a random topic and if its not something the LLM cannot answer, then I have seen ot halusinate. Not sure if there is a way to detect the answer and handle the exception/error. You can think of mutli agent applicaiton which uses a different LLM to validate the response to ensure that it is correct. If you have to integrate with Web and search the web, u can use a langchain agent and integrate that

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

A B Vijay Kumar
A B Vijay Kumar

Written by A B Vijay Kumar

IBM Fellow, Master Inventor, Mobile, RPi & Cloud Architect & Full-Stack Programmer

No responses yet

Write a response