|
Listen to this story
|
Ola’s Krutrim, which recently entered public beta with its generative AI chatbot, has been marred by instances where it incorrectly attributes its creation to OpenAI. The issue came to light when users noticed the chatbot mentioning OpenAI as its creator during interactions.
Pratik Desai, the founder of KissanAI, took to X to offer unsolicited advice to the Krutrim team, suggesting ways to rectify the attribution problem. Desai recommended utilising techniques like Differential Privacy Optimization (DPO) or replacing OpenAI mentions in the dataset with Krutrim identifiers if the chatbot was created from scratch.
In response to Desai’s advice, Krutrim acknowledged the issue and provided insights into the root cause. According to the Krutrim team, the problem stems from a data leakage issue originating from one of the open-source datasets used in the Language Model (LLM) fine-tuning process.
“Hey Pratik, You are correct about the approach. Thanks for sharing this, it is very helpful and will help improve our product. We investigated the issue and found the root cause to be a data leakage issue from one of the open-source datasets used in our LLM fine-tuning,” responded Krutrim.
Launched in December, Krutrim is touted as “India’s first full-stack AI solution”. The company earlier claimed that the model is trained on a vast dataset of two trillion tokens. However, no information about the research, including training methods, the nature of the dataset, and the number of GPUs needed, among others, has been made public.
While acknowledging the possibility of some hallucinations, Aggarwal assures users that the occurrence will be lower in Indian contexts compared to other global platforms. The team acknowledges that this is just the beginning and anticipates significant improvements as they continue building on this foundation and encourage users to provide valuable feedback.
Krutrim became a unicorn company within one month of launch by raising a significant $50 million in equity at a valuation of $1 billion. Key investors, such as Matrix Partners India, played a pivotal role in this funding round.
