Table of Contents
Sarvam AI, an Indian artificial intelligence startup, has taken a significant step in advancing language models with the release of OpenHathi-Hi-0.1, the first open-source Hindi language model. This initiative marks the beginning of a series of models aimed at contributing to the ecosystem by providing open models and datasets, fostering innovation in Indian-language artificial intelligence.
Artificial intelligence Innovation: OpenHathi-Hi-0.1’s Llama Foundation
The foundation of OpenHathi-Hi-0.1 lies in Meta AI’s Llama 2-7B model, showcasing its capabilities in alignment with the renowned GPT-3.5 for Indic languages. In a blog post, the company highlighted the challenges associated with tokenization, a critical process in handling text for large language models. The complexities arise from the scarcity of training text in Hindi compared to English, making tokenization more costly. To address this, the model underwent a two-phase training process, optimizing and making the tokenization process more cost-effective.
The testing phase encompassed various benchmarks, including traditional ones like translation as well as novel ones such as toxicity classification and text classification. This comprehensive evaluation ensures that OpenHathi-Hi-0.1 meets high standards across different applications and scenarios.
Recognizing the importance of accessibility, Sarvam has made the base model available on the Hugging Face platform. This move enables developers to fine-tune the model to cater to specific use cases, promoting flexibility and customization within the artificial intelligence community.
Artificial intelligence Synergy: Sarvam and AI4Bharat’s Crucial Collaboration
The collaborative efforts of Sarvam and AI4Bharat, another homegrown artificial intelligence venture, have played a crucial role in the development of OpenHathi-Hi-0.1. Leveraging AI4Bharat’s language resources and benchmarks, Sarvam Artificial Intelligence utilized valuable insights to train and enhance the capabilities of the Hindi language model. This strategic partnership underscores the collaborative nature of the artificial intelligence community in India, where entities join forces to leverage expertise and resources for mutual benefit.
With a team of approximately 18 professionals, Sarvam has set ambitious goals for the future. The company aims to build large language models that utilize voice as the common interface, aligning with the preferences and demands of the Indian market. This approach not only enhances accessibility but also reflects the commitment to addressing the diverse linguistic landscape in India.
Artificial intelligence Funding Triumph: Sarvam’s $41M Boost
In a recent Series A funding round, Sarvam successfully secured $41 million, a clear testament to the widespread recognition and support from investors. Lightspeed Ventures spearheaded the funding, accompanied by contributions from Peak XV and Khosla Ventures. This substantial financial backing positions Sarvam artificial intelligence to amplify its operations and actively pursue its vision of propelling AI technology advancements within the Indian market. Funds bolster Sarvam’s position, enabling tech enhancement and groundbreaking AI initiatives.
Beyond the release of OpenHathi-Hi-0.1, Sarvam is actively working on a range of enterprise-grade models. These models, integrated into the company’s full-stack generative artificial intelligence platform, are poised to be released soon. The platform’s comprehensive approach signifies Sarvam’s commitment to providing robust solutions that cater to the diverse needs of enterprises in the evolving landscape of artificial intelligence.
Conclusion
Sarvam AI’s introduction of OpenHathi-Hi-0.1, the inaugural open-sourced Hindi language model, represents a pivotal achievement in advancing language models finely tuned for the nuances of the Indian context. This milestone is underscored by strategic collaborations, meticulous development methodologies, and a steadfast commitment to accessibility. Positioned as a central figure in India’s evolving artificial intelligence landscape, Sarvam is navigating its way as a key player. The unveiling of this open-source model, complemented by recent funding triumphs, not only signifies a current success but also lays the foundation for ongoing innovation and substantial impact in the ever-evolving realm of artificial intelligence, setting a dynamic stage for future advancements.
Read more:
MS Dhoni’s 5-Step Epic Fitness Revolution: Tagda Raho Redefining Traditional Strength Training
