- Published on
Exploring how 1B-parameter small language models can outperform 405B giants through clever compute allocation, test-time scaling, and innovative training strategies. Is bigger really always better in the AI world?
7 min read
Read more →Welcome to the DeeperThoughts blog!
I'm Rohith, a Research Scientist at the Centre for Development of Telematics (C-DOT), and a deep learning enthusiast with a passion for peeling back the layers of multimodal machine learning systems. This blog is intended to make recent advances easier to grasp, and is an open invitation to think deeper, explore further, and stay curious about the evolving landscapes of AI.
Enjoyed what you read? I'd love to hear your thoughts—feel free drop a comment on any article. For updates on new posts, Subscribe to the newsletter and get the latest straight to your inbox 📬.
Add Article
Showing 35 of 35 posts
Latest Blog Posts
- Published on
Ever came across reels on Instagram that show Queen Elizabeth breakdancing and wondered how they look so uncannily real? In a world where AI can create art, faces, and even deepfakes from scratch, GANs stand at the center. But how does AI really generate images that even humans can’t tell are fake?11 min readRead more →- Published on
New capabilities of Large Language Models like GPT, LLaMA, Claude, and Grok are emerging almost every day, and at the heart of these powerful models lies the multi-head self-attention mechanism—the secret behind their impressive reasoning and language skills. This article takes a closer look at how these attention heads work together under the hood to create the tools we rely on and admire today.11 min readRead more →
Newsletter Subscription
Subscribe to the newsletter