Silicon Valley startup d-Matrix, co-founded by Sid Sheth and Sudeep Bhoja, has introduced its first AI chip designed to revolutionize how artificial intelligence manages user interactions. With over $160 million in funding, including support from Microsoft’s venture capital arm, the Santa Clara-based company specializes in AI inference hardware, focusing on optimizing user requests on trained AI systems like chatbots and video generators.
The newly developed chip is built to handle a high volume of simultaneous user requests, making it ideal for applications like video generation where multiple users may need unique, customized outputs at the same time. Super Micro Computer is set to integrate d-Matrix chips into its servers, which will be commercially available next year.
Sid Sheth, the CEO of d-Matrix, with over 20 years of experience in semiconductor innovation, including roles at Inphi, Broadcom, and Intel, has been instrumental in driving growth in data center-focused businesses. His strategic insights have led to significant success in networking divisions, such as Inphi’s, which grew into a $200 million enterprise before being acquired for $10 billion by Marvell Technology.
On the other hand, Chief Technical Officer Sudeep Bhoja brings extensive engineering experience, specializing in high-speed data interconnects and optical networking. His groundbreaking work at Inphi in developing digital signal processing technologies for data centers laid the foundation for d-Matrix’s focus on scalable, energy-efficient AI hardware.
While d-Matrix does not aim to replace industry giants like NVIDIA, it aims to complement their offerings by addressing efficiency and cost challenges in AI inference. The startup’s innovative “chiplet” architecture and in-memory computing techniques position it as a promising disruptor in the AI hardware sector, aiming to redefine how data centers manage increasingly complex workloads.
Rumaisa Khusru, a recent MSc graduate from the University of Oxford specializing in Applied Linguistics with a focus on Neurolinguistics, brings a wealth of experience in journalism and editing. With a background in reporting and editing for publications like Cherwell and Oxford Blue newspapers at Oxford, as well as research and writing for the International Business Times in Bangalore, Khusru’s expertise adds a valuable perspective to the field. As the editor-in-chief of Ethos magazine during her undergraduate years in Jeddah, she has honed her skills in communication and storytelling, offering unique insights into various topics.
