GPU

Meta sheds more light on how it is evolving Llama 3 training — it relies for now on almost 50,000 Nvidia H100 GPU, but how long before Meta switches to its own AI chip?

by
Meta sheds more light on how it is evolving Llama 3 training — it relies for now on almost 50,000 Nvidia H100 GPU, but how long before Meta switches to its own AI chip?

Meta has unveiled details about its AI training infrastructure, revealing that it currently relies on almost 50,000 Nvidia H100 GPUs to train its open source Llama 3 LLM.  The company says it will have over 350,000 Nvidia H100 GPUs in service by the end of 2024, and the computing power equivalent to nearly 600,000 H100s … Read more

AMD’s FSR 3.1 promises improved image quality – with less flickering, better motion – and a trick that’ll delight some Nvidia GPU owners

by
AMD’s FSR 3.1 promises improved image quality – with less flickering, better motion – and a trick that’ll delight some Nvidia GPU owners

AMD has announced its next-gen upscaling box of tricks to make frame rates smoother with PC games at GDC 2024. This is FSR 3.1, and it sounds like a big step forward – and not just for the quality of the upscaling tech, since there’s a surprise in tow for Nvidia (and Intel Arc) GPU … Read more

TikTok owner is quietly doing an ‘Apple’ — ByteDance invests in Chinese memory pioneer, months after a similar move in a GPU vendor, as it plans for an Apple Vision Pro VR rival

by
TikTok owner is quietly doing an ‘Apple’ — ByteDance invests in Chinese memory pioneer, months after a similar move in a GPU vendor, as it plans for an Apple Vision Pro VR rival

TikTok’s parent company ByteDance has reportedly quietly invested in Xinyuan Semiconductors, a Chinese memory chip manufacturer.  A report from Pandaily, a tech media site based in Beijing, the move reportedly positions ByteDance as the third-largest shareholder in the chip maker, holding an indirect stake of 9.5%. A ByteDance spokesperson confirmed this previously undisclosed investment to … Read more

AI chip built using ancient Samsung tech is claimed to be as fast as Nvidia A100 GPU — prototype is smaller and much more power efficient but is it just too good to be true?

by
AI chip built using ancient Samsung tech is claimed to be as fast as Nvidia A100 GPU — prototype is smaller and much more power efficient but is it just too good to be true?

Scientists from the Korea Advanced Institute of Science and Technology (KAIST) have unveiled an AI chip that they claim can match the speed of Nvidia‘s A100 GPU but with a smaller size and significantly lower power consumption. The chip was developed using Samsung‘s 28-nanometer manufacturing process, a technology considered relatively old in the fast-moving world … Read more

‘A single chip to outperform a small GPU data center’: Yet another AI chip firm wants to challenge Nvidia’s GPU-centric world — Taalas wants to have super specialized AI chips

by
‘A single chip to outperform a small GPU data center’: Yet another AI chip firm wants to challenge Nvidia’s GPU-centric world — Taalas wants to have super specialized AI chips

Toronto-based AI chip startup Taalas has emerged from stealth with $50 million in funding and the lofty aim of revolutionizing the GPU-centric world dominated by Nvidia. Founded by Ljubisa Bajic, Lejla Bajic, and Drago Ignjatovic, all previously from Tenstorrent (the creator of Grayskull), Taalas is developing an automated flow for quickly turning any AI model – … Read more

NVIDIA’s AI personal assistant demo available for RTX GPU PCs

by
NVIDIA’s AI personal assistant demo available for RTX GPU PCs

NVIDIA has recently unveiled a new technology demonstration that is set to enhance the way we interact with artificial intelligence. This new feature, known as “Chat With RTX,” is designed to work seamlessly on Windows RTX PCs, leveraging the power of NVIDIA RTX GPUs to deliver a personalized and efficient chatbot experience. The technology is … Read more

Build a custom AI large language model GPU server (LLM) to sell

by
Build a custom AI large language model GPU server (LLM) to sell

Deploying a custom language model (LLM) can be a complex task that requires careful planning and execution. For those looking to serve a broad user base, the infrastructure you choose is critical. This guide will walk you through the process of setting up a GPU server, selecting the right API software for text generation, and … Read more

AOC 4K gaming monitors with AI-powered GPU technology

by
AOC 4K gaming monitors with AI-powered GPU technology

AGON by AOC, a leading brand in the gaming monitor and IT accessories sector, has recently unveiled two new gaming monitors to its product range: the AOC GAMING U27G3X/BK and U32G3X/BK. These top-tier monitors are designed to enhance the gaming experience by delivering superior visuals and adaptable performance, catering to both casual and competitive gamers. … Read more

New Apple M3, M3 Pro, and M3 Max silicon chips with next gen GPU architecture

by
New Apple M3, M3 Pro, and M3 Max silicon chips with next gen GPU architecture

Today Apple has unveiled a range of new Apple silicon in the form of the latest M3, M3 Pro, and M3 Max silicon chips. Marking another milestone in Apple’s journey of silicon innovation, propelling the tech giant further into the realm of portable high-performance computing. The M3 family of chips have been built using 3-nanometer … Read more