GPU

AMD RX 7900 GRE gets a free performance boost – is this now the best mid-range GPU you can buy?

by

[ad_1] AMD’s RX 7900 GRE became available to buy in the US (and elsewhere) last month, but with an odd catch on the performance front – the good news being that this hiccup related to overclocking the GPU has now been cured. If you’ve been following the somewhat curious tale of the global launch of … Read more

Startup claims to boost LLM performance using standard memory instead of GPU HBM — but experts remain unconvinced by the numbers despite promising CXL technology

by

[ad_1] MemVerge, a provider of software designed to accelerate and optimize data-intensive applications, has partnered with Micron to boost the performance of LLMs using Compute Express Link (CXL) technology.  The company’s Memory Machine software uses CXL to reduce idle time in GPUs caused by memory loading. The technology was demonstrated at Micron’s booth at Nvidia … Read more

Is the AI GPU the new mainframe? New open source tech allows users to ‘timeshare’ GPU resources for AI purposes for free — reminiscent of the days where scarce resources fosted computing elitism

by

[ad_1] Without an efficient way to squeeze additional computing power from existing infrastructure, organizations are often forced to purchase additional hardware or delay projects. This can lead to longer wait times for results and potentially losing out to competitors. This problem is compounded by the rise of AI workloads which require a high GPU compute … Read more

Meta sheds more light on how it is evolving Llama 3 training — it relies for now on almost 50,000 Nvidia H100 GPU, but how long before Meta switches to its own AI chip?

by

[ad_1] Meta has unveiled details about its AI training infrastructure, revealing that it currently relies on almost 50,000 Nvidia H100 GPUs to train its open source Llama 3 LLM.  The company says it will have over 350,000 Nvidia H100 GPUs in service by the end of 2024, and the computing power equivalent to nearly 600,000 … Read more

AMD’s FSR 3.1 promises improved image quality – with less flickering, better motion – and a trick that’ll delight some Nvidia GPU owners

by

[ad_1] AMD has announced its next-gen upscaling box of tricks to make frame rates smoother with PC games at GDC 2024. This is FSR 3.1, and it sounds like a big step forward – and not just for the quality of the upscaling tech, since there’s a surprise in tow for Nvidia (and Intel Arc) … Read more

TikTok owner is quietly doing an ‘Apple’ — ByteDance invests in Chinese memory pioneer, months after a similar move in a GPU vendor, as it plans for an Apple Vision Pro VR rival

by

[ad_1] TikTok’s parent company ByteDance has reportedly quietly invested in Xinyuan Semiconductors, a Chinese memory chip manufacturer.  A report from Pandaily, a tech media site based in Beijing, the move reportedly positions ByteDance as the third-largest shareholder in the chip maker, holding an indirect stake of 9.5%. A ByteDance spokesperson confirmed this previously undisclosed investment … Read more

AI chip built using ancient Samsung tech is claimed to be as fast as Nvidia A100 GPU — prototype is smaller and much more power efficient but is it just too good to be true?

by

[ad_1] Scientists from the Korea Advanced Institute of Science and Technology (KAIST) have unveiled an AI chip that they claim can match the speed of Nvidia‘s A100 GPU but with a smaller size and significantly lower power consumption. The chip was developed using Samsung‘s 28-nanometer manufacturing process, a technology considered relatively old in the fast-moving … Read more

‘A single chip to outperform a small GPU data center’: Yet another AI chip firm wants to challenge Nvidia’s GPU-centric world — Taalas wants to have super specialized AI chips

by

[ad_1] Toronto-based AI chip startup Taalas has emerged from stealth with $50 million in funding and the lofty aim of revolutionizing the GPU-centric world dominated by Nvidia. Founded by Ljubisa Bajic, Lejla Bajic, and Drago Ignjatovic, all previously from Tenstorrent (the creator of Grayskull), Taalas is developing an automated flow for quickly turning any AI model … Read more

NVIDIA’s AI personal assistant demo available for RTX GPU PCs

by

NVIDIA has recently unveiled a new technology demonstration that is set to enhance the way we interact with artificial intelligence. This new feature, known as “Chat With RTX,” is designed to work seamlessly on Windows RTX PCs, leveraging the power of NVIDIA RTX GPUs to deliver a personalized and efficient chatbot experience. The technology is … Read more