Categories
Featured

AMD RX 7900 GRE gets a free performance boost – is this now the best mid-range GPU you can buy?

[ad_1]

AMD’s RX 7900 GRE became available to buy in the US (and elsewhere) last month, but with an odd catch on the performance front – the good news being that this hiccup related to overclocking the GPU has now been cured.

If you’ve been following the somewhat curious tale of the global launch of the RX 7900 GRE – the ‘Golden Rabbit Edition’ graphics card that was initially exclusive to China – you may recall it was artificially limited to 2.3GHz for the memory clock speed by a bug, as confirmed by AMD. Apparently, this was an issue with an incorrect memory tuning limit.

[ad_2]

Source Article Link

Categories
Featured

Startup claims to boost LLM performance using standard memory instead of GPU HBM — but experts remain unconvinced by the numbers despite promising CXL technology

[ad_1]

MemVerge, a provider of software designed to accelerate and optimize data-intensive applications, has partnered with Micron to boost the performance of LLMs using Compute Express Link (CXL) technology. 

The company’s Memory Machine software uses CXL to reduce idle time in GPUs caused by memory loading.

[ad_2]

Source Article Link

Categories
Featured

Is the AI GPU the new mainframe? New open source tech allows users to ‘timeshare’ GPU resources for AI purposes for free — reminiscent of the days where scarce resources fosted computing elitism

[ad_1]

Without an efficient way to squeeze additional computing power from existing infrastructure, organizations are often forced to purchase additional hardware or delay projects. This can lead to longer wait times for results and potentially losing out to competitors. This problem is compounded by the rise of AI workloads which require a high GPU compute load.

ClearML has come up with what it thinks is the perfect solution to this problem –  fractional GPU capability for open source users, making it possible to “split” a single GPU so it can run multiple AI tasks simultaneously.

[ad_2]

Source Article Link

Categories
Featured

Meta sheds more light on how it is evolving Llama 3 training — it relies for now on almost 50,000 Nvidia H100 GPU, but how long before Meta switches to its own AI chip?

[ad_1]

Meta has unveiled details about its AI training infrastructure, revealing that it currently relies on almost 50,000 Nvidia H100 GPUs to train its open source Llama 3 LLM. 

The company says it will have over 350,000 Nvidia H100 GPUs in service by the end of 2024, and the computing power equivalent to nearly 600,000 H100s when combined with hardware from other sources.

[ad_2]

Source Article Link

Categories
Featured

AMD’s FSR 3.1 promises improved image quality – with less flickering, better motion – and a trick that’ll delight some Nvidia GPU owners

[ad_1]

AMD has announced its next-gen upscaling box of tricks to make frame rates smoother with PC games at GDC 2024.

This is FSR 3.1, and it sounds like a big step forward – and not just for the quality of the upscaling tech, since there’s a surprise in tow for Nvidia (and Intel Arc) GPU owners.

[ad_2]

Source Article Link

Categories
Featured

TikTok owner is quietly doing an ‘Apple’ — ByteDance invests in Chinese memory pioneer, months after a similar move in a GPU vendor, as it plans for an Apple Vision Pro VR rival

[ad_1]

TikTok’s parent company ByteDance has reportedly quietly invested in Xinyuan Semiconductors, a Chinese memory chip manufacturer. 

A report from Pandaily, a tech media site based in Beijing, the move reportedly positions ByteDance as the third-largest shareholder in the chip maker, holding an indirect stake of 9.5%.

[ad_2]

Source Article Link

Categories
Featured

AI chip built using ancient Samsung tech is claimed to be as fast as Nvidia A100 GPU — prototype is smaller and much more power efficient but is it just too good to be true?

[ad_1]

Scientists from the Korea Advanced Institute of Science and Technology (KAIST) have unveiled an AI chip that they claim can match the speed of Nvidia‘s A100 GPU but with a smaller size and significantly lower power consumption. The chip was developed using Samsung‘s 28-nanometer manufacturing process, a technology considered relatively old in the fast-moving world of semiconductors.

The team, led by Professor Yoo Hoi-jun at KAIST’s processing-in-memory research center, has developed what it says is the world’s first ‘Complementary-Transformer’ (C-Transformer) AI chip. This neuromorphic computing system mimics the structure and workings of the human brain, using a deep learning model often employed in visual data processing.

[ad_2]

Source Article Link

Categories
Featured

‘A single chip to outperform a small GPU data center’: Yet another AI chip firm wants to challenge Nvidia’s GPU-centric world — Taalas wants to have super specialized AI chips

[ad_1]

Toronto-based AI chip startup Taalas has emerged from stealth with $50 million in funding and the lofty aim of revolutionizing the GPU-centric world dominated by Nvidia.

Founded by Ljubisa Bajic, Lejla Bajic, and Drago Ignjatovic, all previously from Tenstorrent (the creator of Grayskull), Taalas is developing an automated flow for quickly turning any AI model – Transformers, SSMs, Diffusers, MoEs, etc. – into custom silicon. The company claims that the resulting Hardcore Models are 1000x more efficient than their software counterparts.

[ad_2]

Source Article Link

Categories
News

NVIDIA’s AI personal assistant demo available for RTX GPU PCs

NVIDIA RTX AI PCs Chat Bot Demo

NVIDIA has recently unveiled a new technology demonstration that is set to enhance the way we interact with artificial intelligence. This new feature, known as “Chat With RTX,” is designed to work seamlessly on Windows RTX PCs, leveraging the power of NVIDIA RTX GPUs to deliver a personalized and efficient chatbot experience. The technology is aimed at providing users with quick, secure, and contextually relevant responses, drawing from their own documents and notes to ensure a private and customized interaction.

At the heart of “Chat With RTX” lies a sophisticated GPT large language model that is capable of tailoring conversations to the user’s specific needs. This is not your average chatbot; it’s an intelligent system that can process a variety of file types, including text documents, PDFs, Word documents, XML files, and even transcriptions from YouTube videos. This versatility allows the chatbot to provide assistance that is highly relevant to the user’s personal content.

NVIDIA RTX AI PCs Chat Bot Demo

One of the key features of NVIDIA’s new tech demo is the use of retrieval-augmented generation (RAG), which significantly enhances the quality of the chatbot’s responses. In addition, the demo incorporates TensorRT-LLM, a tool for optimizing large language models, ensuring that the chatbot operates at peak efficiency. Thanks to RTX acceleration, the chatbot is not only accurate but also incredibly fast, running directly on a user’s Windows RTX PC without the need for cloud processing.

Developers, in particular, may find “Chat With RTX” intriguing as it builds upon the TensorRT-LLM RAG developer reference project available on GitHub. This provides them with a valuable opportunity to explore advanced AI models and potentially integrate similar technologies into their own projects.

 

For those interested in experiencing “Chat With RTX,” there are certain system requirements that must be met. The user’s PC should be equipped with a GeForce RTX 30 Series GPU or a more advanced model, with a minimum of 8GB of VRAM. Additionally, the PC must be running either Windows 10 or 11 and have the latest NVIDIA drivers installed to ensure compatibility with the demo.

NVIDIA has acknowledged a current installation issue with “Chat With RTX” and has promised to resolve it in a forthcoming update. In the meantime, users are advised to install the application in the default directory to avoid any complications.

Furthermore, NVIDIA is encouraging developers to push the boundaries of generative AI by hosting a contest. Participants are invited to create innovative applications using NVIDIA RTX GPUs, with the chance to win prizes. This contest not only stimulates creativity within the developer community but also showcases the potential of NVIDIA’s technology in driving forward AI applications.

The introduction of “Chat With RTX” is a testament to NVIDIA’s ongoing efforts to advance AI and GPU technology. By focusing on high-performance computing and data privacy, NVIDIA is making it possible to integrate sophisticated AI capabilities into everyday tasks. This technology allows users to benefit from a smart, responsive, and personalized AI assistant, all while keeping their data securely processed on their local machine. As NVIDIA continues to innovate and address any initial teething problems, “Chat With RTX” is poised to become an essential tool for those seeking a more intelligent and responsive computing experience.

Filed Under: Technology News, Top News





Latest timeswonderful Deals

Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, timeswonderful may earn an affiliate commission. Learn about our Disclosure Policy.

Categories
News

NVIDIA NVIDIA RTX 2000 Ada Generation GPU

NVIDIA NVIDIA RTX 2000 Ada Generation GPU

NVIDIA has just unveiled a new graphics card that’s set to transform the way professionals work across various industries. The RTX 2000 Ada Generation GPU is not just an upgrade; it’s a leap forward, offering up to 50% more performance than its predecessor, the RTX A2000 12 GB. This new card is designed to fit into compact workstations, yet it packs a punch with 16 GB of memory, making it more than capable of handling complex tasks and managing high-resolution content with ease. The NVIDIA RTX 2000 Ada features the latest technologies in the NVIDIA Ada Lovelace GPU architecture, including:

  • Third-generation RT Cores: Up to 1.7x faster ray tracing performance for high-fidelity, photorealistic rendering.
  • Fourth-generation Tensor Cores: Up to 1.8x AI throughput over the previous generation, with structured sparsity and FP8 precision to enable higher inference performance for AI-accelerated tools and applications.
  • CUDA cores: Up to 1.5x the FP32 throughput of the previous generation for significant performance improvements in graphics and compute workloads.
  • Power efficiency: Up to a 2x performance boost across professional graphics, rendering, AI and compute workloads, all within the same 70 W of power as the previous generation.
  • Immersive workflows: Up to 3x performance for virtual-reality workflows over the previous generation.
  • 16 GB of GPU memory: An expanded canvas enables users to tackle larger projects, along with support for error correction code memory to deliver greater computing accuracy and reliability for mission-critical applications.
  • DLSS 3: Delivers a breakthrough in AI-powered graphics, significantly boosting performance by generating additional high-quality frames.
  • AV1 encoder: Eighth-generation NVIDIA Encoder, aka NVENC, with AV1 support is 40% more efficient than H.264, enabling new possibilities for broadcasters, streamers and video callers.

Professionals from all walks of life, including architects, engineers, and content creators, stand to benefit from the RTX 2000 Ada’s enhanced capabilities. For those in architecture and urban planning, the GPU accelerates visualization and structural analysis, making it easier to bring projects to life. Product designers and engineers will appreciate the ability to iterate designs more quickly, streamlining the development process. Content creators, on the other hand, will enjoy smooth editing experiences, even when dealing with high-resolution videos and images. The GPU also supports real-time data processing, which is essential for industries that rely on AI-driven intelligence, such as medical devices, manufacturing, and retail.

NVIDIA NVIDIA RTX 2000

In the realm of virtual reality, the RTX 2000 Ada stands out with its robust support for immersive graphics. It utilizes NVIDIA’s DLSS and ray-tracing technologies to create incredibly realistic images, enhancing enterprise workflows in VR and providing users with an experience that’s closer to reality than ever before.

The technological innovations in the RTX 2000 Ada are impressive. It features third-generation RT Cores for quicker ray tracing, fourth-generation Tensor Cores for enhanced AI throughput, and improved CUDA cores for handling both graphics and compute workloads efficiently. Despite these advancements, the GPU remains power-efficient, delivering twice the performance within a 70 W power envelope. It also includes DLSS 3 technology for AI-powered graphics enhancement and an AV1 encoder, which optimizes video streaming and calling.

NVIDIA NVIDIA RTX 2000 features

 

The feedback from early adopters of the RTX 2000 Ada has been overwhelmingly positive. Companies like Dassault Systèmes, Rob Wolkers Design and Engineering, and WSP have already experienced the GPU’s exceptional performance, versatility, and large memory capacity. These attributes are essential for managing the complex tasks that professionals encounter daily.

NVIDIA ensures that users of the RTX 2000 Ada have the support they need with the latest RTX Enterprise Driver. This driver introduces new features such as Video TrueHDR and Video Super Resolution, enhancing the overall user experience. The GPU is available globally through distribution partners and will be included in systems from major manufacturers like Dell Technologies, HP, and Lenovo starting in April.

Specifications

NVIDIA NVIDIA RTX 2000 specifications

The release of the NVIDIA RTX 2000 Ada Generation GPU is a significant event for professionals who rely on powerful graphics processing. It’s a versatile tool that caters to a wide range of industries and workflows, reflecting NVIDIA’s commitment to pushing the boundaries of graphics technology. For more information on full specifications jump over to the official NVIDIA product page.

Filed Under: Technology News, Top News





Latest timeswonderful Deals

Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, timeswonderful may earn an affiliate commission. Learn about our Disclosure Policy.