Tag: NVIDIA

‘The fastest AI chip in the world’: Gigantic AI CPU has almost one million cores — Cerebras has Nvidia firmily in its sights as it unveils the WSE-3, a chip that can train AI models with 24 trillion parameters

Post author By lisa nichols
Post date March 16, 2024
No Comments on ‘The fastest AI chip in the world’: Gigantic AI CPU has almost one million cores — Cerebras has Nvidia firmily in its sights as it unveils the WSE-3, a chip that can train AI models with 24 trillion parameters

[ad_1]

Cerebras Systems has unveiled its Wafer Scale Engine 3 (WSE-3), dubbed the “fastest AI chip in the world.”

The WSE-3, which powers the Cerebras CS-3 AI supercomputer, reportedly offers twice the performance of its predecessor, the WSE-2, at the same power consumption and price.

The chip is capable of training AI models with up to 24 trillion parameters, a significant leap from previous models.

CS-3 supercomputer

The WSE-3 is built on a 5nm TSMC process and features 44GB on-chip SRAM. It boasts four trillion transistors and 900,000 AI-optimized compute cores, delivering a peak AI performance of 125 petaflops – that’s the theoretical equivalent to about 62 Nvidia H100 GPUs.

The CS-3 supercomputer, powered by the WSE-3, is designed to train next-generation AI models that are 10 times larger than GPT-4 and Gemini. With a memory system of up to 1.2 petabytes, it can reportedly store 24 trillion parameter models in a single logical memory space, simplifying training workflow and boosting developer productivity.

Cerebras says its CS-3 supercomputer is optimized for both enterprise and hyperscale needs, and it offers superior power efficiency and software simplicity, requiring 97% less code than GPUs for large language models (LLMs).

Cerebras CEO and co-founder, Andrew Feldman, said, “WSE-3 is the fastest AI chip in the world, purpose-built for the latest cutting-edge AI work, from mixture of experts to 24 trillion parameter models. We are thrilled for bring WSE-3 and CS-3 to market to help solve today’s biggest AI challenges.”

The company says it already has a backlog of orders for the CS-3 across enterprise, government, and international clouds. The CS-3 will also play a significant role in the strategic partnership between Cerebras and G42, which has already delivered 8 exaFLOPs of AI supercomputer performance via Condor Galaxy 1 and 2. A third installation, Condor Galaxy 3, is currently under construction and will be built with 64 CS-3 systems, producing 8 exaFLOPs of AI compute.

AI chip built using ancient Samsung tech is claimed to be as fast as Nvidia A100 GPU — prototype is smaller and much more power efficient but is it just too good to be true?

[ad_1]

Scientists from the Korea Advanced Institute of Science and Technology (KAIST) have unveiled an AI chip that they claim can match the speed of Nvidia‘s A100 GPU but with a smaller size and significantly lower power consumption. The chip was developed using Samsung‘s 28-nanometer manufacturing process, a technology considered relatively old in the fast-moving world of semiconductors.

The team, led by Professor Yoo Hoi-jun at KAIST’s processing-in-memory research center, has developed what it says is the world’s first ‘Complementary-Transformer’ (C-Transformer) AI chip. This neuromorphic computing system mimics the structure and workings of the human brain, using a deep learning model often employed in visual data processing.

“Neuromorphic computing is a technology that even companies like IBM and Intel have not been able to implement, and we are proud to be the first in the world to run the LLM with a low-power neuromorphic accelerator,” Yoo said.

Questions remain

This technology learns context and meaning by tracking relationships within data, such as words in a sentence, which is a key technology for generative AI services like ChatGPT.

During a demonstration at the ICT ministry’s headquarters, team member Kim Sang-yeob showcased the chip’s capabilities. On a laptop equipped with the chip he performed tasks such as Q&A sessions, sentence summation, and translations using OpenAI‘s LLM, GPT-2. The tasks were completed at least three times faster and, in some cases, up to nine times faster than when running GPT-2 on an internet-connected laptop.

Implementing LLMs in generative AI tasks typically requires numerous GPUs and 250 watts of power, but the team claims their semiconductor uses only 1/625 of the power of Nvidia’s GPU for the same tasks. In addition, because it is also 1/41 of the size, measuring just 4.5mm by 4.5mm, it could ultimately be used in devices like mobile phones.

Whether the chip can deliver on its promises in real-world applications remains to be seen, however. As Tom’s Hardware reports, “Though we are told that the KAIST C-Transformer chip can do the same LLM processing tasks as one of Nvidia’s beefy A100 GPUs, none of the press nor conference materials we have provided any direct comparative performance metrics. That’s a significant statistic, conspicuous by its absence, and the cynical would probably surmise that a performance comparison doesn’t do the C-Transformer any favors.“

Ridiculously powerful PC with six Nvidia RTX 4090 GPUs and liquid cooling finally gets tested — there’s no game benchmarks, but plenty of tests for scientists and pros

[ad_1]

Comino, known for its liquid-cooled servers, has finally released its new flagship for testing.

The Comino Grando Server has been designed to meet a broad spectrum of high-performance computing needs, ranging from data analytics to gaming.

In a comprehensive test by StorageReview, the Grando Server, alongside a Grando Workstation variation, was put through a series of rigorous benchmarks including Blender 4.0, Luxmark, OctaneBench, Blackmagic RAW Speed Test, 7-zip Compression, and Y-Cruncher.

The server, equipped with six Nvidia RTX 4090s, AMD‘s Threadripper PRO 5995WX CPU, 512GB DDR5 DRAM, a 2TB NVMe SSD, and four 1600W PSUs, delivered impressive results, as you’d expect from those specifications.

Grando Server features advanced liquid cooling, allowing it to accommodate those six Nvidia 4090 GPUs side by side, a setup that Lyle Smith from StorageReview noted would be impossible with air cooling.

GPU-driven performance systems done right

The main difference between the Grando Server and Grando Workstation lies in their GPU and CPU capabilities. With its higher core count, the Server model is well-suited for parallel processing tasks. While still powerful, the Workstation offers fewer cores and is better suited for balanced performance across various applications.

The Grando Workstation that Smith tested featured four Nvidia A100 professional GPUs, a Threadripper Pro 3975WX processor, 512GB DDR5 DRAM, and a 2TB NVMe SSD.

In his review, Smith found the Comino Grando Server and Workstation to be “prime examples of GPU-driven performance systems done right.”

He said, “Performance-wise, the benchmark results paint a clear picture: the Grando Server excels in GPU-intensive tests like OctaneBench and Blender 4.0, highlighting its capability to breeze through high-end rendering jobs. With its tailored CPU-GPU balance, the Workstation version offers versatility for various professional applications. The speed and efficiency of both systems in managing large datasets, as evidenced by the 7-zip Compression and Y-Cruncher benchmarks, underscore their capacity for handling data-intensive operations, a critical advantage in today’s data-driven landscape.”

StorageReview approved of the Comino Grando systems so much that it rated them one of its “Best of 2024” award winners.

Samsung’s biggest memory rivals are plotting a tie-up with Kafkaesque implications — SK Hynix and Kioxia could build lucrative HBM chips for Nvidia, AMD and others

[ad_1]

South Korean chipmaker SK Hynix, a key Nvidia supplier, says it has already sold out of its entire 2024 production of stacked high-bandwidth memory DRAMs, crucial for AI processors in data centers. That’s a problem, given just how in demand HBM chips are right now.

However, a solution might have presented itself, as reports say SK Hynix is in talks with Japanese firm Kioxia Holdings to jointly produce HBM chips.

SK Hynix, the world’s second-largest memory chipmaker, is a major shareholder of Kioxia, the world’s No. 2 NAND flash manufacturer, and if the deal goes ahead, it could see the high-performance chips being produced at facilities co-operated by Kioxia and US-based Western Digital Corp. in Japan.

A merger hangs in the balance

What makes this situation even more interesting is Kioxia and Western Digital have been engaged in merger talks, something that SK Hynix is opposed to over fears this would reduce its opportunities with Kioxia. As SK Hynix is a major shareholder in Kioxia, the Japanese firm and Western Digital’s merger can’t go ahead without its blessing, and this new move could be seen as an important sweetener to help things progress.

After the news of the potential deal broke, SK Hynix issued a statement saying simply, “There is no change in our stance that if there is a collaboration opportunity, we will enter into discussion on that matter.”

If the merger between Kioxia and Western Digital does proceed, it will make the company potentially the biggest manufacturer of NAND memory on the planet, leapfrogging current leader Samsung, so there’s a lot to play for.

The Korea Economic Daily says of the move, “The partnership is expected to cement SK Hynix’s leadership in the HBM segment, which it almost evenly splits with Samsung Electronics. Kioxia will likely transform NAND flash lines into those for HBMs, used for generative AI applications, high-performance data centers and machine learning platforms, contributing to a revival in Japan’s semiconductor market.”

Nvidia RTX 5090 could have up to 77% more memory than 4090, a win for gamers

Post author By lisa nichols
Post date March 12, 2024
No Comments on Nvidia RTX 5090 could have up to 77% more memory than 4090, a win for gamers

[ad_1]

The Nvidia GeForce RTX 5090 has long since been a hot topic in the tech rumor mill as possibly the best graphics card in the future market, with the latest ones revealing even more information about its memory specifications.

According to well-known and reliable Twitter hardware leaker Kopite7kimi, the RTX 5090 will feature a 512-bit memory bus that is 33% wider than the one on Nvidia’s RTX 4090. This would allow for higher levels of memory bandwidth and increased GPU memory capabilities. It could even have 32GB of VRAM thanks to its two 16GB GDDR modules.

There’s also a report that the RTX 5090 will have 28Gbps GDDR7 memory modules, 33% faster than the 21Gbps memory modules in the RTX 4090. But what’s most impressive is the memory bandwidth for the alleged card, an apparent 77% boost compared to the 4090 that would give it 1,800 GB/s of memory bandwidth. This checks out with a previous rumor stating that the card would be up to 70% faster than the 4090.

If this RTX 5090 turns out to be true, the specs would be absolutely mind-blowing and would nearly justify what would certainly be a massive price hike compared to current-gen Nvidia cards.

The RTX 5090 could be in trouble

What’s interesting is that other memory producers have been promoting 32Gbps GDDR7 modules, meaning that if these rumors are true then Nvidia is purposefully slowing down the graphics cards to reduce costs and increase yields. But thanks to the Super series refresh of Nvidia cards, we could possibly see an updated version without these restrictions.

However, there seems to be one major caveat, which is the release date. It seems that Nvidia’s 5090 will be released in 2025, meaning that the rumored Nvidia RTX 4090 Super and RTX Titan would have to keep Team Green’s lead until then. A prospect made much more difficult by AMD.

Team Red is prepping its own comeback with the mid-range RDNA 4 graphics cards, which are shaping up to be Nvidia RTX 4080 and 4060 Ti killers. Of course, it’s possible for it to also be released in 2025, but if it comes out before Team Green’s RTX 5000-series then Team Red will still have a major advantage.

We’ll have to wait and see what happens, but regardless we’re sure to have some great competition in the graphics cards market.

[ad_2]

Source Article Link

Tags gamers, memory, NVIDIA, RTX, Win

News

NVIDIA reveals the AI Tools, Software and hardware

Post author By miranda cosgrove
Post date March 7, 2024
No Comments on NVIDIA reveals the AI Tools, Software and hardware

[ad_1]

NVIDIA reveals the AI Tools Software and hardware

NVIDIA explains more about the evolution of AI computing, particularly highlighting NVIDIA’s role with its RTX technologies and GPUs in fostering a growing ecosystem of AI applications and users. Explaining the basics of AI, its transformative potential, and the emergence of generative AI for content creation. As well as detailing how AI is integrated into various sectors, including gaming, creative industries, and software development, and how NVIDIA’s hardware and software solutions are enhancing these applications.

AI is all about giving machines the ability to do things that would normally need a human touch—like recognizing speech or making sense of a photo. These tasks are becoming faster and more efficient, and it’s largely because of the tech that companies like NVIDIA are developing. They’ve got these things called GPUs, which are like supercharged engines for computers, and they’re making AI smarter and quicker than ever before.

GeForce RTX AI PCs and NVIDIA RTX Workstations

AI PCs are computers with dedicated hardware designed to help AI run faster. It’s the difference between sitting around waiting for a 3D image to load, and seeing it update instantaneously with an AI denoiser.

Now, let’s talk about something really cool: generative AI. This is where AI gets creative, making brand new things without any human help. It could be writing a story, designing a graphic, or even coming up with a melody for a song. This is possible because of the sheer power of NVIDIA’s GPUs. They measure this power in teraops, and the higher the number, the smarter the AI.

But it’s not just about big servers and cloud computing. NVIDIA is also making AI personal. They’re putting their tech into everyday PCs, so you can have AI right at your fingertips. This means better privacy and no waiting around for data to bounce back from some far-off server. It’s all happening right there on your own computer.

For gamers, this is a big deal. NVIDIA’s tech is making games look and play better than ever. They’ve got this thing called DLSS, and it’s like a magic wand for gaming graphics. It makes everything smoother and more lifelike, so when you’re exploring a virtual world, it feels like you’re really there.

Content creators, like video editors and graphic designers, are getting a huge helping hand from AI, too. Software they use every day is getting smarter, making their jobs easier and letting them do things that used to be impossible. NVIDIA is right there with them, offering tools that make sure software can make the most of AI. This means creators can spend less time on the boring stuff and more time being creative.

Here are some other articles you may find of interest on the subject of NVIDIA AI

So, what does all this mean for you and me? NVIDIA’s tech is changing the game. It’s not just about making things faster or more efficient; it’s about opening up a whole new world of possibilities. We’re talking about AI that can help us create, learn, and explore in ways we’ve never imagined. And as we keep pushing the limits of what AI can do, NVIDIA’s innovations are going to be right there, making sure we can all get a piece of the action.

Now, you might be wondering, “What’s next?” Well, that’s the exciting part. We’re just scratching the surface of what AI can do. Every day, there are new breakthroughs, new ideas, and new ways that AI is fitting into our lives. And with NVIDIA’s technology, we’re ready for it. They’re not just keeping up; they’re setting the pace, making sure that the future of AI is bright, exciting, and, most importantly, within our reach.

So, the next time you’re playing a game that looks almost too real, or you’re using software that seems to read your mind, remember that there’s some serious tech under the hood. NVIDIA’s GPUs and AI innovations are working behind the scenes, making it all happen. They’re the unsung heroes of our digital age, powering the AI revolution and bringing the future to our doorstep. And as we continue to explore the vast potential of AI, it’s clear that NVIDIA’s role isn’t just important; it’s essential. They’re the ones helping us turn the page, ready to see what wonders the next chapter of technology holds.

Image Credit : NVIDIA

Filed Under: Technology News, Top News

Latest Geeky Gadgets Deals

Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, Geeky Gadgets may earn an affiliate commission. Learn about our Disclosure Policy.

[ad_2]

Source Article Link

Tags hardware, NVIDIA, reveals, Software, tools

News

Inside NVIDIA HQ the offices of a $2 Trillion company explored

Post author By miranda cosgrove
Post date March 2, 2024
No Comments on Inside NVIDIA HQ the offices of a $2 Trillion company explored

Inside NVIDIA HQ the offices of a $2 Trillion company explored

Imagine stepping into a workspace that’s not just an office but a hub of innovation, where the design itself inspires creativity and collaboration. That’s what you’ll find at NVIDIA’s headquarters in the bustling tech epicenter of Silicon Valley. The Santa Clara, California campus, with its two main buildings, Endeavor and Voyager inspired by Star Trek, covers a vast area of 1.25 million square feet and is a reflection of NVIDIA’s pioneering spirit in the tech industry.

Inside NVIDIA HQ Offices outside

As you walk through the doors of this impressive campus, you’ll notice how the company has harnessed the power of natural light. NVIDIA has used its own cutting-edge visualization tools to create an environment that maximizes sunlight, reducing the need for artificial lighting and enhancing the well-being of its employees. The office space is bathed in light filtered through 511 triangular skylights, a clever design choice that not only illuminates but also showcases NVIDIA’s flair for innovation.

NVIDIA Offices

Architectural designs inspired by NVIDIA’s chips and the company’s focus on 3D graphics, with a recurring triangle motif.
The campus includes two buildings named Endeavor and Voyager, with Star Trek-inspired names and an outdoor park connecting them.
Endeavor and Voyager buildings, offer 500,000 and 750,000 square feet respectively.
The “Heart” of Endeavor and the “Mountain” in Voyager, central areas designed to encourage interaction and provide active spaces like reception, conference rooms, and coffee breaks.
Open office layouts in both buildings to enhance collaboration among the approximately 5,000 employees, with acoustical design features to manage noise.
An emphasis on visual connections to facilitate quick iteration and deeper relationships, supported by findings from an MIT study.
Numerous staircases and strategically placed elevators to promote movement and encounters among staff.
Efficient pathways and shortcuts, including a two-minute connection between the two buildings.
511 triangular skylights to control lighting, with certain areas like the center of the mountain intentionally shielded from daylight to accommodate lab spaces.
Integration of greenery, including an 80-foot living wall in Endeavor and over 14,000 plants in Voyager, to balance the technological environment.
NVIDIA hints at the potential for future expansion and the use of AI in the design and construction of additional buildings.

Guided tour of NVIDIA’s HQ workspaces

The architecture of the headquarters is a nod to NVIDIA’s heritage in 3D graphics. Triangles, the fundamental element of 3D rendering, are a recurring motif throughout the campus. This design choice is not just about aesthetics; it’s a constant visual stimulus for the staff, reminding them of the core products that have shaped the company’s success.

Here are some other articles you may find of interest on the subject of NVIDIA technology :

The layout of the Endeavor and Voyager buildings is open and airy, designed to bring together the 5,000 employees who work there. This openness is complemented by acoustical design elements that strike the perfect balance between the lively energy of teamwork and the need for individual focus and quiet.

One of the most striking features of the design is the emphasis on visual connections. Central areas like the “heart” of Endeavor and the “mountain” in Voyager serve as communal hubs. These spaces are more than just meeting points; they’re strategic areas that encourage quick exchanges of ideas and foster strong relationships among colleagues, echoing findings from MIT on the importance of such interactions.

The headquarters is built to encourage movement and chance meetings. With staircases and elevators strategically placed to connect different areas, the campus is designed for dynamic interaction. A quick two-minute walk is all it takes to move between the two main buildings, underscoring the company’s focus on a vibrant, collaborative work environment.

But it’s not all about technology and design. Greenery is an essential part of the NVIDIA campus. The Endeavor building features an 80-foot living wall, and Voyager is adorned with over 14,000 plants. These natural elements provide a serene counterbalance to the high-tech surroundings, offering employees a place to recharge and find inspiration away from their screens.

NVIDIA isn’t stopping here. The company is looking to the future, planning to incorporate AI into the design and construction of its next buildings. This forward-thinking approach shows NVIDIA’s dedication to using its own technologies to push the boundaries of workplace design.

The NVIDIA headquarters stands as a space that not only optimizes work conditions but also nurtures a culture of collaboration and well-being. By integrating its advanced technology into every aspect of its office design, NVIDIA has crafted a work environment that goes beyond the conventional, creating a place where innovation is not just developed but lived and breathed by its workforce.

Image Credit : NVIDIA and Gensler Jason O’Rear Photography

Filed Under: Technology News, Top News

Latest timeswonderful Deals

Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, timeswonderful may earn an affiliate commission. Learn about our Disclosure Policy.

Tags company, Explored, NVIDIA, offices, trillion

News

NVIDIA RTX 500 and 1000 Pro Ada Generation laptop GPUs

Post author By miranda cosgrove
Post date February 28, 2024
No Comments on NVIDIA RTX 500 and 1000 Pro Ada Generation laptop GPUs

NVIDIA RTX Ada Generation Laptop GPUs

NVIDIA has unveiled its latest advancements in graphics processing technology with the introduction of the RTX 500 and 1000 Ada Generation GPUs for laptops. This development is set to make waves among professionals who rely on high-powered computing for tasks such as AI generation, graphic design, and video editing. These new GPUs are tailored to boost productivity and performance, especially in the increasingly common hybrid work environments.

The new RTX 500 and 1000 GPUs are built on NVIDIA’s Ada Lovelace architecture, which is designed to meet the high demands of industry professionals. This architecture includes an NPU and Tensor Cores, which are essential for AI acceleration. This feature is particularly important for handling complex AI tasks more efficiently.

Professionals working with generative AI will find the RTX 500 GPU to be a significant upgrade, offering a performance increase of up to 14 times, which greatly speeds up the creative process and delivers faster results. For those involved in photo editing, the GPU’s capabilities can triple the speed of AI-powered enhancements, making it a valuable tool for improving workflow. Additionally, 3D rendering tasks can be completed up to ten times faster compared to traditional CPU-only setups, which is a major leap forward for professionals in this field.

NVIDIA RTX Ada Generation Laptop GPUs

The RTX 500 and 1000 GPUs are not just about raw performance; they are also designed with specific professional applications in mind. They are particularly effective for high-quality video conferencing and streaming, which is beneficial for video editors and graphic designers. These GPUs are also capable of handling advanced rendering, data science, and deep learning tasks with ease.

NVIDIA’s progress is further emphasized by the inclusion of third-generation RT Cores, fourth-generation Tensor Cores, and Ada Generation CUDA cores in these GPUs. These components work together to improve ray tracing, deep learning, and overall graphics performance. Additional features such as dedicated GPU memory, DLSS 3 for enhanced image quality, and an AV1 encoder for more efficient video compression are crucial for tasks like streaming and video conferencing.

Recognizing the need for portability in today’s professional world, NVIDIA has made sure that these new GPUs are integrated into sleek, lightweight laptops. This ensures that professionals can enjoy top-tier performance without being tied down to a desk, making these laptops perfect for those who are always on the move.

Revolutionizing Mobile Graphics with NVIDIA’s RTX 500 and 1000 GPUs

The RTX 500 and 1000 GPUs are set to be available in the spring, with offerings from leading manufacturers such as Dell Technologies, HP, Lenovo, and MSI. NVIDIA’s latest launch is poised to meet the needs of tech-savvy professionals who are looking to enhance their work efficiency and creative capabilities. With these new GPUs, NVIDIA continues to push the boundaries of what’s possible in mobile computing, providing powerful tools for a wide range of professional applications.

NVIDIA’s introduction of the RTX 500 and 1000 Ada Generation GPUs for laptops marks a significant leap in graphics processing technology. These GPUs are engineered to cater to the needs of professionals who demand high-powered computing for a variety of tasks, including AI generation, graphic design, and video editing. The integration of these GPUs into laptops is poised to enhance productivity and performance significantly, particularly for those who operate in flexible work settings that blend in-office and remote work.

The Ada Lovelace architecture at the core of the RTX 500 and 1000 GPUs is a cutting-edge design that addresses the intensive requirements of industry professionals. It incorporates an NPU (Neural Processing Unit) and Tensor Cores, which are pivotal for AI acceleration. These components are specifically designed to manage complex AI-driven tasks with greater efficiency, offering a substantial improvement over previous generations.

Unleashing Creativity with Enhanced AI and Rendering Capabilities

For those engaged in generative AI projects, the RTX 500 GPU represents a significant advancement, delivering a performance boost that can reach up to 14 times that of earlier models. This enhancement dramatically accelerates the creative process and yields quicker outcomes. In the realm of photo editing, the GPU’s prowess in AI-powered enhancements can triple processing speeds, streamlining workflows for professionals. Furthermore, 3D rendering tasks can be executed up to ten times faster than with conventional CPU-based systems, representing a substantial stride in efficiency for those specializing in 3D graphics.

The RTX 500 and 1000 GPUs are engineered not only for sheer performance but also for specific professional use cases. They excel in applications that require high-quality video conferencing and streaming, which is advantageous for video editors and graphic designers. These GPUs are adept at managing complex tasks such as advanced rendering, data science, and deep learning, making them versatile tools for a wide array of professional applications.

Advanced Cores and Features for Optimal Performance

NVIDIA’s advancements are underscored by the inclusion of third-generation RT Cores, fourth-generation Tensor Cores, and Ada Generation CUDA cores in the new GPUs. These components synergize to elevate ray tracing, deep learning, and overall graphics performance to new heights. Additional features like dedicated GPU memory, DLSS 3 for enhanced image quality, and an AV1 encoder for more efficient video compression are indispensable for professionals engaged in streaming and video conferencing.

In recognition of the growing demand for mobility in the professional sphere, NVIDIA has ensured that these powerful GPUs are incorporated into sleek, lightweight laptops. This integration allows professionals to access top-tier performance on the go, liberating them from the confines of a stationary workspace and catering to the needs of those with dynamic lifestyles.

The RTX 500 and 1000 GPUs are slated for release in the spring, with a lineup from prominent manufacturers such as Dell Technologies, HP, Lenovo, and MSI. NVIDIA’s latest offerings are set to fulfill the aspirations of tech-savvy professionals seeking to amplify their work efficiency and creative potential. With these new GPUs, NVIDIA continues to redefine the capabilities of mobile computing, equipping a diverse range of professionals with robust tools for their trade.

Filed Under: Laptops, Top News

Latest timeswonderful Deals

Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, timeswonderful may earn an affiliate commission. Learn about our Disclosure Policy.

Tags Ada, Generation, GPUs, laptop, NVIDIA, Pro, RTX

News

Google Gemma open source AI optimized to run on NVIDIA GPUs

Post author By miranda cosgrove
Post date February 26, 2024
No Comments on Google Gemma open source AI optimized to run on NVIDIA GPUs

Google Gemma open source AI optimized to run on NVIDIA GPUs

Google has made a significant move by joining forces with NVIDIA, a giant in the field of artificial intelligence hardware, to boost the capabilities of its Gemma language models. This collaboration is set to enhance the efficiency and speed for those who work with AI applications, making it a noteworthy development in the tech world.

The Google Gemma AI models have been upgraded and now come in two versions, one with 2 billion parameters and another with 7 billion parameters. These models are specifically designed to take full advantage of NVIDIA’s cutting-edge AI platforms. This upgrade is beneficial for a wide range of users, from those running large data centers to individuals using personal computers, as the Gemma models are now optimized to deliver top-notch performance.

At the heart of this enhancement lies NVIDIA’s TensorRT-LLM, an open-source library that is instrumental in optimizing large language model inference on NVIDIA GPUs. This tool is essential for ensuring that Gemma operates at peak performance, offering users faster and more precise AI interactions.

Google Gemma

One of the key improvements is Gemma’s compatibility with a wide array of NVIDIA hardware. Now, over 100 million NVIDIA RTX GPUs around the world can support Gemma, which greatly increases its reach. This includes the powerful GPUs found in data centers, the A3 instances in the cloud, and the NVIDIA RTX GPUs in personal computers.

In the realm of cloud computing, Google Cloud plans to employ NVIDIA’s H200 Tensor Core GPUs, which boast advanced memory capabilities. This integration is expected to enhance the performance of Gemma models, particularly in cloud-based applications, resulting in faster and more reliable AI services. NVIDIA’s contributions are not limited to hardware; the company also provides a comprehensive suite of tools for enterprise developers. These tools are designed to help with the fine-tuning and deployment of Gemma in various production environments, which simplifies the development process for AI services, whether they are complex or simple.

For those looking to further customize their AI projects, NVIDIA offers access to model checkpoints and a quantized version of Gemma, all optimized with TensorRT-LLM. This allows for even more detailed refinement and efficiency in AI projects. The NVIDIA AI Playground serves as a user-friendly platform for interacting directly with Gemma models. This platform is designed to be accessible, eliminating the need for complex setup processes, and is an excellent resource for those who want to quickly dive into exploring what Gemma has to offer.

An intriguing element of this integration is the combination of Gemma with NVIDIA’s Chat with RTX tech demo. This demo utilizes the generative AI capabilities of Gemma on RTX-powered PCs to provide a personalized chatbot experience. It is fast and maintains data privacy by operating locally, which means it doesn’t rely on cloud connectivity.

Overall, Google’s Gemma models have made a significant stride with the optimization for NVIDIA GPUs. This progress brings about improved performance, broad hardware support, and powerful tools for developers, making Gemma a strong contender for AI-driven applications. The partnership between Google and NVIDIA promises to deliver a robust and accessible AI experience for both developers and end-users, marking an important step in the evolution of AI technology. Here are some other articles you may find of interest on the subject of Google Gemma :

Filed Under: Technology News, Top News

Latest timeswonderful Deals

Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, timeswonderful may earn an affiliate commission. Learn about our Disclosure Policy.

Tags Gemma, Google, GPUs, NVIDIA, open, Optimized, Run, source

News

NVIDIA CEO unveiling new AI breakthrough at GTC 2024

Post author By miranda cosgrove
Post date February 22, 2024
No Comments on NVIDIA CEO unveiling new AI breakthrough at GTC 2024

NVIDIA CEO Jensen Huang unveiling new AI breakthrough at GTC 2024

The upcoming GTC 2024 conference in San Jose is shaping up to be a significant event for those interested in the latest developments in artificial intelligence. From March 18-21, industry professionals and enthusiasts will gather to hear from NVIDIA’s CEO, Jensen Huang, who will open the event with a keynote speech. His talk is expected to cover the newest AI breakthroughs and will be available to everyone, both live and on-demand, without any registration required.

NVIDIA has been at the forefront of AI technology since 2014 and is set to display its latest work in areas such as large language models, cybersecurity, and robotics. The conference boasts an impressive schedule with 900 sessions and 300 exhibitors, providing a comprehensive look at how NVIDIA’s technology is influencing various industries, including healthcare, finance, and automotive.

GTC 2024 conference

The event will feature presentations from some of the biggest names in the tech world, including representatives from OpenAI, Microsoft, Google DeepMind, Meta, and Stanford University. These speakers will share their perspectives and breakthroughs, offering attendees a window into the future of tech.

Notable speakers include:

Brad Lightcap, chief operating officer, OpenAI
Sébastien Bubeck, vice president, Microsoft GenAI
Vincent Vanhoucke, distinguished scientist and senior director of robotics, Google DeepMind
Joelle Pineau, vice president of AI research, Meta
Dr. Fei-Fei Li, professor of computer science and HAI co-director, Stanford University
Dr. Priscilla Chan, cofounder and co-CEO, Chan Zuckerberg Initiative
Stefan Goebel, senior vice president, chief of staff, product engineering and head of strategic engineering partnerships, SAP Labs
Belinda Neal, chief operating officer for core engineering and head of engineering partnerships, Goldman Sachs
Moises Hernandez-Fernandez, vice president of machine learning center of excellence, JPMorgan Chase
Shan Jegatheeswaran, vice president and global head of MedTech Digital, Johnson & Johnson
Rodolphe Katra, vice president of AI, Medtronic
Aaron Saunders, CTO, Boston Dynamics

Over 1,000 organizations, including Amazon, Adobe, and Mercedes-Benz, will be present to demonstrate how AI is reshaping their businesses. The conference will highlight the progress in large language models by OpenAI and Google DeepMind. Attendees will also gain insights into the latest cybersecurity strategies, where AI is playing a crucial role in combating digital threats. Robotics will be another area of focus, with demonstrations of autonomous robots performing intricate tasks.

NVIDIA AI

For healthcare professionals, there will be valuable discussions on how AI is transforming diagnostics and patient care. The finance industry will explore how AI is being used to assess risks and detect fraud. Meanwhile, the automotive sector will present the newest AI-driven vehicles and advancements in autonomous driving technology.

The GTC 2024 conference promises to be a central point for learning and innovation in AI, with Jensen Huang’s keynote setting the stage for conversations that will shape the future of the field. Participants will come away with a deeper understanding of the profound impact AI is having on different facets of life and business.

Filed Under: Technology News, Top News

Latest timeswonderful Deals

Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, timeswonderful may earn an affiliate commission. Learn about our Disclosure Policy.

Tags breakthrough, CEO, GTC, NVIDIA, Unveiling