LLM

LLM services are being hit by hackers looking to sell on private info

by

Using cloud-hosted large language models (LLM) can be quite expensive, which is why hackers have apparently begun started stealing, and selling, login credentials to the tools. Cybersecurity researchers Sysdig Threat Research Team recently spotted one such campaign, dubbing it LLMjacking. In its report, Sysdig said it observed a threat actor abusing a vulnerability in the … Read more

Gurman: Apple Working on On-Device LLM for Generative AI Features

by

Apple is developing its own large language model (LLM) that runs on-device to prioritize speed and privacy, Bloomberg‘s Mark Gurman reports. Writing in his “Power On” newsletter, Gurman said that Apple’s LLM underpins upcoming generative AI features. “All indications” apparently suggests that it will run entirely on-device, rather than via the cloud like most existing … Read more

Startup claims to boost LLM performance using standard memory instead of GPU HBM — but experts remain unconvinced by the numbers despite promising CXL technology

by

MemVerge, a provider of software designed to accelerate and optimize data-intensive applications, has partnered with Micron to boost the performance of LLMs using Compute Express Link (CXL) technology.  The company’s Memory Machine software uses CXL to reduce idle time in GPUs caused by memory loading. The technology was demonstrated at Micron’s booth at Nvidia GTC … Read more

Claude 3 API Opus LLM performance tested

by

Earlier this week Anthropic surprise the AI community by releasing three new AI models making up the Claude 3 family. The three different-sized models: Haiku, Sonnet, and Opus are vision language models (VLMs), capable of processing both text and images. If you’re interested in learning more about the performance of the Claude 3 API Opus … Read more

Using LangGraph to create multi-agent LLM coding AI frameworks

by

LangGraph has been used to create a multi-agent large language model (LLM) coding framework. This framework is designed to automate various software development tasks, including coding, testing, and debugging. The system is built upon the LangGraph module, which enhances the LangChain ecosystem by enabling the creation of AI agents. The framework features specialized agents, each … Read more

StarCoder2 LLM AI model designed for developers

by

StarCoder2 is an advanced open-source coding language model designed for developers, is being made offering three variants with different parameter sizes: 3 billion, 7 billion, and 15 billion. It is the latest version of the Starcoder series and has been trained on a vast array of programming languages and tokens. The model is noted for … Read more

New Mistral Next prototype large language model (LLM)

by

Mistral AI has released a new prototype large language model (LLM) named Mistral Next without much prior information or details. The model is currently available for testing on the Chatbot Arena platform. Users are encouraged to try it out and provide feedback. The model’s capabilities, training, and architecture remain undisclosed, but it has demonstrated impressive … Read more

MiniCPM 2B small yet powerful large language model (LLM)

by

In the rapidly evolving world of artificial intelligence, a new AI large language model (LLM) has been created in the form of the MiniCPM 2B, a compact AI LLM, offering a level of performance that rivals some of the biggest names in the field. With its 2 billion parameters, it stands as a formidable alternative … Read more

LLMWare unified framework for developing LLM apps with RAG

by

An innovative framework called LLMWare has been developed to provide users with a unified framework for developing projects and applications using large language models (LLMs) . This innovative tool is designed to help developers create applications that are powered by large language models. With its advanced retrieval augmented generation (RAG) capabilities, LLMWare is enhancing the … Read more