Meta sheds more light on how it is evolving Llama 3 training — it relies for now on almost 50,000 Nvidia H100 GPU, but how long before Meta switches to its own AI chip?

Meta has unveiled details about its AI training infrastructure, revealing that it currently relies on almost 50,000 Nvidia H100 GPUs to train its open source Llama 3 LLM.  The company says it will have over 350,000 Nvidia H100 GPUs in service by the end of 2024, and the computing power equivalent to nearly 600,000 H100s … Read more

Why menopause keeps evolving in whales

Hello Nature readers, would you like to get this Briefing in your inbox free every day? Sign up here. Hard at work building China’s Jiangmen Underground Neutrino Observatory (JUNO). JUNO hopes to be detecting neutrinos by the end of 2024.Credit: Qiu Xinsheng/VCG via Getty If all goes to plan, the US$376 million Jiangmen Underground Neutrino … Read more