{"id":230631,"date":"2024-03-26T15:55:44","date_gmt":"2024-03-26T07:55:44","guid":{"rendered":"https:\/\/magicalbits.net\/?p=230631"},"modified":"2024-03-26T15:55:44","modified_gmt":"2024-03-26T07:55:44","slug":"building-metas-genai-infrastructure-engineering-at-meta","status":"publish","type":"post","link":"https:\/\/magicalbits.net\/?p=230631","title":{"rendered":"Building Meta\u2019s GenAI Infrastructure &#8211; Engineering at Meta"},"content":{"rendered":"<blockquote><p>To lead in developing AI means leading investments in hardware infrastructure. Hardware infrastructure plays an important role in AI\u2019s future. Today, we\u2019re sharing details on two versions of our 24,576-GPU data center scale cluster at Meta. These clusters support our current and next generation AI models, including Llama 3, the successor to Llama 2, our publicly released LLM, as well as AI research and development across GenAI and other areas .<\/p><\/blockquote>\n<p>Source: <em><a href=\"https:\/\/engineering.fb.com\/2024\/03\/12\/data-center-engineering\/building-metas-genai-infrastructure\/\">Building Meta\u2019s GenAI Infrastructure &#8211; Engineering at Meta<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>To lead in developing AI means leading investments in hardware infrastructure. Hardware infrastructure plays an important role in AI\u2019s future. Today, we\u2019re sharing details on two versions of our 24,576-GPU data center scale cluster at Meta. These clusters support our current and next generation AI models, including Llama 3, the successor to Llama 2, our [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ep_exclude_from_search":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-230631","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"jetpack_featured_media_url":"","jetpack-related-posts":[],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/magicalbits.net\/index.php?rest_route=\/wp\/v2\/posts\/230631","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/magicalbits.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/magicalbits.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/magicalbits.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/magicalbits.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=230631"}],"version-history":[{"count":1,"href":"https:\/\/magicalbits.net\/index.php?rest_route=\/wp\/v2\/posts\/230631\/revisions"}],"predecessor-version":[{"id":230632,"href":"https:\/\/magicalbits.net\/index.php?rest_route=\/wp\/v2\/posts\/230631\/revisions\/230632"}],"wp:attachment":[{"href":"https:\/\/magicalbits.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=230631"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/magicalbits.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=230631"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/magicalbits.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=230631"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}