{"id":230504,"date":"2023-12-11T18:12:17","date_gmt":"2023-12-11T10:12:17","guid":{"rendered":"https:\/\/magicalbits.net\/?p=230504"},"modified":"2023-12-11T18:12:17","modified_gmt":"2023-12-11T10:12:17","slug":"mudler-localai-robot-the-free-open-source-openai-alternative-self-hosted-community-driven-and-local-first-drop-in-replacement-for-openai-running-on-consumer-grade-hardware-no-gpu-required-run","status":"publish","type":"post","link":"https:\/\/magicalbits.net\/?p=230504","title":{"rendered":"mudler\/LocalAI: :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs ggml, gguf, GPTQ, onnx, TF compatible models: llama, l"},"content":{"rendered":"<blockquote><p>LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that\u2019s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families. Does not require GPU.<\/p><\/blockquote>\n<p>Source: <em><a href=\"https:\/\/github.com\/mudler\/LocalAI\">mudler\/LocalAI: :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs ggml, gguf, GPTQ, onnx, TF compatible models: llama, l<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that\u2019s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families. Does not require GPU. Source: mudler\/LocalAI: :robot: [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ep_exclude_from_search":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-230504","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"jetpack_featured_media_url":"","jetpack-related-posts":[],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/magicalbits.net\/index.php?rest_route=\/wp\/v2\/posts\/230504","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/magicalbits.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/magicalbits.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/magicalbits.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/magicalbits.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=230504"}],"version-history":[{"count":1,"href":"https:\/\/magicalbits.net\/index.php?rest_route=\/wp\/v2\/posts\/230504\/revisions"}],"predecessor-version":[{"id":230505,"href":"https:\/\/magicalbits.net\/index.php?rest_route=\/wp\/v2\/posts\/230504\/revisions\/230505"}],"wp:attachment":[{"href":"https:\/\/magicalbits.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=230504"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/magicalbits.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=230504"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/magicalbits.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=230504"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}