[HN Gopher] A guide to open-source LLM inference and performance ___________________________________________________________________ A guide to open-source LLM inference and performance Author : varunshenoy Score : 46 points Date : 2023-11-20 20:33 UTC (2 hours ago) (HTM) web link (www.baseten.co) (TXT) w3m dump (www.baseten.co) | samspenc wrote: | Likely trending on home page since this is directly relevant to | LLM costs, i.e., questions like "how much would it cost to | rebuild ChatGPT from scratch". | simsspoons wrote: | highly relevant question today | seth_ wrote: | love the deep dive here ___________________________________________________________________ (page generated 2023-11-20 23:00 UTC)