[HN Gopher] Show HN: AI companions stack - create and host your ... ___________________________________________________________________ Show HN: AI companions stack - create and host your own AI companions Author : ykhli Score : 24 points Date : 2023-07-12 18:45 UTC (4 hours ago) (HTM) web link (github.com) (TXT) w3m dump (github.com) | mcbuilder wrote: | I hosted my own AI using SillyTavern + text-generation backend | (e.g. oogabooga / KoboldAI), just need the power needed to crank | the LLM. | yonixw wrote: | It's not host your own AI at all! You need like 5 saas api-keys | to operate this app. But sure, you can host this UI on your own. | causality0 wrote: | It makes me wonder how long it will be until open-source | locally-run AI chatbots reach the GPT-4 level. Five years? Ten? | swyx wrote: | its more a question of hardware progress than software | probably. theres a minimum level for these behaviors to | emerge | lettergram wrote: | It depends on the tasks, I'd argue some of the open source | alternatives are at the gpt-4 level already, particularly for | code generation. | | That said, I suspect summarization, translation, etc will | take time. I'd suspect under 1 year. | worldsayshi wrote: | >I'd argue some of the open source alternatives are at the | gpt-4 level already, particularly for code generation. | | Like which one? | Havoc wrote: | Is this a16z associate with the vc a16z? | dmarcos wrote: | Yeah. | https://twitter.com/stuffyokodraws/status/167879943947197235... | | Smart. A VC firm that heavily invests in software platforms | will make much better decisions if they have first hand | experience using the products. | rand1239 wrote: | Or if the fed prints a lot of money or makes interest rates | 0. Which is what the A16Z playbook is atleast. | rand1239 wrote: | [flagged] | arisAlexis wrote: | I don't get why I wouldn't just keep an open tab with chatgpt on | specific topics. They will very soon have big enough context | windows. Why build another UI, deployment pipes and all that jazz | ? | | P.s nobody will *sms the companion | rootusrootus wrote: | For me, it would be cost and alignment. If I own the software, | I can choose whatever alignment suits me, or none at all. And | ChatGPT is $20/month (assuming you want GPT4, and I do). | | But there's still a good argument for a hybrid solution. Buy | GPT4 access through the API and get a native UI to query it. | Much cheaper to pay as you go, and someone else is still | handling the heavy lifting. But if you want an uncensored | model, you're out of luck. | babyshake wrote: | Its roughly comparable to how you can use a spreadsheet to do a | lot of different things, but it improves the UX (with some | trade-offs) to have more custom designed UIs instead of | directly using a spreadsheet. ___________________________________________________________________ (page generated 2023-07-12 23:00 UTC)