[HN Gopher] Meilisearch Expands Search Power with Arroy's Filter...
___________________________________________________________________
Meilisearch Expands Search Power with Arroy's Filtered Disk ANN
Author : Kerollmops
Score : 63 points
Date : 2023-12-24 08:16 UTC (14 hours ago)
(HTM) web link (blog.kerollmops.com)
(TXT) w3m dump (blog.kerollmops.com)
| sgt101 wrote:
| feels like product placement dressed as a blog
| Kerollmops wrote:
| It's my own company and I work hard on both Meilisearch, the
| keyword search part since 2018 and the soon-to-be-released
| semantic search part. The hybrid search will be also part of
| the v1.6 release in january. I took time to write those three
| blog posts.
|
| What do you think about the blog posts content?
| sroussey wrote:
| Is there a way to make this a bundled library (more like
| sqlite) than a server (more like postgresql)?
|
| I want to have something running local and bundled into an
| app for friends, maybe more.
| _a_a_a_ wrote:
| It's information-dense and informative (also over my head). As
| such it feels absolutely nothing like product placement. I
| think you're being needlessly cynical.
| ko_pivot wrote:
| This is great. The only major thing Meilisearch is missing after
| hybrid search is introduced IMO is high availability. Without
| clustering, it's hard to run any meaningful production workloads
| and there doesn't seem to be an online upgrades story.
| Kerollmops wrote:
| Indeed, you are right about this. This is why we will release
| geo-replication on the cloud in Q1 next year. We heard you and
| worked hard on both of those features. We already have a great
| working proof-of-concept.
| goestoo wrote:
| I tested Meilisearch last year indexing 10mil documents it took 2
| days! same dataset with the same server specs it took less than 2
| hours to index in elasticsearch.
| Kerollmops wrote:
| Thank you for the feedback. You should probably look at our
| blog post explaining how to index in smarter way [1]. You
| should probably come and talk to us on Discord. We work with
| MrBeast and they don't have any issue indexing millions of
| YouTube videos everyday.
|
| Ho! And just to tease you a little bit. We highly improved the
| indexing speed of Meilisearch v1.6 (january 24). Here is a
| teasing tweet [2].
|
| [1]: https://blog.meilisearch.com/best-practices-for-faster-
| index... [2]:
| https://x.com/kerollmops/status/1734576622303404317
| simonw wrote:
| Why does MrBeast index millions of YouTube videos?
| Kerollmops wrote:
| They recently released a new YouTube stats website and they
| use Meilisearch in the frontend.
|
| https://news.ycombinator.com/item?id=38681328
| milkshakes wrote:
| a lot of people will never read your blog, or visit your
| discord but would be quite interested in using a tool like
| meilisearch. you're correct that the information is out
| there, but unless you put it right in front of them, such
| people will have a bad time (and sometimes complain about it,
| publicly!).
| supz_k wrote:
| We recently re-indexed comments to Meilisearch (a PHP process
| that synced data from MYSQL to Meilisearch) after a Meilisearch
| version upgrade. It only took about 1 hour for about 12 million
| documents on a 16GB/4vCPU. In your case, maybe it was a config
| issue? Or, an old version?
| Kerollmops wrote:
| And when you'll use the v1.6 you see a much better indexation
| speed.
|
| https://x.com/kerollmops/status/1734576622303404317
| wg0 wrote:
| I'm thinking of putting this for software documentation. The idea
| is that content is all markdown in Astro or Seveltkit with SSG
| (static site generation) and then Index it all at build time and
| then search it all via Meliesearch.
___________________________________________________________________
(page generated 2023-12-24 23:00 UTC)