8 comments

  • alexpadula 12 minutes ago
    Dark side of the PRISM! The image on the repo 100% inspired by Dark Side of The Moon by Pink Floyd.
  • swe_dima 41 minutes ago
    Sadly if cloud providers don't offer it on managed postgres then not many people can use it...
    • jascha_eng 25 minutes ago
      Well you can always move to tiger cloud if you want it managed :) And this is PostgreSQL licensed just like our pg_textsearch which has been adopted to Googles AlloyDB and microsofts HorizonDB already, so there is hope!
  • EgregiousCube 52 minutes ago
    I'm currently running VectorChord and I love it - with a fast backing disk, it's cut my postgres cost in half. Excited to see competition in low-RAM vector index tools. RAMageddon seems to be creating incentives to find more ways to take advantage of how fast modern nvme drives are!
    • enordstr 11 minutes ago
      I am the main contributor of pg_vectorsearch. If you try both, let us know about your experience and how we can improve.
  • Rapzid 1 hour ago
    Does it support filtering though?

    Edit: post filtering only

    I don't understand how people are efficiently implementing tenant/user/permission scopes with these indexes.

    • qeternity 2 minutes ago
      Partitioning is the easy bit I think, and falls out naturally from Postgres.

      But how are people doing recency biasing with vector databases?

      All of our approaches are either expensive or super hacky.

    • 3abiton 12 minutes ago
      Checks notes, one dayabase per client, per user, per project ... etc
    • enordstr 49 minutes ago
      Multi-column indexes for multi-tenant tables is planned for a future release.
    • esafak 39 minutes ago
      LanceDB supports push down and list/array membership through DataFusion.
  • jascha_eng 1 hour ago
    from the accompanying blog post: https://www.tigerdata.com/blog/announcing-pg_vectorsearch-sc...

    > TLDR: We are launching pg_vectorsearch, a new open-source PostgreSQL extension that makes vector search dramatically faster and more cost-efficient. Its new PRISM index uses partitioning and compression instead of HNSW's graph-based approach, delivering faster queries with a fraction of the memory and significantly faster index builds. At 100 million vectors, PRISM achieved 6 ms query latency on a machine with 4× less memory than HNSW, with index builds over 20× faster.

    • jascha_eng 23 minutes ago
      Btw, I do work for Tiger Data/timescale, but am not at all associated with this team. I just found this release really exciting.

      I sent the thread to Erik (the main contributor) though, so if you have feedback or questions, good chance that he'll see it.

  • esafak 38 minutes ago
    Shouldn't you lead with your benchmarks if you're fast? qps and precision/recall, please.
    • jascha_eng 30 minutes ago
      benchmarks are in the blog post and the benchmarking suite is also open sourced alongside it.
  • hushpadapp 1 hour ago
    [flagged]
  • mfreed 19 minutes ago
    [flagged]