Nx vs. Python performance for sentence-transformer encoding
Hey, I found this thread very helpful, but I would like to ask some additional questions / clarifications! I am trying to speed up some text_embedding creations. I have a data migration where we want to back-fill embeddings for existing entries. I tried various batch sizes for this and settled on 500. I tried to create the changesets with the embedding with Enum.map and Task.async_stream. But they yield the same time. I realized that all the time is spend on generating the embedding. I also...
https://elixirforum.com/t/nx-vs-python-performance-for-sentence-transformer-encoding/56502?page=2