-
Notifications
You must be signed in to change notification settings - Fork 143
[Java] Fix HNSW params allocation #1110
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Java] Fix HNSW params allocation #1110
Conversation
|
Linking cjnolet/nv_elastic#22 |
mythrocks
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1. This is a little simpler than #1109.
I'll see about rebasing this.
|
(Adding myself as an assignee, while working on the rebase.) |
|
/ok to test 37fc956 |
|
/ok to test 053f9e5 |
|
/ok to test 0a52813 |
ChrisHegarty
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
|
/merge |
549d970
into
rapidsai:branch-25.08
…dIndexParamsCreate (#1147) Using `cuvsTieredIndexParamsCreate` and `cuvsTieredIndexParamsDestroy` now instead of allocating arena in Java. -Used CloseableHandle and CuvsParamsHelper as used in #1109 and #1110 for consistency This fixes #1138 Authors: - Puneet Ahuja (https://github.com/punAhuja) Approvers: - MithunR (https://github.com/mythrocks) URL: #1147
Similar to rapidsai#1109, but for HNSW index type (a bit simpler). rapidsai#1109 replaces direct allocations of CAGRA index params (via Memory Arenas) with calls to the `cuvsCagraIndexParamsCreate()` and `cuvsCagraIndexParamsDestroy()` in the C-API. This ensures that the Java API is insulated from changes to show the C-API is implemented. The changes in this PR (rapidsai#1110) make similar changes, but for the HNSW index, and reuses the `CloseableHandle` to ensure cleanup. Authors: - Lorenzo Dematté (https://github.com/ldematte) - MithunR (https://github.com/mythrocks) Approvers: - MithunR (https://github.com/mythrocks) - Chris Hegarty (https://github.com/ChrisHegarty) URL: rapidsai#1110
…dIndexParamsCreate (rapidsai#1147) Using `cuvsTieredIndexParamsCreate` and `cuvsTieredIndexParamsDestroy` now instead of allocating arena in Java. -Used CloseableHandle and CuvsParamsHelper as used in rapidsai#1109 and rapidsai#1110 for consistency This fixes rapidsai#1138 Authors: - Puneet Ahuja (https://github.com/punAhuja) Approvers: - MithunR (https://github.com/mythrocks) URL: rapidsai#1147
Similar to rapidsai#1109, but for HNSW index type (a bit simpler). rapidsai#1109 replaces direct allocations of CAGRA index params (via Memory Arenas) with calls to the `cuvsCagraIndexParamsCreate()` and `cuvsCagraIndexParamsDestroy()` in the C-API. This ensures that the Java API is insulated from changes to show the C-API is implemented. The changes in this PR (rapidsai#1110) make similar changes, but for the HNSW index, and reuses the `CloseableHandle` to ensure cleanup. Authors: - Lorenzo Dematté (https://github.com/ldematte) - MithunR (https://github.com/mythrocks) Approvers: - MithunR (https://github.com/mythrocks) - Chris Hegarty (https://github.com/ChrisHegarty) URL: rapidsai#1110
…dIndexParamsCreate (rapidsai#1147) Using `cuvsTieredIndexParamsCreate` and `cuvsTieredIndexParamsDestroy` now instead of allocating arena in Java. -Used CloseableHandle and CuvsParamsHelper as used in rapidsai#1109 and rapidsai#1110 for consistency This fixes rapidsai#1138 Authors: - Puneet Ahuja (https://github.com/punAhuja) Approvers: - MithunR (https://github.com/mythrocks) URL: rapidsai#1147
Similar to #1109, but for HNSW index type (a bit simpler).
#1109 replaces direct allocations of CAGRA index params (via Memory Arenas) with calls to the
cuvsCagraIndexParamsCreate()andcuvsCagraIndexParamsDestroy()in the C-API. This ensures that the Java API is insulated from changes to show the C-API is implemented.The changes in this PR (#1110) make similar changes, but for the HNSW index, and reuses the
CloseableHandleto ensure cleanup.