[sharktank] Materialize indices in PrefillTask to ease branching logic in downstream code#2507

sogartar merged 3 commits intomainnod-ai/shark-ai:mainfrom

users/sogartar/llm-utils-materialize-logit-indicesnod-ai/shark-ai:users/sogartar/llm-utils-materialize-logit-indicesCopy head branch name to clipboard