Skip to content
This repository was archived by the owner on Oct 31, 2023. It is now read-only.

Error in model, scaling only q matrix not qK.T dot product (qk.T/sqrt(dim_per_head)) #357

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Error in model, scaling only q matrix not qK.T dot product (qk.T/sqrt…

8b3c1f9
Select commit
Loading
Failed to load commit list.
Open

Error in model, scaling only q matrix not qK.T dot product (qk.T/sqrt(dim_per_head)) #357

Error in model, scaling only q matrix not qK.T dot product (qk.T/sqrt…
8b3c1f9
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs