Skip to content

Commit 45b2f7d

Browse files
authored
Add copyright and source information to script
Added copyright notice and source information.
1 parent 15d22c4 commit 45b2f7d

File tree

1 file changed

+4
-6
lines changed

1 file changed

+4
-6
lines changed

ch04/08_deltanet/plot_memory_estimates_gated_deltanet.py

Lines changed: 4 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,7 @@
1-
# Memory vs. context length comparison:
2-
# 1) Full Attention (MHA)
3-
# 2) Gated DeltaNet (no conv)
4-
# 3) 3:1 ratio (3 DeltaNet : 1 Full Attention)
5-
#
6-
# Memory reported in GB (1e9 bytes)
1+
# Copyright (c) Sebastian Raschka under Apache License 2.0 (see LICENSE.txt).
2+
# Source for "Build a Large Language Model From Scratch"
3+
# - https://www.manning.com/books/build-a-large-language-model-from-scratch
4+
# Code: https://github.com/rasbt/LLMs-from-scratch
75

86
import argparse
97
from pathlib import Path

0 commit comments

Comments
 (0)