Skip to content

Commit 1d226be

Browse files
authored
Update 第二章 Transformer架构.md
1 parent 5ac954f commit 1d226be

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/chapter2/第二章 Transformer架构.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -813,7 +813,7 @@ class Transformer(nn.Module):
813813
n_params = sum(p.numel() for p in self.parameters())
814814
# 如果不统计 embedding 的参数,就减去
815815
if non_embedding:
816-
n_params -= self.transformer.wpe.weight.numel()
816+
n_params -= self.transformer.wte.weight.numel()
817817
return n_params
818818

819819
'''初始化权重'''

0 commit comments

Comments
 (0)