Skip to content

Commit 942db8b

Browse files
Merge pull request #18 from InfiniTensor/PanZezhong1725-patch-1
fix causal softmax formula
2 parents 07d764a + ff93dd5 commit 942db8b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

infiniop/ops/causal_softmax/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@ $$ softmax(v_i) = \frac{e^{v_i}}{\sum_{k=0}^{N - 1} e^{v_k}} $$
1414
$$
1515
mask_{i,j} =
1616
\begin{cases}
17-
0 & \text{if } i \leq N - M + j \\
17+
0 & \text{if } j \leq N - M + i \\
1818
-\infty & \text{otherwise}
1919
\end{cases}
2020
$$

0 commit comments

Comments
 (0)