Skip to content

Commit 6f42c37

Browse files
littledggCopilotEmmonsCurse
authored
[Deterministic] Move paddle version batch invariant pkg to Fastdeploy (#4763)
* Move batch invariant pkg to Fastdeploy * fix problem and pre-commit * move test * Change testcase to FD style * Add testcase for log_softmax * Add testcase for mean * Add testcase for addmm * fix pre-commit * API check v0.9 * move to layers and add comment about log_softmax * Update fastdeploy/model_executor/layers/batch_invariant_ops/batch_invariant_ops.py 存在于原版代码注释中的版本控制遗留的内容,确实应该去除 Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update tests/batch_invariant/test_batch_invariance_op_mean.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update tests/batch_invariant/test_batch_invariance_op_logsoftmax.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update fastdeploy/model_executor/layers/batch_invariant_ops/batch_invariant_ops.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * change comment after copilot fix * fix bug about addmm * avoid global effect by enable_torch_proxy --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>
1 parent 70ec1e1 commit 6f42c37

File tree

6 files changed

+943
-0
lines changed

6 files changed

+943
-0
lines changed
Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,25 @@
1+
from .batch_invariant_ops import (
2+
AttentionBlockSize,
3+
disable_batch_invariant_mode,
4+
enable_batch_invariant_mode,
5+
get_batch_invariant_attention_block_size,
6+
is_batch_invariant_mode_enabled,
7+
log_softmax,
8+
matmul_persistent,
9+
mean_dim,
10+
set_batch_invariant_mode,
11+
)
12+
13+
__version__ = "0.1.0"
14+
15+
__all__ = [
16+
"set_batch_invariant_mode",
17+
"is_batch_invariant_mode_enabled",
18+
"disable_batch_invariant_mode",
19+
"enable_batch_invariant_mode",
20+
"matmul_persistent",
21+
"log_softmax",
22+
"mean_dim",
23+
"get_batch_invariant_attention_block_size",
24+
"AttentionBlockSize",
25+
]

0 commit comments

Comments
 (0)