Skip to content

issue/207 operator: sigmoid op on cpu and cuda #292

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

issue/207 operator: sigmoid op on cpu and cuda #292

wants to merge 4 commits into from

Conversation

@pengcheng888
Copy link
Contributor

@pengcheng888 pengcheng888 commented Jun 30, 2025 •
edited
Loading

issue/207 添加了 Sigmoid算子的头文件、cpu实现、cuda实现、python测试用例、gguf测试用例。
https://github.com/InfiniTensor/InfiniCore/issues/207
环境：
cuda11.8 pytorch2.6 nvidia 4070ti

rebase新代码，增加了bf16格式数据:

  • bf16格式没有指数函数，所以将bf16转为fp32，使用了__expf函数；
  • 除法丢失精度较多，bf16格式的10^3误差测试不通过，改为了10^2。

image
image
image
image

@PanZezhong1725
Copy link
Collaborator

PanZezhong1725 commented Jul 1, 2025

为什么这个算子的文档没提交pr？

@PanZezhong1725
Copy link
Collaborator

PanZezhong1725 commented Jul 8, 2025

pytorch测试已更新，需要rebase到最新并支持bf16

@pengcheng888
Copy link
Contributor Author

pengcheng888 commented Jul 12, 2025

pytorch测试已更新，需要rebase到最新并支持bf16

文档和新代码已更新。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PanZezhong1725 PanZezhong1725 Awaiting requested review from PanZezhong1725

@Catheriany Catheriany Awaiting requested review from Catheriany

At least 1 approving review is required to merge this pull request.

Assignees

@pengcheng888 pengcheng888

Labels

模块：算子 类型：开发 需要修改

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@pengcheng888 @PanZezhong1725