-
Notifications
You must be signed in to change notification settings - Fork 37
Create TT client via plugin for TensTorrent devices #1860
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
91e0d7c to
d6da889
Compare
d6da889 to
4e7fde2
Compare
4e7fde2 to
72852fc
Compare
| end | ||
| end | ||
|
|
||
| has_tt() = true |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I need to figure out how to detect the devices automatically, but apart from that this should be good from my side as an experimental plugin. I'm not sure about the "TT" name everywhere though, bit too short and obscure, but that's how all the TensTorrent tools are called.
|
Let's add it to https://github.com/EnzymeAD/Reactant.jl/blob/mg/tt-plugin/docs/src/index.md#select-an-accelerator-backend as well (maybe with |
Based on the template of #1626. This is very preliminary, but very basic stuff works if we ignore the result of a matmul is off by ~0.1%, which doesn't look terribly good (accuracy is a lot better on CPU):
Ref: #1256, #1235 (CC @p-w-rs)
@fleclairTT you might be interested in this, too.