feat: Intel Hardware Support #139
tikikun
started this conversation in
Feature Requests
Replies: 1 comment
-
regarding issue that leads to this discussion: |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Currently nitro can be compiled with intel MKL, however there are ongoing efforts from intel for LLMs inferencing that offers better performance.
Criteria that we might want:
That said with above options and multiple documents regarding on how to do things on intel hardware i think it will be awesome if we can have discussion and more insights on this matter.
Beta Was this translation helpful? Give feedback.
All reactions