Scikit Intelex not usable with AMD CPU #23212
Replies: 3 comments 9 replies
-
|
scikit-learn-intelex is another project managed by Intel. You should report issues on their issue tracker instead. |
Beta Was this translation helpful? Give feedback.
-
|
I already did. I just thought it would be good to spread the knowledge, since the package is designed for scikit specifically and never mentions that it is only working on Intel CPU properly. In the end there is a high chance people might end up in this forum rather than in intelex. But I completely understand your reasoning. |
Beta Was this translation helpful? Give feedback.
-
|
I did end up on this forum, thank you |
Beta Was this translation helpful? Give feedback.
-
|
@benjamineruvieru Me too. Spent more than 5 days trying to figure out why my gridsearchcv with svm was giving non-deterministic results despite setting np.random.seed(42), or, rng=np.random.RandomState(42) etc. Decided to just try turning off scikit-learn-intelex, and there it was. Pretty sad that it doesn't work as expected on AMD CPUs though. Using that library indeed speeds up computation quite a lot. |
Beta Was this translation helpful? Give feedback.
-
sad |
Beta Was this translation helpful? Give feedback.
-
|
i understand the pain. |
Beta Was this translation helpful? Give feedback.
-
|
As mentioned by @jjerphan, we are not maintaining nor developing |
Beta Was this translation helpful? Give feedback.
-
|
I did install it on purpose, but I am not aware of any warnings nor have I seen any. I just stumpled upon the library during my research and it promised performance gains of factor 50-100 out of the box, which is huge, so I implemented it. I would have had no problem if there was a warning during training like "hey you are using hardware which is not working with this library". Right know it just produces wrong scores and index/column splits. |
Beta Was this translation helpful? Give feedback.
-
I was only referring to the warning raised by |
Beta Was this translation helpful? Give feedback.
-
|
When installing scikit-learn via conda on my AMD powered laptop I got the following message: Installed package of scikit-learn can be accelerated using scikit-learn-intelex, about the opposite of a warning. Only later I realised the name "intel" in the URL which is why I ended up here. Maybe omiting the "advice" for AMD CPU's? Thanks for the warnings @nilslacroix and @jjerphan. |
Beta Was this translation helpful? Give feedback.
-
|
Well, according to their page it says it supports "All CPUs with x86 architecture" |
Beta Was this translation helpful? Give feedback.
-
|
As already mentioned, we are not maintaining that package on the main conda package, nor are we the ones giving advice to people to install that package. This is not a scikit-learn core issue, and you should take it to the people maintaining those packages. We have always worried about people being confused with that package, but since we have no control over it, we can't remove that suggestion. You should ALWAYS install the package from pypi or conda-forge if you want us to support what you have installed. The main channel is not us. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I just found out that if you use scikit-learn-intelex with an amd cpu, the scoring of regressors like SVR is inconsistent over the same data and parameter configuration. You could argue it may be stupid to use an intel library with amd, but it states nowhere that you can not use amd cpus with it ...
I don't know if you should write a warning about using this library, but introducing hardware dependencies into scikit is a big nogo for me. Maybe someone will read this when he gets strange bugs like I did.
39 votes ·
Beta Was this translation helpful? Give feedback.
All reactions