8000 WIP recommend OpenBLAS for Ubuntu (and Debian?) by larsmans · Pull Request #1392 · scikit-learn/scikit-learn · GitHub
[go: up one dir, main page]
Skip to content

WIP recommend OpenBLAS for Ubuntu (and Debian?) #1392

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

WIP recommend OpenBLAS for Ubuntu (and Debian?) #1392

wants to merge 1 commit into from

Conversation

larsmans
Copy link
Member

I just spent way too much time optimizing matrix multiplication on an Ubuntu/AMD box and found out that installing OpenBLAS instead of ATLAS can give a major speedup to good old np.dot on two 2-d arrays of dtype=np.float64. It takes just two apt-get commands to replace ATLAS, so I added those to the installation instructions.

The main thing left to do for this PR is test whether the same trick works on my Debian/Intel box at work.

@ogrisel
Copy link
Member
ogrisel commented Nov 22, 2012

LGTM, +1 for merging. Any quick bench? (for instance have you observed a reduction in the runtime of the test suite?).

@jaquesgrobler
Copy link
Member

Nice one! 👍

@larsmans
Copy link
Member Author

Hmm, np.dot is faster on Debian too, but the tests don't work anymore with OpenBLAS. nosetests seems to end up in a busy loop in kernel mode, with strace showing it to stop in the middle of futex.

Since this is Debian testing, and the latest release did not yet include OpenBLAS, I guess we'll have to recommend this only for Ubuntu. Will produce a microbenchmark sometime soon (hopefully tonight, else next week).

@larsmans
Copy link
Member Author

Damn, same problem on Ubuntu. I'm withdrawing this PR for now.

@larsmans larsmans closed this Nov 22, 2012
@GaelVaroquaux
Copy link
Member

Funny, I was discussing openblas with a friend at lunch (because of this PR), and he mentioned similar problems in different settings.

@larsmans
Copy link
Member Author

For #1395 it works quite nicely. I might put a more carefully hedged note in install.rst.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@larsmans @ogrisel @jaquesgrobler @GaelVaroquaux
0