-
-
Notifications
You must be signed in to change notification settings - Fork 32.5k
gh-125022: add support for simple SIMD features detection #125011
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Draft
picnixz
wants to merge
90
commits into
python:main
Choose a base branch
from
picnixz:core/simd-helpers
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
Changes from 23 commits
Commits
Show all changes
90 commits
Select commit
Hold shift + click to select a range
9a6ccb5
support simple SIMD detection
picnixz f4e4f99
add _Py prefix
picnixz 5006686
Use `_py` prefix
picnixz 3c0b4f1
make the interface friendlier for future adjustments
picnixz 01ed21a
Allow `cpu_simd_flags` to be merged.
picnixz 969a619
update comments
picnixz 5a5acc2
fix typo
picnixz ac1b165
fix configure script
picnixz 6f304f2
fix bit detection
picnixz f3bd027
Harden detection of AVX instructions.
picnixz 16b2aed
do not guard the parsing of `os_xsave`
picnixz 5018fa9
Remove old comment.
picnixz e758065
Update cpuinfo.c comments
picnixz 731be81
Update pycore_cpuinfo.h comments
picnixz 7947715
fix lint
picnixz 7a17cbb
I really shouldn't use a Web UI
picnixz 76f67b1
Fix _xgetbv() on Windows builds.
picnixz 0b49a50
fix comment
picnixz 9fd6152
harden detection of CPU features
picnixz 97a0fc5
update configure
picnixz f7da530
Merge remote-tracking branch 'upstream/main' into core/simd-helpers-1…
picnixz 5f2884d
update comments
picnixz 7c3b74e
update Makefile
picnixz 130d099
address Erlend's review
picnixz cd575f0
lint & comment fixups
picnixz 2b597a4
Update docs
picnixz 78be530
Fix typo
picnixz fd47f0e
Merge branch 'main' into core/simd-helpers
picnixz cbb7b53
re-export functions for extension modules
picnixz 21d8ca8
rename os_xsave to osxsave for future automatism
picnixz 1f9dbb4
remember `maxleaf` and make detection more readable
picnixz 553aa7c
use enumeration for flags
picnixz 39d2ba4
fix warnings
picnixz 602bb9c
Merge branch 'main' into core/simd-helpers
picnixz d6a3523
remove un-necessary comment and newline continuation
picnixz ff4212e
Merge branch 'main' into core/simd-helpers
picnixz 3cb79f6
regen configure
picnixz e0a578c
clinic now supports empty comment lines in Python blocks
picnixz 6fdbbdf
Merge remote-tracking branch 'upstream/main' into feat/core/simd-125022
picnixz c265851
Merge remote-tracking branch 'upstream/main' into feat/core/simd-125022
picnixz c12f9c7
move cpuinfo enumerations to real invokable Python scripts
picnixz a6c443f
Merge remote-tracking branch 'upstream/main' into feat/core/simd-125022
picnixz bd3589f
add comments
picnixz d213b67
update C comments
picnixz 4109d90
Merge remote-tracking branch 'upstream/main' into feat/core/simd-125022
picnixz 19b7d86
TMP: usage proof-of-concept
picnixz 1732b6b
Merge remote-tracking branch 'upstream/main' into feat/core/simd-125022
picnixz d59d06d
improve configure.ac
picnixz bc2c1e5
Merge remote-tracking branch 'upstream/main' into feat/core/simd-125022
picnixz 4a92103
Merge remote-tracking branch 'upstream/main' into feat/core/simd-125022
picnixz 26ed6fd
Merge branch 'main' into feat/core/simd-125022
picnixz d00da3e
post-merge
picnixz 8b7ecfb
use `_Py` prefix to prevent public namespace pollution
picnixz 3c31ba3
let the compiler decide on the inlineness
picnixz 143d57e
drop CPUID_REG alias
picnixz ee2a83c
simplify `_Py_cpuid_check_features`
picnixz e6d4583
amend docs for `_Py_cpuid_disable_features`
picnixz 838f928
use macros to support larger flag ranges
picnixz 62c9a40
handle -Wpedantic
picnixz a22aa95
reorganize files
picnixz 87039dc
suppress compilation warnings
picnixz 8a4b120
add linting
picnixz 8603e14
typo
picnixz d6213a5
typo
picnixz 79d5b34
log more!
picnixz f69d74a
skip CI
picnixz cb9065d
more printf
picnixz 88df3b7
faster ci
picnixz db64ba5
!!
picnixz 04012b4
!!
picnixz 144d9ef
does it work now..?
picnixz b364ad2
does it work now..?
picnixz 0791e89
remove xgetbv support?
picnixz 48b2cb2
remove xgetbv support?
picnixz 34f1337
huh?
picnixz 91effb4
only parse maxleaf
picnixz 6dc532d
use different variables!
picnixz 6d5dd0b
disable everything!
picnixz 8e5b2f0
revert CI
picnixz 3b495f6
only check maxleaf
picnixz 8019f09
parse L1
picnixz 820d140
parse L7
picnixz df85ce5
it *should* work now
picnixz 915383e
:@
picnixz c6cf903
:@
picnixz 498518f
waaaaa!
picnixz 3d56d93
remove support for XCR0 registers
picnixz 08daa8a
fix SIMD-256 detection
picnixz afd1137
simplify `get_cpuid_info`
picnixz 79eb72d
add CODEOWNERS
picnixz File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,147 @@ | ||
#ifndef Py_INTERNAL_CPUINFO_H | ||
#define Py_INTERNAL_CPUINFO_H | ||
|
||
#ifdef __cplusplus | ||
extern "C" { | ||
#endif | ||
|
||
#ifndef Py_BUILD_CORE | ||
# error "this header requires Py_BUILD_CORE define" | ||
#endif | ||
|
||
#include <stdint.h> // uint8_t | ||
|
||
typedef struct py_cpuid_features { | ||
/* Macro to declare a member flag of 'py_cpuid_features' as a uint8_t. */ | ||
#define _Py_CPUID_DECL_FLAG(MEMBER_NAME) uint8_t MEMBER_NAME:1 | ||
// --- Streaming SIMD Extensions ------------------------------------------ | ||
_Py_CPUID_DECL_FLAG(sse); | ||
_Py_CPUID_DECL_FLAG(sse2); | ||
_Py_CPUID_DECL_FLAG(sse3); | ||
_Py_CPUID_DECL_FLAG(ssse3); // Supplemental SSE3 instructions | ||
_Py_CPUID_DECL_FLAG(sse41); // SSE4.1 | ||
_Py_CPUID_DECL_FLAG(sse42); // SSE4.2 | ||
|
||
// --- Advanced Vector Extensions ----------------------------------------- | ||
_Py_CPUID_DECL_FLAG(avx); | ||
_Py_CPUID_DECL_FLAG(avx_ifma); | ||
_Py_CPUID_DECL_FLAG(avx_ne_convert); | ||
|
||
_Py_CPUID_DECL_FLAG(avx_vnni); | ||
_Py_CPUID_DECL_FLAG(avx_vnni_int8); | ||
8000 _Py_CPUID_DECL_FLAG(avx_vnni_int16); | ||
|
||
// --- Advanced Vector Extensions 2 --------------------------------------- | ||
_Py_CPUID_DECL_FLAG(avx2); | ||
|
||
// --- Advanced Vector Extensions (512-bit) ------------------------------- | ||
/* | ||
* AVX-512 instruction set are grouped by the processor generation | ||
* that implements them (see https://en.wikipedia.org/wiki/AVX-512). | ||
* | ||
* We do not include GFNI, VPCLMULQDQ and VAES instructions since | ||
* they are not exactly AVX-512 per se, nor do we include BF16 or | ||
* FP16 since they operate on bfloat16 and binary16 (half-float). | ||
* | ||
* See https://en.wikipedia.org/wiki/AVX-512#Instruction_set for | ||
* the meaning of each suffix (e.g., 'f' stands for 'Foundation'). | ||
*/ | ||
_Py_CPUID_DECL_FLAG(avx512_f); | ||
_Py_CPUID_DECL_FLAG(avx512_cd); | ||
|
||
_Py_CPUID_DECL_FLAG(avx512_er); | ||
_Py_CPUID_DECL_FLAG(avx512_pf); | ||
|
||
_Py_CPUID_DECL_FLAG(avx512_4fmaps); | ||
_Py_CPUID_DECL_FLAG(avx512_4vnniw); | ||
|
||
_Py_CPUID_DECL_FLAG(avx512_vpopcntdq); | ||
|
||
_Py_CPUID_DECL_FLAG(avx512_vl); | ||
_Py_CPUID_DECL_FLAG(avx512_dq); | ||
_Py_CPUID_DECL_FLAG(avx512_bw); | ||
|
||
_Py_CPUID_DECL_FLAG(avx512_ifma); | ||
_Py_CPUID_DECL_FLAG(avx512_vbmi); | ||
|
||
_Py_CPUID_DECL_FLAG(avx512_vnni); | ||
|
||
_Py_CPUID_DECL_FLAG(avx512_vbmi2); | ||
_Py_CPUID_DECL_FLAG(avx512_bitalg); | ||
|
||
_Py_CPUID_DECL_FLAG(avx512_vp2intersect); | ||
|
||
// --- Instructions ------------------------------------------------------- | ||
_Py_CPUID_DECL_FLAG(cmov); | ||
_Py_CPUID_DECL_FLAG(fma); | ||
_Py_CPUID_DECL_FLAG(popcnt); | ||
_Py_CPUID_DECL_FLAG(pclmulqdq); | ||
|
||
_Py_CPUID_DECL_FLAG(xsave); // XSAVE/XRSTOR/XSETBV/XGETBV | ||
_Py_CPUID_DECL_FLAG(os_xsave); // XSAVE is enabled by the OS | ||
|
||
// --- XCR0 register bits ------------------------------------------------- | ||
_Py_CPUID_DECL_FLAG(xcr0_sse); | ||
// On some Intel CPUs, it is possible for the CPU to support AVX2 | ||
// instructions even though the underlying OS does not know about | ||
// AVX. In particular, only (SSE) XMM registers will be saved and | ||
// restored on context-switch, but not (AVX) YMM registers. | ||
_Py_CPUID_DECL_FLAG(xcr0_avx); | ||
_Py_CPUID_DECL_FLAG(xcr0_avx512_opmask); | ||
_Py_CPUID_DECL_FLAG(xcr0_avx512_zmm_hi256); | ||
_Py_CPUID_DECL_FLAG(xcr0_avx512_hi16_zmm); | ||
#undef _Py_CPUID_DECL_FLAG | ||
// Whenever a field is added or removed above, update the | ||
// number of fields (40) and adjust the bitsize of 'ready' | ||
// so that the size of this structure is a multiple of 8. | ||
uint8_t ready; // set if the structure is ready for usage | ||
} py_cpuid_features; | ||
|
||
/* | ||
* Explicitly initialize all members to zero to guarantee that | ||
* we never have an un-initialized attribute at runtime which | ||
* could lead to an illegal instruction error. | ||
* | ||
* This does not mark 'flags' as being ready yet. | ||
*/ | ||
extern void | ||
_Py_cpuid_disable_features(py_cpuid_features *flags); | ||
|
||
/* | ||
* Check whether the structure is ready and flags are inter-compatible, | ||
* returning 1 on success and 0 otherwise. | ||
* | ||
* The caller should disable all CPUID detected features if the check | ||
* fails to avoid encountering runtime illegal instruction errors. | ||
*/ | ||
extern int | ||
_Py_cpuid_check_features(const py_cpuid_features *flags); | ||
|
||
/* | ||
* Return 1 if all expected flags are set in 'actual', 0 otherwise. | ||
* | ||
* If 'actual' or 'expect' are not ready yet, this also returns 0. | ||
*/ | ||
extern int | ||
_Py_cpuid_has_features(const py_cpuid_features *actual, | ||
const py_cpuid_features *expect); | ||
|
||
|
||
/* | ||
* Return 1 if 'actual' and 'expect' are identical, 0 otherwise. | ||
* | ||
* If 'actual' or 'expect' are not ready yet, this also returns 0. | ||
*/ | ||
extern int | ||
_Py_cpuid_match_features(const py_cpuid_features *actual, | ||
const py_cpuid_features *expect); | ||
|
||
/* Detect the available features on this machine. */ | ||
extern void | ||
_Py_cpuid_detect_features(py_cpuid_features *flags); | ||
|
||
#ifdef __cplusplus | ||
} | ||
#endif | ||
|
||
#endif /* !Py_INTERNAL_CPUINFO_H */ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.