8000 Migrate the app (ktransformers): dequant.cu by chengxiw · Pull Request #879 · oneapi-src/SYCLomatic-test · GitHub
[go: up one dir, main page]
Skip to content

Migrate the app (ktransformers): dequant.cu #879

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 2 commits into
base: SYCLomatic
Choose a base branch
from
Open

Migrate the app (ktransformers): dequant.cu #879

wants to merge 2 commits into from

Conversation

chengxiw
Copy link
@chengxiw chengxiw commented Mar 6, 2025 •
edited
Loading

Migrate app ktransformer to SYCL,

  • Migrated the cuda file dequant.cu to dequant.dp.cpp in SYCL
  • There serveral tests available in the current stage:
    • 3 sycl tests to test single kernel (passed) in ./migrated/single_kernel_test
    • 4 sycl tests to test single kernel (results mismatch) in ./migrated/single_kernel_test_need_debug
    • 1 torch test to test dequantize_q8_0 in ./migrated/torch_test
    • 9 pytorch test to test in ./migrated/python_test, passed with random generated input, compared with cpu calculation
      • dequantize_f32
      • dequantize_f16
      • dequantize_q8_0
      • dequantize_q2_k
      • dequantize_q3_k
      • dequantize_q4_k
      • dequantize_q5_k
      • dequantize_q6_k
      • dequantize_iq4_xs
  • Added README file on migration instructions and test build

@chengxiw chengxiw requested a review from a team as a code owner March 6, 2025 08:10
@sijialouintel sijialouintel force-pushed the flex_team branch 2 times, most recently from 1818469 to 91b8bd3 Compare March 6, 2025 09:02
@chengxiw chengxiw closed this Mar 6, 2025
@chengxiw chengxiw reopened this Mar 7, 2025
@chengxiw chengxiw closed this Mar 7, 2025
@chengxiw @sijialouintel
Add ktransformer dequant SYCL code and test (#2)
f2c22a4 
* Migrate each CUDA file to SYCL file with the SYCLomatic tool

* Single kernel tests

* Torch tests

* Single kernel tests need debug

* README

* Add test folder info

* update torch version

---------

Co-authored-by: Lou, Sijia <sijia.lou@intel.com>
Signed-off-by: Lou, Sijia <sijia.lou@intel.com>
Signed-off-by: Wu, Chengxi <chengxi.wu@intel.com>
Signed-off-by: Qiu, Xiaodong <xiaodong.qiu@intel.com>
Signed-off-by: Liang, Zilan <zilan.liang@intel.com>
Signed-off-by: Zhou, Shuangpeng<shuangpeng.zhou@intel.com>
@chengxiw chengxiw reopened this Mar 7, 2025
@chengxiw chengxiw mentioned this pull request Mar 7, 2025
Open
@chengxiw
Add pytest build and test (#3)
0ecbcfd 
* use pybind and setup for extension
* migration python cpu reference code
* generate random input and validation pytest

Signed-off-by: Lou, Sijia <sijia.lou@intel.com>
Signed-off-by: Wu, Chengxi <chengxi.wu@intel.com>
Signed-off-by: Qiu, Xiaodong <xiaodong.qiu@intel.com>
Signed-off-by: Liang, Zilan <zilan.liang@intel.com>
Signed-off-by: Zhou, Shuangpeng <shuangpeng.zhou@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@the-slow-one the-slow-one Awaiting requested review from the-slow-one the-slow-one is a code owner automatically assigned from oneapi-src/syclomatic-reviewers

@tomflinda tomflinda Awaiting requested review from tomflinda tomflinda is a code owner automatically assigned from oneapi-src/syclomatic-reviewers

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@chengxiw
0