8000 Cythonized GroupBy Fill by WillAyd · Pull Request #19673 · pandas-dev/pandas · GitHub
[go: up one dir, main page]
Skip to content

Cythonized GroupBy Fill #19673

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 25 commits into from
Feb 25, 2018
Merged

Cythonized GroupBy Fill #19673

Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
c58123c
Added test case for groupby fill methods
WillAyd Feb 12, 2018
2bc8023
Added code for group_fillna
WillAyd Feb 13, 2018
3cb25c0
Added ASV benchmarks
WillAyd Feb 13, 2018
7fecc11
Connected GroupBy method to Cython fillna
WillAyd Feb 13, 2018
3c2fb36
Fixed issue when filling Series after GroupBy
WillAyd Feb 13, 2018
a52b8c4
Added tests to mix group entries; fixed sort bug
WillAyd Feb 13, 2018
16c1823
Simplied groupby Cython calls for ffill/bfill
WillAyd Feb 13, 2018
bd3d5e0
Removed abandoned Cython implementation
WillAyd Feb 13, 2018
cae65af
Added upcast to int64 to prevent 32 bit failures
WillAyd Feb 13, 2018
0266514
Fixed issue with reconstructing grouped Series
WillAyd Feb 14, 2018
50dc690
Changed .view to .astype to avoid 32 bit segfaults
WillAyd Feb 15, 2018
9fa8e25
Added whatsnew
WillAyd Feb 15, 2018
5da06d8
Aligned group_fillna and group_shift signatures
WillAyd Feb 19, 2018
2fe91a4
Fixed failing test; list comp for _fill method
WillAyd Feb 19, 2018
825ba17
Updated whatsnew
WillAyd Feb 19, 2018
127c71c
PEP8 fixes
WillAyd Feb 19, 2018
3a23cd6
Py27 support with super call
WillAyd Feb 20, 2018
a363146
Fixed LIN 8000 T issue
WillAyd Feb 20, 2018
fd513c8
Used kwargs to call Cython groupby funcs
WillAyd Feb 20, 2018
776d1b7
Docstring for _fill method
WillAyd Feb 20, 2018
33f0d06
Cleaned up kwargs passing to Cython layer
WillAyd Feb 21, 2018
662008a
Idiomatic update - replace join with concat
WillAyd Feb 22, 2018
27e24fa
Moved non-templated funcs to groupby.pyx
WillAyd Feb 23, 2018
6f72476
Code update - swap group_index.take with grouper
WillAyd Feb 23, 2018
eff6603
Rebase and update import
WillAyd Feb 24, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Changed .view to .astype to avoid 32 bit segfaults
  • Loading branch information
@WillAyd
WillAyd committed Feb 24, 2018
commit 50dc6906c37c83d7acdd254fbc86f61ba69c98dc
2 changes: 1 addition & 1 deletion pandas/_libs/groupby_helper.pxi.in
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -987,7 +987,7 @@ def group_fillna_indexer(ndarray[int64_t] out,

N = len(out)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe want an assert that N == len(labels) == len(mask)


sorted_labels = np.argsort(labels).view(dtype=np.int64)
sorted_labels = np.argsort(labels).astype(np.int64, copy=False)
if method == 'bfill':
sorted_labels = sorted_labels[::-1]

Expand Down
0