10000 BUG/PERF: groupby.transform with unobserved categories by undermyumbrella1 · Pull Request #58084 · pandas-dev/pandas · GitHub
[go: up one dir, main page]
Skip to content

BUG/PERF: groupby.transform with unobserved categories #58084

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 19 commits into from
May 8, 2024
Merged

BUG/PERF: groupby.transform with unobserved categories #58084

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
a52e7fe
Temporarily change observed=True, for groupby.transform
Apr 17, 2024
898fd12
Add tests
Apr 17, 2024
5311004
Add orig_obj in BaseGroupBy hidden attr
Apr 17, 2024
fb548ad
Update tests according to pr comments
Apr 17, 2024
baa1b28
Move orig_obj arg in constructor to last param, to account for possib…
Apr 17, 2024
30013ee
Move calculation of observed grouper to when initialising groupby
Apr 20, 2024
3b9d27b
Only calculate observed_grouper when grouper is absent to account to …
Apr 20, 2024
4221c34
Merge branch 'main' into fix/type_coercion_for_unobserved_categories
Apr 20, 2024
8588a1e
Remove observed exclusions
Apr 20, 2024
8e669d9
Add observed grouper/grouping as cached method
Apr 20, 2024
0d9f89d
change return type to grouping
Apr 20, 2024
84f83ae
Update rst docs
Apr 25, 2024
cbabce0
Update rst docs
Apr 25, 2024
bcca14f
Cache observed grouping/grouper instead of self obj
Apr 29, 2024 8000
f3a3f63
Update according to pr comments
May 2, 2024
58e759f
Merge main
May 2, 2024
7f99b71
Revert unintentional changes
May 7, 2024
4364440
Revert unintentional changes
May 7, 2024
5d63405
Merge branch 'main' into fix/type_coercion_for_unobserved_categories
undermyumbrella1 May 7, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Move orig_obj arg in constructor to last param, to account for possib… 
…le empty param
  • Loading branch information
Kei committed Apr 17, 2024
commit baa1b284b9e64afc60ea711982d31fdbf6b69ca6
2 changes: 1 addition & 1 deletion pandas/core/groupby/generic.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2048,7 +2048,6 @@ def _gotitem(self, key, ndim: int, subset=None):
orig_obj = self.orig_obj if not self.observed else None
return SeriesGroupBy(
subset,
orig_obj,
self.keys,
level=self.level,
grouper=self._grouper,
Expand All @@ -2059,6 +2058,7 @@ def _gotitem(self, key, ndim: int, subset=None):
group_keys=self.group_keys,
observed=self.observed,
dropna=self.dropna,
orig_obj=orig_obj,
)

raise AssertionError("invalid ndim for _gotitem")
Expand Down
2 changes: 1 addition & 1 deletion pandas/core/groupby/groupby.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1097,7 +1097,6 @@ class GroupBy(BaseGroupBy[NDFrameT]):
def __init__(
self,
obj: NDFrameT,
orig_obj: NDFrameT | None = None,
keys: _KeysArgType | None = None,
level: IndexLabel | None = None,
grouper: ops.BaseGrouper | None = None,
Expand All @@ -1108,6 +1107,7 @@ def __init__(
group_keys: bool = True,
observed: bool = False,
dropna: bool = True,
orig_obj: NDFrameT | None = None,
) -> None:
self._selection = selection

Expand Down
0