10000 ENH: Allow for join between two multi-index dataframe instances by harisbal · Pull Request #20356 · pandas-dev/pandas · GitHub
[go: up one dir, main page]

Skip to content

ENH: Allow for join between two multi-index dataframe instances #20356

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 25 commits into from
Nov 15, 2018
Merged
Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
b581789
Allow for join between two multi-index dataframe instances
Sep 19, 2018
2d61a12
Merge remote-tracking branch 'upstream/master' into multi-index-join
harisbal Sep 19, 2018
4d4acc5
Merge remote-tracking branch 'upstream/master' into multi-index-join
harisbal Oct 7, 2018
66d82fb
Review
harisbal Oct 8, 2018
c091bb4
Merge remote-tracking branch 'upstream/master' into multi-index-join
Oct 8, 2018
d56ebcd
Second review
harisbal Oct 9, 2018
0cdad73
Merge remote-tracking branch 'upstream/master' into multi-index-join
Oct 9, 2018
c2a65aa
Merge remote-tracking branch 'upstream/master' into multi-index-join
harisbal Oct 10, 2018
571fdf7
Merge remote-tracking branch 'upstream/master' into multi-index-join
Nov 1, 2018
ae2d8ad
Review
harisbal Nov 1, 2018
405c1a4
Merge remote-tracking branch 'upstream/master' into multi-index-join
harisbal Nov 1, 2018
1d2d9f3
Fix ci
harisbal Nov 3, 2018
f0ac24d
Merge branch 'master' into multi-index-join
Nov 3, 2018
5ac40ff
Merge remote-tracking branch 'upstream/master' into multi-index-join
harisbal Nov 3, 2018
be862c7
Update v0.24.0.txt
harisbal Nov 4, 2018
e10cbde
Update docstring _restore_dropped_levels_multijoin
harisbal Nov 4, 2018
06d48d0
Update docstring _restore_dropped_levels_multijoin
harisbal Nov 4, 2018
f54c151
Merge remote-tracking branch 'upstream/master' into multi-index-join
Nov 4, 2018
c75108d
Merge remote-tracking branch 'origin/multi-index-join' into multi-ind…
harisbal Nov 5, 2018
c690260
Merge remote-tracking branch 'upstream/master' into multi-index-join
harisbal Nov 6, 2018
4092b34
updated comments
harisbal Nov 6, 2018
cfd5fcc
Refactoring
harisbal Nov 6, 2018
6c8131d
Review
harisbal Nov 10, 2018
ecaf515
Merge remote-tracking branch 'upstream/master' into multi-index-join
harisbal Nov 10, 2018
8b5d0aa
Merge remote-tracking branch 'upstream/master' into harisbal-multi-in…
TomAugspurger Nov 14, 2018
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update docstring _restore_dropped_levels_multijoin
  • Loading branch information
harisbal authored and harisbal committed Nov 4, 2018
commit e10cbdeb5d048f43a2e52efcdc06443adbae1c66
54 changes: 27 additions & 27 deletions pandas/core/reshape/merge.py
Original file line number Diff line number Diff line change
Expand Up @@ -1123,75 +1123,75 @@ def _get_join_indexers(left_keys, right_keys, sort=False, how='inner',


def _restore_dropped_levels_multijoin(left, right, dropped_level_names,
join_idx, lidx, ridx):
join_index, lindexer, rindexer):
"""
*this is an internal non-public method*

Returns the levels, labels and names of a multil-index to multi-index join.
Depending on the type of join, this method restores the appropriate
dropped levels of the joined multi-index. The method relies on lidx, ridx
dropped levels of the joined multi-index. The method relies on lidx, rindexer
which hold the index positions of left and right, where a join was feasible

Parameters
----------
left : Index
left : MultiIndex
left index
right : Index
right : MultiIndex
right index
dropped_level_names : str array
list of non-common levels
join_idx : Index
join_index : MultiIndex
the index of the join between the common levels of left and right
lidx : intp array
lindexer : intp array
left indexer
right : intp array
right indexer

Returns
-------
levels : intp ndarray
levels : list of Index
levels of combined multiindexes
labels : str array
labels : intp array
labels of combined multiindexes
names : str array
names of combined multiindexes

"""

# Convert to 1 level multi-index if not
if not isinstance(join_idx, MultiIndex):
levels = [join_idx.values]
labels = [list(range(join_idx.size))]
names = [join_idx.name]
join_idx = MultiIndex(levels=levels, labels=labels,
names=names, verify_integrity=False)

join_levels = join_idx.levels
join_labels = join_idx.labels
join_names = join_idx.names

# lidx and ridx hold the indexes where the join occured
if not isinstance(join_index, MultiIndex):
levels = [join_index.values]
labels = [list(range(join_index.size))]
names = [join_index.name]
join_index = MultiIndex(levels=levels, labels=labels,
names=names, verify_integrity=False)

join_levels = join_index.levels
join_labels = join_index.labels
join_names = join_index.names

# lindexer and rindexer hold the indexes where the join occured
# for left and right respectively. If left (right) is None then
# the join occured on all indices of left (right)
if lidx is None:
lidx = range(left.size)
if lindexer is None:
lindexer = range(left.size)

if ridx is None:
ridx = range(right.size)
if rindexer is None:
rindexer = range(right.size)

# Iterate through the levels that must be restored
for dropped_level_name in dropped_level_names:
if dropped_level_name in left.names:
idx = left
indexer = lidx
indexer = lindexer
else:
idx = right
indexer = ridx
indexer = rindexer

# The index of the level name to be restored
name_idx = idx.names.index(dropped_level_name)

restore_levels = idx.levels[name_idx].values
restore_levels = idx.levels[name_idx]
# Inject -1 in the labels list where a join was not possible
# IOW indexer[i]=-1
labels = idx.labels[name_idx]
Expand Down
0