8000 Requirements document for the dataframe interchange protocol by rgommers · Pull Request #35 · data-apis/dataframe-api · GitHub
[go: up one dir, main page]
Skip to content

Requirements document for the dataframe interchange protocol #35

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 20 commits into from
Jun 25, 2021
Merged

Requirements document for the dataframe interchange protocol #35

Changes from 1 commit
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
49f3b06
Add a summary document for the dataframe interchange protocol
rgommers Sep 15, 2020
31e301f
Process some review comments
rgommers Sep 17, 2020
a9b5e5c
Process a few more review comments.
rgommers Nov 5, 2020
82bc5ae
Link to Release callback semantics in Arrow C Data Interface docs
rgommers Nov 5, 2020
6197aee
Add design requirements for column selection and df metadata
rgommers Nov 5, 2020
2f51ba8
Edit the nested/heterogeneous dtypes non-requirement
rgommers Nov 5, 2020
183851d
Add requirements for chunking and memory layout description
rgommers Jan 5, 2021
c7575c1
Add TBD notes on dataframe-array connection and from_dataframe
rgommers Jan 5, 2021
5f278b3
Address review comments
rgommers Jan 6, 2021
1708e03
Add details on implementation options
rgommers Jan 6, 2021
3291dd9
Add details about the C implementation
rgommers Jan 6, 2021
e8caeba
Add an image of the dataframe model and its memory layout.
rgommers Jan 6, 2021
c5de640
Add link to discussion on array-dataframe connection
rgommers Jan 6, 2021
93d6e69
Some more updates for review comments
rgommers Jan 7, 2021
7d06066
Update table to indicate Arrow does support categoricals.
rgommers Jan 7, 2021
c0b5759
Add section on dtype format strings
rgommers Jan 7, 2021
6839642
Reflow some lines
rgommers Jan 8, 2021
53446ac
Add a requirement on semantic meaning of NaN/NaT, and timezone detail
rgommers Jan 8, 2021
b37ac91
Textual tweak: say columns in a data frame are ordered
rgommers Feb 9, 2021
be3cd32
Update requirements document for recent decisions/insights
rgommers Jun 25, 2021
File filter

Filter by extension

Filter by extension 8000
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Link to Release callback semantics in Arrow C Data Interface docs
  • Loading branch information
@rgommers
rgommers committed Jan 5, 2021
commit 82bc5ae959c09aa85e5bb7ffe3be1859c64ae7fb
2 changes: 1 addition & 1 deletion protocol/dataframe_protocol_summary.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -123,7 +123,7 @@ the [rationale for the Arrow C Data Interface](https://arrow.apache.org/docs/for
except `__dataframe__` is a Python-level rather than C-level interface.
_TODO: one key thing is Arrow C Data interface relies on providing a deletion
/ finalization method similar to DLPack. The desired semantics here need to
be ironed out._
be ironed out. See Arrow docs on [release callback semantics](https://arrow.apache.org/docs/format/CDataInterface.html#release-callback-semantics-for-consumers)_

The main (only?) limitation seems to be:
- No device support (@kkraus14 will bring this up on the Arrow dev mailing list)
Expand Down
0