8000 PERF: Add cache keyword to to_datetime (#11665) by mroeschke · Pull Request #17077 · pandas-dev/pandas · GitHub
[go: up one dir, main page]
Skip to content

PERF: Add cache keyword to to_datetime (#11665) #17077

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 25 commits into from
Nov 11, 2017
Merged

PERF: Add cache keyword to to_datetime (#11665) #17077

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
7f67ac9
move cache into convert_listlike
mroeschke Sep 6, 2017
a7c65f7
Move cache down the stack, explore threshold to trigger cache
mroeschke Sep 9, 2017
243349a
Add more cache conditions
mroeschke Sep 11, 2017
d154a6d
Add some benchmarks
mroeschke Sep 11, 2017
b5e71d2
Some performance testing
mroeschke Sep 14, 2017
fb2e831
Add asvs, modify tests for caches
mroeschke Sep 25, 2017
33c79d3
Fix asv errors and condition
mroeschke Sep 26, 2017
dcaafb6
Pep8 fixes
mroeschke Sep 26, 2017
04df9d9
Remove unused import
mroeschke Sep 26, 2017
34b468f
Wrap cache logic in a function
mroeschke Sep 26, 2017
d287cc6
Fix Series test
mroeschke Sep 26, 2017
1bf4c9d
Add whatsnew and small documentation fix
mroeschke Sep 26, 2017
3ffdd46
pep 8 fixes
mroeschke Sep 26, 2017
a093b88
Move box logic into maybe_convert_cache
mroeschke Oct 9, 2017
d1fc211
Use quicker unique check
mroeschke Oct 20, 2017
9486df3
Move caching function outside to_datetime
mroeschke Nov 4, 2017
d059d44
Pass most tests
mroeschke Nov 5, 2017
02ab4f3
Skip test related to GH 18111, lint
mroeschke Nov 5, 2017
82f36d3
Update docstring
mroeschke Nov 6, 2017
76547e1
adjust imports, docs and move whatsnew
mroeschke Nov 8, 2017
590c9cc
Remove whitespace
mroeschke Nov 8, 2017
9a985ac
Address comments
mroeschke Nov 9, 2017
85a1f2d
Lint fix
mroeschke Nov 9, 2017
49f5850
Move docs and adjust test
mroeschke Nov 10, 2017
07fa22d
Lint
mroeschke Nov 11, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add whatsnew and small documentation fix
  • Loading branch information
@mroeschke
mroeschke committed Nov 11, 2017
commit 1bf4c9dd0ab8be7094d935a9ddc889e81e153ae6
1 change: 1 addition & 0 deletions doc/source/whatsnew/v0.21.0.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -999,6 +999,7 @@ Performance Improvements
- :attr:`Timestamp.microsecond` no longer re-computes on attribute access (:issue:`17331`)
- Improved performance of the :class:`CategoricalIndex` for data that is already categorical dtype (:issue:`17513`)
- Improved performance of :meth:`RangeIndex.min` and :meth:`RangeIndex.max` by using ``RangeIndex`` properties to perform the computations (:issue:`17607`)
- Added a keyword argument, `cache`, to :func:`to_datetime` that improved the performance of converting duplicate datetime arguments (:issue: `11665`)

.. _whatsnew_0210.docs:

Expand Down
2 changes: 1 addition & 1 deletion pandas/core/tools/datetimes.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -114,7 +114,7 @@ def to_datetime(arg, errors='raise', dayfirst=False, yearfirst=False,
.. versionadded: 0.20.0
cache : boolean, default False
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

default is True

If True, use a cache of unique, converted dates to apply the datetime
conversion. Produces signficant speed-ups when parsing duplicate date.
conversion. Produces signficant speed-ups when parsing duplicate dates.

.. versionadded: 0.21.0
Returns
Expand Down
0