forked from kayibal/sparsity
-
Notifications
You must be signed in to change notification settings - Fork 3
Refactor/binning #69
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Refactor/binning #69
Changes from 5 commits
Commits
Show all changes
33 commits
Select commit
Hold shift + click to select a range
58da78f
Implement distributed groupby sum and apply_concat_apply function for…
kayibal 51ae0a2
Merge branch 'master' into distributed-groupby-sum
kayibal 3f3be49
update comments
kayibal 63d4dc8
add test for different index datatypes
kayibal df110c9
implement sort_index
kayibal 49cb182
implement __len__
kayibal fd10c00
implement rename, optimize groupby_sum and join
kayibal b89f7d4
implement distributed set_index
kayibal bb818ff
Merge branch 'optimization/distributed' into develop
kayibal f942a91
Merge branch 'master' into refactor/binning
kayibal d2b68e3
Formatting
kayibal 2d2ab88
fix dask version until we have an update
kayibal 8fc32b8
number of line ouput in __repr__ changed.
kayibal 47782ed
stop checking for number of lines as it adjust to terminal size now...
kayibal 9c352f9
Create folders when writing to local filesystem
kayibal cd2ce7b
Merge branch 'master' into refactor/binning
kayibal fcdd167
Fix empty dtype
kayibal 18469ff
Implement distributed drop.
kayibal 4876190
Always add npz extension when writing SparseFrame to npz format
kayibal 4c18873
Fix metadata handling on set_index method
kayibal 80aef8e
Correct dask requirement
kayibal 414c69a
Add method for dask SparseFrame and tuple divisions type
kayibal f0aa2d8
Support empty divisions
kayibal 3329492
Pass on divisions on sort_index
kayibal 3223850
More restrictive pandas version as .drop method fails with pandas==0.…
kayibal a603d3d
Fix bug where empty dataframe would create wrongly sized shuffle array
kayibal 92a8f5d
Fix bug where join with in memory sparse frame would return rows from…
kayibal c6fa6d0
update dask version
kayibal d60b758
Update dask version in setup.py
kayibal 031d965
Update deprecated set_options call
kayibal 734ff26
some fixes to tests
kayibal fbf0b17
Fix moto and boto versions
kayibal b836024
Update test dependencies
kayibal File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Shouldn't this be consistent with setup.py? Or shouldn't it be done by
pip install .[test]?There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thx it is resolved