Skip to content

Refactor/binning#69

Merged
kayibal merged 33 commits intomasterfrom
refactor/binning
Dec 4, 2018
Merged

Refactor/binning#69
kayibal merged 33 commits intomasterfrom
refactor/binning

Conversation

@kayibal
Copy link
Copy Markdown

@kayibal kayibal commented Oct 8, 2018

Changes necessary to make distributed binning algorithm work

kayibal added 12 commits March 7, 2018 13:49
# Conflicts:
#	sparsity/test/test_dask_sparse_frame.py
implements distributed rename method and adds quicker routines to groupby_sum if divisions are known. Adds support for joining sp.SparseFrames onto a distributed SparseFrame.
# Conflicts:
#	sparsity/dask/core.py
# Conflicts:
#	sparsity/dask/core.py
#	sparsity/dask/shuffle.py
#	sparsity/sparse_frame.py
#	sparsity/test/test_dask_sparse_frame.py
@codecov
Copy link
Copy Markdown

codecov bot commented Oct 8, 2018

Codecov Report

Merging #69 into master will decrease coverage by 0.15%.
The diff coverage is 61.53%.

Impacted file tree graph

@@            Coverage Diff            @@
##           master     #69      +/-   ##
=========================================
- Coverage   89.65%   89.5%   -0.16%     
=========================================
  Files           7       7              
  Lines        1179    1200      +21     
=========================================
+ Hits         1057    1074      +17     
- Misses        122     126       +4
Impacted Files Coverage Δ
sparsity/dask/multi.py 87.93% <ø> (+3.44%) ⬆️
sparsity/sparse_frame.py 91.41% <0%> (+0.39%) ⬆️
sparsity/dask/shuffle.py 95% <100%> (ø) ⬆️
sparsity/dask/io.py 92.3% <50%> (-0.96%) ⬇️
sparsity/dask/core.py 84.84% <63.63%> (-1.06%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 43d1a44...b836024. Read the comment docs.

@kayibal kayibal requested review from michcio1234 and vitords October 9, 2018 09:03
assert isinstance(res, str)
assert '10x10000' in res
assert '0 stored' in res
assert len(res.splitlines()) == 1 + 5 + 2
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why did the lines number change? I can't see any change that you made that should affect it...

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it's related to pandas version...

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well, I hope our __repr__ still makes sense then...

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It should just lines change I think depending on your terminal size? Don't know...

Copy link
Copy Markdown

@michcio1234 michcio1234 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just one question.

- checkout
- run: pip install pytest pytest-cov moto dask==0.19.2 .
- run: pip install boto3==1.7.84 botocore==1.10.84 moto==1.3.6
- run: pip install pytest pytest-cov dask==1.0.0 .
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't this be consistent with setup.py? Or shouldn't it be done by pip install .[test]?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thx it is resolved

@kayibal kayibal merged commit 4751444 into master Dec 4, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants