Skip to content
This repository was archived by the owner on Jan 15, 2024. It is now read-only.

[CI] update batch to gluonnlp-dev#1268

Merged
szha merged 2 commits intodmlc:numpyfrom
szha:batchv2
Jul 18, 2020
Merged

[CI] update batch to gluonnlp-dev#1268
szha merged 2 commits intodmlc:numpyfrom
szha:batchv2

Conversation

@szha
Copy link
Member

@szha szha commented Jul 17, 2020

Description

update the numpy branch to use the new set of batch setup.

Checklist

Essentials

  • PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
  • Changes are complete (i.e. I finished coding on this PR)
  • Code is well-documented

Changes

  • new batch jobs for g4dn

Comments

  • I replicated the setup in the gluonnlp-dev account so that it doesn't affect the previous setup.

cc @dmlc/gluon-nlp-team

@codecov
Copy link

codecov bot commented Jul 17, 2020

Codecov Report

Merging #1268 into numpy will increase coverage by 0.08%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##            numpy    #1268      +/-   ##
==========================================
+ Coverage   82.45%   82.53%   +0.08%     
==========================================
  Files          38       38              
  Lines        5488     5446      -42     
==========================================
- Hits         4525     4495      -30     
+ Misses        963      951      -12     
Impacted Files Coverage Δ
src/gluonnlp/layers.py 86.78% <0.00%> (-0.45%) ⬇️
src/gluonnlp/models/transformer_xl.py 82.71% <0.00%> (-0.22%) ⬇️
src/gluonnlp/models/mobilebert.py 81.35% <0.00%> (-0.10%) ⬇️
src/gluonnlp/attention_cell.py 79.91% <0.00%> (-0.09%) ⬇️
src/gluonnlp/models/albert.py 96.66% <0.00%> (-0.08%) ⬇️
src/gluonnlp/data/tokenizers.py 77.71% <0.00%> (-0.07%) ⬇️
src/gluonnlp/models/transformer.py 95.95% <0.00%> (-0.04%) ⬇️
src/gluonnlp/sequence_sampler.py 86.32% <0.00%> (ø)
src/gluonnlp/models/bert.py 84.42% <0.00%> (+0.10%) ⬆️
src/gluonnlp/models/roberta.py 93.64% <0.00%> (+0.38%) ⬆️
... and 3 more

@szha szha force-pushed the batchv2 branch 2 times, most recently from dc9689c to 4a0b764 Compare July 17, 2020 01:42
Comment on lines +87 to +96
job_definitions = {
'g4dn.4x': 'gluon-nlp-1-jobs:5',
'g4dn.8x': 'gluon-nlp-1-jobs:4',
'g4dn.12x': 'gluon-nlp-1-4gpu-jobs:1',
'g4dn.16x': 'gluon-nlp-1-jobs:3',
'p3.2x': 'gluon-nlp-1-jobs:5',
'p3.8x': 'gluon-nlp-1-4gpu-jobs:2',
'p3.16x': 'gluon-nlp-1-8gpu-jobs:1',
'p3dn.24x': 'gluon-nlp-1-8gpu-jobs:2'
}
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These states are in gluonnlp-dev account. If we want to add storage or other peripherals we can edit them.

@szha szha merged commit e78a24e into dmlc:numpy Jul 18, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants