Skip to content

Initialization design doc #4852

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 6 commits into from
Closed

Initialization design doc #4852

Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
d76a4ae
Create initialization.md
Oct 17, 2017
dc7a650
Update initialization.md
wangkuiyi Oct 17, 2017
d65fc83
Update initialization.md
wangkuiyi Oct 17, 2017
e6b3b31
formatting
Oct 17, 2017
50ce87c
Merge remote-tracking branch 'upstream/develop' into init-design
Oct 19, 2017
b1dd9c6
update doc conclusion
Oct 19, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions doc/design/initialization.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
# Initialization of Parameters

## Motivation

PaddlePaddle needs a way to init parameters.

## Challenge

Initialization operators must run once and only one; otherwise, every iteration would clear the parameters.

## Solution: Two seperate `ProgramDesc`.

The initialization part of the program in a `ProgramDesc` message, and the rest part in another.