diff --git a/doc/design/initialization.md b/doc/design/initialization.md
new file mode 100644
index 00000000000000..6b5ff67e14763d
--- /dev/null
+++ b/doc/design/initialization.md
@@ -0,0 +1,13 @@
+# Initialization of Parameters
+
+## Motivation
+
+PaddlePaddle needs a way to init parameters.
+
+## Challenge
+
+Initialization operators must run once and only one; otherwise, every iteration would clear the parameters.
+
+## Solution: Two seperate `ProgramDesc`.
+
+The initialization part of the program in a `ProgramDesc` message, and the rest part in another.