[SPARK-6278][MLLIB] Mention the change of objective in linear regression#4978
[SPARK-6278][MLLIB] Mention the change of objective in linear regression#4978mengxr wants to merge 4 commits intoapache:masterfrom
Conversation
There was a problem hiding this comment.
Apache is out-of-sync again. This is the only change in this PR.
There was a problem hiding this comment.
chose -> choose, and I suppose it could be made a little more crystal-clear by saying the step size needs to be multiplied by 2 ('scaled' somehow could mean divide or multiply, to me).
|
Test build #28465 has started for PR 4978 at commit
|
|
Test build #28465 has finished for PR 4978 at commit
|
|
Test PASSed. |
|
Test build #28506 has started for PR 4978 at commit
|
|
Test build #28506 has finished for PR 4978 at commit
|
|
Test FAILed. |
There was a problem hiding this comment.
Hm, it also occurred to me that if the step size doubles, then it affects the regularization parameter as well. Doesn't it have to be half as large as well in order to get the same result? I'm probably overlooking something about the formulation, but I didn't see the reg param updated in a96b727 and if the loss term was halved, leaving all else equal, the regularization term is relatively twice as large right?
There was a problem hiding this comment.
Right. The L2 regularization term didn't change. So to generate the exact result, we need to reduce the regularization constant by half and multiply the step size by 2.
|
Test build #28539 has started for PR 4978 at commit
|
|
Test build #28539 has finished for PR 4978 at commit
|
|
Test PASSed. |
|
Merged into master and branch-1.3. |
As discussed in the RC3 vote thread, we should mention the change of objective in linear regression in the migration guide. srowen Author: Xiangrui Meng <meng@databricks.com> Closes #4978 from mengxr/SPARK-6278 and squashes the following commits: fb3bbe6 [Xiangrui Meng] mention regularization parameter bfd6cff [Xiangrui Meng] Merge remote-tracking branch 'apache/master' into SPARK-6278 375fd09 [Xiangrui Meng] address Sean's comments f87ae71 [Xiangrui Meng] mention step size change (cherry picked from commit 7f13434) Signed-off-by: Xiangrui Meng <meng@databricks.com>
As discussed in the RC3 vote thread, we should mention the change of objective in linear regression in the migration guide. @srowen