Skip to content

Conversation

@hvanhovell
Copy link
Contributor

This PR enables users to create a UDAF in the REPL without getting a java.lang.InternalError.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am not catching a java.lang.InternalError here, because I think these shouldn't be caught at all (the error could have different cause). We enable the use to redefine the name to work arround this problem.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am wondering if we can catch the error and re-throw it with a more informative error message (we put InternalError as the cause of our new error)? In our error message, we can let the user know he/she potentially hit that Scala issue and the workaround is to override def name.

@SparkQA
Copy link

SparkQA commented Nov 9, 2015

Test build #45364 has finished for PR 9568 at commit 401230c.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So, this is the cause of that InternalError?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The getSimpleName call on the defined class causes the internal error.

@hvanhovell
Copy link
Contributor Author

@yhuai
Copy link
Contributor

yhuai commented Nov 10, 2015

How about we add the link to the scala issue in our description and in our code comment?

@hvanhovell
Copy link
Contributor Author

Sounds like a good idea. I'll add this in the morning.

@hvanhovell
Copy link
Contributor Author

Move to scala 2.10.5 fixed this. Closing PR.

@hvanhovell hvanhovell closed this Nov 11, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants