Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-22393][SPARK-SHELL] spark-shell can't find imported types in class constructors, extends clause #19846

Closed
wants to merge 2 commits into from

Conversation

mpetruska
Copy link
Contributor

What changes were proposed in this pull request?

SPARK-22393

How was this patch tested?

With a new test case in RepSuite


This code is a retrofit of the Scala SI-9881 bug fix, which never made it into the Scala 2.11 branches. Pushing these changes directly to the Scala repo is not practical (see: scala/scala#6195).

@mpetruska
Copy link
Contributor Author

Sorry, could not refactor the code better; since it makes heavy use of path-dependent types.

@srowen
Copy link
Member

srowen commented Nov 29, 2017

OK, so this just affects the Scala 2.11 REPL in Spark (good, because the 2.12 version works a little differently and the fix is already in 2.12), and you've just copied in the fixed classes and injected the fixed impl? sounds reasonable.

@mpetruska
Copy link
Contributor Author

@srowen Yes, exactly. Tried to minimize the risks of any problems caused by this change.

@SparkQA
Copy link

SparkQA commented Nov 29, 2017

Test build #3998 has finished for PR 19846 at commit 336446c.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@mpetruska mpetruska mentioned this pull request Nov 29, 2017
1 task
@HyukjinKwon
Copy link
Member

@mpetruska, btw can you fill up the PR description about how it fixes?

@mpetruska
Copy link
Contributor Author

@HyukjinKwon : Hi, yes: this is the "retrofitting" of the original bug fix, which never made it to Scala 2.11. Instead of copy-pasting the original discussion, let me link the original PR.
I can add more details about specific parts, of course.

@srowen
Copy link
Member

srowen commented Dec 1, 2017

Merged to master

@asfgit asfgit closed this in 9d06a9e Dec 1, 2017
@mpetruska mpetruska deleted the SPARK-22393 branch December 1, 2017 11:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants