Skip to content

Use vertices SparkSession#474

Merged
rjurney merged 2 commits into
graphframes:masterfrom
Nassizouz:patch-1
Jan 17, 2025
Merged

Use vertices SparkSession#474
rjurney merged 2 commits into
graphframes:masterfrom
Nassizouz:patch-1

Conversation

@Nassizouz

Copy link
Copy Markdown
Contributor

The previous version of the GraphFrame class used the vertices SQLContext, when the code was changed to use SparkSession the thread's session was taken, this change can break old working code if the GraphFrame is initialized in a thread that didn't initialized a spark session.
This PR uses the vertices SparkSession so it will work regardless to whether a spark session was initialized on the current thread

* Use vertices `SparkSession` instead of the thread's
@rjurney

rjurney commented Jan 2, 2025

Copy link
Copy Markdown
Collaborator

@Nassizouz is there any way you can create a simple unit test for this?

@Nassizouz

Copy link
Copy Markdown
Contributor Author

@rjurney Added a simple unittest

@rjurney

rjurney commented Jan 17, 2025

Copy link
Copy Markdown
Collaborator

@Nassizouz Testing this now... thanks for the bugfix :) Keep it coming!

I need to merge my fix for Java 8 before I can test this in Java 8, one minute...

@rjurney rjurney merged commit 630f617 into graphframes:master Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants