Skip to content

Spark 3.3, 3.4: Parallelize reading files in migrate procedures#11043

Merged
amogh-jahagirdar merged 2 commits into
apache:mainfrom
manuzhang:parallelize-migrate-procedures-backport
Sep 5, 2024
Merged

Spark 3.3, 3.4: Parallelize reading files in migrate procedures#11043
amogh-jahagirdar merged 2 commits into
apache:mainfrom
manuzhang:parallelize-migrate-procedures-backport

Conversation

@manuzhang

@manuzhang manuzhang commented Aug 29, 2024

Copy link
Copy Markdown
Member

This back-ports #9274 and #10037

cc @amogh-jahagirdar @nastra

@github-actions github-actions Bot added the spark label Aug 29, 2024
@manuzhang manuzhang force-pushed the parallelize-migrate-procedures-backport branch 2 times, most recently from b5f81c4 to 1fa210f Compare August 29, 2024 15:38
@manuzhang manuzhang force-pushed the parallelize-migrate-procedures-backport branch from 1fa210f to 8de193b Compare August 30, 2024 03:28
@amogh-jahagirdar

Copy link
Copy Markdown
Contributor

Thanks @manuzhang!

@amogh-jahagirdar amogh-jahagirdar merged commit f508a7e into apache:main Sep 5, 2024
zachdisc pushed a commit to zachdisc/iceberg that referenced this pull request Dec 23, 2024
@manuzhang manuzhang deleted the parallelize-migrate-procedures-backport branch March 2, 2026 07:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants