-
Notifications
You must be signed in to change notification settings - Fork 28.6k
Insights: apache/spark
Overview
-
0 Active issues
-
- 0 Merged pull requests
- 22 Open pull requests
- 0 Closed issues
- 0 New issues
Could not load contribution data
Please try again later
22 Pull requests opened by 22 people
-
[SPARK-52306][SQL] Add support of ALTER TABLE ... UNSET SERDEPROPERTIES
#51017 opened
May 26, 2025 -
[SPARK-52307][PYTHON][CONNECT] Support Scalar Arrow Iterator UDF
#51018 opened
May 26, 2025 -
[SPARK-52308][CORE] Fix the bug that the actual configs of the driver are overwritten
#51019 opened
May 26, 2025 -
[SPARK-44223][CORE] Remove LevelDB support
#51027 opened
May 27, 2025 -
[SPARK-52326][SQL] Add partitions related ExternalCatalogEvent and post them in corresponding operations
#51030 opened
May 27, 2025 -
Added s3 offloading technique for RDD
#51042 opened
May 28, 2025 -
[SPARK-52339][SQL] Fix comparison of `InMemoryFileIndex` instances
#51043 opened
May 28, 2025 -
Move `DefineSqlGraphElements` to `PipelineCommand`
#51044 opened
May 28, 2025 -
[SPARK-52327][Core] Glob based provider for history server
#51045 opened
May 29, 2025 -
[SPARK-51831][SQL] Column pruning with existsJoin for Datasource V2
#51046 opened
May 29, 2025 -
Supports file pruning when underlying Delta Parquet files are explici…
#51049 opened
May 29, 2025 -
[SPARK-52346][SQL] Declarative Pipeline `DataflowGraph` execution and event logging
#51050 opened
May 29, 2025 -
[SPARK-48356][FOLLOW UP][SQL] Improve FOR statement's column schema inference
#51053 opened
May 30, 2025 -
[SPARK-52337][CONNECT] Make InvalidPlanInput a user-facing error
#51054 opened
May 30, 2025 -
Test sbt 1.11.0
#51055 opened
May 30, 2025 -
[SPARK-52353] Fix bug with wrong constraints in LogicalRDDs referencing previous iterations
#51056 opened
May 30, 2025 -
[SPARK-52348] [WIP] [DRAFT] Add support for Spark Connect handlers for pipeline commands
#51057 opened
May 30, 2025 -
[WIP][SPARK-52356][PS] Enable divide-by-zero for boolean mod/rmod with ANSI enabled
#51058 opened
May 30, 2025 -
[SPARK-52363] [SQL] Analyzer NameScope test for nested struct fields inside map values
#51059 opened
May 31, 2025 -
[SPARK-52372][SQL] Fix error handling in `ApplyDefaultCollationToStringType`
#51060 opened
May 31, 2025
23 Unresolved conversations
Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.
-
[SPARK-52283][SQL] Declarative Pipelines `DataflowGraph` creation and resolution
#51003 commented on
Jun 1, 2025 • 98 new comments -
[SPARK-52187][SQ 958B L] Introduce Join pushdown for DSv2
#50921 commented on
May 29, 2025 • 15 new comments -
[SPARK-51987][SQL] DSv2 expressions in column defaults on write
#51002 commented on
May 30, 2025 • 12 new comments -
[SPARK-48660][SQL] Fix explain result for CreateTableAsSelect
#51013 commented on
May 28, 2025 • 9 new comments -
[SPARK-52281][SQL] Change `ALTER TABLE ALTER COLUMN TYPE STRING` not to apply default collation if original data type was instance of `StringType`
#51001 commented on
May 30, 2025 • 9 new comments -
[SPARK-52288][PS] Avoid INVALID_ARRAY_INDEX in `split`/`rsplit` when ANSI mode is on
#51006 commented on
May 28, 2025 • 4 new comments -
[SPARK-47547] BloomFilter fpp degradation
#50933 commented on
May 30, 2025 • 4 new comments -
Enable -Xsource:3 compiler flag
#50474 commented on
May 29, 2025 • 2 new comments -
[SPARK-51069][SQL] Add big-endian support to UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl
#49773 commented on
May 27, 2025 • 1 new comment -
[SPARK-52082][PYTHON][DOCS] Improve ExtractPythonUDF docs
#50867 commented on
May 28, 2025 • 1 new comment -
[SPARK-52065][SQL] Produce another plan tree with output columns (name, data type, nullability) in plan change logging
#50852 commented on
May 29, 2025 • 1 new comment -
[SPARK-52265][SQL][TEST] Fix regex leading to empty PROCESS_TABLES.testingVersions in HiveExternalCatalogVersionsSuite
#50989 commented on
May 27, 2025 • 0 new comments -
[SPARK-52212][PYTHON][INFRA] Upgrade linter image to python 3.11
#50931 commented on
May 28, 2025 • 0 new comments -
[SPARK-52024][SQL] Support cancel ShuffleQueryStage when propagate empty relations
#50814 commented on
Jun 1, 2025 • 0 new comments -
[SPARK-51919][PYTHON] Allow overwriting statically registered Python Data Source
#50716 commented on
May 28, 2025 • 0 new comments -
Test rockdbsjni 10
#50688 commented on
May 26, 2025 • 0 new comments -
[SPARK-51534][Core] Improve parquet read performance by reducing unnecessary operations when converting parquet to row
#50297 commented on
May 26, 2025 • 0 new comments -
[SPARK-51016][SQL] Stage.isIndeterminate gives wrong result in case the shuffle partitioner uses an inDeterministic attribute or expression.
#50029 commented on
Jun 1, 2025 • 0 new comments -
[SPARK-51253][SQL][CONNECT] Mapped KVDS.agg should support sql-expressions
#49999 commented on
Jun 1, 2025 • 0 new comments -
[WIP] TransformWithState docs
#49914 commented on
Jun 1, 2025 • 0 new comments -
[SPARK-50903][CONNECT] Cache logical plans after analysis
#49584 commented on
May 27, 2025 • 0 new comments -
[SPARK-45926][SQL] Implementing equals and hashCode which takes into account pushed runtime filters , in InMemoryTable related scans
#49153 commented on
Jun 1, 2025 • 0 new comments -
[SPARK-49386][SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill
#47856 commented on
May 26, 2025 • 0 new comments