Package profile
pyspark
- Summary: Apache Spark Python API
- Author: Spark Developers
- License: Apache-2.0
- Homepage: https://github.com/apache/spark/tree/master/python
- Source: https://github.com/apache/spark
- Number of releases: 78
- First release: 2.2.0 on 2017-07-12
- Latest release: 4.3.0 on 2026-10-30
- Latest release size: 434.8 MB (sdist)
12 known vulnerabilitiesLatest: GHSA-9437-39hj-3c93 — Apache Spark History Server allows stored cross-site scripting through unescaped application names View all →
Appears in:Dataframe libraries
Dependencies
Pyspark has 9 dependencies, 8 of which optional.View all 9 dependencies →Dependent packages
| Package | Optional | Group |
|---|---|---|
| dagster-pyspark | false | |
| delta-spark | false | |
| pyspark-stubs | false | |
| acryl-great-expectations | true | spark |
| apache-airflow-providers-apache-spark | true | pyspark |
Similar packages
- delta-sparkPython APIs for using Delta Lake with Apache Spark
- koalasKoalas: pandas API on Apache Spark
- sparkmeasurePython API for sparkMeasure, a tool for performance troubleshooting of Apache Spark workloads.
- yarn-api-clientPython client for Hadoop® YARN API
- azure-synapse-sparkMicrosoft Azure Synapse Spark Client Library for Python
- spark-sklearnIntegration tools for running scikit-learn on Spark
- mleapMLeap Python API