Batch Processing

Search every project in one place

Press / to search. Tap a tag to filter. Click any row for details.

Filtering for

Row number				Tags
1	pyspark Batch Processing	43,391	2026-06-03	Batch Processing Distributed Computing DevOps	→
	Apache Spark Python API.
	apache/github.com/apache/spark /2026-06-03
2	ray Batch Processing	42,762	2026-06-03	Batch Processing Distributed Computing DevOps	→
	A system for parallel and distributed Python that unifies the machine learning ecosystem.
	ray-project/github.com/ray-project/ray/ /2026-06-03
3	luigi Batch Processing	18,733	2026-05-19	Batch Processing Distributed Computing DevOps	→
	A module that helps you build complex pipelines of batch jobs.
	spotify/github.com/spotify/luigi /2026-05-19
4	dask Batch Processing	13,848	2026-06-03	Batch Processing Distributed Computing DevOps	→
	A flexible parallel computing library for analytic computing.
	dask/github.com/dask/dask /2026-06-03
5	joblib Batch Processing	4,361	2026-03-03	Batch Processing Distributed Computing DevOps	→
	A set of tools to provide lightweight pipelining in Python.
	joblib/github.com/joblib/joblib /2026-03-03
6	mpi4py Batch Processing	913	2026-05-18	Batch Processing Distributed Computing DevOps	→
	Python bindings for MPI.
	mpi4py/github.com/mpi4py/mpi4py /2026-05-18

Contribute

Know a project that belongs here?

Tell us what it does and why it stands out.

Submit a project Star the repository