[Go to site: main page, start]

Python Distributed

Open-source Python projects categorized as Distributed
Edit details
Python Machine Learning Pytorch Deep Learning Data Science
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 23 Python Distributed Projects

Python logo
Distributed

  1. Ray

    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    Project mention: GSoC 2026 Predictions: 30 NEW AI/ML/Security Organizations You Should Start Contributing to NOW! | dev.to | 2026-02-06

    Main: https://github.com/ray-project/ray ⭐ 34k+

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. optuna

    A hyperparameter optimization framework

    Project mention: Fast Automatic ML Hyperparameter tuning Using Optuna (w. MLflow model registry and IRIS DB) | dev.to | 2026-06-16

    Optuna is a hyperparameter optimization framework that speeds up tuning by training multiple model configurations and learning from their results. It provides:

  4. modin

    Modin: Scale your Pandas workflows by changing a single line of code

  5. scrapy-redis

    Redis-based components for Scrapy.

  6. Gerapy

    Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

  7. arq

    Fast job queuing and RPC in python with asyncio and redis.

  8. lingvo

    Lingvo

  9. fugue

    A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

  10. MLBox

    MLBox is a powerful Automated Machine Learning python library.

  11. pottery

    Redis for humans. 🌎🌍🌏

  12. kubetorch

    Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.

  13. quokka

    Making data lake work for time series (by marsupialtail)

  14. code2vec

    TensorFlow code for the neural network presented in the paper: "code2vec: Learning Distributed Representations of Code"

  15. evotorch

    Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.

  16. AgileRL

    Streamlining reinforcement learning with RLOps. State-of-the-art RL algorithms and tools, with 10x faster training through evolutionary hyperparameter optimization.

  17. bagua

    Bagua Speeds up PyTorch

  18. optuna-examples

    Examples for https://github.com/optuna/optuna

  19. Pyrlang

    Erlang node implemented in Python 3.5+ (Asyncio-based)

  20. wakaq

    Background task queue for Python backed by Redis, a super minimal Celery

  21. malib

    A parallel framework for population-based multi-agent reinforcement learning.

  22. labgrid

    Embedded systems control library for development, testing and installation

  23. sheeprl

    Distributed Reinforcement Learning accelerated by Lightning Fabric

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Distributed discussion

Log in or Post with

Python Distributed related posts

  • Fast Automatic ML Hyperparameter tuning Using Optuna (w. MLflow model registry and IRIS DB)

    2 projects | dev.to | 16 Jun 2026

  • Show HN: Git-native-issue – issues stored as commits in refs/issues/

    3 projects | news.ycombinator.com | 24 Feb 2026

  • Message Queues: A Simple Guide with Analogies

    1 project | news.ycombinator.com | 12 Jan 2026

  • Optuna f-string Refactoring

    1 project | dev.to | 28 Oct 2025

  • From Knowledge Graph Generation to RAG for Stablecoin Regulatory Intelligence

    3 projects | dev.to | 6 Oct 2025

  • Show HN: Fine tuning and RLHF mistralai 7B using DeepSpeed

    1 project | news.ycombinator.com | 30 Jul 2025

  • Show HN: RLHF and Lora finetuning to mistralai 7B with DeepSpeed learning

    1 project | news.ycombinator.com | 30 Jul 2025
  • A note from our sponsor - SaaSHub
    www.saashub.com | 17 Jun 2026
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Distributed projects in Python? This list will help you:

# Project Stars
1 Ray 42,860
2 optuna 14,351
3 modin 10,391
4 scrapy-redis 5,633
5 Gerapy 3,497
6 arq 2,949
7 lingvo 2,864
8 fugue 2,165
9 MLBox 1,530
10 pottery 1,244
11 modal-examples 1,217
12 kubetorch 1,210
13 quokka 1,190
14 code2vec 1,144
15 evotorch 1,141
16 AgileRL 925
17 bagua 882
18 optuna-examples 850
19 Pyrlang 636
20 wakaq 596
21 malib 552
22 labgrid 479
23 sheeprl 433

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Loading...