PipeFunc
PipeFunc: Automate Python DAGs for Scientific Workflows - From Local to HPC with N-D Parameter Sweeps
pipefunc is a Python library that simplifies function composition and pipeline creation for scientific computing and data processing. It automatically generates DAGs from Python functions, efficiently handles N-dimensional parameter sweeps, and scales seamlessly from local to HPC environments. Key features include auto-parallization, N-dimensional map-reduce, and type checking. pipefunc minimizes boilerplate code, allowing users to focus on logic while it manages function dependencies and execution order. Ideal for complex workflows in data science, ML, and scientific computing.
Pinned Loading
Repositories
- graphviz-anywidget Public
Interactive Graphviz visualization widget for Jupyter notebooks using anywidget using Graphviz as Wasm, d3-graphviz, and graphvizsvg
pipefunc/graphviz-anywidget’s past year of commit activity - pipefunc Public
Lightweight fast function pipeline (DAG) creation in pure Python for scientific (HPC) workflows 🕸️🧪
pipefunc/pipefunc’s past year of commit activity - xyflow-anywidget Public
pipefunc/xyflow-anywidget’s past year of commit activity - graphvizsvg Public
A modern ESM module for interactive SVG visualization of Graphviz graph 🕸️🎨
pipefunc/graphvizsvg’s past year of commit activity - .github Public
pipefunc/.github’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…
