Installation Guide

WPipe is distributed via PyPI and is designed to be lightweight with minimal external dependencies.

1. Requirements

  • Python: 3.9, 3.10, 3.11, or 3.12+ (Recommended).

  • OS: Linux (Optimized for Ubuntu/Debian), macOS, Windows (WSL recommended).

2. Standard Installation

Most users should install the stable release via pip:

pip install wpipe

3. Advanced Installation

If you need specific development tools or the latest source code:

Includes testing frameworks (pytest, ruff, mypy).

pip install "wpipe[dev]"

Includes Sphinx and themes for building these docs locally.

pip install "wpipe[docs]"
git clone https://github.com/wisrovi/wpipe
cd wpipe
pip install -e .

4. Containerized (Docker)

For cloud deployments, we recommend using the official Python slim images.

FROM python:3.11-slim
RUN pip install wpipe
COPY my_pipeline.py .
CMD ["python", "my_pipeline.py"]

5. Verification

Ensure the engine is correctly balanced:

import wpipe
print(wpipe.__version__)  # Should return 2.4.0

6. Troubleshooting

Issue

Solution

SQLite Error

Ensure your filesystem supports file locking (required for WAL mode).

Memory Limit Failed

memory_limit utilities require Linux cgroups. Use Docker if on Windows/Mac.

Module Not Found

Ensure your virtual environment is active.