Little gems

https://www.trickster.dev/post/lesser-known-parts-of-python-standard-library/

Dependency management

https://nielscautaerts.xyz/python-dependency-management-is-a-dumpster-fire.html

Create a definition file
Generate a lock file
Sync your environment with the lock file
Track both the definition file and the lock file in version control
As of Nov 2024, use uv (pypi ecosystem) or Pixi (Conda)

https://dublog.net/blog/so-many-python-package-managers/

Best practices

https://www.b-list.org/weblog/2022/may/13/boring-python-dependencies/

always work in, and deploy in, a virtual environment
specify a range of versions you’re willing to accept for direct dependencies
“compile” a list of direct dependencies to a full pinned and hashed tree of all your dependencies (see pip-tools below)
requirements/app.in → app.txt

`pip-tools`

https://til.simonwillison.net/python/pip-tools

compile requirements.in → requirements.txt
sync

Modern use of pyproject.toml with setuptools

PEP-517
PEP-518
pyproject.toml

Awesome example

https://github.com/tiangolo/fastapi/blob/master/pyproject.toml

https://godatadriven.com/blog/a-practical-guide-to-setuptools-and-pyproject-toml/

https://hynek.me/til/pip-tools-and-pyproject-toml/

https://snarky.ca/what-the-heck-is-pyproject-toml/

https://setuptools.pypa.io/en/latest/userguide/pyproject_config.html

http://ivory.idyll.org/blog/2021-transition-to-pyproject.toml-example.html

Rye

https://rye.astral.sh/

All-in-one tooling written in Rust (dependencies, linter, build, publish)
- Wrapper for a number of standard tools

Why avoid Poetry

https://usrme.xyz/posts/why-i-moved-away-from-poetry-for-python/#the-fault-in-poetrys-stars

Version of dependencies

https://stackoverflow.com/questions/54720072/dependency-version-syntax-for-python-poetry

how to specify loose versions in setup.py, requirements.in or pyproject.toml

Don’t cap upper versions

https://iscinumpy.dev/post/bound-version-constraints/#tldr

ALL packaging and distribution tools

https://packaging.python.org/en/latest/key_projects.html

Project template with cookiecutter

https://github.com/TezRomacH/python-package-template

Dev tools

To create CLI tools

https://click.palletsprojects.com/en/stable/

https://google.github.io/python-fire/

Modules that double as CLI commands

https://www.pythonmorsels.com/cli-tools/

http.server
webbrowser
json.tool
calendar
…
pip, venv, pdb
zipapp
tokenize, ast, dis, inspect, pyclbr
asyncio
cProfile, profile, pstats
pickle, pickletools

Hot reloading

https://github.com/reloadware/reloadium

Profilers

Scalene

https://github.com/plasma-umass/scalene

CPU, GPU, memory
Percentage in Python vs C

Memray

https://github.com/bloomberg/memray

Tools for code quality

https://missing.csail.mit.edu/2020/debugging-profiling/

https://testdriven.io/blog/python-code-quality

linters
formatters
code quality scanners
CI setup

Cached package installation with wheels

Example from Earthly

https://github.com/earthly/earthly/blob/main/examples/python/Earthfile

VERSION 0.7
FROM python:3
WORKDIR /code

deps:
    RUN pip install wheel
    COPY requirements.txt ./
    RUN pip wheel -r requirements.txt --wheel-dir=wheels

build:
    FROM +deps
    COPY src src
    SAVE ARTIFACT src /src
    SAVE ARTIFACT wheels /wheels

docker:
    COPY +build/src src
    COPY +build/wheels wheels
    COPY requirements.txt ./
    RUN pip install --no-index --find-links=wheels -r requirements.txt
    ENTRYPOINT ["python3", "./src/hello.py"]
    SAVE IMAGE --push earthly/examples:python