PopPy: Opportunistically Exploiting Parallelism in Python Compound AI Applications

In three linesPopPy is a system that automatically uncovers parallelization opportunities in Python compound AI applications (multiple ML model calls). On real-world applications, PopPy achieves up to 6.4× speedups in end-to-end execution time, combining an ahead-of-time compiler and runtime to handle language complexity, dynamic dispatch, and variable mutation.

Summary generated by Claude — human-verified