Apple announced new on device inference engine for Apple Silicon

In three linesApple announced CoreAI at WWDC, an on-device inference engine to replace CoreML. Supports models up to 20B parameters via Python conversion. Performance vs MLX/llama.cpp not yet documented.

Summary generated by Claude — human-verified