GGUF vs MLX on Apple Silicon
Everyone says the same thing: MLX is faster on Apple Silicon, and it makes sense, MLX was built for Apple's chips. I wanted to see if that holds up, so I tested it. I took Gemma 4 26B in both formats, GGUF and MLX, and ran the same tests on each, on my M3 Ultra.