Pinned Loading

1. coreml-llm-cli coreml-llm-cli Public

   CLI to demonstrate running a large language model (LLM) on Apple Neural Engine.

   Swift 131 11

2. CoreMLInspect CoreMLInspect Public

   See the device (CPU/GPU/ANE) and estimated cost for every layer in your CoreML model.

   Swift 26 3

3. ModernBERT-AppleNeuralEngine ModernBERT-AppleNeuralEngine Public

   ModernBERT model optimized for Apple Neural Engine.

   Python 39 2

4. more-ane-transformers more-ane-transformers Public

   Run transformers (incl. LLMs) on the Apple Neural Engine.

   Python 62 2

5. token-recycling token-recycling Public

   Unofficial implementation of Token Recycling self-speculative decoding method.

   Python 9 1

6. ganq ganq Public

   GPU Adaptive Non-Uniform Quantization (GANQ) Unofficial Implementation

   Python 4 1