A hardware-native autonomous AI agent for macOS. Built on Swift 6 UNO architecture, running entirely on Apple Silicon via local MLX inference.
Pheron Agent is built with native Apple hardware components to achieve speeds unmatched by cloud-based alternatives.
On-device MLX inference featuring wired memory pinning, 4-bit KV quantization, rotating cache (up to 131K context), and speculative decoding via custom draft models.
Hardware-accelerated task routing executed directly on the Apple Neural Engine. Routes prompts to tools, weather, chat, or LLM fallback in milliseconds.
Structured memory layers: L1 Hot Cache (12 messages), L2 Daily Notes, and L3 DreamBank long-term summaries coupled with Metal-accelerated RAG via custom Metal kernels.
Monitored via PheronEnergyDaemon XPC helper utilizing powermetrics at 100ms intervals for exact, hardware-level Joule accounting per task execution.
Rule-based + local LLM PII detection before any external routing, executing PASS, DESENSITIZE, or BLOCK decisions. Direct security audit inquiries: privacy@pheronagent.com.
Self-improving procedural memory. The agent writes and patches its own .skill.md tool scripts, while a background curator Actor consolidates skills across sessions.
All models run entirely on-device via MLX. No internet required. Tool calling and thinking mode support varies by architecture.
| Model | Architecture | Quantization | Min RAM | Speed (M4) | Tool Calling | Thinking Mode |
|---|---|---|---|---|---|---|
| Qwen3.5 4B Hibrit GatedDeltaNet + full-attention mimarisi. | Qwen 3.5 | 4-bit MLX | 6 GB UMA | ~80 tok/s | ✓ | ✓ |
| Qwen3.5 9B 16 GB cihazlar için varsayılan model. | Qwen 3.5 | 4-bit MLX | 10 GB UMA | ~50 tok/s | ✓ | ✓ |
| Qwen3.5 9B OptiQ Karma-hassasiyetli, daha yüksek kalite. | Qwen 3.5 | OptiQ 4-bit | 10 GB UMA | ~50 tok/s | ✓ | ✓ |
| Qwen3.5 27B 24–32 GB Mac'ler için ideal. | Qwen 3.5 | 4-bit MLX | 18 GB UMA | ~20 tok/s | ✓ | ✓ |
| Llama 3.2 1B Ultra-lightweight model. | Llama 3.2 | 4-bit MLX | 2 GB UMA | ~180 tok/s | ✓ | — |
| Llama 3.2 3B M1/M2 base cihazlar için varsayılan fallback. | Llama 3.2 | 4-bit MLX | 4 GB UMA | ~120 tok/s | ✓ | — |
| Llama 3.1 8B Standart Llama 3.1 8B instruct. | Llama 3.1 | 4-bit MLX | 8 GB UMA | ~35 tok/s | ✓ | — |
| Llama 3.3 70B İleri düzey akıl yürütme, Workstation seviyesi. | Llama 3.3 | 4-bit MLX | 48 GB UMA | ~10 tok/s | ✓ | — |
| Llama 4 Scout ⚠️ Experimental — Pinned mlx-swift-lm sürümünde llama4 tipi kayıtsızdır. | Llama 4 MoE | 4-bit MoE | 80 GB UMA | ~8 tok/s | ✓ | — |
| Llama 4 Maverick ⚠️ Experimental — Dev MoE model (72 shard). Llama4 tipi kayıtsızdır. | Llama 4 MoE | 4-bit MoE | 512 GB UMA | ~3 tok/s | ✓ | — |
| Gemma 3 1B Hafif ve son derece hızlı Gemma model. | Gemma 3 | 4-bit MLX | 2 GB UMA | ~250 tok/s | — | — |
| Gemma 3 4B Dengeli Gemma 3 performansı. | Gemma 3 | 4-bit MLX | 6 GB UMA | ~85 tok/s | — | — |
| Gemma 3 12B 16 GB RAM için yüksek başarımlı Gemma. | Gemma 3 | 4-bit MLX | 12 GB UMA | ~35 tok/s | — | — |
| Gemma 3 27B Karmaşık görevler için Gemma 3. | Gemma 3 | 4-bit MLX | 24 GB UMA | ~20 tok/s | — | — |
| Gemma 4 E4B Yeni nesil dense 4.5B model, tool calling ve thinking destekli. | Gemma 4 | 4-bit MLX | 8 GB UMA | ~60 tok/s | ✓ | ✓ |
| Gemma 4 26B ⚠️ Experimental — experts/router desteği kısıtlıdır (mlx-swift-lm#282). | Gemma 4 MoE | 4-bit MoE | 20 GB UMA | ~25 tok/s | ✓ | ✓ |
| Mistral 7B v0.3 Güvenilir Mistral 7B aracı. | Mistral | 4-bit MLX | 8 GB UMA | ~45 tok/s | ✓ | — |
| Mistral Nemo 12B Geniş 128K bağlam pencereli dengeli model. | Mistral | 4-bit MLX | 12 GB UMA | ~30 tok/s | ✓ | — |
| Mistral Small 24B Genel görevler için Mistral Small. | Mistral | 4-bit MLX | 16 GB UMA | ~18 tok/s | ✓ | — |
| Mistral Small 3.2 24B Mistral Small 3.2, geliştirilmiş tool calling. | Mistral | 4-bit MLX | 16 GB UMA | ~18 tok/s | ✓ | — |
| Devstral Small 24B ⚠️ Experimental — mlx-vlm ile dönüştürülmüş geliştirici odaklı model. | Mistral | 4-bit MLX | 24 GB UMA | ~17 tok/s | ✓ | — |
| Mistral Large 123B Büyük ölçekli Mistral Large model. | Mistral | 4-bit MLX | 128 GB UMA | ~6 tok/s | ✓ | — |
| Devstral 2 123B ⚠️ Experimental — ministral3 mimari tipi şu an kayıtsızdır. | Mistral | 4-bit MLX | 128 GB UMA | ~6 tok/s | ✓ | — |
| Phi-4 Mini Microsoft'un native function calling yetenekli akıl yürütme modeli. | Phi 4 | 4-bit MLX | 4 GB UMA | ~150 tok/s | ✓ | — |
| Phi-4 14B Phi-4 14B instruct model. | Phi 4 | 4-bit MLX | 12 GB UMA | ~35 tok/s | — | — |
| DeepSeek Coder V2 Lite ⚠️ Experimental — deepseek_v2 mimari tipi şu an kayıtsızdır. | DeepSeek MoE | 4-bit MoE | 12 GB UMA | ~30 tok/s | — | — |
| DeepSeek V4 Flash ⚠️ Experimental — deepseek_v4 mimari tipi şu an kayıtsızdır. | DeepSeek MoE | 4-bit MoE | 192 GB UMA | ~4 tok/s | ✓ | ✓ |
| Qwen2.5-VL 3B 24GB+ bellek gerektiren Vision-Language modeli. | Qwen 2.5 VL | 4-bit MLX | 24 GB UMA | ~20 tok/s | — | — |
| Qwen3-VL 4B 32GB+ bellek gerektiren Vision-Language modeli. | Qwen 3 VL | 4-bit MLX | 32 GB UMA | ~18 tok/s | — | — |
| Qwen2.5-VL 7B 48GB+ bellek gerektiren Vision-Language modeli. | Qwen 2.5 VL | 4-bit MLX | 48 GB UMA | ~10 tok/s | — | — |
Pheron Agent automatically selects the best model for your hardware. All tiers require macOS 15.0+ and Apple Silicon.
Speed figures are benchmarked on M4. M1/M2 devices run approximately 2–3× slower on equivalent models. Semantic VLM (visual understanding) requires 24 GB+ unified memory.