Yes, an iPhone can run an LLM. Install an app that supports on-device models, download a model of about 2 to 5 GB, and it runs without an internet connection. You do not need a computer or a jailbreak.
What you need
- An iPhone with enough memory. iPhone 15 Pro and later models have 8 GB of RAM, which is the comfortable range. Older models can run smaller models.
- Free storage for the model, plus some spare room.
- An app. opchat needs iOS 17 or later. See other apps too.
Set it up in opchat
- Install opchat.
- Open Settings → Models → On this device.
- Choose a recommended model, or use Browse & Download Models to search Hugging Face. The app labels how well each model fits your phone.
- Wait for the download on Wi-Fi.
- Start a chat. It now works in airplane mode.
Which model to pick
Start with Gemma 4 E2B. It is about 3.1 GB as a GGUF file and our first recommendation. If your phone struggles, try a smaller model such as LFM3. On iPhones with more memory, you can try Gemma 4 E4B, at about 5 GB.
What to expect
- The first reply is slower, because the model has to load into memory.
- Long sessions warm the phone and use battery.
- Small models make mistakes, so verify anything important.
- iOS can close apps that use too much memory. If that happens, use a smaller model.
Want a bigger model some of the time? opchat can also connect to cloud models with your own API key.