System Performance

System performance of the new iPhones should be again excellent given the hardware advancements on the part of the new A14 chip. Alongside iOS14, we should really see no problem with everyday tasks on the phone.

Unfortunately, our benchmark suite for iOS here is still relatively barren, and we have to mostly rely on web browser benchmarks – which isn’t all too much of an issue given that’s the heaviest and most demanding every-day workload for mobile devices.

Speedometer 2.0 - OS WebView

In Speedometer 2, the new A14 showcases a large performance boost of 30% for the new iPhone generation. This is likely both due to the clock frequency increase of the new CPUs as well as the fact that the new microarchitecture has in particular a larger amount of FP/SIMD resources available to itself.

Usually at this point we would point out that it’s an apples-to-oranges comparison to other devices in the chart, and that Apple’s Nitro JavaScript engine could simply be much superior to Google’s V8 engine, but the new release of the Apple Silicon Macs where we could finally compare Safari versus Chrome has shown very little performance discrepancy, meaning the performance here is actually due to the CPUs themselves.

Having that in mind, it means that Apple’s performance advantage over Android devices has grown even bigger this generation, with little hope for upcoming Cortex cores to catch up with such a gap.

JetStream 2 - OS Webview

JetStream 2 has heavier workloads and also make uses of WebAssembly, averaging out a smaller performance increase for the new A14 chip, but still showcasing class-leading performance amongst the competition.

WebXPRT 3 - OS WebView

WebXPRT is a browser workload that tries to mimic real-world interactions and workloads. The new iPhone 12s here actually show very little progress in terms of performance.

This small progress in WebXPRT is actually quite representative of my overall impression of responsiveness of the new iPhones: The A13 and iPhone 11 devices were already so performant and responsive that the actual speed limit for user interactions nowadays are just OS animations and just general SoC DVFS, the latter which Apple has already optimised to an ideal operation a few years back.

I would be lying if I were to say that I noticed that the new iPhone 12s are any faster than the iPhone 11 in everyday usage, but that’s simply because these are already are outstandingly fast devices.

The Apple A14 SoC: Firestorm & Icestorm GPU Performance & Power
POST A COMMENT

105 Comments

View All Comments

  • zanon - Monday, November 30, 2020 - link

    Thanks for the review! I upgraded from an iPhone X to the 12 Pro Max this time around, and have been kicking the tires for a week and a half or so now. SO wanted a 12 Pro regular, and a friend got the plain 12. These days I think the additive improvements over 3-5 generations is probably how must people view these things, year-over-year upgrades, or even every 2 years, seems to quite reasonably be less common (which is a good thing). Coming directly from an X, the changes are quite significant. There are obvious sticker items like improved performance and cameras. But there is also more subtle yet extreme important day-to-day use stuff like the Face ID system being a lot more responsive and accepting more angles and distances now then the generation 1 I had before. Some other disagreement, agreement, and comment:

    Disagreement: I think you really missed the mark on how big a deal the new LIDAR sensor is for pro usage (you barely gave it a sentence) and in turn as a differentiator. In fact even though it's early days and rough, I think that might be one of the most significant Pro differentiators in a long time, "pro" here as-in actual contracting to make money. I've been trying it out with magicplan and RoomScanLiDAR and already used it at a project site. Apps like magicplan previously could be paired with bluetooth laser rangers and used that way (and still can of course), but from my testing so far the new built-in lidar does an extremely close and competent job in measuring over shorter distances and details, and you get a pretty passable v1 3D point cloud too for something you get in your pocket all the time for a few hundred extra. I was able to throw together for plans and basic 3D from scratch for a historic hotel and then use that for mockups and renovation deployment way, way better than I'd ever have expected even a year ago from a handheld with this pricing (dedicated laser 3D scan units have been available for a while, and will produce better results more quickly, but are NOT cheap or pocketable). Even the simple AR Measure app suddenly no longer feels gimicky or last resort but actually is usable without my measuring tape in many cases. The whole calibration thing is gone, it's fast, and accurate in my use to at least 1/2" which for bulk is often good enough.

    Again definitely early, early days. There are obvious holes in the apps, basic things like import are non-existent, etc etc. Yet even so it's already saved me some money and time in commercial work. As far as professional usage goes, it feels like a bigger leap forward in terms of the phone itself being a tool (vs an interface to other tools) than many things before.

    Agreement: I'm glad you highlighted that the new sharp edges are a definite step back in ergonomics. It was what struck me most immediately of course in terms of out-of-box experience. Maybe it works well for the Mini, but even on the regular (let alone the Max) the hand feel stinks compared to the iPhone X/XS/11. The edges really dig in and add to fatigue.

    However, some of that can be mitigated with a case, and that leads me to the comment that I strong suspect Apple is now designing the iPhone at least in part around case use. It's been a while since I last looked it up, but in a previous discussion we did some research and it looked like at least 75% (yes, 3/4) of phone users use cases. They're a big source of personalization, not just in terms of looks but adapting the phone to various personal use cases. Obviously drop/scratch protection to a customizable degree depending on whether someone tends to have accidents or works/hobbies in heavier duty environments, but also more exotic stuff like camera lens/telescope attachment (or just plain extra battery).

    That being the case (harhar), there a reasons to design the phone with that in mind. The camera bump for example, they extra z-distance is necessitated by the camera modules. But of course Apple could just make the whole phone thicker so that it was still smooth. And if it was expected the phone would be used bare, that'd make sense. But if it's expected it'll usually be in a case, it makes *more* sense to have it as it is now, because the available mm means the end result is something that provides whatever else the owner wants but being thinner, lighter and flush on the back than if it was a case over an already thickened device.

    As someone who has never dropped their expensive handheld stuff in 30 someodd years now and previously never bothered with a case, I do kind of miss good old naked devices. But I can't argue with the numbers either. And for the first time with the 12 I feel like a case is a requirement, not just a nice-to-have, it's too sharp and too slippery without it. Of course this makes the use of steel in the Pro even dumber, extra weight for absolutely nothing. I wonder why Apple didn't use titanium instead, they used to do a lot with that material and it seems like it'd let them claim a different "pro" material without so much weight. Oh well.

    Incidentally I think the Max might be the least popular model this time around. I was lazy about ordering, didn't bother for a few days. Yet it shipped almost instantly, while I know people who ordered regular 12s/12 Pros much more quickly than me (same channel/phone company) who are still waiting. Would be interesting if Apple breaks things out, the Mini and regular are really compelling this time (which is as it should be!).

    Thanks again for the review.
    Reply
  • zanon - Monday, November 30, 2020 - link

    Also to add: CreateML (https://developer.apple.com/documentation/createml... is starting to get really impressive, and that Apple has been expending effort to allow it to all stay local rather than dependent on cloud services is useful too. Given the review points out the minimal GPU improvements, it seems like there a implications worth considering given that Apple has chosen to spend a lot of silicon budget on specialized stuff, NN etc instead. At some point I'd like to see more bench marks and articles investigating how that stuff is getting used (even basic simple first party stuff like photo facial recognition), the performance, and what kinds of network dependency and privacy the various iOS/macOS/Android/Windows/Linux implementations have. It's going to be more challenging to to see where silicon budget is yielding gains, but some of that may ultimately matter more than raw CPU/GPU in a lot of day to day and application specific use. Reply
  • name99 - Monday, November 30, 2020 - link

    It's always difficult to know just how much of Apple's timing is planned and how much is luck.

    I think it's definitely planned that the MAC's this year have the same appearance as always, to reassure most buyers that while techies might get excited about the new internals, this is the same familiar mac as always.

    BUT I think it's also clear that the CPU/SoC this year had a very different set of priorities from performance, that it was basically more of the same. Changed where that was easy to do given the new process characteristics, but the emphasis on the stuff required for the mac, secondarily on peak power. I raise this because the corollary to the point I made above is that the best time to change the appearance is precisely when the internals are undergoing their least exciting change...

    If I had to guess, my guess would be that Apple has established the line (mini, maybe refreshed every two years; mainstream; pro; pro max) and the design language, for the next four years or so. Get used to these sizes and the squared off edges!

    On the flip side the most essential Mac-relevant SoC changes are done. Next year may again be "disappointing" in that the leading edge team will have the many core high end machines as its priority, so while the A15 SoC won't exactly be phoned in, it may still be less than we might hope.
    On the other hand, as soon as the A16 Apple may be willing to say "OK, Rosetta2 is over for new machines. If a vendor hasn't ported by now, it's not worth our time to keep coddling them". Being able to drop the compatibility stuff [memory ordering, 4kB subpages] will help a bit (less complexity always helps some), and they'll finally be past the huge effort of the transition, so once again performance can get top billing.

    Another data point for my theory (this is the appearance for the next four years or so), when do we get an Apple modem? Maybe 2022? Once again that will come in a shell that looks absolutely familiar, like an iPhone has looked for years, so that the fact of getting new technology that the techies are all chattering about won't seem strange and unnerving; what you buy will feel like last year's iPhone.
    Reply
  • mrvco - Monday, November 30, 2020 - link

    It was a good run since the OG iPhone launched, but I seem to have lost all interest in replacing smart phones. I've been using an XS Max (~work phone) and an LG V40 (~personal phone) for two years now and I'm still perfectly satisfied with both devices. They both do what I ask of them with little fuss and there just haven't been any new features or phones that have generated more than a passing interest for me. Reply
  • Bob Todd - Monday, November 30, 2020 - link

    As someone who would sometimes change phones more than once a year, I've been in a similar place. We are getting to the point of "good enough" performance. Faster is always better, but high end (and even midrange) SOCs are pretty good these days. My 2 year old phone has 8GB of RAM, 256GB of storage, and a nice large display.

    I do think this generation of iPhones is interesting for a few reasons though. The Mini doesn't even have a good analogue in the Android world, and I'm excited that premium smaller form factor phones are a thing again.
    Reply
  • FunBunny2 - Monday, November 30, 2020 - link

    "The Mini doesn't even have a good analogue in the Android world, and I'm excited that premium smaller form factor phones are a thing again."

    it depends on use case. for those who use a smartphone mostly as a phone, then these Godzilla handsets are contraindicated. OTOH, if the use case is mostly watching video on the run, then the Max and similar make the most sense. Steve clearly intended the former, Mr. Market gave him a full body enema by telling him to shove those teeny, tiny thingees.
    Reply
  • KPOM - Monday, November 30, 2020 - link

    My mother and sister both opted for the 12 mini since they got tired of big phones. I’m sure they aren’t alone. Reply
  • GC2:CS - Monday, November 30, 2020 - link

    Well is there any reason why LPDDR5 was not used over the entire lineup (including M1) ? Is there some hidden compromise with LPDDR5 ?

    So if CPU is improved quite a bit in regards to efficiency, why the GPU lacks an update ? Is it possible that newer node benefits the CPU more than GPU ?

    I heard about new Pro Oleds having better viewing angles. This is something i would greatly appreciate. 11´s Pro do have quite big shifts in white - at screen edges it has greenish, bluish cast. Can somebody describe it a but more ?

    I think this generation could be better. But 5G is quite monumental increse in RF complexity and imagining they did it with custom antena designs and thinner designs is quite remarkable.
    For exemple three mmWave antenas were discoverd so far. One on the side next to the battery, one behind the motherboard and one under the notch on the front.

    But on the other hand 5G sucked up all the effort for other upgrades like better bigger cameras, batteries, 120 Hz and so on.

    I refuse to believe that the next one is iPhone 13. That is just so unlucky...
    Reply
  • michael2k - Monday, November 30, 2020 - link

    I think you answered your own question. The focus on 5G took resources away from lpddr5. Reply
  • mmm200 - Monday, November 30, 2020 - link

    I had both X and Xs Max, wife has 11 Pro.

    I could tell you how good the new 12 Pro Max display is.
    It is better than Apple MBP16 in both color and brightness stability! 2 weeks in I'm amazed still how good the Pro display is!

    Don't like the oversaturated images made indoor. Just too much vibrance and saturation. Looks unnatural.
    2.5x telephoto is great outdoors in sunny weather.
    HDR video capture is mindblowing! Using 1080p30 and 1080p60 - looks great on LG OLED!
    Reply

Log in

Don't have an account? Sign up now