UL Benchmarks - PCMark, 3DMark, and VRMark

This section deals with a selection of the UL Futuremark benchmarks - PCMark 10, PCMark 8, and 3DMark. While the first two evaluate the system as a whole, 3DMark focuses on the graphics capabilities.

PCMark 10

UL's PCMark 10 evaluates computing systems for various usage scenarios (generic / essential tasks such as web browsing and starting up applications, productivity tasks such as editing spreadsheets and documents, gaming, and digital content creation). We benchmarked select PCs with the PCMark 10 Extended profile and recorded the scores for various scenarios. These scores are heavily influenced by the CPU and GPU in the system, though the RAM and storage device also play a part. The power plan was set to Balanced for all the PCs while processing the PCMark 10 benchmark.

Futuremark PCMark 10 - Essentials

Futuremark PCMark 10 - Productivity

Futuremark PCMark 10 - Gaming

Futuremark PCMark 10 - Digital Content Creation

Futuremark PCMark 10 - Extended

PCMark 8

We continue to present PCMark 8 benchmark results (as those have more comparison points) while our PCMark 10 scores database for systems grows in size. PCMark 8 provides various usage scenarios (home, creative and work) and offers ways to benchmark both baseline (CPU-only) as well as OpenCL accelerated (CPU + GPU) performance. We benchmarked select PCs for the OpenCL accelerated performance in all three usage scenarios.

Futuremark PCMark 8 - Home OpenCL

Futuremark PCMark 8 - Creative OpenCL

Futuremark PCMark 8 - Work OpenCL

UL's 3DMark comes with a diverse set of graphics workloads that target different Direct3D feature levels. Correspondingly, the rendering resolutions are also different. The VRMark benchmark targets virtual reality specifically. Its workloads are termed as 'rooms', with each one being a piece of VR content designed to require a specific level of VR performance. We used 3DMark 2.4.4264 and VRMark 1.2.1701 to get an idea of the graphics capabilities of various systems. In this section, we take a look at the performance of the Intel NUC9i9QNX (Ghost Canyon) on a comparative basis across the different workloads.

3DMark Ice Storm

This workload has three levels of varying complexity - the vanilla Ice Storm, Ice Storm Unlimited, and Ice Storm Extreme. It is a cross-platform benchmark (which means that the scores can be compared across different tablets and smartphones as well). All three use DirectX 11 (feature level 9) / OpenGL ES 2.0. While the Extreme renders at 1920 x 1080, the other two render at 1280 x 720. The graphs below present the various Ice Storm worloads' numbers for different systems that we have evaluated.

UL 3DMark - Ice Storm Workloads

3DMark Cloud Gate

The Cloud Gate workload is meant for notebooks and typical home PCs, and uses DirectX 11 (feature level 10) to render frames at 1280 x 720. The graph below presents the overall score for the workload across all the systems that are being compared.

UL 3DMark Cloud Gate Score

3DMark Sky Diver

The Sky Diver workload is meant for gaming notebooks and mid-range PCs, and uses DirectX 11 (feature level 11) to render frames at 1920 x 1080. The graph below presents the overall score for the workload across all the systems that are being compared.

UL 3DMark Sky Diver Score

3DMark Fire Strike Extreme

The Fire Strike benchmark has three workloads. The base version is meant for high-performance gaming PCs. Similar to Sky Diver, it uses DirectX 11 (feature level 11) to render frames at 1920 x 1080. The Ultra version targets 4K gaming system, and renders at 3840 x 2160. However, we only deal with the Extreme version in our benchmarking - It renders at 2560 x 1440, and targets multi-GPU systems and overclocked PCs. The graph below presents the overall score for the Fire Strike Extreme benchmark across all the systems that are being compared.

UL 3DMark Fire Strike Extreme Score

3DMark Time Spy

The Time Spy workload has two levels with different complexities. Both use DirectX 12 (feature level 11). However, the plain version targets high-performance gaming PCs with a 2560 x 1440 render resolution, while the Extreme version renders at 3840 x 2160 resolution. The graphs below present both numbers for all the systems that are being compared in this review.

UL 3DMark - Time Spy Workloads

The VRMark Professional Edition comes with three rooms. Each room can be run either in desktop or HMD mode, with varying minimum requirements for the same workload. The benchmark results include the average FPS achieved, and a score based on the FPS. A pass or fail indicator is also provided based on whether the average FPS exceeds the required FPS. In this section, we take a look at the performance of the Intel NUC9i9QNX (Ghost Canyon) on a comparative basis across the three workloads in desktop mode.

VRMark Orange Room

The Orange Room is meant to test the effectiveness of a system for handling the requirements of the HTC Vive and the Oculus Rift. The recommended hardware for both VR HMDs should be able to easily achieve the desired target FPS (88.9 fps). However, in the desktop mode, the target performance is 109 fps without any frame drops. Systems benching with an average FPS lesser than that are deemed to have failed the VRMark Orange Room benchmark. The graphs below present the average FPS and score for the different systems being considered today.

UL VRMark - Orange Room

VRMark Cyan Room

The Cyan Room sits between the Orange and Blue rooms in complexity. It is a DirectX 12 benchmark. Similar to the Orange room, the target metrics are 88.9 fps on HMDs and 109 fps on the desktop monitor. The graphs below present the average FPS and score for the different systems being considered today.

UL VRMark - Cyan Room

VRMark Blue Room

The Blue Room is the most demanding of the three workloads. At the time of introduction of VRMark in October 2016, no publicly available system running as sold was able to pass the test. The Ghost Canyon NUC configuration with the RTX 2070 performs better than any previously benchmarked system, but it still doesn't meet the requirements to pass the VRMark Blue Room test.

The performance of a system in this benchmark is an indicator of its VR-readiness for future generation of HMDs. Similar to the other workloads, the passing performance metrics are 88.9 fps on HMDs and 109 fps on desktop monitors. The complexity of the workload is due to the higher resolution (5012 x 2880) and additional geometry making it necessary to increase the number of Direct3D API calls. The graphs below present the average FPS and score for the different systems being considered today.

UL VRMark - Blue Room

BAPCo SYSmark 2018 SPECworkstation 3 Benchmark
Comments Locked

109 Comments

View All Comments

  • PeachNCream - Thursday, April 16, 2020 - link

    NUCs have usually had a bit of a markup, but the price here is quite a bit higher than one would expect.
  • Deicidium369 - Thursday, April 16, 2020 - link

    I don't consider this a NUC, even though Intel puts it in that category - same thing with the ones with the skulls on them... the standard 4.5"x4.5" are the only ones I consider a NUC. Not really sure what the use case for this machine is.
  • PeachNCream - Friday, April 17, 2020 - link

    I agree with you all around. This is far different than the goals Intel originally set out to attain with the NUC form factor. It's Intel's objective and the company can do whatever it wants with the name, slapping it on a super computer for all I care, but that doesn't mean we are compelled to acknowledge it in the same way we would prior designs.

    The use case for it - a small form factor system used for gaming or GPU-based graphics work is certainly the intent. The problem is the pricing is way off as a lot of others have pointed out so the same goals could be accomplished in a similar, but slightly larger system for considerably lower cost.

    This seems like a Google-style thought experiment that some employee or team dreamed up. it got approved and is on sale. If subsequent generations are not sold in the future, we will know it didn't get close to projections or targets.
  • Deicidium369 - Friday, April 17, 2020 - link

    I have over 60 of these deployed in my business offices. I fabricate a 4.5" x ~11" piece of stainless steel - each end is drilled with the 100mm VESA bolt pattern. There are 2 90deg brakes (bends). 1 end in sandwiched between the monitor stand and monitor - other side the NUC mounting bracket is bolted. Short (12") DP and USB cables connect NUC to monitor - sourced a 100W power brick (Intel ships a variety of designs. some with convex sides) that is rectangular - with a standard 3pin AC jack and a barrel DC jack. Y splitter for the AC power - 1 to monitor other to power brick, and a 12" DC cable. So, coming up from the wallplate is 1 AC power cable & 1 CAT6e cable

    Makes an all in 1 - usecase doesn't require a desktop PC - even a normal SFF one. My employees can choose wired or wireless Microsoft keybd/mice. Keeps it super neat and super clean.

    When I started to migrate those people to work at home, made the move super easy - and didn't require one of my IT staff to handle the moves - the Palo Alto Networks VPN Endpoint was preconfigured, so just plug in the desktop and the IP Phone, and they were up an running again.

    I have 3 generations of units - about half are the oldest - the real NUC Tiger Lake will replace them all (not running into issues with compute power - but the iGPU struggles with dual 2560 or 4K monitors. 32GB + Samsung 512GB or 1TB NVME - no 2.5"
  • Icehawk - Saturday, April 18, 2020 - link

    Take a look at Dell’s 7070 Ultra. It’s basically a monitor stand, combine with a USB-C monitor and it’s very sleek. I work for a mid sized bank and will be deploying these in the future in our branches where before we used mini-PCs VESA mounted. Much cleaner and enterprise pricing is good.
  • Deicidium369 - Saturday, April 18, 2020 - link

    Thank's for the information - I actually bought one soon after they were released and evaluated as a replacement for the 35 or so NUCs I had installed at the time. There were manufacturing defects or issues, and had to send the eval unit back twice. By December, I had to purchase machines, as the business was expanding - and just couldn't, at that point, consider the Dell an option. The processing power at the time was pretty well evenly matched - the dual channel memory in the NUCs wasn't a huge advantage in testing. and the NVMe speed was comparable. So from a performance standpoint, they were pretty evenly matched - one of the main big features that was lacking in the Dell was the IGP - I had thought that instead of Comet Lake we would have gotten Ice Lake. Our workflow is pretty mundane - Word Excel Outlook and Chrome... So at this point the big reason for sticking with the NUCs is the "ecosystem" I have built around them - when we do replace with the Tiger Lake NUCs later this year, will be pretty well painless.
  • ingwe - Friday, April 17, 2020 - link

    Yeah the pricing is crazy. Which is disappointing because I think it is a pretty neat concept and I would love something like this from AMD.
  • Deicidium369 - Friday, April 17, 2020 - link

    AMD sells CPU and GPU - nothing else.
  • Sailor23M - Saturday, April 18, 2020 - link

    Agree, Intel has lost it way with the NUCs. They should be in the $500-$999 range, come with best embedded graphics that Intel can provide with lots of ports. Not sure who is excited about $3000 SFF box.
  • Qasar - Saturday, April 18, 2020 - link

    intel has lost its way in alot more then just nucs. it lost its way 5-7 years ago when it thought ot was unbeatable, and kept rehashing the same cpu over and over.

Log in

Don't have an account? Sign up now