Multi-Client CIFS Performance for Professional Workloads

NAS units used in SMBs / SMEs need to provide good performance under heavy load from multiple clients. The SPEC SFS 2014 benchmark uses real-life workloads (just like Intel NASPT), but makes it easier for users to understand the benchmark results. This is achieved by using the concept of business metrics. Given a particular NAS unit, how many concurrently accessed databases can reside in it? How many IP cameras or video streams can be simultaneously recorded? To determine this metric, each load point is associated with a target required op rate. If the NAS under test doesn't meet that op rate, it is deemed as an 'invalid run'. SPEC requires all published benchmarks to follow certain strict rules - such as presented results having no invalid runs for at least 10 load points. Unfortunately, small-scale NAS systems with 7200 RPM drives can't meet these requirements, Hence, we can't officially publish SPEC SFS 2014 benchmark results for the evaluation of the QNAP TS-451+.

Using a popular filer benchmarking program, we did play back multi-client real-world professional workload access traces on the NAS using up to 10 Windows 7 VMs. However, failing to meet the required op rate criteria at a particular load point made us stop the testing a couple of load points down the road. The QNAP TS-451+ with four 7200 RPM hard drives in RAID-5 can support recording of 10 or more video streams, 5 or less databases, 4 or less software builds and 2 or less virtual desktops.

Database Operations

The Database Operations workload seems to get / doesn't seem to get acceptable performance for up to 5 clients.The detailed metrics from our trace playback are available here

Database Operations - Op Rates

Database Operations - Bandwidth and Latencies

Software Builds

The Software Builds workload seems to get / doesn't seem to get acceptable performance for up to 4 clients.The detailed metrics from our trace playback are available here

Software Builds - Op Rates

Software Builds - Bandwidth and Latencies

Video Recording

The Video Recording workload seems to get / doesn't seem to get acceptable performance for up to 10 clients.The detailed metrics from our trace playback are available here

Video Recording - Op Rates

Video Recording - Bandwidth and Latencies

Virtual Desktops

The Virtual Desktops workload seems to get / doesn't seem to get acceptable performance for up to 2 clients.The detailed metrics from our trace playback are available here

Virtual Desktops - Op Rates

Virtual Desktops - Bandwidth and Latencies

Multi-Client CIFS Performance for Consumer Workloads Multi-Client NFS Performance for Professional Workloads
Comments Locked

34 Comments

View All Comments

  • BedfordTim - Friday, February 19, 2016 - link

    If you look at Amazon reviews you will find that there is no customer support for a NAS either. At least with off the shelf parts if your power brick fails you can just buy another one. If your proprietary Netgear power brick fails you are facing hours on a premium rate phone line as they don't respond to web requests.
  • kmmatney - Sunday, November 1, 2015 - link

    I never got over the pricing either, and went the WHS route. I started out with a machine built with spare parts 6 years ago, and added hard drives to the system as I went, and now have 9 drives in it. I use Stablebit drivepool for drive pooling and redundancy, which I like better than using RAID. It started out with a Sempron processor which was fine in the beginning, but upgraded to a core i5 Devil's Canyon so I could run several minecraft servers. Too bad they stopped support for WHS. I'll probably just move to Windows 10 in the future.
  • bsd228 - Friday, November 6, 2015 - link

    That's a list price. The predecessor (the 451 non plus - essentially the same but with a 2.4ghz dual core instead of this 2ghz quad core) sells in the 300 (great sale) to 450 range. Amazon already lists the 451+ at 529 for the 2gig memory model.

    If size doesn't matter, and you're up to the task on the software side, then yeah, you can make something better for the same money. Or do it slightly cheaper. And I've done that many times with HP Microservers, and might again with a Fractal Design 304 case. But if it's not your expertise or your time is better spent elsewhere, these turnkey solutions are great. Qnap and Synology have a lot of applets, and now even the ability to run a VM for additional wants.
  • Oscarcharliezulu - Friday, October 30, 2015 - link

    Article mentions raid rebuild is fast but if I'm reading it right rebuilds take 8 hours plus! Why do they (all) take so long? QNAP needs to support btrfs or ZfS so we can have a file system that properly protects against file corruption not just disk failure.
  • Sivar - Friday, October 30, 2015 - link

    An important and oft-overlooked issue with most home NAS units (QNAP, Drobo, Synology) is that if your unit dies out of warranty, that's it -- these companies offer no repair option or support.

    This is a problem with Drobo especially because they use a proprietary file system. You can of course buy another unit, if available, and move the drives over, or buy a newer model and hope for turnkey compatibility.

    With a custom home NAS, well within the capabilities (if not spare time) of most Anandtech readers, you can upgrade and repair parts easily.
  • DanNeely - Friday, October 30, 2015 - link

    Linux based NASes - like almost everything but the Drobo - use standard Filesystems, and can be recovered by sticking the drives in a normal Linux box.
  • BedfordTim - Friday, February 19, 2016 - link

    It isn't much better if they die in warranty. All NAS makers have dire reviews for customer support. Netgear has a premium number for support and a healthy queue length (30-60 minutes this morning) to maximise revenue.
  • Navvie - Monday, November 2, 2015 - link

    What would be nice is a comparison with a roll-your-own NAS solution. For example, a HP Microserver G2020T running FreeNAS or nas4free.
  • colonelclaw - Tuesday, November 3, 2015 - link

    We've been running a QNAP box that's extremely similar to this one in our office for the last couple of years, and I have to say we're extremely happy with it. We use it as an online archive of completed projects that have already been backed up, so it doesn't get a huge amount of use, but it probably shunts a terabyte or two around every week.
    My one criticism is that it feels like every time I log onto the admin console via a web browser it asks to install a new firmware update, but I can put up with this (mainly by not needing to log in that often).
  • akdubya - Wednesday, November 4, 2015 - link

    "For the TS-451+ to become a compelling choice, the pricing aspect needs to be addressed."

    You aren't kidding. I recently put together a comparable Braswell (N3700) system for under $250. And the Braswell SoC's feature AES NI, 4K and HEVC. Yikes! Between the anemic warranties and the severely underpowered and/or overpriced hardware I'm just not seeing the value in these proprietary SOHO NAS boxes. Is it really so hard to jam PLEX/Kodi/Samba on an Ubuntu server these days? And no need to jump through hoops to "use it like a PC" because it is a PC.

Log in

Don't have an account? Sign up now