Browser Face-Off: Battery Life Explored 2014
by Stephen Barrett on August 12, 2014 6:00 AM ESTIt has been five years since we did a benchmark of web browsers effect on battery life and a lot has changed. Back then, our testing included Opera 9 & 10, Chrome 2, Firefox 3.5.2, Safari 4, and IE8. Just looking at those version numbers is nostalgic. Not only have the browsers gone through many revisions since then, but computer hardware and the Windows operating system are very different as well.
Windows Timers: Computer Architecture & Google Chrome
Before we get to any testing of battery life, we need to provide some background information on some of the changes, which requires a deeper understanding of how operating systems and hardware interface with each other. If you've browsed tech news recently, there has been coverage of a Google Chrome design decision from 2010. To recap, Google Chrome on Windows requests the operating system use a 1ms timer in an effort to increase web page rendering speed. Faster is better, but there is a problem with this technique.
For those unfamiliar with OS timers, they form a core component of any operating system. There are two fundamentally different ways to handle timing in a computer system, polling and interrupt modes. A polling system consists of software and hardware that continuously checks to see if something of interest has happened. For example, if a driver sets up a hardware device (i.e. a sound card) to acquire input and then continuously reads memory to check for new values, this is a polling system. However, if the driver sets up the device to acquire and then waits for interrupts (hardware notifications) that new data is available in memory, this is an interrupt system.
In general, interrupt mode is preferred as it saves significant resources and allows other threads to work while the corresponding thread sleeps. The vast majority of API calls a software developer has available do not even provide timing mode selection and simply use interrupt mode. Otherwise, a single application using polling could easily eat up an entire CPU core. There are other factors as well, like preemption, but they are out of scope of this article.
There's a problem with interrupt mode, however: it is slower for a variety of reasons. First, there is interrupt latency. Compared to polling mode checking for something to happen over and over, interrupts are always going to lose.
As an example, if I watch someone building a piece of furniture the entire time, I know exactly when they finish and I can use the furniture. On the other hand, if I wait for the builder to tell me, I could do other things in the meantime (work, sleep, play games, etc.). Of course I wouldn't know exactly when the furniture is ready and there would be a delay between when the furniture is complete and when I first begin using it.
General purpose operating systems like Windows are not typically concerned with interrupt latency. This is more important in embedded mechanical controls like those in your car. But there's another reason interrupts are slower than polling: timer coalescing.
To save power, Microsoft uses timer coalescing in Windows. Applications and drivers waiting for an event can specify their timeout in milliseconds, but in most cases the request time will be rounded to a multiple of Window's 15.6ms default timebase (prior to Windows 8, more on that later). For example, if I wrote some code that waits for an event for 200 milliseconds, Windows might actually sleep my thread for 202.8ms. When two threads request timers, this technique helps Windows continue to wake up at roughly 64 times per second instead of twice as much, 128 times per second.
The results of timer coalescing is that a web browser or other application could theoretically wait up to 15.6ms even when it requests to be scheduled in 1ms interrupts. When push comes to shove, some applications bypass the regular timer mechanism and ask Windows to use a 1ms timer, circumventing these delays. This handicaps CPU and OS power saving features because the longest the hardware and operating system can ever sleep is 1ms. Factoring in thread work time and wake time, sleep duration is likely much less than 1ms.
The power penalty of applications requesting a 1ms timer is exacerbated in Windows 8. In Windows 8, Microsoft maintains the same timer coalescing and timer request API calls, but they have implemented a tick-less kernel under the hood. With a tick-less kernel, the operating system doesn’t just try to round sleep times to a 'default timer resolution' of 15.6ms like Windows 7 and prior did, but instead at every wake event, Windows 8 analyzes the upcoming timed events and intelligently schedules its next wake up time. Therefore, sleep times could be either shorter or much longer than the previous default of 15.6ms. Depending on the distribution of wake up times, this could save significant power. Microsoft provided a blog post with some detail and data regarding the move.
Microsoft did not provide detail on what applications were running when they performed this test. However, we can tell from the data that Chrome was not running, otherwise the only values in the distribution would be at 1ms and below. And that's the crux of the problem.
When Intel launched Haswell one of the focus points was idle power consumption. The theory is when you’re staring at a static screen reading an article or the device is ‘locked’, you can save significant battery life. Consider the following charts of power use for a desktop system:
The idle power of even a desktop Haswell is significantly better than Ivy Bridge
But the load power is the same or worse
Intel spent many years designing Haswell as an improvement over Ivy Bridge for power consumption, but they are at the mercy of application developers. If an application wakes the device up for work every 1ms, the idle power benefits of Haswell don’t have nearly the impact they could.
The developers of Chrome are not ignorant to this and optimized Chrome to turn off its 1ms timer request if the system is running on battery power. However, this optimization is not functional and Chrome unfortunately always requests a 1ms timer. Other developers have criticized this timer technique in Chrome, pointing out that other browsers and high performance applications do not follow this same design pattern and that relying on precise interrupts from a general purpose OS is fundamentally a flawed design. They have likened it to old video games that changed speed with the MHz of the CPU.
By way of comparison, IE and Firefox use a frame rate limiting technique, where they use the default timer resolution of 15.6ms but if a website requests a 1ms refresh rate, they check the system clock after waking up and compute how many iterations to perform to achieve a virtual 1ms update rate. For example, if the browser wakes up after 13ms, then perform 13 iterations before sleeping again. The result is that they do more work less often.
112 Comments
View All Comments
asmian - Saturday, August 16, 2014 - link
Please note http://forum.palemoon.org/viewtopic.php?f=4&t=... - the Pale Moon developer states that it does NOT use 1ms timers, and since this is directly based on FF code (and he does not state that he has changed that part of the code) it is unlikely that FF does either. Maybe there is another app causing this behaviour.lucas1024 - Thursday, August 21, 2014 - link
And yet in reality it DOES use a 1ms timer, even when all plugins and extensions, as well as hardware acceleration, are disabled. powercfg reports the timer requested by mozjs.dll.rhughesjr - Tuesday, August 12, 2014 - link
Often beta software will not have all optimizations enabled in order to more easily debug issues. I wonder if that is the case, and would be very interested in seeing this revisited once Chrome 37 comes out of beta.Freakie - Tuesday, August 12, 2014 - link
Would have been kind of interesting to compared 64bit Firefox (Nightly) to 64bit Chrome, just to see which 64bit version is the best for battery. Would be humorous if Firefox was.I use 64bit Waterfox myself, which even though it is a build of the latest version of Firefox, just compiled as a 64bit program. It's compiled using specific optimizations that the Firefox team doesn't use, so it wouldn't be fair to use a 64bit off-shoot version of Firefox, unfortunately.
Oxford Guy - Wednesday, August 13, 2014 - link
Yes, I was wondering why Chrome was tested for 64-bit but not Firefox. However, one might say that Mozilla has been less supportive of the 64-bit variant than Google has been of its 64-bit Chrome variant.AnnonymousCoward - Tuesday, August 12, 2014 - link
I like Pale Moon over Firefox. No UI BS to deal with.Paapaa125 - Tuesday, August 12, 2014 - link
It would've been interesting to see how OSX+Safari would compare to Windows+Chore on the same MacBook Pro.tuxRoller - Tuesday, August 12, 2014 - link
Any chance of running these tests for both osx and linux (fedora, preferrably as they tend to be amongst the most vanilla [least amount of changes from upstream] of the major distros)? Linux, at least, also supports various levels of timer coalescence (timer_slack), and attempts to wakeup as little as possible when not under load. I'd imagine osx does the same.Also, firefox has beta, aurora, and nightly that are easy to get (https://www.mozilla.org/en-US/firefox/channel/#bet... , https://www.mozilla.org/en-US/firefox/channel/#aur... , https://nightly.mozilla.org/), and chrome has the same.
Samus - Wednesday, August 13, 2014 - link
Firefox is definitely an underrated browser. It's amazing how it still gets such a bad rap from a few crap versions from years ago. Firefox has been an especially superior browser, in my opinion, since the customizable menu center released earlier this year.xype - Wednesday, August 13, 2014 - link
This is kinda stupid. Compare Firefox, Chrome and Safari on OS X and Firefox, Chrome and IE on Windows, if you want to get a good idea of the differences between browsers. Eventually Chrome and Firefox on Linux, too, if you have too much time.As it is, the Safari "part" is meaningless, and without Safari you don’t even have a "Browser Face-Off". And having Firefox and Chrome compared between Windows and OS X (and Linux) would at least allow people to get a good idea of how much of a difference the operating system makes in these tests.
I expected a better article, but then, this is still better than no article (and no information), so thanks for it anyway.