The W3C’s Mobile Web Test Suites Working Group has released their Web Compatibility Test for Mobile Browsers Version 2. It’s at www.w3.org/2010/01/wctmb2/. This is a forward looking test that is designed to test HTML 5 capabilities that will drive the next generation of mobile Webapps including XmlHttpRequest, <canvas>, <input type=’date’>, contenteditable, Appcache, <video>, <audio>, Web Workers, localStorage, sessionStorage and @font-face. Most mobile browsers don’t support many of these capabilities yet.
I tried the new test with all the mobile browsers that I had at my command . The best result I got was a 67% pass rate using the Android Eclair (2.0) browser that comes with the Cyanogenmod 4.2.14.1 ROM for the HTC Dream and Magic.
You can click though from the test to see a results page listing the scores for all tested browsers. There are a lot of results for ringers (desktop browsers) listed with the Firefox 3.6 Beta (Namoroka) topping the charts with a score of 83.33%.
The highest scoring mobile browser was Firefox Mobile (Fennec) 1.0 on Maemo with 75%, followed by my Android result of 67%, which was matched by the latest iPhone build. I went through the results and removed all the desktop browsers and kept only the best results for each mobile browser and added my own tests to create the list below. Scores are rounded to the nearest whole number for consistency.
Browser | Score |
Firefox Mobile (Fennec) 1.0 on Maemo | 75% |
HTC Android Magic with CyanogenMod-4.2.14.1 WebKit 525.20.1 | 67% |
iPhone 3GS Mobile Safari 531.21.10 | 67% |
Opera Mobile 10 Beta 3 (Symbian) | 33% |
Skyfire 1.5.0.15495 for Symbian | 25% |
Nokia N95-3 WebKit 413 | 17% |
Opera Mobile 9.5 Windows Mobile | 17% |
Opera Mini 4.2 | 17% (test did not complete) |
Bolt 1.7 – 17% | 17% (test did not complete) |
UCWEB 7 Symbian | 10% (test did not complete) |
Palm Pre WebKit 525.27.1 | 8% |
UCWEB 7 Java | 7% |
BlackBerry 9000 (Bold) | 0% |
Interesting stuff. The top browsers from Android and Apple actually have support for a lot of HTML5 features. The iPhone passed everything except contenteditable, geolocation, <input type=’date’> and <video>. The failure on geolocation surprised me as I know the iPhone does expose a Location API in the browser. Maybe it doesn’t follow the standard that the W3C is testing against. The Android browser passed the geolocation and contenteditable tests but failed <input type=’date’> ,<video>, <audio> and @font-face. The other vendors including Palm and Opera, clearly have some work ahead of them. The proxy based browsers; Skyfire, Opera Mini, Bolt and UCWEB seem to be at a big disadvantage, it’s got to be difficult to support things like canvas and contenteditable with a browser that’s in the cloud rather than on the handset.
It looks like no one has tested any versions of Mobile Internet Explorer, Samsung Dolfin, NetFront or Obigo yet. If you’ve got one of these untested browsers please point it at www.w3.org/2010/01/wctmb2/ and submit the results.
BOLT browser for mobile is still the king of all mobile browser. It makes your mobile phone a complete system on your palm.
This site just jacked up my Mythic. The phone seems to be attempting to go offline but continues to stay in this mode. Nothing I do will get it out of this mode. I can’t even shut down the phone. Do not us this test. I think more testing of this site needs to be done by the guys who made it. DO NOT USE!!!
You should be able to recover by removing the battery for 30 seconds or so then replacing it and restarting the phone.
The purpose of browser benchmarks like this is to stress test the browser. Yours seems to have failed spectacularly. That’s really more of a problem with the phone than with the test.
Dennis,
I just tested the Dolphin browser on Samsung Jet: a poor 17%.
Cheers.
Great find. I just tested desktop/Mac Opera 9.5 (17%) and 10 (42%). Clearly Opera is working on it.