Hi.
I'm have now rewritten the Spreadsheet and will shortly be integrating my CPU benchmarks and GPU benchmarks into the same sheet (not really that interesting or anything but it's there if you want to see exactly how things are worked out) but it explains why the progress has been slow recently. I have now taken this thread over from Arkymedes - and a HUGE thanks to him for creating the spreadsheet and doing most of the benchmarks which are still being referenced in them. He has done a brilliant job!
This page will continue to keep the tests strictly to GPU performance. CPU performance can be viewed here.
(like Arkymedes) I will take in consideration the clock used in each ROM and try to use the maximum allowed by the kernel using SetCPU. HOWEVER, all rom's will be tested at 691 MHz for consistency and any other frequencies will be detailed.
About JIT, unfortunately, all Arkmedes tests show that it doesn't affect 3D performance YET, since all this apps are not properly optimized and didn't take JIT into account. However, this may change with Froyo builds so keep an eye out.
All the ROM's clocked @ 691MHz "Performance" under SetCPU, unless specified otherwise. All tests are conducted 5 times and an average is taken. The tests are carried out in Aeroplane mode with no widgets running on the desktop. No apps are installed aside from the benchmark apps and Apps2SD is used (if enabled by the ROM). The latest version of the benchmark software is always used (they usually only add support for new phones in updates rather than changing benchmark parameters).
Benchmark apps:
Neocore - Qualcomm's own benchmark tool for 3D performance. Measured in FPS
Benchmark - Softweg's test suite for benchmarking. Only the GPU test done here to account for 2D performance. Measured by an internal score.
An3DBench - Tests based on jPCT, a free 3D engine for Java. 7 tests showing the capabilities of the engine. Measured by an internal score.
Note that all the tests mean: The higher the score, the better.
Anyway, here it goes
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
A little suggestion: you should specify wether whe rom is sense or vanilla, and also the CPU clock used for the tests.
Can't wait!
that's a long couple of hours.......
Are you going to do VillainROM 10.2 with Sense + JIT enabled? If not I can try and do a benchmark.
Thread updated
Please Note:
I believe in the EzHero 2.7 stats, that jit is not enabled, with jit EzHero 2.7 is equal or greater than EzHero 2.0
maybe link each of the roms in the first thread for people to easily find...being quite new here i cant fins the Androbin-cr2-5.0.7...what ever that one is...
Your efforts are highly appreciated, good job.
But there is a problem: you didn't say which ROM is JIT enabled and which is not, because as you see CPU benchmarks have better results on JIT enabled ROMs, even though, as you can see, 3D is not affected.
My bench marks
My benchmarks with EzHero 2.7+ JIT:
Linpack- 4.886
Neocore w/ sound- 30.2FPS
Neocore w/o sound- 33.2FPS
Quadrant Standard- 280
Benchmark Pi- 7222 milliseconds
Very good job on the post, well done keeping us informed!
Hello!
What I'm trying to do here is to benchmark any version that I can find in these forums WITHOUT any further optmization. The benchmarkings are done OUT OF THE BOX
So, if I have to MANUALLY enable JIT or any OC AFTER the flashing, it will NOT show in these graphics!
I didn't do that because it is just impossible for me to keep track of every single optmization that can be done to every single one of this ROM's. I just don't have the time and resources for that.
So again, all this tests are done straight after the flashing of the downloaded ROM (logically, after some reboots and bla bla bla).
I really hope that you guys understand that. It's not a way to show which ROM is better, since there are MANY more factors that dictate that, like BT calls, GPS and so on. It's just a way to measure mostly 3D performance out of the box with the ROM's you provide.
sheridan2000 said:
maybe link each of the roms in the first thread for people to easily find...being quite new here i cant fins the Androbin-cr2-5.0.7...what ever that one is...
Click to expand...
Click to collapse
That's a good idea, but I guess the WIKI sticked in the first page should have done the job. It will be redundant but I can try to keep track of them.
Man sad day, all you have to do in EzHero to enable jit is go to the terminal app and type jit-on.
Still, job well done! Kudos!
xenoside said:
Man sad day, all you have to do in EzHero to enable jit is go to the terminal app and type jit-on.
Still, job well done! Kudos!
Click to expand...
Click to collapse
I will add EZHero 2.7 with JIT enabled after Italy x Paraguay
Arkymedes said:
I will add EZHero 2.7 with JIT enabled after Italy x Paraguay
Click to expand...
Click to collapse
World Cup always comes first my friend lol
its raining pretty hard in the game...
anyways, so 2.0 is JIT enabled and 2.7 is not in your graph? because huge difference in linpack scores with the older having a better score.
you should also mention Benchmark Pi - lower the score, the better.
-2y2k- said:
its raining pretty hard in the game...
anyways, so 2.0 is JIT enabled and 2.7 is not in your graph? because huge difference in linpack scores with the older having a better score.
you should also mention Benchmark Pi - lower the score, the better.
Click to expand...
Click to collapse
Yeah, 2.0 is jit enabled, but now 2.7 is optional due to complaints and split decisions. I posted the benchmarks with jit on the last post of the front page
im a Sense guy but its been awhile since I tried a non-sense one, your ROM is rrreally tempting right now lol
-2y2k- said:
im a Sense guy but its been awhile since I tried a non-sense one, your ROM is rrreally tempting right now lol
Click to expand...
Click to collapse
Well vanilla Eclair and EzHero are both great roms, heck even Androbin is tied with those two.
In the Quadrant Graph, androbin doesn't have his bar.
Related
NB! This tests are old! For newer results please follow the link:
http://forum.xda-developers.com/showthread.php?t=700755
---
Hello all,
Since there are so many flavours of ROMs around, I decided to do a little test with some of them (in my opinion, the more popular ones).
For the test I used the following ROMs:
2.1 Eclair
BeHero 1.3.2
Legendary 1.3.5
aHero 0.6.1
aHero 0.7.1
aHero 0.8
Villain 4.0 beta 2
Villain 5.02
Villain 5.1
Villain 5.2
Villain 5.3
Villain 5.4
CyanogenMod for Hero 1.0
Defiance 2.1
Androbin 1.1110
Legendroid 1.0.1
NeoRom 2.1
Raidroid 1.1
SlideVillain 1.0.1 beta
VanillaEclair 1.3 NAS
---
1.5 Cupcake
Kimera 1.7 @ 768MHz
Also the following for benchmarking:
For 3D Performance
Qualcomm's "NeoCore" 1.9.18 - Measured in FPS
For 2D Performance
Softweg's "Benchmark" 1.03 - Measured by an internal score
For CPU Performance
Linpack for Android - Measured in MFLOPS
All the tests mean: The higher, the better.
The method of testing was the usual flashing, a couple of reboots to make sure every caching necessary was done and the average of 3 benchmark of each test.
----
Here are the results from this first batch of ROM's:
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Don't forget that benchmarks for newer ROM's can be followed here:
http://forum.xda-developers.com/showthread.php?t=700755
---
Also remember that this tests are solely to measure the 2D/3D performance of a ROM, what in no way can be used to measure if a ROM is better or worse then another. It's only for games and overall "snappiness".
Bye
Hey. Thanks for the comparisons. This is very useful.
I have always said that BeHero was the best 2.1 ROM. It is very quick.
Villian was always the slowest for me but had more 'fixes' and features (just as google voice search).
I am currently running Legendary 1.3.5 (the 'upgrade' to BeHero...), which is as good as its predecessor.
Rep +1
jUsT2eXy said:
I am currently running Legendary 1.3.5 (the 'upgrade' to BeHero...), which is as good as its predecessor.
Click to expand...
Click to collapse
According to the post you replied to, it is not as good as its predecessor when it comes to OpenGL performance - I would say it comes at an overall third place in that list.
That said, I wonder whether this should be taken as a measure for performance of a ROM.
Does OpenGL affect performance of the entire device? Or just, as I suspect, those processes which can make use of it - some games perhaps?
naenee said:
According to the post you replied to, it is not as good as its predecessor when it comes to OpenGL performance - I would say it comes at an overall third place in that list.
That said, I wonder whether this should be taken as a measure for performance of a ROM.
Does OpenGL affect performance of the entire device? Or just, as I suspect, those processes which can make use of it - some games perhaps?
Click to expand...
Click to collapse
Hi. Yeah I did read the post I replied to and saw that Legendary came 3rd. But in fact, well in my opinion it is a better performer than its predecessor contrary to the benchmark statistics above.
To me, it feels snappier. Though the stats. say differently.
Just like a car might feel faster than the car you previously drove, but in fact it is not... if that makes sense lol...
where can i download Legendary 1.3.5 ?? i recently flashed my Hero but I do not know which ROM to use for the best.. all I want is a smooth, not sticky ROM which will enable me to use my phone without it freezing... I just dont know where to get the ROM's or which one to go for,,,, can someone PLEASE help me..... thanks
Just tested vanillain rom hybrid 1.0 (fresh install)
NeoCore without sound: 29 fps
Neocore with sound: 25 fps
Ian_4614 said:
where can i download Legendary 1.3.5 ?? i recently flashed my Hero but I do not know which ROM to use for the best.. all I want is a smooth, not sticky ROM which will enable me to use my phone without it freezing... I just dont know where to get the ROM's or which one to go for,,,, can someone PLEASE help me..... thanks
Click to expand...
Click to collapse
google is your friend.
Here is the direct link
Here is the google link. It is much easier to google it than wait for a reply...
http://www.google.co.uk/search?q=Le...s=org.mozilla:en-GB:official&client=firefox-a
thanks good thread up
Added CyanogenMod for Hero v1.0
i am really sorry to sound like such a noob,, but what does that mean ?????
Ian_4614 said:
i am really sorry to sound like such a noob,, but what does that mean ?????
Click to expand...
Click to collapse
Hello,
I'm doing this tests for my own pleasure since I like measuring performance and I saw a good opportunity here and for the moment I have some spare time
Anyway, this tests compare the 2D/3D performance across the different ROMs available for the users in this forums. For some people this might be important, like for me, since I have quite a few games in my Hero. Also it's important for people that cannot stand "lagginess" or "sluggishness" (I don't have a clue how to spell that...) in your home screen and/or browsing the ROM
Added Androbin 1.1110 & Defiance 2.1
Villain 3.4
NeoCore (with sound): 24.6
NeoCore (without sound): 29.9
Softweg (GPU test): 120
Favour
Could you do me a favour and chuck in a 1.5 ROM just for a sense of comparison, such as mr.bang performance rom. Just want to see how much of a 'gain' we get in terms of visuals from the switch to 2.1 if any at all, thanks
You should add Kagu Droid with JIT to the test.
Arkymedes said:
Added Androbin 1.1110 & Defiance 2.1
Click to expand...
Click to collapse
Could you pls add Villain 5.1 pls?
Hi,
I'm trying to add the most number of ROMs possible and about the cupcake version, it's not possible since NeoCore doesn't run
But yes, I would love to check the performance between them.
Re: [Benchmark] 3D/OpenGL performance across ROMs
Ahh thats a shame. In that case could legendroid be uploaded please, i can a few tests and i think it could beat behero!
Sent from my Hero using the XDA mobile application powered by Tapatalk
bratfink said:
Could you do me a favour and chuck in a 1.5 ROM just for a sense of comparison, such as mr.bang performance rom. Just want to see how much of a 'gain' we get in terms of visuals from the switch to 2.1 if any at all, thanks
Click to expand...
Click to collapse
Mr Bang concept 2.0 gets 29FPS without sound.
Arkymedes said:
Hello,
I'm doing this tests for my own pleasure since I like measuring performance and I saw a good opportunity here and for the moment I have some spare time
Anyway, this tests compare the 2D/3D performance across the different ROMs available for the users in this forums. For some people this might be important, like for me, since I have quite a few games in my Hero. Also it's important for people that cannot stand "lagginess" or "sluggishness" (I don't have a clue how to spell that...) in your home screen and/or browsing the ROM
Click to expand...
Click to collapse
Are you sure OpenGL is used outside of apps/games specifically written to make use of it?
Does anyone have a work around for the 30 fps cap the Incredible has on the GPU?
What 30fps cap?
More like, it just doesn't have enough balls to hit 30+ fps, most the time
hahaha true true. I've read that HTC has capped the EVO and the Incredible at 30fps on the GPU.
No, just the Evo. Something to do with HDMI.
I would expect a higher quadrant score with the 1ghz processor the Droid X almost puts up the same numbers and it's running 2.1.
The GPU is making up for it. Quadrant is very GPU oriented.
That and the OMAP is faster. So its a lose-lose situation for us. The GPU in the X walks all over ours.
Kind of like integrated graphics vs a discrete graphics card in a computer.
Makes sense...too bad though I'm the type of guy that always has to have the latest and greatest don't get me wrong the incredible is a great phone can't beat the form factor but I wish it had a little more power under the hood in the area of graphics processing.
HeyItsLou said:
Makes sense...too bad though I'm the type of guy that always has to have the latest and greatest don't get me wrong the incredible is a great phone can't beat the form factor but I wish it had a little more power under the hood in the area of graphics processing.
Click to expand...
Click to collapse
I agree 100%.
adrynalyne said:
The GPU is making up for it. Quadrant is very GPU oriented.
That and the OMAP is faster. So its a lose-lose situation for us. The GPU in the X walks all over ours.
Kind of like integrated graphics vs a discrete graphics card in a computer.
Click to expand...
Click to collapse
It's pretty interesting actually. I thought the same thing, until I saw quadrant run on a droid X. It does get higher fps in most of the 3d tests, (the rotating planet/moon is really choppy and in the low teens of fps)
Anyway, because I had nothing better to spend my money on, I bought the advanced version of quadrant.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
The GPU does score a bit higher in 3d, though for whatever reason the I/O (read/write test) scores crazy high compared to anything else. That's where the most
of the score is coming from...
but on topic, there is no framerate cap. Download fps2d fro the android market and see for yourself.
It's interesting that you say that. I've been doing a lot of development work lately on the DInc and when transferring files I have been getting blazing speeds... much higher than on any other solid state/card reading device I own (why couldn't Nvidia stick a sexy little GPU in there... *sigh* just have to wait a couple years).
I think the lack of 3D performance on the Incredible is due to the drivers HTC includes for the Adreno GPU. I've read that the drivers they include aren't optimized or tweaked at all.
I remember there being a thread a while back about porting drivers from the Samsung devices using it since they were getting much better performance out of the same GPU. Anyone remember that or have any new info on that development?
I'm very disappointed with the Slackdragon chip. I hate the slow downs during game play. Asphalt consistently crashes on this phone.
The guys using the more than 3yr old HTC Vogue just got a new kernel and are enjoying over 30fps on Neocore. I have never reached 26fps. Granted they have DZO who's a brilliant programer but there is no reason why a phone that's years old and is not even an Android phone (at least not native) should be anywhere close to our phone. That phone came with a 400mhz chip and no drivers for the GPU.
I love the form factor and screen on this phone but I doubt any amount of overclocking will ever solve its problems. My next phone will definitely not have Qualcomm chip.
Sent from my ADR6300 using XDA App
I enjoy the phone for what it is.
Otherwise I would have returned it. If someone bought this phone thinking it was a gaming powerhouse...LOL?
Buyer beware, research first.
I will take a 1ghz CPU over a 550mhz CPU, even if it plays games better. I need it to be fast as a phone, not crappy slow except for games.
When Android starts being GPU driven, then I will pay more attention to faster gpus.
You can have the fastest GPU of all, and still run like crap. Ask Samsung Galaxy S owners who are suffering lag and slowness due to apps installing only to sd internal storage But hey, they run games fast!
Dude I didn't buy the phone to replace my xbox but it'd be nice if games didn't crash on my phone. On paper the snapdragon seems great but in all actuality the first Droid isn't far behind at all at half the speed and it out performs this phone when overclocked to 1.2ghz.
I still really like this phone especially now with Froyo but that doesn't mean I can't wish the snapdragon chip wasn't a slacker. I did my research and unless I went with the iphone (which I'd never get) I was not get better 3d performance...on paper. Even video slows down on this phone sometimes. That just doesn't seem right
Sent from my ADR6300 using XDA App
Take Froyo on both phones.
Run Linpack with Moto at 1.2ghz, and Dinc at 1ghz.
Chuckle at how much higher score the Dinc gets.
The game performance is about the same (with oc'ed Moto Droid taking the lead), but the rest is not even in the same ballpark as the Dinc.
It's likely capped at 30 fps to sync with display refresh rate (otherwise known as v sync ) and yes with modifications to the drivers it will be possible to increase this. But as for now I agree with adrenaline and enjoy the phone for what it is.
Don't get me wrong I'm always game for more performance but even at stock clock speeds the incredible is plenty fast. Faster gpu would be at the bottom of my list for tweaks to be made. Even so I'm sure someone will be working on it soon enough.
Sent from my ADR6300 using Tapatalk
*SOLVED*
Milestone Overclock - a free download from the marketplace does now support the Defy. Quadrant shows promising figures for sure.
Just wondering whether anyone has gotten the Defy to Overclock?
I've been trying some Droid Overclock apps as well as purchasing Set CPU.
I've successfully rooted my phone which is a requirement for enabling overclocking features. Set CPU won't even start.
None of the apps I've tried have been working properly.
Any tips?
in developement
Look on the milestone overclock googlecode page, its on the todo list
good to know
Yepp, thanx a lot. Since the chipset has clear OC potential this will be very interesting. Especially if the Defy has an omap3630 core, we'll see.
dave79 said:
Yepp, thanx a lot. Since the chipset has clear OC potential this will be very interesting. Especially if the Defy has an omap3630 core, we'll see.
Click to expand...
Click to collapse
I'm pretty confident that it does indeed have a 3630: http://forum.xda-developers.com/showpost.php?p=9540564&postcount=34
Not only because of the screenshot from windows, but look at how close it is to the Droid X, running a 1ghz 3630.
Wow! and getting that benchmark score while running on 800MHz is quite impressive. I've got good hopes that a ported Milestone Overclock will unleash the raw power the phone truly possess.
And this is not the best defy can do. Actually 1117 has been reported from 2 users (one is me).
Im not sure how this phone is so amazing, and so cheap at the same time
umm yeah anyways, just wanted to say i got quadrant scored of around 1110 to 1118 ish i think- after task killing
Really hoping for some custom 2.2 roms in the near future, like some others said it will make this probably -one of- the best androids out there
xdaid said:
And this is not the best defy can do. Actually 1117 has been reported from 2 users (one is me).
Click to expand...
Click to collapse
My personal best is 1104
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Whoa, nice one, Higgsy!
Sorensiim said:
Whoa, nice one, Higgsy!
Click to expand...
Click to collapse
weeeeell to be fair there was a little cheat there, that was with JIT enabled. But JIT by the standard method wasn't stable, at first it was fine but then after ab out an hour I started to get random force closes, so I reverted. Its a little insight to what can be achieved with JIT. IMO I'll take JIT over a 1GHZ overclock.
Could anyone of you guys share your benchmark results after running Milestone Overclock? I'm now running on 1.2GHz and it's stable
xdaid said:
And this is not the best defy can do. Actually 1117 has been reported from 2 users (one is me).
Click to expand...
Click to collapse
My first benchmark result was in mid 1000 but after a restart I got that score too.
To use JIT is better wait for froyo because have it in native form. There are a appl called JITTER in the market but I think that isn't reliable. (I don't know about other appl similar than)
Now I use the Milestone Overclock beta4 and configure the oc at 1000/56
Someone have better configuration to use? Can explain why?
Hey guys.. Overclocked my Defy with the Milestone Overclock. 1200/66
Got a 1438 benchmark on Quadrant Standard. Putting the vsel any lower got my Device to reboot.
After trying it out I switched back to 1000/52 because some users said that running on 66vsel could damage the CPU.
Main effect I had: Launcher runs very smooth, My battery life went down to 24 hours (37h before).
With 1000/52 I still get a benchmark around 1247
Works for me because I´m saving battery and still got enough power to have a smooth launcher.
But: Can anyone please tell me what the standard settings are ? *lol* Forgot them 800Mhz an vsel=???
Thx in advance.
Daniel (from germany)
Daniel.Stevens said:
Hey guys.. Overclocked my Defy with the Milestone Overclock. 1200/66
Got a 1438 benchmark on Quadrant Standard. Putting the vsel any lower got my Device to reboot.
After trying it out I switched back to 1000/52 because some users said that running on 66vsel could damage the CPU.
Main effect I had: Launcher runs very smooth, My battery life went down to 24 hours (37h before).
With 1000/52 I still get a benchmark around 1247
Works for me because I´m saving battery and still got enough power to have a smooth launcher.
But: Can anyone please tell me what the standard settings are ? *lol* Forgot them 800Mhz an vsel=???
Thx in advance.
Daniel (from germany)
Click to expand...
Click to collapse
Someone in the other thread was running 800/38, I haven't tried it because like you 1000/52 gives me better battery life than stock and more power on top.
Higgsy said:
Someone in the other thread was running 800/38, I haven't tried it because like you 1000/52 gives me better battery life than stock and more power on top.
Click to expand...
Click to collapse
Thanks for answering ;0)
I just wanted to know the original settings in case I wanted to restore them someday.
Or do I just have to click on "unload module" for that ?!? (I gues that´s it I was just to blind/dumb to see it *lol*)
Thx ;0)
Daniel.Stevens said:
Thanks for answering ;0)
I just wanted to know the original settings in case I wanted to restore them someday.
Or do I just have to click on "unload module" for that ?!? (I gues that´s it I was just to blind/dumb to see it *lol*)
Thx ;0)
Click to expand...
Click to collapse
Yeah just unload module and untick apply on boot and your back to stock
Im currently running 1100MHZ with a 58vsel, seems stable so far and got a quadrant benchmark of 1317. But i am wondering if this setting is safe for long term use, I need my phone to last till the end of this conract
I have an XPERIA Arc LT15i. Single-core 1-GHz processor, 512 MB of RAM (much less available to the user, though). I've tried different ROMs, and the highest that I'd ever got on the Antutu benchmark was somewhere in the 5000s. Usually, though, it hovers between 4400 and 4800-ish. I tried a CM10-based MIUI ROM a while back, however, and the Antutu scores were completely off the charts.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
I'm wondering how it's possible for a 1-GHz single-core processor to match a much superior (dual-core) processor (the Optimus 2X) in terms of performance. Or are these benchmarks, which the myriads of review sites out there use to make comparisons between phones, actually rubbish? I'd love to have some clarifications/opinions.
On arc s overclocked to 1.6 running CM10 and a Fusion kernel I'm getting 6250 without rebooting before benchmark and with a few processes running in a background.
edit
I'll try with stock 1.4 and report results.
edit
6148 on 1.4ghz. Also keep in mind that anyone can install a GB rom with kernel that supports overclocking up to 2.0ghz to get even bigger score. Arc s is still a pretty capable device.
edit
Oh you were talking about arc not arc s xD But my point is still true because there is only 400mhz of difference between these phones.
NEVER use Antutu or any other benchmark tools to determine the performance. Benchmark score can easily get cheated by overclocking, increasing memory read ahead or using different IO scheduler
____________________________________________________________________________________________________________
if I helped press thanks :good::good::good:
NEVER use Antutu or any other benchmark tools to determine the performance. Benchmark score can easily get cheated by overclocking, increasing memory read ahead or using different IO scheduler
Click to expand...
Click to collapse
But its not cheating... I agree that benchmarks are not really that accurate and every score should be taken with a grain of salt but overclocking is not cheating. Cheating would be making a modifications to antutu apk for bigger scores.
Thank you for your opinions. However, I've never overclocked the processor on my phone to this date. The mere thought gives me the jitters. What if it burns out? Going by those scores, maybe the ROM overclocked the processor itself without my knowing. Have any of you tried overclocking, though? And, have you noticed any difference in performance or stability issues? Maybe the battery would drain out quicker, too.
MarcSinger said:
Thank you for your opinions. However, I've never overclocked the processor on my phone to this date. The mere thought gives me the jitters. What if it burns out? Going by those scores, maybe the ROM overclocked the processor itself without my knowing. Have any of you tried overclocking, though? And, have you noticed any difference in performance or stability issues? Maybe the battery would drain out quicker, too.
Click to expand...
Click to collapse
If you have read my previous post you would know everything that you asked. On CM10 I'm getting more than 6000 points in antutu without any overclocking (arc s CPU's frequency is 1.4ghz) : D Its not that scores on CM10 are high its just that scores on stock firmware are low. Sony's software is bloated and ****ty in overall.
Overclocking is safe if you are doing it with brain. If you set Arc CPU (1ghz) to 2ghz it will fry for sure but setting it to 1.2 should be perfectly safe. Overclocked phone drains battery faster but its pretty obvious everything is stable and a little smoother.
pypcier said:
If you have read my previous post you would know everything that you asked. On CM10 I'm getting more than 6000 points in antutu without any overclocking (arc s CPU's frequency is 1.4ghz) : D Its not that scores on CM10 are high its just that scores on stock firmware are low. Sony's software is bloated and ****ty in overall.
Overclocking is safe if you are doing it with brain. If you set Arc CPU (1ghz) to 2ghz it will fry for sure but setting it to 1.2 should be perfectly safe. Overclocked phone drains battery faster but its pretty obvious everything is stable and a little smoother.
Click to expand...
Click to collapse
No, I would NOT have known everything that I'd asked. My question was whether there were any stability or battery-drain issues with overclocking, but none of those queries were addressed on your previous post.
But thanks for the clarifications on the scores. Yes, stock ICS is absolute rubbish, that's why I've moved on to CM10/Jelly Bean. It doesn't have the "customizations" you can get with stock ICS, but it's smooth, responsive, fluid, and that's what matters to me.
By the way, I do believe 400 MHz SHOULD make quite a bit of a difference. A 600-MHz processor and a 1-GHz processor wouldn't be giving a similar performance. Correct me if I'm wrong.
Overclocking your Arc to 1.4GHz should be a clearly visible upgrade but I'm not sure if this would be healthy for your phone. It's almost 50% more in performance but under heavy load this could cause some high temperatures and degradation of your phone's battery and cpu life. My Arc s is clocked at 1.6 all the time and it doesn't even gets too hot while playing games so 200MHz more seems right and safe to me.
edit
Values described in this post as "safe" or "best" may not be the same for you so google everything before making any changes to your phone.
Hi guys,
Following the development of CM11 for the Defy(+) by @Quarx, I decided to share the evolution of performance "Nightly".
The results were obtained from the average of 3 tests for each "Nightly", using two app for measuring performance: Quadrant and AnTuTu.
Configuration for testing:
CM11 Nightly (by @Quarx)
Defy+ (MB526)
CPU (OC): 300/20 600/35 900/50 1200/64
CPU (SC): 300/33 600/48 800/58 1000/62
Governor: Interactive
I/O: Deadline
Installation conditions: No clean install (version over version)
TWRP > Advanced Wipe > Dalvik Cache/Cache
Install > Nightly/GApps > Wipe Cache/Dalvik > Reboot System
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Added test on SC (Stock Clock) at the request of @Blechd0se
* Random reboots occurred frequently in the early versions. For me no longer occurs since version 2014.01.24 (except version 2014.01.28, very problematic);
* Crashes occur on Google Search (maybe because I'm using GEL) and Aero Control in the first 4-5 reboots (it seems necessary to stabilize the unclean installs). After, no more crashes!
* @Quarx and @Blechd0se, the greatest variability between consecutive tests in both apps is about IO (reaching 40-60%), by showing up unstable;
BUG @Quarx (and @okij):
Camera: auto-focus doesn't work using size 3.7M (best aspect ratio - the same of screen);
Shortcuts from Apps moved to SD card disappear after reboot;
Battery Drain: 2014.02.08, 2014.02.09, 2014.02.10, 2014.02.11, 2014.02.12;
Battery charge bugs: 2014.02.18, 2014.02.19, 2014.02.20;
Additonal information:
_ Development-related forum (here);
_ Short Path to clean install (here);
_ Bug list by @okij (here);
_ CM11 by @Quarx (here);
_ BaNkS GApps (here) - use only Banks Minimal GApps;
_ For those interested, following link GEL (Google Experience Launcher);
Special thanks for the improvements in the kernel obtained by @Blechd0se!
Sorry for my bad english
Awesome work, keep with this !
Add
All tests were done with my device using all applications for daily use (added to BaNkS GApps, amounted 159 Apps), connected with the following services: Wi-Fi, Location, 2G/3G and Sync.
good:
Welcome @Saturnal here on xda and thanks for this nice debut, well done! If possible, update your thread (preferably the opening post) when new nightlies are released.
I just announced your thread here on the CM11 development thread, because many users are mainly reading the dev thread and I think that your thread deserves some attention.
Great work, keep up!
Could you provide some subjective experiance about less measurable performance as well? I think the most interesting and important would be wake up time during calls (for me at least). In this manner it seems to be worse over time on my device (I also don't do clean installs).
Great work! For reference I Can aport my numbers in antutu I get 4789 with a Defy Red lens in the last CM10.2
Thanks for the info! It is nice interesting to see the difference between the builds (and between the effect on the different benchmark-types).
How precisely does it make sense to compare these numbers with benchmarks on other Defy's with other installed apps?
If meaningful, I might do a benchmark of my own Defy.
I ask this because I find my Defy on Wiui to bug/crash/slow down a bit too much lately (after a few months of using it) and therefore I'm thinking of trying another ROM. As I read that Kitkat in general was lighter on RAM-usage, I tought of looking at that direction. (I'm not that interested in the latest GUI etc., rather looking for stability, efficiency and performance.)
Very interesting. For what it is worth, I get AnTuTu score 4893 with 0126, and a score of 5074 with 0205 nightly. The phone is overclocked to 1200 MHz.
okij said:
Welcome @Saturnal here on xda and thanks for this nice debut, well done! If possible, update your thread (preferably the opening post) when new nightlies are released.
I just announced your thread here on the CM11 development thread, because many users are mainly reading the dev thread and I think that your thread deserves some attention.
Click to expand...
Click to collapse
Thanks @okij and everyone, I'll update today.:good: Yesterday I had many problems to connect to the forum.
NPeete said:
Great work, keep up!
Could you provide some subjective experiance about less measurable performance as well? I think the most interesting and important would be wake up time during calls (for me at least). In this manner it seems to be worse over time on my device (I also don't do clean installs).
Click to expand...
Click to collapse
Sure! Is fairly smooth transition of screens (I'm using GEL). Keeps bug #31 (screen is half blacked out while getting incoming calls) and #26 (screen needs about 5 seconds to wakeup when a call is receive). Crashes occur on Google Search (maybe because GEL) and Aero Control in the first 4-5 reboots (it seems necessary to stabilize the unclean installs).
Johan_V said:
Very interesting. For what it is worth, I get AnTuTu score 4893 with 0126, and a score of 5074 with 0205 nightly. The phone is overclocked to 1200 MHz.
Click to expand...
Click to collapse
Thanks, but it's clear that I posted averages between 3 tests, so got higher values than those shown in the chart Moreover, different test conditions lead to different values.
:good:Keep doing tests and posting to help all users with more references!
bblubb said:
Thanks for the info! It is nice interesting to see the difference between the builds (and between the effect on the different benchmark-types).
How precisely does it make sense to compare these numbers with benchmarks on other Defy's with other installed apps?
If meaningful, I might do a benchmark of my own Defy.
I ask this because I find my Defy on Wiui to bug/crash/slow down a bit too much lately (after a few months of using it) and therefore I'm thinking of trying another ROM. As I read that Kitkat in general was lighter on RAM-usage, I tought of looking at that direction. (I'm not that interested in the latest GUI etc., rather looking for stability, efficiency and performance.)
Click to expand...
Click to collapse
Makes sense to analyze the variation of the benchmarks on the same device in pre-established conditions. So we can see which version is more optimized for use!
If you think about changing ROM, I strongly recommend CM11 by @ Quarx!:good:
BadFranch said:
Great work! For reference I Can aport my numbers in antutu I get 4789 with a Defy Red lens in the last CM10.2
Click to expand...
Click to collapse
Have got 4853 (AnTuTu) and 1962 (Quadrant), but only posted the averages. Maybe it's time you experience the CM11!
Sent from my Defy+
Saturnal said:
View attachment 2561658
Sent from my Defy+
Click to expand...
Click to collapse
I have red lense Defy with GB kernel and latest CM7. No OC, 1000mhz
Antutu score 3900.
Now what is interesting is that you have everything better exceptdatabase I/O. I have 360 and you 215. Hm, Storage I/O is again on your side and nearly double. Mine 425 against your 922+. What is holding down CM11 in this department I wonder.
It is interesting how much results differ. With 0205 nightly I now get consistently over 5200 with AnTuTu. Of course benchmarks results will not translate to real world performance, but 0205 feels very smooth. Telephony problems are gone too, after the build.prop fix.
On the hand, quadrant scores are lower than Saturnal's, average is 1557.
ezantera said:
I have red lense Defy with GB kernel and latest CM7. No OC, 1000mhz
Antutu score 3900.
Now what is interesting is that you have everything better exceptdatabase I/O. I have 360 and you 215. Hm, Storage I/O is again on your side and nearly double. Mine 425 against your 922+. What is holding down CM11 in this department I wonder.
Click to expand...
Click to collapse
There is great variability in the score Storage I/O. Have found values between 271-956. See a test using Stock Clock 1000MHz.
Johan_V said:
It is interesting how much results differ. With 0205 nightly I now get consistently over 5200 with AnTuTu. Of course benchmarks results will not translate to real world performance, but 0205 feels very smooth. Telephony problems are gone too, after the build.prop fix.
On the hand, quadrant scores are lower than Saturnal's, average is 1557.
Click to expand...
Click to collapse
It's an amazing score. If I get the best value of all tests pass little more than you found, reaching 5235 (AnTuTu).:highfive:
Very good work! Just a suggestion: could u add another benchmark app like basemark?
Enviado desde mi MI 2S mediante Tapatalk
espaciosalter20 said:
Very good work! Just a suggestion: could u add another benchmark app like basemark?
Enviado desde mi MI 2S mediante Tapatalk
Click to expand...
Click to collapse
Thanks! But, there's a great variety benchmarks in market. I lose a lot of time to obtain consistent results. Unfortunatly, I can't comply your request. Moreover, basemark is focused on graphics performance, while our target is the entire hardware performance combined with CM11.:good: