Develop Bugs

[Q] Benchmark questions!

First off I'm fairly aware of the fact that benchmarks are not accurate representations of the day to day real life usefulness of the handset.
That said, I used both linpack and quadrant standard edition for the first time tonight while testing another kernel with my current rom (which is cm7, ggingerbread-6).
At the conclusion of my testing it was very obvious that one kernel completely outclassed the other in a benchmarking situation, however something else became apparent that leads to this post.
If I follow and believe everyone else's benchmark scores, even those posted an hour earlier in the same kernel thread, then I might have the slowest Evo on planet earth.
I see other users of the same rom and kernal posting scores which are never below 1500 in quadrant, I saw one instance of 1300 but nonetheless, even overclocking to 1075 I can barely break 1100 and usually fall just below that. Sadly enough on the "slower" of the 2 kernals I was barely surpassing 900.
Now on the linpack side of things I don't have any comparative scores to judge against, but ill post what I received anyhow for information's sake. On the "faster" of the two kernels (the one that came prebuilt into the rom) I was getting between 33-34, on the new kernel I was testing I was getting between 19 and 22, these are all "mflops" of course, whatever that may be.
Someone give me some information or advice here! Do I just happen to have a slow evolution, or are others either exaggerating or using some trick/mod/tweak I'm royalty unaware of??
Thanks in advance!

some people brag, some people cheat, most have low scores, few have high, there isn't a very good baseline and the benchmark programs dont scale very well at all, I have run 1800 scores and I have run 600 scores, guess what. both roms were smooth and you wouldn't have been able to tell a difference, what does that mean? do we believe the benchmark programs? are they spitting a random number at us? who knows! dont believe them, be satisfied with how your evo is running and if it's not running very well then try a different kernel or rom, keep trying new ones until your satisfied, only then will some benchmark program output not mean a thing

Most of my Quadrant benchmarks with aftermarket ROMS+kernels have been in the 1100-1400 range, using VaelPak and various kernels to get most of the better scores there. The highest I've had was CM7RC1 with the SnapTurbo kernel, got an 1821. It was unusable, though.
I've come to the conclusion that the benchmarks aren't as important as battery life, especially with the Evo.

Biggest reason for the huge difference in numbers? Different versions of the app. The dev changed how it rates phones.
Sent from my PC36100 using XDA App

Thanks!
Explained. I knew they were totally not concurrent with the outward performance and usability of the device, and for what its worth while I've only ever flashed a total of 3 roms, this one is perfect for me and I seem to be one of the rare few with no problems whatsoever, everything works exactly as I would expect it to. So yes, l never feared my device was suddenly slower now that I knew the all knowing superultrabenchmark number.

High benchmark, what set up?

I eventually ran a benchmark on my CarbonROM install on my Sprint Galaxy Nexus, clocked at a max of 1.6
But, I saw that my device compared to others is just super super low, I don't have the numbers on me as I don't have my phone, but if you're one of those people who have a high benchmark score, what's your setup?
I know it's said that benchmarks aren't important, but they at least have to mean something with performance.
So, what are you running?

Try flashing franco.Kernel. Makes a huge difference!
Before franco: 2204
After franco: 2932 (Quadrant Standard)
ROM: PACman ROM, 1.2 GHz

Seriously, there should be a thread stickied for the bench freaks, all in the same place. *sigh*
Sent from my Nexus

bk201doesntexist said:
Seriously, there should be a thread stickied for the bench freaks, all in the same place. *sigh*
Sent from my Nexus
Click to expand...
Click to collapse
There is one. Just needs sticky-ing.

Beauenheim said:
I know it's said that benchmarks aren't important, but they at least have to mean something with performance.
So, what are you running?
Click to expand...
Click to collapse
See, the thing is, benchmarks really do mean nothing. Benchmarks don't affect how well your device performs. If it runs fast, it runs fast-- you don't need the benchmark to know that.
Sent from my Mahjong Nexus

Beauenheim said:
I know it's said that benchmarks aren't important, but they at least have to mean something with performance.
So, what are you running?
Click to expand...
Click to collapse
Yeah. Because being able to crunch 110,000,000 triangles vs 90,000,000 has real world implications.

Yay! It's been a while since we've had a thread to remind us how useless benchmarks are and offer us all an opportunity to debate about it, yet again.:good:

I make my words what Chainfire said, but globaly.
If you trust benchmark results, you'll know that running naked in the garden for 5mins will affects performance by 20%

Neat, alright.
So absolutely nothing?
That really doesn't make any sense to me. Those 90,000,000 triangles being processed will at least show me how well it will do in a game, to a degree, right?

Not in any way you could actually notice. That was also an extreme hyperbole as far as differences go. To be totally honest, the only real value of benchmarks is stress testing an OC but even then there are better ways.

063_XOBX said:
Not in any way you could actually notice. That was also an extreme hyperbole as far as differences go. To be totally honest, the only real value of benchmarks is stress testing an OC but even then there are better ways.
Click to expand...
Click to collapse
Well alright, thanks for your insight. I've been in the android game for awhile but I don't know a lot of these things.

How Many People Here Overlock? CPU and GPU?

Just a quick Poll
How many of you fine folks OC? CPU, GPU, or CPU + GPU? What do you run at and what Kernel?
Just curious!

Nothing here. Don't see the need. That's just me though
Sent from my CLEAN Note II

brandonarev said:
Nothing here. Don't see the need. That's just me though
Sent from my CLEAN Note II
Click to expand...
Click to collapse
+1 fully stock:thumbup:
Sent from my SAMSUNG-SGH-I317 using Tapatalk 4 Beta

I'm at 1800 MHz CPU and 733 MHz GPU - Just because my phone doesn't seem to run any hotter, battery life isn't impacted much - I overclock both on my PC, so I fall in the "why not get the free performance boost" sector.

Both 1800/640. I'm also in the why not free power crowd.
Sent from my SAMSUNG-SGH-I317 using Tapatalk 2

I've only over clocked the cpu to 1704 I'm all for the why not get the free power but I'm also cognizant of the argument that over clocking can reduce the lifespan of the hardware. Anybody have any comments or views on that? Would like to hear some other opinions.
Sent from my SGH-I317M using XDA Premium HD app

1800mhz on carbon 1.8
Stock GPU speed. ..
Nova launcher set to faster than light. ..
Among 27 other major mods...
It's like you can hear my phone snap on screen transitions. ..lol...g
Sent from my SAMSUNG-SGH-I317 using XDA Premium HD app

I'm running....
Stock CPU/GPU Speed running CleanRom 3.0 SE AT&T
Saber Kernel 35.6 Trickster Mod Touchwake features
Apex Launcher Paid Version

stock speeds
i haven't found the need to oc the note 2. just running a custom rom that removed all the bloatware on it does wonders for me.
i am running the newest jedi and way new to the root and rom thing. it's nice to be able to overclock or underclock if i wanna.
the note 2 is by far the best phone i have ever owned.

What benefit do you guys see in over clocking the GPU?
Sent from my SAMSUNG-SGH-I317 using Tapatalk 4

I would love to see benchmarks with overclocking of the Note 2, I am leery to touch it because something like Asphalt 8 already makes the phone VERY HOT around the camera lense area on the back.
ps. Asphalt 8 was unplayable on my phone with the stock rom, no matter what you did to clean up the ram, etc, even on the 'Medium' graphics setting. It hitched, it lagged, it hiccuped, and it made a game where you are constantly relying on drifting unplayable. After switching to the Probam rom, the game flies - on the highest setting. It never hitches, ever. I don't know if it is Android 4.3 giving the hardware more breathing room or just a cleaner overall OS that uses less Ram, either way the difference was ridiculous - and I am not overclocked. Yet.

since benchmarks mean absolutely nothing, when it comes to comparing phones, you'll be hard pressed to find anything posted here..most people, with a decent knowledge of how phones work, understand that posting these things are nothing more than an attempt to brag that your phone may or may not be running faster than someone else's; the truth being that no 2 phones do anything exactly like the other, no 2 people have the same exact setup, files, and other stuff on their phones, so these types of comparisons are completely meaningless..
I dont play Asphalt 8, but I have read other posts about people saying it makes their phones run hot...

wase4711 said:
since benchmarks mean absolutely nothing, when it comes to comparing phones, you'll be hard pressed to find anything posted here..most people, with a decent knowledge of how phones work, understand that posting these things are nothing more than an attempt to brag that your phone may or may not be running faster than someone else's; the truth being that no 2 phones do anything exactly like the other, no 2 people have the same exact setup, files, and other stuff on their phones, so these types of comparisons are completely meaningless..
I dont play Asphalt 8, but I have read other posts about people saying it makes their phones run hot...
Click to expand...
Click to collapse
Uhhh... How do you come up with the logic to say that "benchmarks mean absolutely nothing"? They certainly do mean something, the app is stress testing every functionality of the phone and measuring the results. What they are testing are systems (both hardware and software) that are used to push GAMES. Not 'Angry Birds', I am talking about engines pushing tens of thousands of polys with textures, sound effects, physics processing, redrawing the screen several times over for effects like shaders, etc, etc, etc....
Overclocking certainly makes a VERY REAL difference on a pc, how is a phone any different? You push the limits of the hardware beyond the specs it is 'rated for', some phones will make too much heat even with minor overclocking and result in crashes, lockups, and finally permanent failure. Some phones will handle the extra heat, and overclocking will result in noticable boost in performance. Yes, some game engines are locked at a specific framerate and will not be able to take advantage of 'more power', but in general a serious game engines uses all the resources available in the form of raw framerate.

using benchmarks to compare your phone to mine is meaningless; you dont have the same apps as me, you dont have the same settings as me, you dont have the same number of accounts checking email, you dont have the same amount of background apps as me, your settings are not the same as mine, and so on..
if you are having serious issues with your phone, benchmarking can be useful to determine if its software or hardware related, but otherwise, it has no true comparitive meaning...Go ahead a post a poll here, and see what I mean..anyone with extensive experience on this topic will agree..
I've been hacking/modding phones and pc's for 30 years, so, on this topic, I know of what I speak..

wase4711 said:
using benchmarks to compare your phone to mine is meaningless; you dont have the same apps as me, you dont have the same settings as me, you dont have the same number of accounts checking email, you dont have the same amount of background apps as me, your settings are not the same as mine, and so on..
if you are having serious issues with your phone, benchmarking can be useful to determine if its software or hardware related, but otherwise, it has no true comparitive meaning...Go ahead a post a poll here, and see what I mean..anyone with extensive experience on this topic will agree..
I've been hacking/modding phones and pc's for 30 years, so, on this topic, I know of what I speak..
Click to expand...
Click to collapse
I agree
Sent from my Note 2 using Tapatalk 4

wase4711 said:
using benchmarks to compare your phone to mine is meaningless; you dont have the same apps as me, you dont have the same settings as me, you dont have the same number of accounts checking email, you dont have the same amount of background apps as me, your settings are not the same as mine, and so on..
if you are having serious issues with your phone, benchmarking can be useful to determine if its software or hardware related, but otherwise, it has no true comparitive meaning...Go ahead a post a poll here, and see what I mean..anyone with extensive experience on this topic will agree..
I've been hacking/modding phones and pc's for 30 years, so, on this topic, I know of what I speak..
Click to expand...
Click to collapse
Word.....g
Sent from my SAMSUNG-SGH-I317 using XDA Premium HD app

Google edition roms lower benchmarks?

when I install a google edition or cyanogenmod rom or any rom thats not touchwiz I am getting lower scores just wondering why?

Lower's better. And all the TW junk in the background is taken out, leaving room for more processes, so of course it scores better.
Sent from my GT-I9505G using XDA Premium 4 mobile app

Tak23 said:
when I install a google edition or cyanogenmod rom or any rom thats not touchwiz I am getting lower scores just wondering why?
Click to expand...
Click to collapse
But does it feel faster? Because that's what really matters...

lordcheeto03 said:
But does it feel faster? Because that's what really matters...
Click to expand...
Click to collapse
This plus eleventy bagillion.
Benchmarks are totally arbitrary and meaningless.
TouchWiz ROMs scores great on benchmark tests because TW is specifically designed to perform well on such tests by putting the whole device into overdrive when the test is run. It doesn't mean that your day to day usage is better.

Tak23 said:
when I install a google edition or cyanogenmod rom or any rom thats not touchwiz I am getting lower scores just wondering why?
Click to expand...
Click to collapse
That's a very subjective statement. "Lower is better" really depends on the apo being used. Some, eg. Quadrant, a higher score is better. Linpack is the same way.
As said before, benchmark apps don't tell you the real performance of a device. Though they can give you a baseline or at least a general idea of different aspects. I wouldn't jump on the "benchmarks are useless" bandwagon as they do serve a purpose.
Sent from my SGH-M919 using xda app-developers app

KCRic said:
That's a very subjective statement. "Lower is better" really depends on the apo being used. Some, eg. Quadrant, a higher score is better. Linpack is the same way.
As said before, benchmark apps don't tell you the real performance of a device. Though they can give you a baseline or at least a general idea of different aspects. I wouldn't jump on the "benchmarks are useless" bandwagon as they do serve a purpose.
Sent from my SGH-M919 using xda app-developers app
Click to expand...
Click to collapse
Well they are useless when ROMs are set up specifically to perform well on benchmark tests. That gives aboslutely no real world value.
The only time there is any validity to a banchmark comparison is when you are trying to compare 2 things that are set up almost exactly the same with only a single differing variable.
Like if you want to see if a phone is bad, you'd need to run a benchmark on the target phone and another on a different phone of the same model with the exact same settings. Or if you want to see in a mod if the cause of reduced performance, you would need to run a benchmark without the mod, then immediately after the mod, and repeat it several times to ensure you get repeatable results. Etc etc etc...
You can't just abandoned the scientific method and compare a benchmark of a TouchWiz rom with a benchmark of an AOSP rom with god only knows how many differences in the set up (kernel, clock speed, gpu settings, voltage, etc etc etc) and have it be a valid means of determining which is the better rom in any way. You can't even set it up properly so that all the settings match and the only difference is the ROM because there is so much incompatibility betweent the two that factors into it. Especially when the TouchWiz rom is set up with methods of inflating it's scores on benchmark tests and the AOSP ROM isn't.

I agree. Scientific method comes first in determining the performance of a ROM. Actually I would say real world and use experience is the best method. Given today's Hugh end phones, our for example, getting the most out of a benchmark or anything else serves little purpose. I can disable 2, even 3 core and still have a smooth experience with most daily a activities. Even underclocking the CPU & GPU still retains all the speed and usability.
I think most tech literate people use benchmarks just to see what the phone can do. Also, as a quick though fairly inaccurate method of determining if you're ROM and it's mods/scripts are efficient.
To answer the OP's question though - since AOSP is HW accelerated, has been for a while now, it should be "faster" and yield better benchmarks. Less running in the background. The most things are integrated as opposed to added on to the base ROM and code. That's a very generic and butchered explanation.
Sent from my SGH-M919 using xda app-developers app

Benchmarks - Curiosity Posts

Anyone post some benchmarks! I personally don't hold a lot of stock in benchmarks but am curious about what other folks are getting... To me, this seems rather low but I'd like to see some others to compare...

jbarcus81 said:
Anyone post some benchmarks! I personally don't hold a lot of stock in benchmarks but am curious about what other folks are getting... To me, this seems rather low but I'd like to see some others to compare...
Click to expand...
Click to collapse
Not much better here, but like you said I don't hold much stock in benchmarks. Especially something like geekbench..

KonoeKyon said:
Not much better here, but like you said I don't hold much stock in benchmarks. Especially something like geekbench..
Click to expand...
Click to collapse
Unless it's total bias from the application. Should we not be rolling with the results? Shouldn't they be higher? Fastest chip available currently... Other specs... Just seems low...

jbarcus81 said:
Unless it's total bias from the application. Should we not be rolling with the results? Shouldn't they be higher? Fastest chip available currently... Other specs... Just seems low...
Click to expand...
Click to collapse
Too much can influence the results of benchmarks, like a random background app using up CPU cycles. Geekbench also isn't that reliable IMO anyway, they test difference cpus differently which make it look like the iPhones are as fast as laptops with core i7 processors which couldn't be farther from the truth.

I have the essential phone and the 2xl and this is what I got

Interesting stuff... And the comment made about Geekbench and Apple products is so true.. their benchmarks look so fake at times...

Yeah.. Unless Apple has the fastest chips on the planet.. these scores are a bit, what's the word?
Single core score for iOS and Android.. Top 3 results..