Processor benchmarks across roms using linpack - Hero, G2 Touch Android Development

Speed is my 1st priority in roms....
It would be very helpful if ppl post their linpack results for comparison...
Highest i have seen is
3.688 mflops
1.48 sec
Androbin_jit 1.1111 with wifi/bt/sync/gps turned off all apps closed except helix launcher2...
Wats ur best??? And which rom/config??????

and you think we need another thread for that?
http://forum.xda-developers.com/showthread.php?t=656818

Related

Benchmarks

Just done small comparison between 2.1 and 2.2 using linpack. On 2.1 it comes out with an average os 2.2 Mflops while on 2.2 it comes out with about 3.7 Mflops. What's everyone else getting?
I got the same scores
i heard the linpack doesnt give accurate results...i may be wrong.
have you all been able to use the Neocore(Qualcomm benchmark app) or Open GL benchmark with this new ext2 builds? all of those wrked perfectly on the older system sqsh. now i cant get them to run on this new builds with ext2. also alot of live wallpapers from b4 not wrking. anyone with any insight into this? ill do a linpack on mine device, which is basically overclocked to the max, to post what scores i get.

High Quadrant Scores like 2500+

Are we ever going to see quadrant scores like the hd2 is getting now ugh!!
A new rom has been imported to the hd2 that has it at 2800 quadrant score evo is better hardware and still at 1100-1500 whyyyy????
Sent From My HTC EVO4G
Lol.
What is the benchmark going to do for you?
garekinokami said:
What is the benchmark going to do for you?
Click to expand...
Click to collapse
Then what does it mean and why does it even exist?
Where can I download this at
If you really want it, you can get CM6.0 here:
http://forum.cyanogenmod.com/files/category/12-htc-evo/
and Snap 7.6 with Turbo here:
http://forum.xda-developers.com/showthread.php?t=733099
The current Snap only works with CM6.0 though which is a few versions behind, so you might as well wait though.
So the kernel is not universally compatible???
poulosjr said:
So the kernel is not universally compatible???
Click to expand...
Click to collapse
he did clearly say that it was only compatible with cm 6.0
no it is not universally compatible
the benchmark doesn't do anything for you anyway
Quadrant scores are a joke and easily manipulated, just look at CM6 with Snap Turbo. 2800 was my highest quadrant on it and speed was identical to all other roms.
Benchmark..Schmenchmark.....
The reason were all here is to improve the performance and functionality of our devices isn't it?? These scores are posted by every reviewer, manufacturers are giving us more powerful processors with each new device. Kernels and overclock tools are a staple in the dev community. How are these benchmarks not important? Sure they may not reflect the overall performance of the device in every case but if everyone viewed benchmark scores as useless data where would we be?? Not here trying to improve on them
DirtyShroomz said:
Quadrant scores are a joke and easily manipulated, just look at CM6 with Snap Turbo. 2800 was my highest quadrant on it and speed was identical to all other roms.
Click to expand...
Click to collapse
This. Even Cyanogen stated that the quadrant scores are fudged. I read his post somewhere, it had something to do with cheating on the I/O portion of the test.
My EVO with MIUI gets around 1750 and performs as good or better than when I was scoring 2600+ with cm6 and snap turbo.

Quadrant: Worse than you thought

As we all know quadrant is no reliable measure for speed. At least I knew this for a while now and it was repeated and quoted many times.
This article tells anybody with a functioning brain (that is used of course) that quadrant means pretty much nothing.
I can't help to run it from time to time anyway
So I sat on the to... in my room in front of my computer with my phone. I9000 with supersonic ROM and the remount script from adrenaline shot 7. I sat there and said to myself "how hight can you score in quadrant LOL"
I started quadrant up and ran the benchmark: 2309
Then I opened the task manager-> Exit all & Clear memory
Then via long press homebutton back to quadrant to run the benchmark again score: 2453
But since I am a programmer and can imagine all kinds of optimizations and caching I pressed the back button and just ran it again just after it finished
Score: 2675
How the hell could anyone call that a benchmark?^^
just to be sure could anyone confirm that behavior? And does anyone know of a mor reliable alternative? I'd like to collect that knowledge in this thread.
TL;DR: quadrant sucks, you know anything better or want to flame away: do it here
Those are not the actual numbers from my first experiment, I repeated the scenario just now and took the numbers from those runs.
Additional runs scored 2775, 2907 and 2820, that's just silly
I think this behaviour is well known and has to do with JIT optimizations or something like that
allotrios said:
I think this behaviour is well known and has to do with JIT optimizations or something like that
Click to expand...
Click to collapse
The reason is irrelevant. The fact it doesn't provide a reliable benchmark is.
no benchmark is precise if you don't use it as intended. Quadrant produces a reliable comparative benchmark when used as designed: run it five times, remove the lowest and highest scores and average the remaining 3 -- that is your benchmark. You may not like it, but that is how it is designed to be used.
Now if you want to be pedantic, you could reasonably test again, by running quadrant 5 times, removing the outliers and average your 3 remaining scores. Repeat 10 times and then tell me how your average scores do or do not vary: they will in fact be within a narrow range, your actual benchmark.
Alternatively, tell us which benchmark produces the same score each run, as that appears to be the sum total of your objection to quadrant.
There are other benchmarks, such as Caffiene Mark, AnTuTu and NenaMark, but they are all apps just as Quadrant is and all require several runs and averaging to produce a comparable benchmark.
Moreover, the primary use of any benchmark is to compare firmware (kernel and rom) builds on the same phone to see relative performance gain and drop.
A benchmark is supposed to give way of comparing the capabilities of a given device. This means that a device with a high average score implies a better device than a lower score.
But the Quadrant score does nothing of this sort! In a competition with a friend I achieved an average Quadrant score of about 4300, with a peak of 4462. According to Quadrant my device is a lot better than the OP! Which is just not true.
Quadrant is unreliable as a benchmark, no matter how it is "designed to be used".
Sent from my GT-I9000 using XDA App
whaave said:
But the Quadrant score does nothing of this sort! In a competition with a friend I achieved an average Quadrant score of about 4300, with a peak of 4462. According to Quadrant my device is a lot better than the OP! Which is just not true.
Click to expand...
Click to collapse
You're doing it wrong.
lgsshedden said:
Moreover, the primary use of any benchmark is to compare firmware (kernel and rom) builds on the same phone to see relative performance gain and drop.
Click to expand...
Click to collapse
Quadrant scores are useless. I've used custom roms with scores of 2500+ but they aren't as smooth as stock roms, which only have scores of 1600-1800.
Antutu is indeed quite reliable imho. My results never fluctuate more than +-5% on the same config. That's an acceptable range, considering I don't set cpu governor to performance before running my tests.
Sent from my GT-I9000 using XDA App
upichie said:
You're doing it wrong.
Click to expand...
Click to collapse
w00t?
Quadrant does not reflect performance, and therefore can not be used as a comparison parameter.
It can't be much worse than I thought.
My phone with 2.1 and 'lag fix' scored 2200 and lagged so bad I wanted to throw it against a wall multiple times a day.
With stock 2.3 quadrant can be ~1000 but the phone runs much smoother.
Other than the obvious file systems I/O 'cheats' that resulted in the above, there is also the frame rate cap that makes the GPU tests useless as well.
if your trying to measure height with a scale , u wont get your answer .
The only benchmark tool that ever reflected how the phone felt in my hands , in real life usage is linpack .
changing OC / kernel is mainly the only thing that will affect linpack if your trying to use it to compare roms ill efer you to my first statement .
In order to have a good feel of a rom / set up on the phone , use some apps that will use lots of ressources , for example TW4 launcher , go in there scroll a lot open gallery (if you have many pics) scroll thru them and repeat ... Any benchmark tools will basically tell you the 'ability of your device ' ( comparing 2 different models like an inspire and an sgs2 for example will be accurate )
ZioGTS said:
Antutu is indeed quite reliable imho. My results never fluctuate more than +-5% on the same config. That's an acceptable range, considering I don't set cpu governor to performance before running my tests.
Click to expand...
Click to collapse
I recently tried Passmark Mobile. Still a beta version, but I like it. Test results reflect real performance improvement and degradation pretty closely, particularly for what concerns I/O and memory speed.

Good benchmarks

Hey guys I hear a lot of negative stuff about how smooth the GN isn't and how the hardware is not that good but I must say that after 6 months of SGS2 use with many awesome roms like Checkrom etc and overclocking to 1600Mhz running a lot of benchmark tests I have to say that my experience with the GN has been awesome. Its smooth, fast and pretty.
But I saved all my Antutu, Nenamark and Quadrant scores and i have done a series of scores with the GN trying different roms and kernels and I say that the results, even only clocked to 1350Mhz were on average above my old SGS2. We should consider how much more effort is required to use the resolution of the screen to produce 6800 scores on Antutu and 3000+ scores on Quadrant.
This phone is really the next logical step and I actually get it why Google went down this path.
robt772000 said:
Hey guys I hear a lot of negative stuff about how smooth the GN isn't and how the hardware is not that good but I must say that after 6 months of SGS2 use with many awesome roms like Checkrom etc and overclocking to 1600Mhz running a lot of benchmark tests I have to say that my experience with the GN has been awesome. Its smooth, fast and pretty.
But I saved all my Antutu, Nenamark and Quadrant scores and i have done a series of scores with the GN trying different roms and kernels and I say that the results, even only clocked to 1350Mhz were on average above my old SGS2. We should consider how much more effort is required to use the resolution of the screen to produce 6800 scores on Antutu and 3000+ scores on Quadrant.
This phone is really the next logical step and I actually get it why Google went down this path.
Click to expand...
Click to collapse
Nice to see a positive post for once.
Sweet as mate
I started a benchmark scores thread in general.
If you dont mind, can you post your ROM + Kernel and any OC/UV settings u applied.
Also, have u used CF-Bench and what was your score?
Cheers. Its big ie oc to 1350Mhz with Franco kernal.

placebo effect

this is basically a review on custom roms that ive tried...
my purpose of doing so is one to guide newbiez on sgy like myself
to give a background i was on galaxy 551 before switching to the sgy was running on custom roms myself i am no developer just an end user
currently i am running on stock rom with a couple build prop tweaks , audio tweaks, and customized layouts...following hhubs...
currently my device scores around 16xx on antutu benchmark and around the aame figure on quadrant....
yesterday i tried the hybrid 2.0
ive had high expectations on such custom roms specially the most talked about....and recommended roms...
now...ive installed hybrid which was a light and yeah fast rom....
well i couldnt feel the difference from my stock rom...
so i decided to run a benchmark test antutu and quadrant......
gave me the same score as my stock
16xx
but the thing was the rom was fast and lite almoat the same as my stock rom edited.....
if you have a different review please do post so that others can get a fair.review....
will try to review termas rom next week.....
--------------------------------------------------
termas review will be postponed...pc went down..cant flash his kernel...
--------------------------------------------------
adding aurora v2
pretty decent everyday rom
antutu gave a 1704 on performance governor...
i like the retro look..
would be giving it a rate of 9/10
for acouple of graphic glitches that are and will be fixed soon acocrduing to dev..
will write more later..
Sent from my GT-S5360 using Tapatalk
forgot to post working and bugs
everything was ok..except for the message about my balance...
the rom was overall a good rom with a sense ui feel.....
Sent from my GT-S5360 using Tapatalk
if you think that quadrant will show you your phone's actual performance then you re wrong.If you want hi scores on quadrant try searching for quadrant hack
I cant understand some mobile phone owners like you.
What do you expect from your phone?Magical abilities or something?
<post deleted>
ronnieryan said:
now im confused
Hybrid 2.0 doesnt have sense ui feel
Hybrid 2.1 has the sense ui feel
and then again my antutu score with hybrid 2.0 would be 18xx to max 19xx
pls verify what hybrid did you use 2.0 or 2.1?
Click to expand...
Click to collapse
My apologies 2.1 for the sense ui..2.0 was running on touchwiz
Hmmm...good score for you mate
Mine was disappointing really
Sent from my GT-S5360 using Tapatalk
ronnieryan said:
now im confused
Hybrid 2.0 doesnt have sense ui feel
Hybrid 2.1 has the sense ui feel
and then again my antutu score with hybrid 2.0 would be 18xx to max 19xx
pls verify what hybrid did you use 2.0 or 2.1?
Click to expand...
Click to collapse
The sense UI is not that good! I have tried it on my sgy and i accept that it was fast but I removed it because of its buggy interface especially when the name of the app cuts in the dockbar.
Sent from my GT-S5360 using XDA
<post deleted>
[email protected] said:
if you think that quadrant will show you your phone's actual performance then you re wrong.If you want hi scores on quadrant try searching for quadrant hackI cant understand some mobile phone owners like you.
What do you expect from your phone?Magical abilities or something?
Click to expand...
Click to collapse
i didnt say that i was basing my opinion on quadrant scoring...
i just mentioned it...
for reference i guess not really for anything..
for me i was expecting a lil bit better...
from a custom rom...
not just better aesthetics..
this is not my first phone and certainly not my first rom..
thou it might be true that performance cannot be measured by benchmarking...
but how do you measure or know if something is better that the other without benchmarking...
benchmarking is there for a reason,,,,
as for experience my galaxy 551,stock rom..almost the same edits that i have now,,except with a lower cpu of 600mhz..
scores right about 14xx
and with a custom rom from arkas right about 17xx
with a custom from perseus,,right about 18xx-2xx depending on setting made..
stock is good but a bit slow
roms from arkas are fast..
from perseus,,,hellluva fast..but battery...dead in 1-2 hour,...oc to 729..
why am i saying this,,,
custiom roms to my view should atleast give something that isnt offered in stock..
like a2sd from terma...
as far as cheating the benchmark..
why would you conduct a cheated benchmark in the first place,...like playing a good game but using a cheat...useless..
taking the exams and cheating...
Definition of BENCHMARK
1usually bench mark : a mark on a permanent object indicating elevation and serving as a reference in topographic surveys and tidal observations
2a : a point of reference from which measurements may be made b : something that serves as a standard by which others may be measured or judged c : a standardized problem or test that serves as a basis for evaluation or comparison (as of computer system performance)
See benchmark defined for English-language learners »
See benchmark defined for kids »
Examples of BENCHMARK
a stock whose performance is a benchmark against which other stocks can be measured
<this prize-winning biography will be the benchmark against which all others will be judged in future years>
First Known Use of BENCHMARK
circa 1842
http://www.merriam-webster.com/dictionary/benchmark
btw..it would be cool if the phone transforms
guys i believe that ok maybe benchmarks are not perfect but they can show if a rom is faster than another.if your benchmark shows higher score that mean that something goes faster.but for better resaults you must repeat the benchmark for 4-5 times and from all scores get those that are more "stable" and most repeated.for example:if you run 5 times quadrant and get these results:
1050
1097
1129
1125
1130
take your score as around 1127.most times the first test shows lower result.
as for our custom roms i agree with OP but as long as we cant have a custom kernel,this is almost the best we can do.we can do much much more things and more ads and more tweaks and generally more speed for our roms if we had a custom kernel.but i think that all guys deserve our respect and thanks just only for the time their spend trying to do something better for our phone(this better could be faster phone or more fuctional phone or just more beautiful phone.whatever anyone can do).so i respect the opinion of OP whatever parameters he use.he flashed the roms,so he use them,so he can say his experiences!

Categories

Resources