Develop Bugs

[Q] Benchmark low - how to push the benchmark higher?

Hello!
So, I have a DHD with the Revolution HD ROM (2.0.8) and the Buzz Sense kernel. I have locked the CPU to min/max 1516MHz Perf. scaling and, upon running the AnTutu System Review 1.2("System Benchmark" under Market) I get a score of 1879.
Yet in the Rankings I see that the #2 device is a DHD with 2.2 @1516MHz with a whopping score of 2774!!!!!
So, how could I reach those heights? The only thing I can think of is the slow SD card that came with the mobile (read/write scores: 34/117), but other than that what could be holding me back?
Cheers
T

I have reached pretty high scores while testing, but then the overall rom smoothness has pretty much sucked. It is normal that synthetic benchmarks give lower results when you use a custom rom, the optimizations that ensure general smoothness and usability cause it. One big reason is CPU scheduling, in custom rom (custom kernel) cpu time is divided for each task in a different way, thus reducing the overall benchmark score.

jkoljo said:
I have reached pretty high scores while testing, but then the overall rom smoothness has pretty much sucked. It is normal that synthetic benchmarks give lower results when you use a custom rom, the optimizations that ensure general smoothness and usability cause it. One big reason is CPU scheduling, in custom rom (custom kernel) cpu time is divided for each task in a different way, thus reducing the overall benchmark score.
Click to expand...
Click to collapse
Aha... but then this means that this or the other ROM do not let a specific app (say, a heavy 3D game) take the phone to its full potential...

Incorrect, it is just the synthetic benchmark that suffers. Games will run fine, faster than stock.

Jkoljo's right.The overall system speed is much better,performance is better,but it sucks a little in benchmarks.If you are so desperate to see high benchmark scores(I was once too! )try kamma's 1.4 kernel.Quadrant 3200.Need I say more?

tolis626 said:
Jkoljo's right.The overall system speed is much better,performance is better,but it sucks a little in benchmarks.If you are so desperate to see high benchmark scores(I was once too! )try kamma's 1.4 kernel.Quadrant 3200.Need I say more?
Click to expand...
Click to collapse
Really? 3200? Wow. Just out of curiosity, what scores are you getting with other kernels?
Well, at the end of the day, it doesn't matter - I haven't seen an app or game that runs slow or choppy or whatever. It's just for the heck of it

krakout said:
Really? 3200? Wow. Just out of curiosity, what scores are you getting with other kernels?
Well, at the end of the day, it doesn't matter - I haven't seen an app or game that runs slow or choppy or whatever. It's just for the heck of it
Click to expand...
Click to collapse
Oh yeah,I know what tou mean!
Anyway,with Lee's and Apache's kernels I get about 2500-2600 in Quadrant.CPU clocked all the way up to 1.5 GHz of course!

This ROM/Kernel is FAST!! How?

Iv'e read many posts throughout these forums about ROMS and/or Kernels being fast. I think my phone is fast enough for me. For others that may not be the case, so...
- to what extent does speed affect stability if any?
- aside from the obvious overclocking what else would one do to speed up their phone?
- what would you use these speeds for?
- then again what is fast, scrolling speed, transitions, streaming, gaming, browsing.....?
- what methods are being used to gauge these speeds, fps, linpack, quadrant.....other, are they acurate?
- its been said that AOSP is faster than Sense if so how?
It would be nice to gain a better understanding of various opinions on speed. Maybe some screenies of your set-up or different processes taken.
- Thanks for the insight

?
I would like to know the same thing i see alot of asop roms hitting 2000+ on quadrant i can only get to 1700 .....any help?

If you're getting 1700+ on sense, you don't need help. AOSP will be slightly faster just b/c there's less to it than sense. You're not going to feel a difference between a ROM running 1700 and one running 2000+ as long as you setup is running smoothly. Speed is more about feel than numbers anyway, although the popular tests are linpack and quadrant.
If you just want high scores, run CM6.1 and Snap 7.6 Kernel w/ Turbo activated.

what does set cpu do if anyone uses it?

jalai said:
what does set cpu do if anyone uses it?
Click to expand...
Click to collapse
Setcpu is used for over/underclocking your evo, also with screen off profiles, it can help increase you battery life.

Low benchmark score after root/custom rom and kernel

Hi!
First of all, I have been reading around and I did not find exactly what I want to know.
Yesterday I managed to root my desire and flash the CM7 ROM (http://forum.xda-developers.com/showthread.php?t=957344). Today I've added a custom kernel, "vork" 720p (http://forum.xda-developers.com/showthread.php?t=782875&highlight=vork).
My quadrant score is still low (around 1100), even though the phone behaves much better than the stock.
I have 2 questions:
1. What can I do to make it perform even better? (i have a friend with a desire hd who just flashed a sense rom, without any added stuff and scores over 2200).
2. should i install a new "radio"? My gsm signal is much stronger than before as it is.
3. Since this is my first time, what do you think of my choices with the ROM and Kernel? I chose them because they were popular and i assumed they are well tested and function well.
Thank you for your time.

Desire HD has better processor and GPU I believe hence bigger difference. Your score is good for Desire. I got around that overclocked on LeeDroid GB ROM.
Sent from my HTC Desire using XDA App

why do you even care bout the quadrant score ? :X
if you really feel excited bout high numbers having nothing to do with ur phone performance, go with data2ext roms, quadrant gives them 3000+ points, but still they perform worse than, for example, LeeDroid.
then again, new GingerBread Sense 2.1 roms have low quadrant scores, but they are really really fast.

I dont really care about quadrant, but it seems like a valid tool for measuring performance. At least it seems that everyone is judging by that. Quite frankly the phone works very well, i am just out of ideas to make it even better. And if the scores are meaningless why do people use it?

Its probably one of those my d...ck is bigger than yours things. Anyway I used data to SD and I also had high scores but overall experience was very laggy and jerky
Sent from my HTC Desire using XDA App

Quadrant scores are mesaurable only when you launch them on stock, unrooted roms. then it can give you and idea on how this phone with this software will perform.
after rooting, some hacks or scripts make quadrant scores not real

So this means my phone is fine as it is? There is nothing more I can do to enhance it?

you can overclock it, it should all be said in your ROMs topic.
like "OC up to 1200Mhz" means you should be able to set processor speed to 1200mhz with SetCpu. it all depends on kernel i think

Ok, thanks everyone for your input! If there are any more suggestions, I dont mind.

Quadrant: Worse than you thought

As we all know quadrant is no reliable measure for speed. At least I knew this for a while now and it was repeated and quoted many times.
This article tells anybody with a functioning brain (that is used of course) that quadrant means pretty much nothing.
I can't help to run it from time to time anyway
So I sat on the to... in my room in front of my computer with my phone. I9000 with supersonic ROM and the remount script from adrenaline shot 7. I sat there and said to myself "how hight can you score in quadrant LOL"
I started quadrant up and ran the benchmark: 2309
Then I opened the task manager-> Exit all & Clear memory
Then via long press homebutton back to quadrant to run the benchmark again score: 2453
But since I am a programmer and can imagine all kinds of optimizations and caching I pressed the back button and just ran it again just after it finished
Score: 2675
How the hell could anyone call that a benchmark?^^
just to be sure could anyone confirm that behavior? And does anyone know of a mor reliable alternative? I'd like to collect that knowledge in this thread.
TL;DR: quadrant sucks, you know anything better or want to flame away: do it here
Those are not the actual numbers from my first experiment, I repeated the scenario just now and took the numbers from those runs.
Additional runs scored 2775, 2907 and 2820, that's just silly

I think this behaviour is well known and has to do with JIT optimizations or something like that

allotrios said:
I think this behaviour is well known and has to do with JIT optimizations or something like that
Click to expand...
Click to collapse
The reason is irrelevant. The fact it doesn't provide a reliable benchmark is.

no benchmark is precise if you don't use it as intended. Quadrant produces a reliable comparative benchmark when used as designed: run it five times, remove the lowest and highest scores and average the remaining 3 -- that is your benchmark. You may not like it, but that is how it is designed to be used.
Now if you want to be pedantic, you could reasonably test again, by running quadrant 5 times, removing the outliers and average your 3 remaining scores. Repeat 10 times and then tell me how your average scores do or do not vary: they will in fact be within a narrow range, your actual benchmark.
Alternatively, tell us which benchmark produces the same score each run, as that appears to be the sum total of your objection to quadrant.
There are other benchmarks, such as Caffiene Mark, AnTuTu and NenaMark, but they are all apps just as Quadrant is and all require several runs and averaging to produce a comparable benchmark.
Moreover, the primary use of any benchmark is to compare firmware (kernel and rom) builds on the same phone to see relative performance gain and drop.

A benchmark is supposed to give way of comparing the capabilities of a given device. This means that a device with a high average score implies a better device than a lower score.
But the Quadrant score does nothing of this sort! In a competition with a friend I achieved an average Quadrant score of about 4300, with a peak of 4462. According to Quadrant my device is a lot better than the OP! Which is just not true.
Quadrant is unreliable as a benchmark, no matter how it is "designed to be used".
Sent from my GT-I9000 using XDA App

whaave said:
But the Quadrant score does nothing of this sort! In a competition with a friend I achieved an average Quadrant score of about 4300, with a peak of 4462. According to Quadrant my device is a lot better than the OP! Which is just not true.
Click to expand...
Click to collapse
You're doing it wrong.
lgsshedden said:
Moreover, the primary use of any benchmark is to compare firmware (kernel and rom) builds on the same phone to see relative performance gain and drop.
Click to expand...
Click to collapse

Quadrant scores are useless. I've used custom roms with scores of 2500+ but they aren't as smooth as stock roms, which only have scores of 1600-1800.

Antutu is indeed quite reliable imho. My results never fluctuate more than +-5% on the same config. That's an acceptable range, considering I don't set cpu governor to performance before running my tests.
Sent from my GT-I9000 using XDA App

upichie said:
You're doing it wrong.
Click to expand...
Click to collapse
w00t?
Quadrant does not reflect performance, and therefore can not be used as a comparison parameter.

It can't be much worse than I thought.
My phone with 2.1 and 'lag fix' scored 2200 and lagged so bad I wanted to throw it against a wall multiple times a day.
With stock 2.3 quadrant can be ~1000 but the phone runs much smoother.
Other than the obvious file systems I/O 'cheats' that resulted in the above, there is also the frame rate cap that makes the GPU tests useless as well.

if your trying to measure height with a scale , u wont get your answer .
The only benchmark tool that ever reflected how the phone felt in my hands , in real life usage is linpack .
changing OC / kernel is mainly the only thing that will affect linpack if your trying to use it to compare roms ill efer you to my first statement .
In order to have a good feel of a rom / set up on the phone , use some apps that will use lots of ressources , for example TW4 launcher , go in there scroll a lot open gallery (if you have many pics) scroll thru them and repeat ... Any benchmark tools will basically tell you the 'ability of your device ' ( comparing 2 different models like an inspire and an sgs2 for example will be accurate )

ZioGTS said:
Antutu is indeed quite reliable imho. My results never fluctuate more than +-5% on the same config. That's an acceptable range, considering I don't set cpu governor to performance before running my tests.
Click to expand...
Click to collapse
I recently tried Passmark Mobile. Still a beta version, but I like it. Test results reflect real performance improvement and degradation pretty closely, particularly for what concerns I/O and memory speed.

Good benchmarks

Hey guys I hear a lot of negative stuff about how smooth the GN isn't and how the hardware is not that good but I must say that after 6 months of SGS2 use with many awesome roms like Checkrom etc and overclocking to 1600Mhz running a lot of benchmark tests I have to say that my experience with the GN has been awesome. Its smooth, fast and pretty.
But I saved all my Antutu, Nenamark and Quadrant scores and i have done a series of scores with the GN trying different roms and kernels and I say that the results, even only clocked to 1350Mhz were on average above my old SGS2. We should consider how much more effort is required to use the resolution of the screen to produce 6800 scores on Antutu and 3000+ scores on Quadrant.
This phone is really the next logical step and I actually get it why Google went down this path.

robt772000 said:
Hey guys I hear a lot of negative stuff about how smooth the GN isn't and how the hardware is not that good but I must say that after 6 months of SGS2 use with many awesome roms like Checkrom etc and overclocking to 1600Mhz running a lot of benchmark tests I have to say that my experience with the GN has been awesome. Its smooth, fast and pretty.
But I saved all my Antutu, Nenamark and Quadrant scores and i have done a series of scores with the GN trying different roms and kernels and I say that the results, even only clocked to 1350Mhz were on average above my old SGS2. We should consider how much more effort is required to use the resolution of the screen to produce 6800 scores on Antutu and 3000+ scores on Quadrant.
This phone is really the next logical step and I actually get it why Google went down this path.
Click to expand...
Click to collapse
Nice to see a positive post for once.

Sweet as mate
I started a benchmark scores thread in general.
If you dont mind, can you post your ROM + Kernel and any OC/UV settings u applied.
Also, have u used CF-Bench and what was your score?

Cheers. Its big ie oc to 1350Mhz with Franco kernal.