Hellllllllo XDA Communities!
I am really hoping someone out there can help this noob make his boss very happy. We set up a linux machine to start running CTS tests, and I have been desperately looking for help wherever possible, however prospects have been thin. I keep coming across the instructions on how to set up and run CTS testing, but no one seems to break down the details of everything.
We are currently running the test on one of our manufactured device, which is supposed to be CTS certified, however at the conclusion of the test, we got a report that stated several thousand of the tests have failed.
Not to be detered, we went back to the drawing board, and set up a Nexus 6 to run the same tests. Everything was running fine, but there are a few inconsistencies that I would really love some help with (Please forgive me, but I am ultra noob when it comes to Android development, and I may need further clarification if answers go over my head.)
1. What does a successful test look like? Should we presume that the failure of 1000+ test means that the device failed the tests? Would anyone be able to tell me, in layman's terms (or screen shots would be awesome) what a successful test looks like?
2. Is there a way to determine WHY a test was skipped? On our device, about 7,000 tests were not executed, and we figured it was because our devices dont necessarily support everything CTS tests for, however after about 7 hours the Nexus just skipped a veritable TON of tests also.
3. CTS is supposed to take 10 hours no matter the device right?
4. Is the 'Monkey Test' incorporated into the CTS package by default?
Finally, is there some glossary of terms or some cheat sheet that I could use to verify the test results. For example:
-- testAlertDialogCancelable
fail
junit.framework.AssertionFailedError
at android.app.cts.AlertDialogTest.testAlertDialogCancelable(AlertDialogTest.java:182)
This was one of the tests that were failed. I have no idea what this means, and everytime I run a google search, I come back with Null.
Any help, would be greatly, greatly, GREATLY appreciate.
I love the forums, read them all the time, XDA community .... ASSEMBLE!
<3
Related
Ok. Short story of what I want to do and why.
I am a developer and I feel that I don't contribute enough to this fantastic site and its users. After the recent unpleasantness I went away and thought about what it is that I could do to try and fix this. My idea is a site or section of the wiki built specifically to track bugs and issues in new roms (I was specifically thinking WMXL but there is no reason this can't be used for all of them).
I am currently working on my own XML based site with PHP5 driving and if people think it will be useful I'd write and host this service before I continued with my own site (hopefully before WMXL 0.30 is released).
I want to try and restrict the way people enter and search the information relating to problems with new roms and try to cut out the background noise. I was thinking about having fields such as ROM version (drop down list), radio version (text box), boot loader (drop down list), main program affected (text box), extent of interference (drop down list), description of problem (text area), how to reproduce error (mandatory text area!).
This will hopefully encourage more people to think about what might be causing the problem rather than just posting what they cant do and expecting someone else to work everything out. Forcing a description of how to recreate the problem will hopefully find most users not needing to post after they work it out, and if the recreation steps dont work then the post will be closed. Hopefully people will think enough that I will be able to moderate this forum (type thing) myself and maybe someone in another timezone (closer to the UK) can take care of it while im asleep.
No one can stop n00bs posting silly questions but hopefully we can reduce the amount this annoys everyone else.
Sorry it took so long to describe my idea.
Maz
UPDATE: STARTED!
I got started as soon as I'd got a couple of replies but I still need you all.
For the chef's and other brilliant people:
1. What info do you need with each ticket to try solve them?
2. Do you want to be the only one to close tickets? Or should the submitter be able to?
3. What info do you want to store for the roms to filter to the smallest pool of specific tickets?
For the users:
1. How do you want to be able to search this?
I DON'T ASK FOR DONATIONS! ALL I ASK IS THAT PEOPLE SEARCH BEFORE SUBMITTING!
---------------
http://maz.net.au/
Bugzilla? yes please
This is a very good idea. In fact, I think that we need too a place to store the temporary fixes generated after each ROM publishing. It will be a good place for this too.
Good Idea.
It Would Help A Lot, Sounds Like Finding Answers Would Be Easier And Should Cut Down On The Hostile Atmosphere.
Cheers
Yes, very good idea.
This become easyest forum for everyone.
If it would be of any use, i can host this on one of our UK servers so we get very good speeds? I know 'iammaz' has said he can host it but he is in Australia so for the UK guys it might be a tad slow.
If not then no worries, but just trying to do my bit!
jaso2005 said:
If it would be of any use, i can host this on one of our UK servers so we get very good speeds? I know 'iammaz' has said he can host it but he is in Australia so for the UK guys it might be a tad slow.
If not then no worries, but just trying to do my bit!
Click to expand...
Click to collapse
Cheers and I'm sure everyone appreciates the offer. My site is hosted in the US. At the moment this is being built as a module to my current CMS. Whether or not this adds too much overhead I won't know until I try. The problem will be if I use too much cpu time im sure it's against the ToS with my hosting company and they will shut me down.
I hope that I will have it built as a stand alone object by then and anyone else can take this and run this on php5 hosting or in fact I could run it as web services from my personal server at home.
Progress goes well. Just working on possible searching and indexing algorithms to make searching fast and useful.
Maz
-------------------
I can't believe I forget to type this.
http://maz.net.au/
Great idea
It's 2am. I'm piking for the night. I'm expecting a phone call at 7am tomorrow so will be back into it then for 5 or 6 hours. Hopefully will be almost done by the end of that.
I need to work out how you want to have logins work. I don't think i can make it authenticate against this forum (i havent tried integrating with vBulletin before). Do I allow open registration? do I try make it force you to register the same name but PM'ing the password to that username here? do i manually add people as they ask and restrict the group?
let me know in the next 6 hours or so.
Maz
----------------------
Badly styled CMS can be seen here. (new version looks so much better )
http://maz.net.au/
Open registration, but obviously grant privileges to those of us who classify as developers.
Olipro said:
Open registration, but obviously grant privileges to those of us who classify as developers.
Click to expand...
Click to collapse
And super-user privileges for the chef's for bug tickets that apply to their cooked roms.
Maz
----------------
hard at work again at http://maz.net.au/
i think guy brings up a good point and perhaps a decent solution. why not allow/encourage the dev's to explain a bit more. I'm a fairly adept nerd but when i'm installing an app sometimes i'm just not sure why in the world this app needs that permission...how is my mom or sister or anyone that i advocate Android to going to figure it out? why does this app need my coarse or fine location or full network access or access to the contact list etc...
and please do not say 'if you don't like what's listed, don't install the app'. that is exactly the point of this thread. the line items in the Review Permissions window don't always make sense. how can the average end user make a educated guess with the current system...they don't, they just start doing the same thing they do on their Windows Desktops...just click right on thru it. then what happens? some jerk writes a piece of malware. user has an issue. now its all androids fault. and viola, proof that linux based devices are still too geeky for avg use.
http://tech.shantanugoel.com/2010/08/14/android-permissions-malware.html
Unfortunately, there's no denying the cold, hard facts - ignorance is not bliss. Everything has a learning curve. Time and effort must be spent to educate users as to why <this> is happening and what it is doing for them. It's sad but true. Besides, if everything that required higher learning could be easily figured out I'm sure humanity would be freed from the shackles of poverty, war and hunger by now. So, yes, permissions are too obtuse for the average user. Unless they want to educate themselves on more generalized computing skills they'll never get it.
That's just my two cents. Sorry I couldn't be of better assistance
ok. so i wish to educate myself. please provide a full and detailed example listing why which permissions may be needed/used so that i will be able to make an educated choice. where is that link again?
i'm bringing up an issue...not asking for others to chime in and tell me how stoopid the end user base is. i'm an admin for over 10yrs. trust me ... i know. in this case i am also confused as are a large numer of folks. i understand the huge development curve android has experienced over the last 18mths. my concern is that if this issue is not addressed, even the folks that would take the time to read the Review Permissions page will give up. i know i have on more than one occasion. that's a bad trend.
Wow. You bring up a good point. Didn't mean to offend you or anything. I still don't have a good answer for you but I will let you know that I only install apps that I can trust usually after researching them via Google searches and talking about them with people here. I too am an admin (been a long, long 15 years now) and if there's 2 things I learned about recommending custom Android setups they are:
- If you think the user is going to use you as Wikipedia it's probably best to leave them at stock
and
- Only recommend this kind of stuff to users who are willing to accept responsibility for their actions otherwise you'll be the fall guy every time something goes wrong.
Again, I'm sure you know this and I didn't mean to offend you so..... bye.
Users can be pretty obtuse, and I think you're completely correct about the current permission system. However, I don't think it could be made much clearer without multiplying the number of permissions. Malware can exist because users consider certain permissions to be common. Conversely, apps with a good reputation can include permissions that make them wonder, "why would they need that?" Look at keyboards and how many people freak out when they go to enable them.
One thing that would be nice for users is if you could tap on a permission and the phone would display a short explanation of that permission. They probably aren't self explanatory for everyone.
beatblaster said:
- If you think the user is going to use you as Wikipedia it's probably best to leave them at stock
and
- Only recommend this kind of stuff to users who are willing to accept responsibility for their actions otherwise you'll be the fall guy every time something goes wrong.
Again, I'm sure you know this and I didn't mean to offend you so..... bye.
Click to expand...
Click to collapse
no offense. i do understand. there was a point in time where i used to openly provide paid tech support to home systems of my coworkers....it was a short point in time. lol. but i digress ... i may have come off too strong in my reply, i was just trying to prevent the thread from wandering off.
I've tried to post on this topic in the past but have not nothing useful. in and of itself, i find that kinda sad. I've even seen some folks suggest that people "take a trusting stance because most developers do not intend harm". i wish i could. but i'm out of college.
it would be wonderful if someone (ie: a google dev or just someone with knowledge of these things) were able to create a page that could give real world examples and general rules of thumb. currently i have only found a couple pages that cover a couple settings. not nearly enough to be of much use.
Saturn2K said:
One thing that would be nice for users is if you could tap on a permission and the phone would display a short explanation of that permission. They probably aren't self explanatory for everyone.
Click to expand...
Click to collapse
I concur.....I look at the permissions that apps ask for all the time. However, if I see a battery management app is asking me for full internet access and access to my contacts, I just pass on it. A lot of times you can figure out if an app is requesting bogus permissions just by using common sense.
rugedraw said:
I concur.....I look at the permissions that apps ask for all the time. However, if I see a battery management app is asking me for full internet access and access to my contacts, I just pass on it. A lot of times you can figure out if an app is requesting bogus permissions just by using common sense.
Click to expand...
Click to collapse
if your app is paid for by advertisements then it will need Internet Access so it can retrieve ads...thus paying the developer. often that's where i see 'coarse location' used as well...for regional specific ads. so in those cases, not nefarious use but a perfect example of what I'm talking about. thank you.
the problem with the current permissions system is twofold;
1) as mentioned, there is no details WHY or WHAT FOR a particular permission is required
2) its all or nothing, ie you can't give permission for network access and restrict access to contact list, etc. You have to accept all the requested permissions or deny and not install the app.
fwiw: There is an app in the market called "permissions" that tells you not only the permissions each app requires but it gets VERY specific. Within each permission category there is a whole list of specifics.
It won't help with apps you haven't installed yet but it's good info on the ones you already have.
*edit- Just revisited this app, it's not as detailed as I remember.
just a lil bump...
bumpity bump ...
nothing? at all?
Let me introduce a brand new psychology (and may be not only) testing system application for windows phone.
Current release is beta and contains two tests.
The first one is from just for fun series and shows the possibilities of testing engine.
The second one is based on scientific research of the world-famous Ukrainian scientist Tsukanov.
Let me briefly describe what this test is about.
You know that a microprocessor has it own tact-frequency. So the main idea is that every human-being also has such frequency. The test allows to count this frequency and shows some interesting information based on this number.
In future there will be much more information and data available as the results of this test.
Here are the future plans:
1) Stabilize the application, fix bugs.
2) Add more tests.
3) Go to marketplace.
4) Update = new tests. (Any suggestions are appreciated)
5) May be to add the ability to add user-made tests. Engine is ready but there's still no editor for it.
6) ...
7) Profit!
For now everybody who thinks this is interesting - please test it and test yourself and say what you think!
Thanks!
P.S.
You can tweet your results from the second test.
P.P.S. Do you like pressing the girl's eyes at the first screen?
[CHANGELOG]
11/7/2011 v0.1:
Initial release with two tests available.
I am going to try this, sounds fun
Sent from my Spark using XDA Windows Phone 7 App
tested it but what the heck is it? the second test it gave me a number and a word with no explanation of anything. and this 'famous' tsukanov i tried searching to find the meaning of my results but nothing comes up for tsukanov test
This number is your personal unit of time. A lot of things depends on it. As for now it only shows you temperament type I'll add a lot of other interesting explanations in near future. Don't forget it's only beta and the first release. Lot's of things will change before release I hope.
The name 'Tsukanov' is famous in the former USSR psychology school first of all, so if you'll try to search in Russian for 'Цуканов' you'll find more info.
definitely sounds interesting
Cool app
I like the app but it needs some more tests/some more explation. The number it gives you needs to be explained and what excatly that means. Also for the first test you should add some more explaination to what the type of food means
Hello
I am standing before a tough decision and I hope someone can help me.
A recent update for my app (link) brought more complex functionality, and I'm afraid it can scare away users. Therefore I am thinking of adding some kind of guide/help section/floating balloon tips, so all would be clear and easy to understand.
My question being, what is the best approach here?
This is just a normal user speaking, but I'm really not being a fan of being greeted with a bunch of popups / overlays, even if they are meant to help. I much more prefer being able to do the thing I downloaded the app for in a quick manner right after the first startup, even if that means that I'm not using all of its features. Then, afterwards its nice to receive subtle hints every now about how to do things differently or what other goodies there are to discover.
Sorry if this isn't the most helpful answer. Do you have any specific case that you could show?
I got you
This guy is the master of user onboarding. How to do it in a non annoying way. I've used his guide to build 2 successful onboarding experiences and both time saw my retention double!
https://www.useronboard.com/
Android is losing me as a devotee.
If it's going to be as closed off, useless and buggy as iphone, I might as well get the ipieceofcrap so I can at least chat with other humans and not be shunned by females.
Sorry, Android users: These iPhone snobs won’t date you
Forget dreamy eyes the color of the ocean. For young daters, the color of text messages is all that matters. When people with iPhones text each other, their messages send in blue speech bubbles. Bu…
nypost.com
So... I don't know why or how but all of a sudden, Docs, Sheets, Keep and Voice crash immediately. All of a sudden = past month.
So, I finally got some time to see if I could fix it... I am on system reset number 4.
Reset #1 got Photos to work again, but that's it.
Anyone else having this issue.
Rooted, on 13, not my choice.
AlienPDA said:
Android is losing me as a devotee.
If it's going to be as closed off, useless and buggy as iphone, I might as well get the ipieceofcrap so I can at least chat with other humans and not be shunned by females.
Sorry, Android users: These iPhone snobs won’t date you
Forget dreamy eyes the color of the ocean. For young daters, the color of text messages is all that matters. When people with iPhones text each other, their messages send in blue speech bubbles. Bu…
nypost.com
So... I don't know why or how but all of a sudden, Docs, Sheets, Keep and Voice crash immediately. All of a sudden = past month.
So, I finally got some time to see if I could fix it... I am on system reset number 4.
Reset #1 got Photos to work again, but that's it.
Anyone else having this issue.
Rooted, on 13, not my choice.
Click to expand...
Click to collapse
What root? Magisk?
If magisk
What modules for magisk? Anything in deny list? What do you mean "not my choice" do you not wish to be rooted, why not unroot?
Edit: Also the sun is not a reliable news source. They daily have android scare articles like the one you posted.
Nergal di Cuthah said:
What root? Magisk?
If magisk
What modules for magisk? Anything in deny list? What do you mean "not my choice" do you not wish to be rooted, why not unroot?
Edit: Also the sun is not a reliable news source. They daily have android scare articles like the one you posted.
Click to expand...
Click to collapse
Magisk, yes. I looked through downloads (it's been months that it's been rooted and working properly) and I don't think I installed anything 'extra' with Magisk. I just imported the file, fixed it, flashed it.
I will have to recreate everything [I was going to when I got time] to remember all my steps. I will record them this time.
re: "Not a reliable news source." Yeah, nothing is a reliable news source. Do you have a different point? Do you dispute the findings of a news source that you have personally deemed not worthy to regard? What do you use to dispute this? Do you have a list of "your approved sources of news" so we don't have to do the back and forth? Do you not see how it is not productive to say something is not reliable and then just leave it at that? Either produce counterclaim from a source that you deem reliable, prove why they are more reliable or... ?
Edit: the shunning of females was a 'dry joke' that probably didn't translate well to someone that might be more concerned about that issue than I am?