Develop Bugs

[Q] Whole phone's gone crazy.. Apps seemingly disappeared

Hi,
I was just trying out a few ROMs, and after flashing CyanogenMod (The stable release, can't remember the exact name) and then doing a full wipe and restoring my LeeDroid Nandroid backup, I ran into a bit of a kerfuffle...
After booting up, I was greeted with blank homescreens - which was a bit annoying, but nothing too bad - and so went to get started on repopulating them.. only to find hardly any apps were present. I put this down to some of them not having synced yet, until I noticed that even system apps were missing; Market, Music etc - not a single downloaded/sideloaded app is present. They appear under the "Manage Applications" section of the Settings menu but only Data and Cache are present, not the Application themselves.
I reflashed the Nandroid backup again (and again), and was met with the same, only Astro File Manager had miraculously appeared so I could at least install some apps from my SD Card using that. So after installing the Market and Root Explorer from there, I could see that the System Apps were infact there, but required manual installation. I can't even re-download all of the lost Apps, as even attempting to select one in the Market leads to a force close.
I can effectively do nothing, except use the tiny array of Apps that are actually there, which at least does include Messaging and Phone. Does anyone have any idea how I can fix this, or a partial-solution at least?
Thanks
Ok, just as I finished typing this the Factory Reset finished and everything loaded. It seems everything is working now, but still, I'm just left with System Apps and with no sign of my other apps syncing/downloading.

After the wipe factory reset did you do nandroid install again straight after?
Sent from my leedroid v1.3a DhD via xda app

Yeah, and the same happened again. I tried various nandroids from all sorts of ROMs, and I would just get the same, even restoring the Stock ROM.
That said, the thread may as well be closed, I just went and did everything manually and everything's fine now. It took many hours, but it's in a usable state now.

i expect u will face the same problem soon as long as ur apps list will grow and be installed on ur device, this is a big issue i faced and still experimenting to get the best solution for, but currently the most effective cure is to mount ur sd card to a card reader, and go to the folder android_secure, cut some bunch of files ther(maybe half of them) and past to ur desktop, mount back the sd to ur device, ur phone will bahave normally now, this will work great after ur nandroid backup, when u see it work, try again the previous step and start to add files to android_secure folder from ur desktop, untill the bad behaviors start to occur.
hope this will help

[Q] Can't download Handcent SMS or XDA Forums app

I was told I can download handcent sms to fix a timestamp issue im having (because it automatically displays texts in the order they're received instead of using timestamps). However, I had the program and deleted it once before, but after reading up on it I still have a file somewhere on my phone called com.handcent.newsms, and having that somewhere on there is preventing me from installing handcent. I checked in titanium backup and its one of the files with a line through it (aka-its been deleted supposedly), and my phone has been searching my files using ES File Explorer since about 7 hours ago with 0 progress. Any ideas on where this file might be?
Same problem with the XDA Forums app. Had it, deleted it, but after searching Titanium Backup theres still a file being displayed called com.quoord.tapatalkxda.activity and i'm assuming thats the reason I can download but not install the app. And idea where to find this one?

back everything up, boot into recovery and wipe data/cache. then reinstall everything

ive wiped several times when installing new roms (before i knew i even had this issue).

are you restoring the same rom after wiping? if you wipe then install a new rom there should be nothing leftover to give you issues

nope, ive installed a new one every time (to be more specific- miui, cm6, evozone.pure, evozone.riptide). and ive tried searching for the file on my file explorer and it just stays at 0% (on hour 8 now). It shows the files (the handcent one and the xda one) at the very bottom of Titanium Backup with a line through it.

when you touch that line does it not give you the option to delete it? if it is just a line that means that you have a backup for an app that is not currently installed

nope, and it says that theres no backup for it. it has the yellow sign with an exclamation mark in it next to it, which after i looked means theres "nothing"? this is doing a fantastic job of irritating the piss out of me.

in titanium backup, hit menu then clean dalvik, then reload app list, if still there then with a file explorer go into the titaniumbackup folder and delete the files associated with those entries

cleaned dalvik, still there. and thats the problem, i cant find any files associated with them.

ewingt22 said:
cleaned dalvik, still there. and thats the problem, i cant find any files associated with them.
Click to expand...
Click to collapse
Have you ever copied your SD card to your PC? If so - you can go into the TitaniumBackup folder on your SD from previous manual backups and just reinstal the apk from there... I do that all the time. When I flash a ROM, First I make a NAND backup of said ROM, restore all apps and info (Texts,Contacts,Emails etc) then I do a TB back up and a MyBackUpPro Backup and then I copy all the files from my SD (which will contain all the backups you just made)to safely keep all the back ups you just made safe on your PC...If you dont alredy do that kind of thing, maybe its a good idea to start for these types of problems
hope that helps, if not - I do have the Apks for both apps your looking for - I can email them to you if you want

make a backup of your sd card on your computer, then format it and put only a rom .zip file, wipe everything multiple times, install the rom from sd card
check if handcent or xda will install, if yes, replace the files on your sdcard that you copied before format.
if no you have successfully gotten somebody else as frustrated with your phone as you are

Worked, thanks a ton for the help
Sent from my PC36100 using XDA App

[Solved] Oxygen 2.0 - App+data restore fails

Since my post in the development thread has been kindly deleted after ****ing around the whole afternoon with ROM's and restoring, I'm going to post the question here.
Anyone else got the app+data restore working on Oxygen 2.0 final ?
I always wipe before flashing, I tried it with Titanium backup (2 versions) and Mybackup Pro. Backup & restore works fine on CM RC7, but when I try to restore on Oxygen, it's just missing data for some apps.
But some are successfully restored with data, that what's weird.
I first thought, it's an issue with a Dalvik2sd script, but then tried it in clean Oxygen 2.0 ROM. When i check /data/data with the Root explorer, I can see the app there, but it just isn't loaded properly (for instance Financisto, Runkeeper, AlarmClockPlus, Abduction).
So basically, what's different in new 2.3.3 OTA, or am I the only one with the issue ?

Haven't tried all my apps, but its worked fine for those which I have.
Thanks for the dalvik to SD zip btw
Sent from my HTC Desire using Tapatalk

Yeah np :]
Could you please check other apps if they're ok ? I got about 130 apps, so it's kinda annoying to don't get the data restored.

Having looked through the rest of my apps, there aren't any which had saved data. I can confirm data has been successfully restored for angry birds, flow, BBC news, your orange, tapatalk, bedside, crazy snowboard and im+
Sent from my HTC Desire using Tapatalk

I have been using the Oxygen 2.0 for a couple of hours now and I have to say it is nice, compact and fast.
However, I have noticed that "pm, am" indication are missing from the time notification bar. Also the "AUTOMATIC" on Date and Time settings are not getting any update from the network. Am I right? Or it is just me who has it?

Also tested a previous busybox version, still same issue. But backuping and restoring on Oxygen 2.0 works correctly. Also most apps have the data restored correctly only some have issues. Have no idea, I'll just have to live with some data missing then, the 2.0 ROM just rocks that much :]

I think the best way to reinstall all apps after flash is to let Google install them automatically through market.

i have upgraded my desire from DevNull yesterday after backing up all apps with data via Titanium backup and i didnt experienced any issues with any of my apps (around 80).

This supposed to be the fix, a sqlite lib -> http://forum.xda-developers.com/showpost.php?p=11729730&postcount=341

I think this is the solution to your problem :
http://forum.xda-developers.com/showpost.php?p=11729730&postcount=341
-orgler

Since "someone" deleted a correct fix from the Oxygen thread, I'm gonna repost the file here. Seriously uncool.
Replace the libsqlite.so in /system/lib. You're gonna need to be S-OFF or do it in recovery. Sqlite .db files for some apps that were missing data are readable after, so I can confirm it works.

I noticed the missing data problem almost immediately after installing the rom. Thanks for posting a fix. The "mood" in the new oxygen thread gets a bit tense compared to other desire threads.
If I remember ill hit the thanks button when I'm in on a PC.
sK
Sent from my HTC Desire using XDA Premium App

Np, please thank orgler, he found the fix and posted it. I just saved the answer and posted it here as a solution.

I saw your reply to me just after sending you a PM. Flashing the libsqlite.zip file on top of latest oxygen rom didn't work. No big deal as the app I really need data for backs up to sdcard. I'm sure this problem will get fixed soon enough.
sK
Sent from my HTC Desire using XDA Premium App

I just read your instructions again. I'm not s-off. Do you know how I can replace the lib with ADB?
sK
Sent from my HTC Desire using XDA Premium App

Em, its not a flashable .zip (I didn't state that, but sometimes it's good to open the .zip first )
Boot to recovery, mount the system partition, connect USB cable and go to adb shell (we're gonna backup the original lib first):
#cd system
#cd lib
#mv libsqlite.so libsqlite.so.orig
#exit
Make sure you're in the same directory as libsqlite.so, or copy the .so to the dir where adb is (if your var path isn't set). Then enter in command prompt:
adb push libsqlite.so /system/lib
adb shell
#cd system
#cd lib
#chmod libsqlite.so 640
Then reboot

thed0g said:
Since "someone" deleted a correct fix from the Oxygen thread, I'm gonna repost the file here. Seriously uncool.
Replace the libsqlite.so in /system/lib. You're gonna need to be S-OFF or do it in recovery. Sqlite .db files for some apps that were missing data are readable after, so I can confirm it works.
Click to expand...
Click to collapse
Thanks for your assistance with this it's appreciated. However, pushing it via adb didn't work for me either.
I have a full mybackup of data and .apk files. There is no error when I try to restore the missing applications, mybackup confirms it's been done and requests I reboot, but the application is never there.....
Any more ideas?

That seems to be unrelated, issue was only about data in the apps, app restore worked. I suggest trying to backup with Titanium backup and try to restore with it.
So: Im sure you kept the nandroid backup with all the apps and data. Restore it, pull free version of Titanium off the Market and backup some apps. Flash Oxygen (you can replace the .so file with opening oxygen.zip in Winrar and replacing it in /system/lib) then try restoring the apps. If it works, you'll know the issue is with MyBackupPro.

thed0g said:
That seems to be unrelated, issue was only about data in the apps, app restore worked. I suggest trying to backup with Titanium backup and try to restore with it.
So: Im sure you kept the nandroid backup with all the apps and data. Restore it, pull free version of Titanium off the Market and backup some apps. Flash Oxygen (you can replace the .so file with opening oxygen.zip in Winrar and replacing it in /system/lib) then try restoring the apps. If it works, you'll know the issue is with MyBackupPro.
Click to expand...
Click to collapse
I like your thinking... I did indeed keep the nandroid backup, so I'll give it a whirl.
Thank you.

Great. Solved the problems I had with Titanium.

Replaced Evo, nandroid missing files

Recently I had to have my evo replaced because the mic died. sure was nice to spend 35 bucks instead of 400. after a little work i got it rooted and flashed and made a fresh nandroid of the new rom. I noticed that titanium hadn't backed anythingup lately but I had made a nandroid before taking the phone in. After a little research i moved the old nandroid to the new nandroid folder (serial numbers and all that) and proceeded to wipe everything and restore nandroid. Now I have almost everything back... except most of my apps. seems they were on the sdcard and now don't want to play nice. I can go to manage applications and sdcard and they are there but greyed out and unchecked. if I tap on one, it will crash immediately. I tried fix_permissions which ran for a few mins but nothing changed, so i rebooted again. still nothing. is there another solution for this or should I just attempt to pry open the img file and extract my data there? If so, where would said app data be? not the apps, but their data for saves/bookmarks/etc. Any help would be appreciated, this has been very frustrating.

Use Root Explorer to check whether the data's there (in /data/data) and whether the APKs are missing (/data/app if they were stored on the phone, /mnt/asec if they'd been moved to the SD card). You probably just need to reinstall the app, though you should backup the data just in case.

seems that the info is there in data/data, but not in data/apps. mnt/asec is also empty, though I recall moving most of my things to sdcard at one point. how can I copy data/data to my pc? can't seem to mount it where the pc will see it, even through recovery.
I decided since I can't mount it for some reason (lack of knowledge comes to mind) that I would just unyaffs the files. how would I push the data/data files back to the phone?

[CWM Scripts] Relatively painless backup/mod/restore scripts

Ok, these are specifically for MIUI, but they can easily be adapted to any other rom by editing the shell scripts. I'll explain how they work and it should be fairly apparent how one would need to modify for their particular rom/needs. Don't know if anyone will actually use these, but I thought I'd share. I also think it's a really good example of how CWM can be used for more than just flashing stuff.
So I've been running MIUI for a while now and I'm really happy. One little issue that popped up was every Friday when the rom was updated, the OTA update app icon gained a little "1" badge, indicating an update was available. While it's nice to be notified of the update, I occasionally didn't have the time or interest in updating so the little badge remained. I put that app in a folder, but then the folder had the little 1 badge. After a while, I started deleting the update app after install since I could always download and install updates through ROM Manager just as easily. Then I started deleting the update app from the downloaded ROM zip, along with several other apps I didn't want (Facebook, Twitter, the MIUI FileExplorer, etc) before flashing it. But this entailed downloading the Friday update on my phone, transferring it to my desktop, opening the zip in 7 Zip, deleting the unwanted files, uploading it back to my phone and then flashing. Quite a PITA.
Another issue I ran into was that the built-in MIUI backup app failed to backup my SMS/MMS messages. Actually, I don't know if it was failing to back them up, or failing to properly restore them, but at the end of the day, it wouldn't keep my text messages. I know I could avoid this by just installing each update over the current ROM, but I've always believed cleanly installing an OS helps avoid issues. I prefer to wipe everything, install clean and then restore my data.
So, the solution(s) I came up with was to mod the downloaded ROM zip file right on the phone, and manually backup and restore my data. While it took a little while to get set up, I find it actually works considerably faster and smoother than using MIUI's backup/restore app. I now have 3 simple shell scripts that are run through Clockwork Recovery just like installing any zip - one to mod the ROM after downloading, and two to backup and restore my data. Here they are:
MIUI-Mod.zip
This contains a shell script and a zip binary to handle the adding and deleting of files to/from the downloaded rom zip. When run through CWM, it copies zip and the script to /tmp and runs the script. Because the ROM zip is named differently every Friday, I figured the easiest solution was just to rename it manually. So, this script assumes the ROM zip is named "miui.zip" and is located in the root of the SD card. It's a simply matter to download the ROM on Friday, move it to /sdcard and rename it miui.zip. Here's what the script does in 2 commands:
/tmp/zip -d /sdcard/miui.zip /data/app/Twitter.apk /data/app/Facebook.apk /system/app/Email.apk /system/app/FileExplorer.apk /system/app/Gmail.apk /system/app/MIUI.us_Forums_1.1.2_AdSupported.apk /system/app/Superuser.apk /system/app/Updater.apk /system/app/MIUIStats.apk /system/media/lockscreen/* /system/media/wallpaper/*
/tmp/zip /sdcard/miui.zip /system/app/Gmail.apk
Click to expand...
Click to collapse
The first line simply opens the zip and deletes the listed files: Twitter, Facebook, Email, etc. It also removes all the wallpapers for the lock and main screens (I don't use them, so I didn't want them, but it's a good example of the use of wildcards like *).
The second line adds in the Gmail.apk from my current ROM. The latest versions of the Gmail app included in MIUI lock the mail database, which conflicts with a widget I use, so I just replace it with an older version. Every time I run the script, it removes the included Gmail app and adds in my current one. If you didn't want to add anything to the ROM, you could just delete this line entirely.
Data-Backup.zip
This just runs a shell script that creates a tar file in the root of your sdcard containing the listed files and directories. Tar files retain file permissions and owner information, so everything can be restored seamlessly. Here's how it works, it's pretty simple:
tar -c -f sdcard/backup.tar data/app/com.adobe.flashplayer-1.apk data/data/com.adobe.flashplayer data/app/com.speedsoftware.rootexplorer-1.apk data/data/com.speedsoftware.rootexplorer data/app/com.touchtype.swiftkey-1.apk data/data/com.touchtype.swiftkey data/data/com.android.browser data/data/com.android.deskclock data/data/com.android.launcher data/data/com.android.mms data/data/com.android.phone data/data/com.android.providers.contacts data/data/com.android.providers.settings data/data/com.android.providers.telephony data/data/com.android.providers.userdictionary data/data/com.android.thememanager data/data/com.android.vending data/data/com.google.android.gsf data/data/com.miui.camera data/data/com.miui.notes data/data/com.noshufou.android.su data/system data/misc/wifi
Click to expand...
Click to collapse
This creates the tar file and includes Adobe's Flash player and it's data, Root Explorer and it's data, and SwiftKey and it's data (I paired it down to just these three for this example). After that, it backs up a bunch of other data directories which include the current Browser settings, alarms, launcher settings and home screen layouts including widgets, phone logs, the current theme settings, any MIUI notes, current Wifi connections and, yes, SMS and MMS messages.
Obviously, you'd want to add in your specific apps and data directories. Sure, it takes a little work to set this up, but as I said, backing up is very quick and easy afterwards.
Data-Restore.zip
This just runs a shell script that restores all the files from the backup.tar on your SD card:
tar -xf /sdcard/backup.tar
Click to expand...
Click to collapse
Doesn't need much explanation.
So, the process is:
1-Download the Friday update through ROM Manager, move it to the root of my SD card and rename it to miui.zip
2-Reboot into CWM and run Backup-Data.zip to back up my apps and data
3-Run MIUI-Mod.zip to modify the downloaded MIUI rom
4-Wipe everything (cache/data/system)
5-Install the modded MIUI rom
6-Run Data-Restore to restore apps/data
7-Reboot
It's literally about 5 minutes after downloading the ROM and I'm updated and rebooted with a CLEAN os install and all my apps, data and settings intact, my home screen layouts, keyboard, wallpapers, wifi settings and everything retained.
Some notes:
1-Before running these in CWM, you have to make sure you have system, data and sdcard mounted since the scripts will be reading and/or writing to all of these. When you first reboot to CWM, just go to mounts and manually mount each one. The scripts could certainly be set up to mount them automatically, but mount points vary from phone to phone, and it's not difficult to mount through CWM. Also, after flashing a ROM, the ROM install script may unmount some of these, so before you restore your data, you might have to manually remount.
2-If you're adding anything from your current ROM to the zip (like how I add in my current Gmail.apk), make sure you wipe everything *after* running the mod script, otherwise you're deleting everything and then trying to copy file(s) that were just deleted.
3-I would highly recommend using Notepad++ to edit scripts, since it properly saves Unix line breaks.
4-as always, use at your own risk and a full CWM backup is highly recommended before messing with these.
That's pretty much it. Again, it does take a little while to get set up, but once it is, it's really simple. If you install a new app between updates, you just have to edit the backup script, or you can just keep the scripts maintaining a base setup and reinstall various apps through the market each time. This specific process is probably most useful for ROMs that are updated regularly - nightly or weekly, although I'm sure people can find other uses for running scripts through CWM.
Hope someone might find these useful.

This is really cool. I run Miui and would really like to be able to do a fresh install each week, but hate the hassle of resetting up my phone, even using Titanium backup, it's still a time consuming process. So needless to say, I flash the new rom over top of the old version without wiping just to save time.
So, basically I can open up the data restore zip in 7 zip, add in a few of my apps/data such as Tasker and so forth, close it and flash? If so, that will be great.
Thanks for sharing this!!!

You don't need to touch the Data-Restore.zip, all that does is extract the backup.tar file created with the backup script. What you'd do is open the Data-Backup.zip and edit the backup file (it's just a text file). Add in any of your apps and their corresponding data directories and when you flash the Data-Backup.zip in CWM, it'll back up those files/folders.
To find the files you want to backup, use something like Root Explorer and look in /data/app. There you'll find all the 3rd party apps you've installed. Add each one to the tar command in the backup file just like the ones I included. Then go into /data/data and find each app you want to back up's corresponding data folder. Add them to the tar command too.
Save the file, re-zip it and when you flash it through CWM, it'll back up the new files.

Just what i wanted
I also always install everything from clean system so setting up everything is a pain.
Would this work for Internal storage? I have a Motorola RAZR XT910 and running JBX roms.
Google does install all the apps when i sign in into the new rom but then i always had to move each folder to the correct destination manually using some file explorer. was thinking of making something like this but didnt know how to start. Thanks, I will now try and mod these to suit my phone :good: