[Solved] Restoring messages, contacts and calendar from .db files? - Desire Q&A, Help & Troubleshooting

Hi,
I changed the ROM on my Desire, and I forgot to backup my calendar/contacts/messages/call logs with a proper backup program, and none of this info was synced with Google.
However, I still have the data files on my micro SD card (I was using a ROM with apps2ext).
From what I've understood - correct me if I'm wrong - these are relevant files:
/data/data/com.android.providers.calendar/databases/calendar.db
/data/data/com.android.providers.telephony/databases/mmssms.db
/data/data/com.android.providers.telephony/databases/telephony.db
/data/data/com.android.providers.contacts/databases/contacts2.db (this one isn't very important, since I saved my contacts to a .vcf file)
I tried to simply copy the backed up files to those locations but it doesn't seem to work.. I'm a noob
Can anyone please help?
P.S. I was using a modified rooted stock ROM, and now I'm using Cyanogenmod 7
EDIT:
I think the problem is that the .db file structure is different in Cyanogenmod.
I restored the data by installing a rooted stock ROM again, restored the .db files to their original locations (instructions here), used MyBackup Pro to backup the data, installed Cyanogenmod again and restored the data using MyBackup Pro.
Oh, and contacts2.db holds both contacts and call logs. Not telephony.db.

Related

[Q] Text Message backup mmssms.db CMrc4

I moved from Sense 2.2 to Cyanogenmod 2.3.
Everything works great so far.
But I have a question regarding text messages. I backed up and restored the data with Titanium backup (which is basically telephony.db and mmssms.db). I can see that the file transferred correctly. But the text messages don't show up in the standard text app.
Any idea what could be the problem. I searched a lot, but couldn't find anything.
Thanks for any hints or links!
When you restored, did you restore system settings, and did you flash the latest gapps?
Thanks for the quick response.
Here is what I did exactly:
- wipe ...
- flash CMr4
- flash gapps 0307
- flash savagedzen kernel cfs sbs 1.01
- rebooted and tested everything
- configured pin, bluetooth, wifi manually
- rebooted again
- install titanium backup
- restored sms/mms dialer storage data
That is all I did.
So I did not restore any system settings.
I looked at the titanium list, but couldn't an entry named "system settings" or so.
It looks like it is not possible to restore sms from sense to cyanogen, right?
curious, I'm trying to pull my mmssms.db from a previous titanium backup (old Samsung Epic), and trying to restore to my new Evo.
Is the path still: ?
data/data/com.android.providers.telephony/databases/mmssms.db
in a froyo rom ?
(I usually copy the other 2 dbs in there as well).
EDIT: verified it is.. just the db structure is different. (f$%#).

[Q] How to manually restore application data?

Hi,
i had a corrupt nandroid backup but i managed to extract some data from the data.img.
Now i start from the scratch with a new rom and i have an old Titanium Backup of my apps which i already restored.
But the current entries of the applications are stored only in the nandroid. I have no other backup.
I managed to extract the folder data/data in which most application data is stored. When i now try to rename the folder of e.g. "My Car" from \data\data\com.aguirre.android.mycar.activity to OLDcom.aguirre.android.mycar.activity and restore the folder from my nandroid the application crashes. When i rename OLD to com.aguirre.android.mycar.activity to get my old state back everything works fine.
I already tried that (replace the database) months ago with the calendar but it failed too. Why? What does Titantium when restoring application data? Where is the difference?
thanks
Okay the permissions are the problem!
How can i
- change the user and group in root explorer
- change this settings recursive
I now granted everything to all folders and files of com.aguirre.android.mycar.activity and it works.
But how can i get the correct permissions!?

Restore old SMS

Hi,
I've gone from Insertcoin ROM to Cyanhenmod 12 5.1.
I've got backups of my old SMS using the stock HTC One M8 messaging app.
How do I restore my backups in CyanogenMod as it only wants to see .zip files but I don't know where they are stored for me to restore these.
Thanks.
I don't know if you have your answer already, but for the sake of researchers...
The stock HTC Messages app creates .hbk files when it backs up it's SMS. Keep in mind MMS does not backup. I have lost my Group Messages because they apparently come in as MMS. (I'm sure this is changeable within settings, but I don't want to change it).
To restore your messages, you'll need to either somehow get the Stock HTC Messages app in CyanogenMod and restore it from there, or... flash a Sense ROM and restore it from there.
The backups are saved in a folder named "sms_backup". This folder is generally located in the root of the internal storage. If you use a file explorer, or plug your phone into your computer, you generally start in the root folder already. (Check your external as well if you don't see the folder). If you don't see the folder, it's safe to create it on your own, and place your backup files there. I suggest placing them in the internal storage, and not the external (for the sake of making sure it works the first time[not saying it won't work, it's just easy to troubleshoot issues if people follow the same steps {malfunctioning SD card could cause an issue with restoring}])
Remember, MMS is NOT backed up using the Stock HTC Messages app for backing up SMS. This means your group messages may not back up. I am now going to start using a 3rd party app to back up my SMS, as so I can backup SMS and MMS.
I have no recommendations on 3rd Party back up SMS applications.
Jaymie1989 said:
Hi,
I've gone from Insertcoin ROM to Cyanhenmod 12 5.1.
I've got backups of my old SMS using the stock HTC One M8 messaging app.
How do I restore my backups in CyanogenMod as it only wants to see .zip files but I don't know where they are stored for me to restore these.
Thanks.
Click to expand...
Click to collapse
Download nandroid manager from the play store. It will read your backups and can restore SMS, MMS, call logs, Wi-Fi, apps, user dictionary, and some other things I don't use. It's been invaluable to me over the years.

SMS/MMS database location change Android 7.0 Nougat?

sorry if it seems like this is an easy one at first but i've been having some strange issues here.
i installed the 7.0 OTA on a new 5X that i'm about to switch to (coming from another 5X with a broken mic). both rooted. did a clean wipe on the new one with 7.0. moving data from the old to the new i can't get sms/mms to copy over. using titanium, rom toolbox, and carbon it won't work right. at first when i used carbon it only restored texts up to april this year. so i wiped them out and tried titanium etc. nothing works. then i went and directly copied the mmssms.db (and all the files) from /data/data/com.android.providers.telephony and still nothing. there were no texts showing in messenger app (tried textra too) so i sent a few test messages. those are showing up. but when i deleted the entire telephony folder within twrp, wiped cache and dalvik, rebooted those test messages are still showing up! when i browse to the new telephony folder that android created there's nothing in the folder. yet the text messages are still showing up. also the call log is still full (it actually restored properly with titanium).
i can't find any info that says the texts are stored anywhere besides the mmssms.db file so anyone know what i'm doing wrong?
recap:
-backed up sms/mms with carbon, titanium, rom toolbox (on android 6.0.1)
-fresh install 7.0
-restored with all those apps
-*partial restore*
-wiped com.android.providers.telephony folder
-manually copied backed up files into com.android.providers.telephony folder
-*nothing*
-sent a few texts through the app
-wiped com.android.providers.telephony folder
-*can still see texts with nothing in the folder*
-------------------
SOLVED
found it in /data/user_de/0/com.android.providers.telephony on the device running android N. don't know if it's like that for everyone but that's where it is on mine.
I used Titanium backup to backup call log/SMS from M and restore in N (clean install) with success.
dlegit said:
sorry if it seems like this is an easy one at first but i've been having some strange issues here.
i installed the 7.0 OTA on a new 5X that i'm about to switch to (coming from another 5X with a broken mic). both rooted. did a clean wipe on the new one with 7.0. moving data from the old to the new i can't get sms/mms to copy over. using titanium, rom toolbox, and carbon it won't work right. at first when i used carbon it only restored texts up to april this year. so i wiped them out and tried titanium etc. nothing works. then i went and directly copied the mmssms.db (and all the files) from /data/data/com.android.providers.telephony and still nothing. there were no texts showing in messenger app (tried textra too) so i sent a few test messages. those are showing up. but when i deleted the entire telephony folder within twrp, wiped cache and dalvik, rebooted those test messages are still showing up! when i browse to the new telephony folder that android created there's nothing in the folder. yet the text messages are still showing up. also the call log is still full (it actually restored properly with titanium).
i can't find any info that says the texts are stored anywhere besides the mmssms.db file so anyone know what i'm doing wrong?
recap:
-backed up sms/mms with carbon, titanium, rom toolbox (on android 6.0.1)
-fresh install 7.0
-restored with all those apps
-*partial restore*
-wiped com.android.providers.telephony folder
-manually copied backed up files into com.android.providers.telephony folder
-*nothing*
-sent a few texts through the app
-wiped com.android.providers.telephony folder
-*can still see texts with nothing in the folder*
Click to expand...
Click to collapse
Does your old phone still have all the texts you want on it? If so, use SMS backup and restore from the play store. Backup on the old phone, transfer the files to the new one and restore. It seems like you're doing more work than you have to just to transfer texts.
https://play.google.com/store/apps/details?id=com.riteshsahu.SMSBackupRestore&hl=en
jsgraphicart said:
Does your old phone still have all the texts you want on it? If so, use SMS backup and restore from the play store. Backup on the old phone, transfer the files to the new one and restore. It seems like you're doing more work than you have to just to transfer texts.
Click to expand...
Click to collapse
yeah i get it. it's a little much. i guess it's become more about how this thing is storing the texts if it's not in the usual place.
well if anyone is interested i found on the device running N that the new location is /data/user_de/0/com.android.providers.telephony. don't know why it's like that for mine but maybe it'll be useful for someone else too.
dlegit said:
well if anyone is interested i found on the device running N that the new location is /data/user_de/0/com.android.providers.telephony. don't know why it's like that for mine but maybe it'll be useful for someone else too.
Click to expand...
Click to collapse
I was able to extract the 'databases' folder from this location before restoring, but I'm having trouble restoring. Any ideas to restore these .db files to show in Messages app?
I tried to just copy them back to the /data/user_de location mentioned above, but also noticed there was no 'databases' folder there (I'd received one 2FA text from Google since doing the fresh restore) but even with root access couldn't properly create the folder. I then checked the /data/data location mention by OP and noticed there was a 'databases' folder there, I was able to paste my .db files in the folder, but they're still not showing in the Messages app.
Any input is much appreciated. At the least, I have the files, can open them in Windows with text editor and have confirmed there is conversations in there, my mmssms.db file is about 3 MB.
mrniceguy1437 said:
I was able to extract the 'databases' folder from this location before restoring, but I'm having trouble restoring. Any ideas to restore these .db files to show in Messages app?
I tried to just copy them back to the /data/user_de location mentioned above, but also noticed there was no 'databases' folder there (I'd received one 2FA text from Google since doing the fresh restore) but even with root access couldn't properly create the folder. I then checked the /data/data location mention by OP and noticed there was a 'databases' folder there, I was able to paste my .db files in the folder, but they're still not showing in the Messages app.
Any input is much appreciated. At the least, I have the files, can open them in Windows with text editor and have confirmed there is conversations in there, my mmssms.db file is about 3 MB.
Click to expand...
Click to collapse
I had the same problem, so I deleted the *.db-journal files, and after that I could start the SMS app and all messages were there!
Error.
Have been doing this since CM12 up to CM13. When I tried LineageOS 7.1.1 a few days ago, I restored my mmssms.db backup just like I always do. Found out that it was not located in /data/data/com.android.providers.telephony/database anymore so I found this thread. The problem is, if I put my mmssms.db backup at/data/user_de/0/com.android.providers.telephony/database, my sms app crashes. Tried to delete *.db-journal files too but still my sms app crashes and the only way to make it work again is to wipe my data.
cyberangel22k said:
Have been doing this since CM12 up to CM13. When I tried LineageOS 7.1.1 a few days ago, I restored my mmssms.db backup just like I always do. Found out that it was not located in /data/data/com.android.providers.telephony/database anymore so I found this thread. The problem is, if I put my mmssms.db backup at/data/user_de/0/com.android.providers.telephony/database, my sms app crashes. Tried to delete *.db-journal files too but still my sms app crashes and the only way to make it work again is to wipe my data.
Click to expand...
Click to collapse
I found that you should delete the contents of /data/user_de/0/com.android.providers.telephony/databases and the app_parts folder, then reboot. Then do the manual move of your attachments (into app_parts) and the .db files (into databases). Then reboot again BEFORE opening your SMS or messaging app. This addressed the messaging app being unable to load MMS for me, but I don't know if this will help your crash problem. I'm on OxygenOS 7.0.
Silly22 said:
I found that you should delete the contents of /data/user_de/0/com.android.providers.telephony/databases and the app_parts folder, then reboot. Then do the manual move of your attachments (into app_parts) and the .db files (into databases). Then reboot again BEFORE opening your SMS or messaging app. This addressed the messaging app being unable to load MMS for me, but I don't know if this will help your crash problem. I'm on OxygenOS 7.0.
Click to expand...
Click to collapse
Thanks for your suggestion. I will try this later. :good:
Tried this:
-deleted contents of /data/user_de/0/com.android.providers.telephony/databases
-rebooted. A new set of db files were generated automatically
-overwritten mmssms.db
-rebooted. Messenger app does not crash anymore but cannot load messages and cannot create new message.
-tried steps 1-3 again
-after reboot I cleared the messenger's app data but still same result.
I will convert my backup now to xml and restore it via app until there's another way of restoring it manually.
Using lineageOS BTW. Thanks.
I've been able to restore SMS/MMS/APN data from Titanium Backup on LOS 14.1
I just need to copy and keep file modes and ownership of "com.android.providers.telephony" from /data/data to /data/user_de/0 folder. The built in tar command will do that just fine
Code:
# tar -C /data/data -cf - com.android.providers.telephony | tar -C /data/user_de/0 -xf -
If you have copied the folder manually, just change the ownership of com..android.providers.telephony to "radio:radio" (user=radio, group=radio). No need to do this with tar command above, since tar when run as root will keep file and folder ownership.
Now waiting for Titanium Backup to support "user_de" system folder backup and restore on Android N based ROMs.
Can anyone explicitly confirm this works copying from a <=6.0 system to Nougat?
Here's what I gather:
- Mrniceguy can't get it to work
- criza got something to work
- for cyberangel, it crashed
- silly got it to work on Oxygen
- mydeardiary got tar to work (though your tar command looks a bit funny)
My Droid Turbo's (6.0) screen died, but I can access ADB. I tried copying the mms db to a Galaxy S4 (5.0.1) without success. When I copied the mmssms.db and journal, Messages showed an empty history. I made sure the permissions were set (660, radio:radio). Copying the telephony files over caused the Phone app to constantly spam a FC dialog until I turned the phone off. Restoring the original (S4) files fixed it.
I don't want to risk my shiny new Nexus 5X unless I'm sure that just copying the files over will work.
I can confirm that copying the database from an older version to Nougat doesn't work.
- in /data/user_de/0/com.android.providers.telephony/databases:
- backup all files
- delete mmssms.db, mmssms.db-journal
- reboot
- copy in mmssms.db, set permissions 660, radio:radio
- reboot
- run Messages
empty message list
when trying to create conversation: "Failed to create conversation, please try again later."
- restoring original files fixes messaging
I suspect there's something to the format of the mmssms.db file that is different across releases, or between phones.
cyberangel22k said:
Thanks for your suggestion. I will try this later. :good:
Tried this:
-deleted contents of /data/user_de/0/com.android.providers.telephony/databases
-rebooted. A new set of db files were generated automatically
-overwritten mmssms.db
-rebooted. Messenger app does not crash anymore but cannot load messages and cannot create new message.
-tried steps 1-3 again
-after reboot I cleared the messenger's app data but still same result.
I will convert my backup now to xml and restore it via app until there's another way of restoring it manually.
Using lineageOS BTW. Thanks.
Click to expand...
Click to collapse
I finally got it working... I was eagerly ready all the posts here.
Here is my solution:
After freshly installing the new LineageOS I installed Root Browser and BusyBox (obviously you need root permissions for this). Then I opened in Root Browser the location /data/user_de/0/com.android.providers.telephony/databases. I made a backup of the files inside in a subfolder. I copied my old files into the now empty folder (adb root, adb push.....--> six Files: HbpcdLookup.db, HbpcdLookup.db-journal, mmssms.db, mmssms.db-journal, telephony.db, telephony.db-journal). Then I gave to all xyz.db files the read/write permissions for the owner and the group, and for the journals, I gave them only read/write permissions from the owner (I got an error that the permissions couldn't be applied --> ignore it, it does get applied). To all six files, I changed the Ownership from root to radio. --> rebooted --> no crashing but no messages visible --> installed the "SMS from Android 4.4" from the PlayStore--> set this SMS app do be de default one (I set the mark to not delete old messages in the settings) --> this app restored all my SMS that I had lost.
Its quite some trouble to get to the files but in the end it seems to work.
I hope you can reproduce this procedure...
Same problem here with latest Lineage on a rooted serranoltexx (Samsung Galaxy S4 mini LTE). I think something changed in the last update, but I don't understand whether it's Android's or Lineage's fault.
I give you more information, as it seems like a recent issue which troubles a lot of users - I found many similar threads, but no solution so far.
On my old Samsung S2 I was using the app SlightBackup (free, from F-Droid) to backup SMSs. However, copying the SlightBackup database (.xml format) on my new phone and reinstalling it there doesn't seem to work, so I decided to copy manually the mmssms.db file. Also in my case, the new directory seems to be /data/user_de/0/com.android.providers.telephony/databases (however, there is also a file called telephony.db which has a symbolic link in /data/data/com.android.providers.telephony/databases )
Still, my SMSs do not show up, and moreover the "contacts" app crashes. I tried deleting all the content of the folder and then the messaging app crashes (a full reboot restored the content, however, and the functionality of both apps with it).
Interesting to notice that all the *.db and *.db-journal files in the folder do not change size even if I send/receive SMSs, so I guess they are there just for compatibility, and do not actually store the messages. The "real" database is probably somewhere else, but I have no idea where to look for.
Help would be really appreciated. I'm willing to send 0.01 BTC to the first person who finds a working solution
P.S.: yes, I have also taken care of the filesystem permissions of the .db file, which is something only mentioned in this thread amongst all those I've found, but important I think. In my case the .db file is 660 with owner radio:radio, same for the .db-journal but permissions 600.
P.P.S.: installing third-party apps to restore my SMSs is not an option in my case. I know about working apps in the Play Store but I don't want to use them.
P.P.P.S.: yes, my phone is rooted, and I am not using third-party messaging apps, just the default one.
Silly22 said:
I found that you should delete the contents of ... Then do the manual move of your attachments ... Then reboot again BEFORE opening your SMS ...
Click to expand...
Click to collapse
This doesn't work for me.
Serachja said:
I finally got it working... I was eagerly ready all the posts here.
Here is my solution...
Click to expand...
Click to collapse
Thanks for the hint. Your solution probably works because the app "SMS from Android 4" is still using the old location/format of the database. This strengthens my idea that in the last update the situation has changed for the default messaging app (as I said, I don't want to use third-party apps in this case).
That's really frustrating... it's crazy that such a simple thing as the local SMS database creates so much trouble
Here is new db location: /data/data/com.google.android.gms/databases/icing_mmssms.db
You can also find a lot of things in that folder
ognevod said:
Here is new db location: /data/data/com.google.android.gms/databases/icing_mmssms.db
You can also find a lot of things in that folder
Click to expand...
Click to collapse
Hey, thanks but unfortunately that doesn't work for me: I don't have that location at all, the only com.google folder I have is com.google.zxing.client.android and that doesn'tcontain the mmssms.db
It's in the same place on my Galaxy S6. Does this file also contain the APN settings on your phone? I was able to edit it and enable my phone's native tethering
As I said, unfortunately that doesn't work for me I'm using Lineage OS 14.something (nightly). At this point I just gave up and deleted all my old SMSs, there was nothing too important anyway. But it still kinda suck. Well, never mind.

SMS/MMS location within file system?

Hi all,
I have both a TWRP and a Titanium backup from my phone at an earlier version of my ROM.
I've since done full data format and install so I have lost my MMS/SMS messages.
I did not use another utility to back them up at all.
Does anyone know where in the file system these are stored or how I might be able to restore them from my Ti or TWRP backups?
I've tried doing a TWRP restore to the earlier ROM version but messages was still empty. I've tried doing a full restore and individual restores of dialler storage in TiBU etc but so far have had no luck in restoring the messages.
Thanks in advance
kamold said:
Hi all,
I have both a TWRP and a Titanium backup from my phone at an earlier version of my ROM.
I've since done full data format and install so I have lost my MMS/SMS messages.
I did not use another utility to back them up at all.
Does anyone know where in the file system these are stored or how I might be able to restore them from my Ti or TWRP backups?
I've tried doing a TWRP restore to the earlier ROM version but messages was still empty. I've tried doing a full restore and individual restores of dialler storage in TiBU etc but so far have had no luck in restoring the messages.
Thanks in advance
Click to expand...
Click to collapse
If you're using nougat, I believe the location is
/data/user_de/0/com.android.providers.telephony/databases/
Then it's the mmssms.db file you need.
When I do a clean flash, I always use the backup function that is built in to export messages to sd card.
squ89r97 said:
If you're using nougat, I believe the location is
/data/user_de/0/com.android.providers.telephony/databases/
Then it's the mmssms.db file you need.
When I do a clean flash, I always use the backup function that is built in to export messages to sd card.
Click to expand...
Click to collapse
Thanks for that info That appears to be the correct location in my case.
Previous to Nougat seems to have been in /data/data/com.android.providers.telephony/databases
I restored the whole com.android.providers.telephony folder from the backup as it also contains the pics from attachments. Initially after a the first bootup messages was still empty, so you need to reboot again and they will be restored.
I'll also make sure I backup messages using the inbuilt backup feature in future.

Categories

Resources