Develop Bugs

Beta: WM5 ROM editing tool

I've made a set of tools that can assist in cooking your own WM5 ROMs. These tools were tested only on BlueAngel devices. They should also work on Himalaya. Universal and Wizard support is also present, but it is untested, so the tools may crash or turn your device into brick. But it is possible to extract files from universal/wizard ROMs and use them on other devices.
I've attached 2 archives - make_hv.rar, a tool from Platform Builder that can be used to recreate .HV files (they contain default and boot registry), and imgfs_tools.rar - these tools should be used to edit WM5 IMGFS partition.
With these tools and http://forum.xda-developers.com/viewtopic.php?t=33321 (it can edit WM5 boot XIP partition) it is possible to replace/add/delete any file in WM5 ROM.
Usage:
Code:
prepare_imgfs.exe
Splits nk.nba into imgfs_raw_data.bin and imgfs_removed_data.bin.
imgfs_raw_data.bin - contains raw IMGFS data
imgfs_removed_data.bin - contains extra data (something like FAT table).
Usage:
prepare_imgfs.exe nk.nba [-nosplit] [-mpx200] [-acer]
Use "-nosplit" for HTC Wizard and Universal ROMs that don't contain extra
blocks of data. In this case imgfs_removed_data.bin would be empty.
make_imgfs.exe
Reverse of prepare_imgfs. Combines imgfs_raw_data.bin and imgfs_removed_data.bin
into nk.nba file. Use -nosplit if it was specified for prepare_imgfs.exe.
Usage:
make_imgfs.exe nk.nba [-nosplit]
The nk.nba file would be used as a template, its contents would be overwritten.
viewimgfs.exe
Dumps the contents of imgfs_raw_data.bin to "dump" subdirectory. Files are
dumped as is, modules as directories. File time and attributes are preserved.
If RecMod.exe is present in the current directory, all modules are
reconstructed as working DLLs/EXEs and placed in the corresponding subdirectory.
Tool creates dump_MemoryMap.txt with address ranges occupied by modules.
Usage:
viewimgfs.exe imgfs_raw_data.bin
RecMod.exe
Reconstructs a module dumped as directory to a working state. Rebuilds
relocations information, and tries to guess section names.
Usage:
RecMod.exe [path to module directory]
BuildImgfs.exe
Reverse of viewimgfs. Reconstructs imgfs_raw_data.bin and imgfs_removed_data.bin
from files in "dump" directory. Overwrites contents of imgfs_raw_data.bin/imgfs_removed_data.bin
files. Does not check for errors or end of free space. Approximate free space
left is displayed when program is finished. In case of error contents of bin
files is undefined.
Usage:
BuildImgfs.exe
It would overwrite imgfs_raw_data.bin/imgfs_removed_data.bin in current directory.
DelFile.exe
Deletes one file or module from imgfs_raw_data.bin. Wildcards are not supported.
Usage:
DelFile.exe filename.ext
Uses imgfs_raw_data.bin from current directory. Does not check for errors.
AddFile.exe
Adds one file to imgfs_raw_data.bin. Would reuse space freed by DelFile.
Usage:
AddFile.exe filename.ext
Uses imgfs_raw_data.bin from current directory. Does not check for errors.
The typical process should be:
prepare_imgfs.exe nk.nba
viewimgfs.exe imgfs_raw_data.bin
...modify "dump" directory as you need...
BuildImgfs.exe
make_imgfs.exe nk.nba
or
prepare_imgfs.exe nk.nba
DelFile.exe filename.ext
AddFile.exe filename.ext
...you may add/delete as many files as you need...
make_imgfs.exe nk.nba
Of cause you'll need a tool to convert NBF<->NBA files. SD-card images can be also used instead of NK.NBA file, but this was not tested!
Troubleshooting.
In case of invalid ROM the tools would crash without saying anything. In this case they may destroy the contents of input files.
Use these tools at your own risk! They may make your device completely unusable! Always make an SD-card backup of your ROM and Extrom!
The worst case I had during tests was complete destroying of DOC partition on my device. I had to flash WM2003 OS, repartition DOC from there and this fixed the device. Of cause this method cannot be used on Wizard or Universal.
I've published these tools so that someone could integrate BA patches into a ROM or play with cooking own ROMs.
edited 12.12.2005. AddFile/BuildImgfs should work on Universal/Wizard ROMS (i.e. roms with empty imgfs_removed_data.bin file).
edited 15.01.2005. Fixed a major bug found by TofClock. Short name of files with filename length 24 chars or longer (like "instmsgrresources.96.dll") was incorrectly generated and in some cases they were inaccessible by OS.
edited 05.02.2005. Added several checks so that viewimgfs.exe does not crash on incorrectly patched ROMs (MPX200). Don't use buildimgfs.exe on such ROMs.
edited 30.03.2006. Added RecMod tool that reconstructs modules dumped as directories to a working DLL. So reusing modules from other ROMs is now much easier. Added updated prepare_imgfs.exe with support of ACER N300 ROM (thanks to Tuatara).
edited 12.07.2006. Added source code of prepare_imgfs/make_imgfs tools, so anyone can add the support of new devices.
edited 25.10.2006. Published the source code on my site. The code is ugly and is not commented at all. Don't ask me how to compile or use it!
I've stopped working on this project. There would be no updates.
Complete source code is available on my site.

mamaich,
can this be done on Alpine device??? Alpine that known as faster Himalaya also should be running WM5.....
thanks

Looks nice
Some questions:
1. AddFile:
Can I add single file like
Code:
AddFile something.exe
or have I use 'modules as directories' [like directories dumped with ViewImgfs]
2. AddFile:
Is it possible to add files into directories not in \Windows? For example: "\Program Files\Something\something.exe"
3. Is it possible to modify the kernel? Can I extract and replace \Windows\fatfsd.dll?
Thanks in advance.

mamaich, would for example replacing the internet explorer exe be enough to get it to render gifs correctly? Or are extra dll needed? Also is it necessary to use the other tool you linked to as it appears your tool can add and delete files itself? thanks
Edit: Forgot to add, thanks for your hard work.

mamaiiiiichhhhh I was waiting those tools gr8 work mate, can you upload the modified rom that you already customized for testing it?

baniaczek said:
1. AddFile:
Can I add single file like
Code:
AddFile something.exe
Click to expand...
Click to collapse
You can use both methods, but subdirs can be used only if you are really know what you are doing (i.e. you know all addresses of each section and 100% sure that they don't overlap some other modules and you've edited .VM and .ROM files). In most cases you should add EXE/DLL files as normal files.
Is it possible to add files into directories not in \Windows? For example: "\Program Files\Something\something.exe"
Click to expand...
Click to collapse
All files are placed into \windows dir and then moved by coldinit to subdirs according to instructions in initflashfiles.dat. Of cause you can modify that file as you like.
3. Is it possible to modify the kernel? Can I extract and replace \Windows\fatfsd.dll?
Click to expand...
Click to collapse
Boot part can be edited with http://forum.xda-developers.com/viewtopic.php?t=33321
ramram
There is no ROM I can release for public testing. I would not integrate my patches into the ROM, I'm working on adopting Wizard's ROM for our devices. But everything is on too early stage, I have to combine registry settings, ROM files, find and patch drivers for ROMs to work, etc. And Wizard's ROM is larger than ours, some files should be removed.

efjay said:
mamaich, would for example replacing the internet explorer exe be enough to get it to render gifs correctly? ...
Click to expand...
Click to collapse
I don't have any problems with IE.

Ic
mamaich,
I'll wait you then until you finish the wizard rom adoptation, I'll be glad trying it on the BA if you don't mind, consider my device for development purpose and beta testing if needed.
Concernig the IE, I have the same problems as Efjay mentioned earlier.
Thank you

@mamaich
Thank you for the answer. And thank you for your hard work [sinze Siemens SL45i].

mamaich said:
efjay said:
mamaich, would for example replacing the internet explorer exe be enough to get it to render gifs correctly? ...
Click to expand...
Click to collapse
I don't have any problems with IE.
Click to expand...
Click to collapse
mamaich, the problem is with viewing gif files. On this site using PIE i cannot see the quote button and other buttons below a post. Even manually opening a gif file on the BA opens PIE with a blank page.

go mamaich!!!
;o)))
buzz

buzz_lightyear said:
go mamaich!!!
;o)))
buzz
Click to expand...
Click to collapse
And GooO BuzZ

how about buzz if you can with your know how get a bare minimum rom version of universal not having alot of crap like the various silly tsk files and other pictures and videos that serve as demos on the rom and not do anyting else..im sure alot of us use our own file explorers (resco,tc) so that can be removed aswell.. what do you think...??/

can you use nk.nbf? how can i convert nk.nbf into nk.nba????

zohaer21 said:
can you use nk.nbf? how can i convert nk.nbf into nk.nba????
Click to expand...
Click to collapse
you can use this tool xda3nbftool.exe download from ftp for BA or Xda2nbftool.exe for Himalaya.
@Maimach
All the module files are Directory ??? How can I use these for my purpose ? But it Great work Maimach , go on!!!!!!

I tried to use this tool to add two modules and then flash the finished nbf file but i get an error file is corrupt if i use BaUpgradeUt.exe. If i use MaUpgradeUt_noID.exe it seems to initialise but no rom info is shown on the upgrade screen. Continuing the rom upgrade nothing then happens then a message comes up that the upgrade is finished. Soft reset and back to normal. I followed mamaichs instructions and everything seemed to go ok. Any idea why it didnt work for me?

Yeah, go Mamaich, you rock. After the Wizard ROM on the BA, the next step could be a complete ROMkitchen (á lá Wallaby...).

Stupid question, where can I find the NBF<->NBA converter? (Yes, i did search the forums)

ftp://xda:[email protected]/BlueAngel/Tools/UpgradeTools.rar
and this page for info
http://wiki.xda-developers.com/index.php?pagename=BA_GettingStarted

@efjay
did you use the -sd -sl -so and the -c -u options in xda3nbftool? Thats where i went wrong first time.

UPLOAD DIRECTLY TO XDA (no file size limit)

''HJ-split'' will split ANY file into ANY size! (you choose!)
''goodbye rapidshare/4shared/megaupload..''
let me explain.. for example a .NBH file
2 - Split
* Select Input cooked .nbh file and Output location..
* Select file size as 8 MB.. (maximum upload size for xda dev's)
* Start..
* Place Output parts's into WinRarZip file's..
* Lable eg. ''NBH_Part1'' - 2.. 3.. ect..
(WinrarZip will be less than 8 MB for each part..)
* Upload to xda dev's!
4 - Joining
** Extract all part's to same folder **
* Select Input file NBH_Part1 ''ONLY''..
* Select Output location of your cooked .nbh file..
* Start..
PISS EASY and QUICK!

...
this is o2 uk official os nbh..
split..

Hmm I think this is exactly why the filesize limits are set - to prevent people wasting server space with huge archives, that can be stored externally. Too many people DLing will only slow down the forums for the rest of us.
It's very easy to increase the filesize limit on server if the admins choose to do so
But speaking of it, I think it's better idea to use WinRAR SFX archive split by say 6MB and then zip the parts.
- you don't need any software to unpack them other than Windows ZIP compression
- the result will be much smaller in total size
- the parts sizes will be almost even, so there's less parts total
The zipped RAR may in theory actually be bigger than the RAR part, that's why not split by 8MB but rather 6 or 7
Unpack:
- unzip all parts to one folder
- run the exe and select where to unpack
- done

[PC][TOOL] Manila Source Kitchen - in development

UPDATE: For example of dump, go to Post #3!
Thanks to Co0kieMonster, Chainfire and other people I use their tools (LuaConv, LuaC, LuaDec, CFC, Mode9Decode and some other).
Hello,
[OT]
I am planning on totally remaking Manila into something totally different.
[/OT]
Anyway, back to the topic.
I decided to use Manila, because it has builtin OpenGLES animations that can be decoded to XML, also it uses LUA scripts which are really easy to write, plus manila provides me access to all what I need - audio library, messaging, ...
But this requires A LOT of effort. That's why I decided to create something like Manila kitchen, that would build whole manila from source .lua, .png, .mode9 and .xml files and all the rest I just forgot, to the asd123qwer_manila files.
Advantage of this is, that when some lua script has does require something like messaging\messaging.luac, it really is there, so you don't have to via manilahash.exe search for that file, disassemble, edit etc. Kitchen will do all of this itself
As of now, I have done part, which will grab folder filled with those _manila files, disassemble the lua files, it can delete unneeded langs in xml (afterall, all will be deleted for my purpose), those disassembled .lua files renames by the list (thanks to Co0kieMonster and others who helped him to fill it) it has, creates virtual original file structure. And from this structure, it again rebuilds into output directory. (And yes, it takes that base is \windows\htc, it just seemed useless to have there, since all scripts have that base name)
Example:
from:
C:\ManilaSourceKitchen\Dump\08c9c9cc_manila
C:\ManilaSourceKitchen\Dump\575c2a6d_manila
happens
C:\ManilaSourceKitchen\Source\scripts\activesyncdetect.luac
C:\ManilaSourceKitchen\Source\scripts\audio\music_property.luac
etc.
(Testing and developing is on TF3D 2.1, but will be Sense 2.1/2.5 compatible too.)
Current progress
-- LUA:
- Disassemble
- Move to Source folder with propriate name
- Compile back to _manila file
-- XML:
- Delete languages you don't want
- Move to Source folder with propriate name
- Compile (copy) back to _manila file
-- MODE9:
- Decompile from binary to XML
- Move to Source folder with propriate name
- Compile back to _manila file
-- QTC:
- Revert to PNG from QTC
- Move to Source folder with propriate name
- Compile back to _manila file
-- Kitchen:
- UI
Who's interested?
PS: The "new" Manila, simple picture (MSPaint, mouse, 2 minutes):

Sounds very interesting. It will be great to see what you come up with.

I've been working another hour and half and I made another progress. Now is being decmopiled what can be:
LUA -> luac source code
MODE9 -> XML (editable view of binary mode9)
QTC -> PNG
proper file naming from names.txt -- still needs updating. For TF3D there is about 160 files without name. But with this it is easy to find out what is missing, because when some scripts asks for \Windows\HTC\Assets\Images\someimage.qtc, I can easily check, if that file is there. If not, I simply check it's hash and then find propriate file, add it to names.txt and voila .
To show you how does it look atm, I enclose ZIPped TF3D dump from my ROM.
All files in Sand\*_manila are those without proper records in names.txt which has to be discovered their original name.

Hello all,
Am using this opportunity to introduce myself to the community.My name is Calvin and I,m the new kid on the bloc hoping to find my way around your community to meet some nice and interesting people with fresh ideas.Hope we find a common path to tread.
Calvin
web design,web development, cms websites, Joomla Development, cms based websites, website design and development

Sounds like an interesting project, I know the manila/sense guys in the TouchFLO/Manila/SenseUI social group are keen to move on from the Manila Command Line Kitchen (excellent though it is).
Shall look forward to seeing what comes of this.
Welcome aboard Calvin123.

The "Decompiling" part is a bit of problem, because lua decompiler isn't 100% accurate, so recompile "what you just dumped" doesn't work on all files. Images yes, XML yes, mode9 yes, not not lua scripts.
Anyway, those remaining _manila files are now being bruteforced. Couldn't find link to them in require("somescript"), nor mode9 files . It goes quite fast, hope to get results till 2 hours from now (counting max 30 filename length + .luac name). Bruteforce to find original filenames will be enclosed too, IMHO best way to find original filename, if you can't find it manually by checking dependencies in mode9 and luac

Editing RSR string files made easy (application)

Here's a small side project of mine:
convRSR v0.2
Usage: convRSR [RSR or CSV file]
... or just use the included Windows Batch files.
convRSR converts RSR string files to editable CSV files (edit with LibreOffice or Excel) and vice versa. File types are recognized automatically. It's pretty easy to use and beats string editing via WR by lengths, so just try it.
Keep in mind that this didn't undergo much testing, so always check your RSR files (using WR or hardware) before using in a release project!

... and a small update. The last one had a small bug that is now fixed.

all2rsr.bat and all2csv.bat not included actual attachement.
Anyway.
Used from older Version in convRSR.7z
Thanx.
Best Regards

Repacking kernel bzImage possible ?

Hi all,
I have a kernel running on a android 8.1.0 device.
the kernel binary(x86_64 V4.9 ) is an self extracting lz4 binary image.
If i change bytes in the LZ4 compressed data, kernel still boots. (some compressed text was recognizable..and changing it was seeable in kernel log output)
I can lookup the LZ4 header, and from there extract the compressed vmlinux.
i would like to byte-patch this vmlinux binary..and put it back in the kernel file.
If i edit it, and recompress i get a smaller file.
if i paste that into the original kernel binary (filling the missing space)..there is no boot at all., no kernel msg whatsoever.
i found a compressed size in the header (found from source /arch/x86/boot), but updating that doesn't do the trick.
any idea's ? or know tools for this ?
Thanks!!