Develop Bugs

Downloads and Stuff

I know, I know, I know. I'm not paying, so I shouldn't complain.
However, I think we can agree that rapidshare is the opposite of efficient for ROM distribution.
Since I'm no coder myself, just an end user (with an engineering degree in telecoms), for me to set up a good solution myself doesn't exactly strike home eighter.
However, we have some VERY capable coders here. And we have a lot of end users with some bandwidth to share. Is there a chance we can set up an rss-based downloader (using bittorrent to distribute roms), and then simply tell regular downloaders to get the torrent file? (And thus save this site bandwidth and storage, and end users gray hairs over downloads that are SLOOOOOW). Setting up a Diamond "rom-farm" spread over the internet would solve a lot of problems. I know _I_ can prolly share half of my 8mbit (on average), and I think there are others out there who can share aswell, giving this group a good potential (and if we can get other groups to cooperate we can prolly increase bandwidth and spread over the internet).
Bittorrent is ideally suited to this work, especially if we have a few "always on" seeding-servers.
//Svein

This is a very good idea.
I'm on a 100MBit, so that won't be a problem.
I also have a spare dual opteron server lying around.
I've seen that tom (who has a Latvian hosting) also has some good bandwidth.

adwinp said:
This is a very good idea.
I'm on a 100MBit, so that won't be a problem.
I also have a spare dualopteron server lying around.
I've seen that tom (who has a Latvian hosting) also has some good bandwidth.
Click to expand...
Click to collapse
unlimited

What we basically need:
1. Someone with a *nix box on a low-latency (bandwidth isn't an issue, latency is) link, willing to run "our" tracker, and set up the needed accounts for uploads, and set up the tracker to rss-feed the seeder servers.
2. Several people willing to run seeder servers. These need bandwidth. The seeder servers should run in rss-fed full automatic mode.
From what I've seen (between the lines) in the posts on this forum, getting people willing to give bandwidth shouldn't be a problem. What we need is a decent tracker software (I'm open to any suggestions), and some template for setting up the seeder servers.
Am I missing anything? Who volunteers to make the tracker? (I can volunteer to run it, and to make sure latency is ... acceptable on the link. I'm a pedantic millisecond-centric ex netadmin. Ex because of health.)
//Svein

this is a great idea. If i can help in any way I will.

The dual opteron box I was talking about is running gentoo linux.
I will have to reconfig it though.
I can take care of most of the setup during the week-end (if I stay home don't go on the potential trip I planned).
Let's take care of all the suggestions via this thread / pm.

What a great idea

sskogen said:
What we basically need:
Am I missing anything? Who volunteers to make the tracker? (I can volunteer to run it, and to make sure latency is ... acceptable on the link. I'm a pedantic millisecond-centric ex netadmin. Ex because of health.)
//Svein
Click to expand...
Click to collapse
I was a net admin for 4 years so I know how you feel.
^.^
Try testing adwinp.org and see if the latency suits your needs (it should; we are on a 10GBit backbone).
^.^

Well this seems promising! While this whole thing gets in place, as a sort of alpha tryout, how about using public trackers such as thepiratebay for example? And have a wiki page with up to date torrent links.

wow great idea =)
only suggestion here is maybe change the title of this thread xD

I uploaded torrents for the radios and Elite ROMs.
Links are available on the Diamond Radio wiki: http://wiki.xda-developers.com/index.php?pagename=Diamond_ExtractedRadioRoms
and the Diamond Elite ROMs wiki: http://wiki.xda-developers.com/index.php?pagename=Diamond_Elite_ROMs
It should work.. normally... and be faster than rapidshare once we get seeders.
Time to flash Elite 3.0 now
If you already have the files, don't download them again! Just copy them to the torrent download directory, like that your torrent will be 100% complete and you will be able to seed and help others download faster.

Have added the 5 torrents to my local box.
//Svein

Torrent sharing is great. I'll help!

File hosting for XDA-Developers.

I have been "leeching" from XDA for a while now and I want to give something back to XDA.
I have a webhosting business. I am not really doing anything with it at this time. I was thinking about opening it up for XDA members for file hosting.
I HATE RapidShare and other "free" sites like it... I wouldnt do anything more than some banner ads on the site, maybe some GoogleAdSense... Nothing intrusive... I promise...
Would anyone use this COMPLETELY FREE SERVICE?
Im setting it up now, 100MB for RAR and ZIP, 50MB for CABS
www.FarBeyondHosting.com

That is a very nice idea! It would be great for this great site.
I join ya! - I absoluty HATE Rapidshare too, most of the time it's busy or I'll keep on countin' the seconds
The adds are no problem, when there aren't a lot - that is...

Most of the rom's are above 100mb though...
WC

Yep file limits may not be the best but its a great idea... thanks for sharing

I have to admit, I dont know what kind of files sizes are needed for the ROMS.
I have used the roms for the 8525, and the tilt, and now the Raphael/Fuze... And those are generally less than 100MB...
What would a good size be? 200? I have unlimited space on that server...

Thanks a lot
I think this is a good idea!

btw has anybody thought how many roms there are published here?

Lol, I was just coming to post the same topic, I have unlimited space and bandwidth if I need it, do you have any bandwidth limits?
I've started hosting files for the android/kaiser project but haven't moved out into the rest of the site so far.
My idea was to just register under a username (hopefully associated with your xda account) and upload your files without size limit (unless it's over 1GB?) and also provide a link for users to view all your posted files/ROMs etc.
Seeing you're already looking into this, maybe I'll still do it, maybe I won't :-D
BTW, thanks for giving back!

Well i have my own physical server in a UK datacenter. Physical as in if i wanted to i could go there and pick it up etc.
It's an intel xeon quad core server with 4gb ram and loads of space!
It's hosted on a dedicated 100mbit connection, with offsite backups located in the USA.
Those intrested ping fbdn.net we run ESXI so basically emulating OS's for better performance etc
I dont see a problem with hosting these files will check my datacenters TOS and AUP in a sec

XDA Tracker

Hi!
I'm no developer, but wanna help all the good folks here at the forums. So I decided to set up a torrent tracker for all of you. Most developers are sharing their files via cyberlockers (like MediaFire, etc...) which is not really an option for some people. I thought a torrent tracker would be much easier and more efficient way for distributing the files (like ROMs, Themes).
Here is the link for the tracker: http://619media.hu/xdadev/
If you want to upload a file PM me for username and password.
Announce URL if you create a torrent file: http://619media.hu/xdadev/announce.php
I've uploaded zdzihu's xRecovery for the X10 as a test. If there are any problems, you can't download, etc. please PM me. I know, there will be some problems at the beginning, but I hope we can make it work.
Cheers,
DRuNKeN MaSTeR
@MODs: if this is not the appropriate forum for this thread please feel free to move it. Also, if the tracker conflicts with your rules, contact me.

That is a GREAT idea, does it happen to support HTTP seeding also? Because in addition to this it would also be awesome to have a kinda standard drop box that isnt like the other file dumpsters.

Hi!
Yup, supports HTTP seeding Currently only 5 simultaneous uploads with 100KB/s each, but I can take it higher if this catches on.
EDIT: RT supports 2 types of HTTP seeding:
- "Use BitTornado HTTP seeding specification: Relative location of file or directory, e.g. ../../files/file.zip" -> I can give limited space on my server for this type (about 30-40GB).
- "Use GetRight HTTP seeding specification: FTP/HTTP URL of file or directory, e.g. http://yourwebsite.com/file.zip" -> this everybody can use.

Bump! Nobody interested?

This is a GREAT idea!
You should discreetly pm some developers, as they probably haven't seen the thread

I'm with this. Just hang in there till word gets around about it. You've built it, now they will come

Of 'course people are interested. YOU DA MAN!
No Sieriously - Thanks so much.

thumbs up
Great idea

any torrent i create i just copy and paste a list of about 30 known working trackers into the settings of create torrent, works like a charm, no password bull, create & start seeding, put the .torrent up on forum or PM out... dont know why this would be needed....
http://inferno.demonoid.com:3416/announce
http://tracker2.istole.it:6969/announce
http://www.h33t.com:3310/announce
http://tracker.istole.it:80/announce
http://exodus.1337x.org/announce
http://nemesis.1337x.org/announce
http://genesis.1337x.org:1337/announce
http://tracker.publicbt.com/announce
http://tracker.openbittorrent.com/announce
http://tracker.torrentbay.to:6969/announce
http://cpleft.com:2710/announce
http://h33t.com:3310/announce
http://papaja.v2v.cc:6970/announce
http://tracker.desi6.com:7979/3paz2gybgymgo6aub7e9d3u15784ubfx/announce
http://tracker.packy.se:2710/announce
http://dttracker.debian.net:6969/announce
http://tracker.torrent.to:2710/announce
http://tracker.bitreactor.to:2710/announce
http://tracker.ccc.de/announce
http://umunu.com:1984/announce
http://opentracker.umunu.com:80/announce
http://p2p.lineage2.com.cn:6969/announce
http://PhoenixRG.no-ip.org:2710/announce
http://gdbt.3322.org:6969/announce
http://star-tw.no-ip.org/announce.php
http://exodus.desync.com:6969/announce
http://222.171.190.184:7000/announce
http://scene-project.com/announce.php
Click to expand...
Click to collapse

Really cool idea. Will use it for my firmwares.

This is a great idea
This is a bloody good idea! I wish more of the ROM dev's would use it.

Eh not being a negative nancy but I thought mods already decided against using torrents for roms there's a thread in the about xda section for it
Sent from my SCH-I400 using XDA App

Bierce22 said:
Eh not being a negative nancy but I thought mods already decided against using torrents for roms there's a thread in the about xda section for it
Click to expand...
Click to collapse
Torrents have a bad rap because of their association with...unsavory material, but the torrent protocol itself is actually a very efficient way of distributing large files to large numbers of people. Just look at big linux distro releases, ubuntu especially. It is simply a data transmission technology just like email, FTP, or HTTP in that they can be used to transfer files.
I for one would love to donate some of my bandwidth and seed things for XDA, at the very least everything I download and use if not setting up a seedbox.
Hopefully XDA seriously considers embracing torrents and encourages devs to upload to and users to seed on the official tracker in addition to the current methods (for n00bs or those who don't want to set up a torrent client). I'm sure everyone would appreciate not having to negotiate the megaupload-style sites with ads (and what about their uploaded content licensing?) only to get throttled bandwidth.

Sorry to say but the link to dl the app/prog is broken? Cheers

THis thread is 3 years old. XDA has it's own use of torrents through the DevDB projects.

Why not use torrents?

I've been noticing that most of you developers use file hosts for your ROMs. Yes that's quite reliable, but sometimes speeds are horribly slow.. One day I've noticed people will be maxing their speed, then another they will be going super slow.. Like downloading 100kb a sec instead of like 1.8mb (1.8 is the max download speed with 15mbs Internet for example).
Though a little less reliable, there's torrents you guys could set up.. With the mass amount of supporters, seeding is another way to support your ROMs, and when you got seeders, you can max out your speed always. If there's some big specific reason you guys don't, I would understand lol.
Sometimes, 2 or 3 seeders is all you need.

Mainly because I do not like my computer sitting there linked to a torrent site when there main use is for piracy. Many sites have been blocked by Homeland Security just to have to open a new site. I prefer my IP address not be sitting there when these things happen. File hosting is the safest means and there are many free ones available so several mirrors can be put up.

kennyglass123 said:
Mainly because I do not like my computer sitting there linked to a torrent site when there main use is for piracy. Many sites have been blocked by Homeland Security just to have to open a new site. I prefer my IP address not be sitting there when these things happen. File hosting is the safest means and there are many free ones available so several mirrors can be put up.
Click to expand...
Click to collapse
There are non-piracy bittorrent trackers out there. Additionally it isn't that hard to set one up.
ReapersDeath said:
I've been noticing that most of you developers use file hosts for your ROMs. Yes that's quite reliable, but sometimes speeds are horribly slow.. One day I've noticed people will be maxing their speed, then another they will be going super slow.. Like downloading 100kb a sec instead of like 1.8mb (1.8 is the max download speed with 15mbs Internet for example).
Though a little less reliable, there's torrents you guys could set up.. With the mass amount of supporters, seeding is another way to support your ROMs, and when you got seeders, you can max out your speed always. If there's some big specific reason you guys don't, I would understand lol.
Sometimes, 2 or 3 seeders is all you need.
Click to expand...
Click to collapse
Better yet, newer clients support "web seeds" which allow the client to download over HTTP in addition to anything it can get from the swarm. In the worst case scenario (no peers) the user will still be able to complete the download. Also, Cyanogenmod already offers torrents at get.cm.

harpdarp said:
There are non-piracy bittorrent trackers out there. Additionally it isn't that hard to set one up.
Better yet, newer clients support "web seeds" which allow the client to download over HTTP in addition to anything it can get from the swarm. In the worst case scenario (no peers) the user will still be able to complete the download. Also, Cyanogenmod already offers torrents at get.cm.
Click to expand...
Click to collapse
Then what is needed is a thread explaining how to set this up and with which free safe sites. It is more common knowledge on setting up a dev-host or androidfilehost account and just upload then to set up bittorrent trackers.
Friendly Neighborhood Moderator

kennyglass123 said:
Then what is needed is a thread explaining how to set this up and with which free safe sites. It is more common knowledge on setting up a dev-host or androidfilehost account and just upload then to set up bittorrent trackers.
Friendly Neighborhood Moderator
Click to expand...
Click to collapse
Not all are for piracy. Not to mention that should be coming to a halt soon. Apparently several Internet providers signed a contract about a 6 strike thing. The government refused to make it a law, but anyways, downloading ILLEGAL pirated torrents will now result in strikes. You will be warned in the mail. First 3 are warnings and then the last 3 are bad news. If you hit 6 total, your Internet is slowed to a crawl. (my friends deep in the torrent community). Anyways, there's a couple different sides of torrents.. The piracy side, and then the actual file sharing side.. As you guys are the owners and makers of the ROMs, you can share them as you feel, ie, the original purpose of torrents. Bittorrent is quite nice Imo. I'll post some info on how to do some of this stuff.
And also, if you own a sever, you could have the server seed or host the torrent instead of using your bandwidth.
I mainly only brought this up because dev host is some times so slow that it could take like 3 hours sometimes..
Sent from my SPH-L710 using xda app-developers app

i have to agree with this. torrents are just easier, and much faster. file hosting, i'm sitting there waiting an hour or 4 sometimes, depending on the hosting site, while i'm downloading a torrent at 800kb/sec. Torrents have a stereotype, but we need to stop the hate!

ou2mame said:
i have to agree with this. torrents are just easier, and much faster. file hosting, i'm sitting there waiting an hour or 4 sometimes, depending on the hosting site, while i'm downloading a torrent at 800kb/sec. Torrents have a stereotype, but we need to stop the hate!
Click to expand...
Click to collapse
Lol with most torrents i get 1.8mb a second of download speed XD takes like 5-10 mins depending.
Sadly, i only know the basics of setting up a torrent. Just open bittorrent and click create torrent, select the file, then check the box saying seed, then distribute the torrent file. People just click it, it opens a torrent program, downloads, and then automatically seeds unless cancelled. Just need to ask people to seed to show support.
so in the end, 100kb/s or 1.8MB/s? (18 just an example of some peoples max)

The issue with torrents is that not everyone knows how to setup a client and use it. There's other stuff that can complicate things too. If port forwarding isn't setup speeds can be sub-par. Also some ISPs heavily throttle bittorrent traffic regardless of its content.
Personally, ROM torrents sound like a good idea. Popular ROMs would distribute quickly on the week of release since there would be hundreds of seeds, whereas something like devhost would be slower than a snail.

There is a another downside to peer-to-peer. Viruses. Not everyone is diligent and you don't know where those computers have been.

jdelano said:
There is a another downside to peer-to-peer. Viruses. Not everyone is diligent and you don't know where those computers have been.
Click to expand...
Click to collapse
Like sleeping with that really hot chic that has herpes, cuz she didn't have an outbreak at the time. If she's too hot to be putting out on the first date, run!
I like to break stuff!

[Suggestion to Admins] Centralized torrent hub for Roms downloads.

Dear Admins,
I am writing to you on behalf of many users from Countries with slow and unreliable internet connections.
I'm having slow internet connection and the download stops mid way while downloading roms of 1GB+ sizes. What a frustrating waste of time and bandwidth!!
There are many people like me who are victims of these 1 GB+ sized roms. We want to try out these roms just as much as anybody else, but its really kills us to wait for 4 to 5 hours for the downlaod and then see it abort half way without a resume support. I want to reach out to Sr Devs and admins to switch to a resume supported file-hosts or something like torrents where all devs could create and upload their rom torrents. Downloading from torrent is much more convenient since there is a resume support.
If this is not the right section, please move the thread accordingly.
Thank you.

in actuall the roms are not of this much bigger size,,, but ur option seems to be gud :good:

I agree with you, sometimes downloads are quite long. the advantage of torrents is to download at any time, with no lost connection.

We actually include a torrent option for those who use the XDA Download system for their DevDB projects.

I think the reason why developers use their own option is so they can track the downloads of their rom.
I'm not sure if it is, but if it is possible in the centralized torrent hub, maybe the developers would definitely use it.
if it is possible, maybe the developers don't know bout this service and we need to get the word out there