Hi Chris, I'm looking into it generation it without FTPing, but as the FTP system is well and truly wrapped in to it, im not sure how hard this is going to be, as about 90% of the code will need changing.

The robots TXT, I personally dont think the Mambots folder need excluding to be honest. The spider will only visit links and pages that are linked from other pages, and i dont think there are any links to anything in there. Ill see if i can also modify it to export the XML into a root folder, this may correct this issue.

I have to say though at the moment, i have major amounts of work on, we are launching a new system as i type, developing a secret new Froogle system that will be launched in 2 months time, and i have 4 clients websites to go live by the end of this week. So i probably cant do this straight away.

Regards
Ian