0

I'd like to scan all the url's on my website as well as get the files in them, but the thing is, there are too many for me to do this manually so how would I do this?

I'd like it formatted anyway as long as there is some type of order to it.

Eg: URL/FOLDER URL/FOLDER/FILE URL/FOLDER/FILE2 URL/FOLDER2/FILE

All in a file like a .txt

How would I do that?

1
  • 1
    What about wget, find, ls? Dec 27, 2012 at 8:21

1 Answer 1

2

Try ls passing the -R switch. It lists subdirectories. Here is an example:

ls -R /path/to/whatever > folders.txt 
1
  • Sorry, its kinda late. But that was perfect. I was busy fixing everything.
    – user151015
    Jan 23, 2013 at 0:07

You must log in to answer this question.