-2

if I do a wget on BBC RSS it works fine:

wget http://feeds.bbci.co.uk/news/world/rss.xml

But if I do that with times, I get a 403 forbidden error:

wget http://www.thetimes.co.uk/tto/news/rss

Even though this is meant to be the correct rss: http://www.thetimes.co.uk/tto/newsrss/?service=rss

What am I missing please?

closed as off-topic by Khaled, MadHatter, masegaloeh, Dave M, kasperd May 14 '15 at 12:00

This question appears to be off-topic. The users who voted to close gave this specific reason:

  • "Questions on Server Fault must be about managing information technology systems in a business environment. Home and end-user computing questions may be asked on Super User, and questions about development, testing and development tools may be asked on Stack Overflow." – Khaled, MadHatter, masegaloeh, Dave M, kasperd
If this question can be reworded to fit the rules in the help center, please edit the question.

  • 2
    Downvoting without comment is useless. What do you want me to change? I can't see into your head. – Houman May 14 '15 at 10:15
2

In most cases, supplying wget with a user agent will resolve errors such as 403 forbidden:

wget -U "Mozilla" http://www.thetimes.co.uk/tto/news/rss

This worked for me.

0

The request may be failing because the Times is filtering based upon the provided user agent.

To change your user agent to impersonate Firefox on OSX, try this:

wget --header="Accept: text/html" --user-agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:21.0) Gecko/20100101 Firefox/21.0" http://www.thetimes.co.uk/tto/news/rss

  • Although the code is appreciated, it should always have an accompanying explanation. This doesn't have to be long but it is expected. – peterh May 14 '15 at 13:16

Not the answer you're looking for? Browse other questions tagged or ask your own question.