We have a website idea that is related with some specific files. What we will do is to crawl all the web and fetch some specific files, and as you guess, host them in CDNs. Some of the files could be copyrighted materials as there are a lot of open websites that host copyrighted materials. We may have 40-50 thousands copyrighted materials out of 1 million files. If we get any complaints, we'll remove the material in one business day.
However, do you think in the meantime CDNs may delete all of our files? As you may know, if you host copyrighted materials, a lot of companies make their complaints directly to the datacenters which host these files to create additional pressure on the owner. And sometimes datacenters shut down the servers without giving any notice. We will be a fully legitimate business but it is practically impossible to detect copyrighted materials.
This project is still an idea, however we would like to foresee the potential problems. What do you think? Is it just better off to create our own storage solution?
edit: I guess I could not make it clear. It is %100 same as google or yahoo or bing. We just will be a focused search engine. Google has already indexed those type of documents. So there is no problem with that. However, my question was, google is removing those type of documents if they get complaints, but they have no efforts or whatsoever to prevent indexing the documents, because it is practically impossible for google too. The main point is, google is a giant so they have no problems with that. However, small companies may have troubles. If we work with local datacenters in Europe, we will have zero problems, as we already have excellent relationships with them (we rent hundreds of servers time to time for different projects) However, we do not have any relationship with any CDNs as we did not attempt to have a global project. Anyway, I guess it is more clear now.
Thanks,