Sometimes, when you search in google for something, you find very nice results but when you visit those sites, they seem to be protected i.e; you need to either sign-up or maybe you need to pay for it. So, here’s a way to get access to it without paying or even signing up.
Mostly people want their exclusive content to be protected. Since it is exclusive, they would want people to know about it so that more people join the site. That is why they let search engines to access their protected content so that it gets listed in their results and site gets traffic for that. Now search engines are similar to people. Websites only have one way to differentiate between them – User agents. All the search engines have user agents which makes them differentiate from humans.
As we all know, Google is the greatest and largest search engine (hope Bing will capture the market too).
Its user-agent is “Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)”.
With this information, we can get access to protected sites which is freely available only to search engines.
We need Mozilla Firefox for the purpose. Download it from here if you don’t have it.
Now, get this user agent switcher addon for firefox:
https://addons.mozilla.org/en-US/firefox/addon/59
Now, download this file:
http://www.techmindz.com/useragents.xml
Now, import the user-agent strings into the add-on by:
In Mozilla Firefox:
Tools -> User Agent Switcher -> Options -> Options -> User agents -> Import
Select the file you just downloaded.
When accessing the protected site, goto Tools -> User agent switcher -> Googlebot 2.1 (New Version)
You will get access to its contents.
Any queries will be answered here.
Regards