I want the following:
1) Sign in using Internet Explorer
2) Ask for my software that uses the WinInet API to crawl the site, reuses the same cookies / session (i.e., so that the crawler "logged in")
I tried to create a login myself using INDY, and while session cookies work well, many websites use a more sophisticated login mechanism, which currently combines the client and server side components for the initial login.
...
I suppose, for example, WordPress, ASP.Net, etc. It uses client-side / AJAX material, as well as hash / time / user code / verification codes, etc. that I can send accurate HTTP headers 30 seconds after my own crawler program, for example. FireFox is used during login, but this will not work.
(Compare this to regular session cookie-based inputs, where my own crawler will connect normally.)
source
share