I ask myself if anybody has some experience with this here?
I have to programme a task were I login with an AC read 3 values, logoff the HP and go to the next AC.
The results(values) should be saved in an ods. I would love to use a webcrawler instead of an macro.
Maybe I'm to focus using gecko but I don't find really an "how to" for starting.
Progamming a webcrawler
Progamming a webcrawler
Jack-of-all-trades, but master-of-only of a few
My Reps:
https://github.com/BlubBlab/Micromacro-with-OpenCV (My version of MM2 with OpenCV and for MS Visual Studio)
https://github.com/BlubBlab/rom-bot (rombot with no stop WP and advanced human emulation mode and some other extensions)
https://github.com/BlubBlab/Micromacro-2-Bot-Framework ( A work in progress )
My Tools : viewtopic.php?f=10&t=6226
My Reps:
https://github.com/BlubBlab/Micromacro-with-OpenCV (My version of MM2 with OpenCV and for MS Visual Studio)
https://github.com/BlubBlab/rom-bot (rombot with no stop WP and advanced human emulation mode and some other extensions)
https://github.com/BlubBlab/Micromacro-2-Bot-Framework ( A work in progress )
My Tools : viewtopic.php?f=10&t=6226
- Administrator
- Site Admin
- Posts: 5312
- Joined: Sat Jan 05, 2008 4:21 pm
Re: Progamming a webcrawler
I've done it with MicroMacro using a cURL addon, as well as from straight C/C++. Now with MicroMacro 2, you can do it without any additional addons as long as you're willing to learn a bit about how the sockets work and research the HTTP protocol. Looking at the IRC bot code I provided should be of some use. You should also be aware that it doesn't support HTTPS (yet), and will have to figure out how to handle cookies upon request.
Basically all you do is post a command to the server to fetch a specific page, and then read the content it sends back. Parse out what you need using regex.
Basically all you do is post a command to the server to fetch a specific page, and then read the content it sends back. Parse out what you need using regex.
Re: Progamming a webcrawler
Thanks but I ended up using this : http://watin.org/
Jack-of-all-trades, but master-of-only of a few
My Reps:
https://github.com/BlubBlab/Micromacro-with-OpenCV (My version of MM2 with OpenCV and for MS Visual Studio)
https://github.com/BlubBlab/rom-bot (rombot with no stop WP and advanced human emulation mode and some other extensions)
https://github.com/BlubBlab/Micromacro-2-Bot-Framework ( A work in progress )
My Tools : viewtopic.php?f=10&t=6226
My Reps:
https://github.com/BlubBlab/Micromacro-with-OpenCV (My version of MM2 with OpenCV and for MS Visual Studio)
https://github.com/BlubBlab/rom-bot (rombot with no stop WP and advanced human emulation mode and some other extensions)
https://github.com/BlubBlab/Micromacro-2-Bot-Framework ( A work in progress )
My Tools : viewtopic.php?f=10&t=6226
Who is online
Users browsing this forum: No registered users and 3 guests