Website Crawler Spider Nov 13, 2008
We need a system that will automatically search on many tender / Request For Proposal websites
The system must be able to
- determine last time/date the system executed. If it executed more than 24 hours ago, execute those tasks:
- for each website to search:
1 - automatically open a session on the website
2 - search for particular keywords in tenders titles
3 - search for particular keywords in tenders detailed description
4 - search for particular companies who have ordered tender documents
5 - send an email when results have been found
6 - When available on the website, change language on website to french and perform operations 1 to 5 again
- A config file must contain the following parameters:
- username password (one for each website searched)
- keywords to search in titles (one set in english and one set in french)
- keywords to search in companies who have ordered tender documents
- email address to send retults
The keywords should accept most regular expressions, for example: software -java
For debugging purposes, an email must be sent everytime the software executed a search, with a log of the searched tenders.
The tool must me modular:
In the first phase, the tool will search on only one website. On next phase, we will add a module to search on other websites.
We know that some tools for performing this knid of work already exist and using them would be a plus.
The first website we want to search is merx dot com
To present a service offer, the following information MUST be included:
- Demonstrate past experience on at least one similar project. Expain what were your tasks.
- Time and cost estimate. We want to offer a fixed cost project.
- A payment schedule showing the deliverables and the payment associated with it. We will need to see tangible work to issue a payment.
- Contact information
- Programming language and development environment/tools that will be used (Will un on Windows XP)
- If possible, include link when we can see the system working
*** Please do not apply if you do not meet the requirements *** We always receive generic applications no demonstrating relevent experience.
Generic application emails will not be accepted. You must demonstrate previous experience on a similar project.
Please don’t waste our time. Thanks.
Thank you and good luck!
Place bid
Email This Project





