endorsedCompleted

Python Data Crawler & Data Extraction for Marketing Agency

Services Covered:

Custom Software Development • AI and Machine Learning

Industry

Advertising & Marketing

Duration

7 months

Budget

10K - 49K

Start Date

1 November 2019

Team Size

1-5 Employees

Engagement Model

Onshore

Project Capability Score (PCS)

70/100

Good

Project Capability Score (PCS) estimates how capable Dataeaze Systems is of successfully delivering a project like this, based on its past experience, track record, and ability to handle similar work. Learn more about PCS

Client

Confidential

New Delhi, India

Project Summary

A marketing company hired Dataeaze Systems to build a Python-based data crawler to scrape portals, extract information, and store the results in a MongoDB backend. The vendor used UML tools to extract intelligence from the data and provided architecture and development support led by an architect and project manager. The engagement was completed in June 2020 and continues as an ongoing maintenance relationship; the client rated the deliverables positively and highlighted strong communication and technical expertise.

Key Challenges

Build a data crawler to scrape multiple portals and extract structured information
Process scraped raw data and run AI libraries to generate insights

Project Deliverables

Python-based data crawler to scrape websites and extract information
Backend database implemented in MongoDB to store scraped data
UML-based data extraction/processing to derive intelligence from raw data

Project Solution

Dataeaze developed a Python-based data crawler to scrape websites and portals and implemented a MongoDB backend to store the extracted data. They used UML tools to extract information and intelligence from the stored data. The engagement was research- and R&D-heavy and involved an architect and project manager with a small development team; post-delivery maintenance and incremental updates (additional sites and AI libraries) have continued.

Project Outcome

Client rated the quality of work four out of five
Ongoing expansion of the system with additional sites and more AI libraries
Strong communication and understanding of tools from the vendor

Platforms

Tech Stack

Python
MongoDB

Client Endorsement

Overall Review Rating

4.5

Timeliness

Cost Rating

Willing to Refer

Quality of Deliverables

“The team at Dataeaze Systems met expectations. They provide a quality service within budget. Their skilled expertise makes them stand out from other providers. Their communication style is also noteworthy.”
Anonymous
Founder
Date: 01/26/2021