endorsedCompleted

Market Research for Media Monitoring Business

Services Covered:

Web Scraping Services

Industry

Arts, Entertainment & Recreation

Duration

4 months

Budget

10K - 49K

Start Date

1 August 2016

Team Size

Confidential

Engagement Model

Nearshore

Project Capability Score (PCS)

67/100

Good

Project Capability Score (PCS) estimates how capable Wiser Technology is of successfully delivering a project like this, based on its past experience, track record, and ability to handle similar work. Learn more about PCS

Client

My Market Insight

London, United Kingdom

Project Summary

Bianor built an automated web data extraction and scraping solution for a media-monitoring business, delivering project management, design, specifications, and an implemented extraction tool. The vendor implemented a website scraping tool using Symfony and RabbitMQ and designed the pipeline with Docker. The client reported ~50,000 URLs scraped in the first months, praised communication, and said timelines were met.

Key Challenges

Automate the gathering of information from the web

Project Deliverables

Website scraping tool
Data extraction tool
Project management design and specifications

Project Solution

Bianor managed project design, specification, and implementation to build a website scraping tool and a complementary data extraction pipeline. The implementation used Symfony and RabbitMQ and was containerized/designed to run with Docker. The vendor delivered the scraping engine and text-extraction algorithms to automate collection of relevant site content.

Project Outcome

Scraped around 50,000 URLs in the first couple of months
Designed to handle ten times this number of processes
Algorithmic data extraction saved many hours of manual configuration
Communication was timely and deadlines were met

Platforms

Tech Stack

Symfony Framework
RabbitMQ

Client Endorsement

Overall Review Rating

4.25

Timeliness

Cost Rating

Willing to Refer

Quality of Deliverables

“The client feels their expectations have been met so far with regard to the amount of data that has been collected. They were impressed with Bianor's ability to communicate thoroughly and that all their timelines were met.”
Simon Westgarth
Client Operations Director
Date: 02/07/2017