endorsedOngoing

Data Scraping and SQL Database Development for Machine Learning Company

Services Covered:

Big Data Analytics and Business Intelligence • Custom Software Development • Website Development

Industry

Artificial Intelligence and Machine Learning

Duration

76 months

Budget

10K - 49K

Start Date

1 April 2020

Team Size

Confidential

Engagement Model

Offshore

Project Capability Score (PCS)

74/100

Good

Project Capability Score (PCS) estimates how capable Algoscale Technologies is of successfully delivering a project like this, based on its past experience, track record, and ability to handle similar work. Learn more about PCS

Client

Perceptronix Ltd

United Kingdom

Project Summary

Algoscale built Python applications to scrape structured and unstructured financial-market data, designed normalized SQL (MariaDB) storage and transformation layers, and developed data-visualization scripts to reveal statistical relationships for a machine-learning firm. The vendor also produced training materials. The client praised the quality of data, robust storage, insightful visualizations, and responsive remote communication.

Key Challenges

Develop versatile and fully normalised SQL database architectures and applications
Create a data visualisation tool to reveal statistical relationships between features and target classes
Scrape structured and unstructured web data about financial markets of interest

Project Deliverables

Python applications to scrape structured and unstructured web data
SQL database applications (MariaDB) and normalized SQL architectures
Data transformation routines to make scraped data compatible with legacy systems
Data visualization scripts to reveal statistical properties of features
Training materials for the delivered applications

Project Solution

Built Python applications to scrape structured and unstructured web data and transform it for legacy-system parsing; designed and developed normalized SQL database architectures and applications in MariaDB; implemented data-visualization scripts to reveal statistical relationships between features and target classes; and produced training materials for the delivered tools.

Project Outcome

Quality and usability of scraped data
Robust storage of scraped data in SQL database with ability to extract data using sophisticated queries
Insightful visualisation and numerical evaluation of features for in-sample and out-sample datasets
Well-structured project management and timely progress checks; flexible and professional communication

Platforms

Tech Stack

Python
MariaDB
SQL

Client Endorsement

Overall Review Rating

Timeliness

Cost Rating

Willing to Refer

Quality of Deliverables

“Algoscale Technologies, Inc. has delivered high-quality data, insightful visualization, and robust storage. They have communicated remotely and responded promptly, ensuring an effective workflow. Their proactive approach and excellent flexibility have been hallmarks of their work.”
Anonymous
Executive
Date: 03/27/2023