endorsedCompleted

A/B Testing System for Online Marketplace

Services Covered:

Custom Software Development

Industry

Advertising & Marketing

Duration

10 months

Budget

200K - 999K

Start Date

1 June 2014

Team Size

Confidential

Engagement Model

Onshore

Project Capability Score (PCS)

68/100

Good

Project Capability Score (PCS) estimates how capable AgileEngine is of successfully delivering a project like this, based on its past experience, track record, and ability to handle similar work. Learn more about PCS

Client

LivingSocial

Washington, United States of America

Project Summary

AgileEngine provided development services to build an A/B testing engine usable across consumer web and native mobile applications, handling response-time and concurrency requirements. They collaborated with the client's internal developers on requirements and delivered a functioning solution despite communication and staffing fluctuations. The reviewer noted strong leadership from the vendor's CEO and satisfactory overall results.

Key Challenges

Improve A/B testing across web and native mobile applications
Meet response-time and concurrency/load-handling requirements
Replace or improve on prior unsatisfactory engagements with outside consultants

Project Deliverables

A/B testing engine
Standard API endpoint
Scala backend application

Project Solution

AgileEngine collaborated with the client’s internal development team to gather requirements and performed most of the development for a new A/B testing engine. They implemented a standard API interface and built the backend in Scala to meet response-time and concurrency goals. They adjusted schedules to accommodate timezone differences and worked through communication and staffing challenges to deliver the agreed solution.

Project Outcome

Delivered a solid A/B testing solution that met the project's specifications
Overcame communication and staffing challenges to complete delivery
Impact on business and measurable ROI were not observed by the reviewer

Platforms

Web
Mobile

Tech Stack

Scala
Ruby on Rails
REST API

Client Endorsement

Overall Review Rating

4.38

Timeliness

Cost Rating

Willing to Refer

Quality of Deliverables

“AgileEngine built a quality product, overcoming communication challenges and several fluctuations in staff. Their CEO’s strong leadership and desire to exceed expectations helps them stand out among other vendors, although clearly defining project ownership is recommended for future endeavors.”
Doug Ramsay
Former Director of Engineering
Date: 07/21/2017