Growth / UK / Consumer Electronics
Broadening performance insights with web scraping
"Our solution allowed the client to benefit from enhanced automation capabilities, providing them with timely insights without the risk of human error."
Business issue
A multinational consumer electronics company were looking for a solution which would enhance their understanding of the performance of their own, and their competitor’s products, across a number of eCommerce retailer sites across the world.
They wanted a solution which would provide refreshed data on a regular cadence to ensure they had up-to-date information.
They needed an all-encompassing solution which provided insights around customer reviews, ratings, out of stock percentage price, on-site search ranking and share of voice.
Our solution
We developed a solution which involved creating multiple Python scripts that could extract the relevant information from numerous eCommerce sites in parallel.
This scraped data, alongside additional third-party data, was then inputted directly into Excel, and stored in the cloud using Microsoft Azure.
By leveraging Azure Data Factory, the team then created pipelines which transferred the data from Azure to SQL, enabling us to clean and transform the data into a format which was ‘dashboard-ready’.
For more information on this case study, get in touch here.
