Helping RSAC, a Fortune 500 manufacturing company take the Data to Insight leap

Manage and process your big data workflows with Airflow and Amazon EMR

Highlights

98%

of time potentially reduction

15 minutes

of Infrastructure deployment process reduced ETL

30 minutes

of processing reduced

Quick report generation

Scaled and reduced latency of ADHOC ETL processing requests

Client Profile

Reliance Steel and Aluminum Company (RSAC) is North America’s largest metals service center company, offering 100,000+ products and value-added processing and serving over 125,000 customers primarily by providing metals processing, inventory management services, and quick delivery.

Business challenges

Reliance Steel and Aluminum Company (RSAC), a Fortune 500 metal services provider in North America holds 60 companies under its umbrella. Each of these businesses operated independently of each other with their own unique processes and on-premise technology setup. All data was siloed, and the company had no way of analyzing it to derive insights. This lack of insight to make data driven decisions impacted multiple aspects of their business – from supply chain and sales optimizations to vendor and inventory management. The business needed to be more responsive and become a data driven company.

Agilisium was hand-picked by AWS for our competency in helping organizations take the Data-to-Insight leap. As consultants, we provided a multi part solution that would onboard RSAC’s disparate on-premise data sources and systems into a Consolidated Enterprise Data Warehouse (CEDW). With this move up the information maturity curve, RSAC could then enable and accelerate strategic data initiatives, product development, and R&D.

Agilisium Solution

Enabling arobust technical foundation on cloud using DevOps

AUTOMATEDIAAS

IaaS was split into 4 broad categories like microservices. The setup aspects were automated via CloudFormation Templates with an emphasis on fail safe environment.

‍CI/CDPIPELINE

Cost effective open source tools were used to automate the CI/CD pipeline, drastically cutting time to market.

AUTOSCALE OUT ENVIRONMENT

Architecture incorporated AWS Autoscaling for EC2 instances and CloudWatch to ensure a reliable and scalable environment whatever the load.

STANDARDIZEDPROCESS

All Cloud Formation templates configured into an Ansible playbook for ease of use for end user.

Tech-stacks Used

AWS – S3

AWS EMR

AWS Aurora

AWS cloudTrails

AWS Cloudwatch

AWS SNS

AWS IAM

Airflow

Gitlab

Python

Business outcome

Infrastructure employment process reduced to 15 minutes, potentially reduction of 98% time when compared to manual deployment.
Faster ETL job deploy and execution process via CI/CD.
Increased productivity as developers can now focus on core jobs
DevOps culture encourages collaboration &eliminates silos..