Consolidating data sources
Reliance Steel and Aluminum Company (RSAC), a Fortune 500 metal services provider in North America holds 60 companies under its umbrella. Each of these businesses operated independently of each other with their own unique processes and on-premise technology setup. All data was siloed, and the company had no way of analyzing it to derive insights. This lack of insight to make data driven decisions impacted multiple aspects of their business – from supply chain and sales optimizations to vendor and inventory management. The business needed to be more responsive and become a data driven company.
Agilisium was hand-picked by AWS for our competency in helping organizations take the Data-to-Insight leap. As consultants, we provided a multi part solution that would onboard RSAC’s disparate on-premise data sources and systems into a Consolidated Enterprise Data Warehouse (CEDW). With this move up the information maturity curve, RSAC could then enable and accelerate strategic data initiatives, product development, and R&D.
Enabling a robust technical foundation on cloud using DevOps
On-premise to cloud data migration done via traditional migration methods can be complex and time consuming.
Very early in the consulting process, Agilisium recommended a DevOps based approach to implement this multi-part project. The heart of the solution was a unified cloud information architecture model. This model would act as the foundation on which data from all 60 umbrella companies would be consolidated into a CEDW. 30 of the 60 companies’ data were unified as part of Phase one.
All migration of data sources was done via the DevOps approach – primarily through aggressive automation. The resulting ease of infrastructure setup and ETL Pipeline deployment, ensured a scalable and reliable cloud environment needed for future developments.
IaaS was split into 4 broad categories like microservices. The setup aspects were automated via Cloud Formation Templates with an emphasis on fail safe environment.
Cost effective open source tools were used to automate the CI/CD pipeline, drastically cutting time to market.
Auto scale out environment
Architecture incorporated AWS Autoscaling for EC2 instances and CloudWatch to ensure a reliable and scalable environment whatever the load.
All Cloud Formation templates configured into an Ansible playbook for ease of use for end user.
Aggressive automation accelerates cloud migration
Robust, reusable, secure cloud architecture and implementation of streamlined workflows and processes via DevOps has created an agile, data driven organization ready to be responsive, optimize and scale rapidly.
- 98% potential reduction in Time to Market (TTM) due to DevOps enabling IaaS automation
- Faster ETL job deploy and execution process via CI/CD.
- Increased productivity as developers can now focus on core jobs
- Collaborative Environment due to DevOps process adoption.