Migrating Data & Analytics to the Cloud | Government Data Leaders Forum
Analytics Institute Government Data Leaders Forum as designed to bring together leaders in the data & analytics sector to address challenges and opportunities unique to the public sector.
Join us for our upcoming Government Data Leaders Forum taking place on March 14th from 9:30-10:45am in Central Bank, New Wapping Street, North Wall Quay, Dublin 1, D01 F7X3
Our Government Data Leaders are often faced with the challenge of managing data estates that are growing ever larger and more complex – while providing greater increased agility and flexibility for the data analysts, data scientists, and data consumers that depend on the data.
As the level of ambition of analytics teams and the expectations of consumers increase, and more advanced reporting, analytics, machine learning, artificial intelligence and Generative AI solutions are developed, the cloud has the potential to unlock business value and enable data driven transformation – but we need to adopt an appropriate cloud data architecture, and manage the migration effectively.
Edward Kelly, Enterprise Account Executive, Databricks
Robert Whiffin, Solutions Architect, Databricks
Berny Purcell, Senior Analyst - Central Bank
Here in the Central Bank, we are in the very early stages of migrating from our existing on premise Data & Analytics platform to the cloud. Over the last couple of years, we have developed an Analytics Technology Strategy that sets out a target architecture for data & analytics in Azure, and completed a Data Analytics Pilot to validate the architecture. We are currently completing a Big Data POC where we migrate a large dataset from a relational database (SQL Server) on premise to a Data Lakehouse (Databricks) in the cloud to measure the actual level of performance and scalability we can expect, and get an idea of the likely costs of operating in the cloud. This information will then be used to inform our roadmap and timelines for migration.
At this session, we would like to present on some of the specific data challenges we’ve encountered, how we expect our cloud data & analytics platform to address them, and what we’re seeing so far in terms of evaluating the target cloud technologies, particularly the Databricks Data Lakehouse. (The session will be held in conjunction with our implementation partner Databricks).
We are hoping to initiate an open conversation around the data challenges that exist in the public sector and how we can collaborate and share knowledge to overcome them.