My client is a large insurance company committed to enhancing business intelligence and data capabilities across existing enterprises. As they embark on their ambitious BI modernization project, they are now seeking a talented and experienced Data Engineer to join a growing team.
The role will be working with cutting-edge technologies and a team of dedicated professionals focused on making a real impact to drive innovation and improvement across existing data landscape.
Responsibilities of the Role:
Manage and Administer the Cloud Data Platform
Maintain existing data pipelines across various projects, ensuring they are efficient and sustainable.
Optimize data ingestion and curation layers to enhance performance and scalability.
Review and improve database models and architecture as needed.
Innovate the data platform by suggesting and implementing improvements in operationalization, DevOps, and security, including the development, and testing of Proof of Concept (PoC).
Provision necessary components in both Azure and non-Azure environments.
Data Pipeline Development and Guidance
Provide expertise in the development of new data pipelines and ingestion processes for diverse projects.
Offer strategic guidance and possibly build data pipelines tailored for analytics use cases or data science projects.
Required Skills for the Role:
Degree in Computer Science, software engineer or related fields
Minimum of 5 years of experience in a Data Engineer role, with hands-on exposure to cloud or on-premises tools.
At least 1 year of practical experience with Databricks, including:
Workspace configuration.
Cluster optimization.
Proficiency in Python and SQL.
Knowledge of data ingestion from traditional databases, data lakes, and APIs.
Familiarity with Azure technologies (e.g., SQL Server DB, Storage Account, Logic Apps) is highly preferred.
Strong background in building data platforms or data warehouses, with a focus on data modeling
Excellent communication skills in English, both written and verbal.
Please send your resume highlighting your relevant experience to mary.delfin@ecmanagedsolutions.com
