solutions in a production environment Proven expertise in big data processing field: Spark, Delta Lake (or equivalent... customers to centralize and standardize their customer data and content across the enterprise powering 360-degree customer...
with you. About the Role: The data engineering team is on a mission to create a hyper scale data lake, which helps find bad actors... hunting. As a senior engineer on the team, you will contribute to the full spectrum of our systems, from foundational...
at scale? We’re looking for a passionate Senior Data Platform & Cloud Engineer to join our high-impact, fast-moving Data...: Cloud & Data Services: AWS (S3, Glue, Lake Formation, Lambda, Redshift, Step Functions, IAM, VPC) IaC Mastery: AWS CDK...
and optimizing the Medallion architecture (Bronze, Silver, Gold) using Delta Lake to ensure data quality, consistency, and historical... from DWH and Data Lake. Performance Optimization: Optimize Databricks clusters, Spark operations, and Delta tables (e.g...
in software development, data management, non-financial risk & compliance, audit, and retail operations to 24 ING units worldwide... as operating and file transfer system for the incoming/outgoing data files Maintain the applications running in our Data Lake...