pipelines and implementing robust data governance strategies using Unity Catalog. Key Responsibilities: Design and implement ETL... control, and testing practices for data pipelines. Required Skills: Proven experience with Databricks and Unity Catalog (data...
based Streaming Experience Kafka Pyspark SQL ElasticSearch Python ETL BigData AWS/Azure Containers and Container... and automation. For more information, please visit solera.com. The Role: The Lead Data Engineer is responsible for designing...
governance, and seamless data integration through advanced ETL processes. Our goal is to deliver high-quality, timely data... architecture, RESTful API design, and modern application development, with expertise in Python frameworks, database management...
in ETL/ELT, data integration, ML Ops, and SQL, as well as intermediate to advanced skills in Python, Pyspark, AI/ML, and data...-to-end data pipelines for batch and real-time data processing Build robust ETL/ELT workflows to ingest, transform, and load...
in Oracle Database development (SQL, PL/SQL). Test automation experience. Proficiency with ETL tools, ideally Talend..., and experience supporting data migration projects. Proven hands-on experience with Linux/UNIX and automation using Bash/Python...
. Design and implement scalable ETL/ELT pipelines for large structured and unstructured healthcare datasets. Build robust... governance practices, including lineage tracking, metadata management, and data access controls. Build automated data testing...
and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL... Python or other programming languages utilized for data manipulation. Experience with ETL tools such as Apache Airflow...
. This role involves close collaboration with business and data teams to deliver scalable data solutions and workflow automation..., and Contour. Perform backend development using PySpark, Python and SQL to support data processing, transformation...
platforms - AWS 5. Python, Pyspark, UNIX shell scripting, Project & resource management 6. SVN, GIT, JIRA, Automation workflow..., etc.) 3. ETL tool (two or more of AWS Glue, AWS Step Functions, Amazon Kinesis, Amazon Firehose, etc.) 4. Experience in Cloud...
focused data engineer / ETL developer with strong Data analytics skills and experience on various data visualization tools..., retrospectives, etc.) and XP (continuous integration, refactoring, unit testing, etc.) best practices. Candidates must therefore...
data quality checks, testing frameworks, and monitoring processes. Support performance optimization across ETL/ELT... principles (e.g., Kimball, Data Vault, or modern ELT architectures). Strong Python skills for data manipulation and automation...
to support data processing, testing, automation, and integration tasks. Work extensively with Snowflake for data transformation... and Python, and a solid understanding of data warehousing concepts. You'll work on building scalable data models and data...
combines strong analytical, technical, and communication skills to drive business value through data insights and automation... Authoring, Contour, Workshop, and Data Ingestion modules. Advanced proficiency in Python, SQL, React, JavaScript, and CSS...
Engineer with strong expertise in Master Data Management (MDM) testing, ETL/Data Pipeline validation, API Testing, and hands... processes. Ensure consistency across landing, staging, base, XREF, and downstream consumption. ETL / Data Pipeline Testing...
DevSecOps methodologies and best practice to automate deployments and testing Demonstrable in Python, SQL, Spark, and Scala... Lake frameworks using Scala, PySpark, or Python, with robust data quality and security controls.Create reusable libraries...
; NoSQL KV stores (Redis, Memcached, MongoDB etc.). Python: Scripting, automation, data utilities. Ops & CI/CD: Monitoring..., and performance. Implement data ETL processes for batch and streaming analytics requirements. Optimize and troubleshoot...
, and performance of our data systems. The ideal candidate will bring strong expertise in ETL testing, data validation, AWS-based data... initiatives. ETL Testing: Design and perform thorough ETL tests, including test case development, data validation...
principles and database design Proficiency with Python for data processing and automation Experience implementing... Experience with ETL tools like Informatica and Control-M Unix shell scripting skills for data processing and automation...
principles and database design Proficiency with Python for data processing and automation Experience implementing... Experience with ETL tools like Informatica and Control-M Unix shell scripting skills for data processing and automation...
, ETL processes, and data governance principles. Experience with test automation tools and scripting (e.g., Python, PyTest... systems. Azure-Focused Testing Test data flows in Azure Data Factory, Synapse Analytics, and Azure SQL. Monitor...