Job Description: Design and implement ETL/ELT pipelines using Databricks and PySpark. Work with Unity Catalog... and lineage within the Databricks ecosystem. Participate in CI/CD, version control, and testing practices for data pipelines...
- Data and Analytics - D and A - Azure Databricks - Manager As part of our EY-GDS D&A (Data and Analytics) team, we help... Architect in designing highly scalable solutions Azure, AWS and GCP. Strong understanding & familiarity with all Azure/AWS/GCP...
and scalability are necessary Responsible for documenting the technical solutions Administer and manage Azure Databricks workspaces... across multiple time zones. Must Have: 6 to 8 years of hands-on experience administering Azure Databricks in cloud environments...
development programs. Partnership and Ecosystem Development Build and nurture strategic alliances with Databricks and Azure... Proven experience in designing and implementing cloud data warehouse solutions (Databricks) on Azure. Deep understanding...
Job Description: Role Description: ● Developing Modern Data Warehouse solutions using Databricks and Azure Stack... ● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot ● Databricks Certified Data...
Databricks workspaces within the Azure portal, including selecting the appropriate pricing tier. Creating, configuring... to Databricks and integrated Azure resources. Creating an Access Connector for Azure Databricks, assigning it the necessary roles...
and data manipulation Experience with Databricks, Azure Synapse, Snowflake, or similar cloud data platforms Familiarity... with ETL tools like Azure Data Factory or Alteryx Understanding of data modeling, data warehousing, and data architecture...
Power Automate Azure Databricks Python, R, SQL Alteryx Curiosity and ability to develop new approaches and solutions... and insights generation for the in Shell’s Retail business The ideal candidate is a problem solver having an analytical mindset...
data analysis – Have the business & technical knowledge to be able to perform exploratory analysis in databricks... Analysis with preferred experience in Python & Databricks Hands-on experience in data science, with a strong focus on retail...
pipelines. Build and maintain data pipelines leveraging Azure Data Lake, Databricks, and AWS data services (e.g., S3, Glue... Python, PowerShell, Shell, Bash, Groovy, and leverage cloud-native CLI tools (Azure CLI, AWS CLI) for operational tasks...
(17+), JUnit, REST Assured, Shell scripting; Infrastructure & Tooling: Docker, Kubernetes, Terraform, Bazel, Cloud... & Platform: AWS, GCP, Azure Observability & Monitoring: Grafana, CI/CD & Automation: Jenkins, Buildkite Data & Testing:ELT...
tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently... and Azure ADF. Hands-on experience with cloud platforms like AWS Azure or Google Cloud particularly with data-related services...
Databricks and AWS/ Azure Stack ● Ability to provide solutions that are forward-thinking in data engineering and analytics... attention to detail. Mandatory Skills: Python/ PySpark / Spark with Azure/ Databricks Tredence is an equal opportunity...
Responsibilities- Platform Administration Handle and maintain workspaces, clusters, pools, and jobs in Databricks or other big data.... Automation & DevOps Develop CI/CD pipelines for notebooks, jobs, and libraries using tools like Gitlab, GitHub Actions, Azure...
7-10 years in platform/data engineering. Proficient in Python, Shell, Kubernetes, CI/CD, Terraform, observability tools..., and Linux-based systems. Cloud & Data Ecosystem Hands-on with Azure/GCP/AWS, modern orchestration tools, data formats (Parquet...
7-10 years in platform/data engineering. Proficient in Python, Shell, Kubernetes, CI/CD, Terraform, observability tools..., and Linux-based systems. Cloud & Data Ecosystem Hands-on with Azure/GCP/AWS, modern orchestration tools, data formats (Parquet...
7-10 years in platform/data engineering. Proficient in Python, Shell, Kubernetes, CI/CD, Terraform, observability tools..., and Linux-based systems. Cloud & Data Ecosystem Hands-on with Azure/GCP/AWS, modern orchestration tools, data formats (Parquet...
– Azure (Databricks, Snowflake), AWS, and their respective offerings Experience in developing Large scale Distributed data... across Hadoop eco-system, Spark (Databricks or otherwise), Snowflake and Cloud platform(s) Understanding of applied Machine...
(Client, Marketo, Azure, AWS etc.) & also, on any perpetual relational DB’s like Databricks, SQL Server etc. Develop.... Working knowledge in Change Data Capture and Slowly Changing Dimensions Advance level on Unix shell scripting, SQL/ PLSQL...
with variety of source systems like Cloud (Client, Marketo, Azure, AWS etc.) & also, on any perpetual relational DB’s like Oracle..., SQL Server etc. (good to have) Intermediate experience level in Unix shell scripting & Python. Working knowledge...