and optimization: Snowflake, Redshift, BigQuery. Expertise in orchestration frameworks: Airflow, Azure Data Factory, Databricks...
, and operate scalable and maintainable data pipelines in the Azure Databricks environment - Develop all technical artefacts... pipelines in Azure Databricks using PySpark and/or Scala Implement ingestion from structured and semi-structured sources (e.g...
/Docker and Kubernetes/FastAPI or Flask/CICD/Jenkins/Spark/SQL/RDB/Cosmos/Kafka/ADLS/API/Databricks Azure/LLMOps/ADF/ETL...
databricks, you will be building applications, you will also contribute to scaling the platform including topics... Azure Databricks pipeline to take data from source systems to target system ensuring the quality and consistency of data...
, automation) on the Azure Databricks platform. Own the full ML lifecycle: model development, deployment, monitoring... scope: Global business and IT teams Platform scope: Databricks (MLflow, notebooks, jobs, model registry), Azure services...
to implement best practices in data storage, processing, and governance. Build and deploy data solutions on Databricks, leveraging... Architecture – practical exposure required o Hands-on experience with Databricks and AWS (should be visible in past projects...
, and operate scalable and maintainable data pipelines in the Azure Databricks environment - Develop all technical artefacts... Tasks: Design scalable batch and streaming pipelines in Azure Databricks using PySpark and/or Scala Implement ingestion...
data platform (Snowflake, Databricks) capabilities to create an enterprise lake house. Advanced expertise with AWS...
in Airflow or similar technology Experienced in working with data warehouse/lake platforms such as Databricks, Snowflake, AWS...
Lakehouse using Databricks. Technology Ecosystem: Databases: Microsoft SQL Server (T-SQL, SSIS, SSRS). Programming languages... production systems. Experience working with Adhoc data requests for Support Teams. Practical Knowledge in Spark, Databricks...
or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations Use Azure Data Factory and Databricks... proficiency Data modeling ETL processes Azure Databricks knowledge Familiarity with data warehousing Big data technologies...
using Databricks (PySpark) Write complex T-SQL queries, stored procedures, functions, and triggers. Implement DevOps..., Databricks, Cosmos DB, Analysis Services Programming in Python and C# Hands-on experience with CI/CD and Azure DevOps Sound...
using Databricks (PySpark) Write complex T-SQL queries, stored procedures, functions, and triggers. Implement DevOps..., Databricks, Cosmos DB, Analysis Services Programming in Python and C# Hands-on experience with CI/CD and Azure DevOps Sound...
etc) Experience with interactive notebooks (e.g. JupyterHub, Databricks) Experience with Git Ops style automation Experience...
JOB Role- ETL Test Engineer (Databricks) Location- Bangalore Experinece - 5+...
markets data analysis (ex., stock market prices and volumes) Cloud and systems experience in AWS S3/EC2, Databricks...
. Architect solutions using modern data platforms such as Databricks, Delta Lake, and Prophecy. Define scalable patterns.... Strong experience with Databricks, Delta Lake, and data orchestration frameworks. Hands-on expertise with data quality tools (SODA...
of Databricks platform and configurations Integration between S3 and Databricks Setup Databricks catalog, schema Optimizing... Databricks clusters, notebooks, and jobs for performance and efficiency Mandatory Skills AWS Devops Engineer/Databricks Work...
programming and Databricks for data transformation and orchestration. · Strong experience with data warehouse databases...
AI solutions, leveraging AWS Bedrock and Databricks. This includes building Retrieval Augmented Generation (RAG) pipelines... in all, but willing to learn them): Databricks on AWS Python Snowflake Tecton - feature store Fiddler - model observability platform...