skill sets: · Databricks, PySpark, and SQL on any cloud platform (AWS or Azure). Preferred skill sets: ETL,Pyspark...: · Design and develop data pipelines using Databricks and PySpark to ingest, process, and transform large volumes of data...
(Jenkins, GitHub Actions, etc.) Infra as code (Terraform, CloudFormation) Cloud/serverless experience (AWS preferred..., Dagster, etc.) Familiar with Docker, Kubernetes, Kafka, Flink Knowledge of modern data stacks (Snowflake, Databricks...
Data Services - Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Azure SQL, Cosmos DB Scenario-based..., Data Sharing, and Performance Optimization. Experience with cloud platforms (AWS, GCP). Proficiency in SQL, Python...
with cloud-native data engineering on platforms such as Databricks and Azure/AWS. · Familiarity with cloud services related... Associate Experience: 5- 8 Years Location: Bangalore Type: Full Time Certifications: Spark 3.0(Mandatory) and/or Databricks...
training and inference, using tools like Azure Databricks, Azure Data Factory, and Azure Synapse Analytics. Familiarity... (e.g., AWS, Google Cloud Platform) and additional programming languages (e.g., R, Java) is a plus. Ideally, you'll...
AWS native technologies and Databricks to support increasing data sources, volumes, and complexity. Drive identification... (Databricks, Oracle, MongoDB), Basic understanding of batch-based manufacturing processes, Understanding of Shop-Floor systems...
and reporting architecture for both on-prem and cloud (MS Azure/AWS/GCP) Assisting the team with performance tuning for ETL... platforms (preferably AWS/Azure/GCP) Minimum 3+ years experience in Azure database offerings [Relational, NoSQL, Datawarehouse...
on different cloud platforms like Azure, AWS and/or Google Cloud. Experience in using and orchestration LLM models on cloud... platforms i.e., OpenAI @ Azure/AWS Bedrock/ GCP Vertex AI or Gemini AI Experience in writing SQL and data modelling...
solutions using Python on Azure Databricks. Integrate Generative AI and Agentic AI models into existing and new workflows... across Azure-native services including Azure Databricks, Azure Storage (Blob, Data Lake), and Snowflake, ensuring data quality...
SQL Server, MySQL, Redshift etc. Cloud – AWS, Azure Tools – Snowflake, Collibra , MDM, Git/Bit bucket Data Flow tools... – Alteryx, SSIS, Databricks, ADF, notebooks. DevOps, Helm, Openshit, CI/CD, SonarCube, Kubernetes, Teeraform Cloud infra...
pipelines to handle large datasets efficiently. Employ frameworks such as Apache Spark, Databricks, Snowflake or Airflow...-level proficiency in Python/PySpark Extensive experience with cloud platforms, particularly AWS-or- Azure-or- GCP Advanced...
Policy, Azure Security Center, AWS Config), identity management and access control, firewall management, auditing..., Load balancing, Security Management, Databases and EC2 or VM machine hosting Databricks, Data Factory, Data Lake Storage...
pipelines to handle large datasets efficiently. Employ frameworks such as Apache Spark, Databricks, Snowflake or Airflow...-level proficiency in Python/PySpark Extensive experience with cloud platforms, particularly AWS-or- Azure-or- GCP Advanced...
, Databricks, and Delta Live Tables Guide the use of cloud platforms (AWS, Azure, GCP) for scalable ML infrastructure Mentor..., and ML Ops Experience with big data tools like Spark, Databricks, or Delta Live Tables Experience with AWS Good...
and analytical logic. Develop and automate EDA/DQM checks (completeness, sparsity, outlier detection) using Databricks and AWS Glue...: 2–8years Required Skills: Python (LangChain, FastAPI, OpenAI API, Databricks SDK) Strong SQL, PySpark, AWS Glue...
+ years of experience as Data Analyst / Data Engineer with Databricks on AWS expertise in designing and implementing scalable..., secure, and cost-efficient data solutions on AWS Job Profile: Hands-on data analytics experience with Databricks on AWS...
Required 7+ years of experience as Data Analyst / Data Engineer with Databricks on AWS expertise in designing and implementing... scalable, secure, and cost-efficient data solutions on AWS Job Profile: Hands-on data analytics experience with Databricks...
techniques, prompt engineering) Design and optimize Retrieval-Augmented Generation (RAG) solutions Manage Databricks workflows..., including job and cluster creation also Databricks API Apply data structures and algorithms knowledge, including...
enterprise applications both on-prem and in the cloud (AWS) along with Modern Data Platform such as Snowflake and Data... and unstructured data from various sources into AWS data lakes or modern data platforms. Assist with Data Quality Controls as assigned...
with cloud and AI partners (Microsoft, AWS, Google, Databricks, Snowflake). Qualifications We Seek in You Minimum..., and DevOps/MLOps pipelines. Certifications preferred: o Cloud Architect (Azure/AWS/GCP) o Databricks or Snowflake...