pipelines and applications on Foundry requires: Proficiency in SQL / Scala / Python (Python required; all 3 not necessary...) Proficiency in PySpark for distributed computation Proficiency in Ontology, Slate, Familiarity with Workshop App basic design...
pipeline development. Write complex SQL queries and PySpark / Scala code for data transformation. Use Delta Lake, Unity...
scripting Pyspark Scoop Scala Sql About Standard Chartered We're an international bank, nimble enough to act, big... Responsibilities BI Tools like MicroStrategy, Power BI, Tableau Programming skills like Python, Scala, or Java for custom ETL...
Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation . Semantic Modelling... with at least one of Python, Scala or Java Location- Pune, Bangalore, Coimbatore, Chennai Mandatory Skills: DataBricks - Data Engineering...
for interactive data analysis, prototyping, and documentation. Utilize SQL, Python (PySpark), or Scala to work with large datasets.... Strong proficiency in Python (PySpark), SQL or Scala. Experience with cloud platforms such as AWS(preferred), Azure, or Google Cloud...
efficient and production-ready PySpark or Scala code for data transformation and ETL processes.Integrate data from various... Live Tables, Unity Catalog).Strong programming skills in PySpark andor Scala.Solid understanding of Delta Lake architecture...
solutions Strong proficiency in Python, Java or Scala Extensive experience with Apache Spark (Spark SQL, Spark Streaming..., PySpark) Hands-on experience with Hadoop ecosystem (HDFS, YARN, Hive, HBase) Experience with cloud-based data platforms...
) processes, data pipelines, and data streaming using Python , Kafka for streams , Pyspark , DBT , and ETL services provided... languages such as Python, Java, or Scala, and experience with scripting languages like SQL or Shell scripting. Communication...
pipelines in Azure Databricks using PySpark and/or Scala Implement ingestion from structured and semi-structured sources (e.g...
Tasks: Design scalable batch and streaming pipelines in Azure Databricks using PySpark and/or Scala Implement ingestion...
Tasks: Design scalable batch and streaming pipelines in Azure Databricks using PySpark and/or Scala Implement ingestion...
: Python, PySpark, Scala Cloud: Azure Big Data: Hadoop Primary duties will include: Data Warehouse Development... to maximize performance. Data Processing & Pipelines: Develop and optimize data pipelines using PySpark, Scala, and Python...
Job Title: Data Analyst (Python +Pyspark) About Us “Capco, a Wipro company, is a global technology and management... analytical skills and commercial acumen, Minimum 4+ years of experience with Python and Pyspark. Good understanding of the...
in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion... skills - Azure Data Factory (primary) , Azure Data bricks Spark (PySpark, SQL) Must-have skills Cloud certified...
, and custom Python-based ETL frameworks Must know Programming skills like ETL using Hadoop, Python, SQL, Shell scripting, PySpark..., Scoop, Scala SQL Expertise in writing complex queries, performance tuning, query optimization Data Modelling of Star...
. Must have skills - DataBricks, Delta Lake, pyspark or scala spark, unity catalog. · Good to have skills - Azure/AWS Cloud skills...
, Pyspark, ETL Role: Required Tech Stack: Has strong execution knowledge of Data Modeling, Databases in general (SQL...-negotiable) and Scala/Rust/Java Understanding of Medallion architecture pattern Has strong SQL knowledge...
: Data Engineering Skills Required: Python, Pyspark, SQL, Cloud, ETL, ELT, Data Pipeline Role: Required Tech Stack..., such as Python (or Scala/Rust/Java) Has strong execution knowledge of Data Modeling (star schema, snowflake schema, fact vs...
Hubs, Key Vault). Hands-on experience with Apache Spark (PySpark/Scala), Kafka, NiFi, Delta Lake, and Databricks...