: SQL, ADF, ADLS, Synapse, Pyspark, Databricks, data modelling Years of experience required: 7 – 10 yrs Education...
engineering, Scala and Spark. Expertise in Spark/Pyspark and Scala. Strong programming skills in Scala for data processing...+ Yr 0-30 Days Con/Scon Active DE Data Engineer - Snowflake/DWH/PySpark DEI Neelima Bangalore hands...
problems at scale. About the role: Architect, design, and implement high-performance data pipelines and ETL processes..., preferably GCP. Working knowledge in any data transformation libraries like DBT (Data Build Tool), PySpark, or Snowflake...
Responsibilities: Core responsibilities - Architect, Design, Develop, Test for a ground-up SaaS product in the Data...: Languages and Frameworks: Python, PySpark, REST APIs, and OAuth 2.0 Cloud: Microsoft Azure (AKS, HDInsight, Event Hub...
for integrating information applications and programs. Roles & Responsibilities Key Responsibilities Architect, design... Pipelines PySpark Workbooks Spark SQL & SQL Warehouse Unity Catalog (data governance, lineage) Genie (query performance...
in Google Professional Data Engineer/ Solution Architect is a major Advantage Skills Required: · 8+ years’ experience in IT..., Dataproc+pyspark, Python injection, Dataflow+PUB/SUB About Company: Welcome to Tredence! Since our founding in 2013...
Palantir Foundry. · · preferably in PySpark and hyperscaler platforms (cloud services like AWS, GCP and Azure) with focus..., Python and PySpark. Demonstrable ability to write & optimize SQL and spark jobs. Some experience in Apache Kafka and Airflow...
in Google Professional Data Engineer/ Solution Architect is a major Advantage Skills Required: · 8+ years’ experience in IT..., Dataproc+pyspark, Python injection, Dataflow+PUB/SUB About Company: Welcome to Tredence! Since our founding in 2013...
Proficiency in Python, SQL, PySpark, Glue, Lambda, S3 and other AWS tool sets Good understanding of data warehouses, ETL, AWS...) to develop data pipelines AWS certifications: Solution Architect (SAA / SAP) or Data Analytics Specialty (DAS) Experience...
payments ecosystem. You'll architect and implement reliable, real-time data streaming solutions where precision and data...: Apache Spark (PySpark, Spark SQL, Spark with Java), Apache Kafka, Apache Airflow Cloud Platforms: AWS (EMR, Glue, Redshift...
. Responsibilities Architect and implement scalable AI/ML models (using MS Copilot, Python, PySpark, and other tools) for detecting... systems in a global investment banking environment, leveraging Python, PySpark, big data technologies, and MS Copilot...
solutions. Spearhead Spark optimization strategies to maximize performance and scalability in data processing. Architect... or similar databases. Proficiency in Python (PySpark) is essential; knowledge of Scala and Java is advantageous. Advanced...
solutions. Spearhead Spark optimization strategies to maximize performance and scalability in data processing. Architect... or similar databases. Proficiency in Python (PySpark) is essential; knowledge of Scala and Java is advantageous. Advanced...
and communication skills, both written and verbal Ability to problem solve and architect in an environment with unclear requirements... ( Blob Storage, ADLS gen2, ADF) Should have good experience in Python/Pyspark integration with Snowflake and cloud (AWS...
), Pyspark scripting, Azure Analysis Services. •Must be certified with DP 203 (Azure Data Engineer Associate), Databricks... Certified Data Engineer Professional (Architect / Managerial level) •Strong troubleshooting and debugging skills. •Proven...
best practices, strategies, and solutions Is an Architect who can guide the customers, team, and overall organization on tools... architecture pattern Has worked on at least one cloud platform Has worked as data architect and executed multiple end-end data...
), governance, and cost optimization, while mentoring a talented team of engineers. Architect and build scalable data ingestion... Hubs, Key Vault). Hands-on experience with Apache Spark (PySpark/Scala), Kafka, NiFi, Delta Lake, and Databricks...
our requirements and architect systems to increase and extend to accommodate those needs Diagnose issues in distributed systems... Experience with data processing and SQL databases Experience with Spark/PySpark/ Experience with Iceberg, Presto, Hive...
, and job orchestration. experience in RDBMS, ANSI SQL/PL SQL, Hadoop, Python and/or Java,spark/Pyspark. Proficiency in Spark architecture... Preferred Certifications: Microsoft Certified: Azure Administrator Associate/ Microsoft Certified: Azure Solutions Architect...
breakthroughs in engine technologies, advanced materials, and additive manufacturing. Role Overview Architect scalable data... tools such as Azure Data Factory, PySpark, SQL, and Kusto Query Language (KQL) Ensure data quality and governance...