distributed data processing code with PySpark Optimizing Spark jobs using DataFrames API and RDDs Working with Spark SQL... Databricks workflows and Delta Live Tables Data pipelines with Databricks Jobs Streaming data processing with Structured...
and AI solutions using Scala/Java, Python, Spring Boot, REST/gRPC APIs, SQL/NoSQL databases, and modern UI frameworks such as Angular... in modern Data Engineering including Spark (Structured Streaming), Databricks, Kafka, Airflow, DBT, Delta Lake/Apache Iceberg...
and batch use cases across latency windows. Transform at scale: Develop transformation logic using SQL, Python, Spark...: You’ve worked with AWS-native services like Glue, EMR, Athena, Lambda, and object storage (S3). Bonus if you’ve used Databricks...
and AI solutions using Scala/Java, Python, Spring Boot, REST/gRPC APIs, SQL/NoSQL databases, and modern UI frameworks such as Angular... in modern Data Engineering including Spark (Structured Streaming), Databricks, Kafka, Airflow, DBT, Delta Lake/Apache Iceberg...
and develop data pipelines in Python/Databricks and collaborate with cloud data platforms. Apply Generative AI techniques... of SQL and capability to handle relational and non-relational data. Familiarity with cloud platforms (AWS, Azure, or GCP...
/data engineering Knowledge, Skills, Abilities 8 years or more experience using Python and SQL Fluency in Databricks... find cures for cancer. Location/Division Specific Information The team focuses on data democratization using a host...
within data lake ecosystems Preferred Qualifications Mastery of SQL and Python Excellent verbal and written communication... product features for our members. Our stack: Python, SQL, dbt, Metaplane, Airflow, PostgreSQL, MySQL, REST, Aptible, Docker...
. We are now looking for a Senior Data Engineer as we seek to grow our recently established team. Role and responsibilities: Working alongside... you to have: 3-5 years programming experience in Java, Kafka, PySpark, Python, Spark, SQL, Java, and unix shell scripting Proven...
in Databricks, Pyspark/Python & SQL (minimum 3+ year of experience) Hands on experience in could AWS/Azure (preferably AWS...) Excellent communication. Can be able to work independently. Skills: databricks,pyspark,sql,data pipelines,aws,airflow...
to other team members. Knowledge and Skills Requirements: Strong programming and modeling skills using Python, PySpark, R, SQL... in cloud environments (SAP, Databricks, Microsoft). Expertise in data wrangling, feature engineering, and large-scale data...
Python, PySpark, Pandas on Azure. 2. Work with Azure Data Factory, Databricks, Synapse, Data Lake, Azure SQL/DWH. 3.... Implement DevOps practices, CI/CD pipelines, and manage code with Git. Role-Specific Responsibilities - AWS Data Engineer 1...
Required (desirable): Knowledge of data warehouse appliances, e.g. Snowflake, Databricks, Python,Scala,AWS Education Qualificaiton BE/B... tools such as Informatica Glue Databricks and DataProc with coding skills in Python PySpark and SQL. Works independently...
tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently... queries), python, Rest Api's, AWS(Redshift, lambda, EC2, CloudWatch) Skill to Evaluate SQL,python,AWS,lambda,redshift,stored...
. Desired: Experience in data domains and ETL workflows. Familiarity with data stacks such as Kafka, Databricks, and Snowflake...Req ID: 356861 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow...
. Desired: Experience in data domains and ETL workflows. Familiarity with data stacks such as Kafka, Databricks, and Snowflake...Req ID: 356861 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow...
. Desired: Experience in data domains and ETL workflows. Familiarity with data stacks such as Kafka, Databricks, and Snowflake...Req ID: 356861 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow...
, Databricks, or BigQuery. Familiarity with DBT and SQL-based data models. Experience integrating APIs with data warehouses... Engineer with a strong focus on API development and frontend applications, building scalable internal and customer-facing tools...
pipelines Work with cloud platforms: Azure (Databricks, ML Studio, Data Factory, Data Lake, Delta Tables), AWS, and GCP... security, prompt engineering, and responsible AI practices Proven solid expertise in Python, PySpark, T-SQL, SQL, and big data...
with big data and streaming technologies including Spark, Flink, Airflow, Databricks, and Kafka for large-scale, high...Job Posting Title: Staff/Architect Software Engineer Req ID: 10141890 Job Description: Staff/Architect Software...
-performance data processing solutions using Python, SQL, and distributed processing frameworks where applicable. Support, enhance..., and troubleshoot existing ETL processes written in SQL and Python, ensuring reliability, data accuracy, and timely resolution...