Facebook pixel_DO NOT CLICK_
Expoint - all jobs in one place

The point where experts and best companies meet

Big Data jobs

With Expoint, the dream vaccancy is waiting for you around the corner. Jobs as Big Data, is this the job you are looking for? We definitely have a Big Data, with your name on it.
Company
5,325 jobs found
IBM

IBM Data Engineer Big Data India, Bengaluru

25.07.2022
IBM

IBM Data Engineer Big Data India, Gurugram

26.07.2022
IBM

IBM Data Engineer Big Data India, Pune

26.07.2022
IBM

IBM Data Engineer Big Data India, Kochi

26.07.2022
IBM

IBM Data Engineer Big Data India, Bengaluru

27.07.2022
IBM

IBM Data Engineer Big Data India, Hyderabad

25.07.2022
IBM

IBM Data Engineer Big Data India, Pune

25.07.2022
IBM

IBM Data Engineer Big Data India, Bengaluru

25.07.2022
IBM

IBM Data Engineer Big Data India, Bengaluru

25.07.2022
IBM

IBM Data Engineer Big Data India, Chennai

24.07.2022
1
2
3
4
5
6
Limitless High-tech career opportunities - Expoint
IBM

Data Engineer Big Data

India, Bengaluru
Details

Your Role and Responsibilities
be involved in data engineering activities like Creating pipelines / workflows for Source to Target etc.

Responsibilities:

  • You will be involved in the Azure Data platform implementation. Willing to work in shift timings 2PM to 11PM
  • Responsible for assessing feasibility of migrating customer solutions and/or integrating with 3rd party systems both Microsoft and non-Microsoft platforms
  • Designing and developing Data Pipelines for Data Ingestion or Transformation using Python (PySpark)/Spark SQL
  • Work with version control GitHub and CI/CD pipelines using Azure DevOps

Required Technical and Professional Expertise

  • Total Years of Experience 5+ years in IT industry
  • 2+ years current and deep experience with Azure Data platform implementation. Proven experience managing projects through the entire project lifecycle.
  • Relevant years of experience 2+ years in Azure Data Factory, Azure Data Lake, Azure DevOps, Azure DataBricks, AzureSQL
  • Proficient in Azure Data Integration, Azure Data Architecture
  • Proven experience using the Microsoft Azure Data Stack (ADFv2, Azure SQL DB, Azure SQL Datawarehouse, Azure Data Lake, Azure Databricks, Analysis Services, Cosmos DB)
  • Experience in Azure data migration patterns
  • Experience in Python, C# is mandatory
  • Agile methodology experience essential
  • 3+ years’ experience assessing feasibility of migrating customer solutions and/or integrating with 3rd party systems both Microsoft and non-Microsoft platforms
  • Hands on experience Designing and developing Data Pipelines for Data Ingestion or Transformation using Python (PySpark)/Spark SQL


Preferred Technical and Professional Expertise

  • AZ 900 – Azure Fundamentals
  • DP 200, DP 201, DP 203, AZ 204 – Data Engineering
  • AZ 400 – Devops Certification
  • You love collaborative environments that use agile methodologies to encourage creative design thinking and find innovative ways to develop with cutting edge technologies
  • Ambitious individual who can work under their own direction towards agreed targets/goals and with creative approach to work
  • Intuitive individual with an ability to manage change and proven time management
  • Proven interpersonal skills while contributing to team effort by accomplishing related results as needed
  • Up-to-date technical knowledge by attending educational workshops, reviewing publications
  • Experience working with version control GitHub and CI/CD pipelines using Azure DevOps