Ingestion Data Engineer

• Practice Data

• Technologies Business Intelligence Jobs and Data Recruitment

• Location Warszawa, - None Specified -

• Type Contract

Job description
We are seeking a proactive, dynamic, and adaptable member to join our global, diverse, and inclusive team. Given the continuous growth and evolution of our products, we require candidates who not only embrace change but also possess the experience and capability to hit the ground running. Ideal team members will thrive in ambiguous environments, demonstrating curiosity and proactiveness while effectively contributing from day one.
We are looking for an experienced Data Engineer to work within our Client’s Data Marketplace Ingestion team, reporting into the Ingestion Tech Leads. In this role, you will serve as a Data Engineer, responsible for supporting the Data Ingestion team, Business and Technical Product Owners, to expand and promote our offering throughout EY’s Service Lines, Products, Functions and engagement teams. This role covers a broad area of activity, including technical design and development of near real time data processing, consumer interaction, business documentation and reporting.
Your key responsibilities

• Collaboratively identify and ideate opportunities to continuously improve Client’s Data Marketplace’s data asset and the services it provides to consumers.
• Engage in design and development sessions to further client’s data asset creation and ingestion pipelines with a focus on stability, optimisation and traceability.
• Develop, test and maintain Client’s Data Marketplace data pipelines & processes.
• Developing and testing resilient, fault tolerant, modular code, to ensure Client’s Data Marketplace processes, pipelines and services are robust and highly available.
• Research, explore and if feasible implement new methods and processes across EYDM to build world class data products and associated services.
• Actively participate in cross-team collaboration to ensure smooth transition through Ingestion, Consumption and Activation

Skills and attributes for success

• Strong Python expertise with debugging skills (heavy hands-on experience, primarily Python for 2.x)
• Solid understanding of Azure Data Engineering concepts
• Hands-on experience with:
  • Azure Data Factory (ADF)
  • Azure Databricks (ADB)
  • Python / PySpark
  • SQL
• Experience in building and maintaining data pipelines and data processing workflows on Azure

• share
• 
• 
• 
•