Lead Data Engineer

Posted 14d ago

Melbourne, VIC, 3000

Location

Full Time

Work Type

Remote / Work from Home

Work Setting

Job Description

The Opportunity

At APA, our purpose is simple: to strengthen communities through responsible energy.

We now have an exciting opportunity available for a Lead Data Engineer in Melbourne, Adelaide, Sydney or Brisbane on a full-time permanent basis.

Reporting to the Transformation & Governance Manager, this role serves as the Lead Data Engineer, requiring extensive expertise in Databricks and AWS, coupled with a proven track record in establishing and developing cloud-based Data Platform teams. The ideal candidate brings hands-on experience with Big Data and Data Lake technologies across both cloud and on-premises environments, a deep understanding of data warehousing methodologies, and a strong focus on improving data quality and documentation processes.

Key Responsibilities

  • Lead the design and implementation of data pipelines, ETL processes and data models on AWS Databricks.
  • Ensure the adoption of best practices in data engineering, including data quality, optimisation and security.
  • Translate high-level architecture into actionable implementation plans.
  • Ensuring solutions are scalable, reliable and secure along with mentoring team members.
  • Conduct code reviews, design reviews and ensure the team follows best practices in version control, CI/CD and DevOps for data engineering.
  • Ensure data governance, security and quality standards are maintained throughout the data lifecycle.
  • Monitor and support data management initiatives, including within specific environments like AWS/Databricks.

Your background

  • Bachelor's degree in computer science or a related field.
  • Strong experience in data engineering, with a strong focus on Azure Cloud and Azure Databricks.
  • Strong understanding of data architecture, data warehousing, data modelling, ETL processes and cloud based technologies.
  • Demonstrated experience in mentoring technical teams
  • Proficiency across Python, SQL and Scala
  • Excellent problem-solving skills and the ability to work under pressure in a fast-paced environment
  • Strong communication skills, with the ability to interact effectively with technical and non-technical stakeholders

About the Team

Technology underpins everything we do at APA from helping connect millions of Australians to essential energy sources every day to achieving our net zero ambition - and the capability for our people to make this happen.

To help APA power ahead, the Technology teams is focused on enhancing APAs technology offering, providing innovative and progressive technology - enabling APA to be world class in energy solutions.

This is an exciting time for the team, we need people who are courageous, nimble, and ready to make an impact - change makers and risk takers.

Working at APA

At APA we're committed to fostering a safe and inclusive workplace where you can achieve your best. We'll provide you with access to targeted career development programs, competitive remuneration, employee benefits, flexible working arrangements, and wellbeing programs. We also have an inclusive parental leave policy providing 18 weeks leave including superannuation to support parents at work and in life.

We employ more than 2700 people across Australia and are committed to creating a diverse and inclusive culture, where everyone feels safe, valued, and trusted to do their best every day.

We are APA

APA Group is a leading Australian energy infrastructure business.

We proudly own, operate and manage a diverse $27 billion portfolio of gas, electricity, solar and wind assets which deliver essential services to communities and customers across Australia.

And we own over 15,000 kilometres of gas pipelines which deliver energy to families and industry across every corner of Australia.

As the partner of choice in delivering infrastructure solutions for the energy transition, we're focused on bundled remote grid energy solutions, electricity and gas transmission, and future energy, including hydrogen and carbon capture and storage.

Our customer centric approach means we understand our customers and their businesses offering reliable, innovative, and cost-effective energy solutions that support their decarbonisation ambitions.

We are committed to delivering infrastructure solutions for Australia's energy transition and supporting the decarbonisation ambitions of our customers.

We prioritise sustainable outcomes so that APA, our people, customers, and communities can thrive - now and in the future.

Join our team and be part of Australia's energy transition!

We'd love to hear from you.

APA is an equal opportunity employer. The safety, health and wellbeing our people, community and environment a priority. We embrace diversity in our people to ensure our workforce is representative of the communities that we operate in.

Applicants must be eligible to work in Australia to be considered.

This vacancy works with critical APA data, systems or infrastructure and candidates are subject to background vetting (including Police checks) before & during employment.

Role closes Sunday 9 February 2025 Role Reference number JR1392.

APA Group will not accept unsolicited resumes from recruitment agencies.

We will contact successful candidates after the closing date.

Job Activity

  • Employer reviewed job: 2 weeks ago
  • Posted: 1 days ago
Report Job

Company Details

APA

  • Active Jobs 6

Share Job

https://jobs.wit.org.au/link/53778

Copied to clipboard

Other Jobs at APA

APA logo

Senior OT Project Engineer (Power)

APA

$110,000 - $120,000

Sydney, NSW, 2000

Other

We now have an exciting opportunity available for an OT Scada Project Engineer to join our Transform...
Full Time Mixed (Both In Office + Remote)
0/1 positions filled
Posted 27d ago
APA logo

OT Engineer

APA

$130,000 - $140,000

Melbourne, VIC, 3000

Other

We now have an exciting opportunity for an OT Engineer to join OT Engineering team in Sydney, Melbou...
Full Time Mixed (Both In Office + Remote)
0/1 positions filled
Posted 27d ago
APA logo

OT Engineering Team Lead – Data and Modelling

APA

$130,000 - $140,000

Melbourne, VIC, 3000

Other

We are excited to offer an opportunity for an OT Engineering Team Lead – Data and Modelling to join...
Full Time Mixed (Both In Office + Remote)
0/1 positions filled
Posted 27d ago
APA logo

Workday Integration Lead

APA

$180,000 - $190,000

Sydney, NSW, 2000

Other

We now have an exciting opportunity for a Workday Integration Lead to join our Information Technolog...
Full Time Remote / Work from Home
0/1 positions filled
Posted yesterday
APA logo

Systems Analyst, Workday

APA

Sydney, NSW, 2000

Networks & Systems Administration

We now have an exciting opportunity for a Workday System Analyst to join our Information Technology...
Full Time Remote / Work from Home
0/1 positions filled
Posted today