Data Engineers - Specialist and Principal - Digital Factory

Last updated 1 hours ago

About BHP

At BHP Technology we support our people to grow, learn, develop their skills and reach their potential.

With a global portfolio of operations, we offer a diverse and inclusive environment with extraordinary career opportunities. Our strategy is to focus on creating a safe work environment where our employees feel strongly connected to our values and objectives, and where the capability of our people is key to our success.

To enable the rapid deployment of digital solutions we have established Digital Teams here in Queensland. Think of us as a “startup within a company” made up of multi-disciplinary, non-hierarchical teams with one focus: delivering digital solutions that improve the lives and work of our mining teams.

We work fast and solve tough problems, and pride ourselves on our culture of open collaboration, safety, diversity of thought and fun. We’re looking for the best and brightest developers, engineers, data scientists and designers to join us, working from our new nerve center in Brisbane.

Come and be a part of this success.

About the role

As a Data Engineer, you will play a key role supporting the Digital team and the Digital Factory projects that fundamentally change BHP’s performance across safety, productivity and people performance. The Digital Factory is BHP’s approach to rapid design and development of digital that provide solutions to operational challenges. These products are built on effective access to high-quality data.

The fun parts of this role include;

  • Define the data lifecycle (including data models and data sources for analytics platforms), and to gather and clean business data from the business in order to provide ready-to-work inputs for Data Scientists.
  • Working with a diverse range of people and skills from digital professionals to our Coal operators
  • Apply strong expertise in data mining and information retrieval to design, develop, optimise, and maintain data architecture and pipelines.
  • Accountability for ensuring that data is available to be utilised by the applications and digital products is of high quality.
  • Collaborate with internal BHP customers to understand their data requirements.
  • Contribute in the design and development of data integration and data pipelines.
  • Work with various on-prem and cloud-based data platforms, technologies and services.
  • Plan and deliver secure, good practice data integration strategies and approaches.
  • Collaborate with teams on data requirements, quality control and standardisation.
About you

We are looking for all those that eat, sleep and breathe data. You will enjoy solving complex problems and delivering innovative solutions within a team environment made of diverse skills and experiences. You will be happy working in a fast paced start-up like culture but with the resources of multinational organization can provide.

It would be ideal if you have the following experience however, we are looking for Data Engineers of all levels;

STEM Bachelor’s degree highly desirable

Experience working in data engineering or architecture role

Exposure with at least two of the following technologies: Python, Scala, SQL, Java

Understanding of multiple database technologies such as: Distributed Processing (Spark, Hadoop, EMR) Traditional RDBMS (MS SQL Server, Oracle, MySQL, PostgreSQL) Cloud Database Services (DynamoDB, Elasticache for Redis, Snowflake)

Experience in traditional data warehousing / ETL tools (Informatica, Talend, Pentaho, DataStage)

Ability to work across structured, semi-structured, and unstructured data

Exposure to Cloud platforms

Experience in designing and building streaming data ingestion, analysis and processing pipelines using Kafka, Kafka Streams, Spark Streaming and similar cloud native technologies.

Experience with data processing systems with Hadoop, Spark, Storm, Impala, etc.

Able to use Data Visualisation tools

Experience deploying applications into production environments e.g. code packaging, integration testing, monitoring, release management

Strong understanding of understanding of traditional ETL tools & RDBMS, End to End Data Pipeline

Knowledge of Data Governance and strong understanding of data lineage and data quality

Supporting a Diverse Workforce

The size and magnitude of our business not only provides significant opportunity for professional development, but also attractive salary packages with performance based bonuses and unique BHP employee share program.

At BHP, we recognise that we are strengthened by diversity. We are committed to providing a work environment in which everyone is included, treated fairly and with respect. We are an Equal Opportunity employer and we encourage applications from women and Indigenous people. We know there are many aspects of our employees' lives that are important, and work is only one of these, so we offer benefits to enable your work to fit with your life. These benefits include flexible working options, a generous paid parental leave policy, other extended leave entitlements and parent rooms.

All qualified applicants will receive consideration for employment without regard to race, color, sex, national origin, age, religion, disability, sexual orientation, gender identity, protected veteran status, citizenship, genetic information or other protected status under federal, state or local laws.

BHP is an Equal Opportunity Employer - Minorities/Females/Veterans/Disability.