Data Engineer

Requisition Number: 1290

Position Title: Software Engineer_G01

External Description:

• Data Engineer

   

  Working as part of our Data Engineering team, your role will be to build infrastructure and solutions for the management and organization of Monster’s data. In order to succeed in this role, you will be required to gather requirements from stakeholders, design data structures and data models, design and build data pipelines and understand how to build secure, scalable, efficient and fault tolerant solutions within cloud environments.

   

  Primary Functions:

  · Build and maintain robust, scalable, automated cloud-based data pipelines using industry best practices.

  · Ensure quality of technical solutions as data moves across environments.

  · Recommend ways to improve data reliability, efficiency and quality.

  · Partake in cross team code reviews to ensure all solutions developed meet required standards.

  · Contribute to the ongoing development of the Data Engineering team’s processes and skill sets by finding innovative ways to tell the story of Monster's data and ensure it is available to the right people at the right time.

  · Analyse source systems, define underlying data sources and transformation requirements, design suitable data models and document the design/specifications.

  · Provide insight into the changing data environment, data processing, data storage and utilization requirements for Monster and offer suggestions for solutions.

   

  Knowledge and Skills:

  Need to Have:

  · Diverse technical background with over 5 years of experience in the development of data platforms preferably in an Agile environment.

  · Over 3 years of experience working in a Big Data ecosystem processing data (includes file systems, data structures, automation, security, messaging, movement etc.)

  · Over 3 years of experience working within a production cloud data infrastructure including design, implementation and maintenance (preferable GCP).

  · At least 3 years of experience with SQL development across multiple language variations (e.g. SQL Server, Oracle, MySQL and Big Query).

  · At least 2 years of experience developing data pipelines with orchestration tools such as Apache Airflow or GCP Composer.

  · Hands-on experience implementing ETL (or ELT) best practices at scale.

  · Over 2 years of experience in Python development.

  · Experience working with both structured and non-structured data in various formats such as JSON, AVRO, CSV, TSV, PDF etc. required.

  · Knowledge of CI\CD best practices.

  · Relentless focus on continuous improvement of solutions and processes to improve data reliability, efficiency, quality and the Data Engineering team at Monster.

  · Good communications skills across all levels of stakeholder (business & technical).

  · Continually keep up with advancements in data engineering practices.

  · Create and maintain architecture and systems documentation.

   

   

  Nice to Have:

  · Experience of encrypting and obfuscating sensitive data.

  · Experience of deploying Infrastructure as Code preferably using Terraform.

  · Experience of developing ETL and ELT data pipelines using Apache Beam, GCP Dataflow, Apache Spark or GCP Dataproc.

  · Knowledge of Salesforce, Salesforce Marketing Cloud and Zuora.

  · Experience in Scala development.

  · Experience using Datadog, Stackdriver and Pager Duty.

  · Hands on experience complimenting inhouse built pipelines with pipelines that use SaaS solutions is preferred.

City:

State:

Country:

Community / Marketing Title: Data Engineer

Company Profile:

Monster (Randstad Group) is the worldwide leader in successfully connecting people to job opportunities. From the web, to mobile, to social, we help companies find people with customized solutions and we use the world's most advanced technology to match the right people to the right job.

We've made it our mission to help companies find better candidates. And nobody brings more cutting-edge tools to help them do just that than Monster. Whatever their needs are, we have the products and technologies to build a bespoke solution for our clients, to help them find #TheRightFit.

Innovation is the heart of our success... and our future. We're changing the way people think about work, and we're helping them improve their lives and their work performance with new technology, tools and training.

What makes Monster great…

Monster is synonymous with innovation; we are passionate about bringing great people and great companies together. In fact, we are obsessive about it – it’s what we do every day. We believe that the work that we do has a noble purpose... Making people’s lives better.

At Monster, we let people breath, giving everyone the opportunity to shape their destiny and provide the development support that allows them to do so.

Find out more about Working at Monster here: https://www.monster.com/about/working-here/

Location_formattedLocationLong: Sydney, New South Wales AU