IT - Other, IT & Telecomms

An enterprise level organisation within the insurance/finance sector is seeking to enhance their data capabilities by bringing in a Data Ops Engineer to provide strong, hands-on technical capabilities while providing guidance around architecture, design, and release management.

Your Key Responsibilities

  • Build and maintain robust, scalable, and automated cloud-based data pipelines using industry best practices
  • Provide consultation to technical and non-technical stakeholders around data knowledge, current processes, best practices, and ideas to refine the business requirements
  • Develop strong relationships with other teams, service partners, and vendors
  • Identify opportunities for improvement of data service performance and reliability, and lead initiatives to do 
  • Incorporating the key patterns, standards, and principles for Data Engineering
  • Design, implement, and test all data solutions incorporating best cloud practices and modern development techniques

Essential Skills and Requirement

5+ years’ experience with each of the following:

  • MsSQL, My SQL, PostgreSQL
  • Spark and Databricks or alternatives such as Spark + AWS/GCP/Azure 
  • Distributing processing (Spark, Hadoop, EMR)
  • Cloud database/Data Warehousing experience
  • Experience with data management and stream flows, then creating  insights
  • Experience in working with data governance/data quality
  • Strong ability to design, build and manage data pipelines
  • Extensive experience working in data management disciplines