Data Engineer
Remote working, West Sussex, Manchester
Up to £54,000 per annum + Bonus

An exciting opportunity has arisen to join a leading company in the Insurance and technology sector, renown for its outstanding working culture, in a Data Engineering role. The role will require someone who has strong Pyspark and SQL experience alongside an Azure background.

Key responsibilities:

• Develop low to high complexity, secure, governed, high quality, efficient data pipelinesfrom a variety of on and off premise, internal and external data sources
• Ensure that data is cleansed, mapped, transformed and optimised for storage to meet requirements for business and technical use cases.
• Build data observability and data quality by design into all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies.
• Build solutions that pipe transform data into data lake storage areas, physical databasemodels and reporting structures across data lake, data warehouse, Business Intelligence systems and analytics applications.
• Build physical data models that are appropriately designed to meet business needs and optimise storage requirements, ensuring maximum re-use.
• Carry out unit testing of own code, and peer testing of others code to ensure appropriate quality
• Maintain effective, and appropriate documentation that brings transparency and understandability to pipelines created and code created.
• Create high complexity BI solutions including data mart, semantic layer, and reporting & visualisation solutions in recognised BI tools such as PowerBI.

Skills required:

• Strong experience with SQL server and/or Azure (Synapse, Datafactory)
• Pyspark
• Experience of designing and building end to end data solutions
• A good understanding of the full data life cycle
• The ability to coach/mentor junior Data Engineers
• Power BI
• Terraform (desirable)

This company have an outstanding culture and a fast paced, entrepreneurial way of working, which is generally a breath of fresh air to their employees. They have also adopted flexible working which can be discussed and tailored to candidates at interview and offer a bonus and generous benefits package.

If you are interested, please apply for full details.