Data Engineer - DataBricks

Data Engineer - DataBricks

Location:
Guernsey, Haywards Heath or Manchester
Salary:
up to £49,000 depending on level of experience
Department:
Technology and Data
Apply for this job

We’re First Central Insurance & Technology Group (First Central for short), an award-winning innovative insurance and technology organisation, delivering market-leading motor insurance, underwriting, distribution, finance, technology and legal services.
 

We’re on the hunt for a talented Azure Data Engineers to join our Technology and Data Teams in either Salford Quays, Manchester, Haywards Heath, West Sussex, or our offices in Guernsey. 

This is an exciting opportunity to work with the Data Engineering, Business Services and Technical partners to create and integrate Azure Data Engineering pipelines transforming core systems data into knowledge.  The successful Azure Data Engineers will be self-starters with a very strong background in Azure who are looking to build on their extensive Databricks skills and experience in a dynamic and demanding team environment. This is an excellent opportunity to join an organisation that highly values its data and its people. 

To be successful in this role, you’ll need:

  • Extensive experience of working with Pyspark / Scala for Databricks or Apache Spark
  • Advanced SQL coding skills.
  • Experience working with Microsoft best practices working with
    • Azure Data Lake (Gen 1 and 2)
    • Azure Analysis Services
    • Azure SQL Data Warehouse (Synapse Analytics)
    • Azure Data Factory
    • Databricks or similar Spark environment
  • A minimum of two years’ experience in Data Engineering using Python

Job Responsibilities:

  • Work with other members of the Data Engineering team, you will actively participate in the design and development of processes and technologies that support secure and efficient data ETL, connecting to a variety of on- and off- premise data sources
  • Ensure data is cleansed, mapped, transformed and otherwise optimised for storage, and to meet requirements for business and technical use cases
  • Apply business and logic rules to derive insight from company data, and deliver these in real-time to the quote ratings engine
  • Generate and schedule data enrichment processes
  • Work closely with the Scrum Master to understand business requirements of items in the backlog, and translate those into technical deliverables
  • Develop effective, scalable solutions that can be efficiently tested, deployed, updated, maintained and managed
  • Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications
  • Support relationships with the other areas of FCG to ensure that requirements can be developed
  • Ensure solutions support the architectural direction of FCG technology and use approved technical components
  • Work to the agreed prioritisation of requirements for development and to the agreed delivery dates against these requirements
  • Assists in the identification of root causes and fixes for major incidents where required

Core Competencies 

  • Experience working in an Agile environment
  • Expert in Pyspark / Scala for Databricks or Apache Spark
  • Advanced SQL coding skills
  • Microsoft best practices working with
    • Azure Data Lake (Gen 1 and 2)
    • Azure Analysis Services
    • Azure SQL Data Warehouse (Synapse Analytics)
    • Azure Data Factory
    • Databricks or similar Spark environment
  • A minimum of two years’ experience in Data Engineering using Python
  • Experience of working with large data sets in an enterprise environment
  • Create and populate staging areas and data pipelines to perform a range of transformations
  • Experience working with large JSON documents
  • Microsoft best practices working with Azure
  • Strong data modelling skills
  • Logical and physical model design and implementation
  • Problem solver and solution finder

Desirable Competencies 

  • A Computer Science, Software Engineering, or related degree 
  • Microsoft Certified qualifications 
  • An understanding of software development lifecycle 
  • Understanding of the retail Insurance business  
  • Experience of testing tools and performance monitoring
  • Appreciation of Data reporting and visualisation using Power BI
  • Experience working in a regulated environment
  • Understanding of the retail Insurance business

Behaviours

  • An organised and pro-active approach
  • A flexible approach and positive attitude
  • Emphasis on attention to detail and accuracy
  • Strives to drive business improvements to contribute to the success of the business
  • Embrace, embed and incorporate the company values

What can we do for you? 

We believe we can offer you a great working environment as we’re so passionate about our people. Here are just some of the benefits and perks that we offer…

  • Fantastic training and development opportunities
  • Employee benefit packages to suit your lifestyle
  • Flexible working
  • YOUday – we give you an extra day off to celebrate a special day
  • The opportunity to take a paid day off each year to do charity work
  • A health cash plan
  • Help with travel expenses
  • The opportunity to buy additional holiday
  • Company pension scheme
  • Group life assurance
  • Enhanced maternity and paternity pay
  • Professional subscription fees paid
     

Employee wellbeing is high on the agenda here too. We provide a weekly free fruit delivery, discounted membership at a local health club and access to an Employee Assistance Programme, which promotes physical and emotional wellbeing at work and at home. In addition, we provide wellbeing events throughout the year to support physical and mental health.

For further information on what we can offer and to learn more about this role, feel free to contact our dedicated Recruitment team.

We pride ourselves on being a great place to work. Check out our Glassdoor page to see what our employees think about working here.

We’re happy to discuss flexible working during the recruitment process .

Apply for this job

glassdoor

86% of people would recommend a friend to work at First Central

Based on 150 Glassdoor reviews (October 2021)

Benefits

View all benefits >

Flexible working

We support colleagues who wish to work flexibly whilst meeting the needs of the business.

YOUday

We give you an extra day off to celebrate a special day.

Holiday Extra

Not only do you get a generous holiday entitlement, you can also buy additional leave.

Volunteering

Get a day off each year to take part in volunteering activities.

Health cash plan

Claim money back on your healthcare costs, such as dental check-ups and eye tests.

Season ticket loan

We provide interest-free loans to cover the cost of season tickets for rail, bus or car parking.