Back to job search

Principal Data Engineer

  • Location:

    New York

  • Sector:

    Technology

  • Job type:

    Permanent

  • Salary:

    Negotiable

  • Contact:

    John O'Reilly

  • Contact email:

    John.OReilly@weareoliverjames.com

  • Job ref:

    JOB-032021-137712_1615902302

  • Published:

    26 days ago

  • Expiry date:

    2021-04-15

  • Startdate:

    ASAP

Oliver James' Client is a privately held, Bermuda registered company that provides speciality re/insurance through its wholly owned subsidiaries. Companies are operating in an increasingly uncertain world. Driven by relentless curiosity, our team of trusted experts provides a fresh perspective on our client's risks. Designed for the future, our client adds creativity to tech-enabled efficiency and robust analytics to address risks others avoid.

Role: Data Engineer

We are seeking talented and intellectually curious data engineers with a passion for the "R" in R&D. You will be part of the Data & Analytics team reporting to the Chief Data Officer.

Responsibilities include:

  • Researching and evaluating data sources to solve specific business problems
  • Collecting and preparing the data to support Data Science projects and business initiatives
  • Designing and building robust and reusable data pipelines
  • Contributing to the design and architecture of innovative solutions to difficult problems
  • Closely collaborating with data scientists, actuaries, IT and the business to identify, build, test, and deploy data collection, management, and curation tools and help ensure proper integration with a broader cloud infrastructure

Qualifications / Skills:

  • 3+ years of industry experience collecting data and building data pipelines
  • Degree in Computer Science or related field
  • Expert knowledge of databases and SQL
  • Experience with Python or relevant scripting language
  • Experience building data pipelines from end to end:
    • Understanding business use cases and requirements for different internal teams
    • Prototyping initial collection and leveraging existing tools and/or creating new tools
    • Building and deploying scalable data pipelines for production
    • Maintenance of such pipelines with a focus on performance and data quality
  • Experience working with different types of datasets (e.g. unstructured, semi-structured, with missing information)
  • Experience with Azure Dev Ops or other cloud provider technology stacks
  • Experience in code versioning and repository software
  • Proven track record working in an agile framework driving value to the business in beneficial increments
  • Ability to think critically and creatively in a dynamic environment, while picking up new tools and domain knowledge along the way
  • A positive attitude, and a growth mindset
  • Excellent programming skills coupled with an understanding of software design patterns and good engineering practices

Additional experience

  • Familiarity with different data stores (e.g. flat files, buckets, graph, columnar, NoSQL)
  • Experience with open-source data processing frameworks (e.g. Spark)
  • Experience with ETL/data movement (hand-coded or using commercial/open source tools)
  • Experience with data mining and machine learning
  • Python webapp development skills (Flask/Django/Dash)
  • Experience using property, geospatial, and image data.
  • Experience solving financial and risk domain related problems

Two people with surfboards

We are Oliver James and we bring

people together

Click below to watch the launch video for the new Oliver James brand