Senior Data Engineer (Databricks)

About the job

Join our research team as an experienced data analyst, delivering actionable data driven insights across diverse global shipping, trade, offshore, renewables and energy datasets. You will help us build and derive valuable data used widely to analyse impacts of market trends, geopolitics, and decarbonisation.

What you'll be doing:

- Lead in proposing plans and implementing systems for processing and analysing big data sets - Develop and use algorithmic and machine learning techniques to extract, transform, derive, aggregate and validate data - Work alongside data analysts and developers to deliver big data processing solutions and analytics - Collaborate with stakeholders for requirement gathering, plan project deliverables, and track implementation with analysts, data engineers and developers - Lead implementation of ETL and processing pipelines, data derivation and analysis - Work in a fast-paced, motivated and agile team, supporting clients and reporting progress to senior management

You'll need to have:

- 4+ years' experience working with Big Data tools including: Databricks, Apache Spark, Kafka, Data Lakes - Experience designing and scaling Big Data systems including partitioning strategies - Excellent demonstratable SQL skills including complex queries, stored procedures, Spark SQL, and Spark Streaming abilities - Expert in Spark optimization, Delta, and Databricks Lakehouse - Working knowledge of Azure, including streaming data from Event Hubs or Kafka - Working knowledge of Python or PySpark - Comfortable with Git in Azure DevOps and Infrastructure as Code (IaC) provisioning - A degree in relevant numerate or analytical subject - Good organisational skills and strong attention to detail

We love to see:

- Curiosity and willingness to learn new techniques, programming languages and software tools - Appreciation of the wider data science technology landscape - Any spatial data experience using H3 indexes - Any knowledge of the maritime, offshore oil and gas, or offshore renewable industries - Awareness of global trade, economics and statistics

Working at Clarksons Research:

Clarksons Research is the leading global provider of intelligence and research across shipping, trade, offshore and energy. Respected worldwide, the Clarksons Research team of over 175 experts provides powerful analysis, insight, and data through a range of online platforms, reports, valuations, and consultancy work. Clarksons Research is part of the Clarksons Group, the world's leading integrated shipping services provider and a FTSE 250 company.

Clarksons Research is currently offering exciting opportunities for experienced senior data engineers to join its expanding Development team. Successful candidates will join a fast-expanding business offering excellent opportunities for career progression within a supportive organisation with a strong track record of training, mentoring and ensuring people reach their full potential. We offer a competitive range of benefits including 21-days holiday and health insurance.

Details:

Salary: Competitive (dependent on experience) plus bonus and benefits

Location: Gurgaon, Delhi

Number of vacancies: 1-2

Start date: Q2 2026

Closing date: 30 March 2026 (though applications reviewed and accepted immediately)

Think you'd be a good fit:

To prioritise your application for immediate review or to highlight relevant maritime or energy industry experience, please send a CV and letter directly to Apeksha Mehta at recruitment.crs@clarksons.com quoting reference CRSL/RES-DEV- DEL/516

In the meantime, have a look at www.clarksons.net/about-us and www.clarksons.com/research

What to expect from us:

We believe in human insights, and all applications are reviewed by real people, not algorithms. We know your time is valuable and aim to keep to a two-stage process where possible.