SA
Data Engineer (Detect & Track Distillation)
Contract type
Ongoing
Work mode
Remote · Paris, France
Experience
3 years
Job description
Data Engineer role at Harmattan AI, owning the data layer that feeds ML teams' models, from raw field logs and public datasets through curated, versioned, training-ready datasets. Based out of Paris, Lausanne, or Zurich.
At a glance
- Work mode
- Remote · Paris, France
What you'll do
- Ingest, decode, and store raw, unstructured field data (video and other sensor streams) from field logs into efficient, controlled formats.
- Align multiple data streams temporally and spatially so paired data is usable for training.
- Transfer both ingested data and public datasets into high-value data, including parsing, filtering, de-duplication and revision.
- Define which data to gather and what and how to label it, and own the dataset-construction workflow and labeling tooling.
- Coordinate with the teams responsible for data gathering and labeling.
- Build task-specific datasets for the team's training and evaluation needs, in collaboration with acquisition, annotation and product teams.
- Version datasets and maintain lineage so training runs stay reproducible.
- Store data in efficient, training-ready formats (such as columnar or sharded formats) and manage storage tiering to balance cost and latency as datasets grow.
- Deliver clean, documented datasets and the corresponding tools for loading to keep training from being I/O-bound, shaping their structure with the modelers.
What we're looking for
- A degree in a STEM field, or equivalent practical experience.
- Built and maintained pipelines for unstructured data at scale (video, images, or sensor data), covering ingestion, decode, storage, curation, and versioning.
- Strong in Python and data engineering, and comfortable optimizing data loaders for common training frameworks (for example PyTorch).
- Systematic, quality-minded, pragmatic, and service-oriented so the modelers are enabled, with a knack for taming messy data via automation.
- 100% dedication to Harmattan AI's mission of providing a defensive edge to allied nations through ethical, high-impact technology.
Nice to have
- Multimodal sensor data, labeling or dataset construction for ML, dataset versioning tooling, and distributed data processing tooling.
Apply
About Harmattan AI
A next-generation defense prime building autonomous and scalable defense systems.
Harmattan AI is a next-generation defense prime building autonomous and scalable defense systems. Following the close of a $200M Series B, valuing the company at $1.4 billion, they are expanding their teams and capabilities to deliver mission-critical systems to allied forces.
Mission
Providing a defensive edge to allied nations through ethical, high-impact technology.
Key facts
- Defense
- Closed a $200M Series B
- Valued at $1.4 billion
- Delivers mission-critical systems to allied forces
What they value
- Building technologies with real-world impact
- Pursuing excellence in everything we do
- Setting ambitious goals
- Taking on the hardest technical challenges