Role Overview:
As a Senior Data Engineer, you will play a critical role in advancing our AI solutions, and pruning CNNs to achieve high-performance, low-latency processing.
Key Responsibilities:
You will be responsible for developing, optimizing, and deploying data pipelines and machine learning models. Ideally, this role couples deep understanding of the mathematical foundations with the technical expertise and solid background in hardware.
Experience:
Requirements:
Preferred Qualifications:
Other requirements:
As a Senior Data Engineer, you will play a critical role in advancing our AI solutions, and pruning CNNs to achieve high-performance, low-latency processing.
Key Responsibilities:
You will be responsible for developing, optimizing, and deploying data pipelines and machine learning models. Ideally, this role couples deep understanding of the mathematical foundations with the technical expertise and solid background in hardware.
Experience:
- Demonstrated proficiency with PyTorch, NumPy, scikit-learn, and pandas, with a solid understanding of syntax and core operations (e.g. convolutions, activations).
- Experience with model quantization and pruning techniques, like PTQ or QAT is a plus.
- Versioning models, including hyperparameters, metrics, and managing checkpoints.
- Experience in deploying and training models from repositories.
- Proven skills of writing/selecting metrics, loss functions, samplers, and schedulers tailored to specific tasks.
- Experience working with ClearML (or alternatives like MLFlow).
- Deep understanding of YOLO models: architecture, training, and deployment in real-time object detection and classification tasks.
- Experience in collecting and labeling CV datasets for classification, detection, and segmentation.
- Data versioning, creating file lists for training (balancing data across classes while maximizing intra-class diversity).
- Writing data processing pipelines (e.g., using Snakemake or other tools).
- Data storage management, creating backup storage, and managing backups.
Requirements:
- Strong foundation in Mathematical Analysis, Advanced Mathematics, and Mathematical Statistics.
Preferred Qualifications:
- Advanced degree in mathematics, data management, statistics, hardware or software engineering;
- experience with high-performance computing and understanding hardware is a plus;
- strong problem-solving, communication, and project management skills.
Other requirements:
- The company is based in Abu Dhabi, UAE so relocation to the UAE is a must.
- Language proficiency in English: B2 or higher.
