PhD in Adapting Transformer Models for Defect Detection with Limited Data

Introduction

Join the NWO Perspectief FIND program and develop methods to adapt Transformer-based foundation models for defect detection where data is scarce and unlabeled. Explore few-shot learning, self-supervised adaptation, and synthetic data generation to enable robust, scalable AI in semiconductor and printing systems. Work with leading industry partners like Canon and help transform quality inspection in next-generation high-tech equipment!

Job Description

Industrial edge deployments—in semiconductor manufacturing, industrial printing systems, automotive radar, smart mobility cameras, and HealthTech—require on-device AI to ensure low latency, privacy, and resilience. Today’s Transformers models scale poorly and assume abundant cloud resources. The research program FIND aims to deliver architectural and algorithmic breakthroughs that enable foundation models to run predictably and efficiently on embedded processors and accelerators.

FIND is a research program funded by the Dutch government and industry that brings together 5 universities, 11 companies (startups to multinationals), and 2 knowledge institutes to develop foundation models (large AI models) for Dutch high‑tech industry, with strong emphasis on edge deployment, privacy, and timely decision‑making. Partners include ASML, NXP, Canon Production Printing, ASMPT, Technolution, Signify, Shell, Stryker, TNO, and others. A total of 12 PhDs will be employed on the FIND program covering topics from foundation model pre-training and multimodal adaptation to architectures and compression for edge deployment while targeting real-world validation in domains like HealthTech, smart industry, and autonomous mobility.

This PhD position focuses on adapting and fine-tuning Transformer-based foundation models for defect detection in high-tech manufacturing environments where only limited and largely unlabeled defect data is available. Current solutions typically rely on supervised CNN-based models trained on large labeled datasets, which fail when defects are rare, vary across machines, or when labeling is prohibitively expensive. These approaches lack flexibility and generalization, making them unsuitable for dynamic industrial settings with scarce and imbalanced data.

You will also explore few-shot learning, self-supervised adaptation, and multimodal integration techniques to overcome data scarcity and improve robustness. Unlike existing methods that depend on exhaustive annotation or handcrafted features, this research will leverage the rich representations of foundation models and develop strategies for zero-shot or few-shot adaptation. You will investigate domain adaptation, synthetic data generation, and cross-modal learning to enable models that generalize across defect types and machine configurations. This ensures scalable, accurate defect detection even in low-resource industrial contexts.

The resulting models will be validated in collaboration with a lead high-tech company, demonstrating how foundation models can transform quality inspection by reducing dependency on labeled data and enabling rapid adaptation to new defect patterns—closing the gap between AI capability and real-world manufacturing constraints.

Research group and company

This position is embedded in the Mobile Perception Systems (MPS) Lab and Electronic Systems (ES) group within the Electrical Engineering department at Eindhoven University of Technology (TU/e). The MPS lab and ES group have a strong history of collaborative research projects leading to real-world impact.

This PhD project is executed in close collaboration with Canon Production Printing which is a global leader in high-end digital printing, offering advanced hardware, software, and services aimed at professional and industrial-scale print environments.

Job Requirements

• A master’s degree (or an equivalent university degree) in Computer Science, Electrical Engineering, Artificial Intelligence, or related background.
• Strong background in machine learning, computer vision, and deep learning.
• Knowledge of transformer architectures and foundation models.
• Experience with few-shot learning, self-supervised learning, or domain adaptation is a plus.
• Proficiency in Python and deep learning frameworks (PyTorch, TensorFlow).
• Ability to work in an interdisciplinary team.
• Motivated to develop your teaching skills and coach students.
• Fluent in spoken and written English (C1 level).   
  
  

Conditions of Employment

A meaningful job in a dynamic and ambitious university, in an interdisciplinary setting and within an international network. You will work on a beautiful, green campus within walking distance of the central train station. In addition, we offer you: 

• Full-time employment for four years, with an intermediate assessment after nine months. You will spend a minimum of 10% of your four-year employment on teaching tasks, with a maximum of 15% per year of your employment. 
• Salary and benefits (such as a pension scheme, paid pregnancy and maternity leave, partially paid parental leave) in accordance with the Collective Labour Agreement for Dutch Universities, scale P (min. € 3,059 - max. € 3,881).  
• A year-end bonus of 8.3% and annual vacation pay of 8%. 
• High-quality training programs and other support to grow into a self-aware, autonomous scientific researcher. At TU/e we challenge you to take charge of your own learning process. 
• An excellent technical infrastructure, on-campus children's day care and sports facilities.  
• An allowance for commuting, working from home and internet costs. 
• A Staff Immigration Team and a tax compensation scheme (the 30% facility) for international candidates. 

About us

Eindhoven University of Technology is a leading international university within the Brainport region where scientific curiosity meets a hands-on mindset. We work in an open and collaborative way with high-tech industries to tackle complex societal challenges. Our responsible and respectful approach ensures impact — today and in the future. TU/e is home to over 13,000 students and more than 7,000 staff, forming a diverse and vibrant academic community.

The mission of the Department of Electrical Engineering is to acquire, share and transfer knowledge and understanding in the whole field of Electrical Engineering through education, research and valorization. We work towards a ‘Smart Sustainable Society’, a ‘Connected World’, and a healthy humanity (‘Care & Cure’). Activities share an application-oriented character, a high degree of complexity and a large synergy between multiple facets of the field.

Research is carried out into the applications of electromagnetic phenomena in all forms of energy conversion, telecommunication and electrical signal processing. Existing and new electrical components and systems are analyzed, designed and built. The Electrical Engineering department takes its inspiration from contacts with high-tech industry in the direct surrounding region and beyond.

The department is innovative and has international ambitions and partnerships. The result is a challenging and inspiring setting in which socially relevant issues are addressed.

Information

Do you recognize yourself in this profile and would you like to know more? Please contact the hiring manager dr.ir. Sander Stuijk, s.stuijk@tue.nl.

Visit our website for more information about the application process or the conditions of employment. You can also contact Kevin Caris, HR advisor, k.t.caris@tue.nl or +31 40 247 8835.

Curious to hear more about what it’s like as a PhD candidate at TU/e? Please view the video.

Are you inspired and would like to know more about working at TU/e? Please visit our career page.

Application

We invite you to submit a complete application by using the apply button. The application should include a:

• Cover letter in which you describe your motivation and qualifications for the position.
• Curriculum vitae, including a list of your publications and the contact information of three references. Kindly note that we may reach out to references at any stage of the recruitment process. We recommend notifying your references upon submitting your application.

Ensure that you submit all the requested application documents. We give priority to complete applications.

We look forward to receiving your application and will screen it as soon as possible. The vacancy will remain open until the position is filled.

Please note

• You can apply online. We will not process applications sent by email and/or post. 
• A pre-employment screening (e.g. knowledge security check) can be part of the selection procedure. For more information on the knowledge security check, please consult the National Knowledge Security Guidelines.
• Please do not contact us for unsolicited services.