Our paper “Rethinking Mutation Testing When the Natural Language Specification Is the Program” has been accepted to ICSE 2027.
About
Making software and AI dependable.
I am a postdoctoral researcher at the TAU Lab at Università della Svizzera italiana (USI), led by Prof. Paolo Tonella.
I completed my Ph.D. at KAIST under the supervision of Prof. Shin Yoo. My research bridges software engineering and artificial intelligence, with a focus on testing, reliability, robustness, interpretability, and assurance for learning-enabled systems.
- Software testing
- AI assurance
- Learning-enabled systems
- Robustness & interpretability
Updates
Latest news
2026
Our paper “When Knowledge Changes: Metamorphic Testing of RAG Systems with Mutations” has been accepted for publication in ASE 2026.
Our paper “Testing Retrieval-Augmented Generation Systems with Chunk Coverage” has been accepted for publication in ISSTA 2026.
I joined the organizing committee for ICST 2027 as a Posters Track Co-chair.
I joined the PC of ICSE 2027 and Mutation 2026.
I joined the organizing committee for SSBSE 2026 as a Publicity Co-chair.
I joined the PC of ASE 2026.
2025
Our paper “Revisiting “Revisiting Neuron Coverage for DNN Testing: A Layer-Wise and Distribution-Aware Criterion”: A Critical Review and Implications on DNN Coverage Testing” has been accepted for publication in ICSE 2026.
The paper “A Taxonomy of System-Level Attacks on Deep Learning Models in Autonomous Vehicles” has been accepted for publication in TOSEM. This is the second paper of mine with my PhD student, Masoud Jamshidiyan Tehrani.
Our paper, “Evaluating and Improving the Robustness of Security Attack Detectors Generated by LLMs” has been accepted for publication in Empirical Software Engineering. This marks the first paper from my PhD student, Samuele Pasini.
I serve as a co-chair of the Testing Tools and Data Showcase Track at ICST 2026.
I am organising SBFT 2026 and DeepTest 2026, both of which will be co-located with ICSE 2026.
The paper “An Empirical Study of Fault Localisation Techniques for Deep Neural Networks” has been accepted for publication in Empirical Software Engineering.
The paper “PCLA: A Framework for Testing Autonomous Agents in the CARLA Simulator” has been accepted for FSE 2025 (Demonstrations Track).
I joined the program committee of ASE 2025 (NIER Track, Student Research Competition Track) and DeMeSSAI 2025.
2024
I joined the program committee of SBFT 2025 and Mutation 2025.
I am organising DeepTest 2025, co-located with ICSE 2025.
I joined the program committee of ASE 2024 (Demonstrations Track, NIER Track).
I joined the program committee of ISSTA 2025 (Research Track).
I joined the TOSEM Board of Distinguished Reviewers.
2023
I’m thrilled to share that I’m beginning a postdoc at USI Lugano under the guidance of Prof. Paolo Tonella!
Our paper wins a best paper award at Mutation 2023.
2022
In collaboration with TAU Lab, our paper “Repairing DNN Architecture: Are We There Yet?” has been accepted to publication at ICST 2023 (Research Papers Track).
I’m delighted to announce that I have successfully defended my Ph.D. thesis!
I’ll visit Prof. Paolo Tonella at Università della Svizzera italiana (USI) for two months.
I successfully completed my dissertation proposal.
Recent work
Latest publications
-
Selected publication. ICSE 2027Rethinking Mutation Testing When the Natural Language Specification Is the Program
Proceedings of the 49th IEEE/ACM International Conference on Software Engineering
-
TRUST 2026
Dynamic Deception: When Pedestrians Team Up to Fool Autonomous Cars
Proceedings of the 1st International Workshop on Trustworthy and Responsible aUtonomous SysTems
-
Selected publication. ASE 2026When Knowledge Changes: Metamorphic Testing of RAG Systems with Mutations
Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering
Research output
Publications
For an up-to-date list of publications and citation counts, visit my Google Scholar profile. Unless otherwise specified, publications appeared in the main research track.
Selected publications
Journals 7 papers
-
JSS 2026
Cross-Site Scripting Adversarial Attacks Based on Deep Reinforcement Learning: Evaluation and Extension Study
Journal of Systems and Software
-
Selected publication. TOSEM 2025A Taxonomy of System-Level Attacks on Deep Learning Models in Autonomous Vehicles
ACM Transactions on Software Engineering and Methodology
Presented at the journal-first track of ICSE 2026
-
Selected publication. EMSE 2025Evaluating and Improving the Robustness of Security Attack Detectors Generated by LLMs
Empirical Software Engineering
Presented at the journal-first track of ICSE 2026
-
Selected publication. EMSE 2025An Empirical Study of Fault Localisation Techniques for Deep Neural Networks
Empirical Software Engineering
Presented at the journal-first track of ICST 2026
-
Selected publication. TOSEM 2023Evaluating Surprise Adequacy for Deep Learning System Testing
ACM Transactions on Software Engineering and Methodology
-
IST 2023
Learning Test-Mutant Relationship for Accurate Fault Localisation
Information and Software Technology
-
Selected publication. TOSEM 2022Predictive Mutation Analysis via Natural Language Channel in Source Code
ACM Transactions on Software Engineering and Methodology
Presented at the journal-first track of ICSE 2023
Conferences & workshops 18 papers
-
Selected publication. ICSE 2027Rethinking Mutation Testing When the Natural Language Specification Is the Program
Proceedings of the 49th IEEE/ACM International Conference on Software Engineering
-
TRUST 2026
Dynamic Deception: When Pedestrians Team Up to Fool Autonomous Cars
Proceedings of the 1st International Workshop on Trustworthy and Responsible aUtonomous SysTems
-
Selected publication. ASE 2026When Knowledge Changes: Metamorphic Testing of RAG Systems with Mutations
Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering
-
Selected publication. ISSTA 2026Testing Retrieval-Augmented Generation Systems with Chunk Coverage
Proceedings of the 35th ACM International Symposium on Software Testing and Analysis
-
Selected publication. ICSE 2026Revisiting "Revisiting Neuron Coverage for DNN Testing: A Layer-Wise and Distribution-Aware Criterion": A Critical Review and Implications on DNN Coverage Testing
Proceedings of the 48th IEEE/ACM International Conference on Software Engineering
-
FSE Demo 2025
PCLA: A Framework for Testing Autonomous Agents in the CARLA Simulator
Proceedings of ACM on the Foundations of Software Engineering
-
Selected publication. ICST 2023Repairing DNN Architecture: Are We There Yet?
Proceedings of the 16th IEEE International Conference on Software Testing, Verification and Validation
-
Mutation 2023
The Inversive Relationship Between Bugs and Patches: An Empirical Study
Proceedings of the 18th International Workshop on Mutation Analysis
Best Paper Award
-
ICST Industry 2022
Repairing Fragile GUI Test Cases Using Word and Layout Embedding
Proceedings of the 15th IEEE International Conference on Software Testing, Verification and Validation
-
Selected publication. ISSRE 2021Ahead of Time Mutation Based Fault Localisation Using Statistical Inference
Proceedings of the 32nd International Symposium on Software Reliability Engineering
Invited for a special issue of IST Journal
-
FSE Industry 2020
Reducing DNN Labelling Cost Using Surprise Adequacy: An Industrial Case Study for Autonomous Driving
Proceedings of ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
-
Selected publication. ICSE 2019Guiding Deep Learning System Testing Using Surprise Adequacy
Proceedings of the 41st IEEE/ACM International Conference on Software Engineering
-
SSBSE 2018
Learning Without Peeking: Secure Multi-Party Computation Genetic Programming
Proceedings of the 10th International Symposium on Search Based Software Engineering
-
L@S 2018
Elicast: Embedding Interactive Exercises in Instructional Programming Screencasts
Proceedings of the Fifth Annual ACM Conference on Learning at Scale
-
GI 2018
Comparing Line and AST Granularity Level for Program Repair Using PyGGI
Proceedings of the 4th Genetic Improvement Workshop
-
KCSE 2017
PyGGI: Python General framework for Genetic Improvement
Proceedings of Korea Software Congress
-
SSBSE Short Papers 2017
GPGPGPU: Evaluation of Parallelisation of Genetic Programming Using GPGPU
Proceedings of the 9th International Symposium on Search Based Software Engineering
-
CHI 2016
BeUpright: Posture Correction Using Relational Norm Intervention
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
Thesis 1 dissertation
-
Ph.D. 2023
Exploiting Mutant’s Relationship with Code, Faults, and Patches for Higher Efficacy of Mutation Analysis
KAIST, February 2023
Organizing & reviewing
Community service
Organizing
3 yearsProgram committees
8 years- 2027 ICSE Research Track
- 2026 ASE Research Track ESEM Research Track ICST Education Track Mutation RASE
- 2025 ISSTA Research Track ASE NIER Track ASE Student Research Competition SSBSE SBFT Mutation DeMeSSAI
- 2024 SCAM Research Track ICSE Demonstrations Track ASE Demonstrations Track ASE NIER Track DeepTest Mutation
- 2023 Mutation ASE NIER Track ICSME Artifact Evaluation Track
- 2022 Mutation ICST Posters Track ICSME Registered Reports Track ICSME Artifact Evaluation Track
- 2021 Mutation ICSME Artifact Evaluation Track
- 2020 Mutation
Reviewing
7 years- 2026 EMSE Reviewer
- 2025 TOSEM Board of Distinguished Reviewers TSE Reviewer TOSEM Reviewer EMSE Reviewer STVR Reviewer IEEE Computer Reviewer
- 2024 TOSEM Board of Distinguished Reviewers TSE Reviewer TOSEM Reviewer EMSE Reviewer JSEP Reviewer JSS Reviewer
- 2023 TSE Reviewer TOSEM Reviewer EMSE Reviewer JSEP Reviewer
- 2022 TOSEM Reviewer JSEP Reviewer
- 2021 TOSEM Reviewer STVR Reviewer
- 2020 IST Reviewer JSS Reviewer