Metamorphic Testing Papers
Remark: This website is only used for collecting and grouping the related Metamorphic Testing paper.
FSE 2026
MR-Coupler: Automated Metamorphic Test Generation via Functional Coupling Analysis
Validating LLM-Generated SQL Queries Through Metamorphic Prompting
ICSE 2026
Metamorphic Fuzzing for Multi-Agent Path Finding Algorithms
META$^2$V2V: Revealing Behavioural Deviations under Mutual Perception in Multi-Vehicle Autonomous Driving
TSE 2026
How Composite Metamorphic Relations Enhance Test Effectiveness of DNN Testing: An Empirical Study
ASE 2025
Metamorphic Testing for Audio Content Moderation Software - abstract / arXiv
FSE 2025
Detecting and Reducing the Factual Hallucinations of Large Language Models with Metamorphic Testing - abstract
Hallucination Detection in Large Language Models with Metamorphic Relations - abstract / arXiv
ICSE 2025
ChatGPT Inaccuracy Mitigation during Technical Report Understanding: Are We There Yet? - abstract / arXiv
ROSA: Finding Backdoors with Fuzzing - abstract / github.io
Metamorphic-Based Many-Objective Distillation of LLMs for Code-related Tasks - abstract / TUDelft
ISSTA 2025
Improving Deep Learning Framework Testing with Model-Level Metamorphic Testing - abstract
QTRAN: Extending Metamorphic-Oracle based Logical Bug Detection Techniques for Multiple-DBMS Dialect Support - abstract
TOSEM 2025
Identifying the Failure-Revealing Test Cases in Metamorphic Testing: A Statistical Approach - abstract / ACM
Metamorphic Relation Generation: State of the Art and Research Directions.
TSE 2025
Using Cooperative Co-evolutionary Search to Generate Metamorphic Test Cases for Autonomous Driving Systems - abstract / arXiv
Testing CPS With Design Assumptions-Based Metamorphic Relations and Genetic Programming
SANER 2025
Can Large Language Models Discover Metamorphic Relations? A Large-Scale Empirical Study - abstract
ASE 2024
MR-Adopt: Automatic Deduction of Input Transformation Function for Metamorphic Testing - abstract / ACM / IEEE
Evaluating Terminology Translation in Machine Translation Systems via Metamorphic Testing
FSE 2024
Abstraction-Aware Inference of Metamorphic Relations - abstract
A Miss Is as Good as A Mile: Metamorphic Testing for Deep Learning Operators - abstract
Metamorphic Testing of Secure Multi-Party Computation (MPC) Compilers - abstract
ICSE 2024
EDEFuzz: A Web API Fuzzer for Excessive Data Exposures - abstract
OOPSLA 2024
Drowzee: Metamorphic Testing for Fact-Conflicting Hallucination Detection in Large Language Models - abstract
TOSEM 2024
Word Closure-Based Metamorphic Testing for Machine Translation - abstract
MET-MAPF: A Metamorphic Testing Approach for Multi-Agent Path Finding Algorithms - abstract
MR-Scout: Automated Synthesis of Metamorphic Relations from Existing Test Cases - abstract
TSE 2024
GenMorph: Automatically Generating Metamorphic Relations via Genetic Programming - abstract
Metamorphic Testing of Image Captioning Systems via Image-Level Reduction
AIM: Automated Input Set Minimization for Metamorphic Security Testing
SANER 2024
Testing Constraint Checking Implementations via Principled Metamorphic Transformations
ICSE 2023
MorphQ: Metamorphic Testing of the Qiskit Quantum Computing Platform - abstract
MTTM: Metamorphic Testing for Textual Content Moderation Softwar - abstract
Metamorphic Shader Fusion for Testing Graphics Shader Compilers - abstract
Metamorphic Testing with Causal Graphs - abstract
CCTest: Testing and Repairing Code Completion Systems - abstract
ISSTA 2023
Dependency-Aware Metamorphic Testing of Datalog Engines - abstract
ECSTATIC: Automatic Configuration-Aware Testing and Debugging of Static Analysis Tools - abstract
TOSEM 2023
Feedback-directed Metamorphic Testing - abstract
TSE 2023
Metamorphic Testing for Web System Security - abstract
ASE 2022
ElecDaug: Electromagnetic Data Augmentation for Model Repair based on Metamorphic Relation - abstract
Unveiling Hidden DNN Defects with Decision-Based Metamorphic Testing - abstract
ISSTA 2022
One Step Further: Evaluating Interpreters using Metamorphic Testing - abstract
Metamorphic Relations via Relaxations: An Approach to Obtain Oracles for Action-Policy Testing - abstract
TSE 2022
Using Metamorphic Testing to Improve the Quality of Tags in OpenStreetMap - abstract
A Declarative Metamorphic Testing Framework for Autonomous Driving - abstract
ASE 2021
Assessing Robustness of ML-Based Program Analysis Tools using Metamorphic Program Transformations - abstract
Metamorphic Testing on Multi-module UAV Systems - abstract
FSE 2021
Generating Metamorphic Relations for Cyber-physical Systems with Genetic Programming: An Industrial Case Study - abstract
New Visions on Metamorphic Testing after a Quarter of a Century of Inception - abstract
Metamorphic Testing of Datalog Engines - abstract
TSE 2021
Enhance Combinatorial Testing With Metamorphic Relations - abstract
Metamorphic Robustness Testing: Exposing Hidden Defects in Citation Statistics and Journal Impact Factors - abstract
BiasFinder: Metamorphic Test Generation to Uncover Bias for Sentiment Analysis Systems - abstract
ASE 2020
TestMC: Testing Model Counters using Differential and Metamorphic Testing - abstract
Metamorphic Object Insertion for Testing Object Detection Systems - abstract
TSE 2020
Theoretical and Empirical Analyses of the Effectiveness of Metamorphic Relation Composition - abstract
TSE 2019
METRIC+: A Metamorphic Relation Identification Technique Based on Input Plus Output Domains - abstract
ASE 2018
DeepRoad: GAN-based Metamorphic Testing and Input Validation Framework for Autonomous Driving Systems - abstract
CSUR 2018
Metamorphic Testing: A Review of Challenges and Opportunities - abstract
ISSTA 2018
Identifying Implementation Bugs in Machine Learning Based Image Classifiers using Metamorphic Testing - abstract
TSE 2018
Metamorphic Relations for Enhancing System Understanding and Use - abstract
OOPSLA 2017
Automated testing of graphics shader compilers - [abstract] / ACM
JSS 2016
METRIC: METamorphic Relation Identification based on the Category-choice framework - abstract
TSE 2016
A Survey on Metamorphic Testing - abstract
Metamorphic Testing for Software Quality Assessment: A Study of Search Engines - abstract
ICSE 2015
Metamorphic Model-Based Testing Applied on NASA DAT - An Experience Report - abstract
ASE 2014
Search-based Inference of Polynomial Metamorphic Relations - abstract
TSE 2013
How Effectively Does Metamorphic Testing Alleviate the Oracle Problem? - abstract