Professor Phil McMinn
PhD
School of Computer Science
Professor of Software Engineering
PGR lead
Head of the Testing research group
p.mcminn@sheffield.ac.uk
+44 114 222 1826
+44 114 222 1826
Regent Court (DCS)
Full contact details
Professor Phil McMinn
School of Computer Science
Regent Court (DCS)
211 Portobello
91Ö±²¥
S1 4DP
School of Computer Science
Regent Court (DCS)
211 Portobello
91Ö±²¥
S1 4DP
- Profile
-
Phil McMinn is a Professor of Software Engineering who specialises in software testing. He primarily works on developing automated techniques to assist software engineers in developing test suites that are effective at finding bugs and are efficient to maintain.
While he is well-known in the software testing field for his work in search-based automatic test data generation, his research has tackled a variety of problems including test flakiness, test oracles, and ensuring test quality through mutation analysis.
His work has been funded by Meta (Facebook), the EPSRC, and HEFCE.
- Research interests
-
- Software testing
- Search-based software engineering,
- Test oracles
- Test flakiness
- Mutation analysis
- Publications
-
Journal articles
- . ACM SIGSOFT Software Engineering Notes, 49(3), 35-36.
- Foreword to the 1st International Flaky TestsWorkshop 2024 (FTW2024). Proceedings - 2024 IEEE/ACM International Flaky Tests Workshop, FTW 2024, VI-VII.
- . Empirical Software Engineering, 28.
- A Survey of the Metrics, Uses, and Subjects of Diversity-Based Techniques in Software Testing.. CoRR, abs/2311.09714.
- . ACM Transactions on Software Engineering and Methodology, 31(1), 1-74.
- . Software Testing, Verification and Reliability.
- . IEEE Transactions on Software Engineering, 45(5), 427-463.
- . Software Testing, Verification & Reliability.
- . IEEE Transactions on Software Engineering.
- . ACM Transactions on Software Engineering and Methodology, 25(1), 1-49.
- . Theoretical Computer Science, 605, 1-20.
- . IEEE Transactions on Software Engineering, 41(5), 507-525.
- . Journal of Systems and Software, 103(C), 311-327.
- . Science of Computer Programming, 97(4), 405-425.
- . Journal of Systems and Software.
- . Journal of Systems and Software.
- . Information and Software Technology.
- . Integr Biol (Camb), 4(1), 53-64.
- . IEEE Transactions on Software Engineering, 38(2), 453-477.
- . 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops.
- . J SYST SOFTWARE, 83(12), 2379-2391.
- . IEEE T SOFTWARE ENG, 36(2), 226-247.
- . ACM T SOFTW ENG METH, 18(3).
- . Biosystems, 93(1-2), 141-150.
- Editorial: Testing practice and research.. Softw. Test. Verification Reliab., 18, 69-70.
- . PLoS One, 3(5), e2129.
- . J R Soc Interface, 4(17), 1077-1092.
- . SOFTW TEST VERIF REL, 16(3), 131-132.
- Development and validation of an agent-based computational model of normal human keratinocytes organisation in vitro. European Cells and Materials, 11(SUPPL.2), 28.
- . Evol Comput, 14(1), 41-64.
- Search-based software test data generation: a survey. SOFTW TEST VERIF REL, 14(2), 105-156.
- . Software Testing, Verification and Reliability.
- Automated Visual Classification of DOM-based Presentation Failure Reports for Responsive Web Pages. Software Testing, Verification and Reliability.
Chapters
- , Search-Based Software Engineering (pp. 19-34). Springer International Publishing
- (pp. 1-59).
- (pp. 320-344).
Conference proceedings papers
- . Proceedings of the 5th ACM/IEEE International Conference on Automation of Software Test (AST 2024)
- . 2023 IEEE Conference on Software Testing, Verification and Validation (ICST), 16 April 2023 - 20 April 2023.
- . Proceedings of the 44th International Conference on Software Engineering: Software Engineering in Practice
- . Proceedings of the 3rd ACM/IEEE International Conference on Automation of Software Test
- . 2022 IEEE/ACM 44th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP), 22 May 2022 - 24 May 2022.
- . 2022 IEEE Conference on Software Testing, Verification and Validation (ICST), 4 April 2022 - 14 April 2022.
- . 2022 IEEE Conference on Software Testing, Verification and Validation (ICST), 4 April 2022 - 14 April 2022.
- Diagnosability, Adequacy & Size: How Test Suites Impact Autograding. Proceedings of the Annual Hawaii International Conference on System Sciences, Vol. 2022-January (pp 861-870)
- . Proceedings of the 52nd ACM Technical Symposium on Computer Science Education
- . 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET), 25 May 2021 - 28 May 2021.
- . 2020 IEEE 32nd Conference on Software Engineering Education and Training (CSEE&T), 9 November 2020 - 12 November 2020.
- . Proceedings of the IEEE/ACM 1st International Conference on Automation of Software Test
- . 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST), 24 October 2020 - 28 October 2020.
- . Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops
- The Influence of Test Suite Properties on Automated Grading of Programming Exercises. 2020 IEEE 32ND CONFERENCE ON SOFTWARE ENGINEERING EDUCATION AND TRAINING (CSEE&T) (pp 105-114)
- . 2019 IEEE International Conference on Software Maintenance and Evolution (ICSME) (pp 437-448). Cleveland, OH, USA, 30 September 2019 - 4 October 2019.
- . 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST). Xian, China, 22 April 2019 - 27 April 2019.
- . 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST), 22 April 2019 - 27 April 2019.
- . 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET), 25 May 2019 - 31 May 2019.
- . Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis - ISSTA 2018, 16 July 2018 - 21 July 2018.
- . 2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST) (pp 12-22), 9 April 2018 - 13 April 2018.
- . Proceedings of the International Conference on Software Testing, Verification and Validation (ICST 2018) (pp 215-226), 9 April 2018 - 13 April 2018.
- . Proceedings of the 40th International Conference on Software Engineering (pp 140-150), 27 May 2018 - 3 June 2018.
- . Proceedings of the 13th International Workshop on Automation of Software Test - AST '18, 28 May 2018 - 29 May 2018.
- . Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis (pp 249-260). New York
- (pp 143-149)
- . Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis - ISSTA 2017, 10 July 2017 - 14 July 2017.
- . Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis - ISSTA 2017, 10 July 2017 - 14 July 2017.
- . 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C), 20 May 2017 - 28 May 2017.
- . Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis - ISSTA 2017, 10 July 2017 - 14 July 2017.
- . SBST '16 Proceedings of the 9th International Workshop on Search-Based Software Testing (pp 43-44), 16 May 2016 - 17 May 2016.
- . AST '16 Proceedings of the 11th International Workshop on Automation of Software Test (pp 36-42), 14 May 2016 - 22 May 2016.
- . SBST '16 Proceedings of the 9th International Workshop on Search-Based Software Testing (pp 55-56), 16 May 2016 - 17 May 2016.
- (pp 259-266)
- . 2016 IEEE International Conference on Software Maintenance and Evolution (ICSME), 2 October 2016 - 7 October 2016.
- . 2016 IEEE International Conference on Software Maintenance and Evolution (ICSME), 2 October 2016 - 7 October 2016.
- . 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE), 9 November 2015 - 13 November 2015.
- . ACM Transactions on Software Engineering and Methodology, Vol. 24(4), 15 July 2013 - 20 July 2013.
- EXPOSE: Inferring worst-case time complexity by automatic empirical study. Proceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE, Vol. 2015-January (pp 730-731)
- . Proceedings of the 27th International Conference on Software Engineering and Knowledge Engineering
- . 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE), 9 November 2015 - 13 November 2015.
- . Proceedings of the 2015 on Genetic and Evolutionary Computation Conference - GECCO '15, 11 July 2015 - 15 July 2015.
- Message from the chairs. 7th International Workshop on Search-Based Software Testing, SBST 2014 - Proceedings (pp iii)
- Message from the chairs. 7th International Workshop on Search-Based Software Testing, SBST 2014 - Proceedings (pp iii)
- . 2014 IEEE International Conference on Software Maintenance and Evolution, 29 September 2014 - 3 October 2014.
- . 2014 14th International Conference on Quality Software, 2 October 2014 - 3 October 2014.
- . Genetic and Evolutionary Computation Conference (GECCO 2013) (pp 1445-1452). Amsterdam, 6 July 2013 - 10 July 2013.
- . Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 7838 LNAI (pp 143-156)
- . Proceedings - IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013 (pp 31-40)
- . Proceedings - IEEE 6th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2013 (pp 63-72)
- Test Suite Generation with Memetic Algorithms. GECCO'13: PROCEEDINGS OF THE 2013 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (pp 1437-1444)
- . Proceedings - IEEE 6th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2013 (pp 396-399)
- . Proceedings - IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013 (pp 352-361)
- . 2013 International Symposium on Software Testing and Analysis, ISSTA 2013 - Proceedings (pp 291-301)
- . IEEE International Conference on Software Maintenance, ICSM (pp 472-481)
- . Proceedings - International Conference on Quality Software (pp 79-88)
- . Proceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012 (pp 141-150)
- . 2011 26th IEEE/ACM International Conference on Automated Software Engineering, ASE 2011, Proceedings (pp 53-62)
- . 2011 IEEE Congress of Evolutionary Computation, CEC 2011 (pp 2237-2244)
- . Proceedings - 4th IEEE International Conference on Software Testing, Verification, and Validation Workshops, ICSTW 2011 (pp 153-163)
- . Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 6956 LNCS
- Investigation of qualitative human oracle costs.. PPIG (pp 8-8)
- . ICSTW 2010 - 3rd International Conference on Software Testing, Verification, and Validation Workshops (pp 182-191)
- . Proceedings - 2nd International Symposium on Search Based Software Engineering, SSBSE 2010 (pp 9-18)
- . Proceedings of the 2010 Workshop on Dynamic Analysis, WODA 2010 (pp 8-13)
- . ICSTW 2010 - 3rd International Conference on Software Testing, Verification, and Validation Workshops (pp 151-156)
- . 1st International Workshop on Software Test Output Validation, STOV 2010, in Conjunction with the 2010 International Conference on Software Testing and Analysis, ISSTA 2010 (pp 1-4)
- Superstate identification for state machines using search-based clustering.. GECCO (pp 1381-1388)
- . J SYST SOFTWARE, Vol. 82(11) (pp 1753-1754)
- . Proceedings of the 11th Annual Genetic and Evolutionary Computation Conference, GECCO-2009 (pp 1689-1696)
- . TAIC PART 2009 - Testing: Academic and Industrial Conference - Practice and Research Techniques (pp 95-104)
- Co-testability Transformation. Dagstuhl Seminar Proceedings, Vol. 8351
- . GECCO'08: Proceedings of the 10th Annual Conference on Genetic and Evolutionary Computation 2008 (pp 1759-1766)
- Co-testability Transformation. Dagstuhl Seminar Proceedings, Vol. 8051
- A theoretical & empirical znalysis of evolutionary testing and hill climbing for structural test data generation.. ISSTA (pp 73-83)
- . 6th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, ESEC/FSE 2007 (pp 155-164)
- . Proceedings of GECCO 2007: Genetic and Evolutionary Computation Conference (pp 1098-1105)
- . Proceedings of the 2006 International Symposium on Software Testing and Analysis, ISSTA 2006, Vol. 2006 (pp 13-23)
- Evolutionary testing of state-based programs. GECCO 2005: Genetic and Evolutionary Computation Conference, Vols 1 and 2 (pp 1013-1020)
- Hybridizing evolutionary testing with the chaining approach. GENETIC AND EVOLUTIONARY COMPUTATION GECCO 2004 , PT 2, PROCEEDINGS, Vol. 3103 (pp 1363-1374)
- The state problem for evolutionary testing. GENETIC AND EVOLUTIONARY COMPUTATION - GECCO 2003, PT II, PROCEEDINGS, Vol. 2724 (pp 2488-2498)
- Viscount: A Direct Method Call Coverage Tool for Java. Proceedings of the International Conference on Software Maintenance and Evolution (ICSME 2024)
- Private—Keep Out? Understanding How Developers Account for Code Visibility in Unit Testing. Proceedings of the International Conference on Software Maintenance and Evolution (ICSME 2024)
- PSEUDOSWEEP: A Pseudo-Tested Code Identifier. Proceedings of the International Conference on Software Maintenance and Evolution
- Exploring Pseudo-Testedness: Empirically Evaluating Extreme Mutation Testing at the Statement Level. Proceedings of the International Conference on Software Maintenance and Evolution 2024
- . Proceedings of the International Conference on Software Engineering (ICSE) 2024
- An Investigation into the Effect of Control and Data Dependence Paths on Predicate Testability. 20th IEEE International Working Conference on Source Code Analysis and Manipulation
Preprints
- Grants
-
Current grants
- Test FLARE: , EPSRC, 10/2023 - 02/2027, £544,227, as PI
- RoarQ, RCUK, 05/2023 - 03/2026, £6,000, as PI
Previous grants
- Flake-It: Search-Based Inducement and Repair of Latent Test Flakiness, Industrial, 01/2020 - 09/2023, £40,000, as PI
- RE-PRESENT: Automatic Repair of Presentation Failures in Web Applications, EPSRC, 04/2020 - 03/2023, £34,717, as PI
- Insitute of Coding, HEFCE, 11/2017 - 03/2020, £957,000, as PI
- , EPSRC, 03/2016 - 10/2018, £516,859, as Co-PI
- , EPSRC, 04/2009 - 09/2012, £315,209, as Co-PI
- , EPSRC, 08/2009 - 07/2012, £241,737, as PI
- , EPSRC, 01/2011 - 01/2014, £302,580, as PI
- Professional activities and memberships
-
- Member of the research group
- SBST 2014 Chair
- ICSE 2014 Review Committee member
- ICSE 2013 Program Committee member
- ISSTA 2012 Program Committee member
- SSBSE 2011 General Chair
- Best paper winner at SSBSE 2010