Automated Penetration Testing · LLMs

Ruozhao Yang 杨若钊

Ph.D. Student in Computer Science · SMU

About

I'm a Ph.D. student in Computer Science at Singapore Management University, advised by Prof. Xiaofei Xie. My researches mainly focus on automated penetration testing with large language models. My background is hands-on: CTF competitions, attack-and-defense exercises, and real-world penetration testing gave me a feel for how systems actually break, and these days I'm distilling that experience into rigorous research and practical, automated tooling.

Education

Singapore Management University2025 – Present
Ph.D. in Computer Science · Advisor: Prof. Xiaofei Xie
Tianjin University2020 – 2024
B.Eng. in Computer Science and Technology
Thesis: “Visual Analysis Model of APT Attack Samples” · Advisor: Prof. Tao Luo

Researches

arXiv preprint · 2026

AutoEG: Exploiting Known Third-Party Vulnerabilities in Black-Box Web Applications

Ruozhao Yang, Mingfei Cheng, Gelei Deng, Junjie Wang, Tianwei Zhang, Xiaofei Xie

arXiv preprint · 2026

What Makes a Good LLM Agent for Real-world Penetration Testing?

Gelei Deng, Yi Liu, Yuekang Li, Ruozhao Yang, Xiaofei Xie, Jie Zhang, Han Qiu, Tianwei Zhang

arXiv preprint · 2025

PentestEval: Benchmarking LLM-based Penetration Testing with Modular and Stage-Level Design

Ruozhao Yang, Mingfei Cheng, Gelei Deng, Tianwei Zhang, Junjie Wang, Xiaofei Xie

CTF Experience

Web · 2021–2024
Captain

D.I.E

TJU Official Team · 2022–2024 · Web
Main Member

Dest0g3

2021–2023 · Web
Co-founder

TTT-team

Joint Tianjin team · 2021
Domestic (China)
第四届“第五空间”网络安全大赛 冠军
第四届“长城杯”信息安全铁人三项赛 一等奖(亚军)
第十五届全国大学生信息安全竞赛 国家级二等奖
…… 等
International
🥈 7th XCTF Finals2nd Prize
SUSCTF — Meritorious Winner4 / 308
SCTF6 / 206
L3HCTF10 / 275
*CTF13 / 372
Azure Assassin Alliance CTF26 / 310
BSidesNoida CTF26 / 411
RCTF34 / 363
CyBRICS 202144 / 482
Real World CTF 4th68 / 947

Personal Blogs

All posts →