Hyungjun Yoon

Hyungjun Yoon

Ph.D. Student @ KAIST | Microsoft Research Intern
I am a Ph.D. student in Networking & Mobile Systems Lab at KAIST, advised by Professor Sung-Ju Lee. Currently, I'm doing research internship at Microsoft Research, mentored by Professor Lili Qiu. I'm interested in Applied Machine Learning, Mobile Sensing, and Foundation Models including Large Language Models. I enjoy exploring how the techniques can be used for real-world problems.
CV   Email   Github Scholar   X   LinkedIn  

News

  • Feb. 2025 |   Paper accepted at SenSys ‘25
  • Feb. 2025 |   Paper accepted at ACM CHI ‘25 LBW
  • Nov. 2024 |   Invited talk at MSRA
  • Sep. 2024 |   Paper accepted at UbiComp ‘25
  • Sep. 2024 |   Paper accepted at EMNLP ‘24
  • Sep. 2024 |   Started my research internship at Microsoft Research (Advisor Prof. Lili Qiu)
  • Oct. 2023 |   Paper accepted at EMNLP ‘23
  • Sep. 2022 |   Started my visiting research at NTU, Singapore (Advisor Prof. Mo Li) (by Dec. 2022)
  • Mar. 2022 |   Honorable Mention at ACM CHI ‘22
  • Nov. 2021 |   Paper accepted at ACM CHI ‘22
  • Mar. 2021 |   Started my integrated M.S. and Ph.D. in Networking & Mobile Systems Lab
  • Mar. 2020 |   Started my M.S. in Networking & Mobile Systems Lab
  • Feb. 2020 |   Graduated from KAIST as B.S. (Cum Laude)

Publications

Conferences and Journals

"SelfReplay: Adapting Self-Supervised Sensory Models via Adaptive Meta-Task Replay"
Hyungjun Yoon, Jaehyun Kwak, Biniyam Aschalew Tolera, Gaole Dai, Mo Li, Taesik Gong, Kimin Lee, and Sung-Ju Lee
SenSys 2025
pdf
""I know my personal data does not leave my phone, but ...": Understanding User (Mis)Perceptions of On-Device AI Voice Phishing Detection"
Subin Park, Hyungjun Yoon, Janu Kim, Hyoungshick Kim, and Sung-Ju Lee
CHI 2025 LBW
pdf
"ContrastSense: Domain-invariant Contrastive Learning for In-the-wild Wearable Sensing"
Gaole Dai, Huatao Xu, Hyungjun Yoon, Sung-Ju Lee, Rui Tan, and Mo Li
UbiComp 2025
pdf website
"By My Eyes: Grounding Multimodal Large Language Models with Sensor Data via Visual Prompting"
Hyungjun Yoon, Biniyam Aschalew Tolera, Taesik Gong, Kimin Lee, Sung-Ju Lee
EMNLP 2024 (main track, long paper)
pdf website
"FedTherapist: Mental Health Monitoring with User-Generated Linguistic Expressions on Smartphones via Federated Learning"
Jaemin Shin, Hyungjun Yoon, Seungjoo Lee, Sungjoon Park, Yunxin Liu, Jinho D. Choi, and Sung-Ju Lee
EMNLP 2023 (main track, short paper)
pdf website
"MyDJ: Sensing Food Intakes with an Attachable on Your Eyeglass Frame"
Jaemin Shin, Seungjoo Lee, Taesik Gong, Hyungjun Yoon, Hyunchul Roh, Andrea Bianchi, and Sung-Ju Lee
CHI 2022
pdf website video Honorable Mention Award

Preprints & Under Review

"Anonymized Title"
XiaoMeng Chen*, Seungjoo Lee*, Hyungjun Yoon*, Yu Wu*, Taiting Lu, Freddy Yifei Liu, Sung-Ju Lee†, Dongyao Chen†, Cecilia Mascolo†, and Lili Qiu
* Equal contribution. † Equal senior role.
In Submission
"From Vision to Motion: Translating Large-Scale Knowledge for Data-Scarce IMU Applications"
Hyungjun Yoon, Hyeongheon Cha, Canh Hoang Nguyen, Taesik Gong, and Sung-Ju Lee
In Submission
pdf arXiv
"Recover as It is Designed to Be: Recovering from Compatibility Mobile App Crashes by Reusing User Flows"
Donghwi Kim, Hyungjun Yoon, Chang Min Park, Sujin Han, Youngjin Kwon, Steve Ko, and Sung-Ju Lee
arXiv preprint
pdf arXiv

Honors

Best Paper Honorable Mention

ACM CHI 2022; Awarded for the top 5% of all submissions

Dean's List

KAIST, Spring 2019; Awarded to the top 3% students in College of Engineering

Education & Research Experience

 
 
 
 
 
Research internship, Microsoft Research, China (Advisor Prof. Lili Qiu)
Sep 2024 – Present
 
 
 
 
 
Ph.D. in Electrical Engineering, KAIST, Republic of Korea (Advisor Prof. Sung-Ju Lee)
Mar 2022 – Present
 
 
 
 
 
Visiting researcher at Wireless and Networked Distributed Sensing (WANDS) group, NTU, Singapore (Advisor Prof. Mo Li)
Sep 2022 – Dec 2022
 
 
 
 
 
M.S. in Computer Science, KAIST, Republic of Korea (Advisor Prof. Sung-Ju Lee)
Mar 2020 – Feb 2021
 
 
 
 
 
B.S. in Computer Science, KAIST, Republic of Korea (Cum Laude)
Mar 2015 – Feb 2020
 
 
 
 
 
Research intern at Data Science Group, KAIST, Republic of Korea (Advisor Prof. Meeyoung Cha)
Aug 2019 – Jan 2020

Patents

"Adaptive State-Space Model-Based Deep Learning System for Real-Time Data Inference on Mobile Devices"

Sung-Ju Lee, Seungjoo Lee, Hyungjun Yoon
Korea Patent; In progress

"Inference Method Using Dynamic Resource-Based Adaptive Deep Learning Model and Deep Learning Model Inference Device Performing Method"

Sung-Ju Lee, Donghwi Kim, Hyungjun Yoon, Yewon Kim, Sujin Han
US Patent; Filing date: 2023.12.20, No.18/389,848; Korea patent; Filing date: 2023.05.10, No.10-2023-0060780

"A System of Mental Health Monitoring with User-Generated Linguistic Expressions on Smartphones via Federated Learning"

Sung-Ju Lee, Hyungjun Yoon, Seungjoo Lee, Jaemin Shin
Korea Patent; Filing date: 2023.11.23, No.10-2023-0164077

"Artificial Intelligence Model Training Method and Apparatus for Voice Phishing Detection"

Sung-Ju Lee, Seungjoo Lee, Hyungjun Yoon
Korea Patent; Filing date: 2023.10.04, No.10-2023-0131748

"Dynamic Resource-Based Adaptive Smartphone On-Device Inference Method"

Sung-Ju Lee, Hyungjun Yoon, Donghwi Kim, Sujin Han, Yewon Kim
Korea Patent; Filing date: 2022.12.21, No.10-2022-0180842

"Time-Aware Reinforcement-Learning Method for Geographic Ad Hoc Routing with Pre-defined Mobility and Computer Device for the Same"

Jaeha Ahn, Sung-Ju Lee, Taesik Gong, Hyungjun Yoon, Taeckyung Lee
Korea Patent; Filing date: 2022.11.11, No.10-2022-0150662

"Reinforcement Learning for Ad-hoc Routing Using Pre-defined Mobility"

Sung-Ju Lee, Taesik Gong, Hyungjun Yoon, Taeckyung Lee, Jaeha Ahn
Korea Patent; Filing date: 2022.03.21, No.10-2022-0034824