Hyungjun Yoon
Ph.D. Student @ KAIST | Microsoft Research InternI am a Ph.D. student in Networking & Mobile Systems Lab at KAIST, advised by Professor Sung-Ju Lee. Currently, I'm doing research internship at Microsoft Research, mentored by Professor Lili Qiu. I'm interested in Applied Machine Learning, Mobile Sensing, and Foundation Models including Large Language Models. I enjoy exploring how the techniques can be used for real-world problems.
CV Email Github Scholar X LinkedIn
CV Email Github Scholar X LinkedIn
News
- Nov. 2024 | Invited talk at MSRA
- Sep. 2024 | Paper accepted at UbiComp ‘25
- Sep. 2024 | Paper accepted at EMNLP ‘24
- Sep. 2024 | Started my research internship at Microsoft Research (Advisor Prof. Lili Qiu)
- Oct. 2023 | Paper accepted at EMNLP ‘23
- Sep. 2022 | Started my visiting research at NTU, Singapore (Advisor Prof. Mo Li) (by Dec. 2022)
- Mar. 2022 | Honorable Mention at ACM CHI ‘22
- Nov. 2021 | Paper accepted at ACM CHI ‘22
- Mar. 2021 | Started my integrated M.S. and Ph.D. in Networking & Mobile Systems Lab
- Mar. 2020 | Started my M.S. in Networking & Mobile Systems Lab
- Feb. 2020 | Graduated from KAIST as B.S. (Cum Laude)
Publications
Conferences and Journals
"ContrastSense: Domain-invariant Contrastive Learning for In-the-wild Wearable Sensing"Gaole Dai, Huatao Xu, Hyungjun Yoon, Sung-Ju Lee, Rui Tan, and Mo LiUbiComp 2025 pdf
"By My Eyes: Grounding Multimodal Large Language Models with Sensor Data via Visual Prompting"Hyungjun Yoon, Biniyam Aschalew Tolera, Taesik Gong, Kimin Lee, Sung-Ju LeeEMNLP 2024 (main track, long paper) pdf
arXiv
"FedTherapist: Mental Health Monitoring with User-Generated Linguistic Expressions on Smartphones via Federated Learning"Jaemin Shin, Hyungjun Yoon, Seungjoo Lee, Sungjoon Park, Yunxin Liu, Jinho D. Choi, and Sung-Ju LeeEMNLP 2023 (main track, short paper) pdf
website
"MyDJ: Sensing Food Intakes with an Attachable on Your Eyeglass Frame"Jaemin Shin, Seungjoo Lee, Taesik Gong, Hyungjun Yoon, Hyunchul Roh, Andrea Bianchi, and Sung-Ju LeeCHI 2022 pdf
website
video
Honorable Mention Award
Preprints & Under Review
"Adapt^2: Adapting Pre-Trained Sensing Models to End-Users via Self-Supervision Replay"Hyungjun Yoon, Jaehyun Kwak, Biniyam Aschalew Tolera, Gaole Dai, Mo Li, Taesik Gong, Kimin Lee, and Sung-Ju LeearXiv preprint pdf
arXiv
"IMG2IMU: Applying Knowledge from Large-Scale Images to IMU Applications via Contrastive Learning"Hyungjun Yoon, Hyeongheon Cha, Canh Hoang Nguyen, Taesik Gong, and Sung-Ju LeeUnder review pdf
arXiv
""I know my personal data does not leave my phone, but ...": Understanding User (Mis)Perceptions of On-Device AI Voice Phishing Detection"Subin Park, Hyungjun Yoon, Hyoungshick Kim, and Sung-Ju LeeUnder review
"Recover as It is Designed to Be: Recovering from Compatibility Mobile App Crashes by Reusing User Flows"Donghwi Kim, Hyungjun Yoon, Chang Min Park, Sujin Han, Youngjin Kwon, Steve Ko, and Sung-Ju LeearXiv preprint pdf
arXiv
Honors
Best Paper Honorable Mention
ACM CHI 2022; Awarded for the top 5% of all submissionsDean's List
KAIST, Spring 2019; Awarded to the top 3% students in College of EngineeringEducation & Research Experience
Research internship, Microsoft Research, China (Advisor Prof. Lili Qiu)
Ph.D. in Electrical Engineering, KAIST, Republic of Korea (Advisor Prof. Sung-Ju Lee)
Visiting researcher at Wireless and Networked Distributed Sensing (WANDS) group, NTU, Singapore (Advisor Prof. Mo Li)
M.S. in Computer Science, KAIST, Republic of Korea (Advisor Prof. Sung-Ju Lee)
B.S. in Computer Science, KAIST, Republic of Korea (Cum Laude)
Patents
"Adaptive State-Space Model-Based Deep Learning System for Real-Time Data Inference on Mobile Devices"
Sung-Ju Lee, Seungjoo Lee, Hyungjun YoonKorea Patent; In progress"Inference Method Using Dynamic Resource-Based Adaptive Deep Learning Model and Deep Learning Model Inference Device Performing Method"
Sung-Ju Lee, Donghwi Kim, Hyungjun Yoon, Yewon Kim, Sujin HanUS Patent; Filing date: 2023.12.20, No.18/389,848; Korea patent; Filing date: 2023.05.10, No.10-2023-0060780"A System of Mental Health Monitoring with User-Generated Linguistic Expressions on Smartphones via Federated Learning"
Sung-Ju Lee, Hyungjun Yoon, Seungjoo Lee, Jaemin ShinKorea Patent; Filing date: 2023.11.23, No.10-2023-0164077"Artificial Intelligence Model Training Method and Apparatus for Voice Phishing Detection"
Sung-Ju Lee, Seungjoo Lee, Hyungjun YoonKorea Patent; Filing date: 2023.10.04, No.10-2023-0131748"Dynamic Resource-Based Adaptive Smartphone On-Device Inference Method"
Sung-Ju Lee, Hyungjun Yoon, Donghwi Kim, Sujin Han, Yewon KimKorea Patent; Filing date: 2022.12.21, No.10-2022-0180842"Time-Aware Reinforcement-Learning Method for Geographic Ad Hoc Routing with Pre-defined Mobility and Computer Device for the Same"
Jaeha Ahn, Sung-Ju Lee, Taesik Gong, Hyungjun Yoon, Taeckyung LeeKorea Patent; Filing date: 2022.11.11, No.10-2022-0150662"Reinforcement Learning for Ad-hoc Routing Using Pre-defined Mobility"
Sung-Ju Lee, Taesik Gong, Hyungjun Yoon, Taeckyung Lee, Jaeha AhnKorea Patent; Filing date: 2022.03.21, No.10-2022-0034824