Vincent-Daniel Yun

MS in Artificial Intelligence student at the University of Southern California

Los Angeles, CA, USA

Vincent-Daniel Yun

This is Daniel, a first-year MSAI student at the University of Southern California researching Deep Learning Foundation & LLM Optimization. I'm fortunately supervised by Prof. Sai Praneeth Karimireddy and Prof. Vatsal Sharan from USC. I am also closely working with Prof. Sunwoo Lee from Inha University (Republic of Korea).

Recent progress in AI such as large language models has been driven largely by scaling, but this comes with significant computational and memory costs. This motivates a broader question at the core of my research:

Given that modern neural networks are inherently overparameterized and computationally redundant, how can we transform them into structurally and computationally optimal systems?

Therefore, my research focuses on improving optimization, generalization, and model compression techniques to make neural networks lighter, faster, and more efficient in learning from data.

My current research interests:

My current affiliations include:

Education

[PhD] Actively Seeking Fall 2027 Admission PhD Program
Computer Science, Electrical Engineering, Computer Engineering
Potential Research Fields: Deep Learning (AI) Foundation, LLM Compression, Optimization, and Reasoning
[Visiting Scholar] Seoul National University, Seoul, Republic of Korea (05.2026 – 08.2026)
Computing and Memory Architecture Laboratory (CMAL)
Supervisor: Prof. Sungjoo Yoo (with PhD student Woosang Lim)
Research: Efficient LLM systems — KV-cache compression, quantization
[MS] University of Southern California, Los Angeles, CA (08.2025 – 05.2027)
Master of Science in Artificial Intelligence (Computer Science)
Research Supervisor: Prof. Sai Praneeth Karimireddy and Prof. Vatsal Sharan
[BS] Stony Brook University, Stony Brook, NY (01.2018 – 05.2025)
Bachelor of Science in Computer Science with AI specialization (Major 1)
Bachelor of Science in Applied Mathematics and Statistics (Major 2)
Research Supervisor: Prof. Chao Chen
2-year leave of absence due to mandatory military duty (Republic of Korea)

약력

2026 서울대학교 컴퓨팅·메모리 아키텍처 연구실 방문 연구원
2025 – 현재 인하대학교 대형 머신러닝 최적화 연구소 협력 연구원
2025 – 현재 서던캘리포니아대학교(USC) 이론 인공지능 그룹 연구 조교
2025 모두의연구소 「인공지능, 우리는 어디까지 왔고 어디로 가야 하는가」 강연자
2025 – 현재 서던캘리포니아대학교(USC) 인공지능학과 석사과정
2025 – 2026 모두의연구소 Neural Superintelligence Lab 랩 디렉터
2024 – 2025 모두의연구소 Open Neural Networks Research Lab 랩 디렉터
2023 – 2025 뉴욕주립대학교 스토니브룩 병원 디지털 병리학·암 감지 인공지능 연구원
2022 – 2023 뉴욕주립대학교 스토니브룩 Data and Intelligence Computing Lab 연구 조교
2020 – 2022 대한민국 공군본부 우주기상팀 우주기상 딥러닝 모델 개발 담당
2019 – 2020 나인와트(Ninewatt) 전력 예측 인공지능 연구원
2019 뉴욕주립대학교 스토니브룩 기상 예측 인공지능 연구 조교
2018 – 2025 뉴욕주립대학교 스토니브룩 컴퓨터과학 전공 · 응용수학 복수전공

Recent News

Jun, 2026 Three papers were submitted to EMNLP 2026. Pruning Pruning Agent
Jun, 2026 [ICML 2026 Workshop] Three papers accepted as posters at the ICML 2026 AdaptFM Workshop (Resource-Adaptive Foundation Model Inference):
  • Rethinking Layer Redundancy in Large Language Models: Calibration Objectives and Search for Depth Pruning Pruning
  • Weight Concentration Regularization for Improving Pruning Robustness Under High Sparsity Pruning
  • Ghosted Layers: Unconstrained Activation Alignment for Recovering Layer-Pruned LLMs Pruning
May, 2026 [ICML 2026 Workshop] Our paper "Robust Multi-Agent LLMs under Byzantine Faults" is accepted at the ICML 2026 Workshop on Agents in the Wild: Safety, Security, and Beyond. Agent
May, 2026 [ICML 2026 Workshop] Our paper "On How Muon Reshapes Skill Learning Dynamics" is accepted at the ICML 2026 High-dimensional Learning Dynamics (HiLD) Workshop. Optimization
May, 2026 Five papers were submitted to NeurIPS 2026. Optimization Optimization Pruning Pruning Pruning
Apr, 2026 We recently started a research collaboration with the University of Michigan–Ann Arbor on robust multi-agent AI systems, in collaboration with PhD student Haejoon Lee and Prof. Dimitra Panagou.
Mar, 2026 [Travel Grant for ICASSP 2026] Recipient of the USC GSG Travel Grant for ICASSP 2026.
Jan, 2026 [ICASSP 2026 Main] Our paper "Sharpness-Aware Minimization with Z-Score Gradient Filtering" is accepted at the 2026 International Conference on Acoustics, Speech, and Signal Processing. [Paper] [Conference]
Nov, 2025 [Research Grant / $6,000] Our four papers have been supported by the Brian Impact Foundation and MODULABS from Korea, with a total research grant of $6,000.
Nov, 2025 [ICONIP 2025 / Best Paper Award] "Revisiting 16-bit Neural Network Training: A Practical Approach for Resource-Limited Learning" has been nominated as the Best Paper at ICONIP 2025. [Paper]
Sep, 2025 [NeurIPS 2025 OPT] Our paper "Why Does Stochastic Gradient Descent Slow Down in Low-Precision Training?" is accepted at the NeurIPS 2025 OPT Workshop. [Paper] [Workshop]
Sep, 2025 [NeurIPS 2025 OPT] Our paper "Sharpness-Aware Minimization with Z-Score Gradient Filtering" is accepted at the NeurIPS 2025 OPT Workshop. [Paper] [Workshop]
Sep, 2025 [NeurIPS 2025 OPT] Our paper "Hyperparameter-Free Auto-Scaled Gradient Normalization via Global Standard Deviation Dynamics" is accepted at the NeurIPS 2025 OPT Workshop. [Paper] [Workshop]
Sep, 2025 [CIKM 2025 HCAI] Our paper "Fast Fourier Transform-Based Spectral and Temporal Gradient Filtering for Differential Privacy" is accepted at the CIKM 2025 Human-Centric AI Workshop. [Paper] [Workshop]
Jul, 2025 [ICONIP 2025] Our paper "Revisiting 16-bit Neural Network Training: A Practical Approach for Resource-Limited Learning" has been accepted as an oral presentation at ICONIP 2025 (top 8% acceptance rate). [Paper]
Nov, 2024 [AAAIW 2025] Our paper "ZNorm: Z-Score Gradient Normalization Accelerating Skip-Connected Network Training Without Architectural Modification" is accepted at AAAI 2025 Workshops. [Paper] [Workshop]
Nov, 2024 [IEEE BigDataW 2024] Our paper "Mitigating Gradient Overlap in Deep Residual Networks with Gradient Normalization for Improved Non-Convex Optimization" is accepted at the IEEE BigData Optimization Workshop, BPOD. [Paper] [Workshop]
Sep, 2024 [ESA SPAICE 2024] Our paper "Analysis and Predictive Modeling of Solar Coronal Holes Using Computer Vision and ARIMA-LSTM Networks" is accepted at SPAICE 2024. [Paper] [Conference]
Mar, 2024 [IJCNN 2024] Our paper "Robust Neural Pruning with Gradient Sampling Optimization for Residual Neural Networks" is accepted at IJCNN 2024 (Oral). [Paper]
Mar, 2024 [CVPRW 2024] Our paper "Uncertainty Estimation for Tumor Prediction with Unlabeled Data" is accepted at the IEEE/CVF CVPR Workshop. [Paper]

Academic Services

2026 Reviewer, Conference on Neural Information Processing Systems (NeurIPS)
2025 Reviewer, Conference on Parsimony and Learning (CPAL)
2025 Reviewer, International Joint Conference on Neural Networks (IJCNN)
2020 Teaching Assistant, CSE 216: Programming Abstractions, Stony Brook University
2019 Teaching Assistant, CSE 114: Introduction to Object-Oriented Programming, Stony Brook University

Awards

Mar, 2026 USC GSG Travel Award for ICASSP 2026
Nov, 2025 Best Paper Award at International Conference on Neural Information Processing (ICONIP) 2025
Apr, 2025 3rd place at Stony Brook Web Development Hackathon
Oct, 2023 1st place at Data Science Track of NYC Hack-O-Ween Hackathon
Jul, 2023 3rd place at Microsoft Hackerground Hackathon 2023
May, 2023 1st place at Stony Brook SUNYK Hackathon 2023
Apr, 2021 3rd place at Korea Smart City Data Hackathon 2021
Jul, 2020 1st place at Busan Pathhack / Google Developer Groups Hackathon 2019
Jul, 2019 1st place / Contributor MVP Award at COSMOS Hackathon Seoul 2019
Jul, 2018 3rd place at Global Applied Game Jam 2018
Feb, 2018 Merit Scholarship from Stony Brook University