About Me
I am currently a Research Scientist in ByteDance Seed. Before joining ByteDance, I received my Ph.D degree in Mathematics from The Hong Kong University of Science and Technology (HKUST), supervised by Prof. Tong Zhang. Before that, I obtained my Bachelor degree in Electronic Engineering from Tsinghua University.
Tech Reports
- Seed LiveInterpret 2.0: End-to-end Simultaneous Speech-to-speech Translation with Your Voice
Shanbo Cheng, Yu Bao, Zhichao Huang, Yu Lu, Ningxin Peng, Lu Xu, Runsheng Yu, et.al.
[Project Page] - Seed-X: Building Strong Multilingual Translation LLM with 7B Parameters
Shanbo Cheng, Yu Bao, Qian Cao, Luyang Huang, Liyan Kang, Zhicheng Liu, Yu Lu, Wenhao Zhu, Zhichao Huang, Tao Li, Sitong Liu, Ningxin Peng, Shuaijie She, Lu Xu, et.al.
[Project Page] - Towards Achieving Human Parity on End-to-end Simultaneous Speech Translation via LLM Agent
Shanbo Cheng, Zhichao Huang, Tom Ko, Hang Li, Ningxin Peng, Lu Xu, Qini Zhang ($\alpha-\beta$ order)
[Project page] - Speech Translation with Large Language Models: An Industrial Practice
Zhichao Huang, Rong Ye, Tom Ko, Qianqian Dong, Shanbo Cheng, Mingxuan Wang, Hang Li
[Demo]
Publications
- SeqPO-SiMT: Sequential Policy Optimization for Simultaneous Machine Translation
Ting Xu, Zhichao Huang†, Jiankai Sun, Shanbo Cheng, Wai Lam
ACL 2025 Findings (†correspoding author) - On the Impact of Hard Adversarial Instances on Overfitting in Adversarial Training
Chen Liu, Zhichao Huang, Mathieu Salzmann, Tong Zhang, Sabine Süsstrunk
Journal of Machine Learning Research (JMLR)
[Code] - RepCodec: A Speech Representation Codec for Speech Tokenization
Zhichao Huang*, Chutong Meng*, Tom Ko
The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) [Oral]
[Code] - Fast Adversarial Training with Adaptive Step Size
Zhichao Huang, Yanbo Fan, Chen Liu, Weizhong Zhang, Yong Zhang, Mathieu Salzmann, Sabine Süsstrunk, Jue Wang
Transcation on Image Processing (TIP)
[Code] - Towards Stable and Efficient Adversarial Training against $\ell_1$ Bounded Adversarial Attacks
Yulun Jiang, Chen Liu, Zhichao Huang, Mathieu Salzmann, Sabine Süsstrunk
Fortieth International Conference on Machine Learning (ICML 2023)
[Code] - Black-Box Prompt Learning for Pre-trained Language Models
Shizhe Diao, Zhichao Huang, Ruijia Xu, Xuechun Li, Yong Lin, Xiao Zhou, Tong Zhang
Transactions on Machine Learning Research (TMLR)
[Code] - Few-Shot Human Motion Transfer by Personalized Geometry and Texture Modeling
Zhichao Huang, Xintong Han, Jia Xu, Tong Zhang
2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021)
[Code][Video] - Stochastic Recursive Gradient Descent Ascent for Stochastic Nonconvex-Strongly-Concave Minimax Problems
Luo Luo, Haishan Ye, Zhichao Huang, Tong Zhang
34th Conference on Neural Information Processing Systems (NeurIPS 2020) - Black-box Adversarial Attack with Transferable Model-Based Embedding
Zhichao Huang, Tong Zhang
Eighth International Conference on Learning Representations (ICLR 2020)
[Code] - Hessian-Aware Zeroth-Order Optimization
Haishan Ye, Zhichao Huang, Cong Fang, Chris Junchi Li, Tong Zhang
Transactions on Pattern Analysis and Machine Intelligence (T-PAMI) - Enhancing CNN Incremental Learning Capability with an Expanded Network
Shanshan Cai*, Zhuwei Xu*, Zhichao Huang*, Yueru Chen, C.-C. Jay Kuo
2018 IEEE International Conference on Multimedia and Expo (ICME 2018) (*equal contribution) - CorrAttack: Black-box Adversarial Attack with Structured Search
Zhichao Huang*, Yaowei Huang*, Tong Zhang (*equal contribution)
Experiences
- Research Intern, Tencent AI Lab, Shenzhen, China
Topic: Adversarial Examples
Mentor: Yanbo Fan
Mar 2021 - Nov 2021 - Research Intern, Huya Inc, Guangzhou, China
Topic: Human Motion Transfer
Mentor: Jia Xu
Jun 2019 - Aug 2019 - Research Intern, Sensetime Group Limited, Beijing, China
Topic: Multitask Semantic Segmentation in Autonomous Driving
Mentor: Guangliang Cheng
Dec 2017 - Jun 2018 - Research Assistant, University of Southern California, Los Angeles, USA
Topic: Incremental Learning in CNN
Advisor: C.-C. Jay Kuo
Jun 2017 - Aug 2017
Teaching
- MATH 1014 - Calculus II (Spring 2019)
- MATH 1013 - Calculus IB (Fall 2019)
- MATH 2011 - Introduction to Multivariable Calculus (Spring 2020, Spring 2021)
- MATH 2111 - Matrix Algebra and Applications (Fall 2020, Fall 2021)
- MATH 2011 - Introduction to Multivariable Calculus (Spring 2021)
Awards
- Best TA Teaching Award, 2020 - 2021
- HKUST Postgraduate Studentship, 2018-2022
Academic Service
- Reviewer of ICML, NeurIPS, ICLR, T-PAMI, IJCV, SIMODS, ACL etc.