About Me

Greetings~ My name is Jiacheng Zhang. I am first-year PhD student advised by Professor Steve Oney. Before that, I earned my Bachelor's degree in Computer Science from University of Michigan. I also obtained another degree in Electrical and Computer Engineering from Shanghai Jiao Tong University. My research interest lies in Human-Centered Artificial Intelligence.
During my undergraduate years, I was fortunate to work with Prof. Xinyu Wang and Prof. Tianyi Zhang in web automation systems. I was also advised by Prof. Andrew Owens in multimodal learning and computer vision.



  • Aug 2021 - May 2023
    B.S.E in Computer Science | Minor. Statistics
    (Summa Cum Laude)
    University of Michigan, Ann Arbor, US
  • Sep 2019 - Present
    B.S.E in Electrical and Computer Engineering
    Shanghai Jiao Tong University, Shanghai, China


touch-go  Generating Visual Scenes from Touch
Fengyu Yang, Jiacheng Zhang, Andrew Owens
ICCV, 2023                    

We use diffusion to generate images from a touch signal (and vice versa).

[project page] [paper]
touch-go  Touch and Go: Learning from Human-Collected Vision and Touch
Fengyu Yang*, Chenyang Ma*, Jiacheng Zhang, Jing Zhu, Wenzhen Yuan, Andrew Owens NeurIPS (Datasets and Benchmarks Track), 2022                    

A dataset of paired vision-and-touch data collected by humans. We apply it to: 1) restyling an image to match a tactile input, 2) self-supervised representation learning, 3) multimodal video prediction.

[project page] [paper] [dataset]
miwa  MIWA: Mixed-InitiativeWeb Automation for Better User Control and Confidence
Weihao Chen, Xiaoyu Liu, Jiacheng Zhang, Zhicheng Huang, Ian Long Lam, Rui Dong, Xinyu Wang, Tianyi Zhang
UIST, 2023                    

We provide MIWA, a mixed-initiative web automation system that enables users to create web scraping programs by demonstrating what contents they want from the targeted websites.