Huijuan Xu

EECS, UC Berkeley


About Me

I am now a Post-doc at UC Berkeley EECS with Professor Trevor Darrell. My research focuses on deep learning, computer vision and natural language processing, particularly in the area of visual question answering, video language description and activity detection.

I obtain my PhD degree from the computer science department at Boston University in September 2018, advised by Professor Kate Saenko. Before coming to US, I received a Master’s degree from Graduate University of Chinese Academy of Sciences in 2012, advised by Professor Hua Yu, and a Bachelor’s degree in computer science from Hefei University of Technology in 2009. I conducted my PhD studies at the CS Department of UMass Lowell for three years, before transferring to the CS Department of Boston University to continue my PhD studies with Professor Kate Saenko.


Selected Publications

Google Scholar

Multilevel Language and Vision Integration for Text-to-Clip Retrieval.

Huijuan Xu, Kun He, Bryan A. Plummer, Leonid Sigal, Stan Sclaroff, Kate Saenko.
In Thirty-Third AAAI Conference on Artificial Intelligence (AAAI-19), 2019.
arXiv Code Demo1 Demo2

Joint Event Detection and Description in Continuous Video Streams.

Huijuan Xu, Boyang Li, Vasili Ramanishka, Leonid Sigal, Kate Saenko.
In IEEE Winter Conference on Applications of Computer Vision (WACV), 2019.
arXiv Code Demo1 Demo2

R-C3D: Region Convolutional 3D Network for Temporal Activity Detection.

Huijuan Xu, Abir Das, Kate Saenko.
In International Conference on Computer Vision (ICCV), 2017.
arXiv Code Demo Project page

Ask, Attend and Answer: Exploring Question-Guided Spatial Attention for Visual Question Answering.

Huijuan Xu, Kate Saenko.
In European Conference on Computer Vision (ECCV), 2016.
arXiv Code

Translating Videos to Natural Language Using Deep Recurrent Neural Networks.

Subhashini Venugopalan, Huijuan Xu, Jeff Donahue, Marcus Rohrbach, Raymond Mooney, Kate Saenko.
North American Chapter of the Association for Computational Linguistics (NAACL), 2015.
arXiv Project page

Workshop Papers

Huijuan Xu and Kate Saenko. Dual Attention Network for Visual Question Answering. ECCV2016 2nd Workshop on Storytelling with Images and Videos (VisStory), 2016.
Huijuan Xu and Kate Saenko. Ask, Attend and Answer: Exploring Question-Guided Spatial Attention for Visual Question Answering. VQA Challenge Workshop at CVPR 2016.
Huijuan Xu, Subhashini Venugopalan, Vasili Ramanishka, Marcus Rohrbach and Kate Saenko. A Multi-scale Multiple Instance Video Description Network. ICCV15 workshop on Closing the Loop Between Vision and Language (CLVL), 2015. (Abstract)


Teaching Assistant, UMass Lowell(Spring 2015)
91.422/545: Machine Learning

Lab Instructor, UMass Lowell (Fall 2013, Spring 2014)
91.103: Computing I Lab

Research Internship

Disney Research, Pittsburgh, Summer 2017

Professional Activities

Reviewer for journals:

Transactions on Pattern Analysis and Machine Intelligence (TPAMI), International Journal of Computer Vision (IJCV), ACM Transactions on Multimedia Activities Computing Communications and Applications (TOMM), IEEE Transactions on Image Processing (TIP)

Reviewer/program committee member for conferences:

ICCV2017, CVPR2018, WiCV2018, ECCV2018, ACCV2018, CVPR2019, NAACL-HLT2019, IJCAI2019, ICCV2019, WiCV2019, AAAI2020, CVPR2020, HADCV'20, ECCV2020, IJCAI2020, ICML2020