AJJEN JOSHI
PhD candidate @ Boston University
Creative @ ajjenjoshi.com

ABOUT


I am currently a PhD candidate working under the supervision of Dr. Margrit Betke and Dr. Stan Sclaroff with the Image and Video Computing research group at Boston University's Department of Computer Science. I attained a Master of Science degree in Computer Science from Boston University in 2014, and a Bachelor of Arts degree from Connecticut College in 2012 where I majored in Computer Science and Architectural Studies and completed a certificate program in Arts and Technology. I have had the opportunity to intern at Disney Research (Summer 2015) and Adobe Creative Technologies Lab (Summer 2016).

My broad research interests lie in the intersectional and interdisciplinary fields of computer vision, machine learning, and human computer interaction. Particularly, I am interested in the analysis of spatio-temporal human signals, generated for instance by eye-gaze, facial expressions and body gestures, in order to facilitate a computational understanding of various aspects of human behavior as well as enable intelligent interaction with the computer. In my spare time, I do freelance work in art and photography. Some of my work can be seen at ajjenjoshi.com.

RESEARCH

2018


EyeSwipe: Towards Fast and Comfortable Text Entry Using Gaze Paths
Andrew Kurauchi, Wenxin Feng, Ajjen Joshi, Carlos Morimoto, Margrit Betkes
In Submission.



Enabling Early Gesture Recognition by Motion Augmentation
Rohit Agrawal, Ajjen Joshi, Margrit Betke
ACM International Conference on Pervasive Technologies Related to Assistive Environments (PETRA), 2018. To Appear.



Context-Sensitive Prediction of Facial Expressivity Using Multimodal Hierarchical Bayesian Neural Networks
Ajjen Joshi, Soumya Ghosh, Sarah Gunnery, Linda Tickle-Degnen, Margrit Betke, Stan Sclaroff
IEEE International Conference on Automatic Face and Gesture Recognition (AFGR), 2018. To Appear.


2017


Personalizing Gesture Recognition Using Hierarchical Bayesian Neural Networks
Ajjen Joshi, Soumya Ghosh, Margrit Betke, Stan Sclaroff, Hanspeter Pfister
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017. Poster.

[Paper] | [Supplement] | [Poster]



ExerciseCheck: Remote Monitoring and Evaluation Platform for Home Based Physical Therapy
Elham Saraee, Saurabh Singh, Kathryn Hendron, Mingxin Zheng, Ajjen Joshi, Terry Ellis, Margrit Betke
ACM International Conference on Pervasive Technologies Related to Assistive Environments (PETRA), 2017. Oral.

[Paper]



A Therapeutic Robotic System for the Upper Body based on the Proficio Robotic Arm
Elham Saraee, Ajjen Joshi, Margrit Betke
IEEE International Conference on Virtual Rehabilitation (ICVR), 2017. Poster.

[Paper] | [Poster] | [Spotlight]



PostureCheck: Posture Modeling for Exercise Assessment using the Microsoft Kinect
Elham Saraee, Saurabh Singh, Ajjen Joshi, Margrit Betke
IEEE International Conference on Virtual Rehabilitation (ICVR), 2017. Poster.

[Paper] | [Poster] | [Spotlight]


2016


Hierarchical Bayesian Neural Networks for Personalized Classification
Ajjen Joshi, Soumya Ghosh, Margrit Betke, Hanspeter Pfister
Neural Information Processing Systems (NIPS) Workshop on Bayesian Deep Learning, 2016. Poster.

[Paper] | [Poster] | [Spotlight]


Predicting Active Facial Expressivity in People with Parkinson's Disease
Ajjen Joshi, Linda Tickle-Degnen, Sarah Gunnery, Terry Ellis, Margrit Betke
ACM International Conference on Pervasive Technologies Related to Assistive Environments (PETRA), 2016. Oral.

[Paper]


Comparing Random Forest Approaches To Segmenting And Classifying Gestures
Ajjen Joshi, Camille Monnier, Margrit Betke, Stan Sclaroff
Elsevier Image and Vision Computing (IMAVIS), 2016.

[Paper]


Eyeswipe: Dwell-Free Text Entry Using Gaze Paths
Andrew Kurauchi, Wenxin Feng, Ajjen Joshi, Carlos Morimoto, Margrit Betke
ACM Conference on Human Factors in Computing Systems (CHI), 2016. Oral.

[Paper] | [Video]


b3.js: A Library for Interactive Virtual Reality Web 3D Graphs
Huy Le, Ajjen Joshi, Margrit Betke
IEEE Virtual Reality (VR), 2016. Research Demo.

[Paper] | [Video]

2015 and older


A Random Forest Approach to Segmenting And Classifying Gestures
Ajjen Joshi, Camille Monnier, Margrit Betke, Stan Sclaroff
IEEE International Conference on Automatic Face and Gesture Recognition (AFGR), 2015. Oral.

[MS Thesis] | [Paper] | [Video]


Developing a Tool for Dance Motion Synthesis
Ajjen Joshi, Bridget Baird, Ozgur Izmirli
Connecticut College Biennial Symposium on Arts and Technology (SAT), 2012. Oral.

[Paper]

PROJECTS


Autonomous Driving (2017)
A collection of projects in the the self-driving car stack.

[Github]


Generative (2017)
A collection of Processing sketches that generates art from code.

[Github]


A Data-driven Approach to Automatic Inbetweening in Handdrawn Animation (2016)
Built a prototype deep learning system to generate inbetween frames in handdrawn animations during an internship at Adobe research.

[Github]


Victory Over the Sun (2015)
Created projections for a rendition of the futurist opera: Victory Over the Sun. Wrote scripts creating generative animations and used the Kinect to record and animate dancers.

[Github]


Key Eye (2015)
A prototype of a hands-free eye typing system (created by a 2-person team). Designed for people with motor impairments, users typed words using their eyegaze with a wearable eye-tracker.

[Video]


TEACHING


ARTIFICIAL INTELLIGENCE (Spring 2016, 2017)
Boston University CS440 (Undergraduate course on artificial intelligence)

IMAGE AND VIDEO COMPUTING (Fall 2014)
Boston University CS585 (Graduate level course on computer vision)

INTRODUCTION TO APPLICATION PROGRAMMING (Fall 2013)
Boston University CS108 (Introductory course on computer programming)

3D GAME DESIGN (Spring 2013)
Boston University STEM Academy (Introductory course on game design for high school students)

MULTIMEDIA PROCESSING (Fall 2011)
Connecticut College CS218 (Introductory course on image and audio processing)

ANIMATION AND MOTION CAPTURE WORKSHOP (Winter 2010, 2011)
Connecticut College Center for Arts and Technology (Workshop on 3d animation and motion capture)

TESTIMONIALS

"Goes in the pantheon of great CS TAs I've had here at BU." -CS440 student, Spring 2017

"Ajjen was the best teaching fellow I have had at BU thus far. He is very knowledgeable in all things computer vision and was helpful when explaining topics." -CS585 student, Fall 2014

"Ajjen is extremely qualified for this position and he clearly demonstrated it by helping students outside of class with projects he is not familiar with. He is extremely helpful and definitely deserves a good recommendation." -CS108 student, Fall 2013


CONTACT