Sathyanarayanan N. Aakur
Assistant Professor

Oklahoma State University
Department of Computer Science,
College of Arts and Sciences
Stillwater, OK, 74078

saakurn (at) okstate (dot) edu
[CV] [ LinkedIn ] [ Twitter ]

Bio

I am an Assistant Professor of Computer Science at Oklahoma State University. In my research, I’m broadly interested in the intersection of computer vision, natural language processing and psychology: I aim to build intelligent agents that understand the visual world beyond recognition (labels) or captions (sentences) without the need for explicit human supervision through expensive annotations. This entails developing approaches that do things such as:

  • self-supervised predictive learning for video event segmentation
  • commonsense reasoning to ground perception and prior knowledge
  • generative modeling for building knowledge from the ground-up

Much of my group's current work focuses on analyzing, modeling, and synthesizing complex video scenes and the semantic structure that can describe them. I also work on applying machine learning to other domains such as IoT security and running deep learning algorithms on constrained platforms like FPGA.

I received my PhD from University of South Florida, where I worked with Dr. Sudeep Sarkar in the Computer Vision and Pattern Recognition Group and with Dr. Kenneth Malmberg. I received my Master's degree in Management Information Systems from the Muma College of Business at the University of South Florida and my undergraduate degree in Electronics and Communication Engineering from Velammal Engineering College, Anna University, India.

News

I am looking for highly motivated graduate students with a strong mathematical foundation (especially linear algebra and probability theory) and strong coding skills. Preferably interested in computer vision and/or its grounded applications in natural language processing and robotics. Some background in machine learning, deep learning and computer vision would be useful. I also work with undergraduate students (esp. if you are already at Oklahoma State University). We highly encourage diversity! Send me an email with your CV and area of interest to further proceed.

  • September 2019: One paper accepted at VLSID 2020 on Dissecting CNNs for Implementation on Constrained Platforms!
  • September 2019: One paper accepted at IFIP IoT on Latent Space modeling for PUF encrypted PUF security!
  • May 2019: I have accepted a position as Assistant Professor at Oklahoma State University! Exciting times ahead!
  • May 2019: Successfully defended my dissertation!
  • April 2019: One paper accepted at ISVLSI on Machine Learning based Attack and Defense for PUF-based IoT Security!
  • March 2019: One paper accepted at CVPR on Video Event Segmentation with Self-Supervised Learning!
  • December 2018: Invited Talk at Oklahoma State University on The Role of Commonsense Knowledge in Visual Understanding!
  • October 2018: Paper on Open Domain Activity Interpretation accepted in Quarterly of Applied Mathematics!
  • August 2018: One paper accepted at WACV 2019 on Video Activity Interpretation using Commonsense Knowledge!
  • May 2018: Accepted position as Applied Scientist Intern at Amazon Go in Boston, MA!

Education

  • Department of Computer Science and Engineering, University of South Florida (January 2016 - Present)
    Ph.D Student

  • Information Systems and Decision Sciences, Muma College of Business, University of South Florida (August 2014 - December 2015)
    M.S. Management Information Systems (Business Intelligence)

  • Velammal Engineering College, Anna University, Chennai, India (August 2009 - May 2013)
    B.E., Electronics and Communications Engineering

Publications

  • Machine Learning based IoT Edge Node Security Attack and Countermeasures
    Vishalini R. Laguduva, Sheikh Ariful Islam, Sathyanarayanan Aakur, Srinivas Katkoori and Robert Karam.
    IEEE Computer Society Annual Symposium on VLSI (ISVLSI), 2019.

  • A Perceptual Prediction Framework for Self Supervised Event Segmentation
    Sathyanarayanan Aakur, Sudeep Sarkar
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019 [pdf] [Project Page]

  • Fine-grained Action Detection in Long Surveillance Videos
    Sathyanarayanan Aakur, Daniel Sawyer, Sudeep Sarkar
    Workshop on Human Activity Detection in Multi-Camera, Continuous, Long-Duration Video (HADCV'19), Winter Conference on Applications of Computer Vision (WACV), Waikoloa Village, Hawaii [pdf](Coming Soon!)

  • Going Deeper with Semantics: Exploiting Semantic Contextualization for Interpretation of Human Activity in Videos
    Sathyanarayanan Aakur, Fillipe DM de Souza, Sudeep Sarkar
    Winter Conference on Applications of Computer Vision (WACV), Waikoloa Village, Hawaii [pdf]

  • Generating Open World Descriptions of Video using Commonsense Knowledge in a Pattern Theory Framework
    Sathyanarayanan Aakur, Fillipe DM de Souza, Sudeep Sarkar
    Quarterly of Applied Mathematics, 2019 [pdf]

  • Using semantic relationships among objects for geospatial land use classification
    Gilbert Rotich*, Sathyanarayanan Aakur*, Rodrigo Minetto, Mauricio Segundo, Sudeep Sarkar
    2018 IEEE Workshop on Applied Imagery and Pattern Recognition.

  • On the Inherent Explainability of Pattern Theory-based Video Event Interpretations
    Sathyanarayanan Aakur, Fillipe de Souza, Sudeep Sarkar
    Book Chapter, Explainable and Interpretable Models in Computer Vision and Machine Learning in the Springer Series on Challenges in Machine Learning, 2019 [pdf]

  • An Inherently Explainable Model for Video Activity Interpretation
    Sathyanarayanan Aakur, Fillipe DM de Souza, Sudeep Sarkar
    AAAI Workshop On Reasoning and Learning for Human-Machine Dialogues (DEEP-DIAL18), February 2018. [pdf]

  • Towards a Knowledge-based approach for Generating Video Descriptions
    Sathyanarayanan Aakur, Fillipe DM de Souza, Sudeep Sarkar
    In Proceedings of the Conference on Computer and Robot Vision, Edmonton, Alberta, Canada, May 2017. [pdf]

  • Real Time Data Acquisition System for Production Report Generation
    Sathyanarayanan Aakur, Mithun Singh
    In Proceedings of the International Conference on Computational Intelligence and Advanced Manufacturing Research (ICCIAMR'13), Chennai, India, April 2013.

Honors and Awards

  • Oral Presentation , Conference on Computer Vision and Robotic Vision, 2017

  • Certificate of Appreciation for Contribution to the Company , CTSI-Global, 2015

  • Best Student Project Award , Velammal Engineering College, 2010

  • Best Student in Foreign Language - French , Leo Matriculation School, 2009

Projects

  • Event Understanding in Videos [Project Page]
    To obtain interpretations of activities in videos using a domain-independent methodology using Ulf Grenander's General Pattern Theory framework.

  • Video Summarization using Cognitive Memory Models [Under Progress]
    To create dynamic video summaries from egocentric videos using Cognitive Memory Models.

Teaching

  • CAP 6415 - Computer Vision Teaching Assistant, [Spring 2019]
    Teaching assistant for a graduate class. The course teaches the fundamental principles of Computer Vision with applications of several algorithms such as Image Segmentation, Image Features, Image Formation, Structure from Motion and Object Recognition. I worked under Dr. Sudeep Sarkar.

  • CIS6930 - Biometrics Teaching Assistant, [Spring 2017]
    Teaching assistant for a graduate class. The course teaches the principles of Biometrics with applications of several algorithms such as Face Detection, Fingerprint Recogntion and Face Recognition. I worked under Dr. Rangachar Kasturi.

  • EEL4854 - IT Data Structures and Algorithms Teaching Assistant, [Spring 2017]
    Teaching assistant for a class of 70+ students. The course teaches the Data Structures in a modern programming language Python. I worked under Dr. Isabela Hidalgo.

  • EEL4854 - IT Data Structures Teaching Assistant, [Fall 2016]
    Teaching assistant for a class of 60+ students. The course teaches the Data Structures in a modern programming language C++. I worked under Dr. Philip Ventura.

  • COT4521 - Computational Geometry Teaching Assistant, [Fall 2016]
    Teaching assistant for a class of 40+ students. The course teaches the concepts used in Computational Geometry. I worked under Dr. Valentina Korzhova.

  • COP2512 - IT Programming Fundamentals Instructor, [Summer 2016]
    Taught a class of 60+ students the basic programming concepts in a modern programming language JAVA. The syllabus can be found here.

  • COT4210 - Automata Theory/Formal Languages Teaching Assistant, [Spring 2016]
    Teaching assistant for a class of 60+ students. The course teaches the concepts used in Automata and Formal Languages. I worked under Dr. Valentina Korzhova.

Work Experience

  • Amazon Go
    Applied Scientist Intern
    May 2018 - August 2018
    Mentor: Dr. Mirko Ristivojevic

  • University of South Florida
    Research Assistant
    May 2017 - Present

  • University of South Florida
    Teaching Assistant
    January 2016 - May 2017

  • CTSI-Global
    Programmer Analyst
    October 2012 - November 2015

  • CTSI-Global
    Programmer Analyst Intern
    April 2012 - September 2012

  • Velammal Engineering College
    Undergraduate Research Assistant
    January 2010 - June 2010
    Advisor: Dr. Srinivasan Devashankar