Analytics Softwares by the Research Group of
Prof. Ganesh Ramakrishnan

Video Analytics for Defense and Security Applications

Video Analytics and Surveillance softwares for real-time analysis (intrusion, loitering, tracking) and post-mortem analysis (video search, summarization)

Data Efficient Machine Learning (DECILE)

CORDS (COResets and Data Subset selection), DISTIL (Deep dIverSified inTeractIve Learning), SPEAR (Semi-suPervisEd dAta pRogramming), SUBMODLIB (SUBMODular optimization LIBrary)

Document Analytics

Optical Character Recognition (OCR) and Scene text Recognition for Indian languages and Indian context

Video Analytics (won The National eGovernance Gold Award 2022)

Video Analytics softwares for security applications includes real-time analysis such as intrusion, loitering, tracking (codenamed SurakshaVyuha, now being productized by SrivisifAI as 3rdAI) and post-mortem analysis - video search (Jigyasa), summarization (VideoSummy and VISIOCITY). These are ongoing projects, initiated by Prof. Ganesh Ramakrishnan in 2016, which got incorporated in 2017 as a part of the National Centre of Excellence in Technology for Internal Security (NCETIS). NCETIS has been strongly facilitating as well as promoting the work to the Indian Navy, Indian Army and Several state police forces. We also feature below video analytics for compliance and quality monitoring (Drishti), a work with the Ministry of Rural Development, Government of India.


Our USPs: Scalable architecture to support 1000+ Cameras | Modular architecture to accommodate hardware upgrades | On-Cloud, On-Premise and Hybrid deployment models | Continuous improvements in AI algorithms | Integration with existing solutions | Customer-specific use-case based workflows | Real-time Dashboards

In the works: Thermal Imaging | Coastal/Drone Surveillance | Person ReID | under Water Video Analytics | IoT

Surakshavyuha

Video Surveillance Analytics

Now being productized as 3rdAI, this CCTV Video Analytics solution includes real-time intrusion detection, perimeter monitoring, loitering detection, object tracking, etc.

Download User Manual Installation Guide

Credentials to use the software can be provided upon acknowledgement/request.

Jigyasa

Video Search Analytics

Jigyasa is a Video Repository Indexing and Search platform with features like text search, face search, etc.

Repository Manager Video Search

Credentials to use the software can be provided upon acknowledgement/request.

Videosummy

and

Visiocity Summarization Benchmark

Video Summarization Software

Videosummy can condense hours’ worth of video into a couple of minutes, by preserving key events and vignettes from your original video and removing repetitive visual information. Read in details, our VISIOCITY dataset and benchmark algorithms and evaluations for video summarization across different domains such as surveillance, TV shows, sports, education, events (birthdays and weddings), and different facets of summarization therein.

Download

Drishti

Compliance and Quality Monitoring

Drishti is an ongoing project with the Ministry of Rural Development (MoRD), Government of India to provide automated compliance and quality monitoring solution for their DDU-GKY skill development scheme (Deen Dayal Upadhyaya Gramina Kaushalya Yojana). It supports analytics like instructor face recognition, student count, uniform compliance, punctuality detection etc. on classroom videos.

Data Efficient Machine Learning (DECILE)

Softwares and libraries for data efficient machine learning with less data.
CORDS (COResets and Data Subset selection)
DISTIL (Deep dIverSified inTeractIve Learning)
SPEAR (Semi-suPervisEd dAta pRogramming)
SUBMODLIB (SUBMODular optimization LIBrary)

Visit the project page https://decile.org

Document Analytics

Optical Character Recognition (OCR) and Scene text Recognition for Indian languages and Indian context

IndicOCR

Optical Character Recognition for Indian Texts

End-to-end framework for Error Detection and Corrections in Indic-OCR. The system inputs a PDF file of a book, and obtains the OCR output using IndSenz OCR and Google OCR, and then corrects the OCRed text, and provides suggestions for words that probably have mistakes during the OCR method, hence any mistakes during the OCR process can be corrected by the user.

Demo Github Install Details More Info

Credentials to use the software can be provided upon acknowledgement/request.

Publications

Selected publications related to the projects.

SeRVo-HOI: Skew-Robust Human-Object Interactions in Videos

Apoorva Agarwal, Rishabh Dabral, Arjun Jain, Ganesh Ramakrishnan

In Proceedings of The 11th IEEE Winter Conference on Applications of Computer Vision (WACV 2023).

AUTOMATA: Gradient Based Data Subset Selection for Compute-Efficient Hyper-parameter Tuning

KrishnaTeja Killamsetty, Guttu Sai Abhishek, Aakriti, Ganesh Ramakrishnan, Alexandre V. Evfimievski, Lucian Popa, Rishabh K. Iyer

Accepted paper at the Thirty-sixth Conference on Neural Information Processing Systems (Neurips 2022).

SPEAR : Semi-supervised Data Programming in Python

Guttu Sai Abhishek, Harshad Ingole, Parth Laturia, Vineeth Dorna, Ayush Maheshwari, Rishabh Iyer, Ganesh Ramakrishnan

Accepted paper at the 2022 Conference on Empirical Methods in Natural Language Processing, EMNLP 2022, Abu Dhabi (Demo paper).

PRISM: A Rich Class of Parameterized Submodular Information Measures for Guided Data Subset Selection

Suraj Kothawade, Vishal Kaushal, Ganesh Ramakrishnan, Jeff Bilmes, Rishabh Iyer

In Proceedings of The 36th AAAI Conference on Artificial Intelligence (AAAI 2022).

GLISTER: Generalization based Data Subset Selection for Efficient and Robust Learning [source code , video]

Krishnateja Killamsetty, Durga S, Ganesh Ramakrishnan, and Rishabh Iyer

In Proceedings of The 35th AAAI Conference on Artificial Intelligence (AAAI 2021).

Training Data Subset Selection for Regression With Controlled Generalization Error [source code ]

Durga Sivasubramanian, Rishabh Iyer, Ganesh Ramakrishnan, Abir De

Accepted paper at the 38th International Conference on Machine Learning (ICML 2021).

GRAD-MATCH: Gradient Matching based Data Subset Selection for EfficientDeep Model Training [source code , video]

Krishnateja Killamsetty, Durga Sivasubramanian, Ganesh Ramakrishnan, Abir De, Rishabh Iyer

Accepted paper at the 38th International Conference on Machine Learning (ICML 2021).

Semi-Supervised Data Programming with Subset Selection [source code , video]

Ayush Maheshwari, Oishik Chatterjee, Krishnateja Killamsetty, Ganesh Ramakrishnan, Rishabh Iyer

Accepted paper at the 59th Annual Meeting of the Association for Computational Linguistics (ACL 2021 Findings).

Wisdom of (Binned) Crowds: A Bayesian Stratification Paradigm for Crowd Counting [source code ]

Sravya Shivapuja, Mansi Khamkar, Divij Bajaj, Ganesh Ramakrishnan, Ravi Kiran Sarvadevabhatla

Accepted at The 29th ACM International Conference on Multimedia (ACMM 2021)

CATALIST: CAmera TrAnsformations for multi-LIngual Scene Text recognition [project page, slides]

Shivam Sood, Rohit Saluja, Ganesh Ramakrishnan and Parag Chaudhuri

Accepted at ICDAR 2021 Workshop on Camera-Based Document Analysis and Recognition (CBDAR 2021, 9TH EDITION)

Select, Substitute, Search: A New Benchmark for Knowledge-Augmented Visual Question Answering [data and source code]

Aman Jain, Mayank Kothyari, Vishwajeet Kumar, Preethi Jyothi, Ganesh Ramakrishnan, Soumen Chakrabarti

Accepted paper at The 44th International ACM Conference on Research and Development in Information Retrieval (SIGIR), Resource Track, 2021.

Exploration of Spatial and Temporal Modeling Alternatives for HOI [presentation, source code]

Rishabh Dabral, Srijon Sarkar, Sai Praneeth Reddy, Ganesh Ramakrishnan

In Proceedings of The 9th IEEE Winter Conference on Applications of Computer Vision (WACV 2021).

LIGHTEN: Learning Interactions with Graph and Heirarchical TEmporal Networks for HOI in videos [source code]

Sai Praneeth Sunkesula, Rishabh Dabral, Ganesh Ramakrishnan

In Proceedings of The 28th ACM International Conference on Multimedia (ACMM 2020), Seattle, USA.

Caption Alignment for Low Resource Audio-Visual Data

Vighnesh Reddy Konda, Mayur Warialani, Rakesh Prasanth Achari, Varad Bhatnagar, Japrakash Akula, Preethi Jyothi, Ganesh Ramakrishnan, Gholamreza Haffari and Pankaj Singh

Accepted paper at the 21st INTERSPEECH Conference (Interspeech 2020), Shanghai, China

A Framework towards Domain Specific Video Summarization

Vishal Kaushal, Sandeep Subramanian, Suraj Kothawade, Rishabh Iyer, Ganesh Ramakrishnan

Accepted paper at the 7th IEEE Winter Conference on Applications of Computer Vision (WACV), 2019, Hawaii, USA.

A Framework towards Domain Specific Video Summarization

Vishal Kaushal, Sandeep Subramanian, Suraj Kothawade, Rishabh Iyer, Ganesh Ramakrishnan

Accepted paper at the 7th IEEE Winter Conference on Applications of Computer Vision (WACV), 2019, Hawaii, USA.

Learning From Less Data: Diversified Subset Selection and Active Learning in Image Classification Tasks

Vishal Kaushal, Rishabh Iyer, Anurag Sahoo, Khoshrav Doctor, Narasimha Raju, Ganesh Ramakrishnan

Accepted paper at the 7th IEEE Winter Conference on Applications of Computer Vision (WACV), 2019, Hawaii, USA.

Demystifying Multi-Faceted Video Summarization: Tradeoff Between Diversity,Representation, Coverage and Importance

Vishal Kaushal, Rishabh Iyer, Anurag Sahoo, Pratik Dubal, Suraj Kothawade, Rohan Mahadev, Kunal Dargan, Ganesh Ramakrishnan

Accepted paper at the 7th IEEE Winter Conference on Applications of Computer Vision (WACV), 2019, Hawaii, USA.

Anomaly Detection in Surveillance Videos

Sukalyan Bhakat, Ganesh Ramakrishnan

Best demo paper award. In Proceedings of the ACM India Joint International Conference on Data Science and Management of Data, CoDS-COMAD '19, Kolkota, India.

An Interactive Multi-Label Consensus Labeling Model for Multiple Labeler Judgments

Ashish Kulkarni, Narasimha Raju Uppalapati, Pankaj Singh, Ganesh Ramakrishnan

In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI-18), New Orleans, Louisiana, USA.

Synthesis of Programs from Multimodal Datasets

Shantanu Thakoor, Simoni Shah, Ganesh Ramakrishnan, Amitabha Sanyal

In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI-18), New Orleans, Louisiana, USA.

Error Detection and Corrections in Indic OCR using LSTMs

Rohit Saluja, Devaraj Adiga, Parag Chaudhuri, Ganesh Ramakrishnan and Mark Carman

International Conference on Document Analysis and Recognition (ICDAR) 2017, Kyoto, Japan.

A Framework for Document Specific Error Detection and Corrections in Indic OCR

Rohit Saluja, Devaraj Adiga, Ganesh Ramakrishnan, Parag Chaudhuri and Mark Carman

1st International Workshop on Open Services and Tools for Document Analysis (ICDAR- OST) 2017, Kyoto, Japan.

Improving the learnability of classifiers for Sanskrit OCR corrections

Devaraja Adiga, Rohit Saluja, Vaibhav Agrawal, Ganesh Ramakrishnan, Parag Chaudhuri, K. Ramasubramanian and Malhar Kulkarni

Proceedings of the 17th World Sanskrit Conference, Vancouver, 2018.

A Framework for Error Detection and Corrections in Sanskrit

Rohit Saluja, Devaraj Adiga, Parag Chaudhuri, Ganesh Ramakrishnan and Mark Carman

Research and Innovation Symposium in Computing (RISC) 2017 (Most Admiring Poster Presentation Award), IIT-Bombay, India.

Summarizing Multi-Document Topic Hierarchies using Submodular Mixtures

Ramakrishna Bairi, Rishabh Iyer, Ganesh Ramakrishnan and Jeff Bilmes

In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), Beijing, China, July - 2015

In The News

Team of Prof. Ganesh Ramakrishnan (with Dr. Vishal Kaushal and SrivisifAI Technologies) wins National e-Governance Award

25th National Conference on eGovernance, 26th-27th November, Jammu

Award Film

Official Facebook Post by Govt. of India

Official Twitter Post by Govt. of India

Times Of India

IIT Bombay Twitter

IIT Bombay Facebook

News18 Jammu Twitter

News9

News18 Video

Prof. Ganesh Ramakrishnan and Vishal Kaushal receive the Dr. P. K. Patwardhan Technology Development Award 2020

IIT Bombay, September 6, 2021

Link to the presentation (50:36 onwards)

CCTV tech by IIT-Bombay checks footage, sends out alerts

Mid-Day, Mumbai, June 18, 2021

Link to the article

IIT-Bombay develops AI platform for real-time video surveillance

Hindustan Times, Mumbai, June 17, 2021

Link to the article

IIT-Bombay develops AI-based solutions for video analytics, surveillance

Times Of India, Mumbai, June 17, 2021

Link to the article

Director, IIT Bombay

Facebook, June 16, 2021

Link to the post

TEAM

Ganesh Ramakrishnan, Faculty, CSE (Principal Investigator); Rishabh Iyer, Faculty, UT Dallas (Collaborator)

Vishal Kaushal (Research Scholar, Video Analytics); Rohit Saluja (Research Scholar, Document Analytics

Pankaj Singh, Aify (Collaborator)

SrivisifAI Technologies Pvt. Ltd. (Industry Partner)

Contact Us

For further details or if you are interested in using the softwares.

SI-A418, KReSIT, IIT-Bombay, Mumbai, Maharastra

ganesh@cse.iitb.ac.in

+91-022-25767728

Interested in our work?

Inquire