I also worked as a machine learning developer at Mojow Autonomous Solutions for over two years between 2021 and 2025, researching ways to automate farming operations using computer vision and deep learning.
I spent another year or so between 2018 and 2021 working as a developer at a former non-profit named ACAMP, where I contributed to the human and animal detection and fence damage detection components of an autonomous security ATV.
My research interests include all aspects of computer vision and machine learning, though I am particularly interested in the application of deep learning to visual recognition tasks like object detection, segmentation and tracking.
End-to-End Multi-Object Tracking with Sequence Prediction: (July 2020 - Oct 2023): Supervisor: Nilanjan Ray, University of Alberta
Adapting a couple of dense video captioning methods for multi-object tracking
Creating a language of trajectories so that a sentence corresponds to a trajectory and a multi-sentence caption corresponds to the set of all trajectories in the video clip
Deep MDP: (May 2019 - April 2021): Supervisor: Nilanjan Ray, University of Alberta
Attempted to improve the performance of the MDP system and remove its heavy dependency on handcrafted features and heuristics by incorporating deep learning
Created an elegant abstraction to generalize the MDP framework to incorporate deep learning-based trackers, feature extractors and classifiers
Added support for cell tracking in microscopy images
Fence Damage Detection with Laser Imaging: (September 2020 - March 2021): Supervisor: Ken Brizel, ACAMP
Developed and analysed algorithms to detect small holes in fences using laser line detection based fence mask extraction and computer vision based hole detection
Animal and Human Detection with Deep Learning : (May-August 2018, January-April 2019): Supervisors: Nilanjan Ray, University of Alberta,
Nehla Ghouaiel, ACAMP
Trained and tested 6 deep CNN based object detectors - RFCN, SSD, YOLO(1,2,3) and 3 variants of Faster RCNN - Inceptionv4, ResNet101, NAS - for detecting humans and 8 different types of animals
Trained and tested several instance segmentation methods like Mask RCNN and Sharpmask to generate realistic augmented data
Used Tensorflow, Darknet and Pytorch for implementation.
Created a ROS compatible application ready for deployment on an autonomous ATV.
Developed efficient ways to get compressed video data from the ATV to the GPU server.
Helped develop a fence damage detection algorithm using laser based line detection and unsupervised learning.
Vehicle and Pedestrian Tracking for Road Traffic Analysis at Intersections : (March 2017-Jan 2018): Supervisor: Nilanjan Ray, University of Alberta, Douglas Hallett, ISL Engineering
Created a system for tracking vehicles and pedestrians in real time traffic videos of roundabouts and intersections captured from UAV and pole mounted cameras.
Created a highly efficient python implementation of the MDP online multi object tracker using opencv, cuda and numpy to obtain a tenfold speed increase over the Matlab version and make it suitable for real time deployment.
Adapted an open source PyQt based graphical tool to perform integrated detection, tracking and semi automated labelling.
Modular Tracking Framework: A Unified Approach to Registration based Tracking : (Jan 2015-Feb 2017): Supervisor: Prof. Martin Jagersand, University of Alberta
Devised a novel way to study registration based trackers by decomposing them into three constituent
sub modules: appearance model, search method and state space model
Empirically tested different combinations of sub modules to produce novel and interesting observations and insights missing in each method's original paper due to limited testing.
Proposed two new appearance models and several new composite search methods to achieve a new state of the art in registration tracking.
Conducted experiments using four large datasets: TMT, UCSB, LinTrack and PAMI - with over 100,000 frames in all to ensure their statistical significance.
Created an open source tracking framework that can be used to reproduce all results and, owing to its efficient C++ implementation, also address practical tracking requirements.
Using Deep Learning techniques for 3D Object Recognition : (Jan 2014-April 2014): Supervisor: Dale Schuurmans, University of Alberta
Developed and tested several variants of the 6 hidden layer LeNet-5 architecture for classification of handwritten digits and 3D real world objects represented by the MNIST and NORB datasets respectively.
Used Matlab deep learning toolbox for implementation.
Multi Object Recognition in an Indoor Environment : (July 2012-Nov 2012): Supervisor: U.S. Tiwary, IIIT Allahabad
Implemented an object recognition system based on a hierarchical model of visual processing in the human visual cortex
System learns both invariance to object transformations and selectivity towards specific object features in an incremental manner, across several layers
Matlab was used for implementation and a custom created database of several common indoor objects was used for testing the system
Object Based Change Detection in Multi Temporal High Resolution Satellite Images : (July 2011-Nov 2011): Supervisor: Anupam Agrawal, IIIT Allahabad
Analyzed, debugged and documented an existing work based on multi feature fusion based change detection and also extended it with a hierarchical clustering based approach
The results of these were compared with each other as well as with existing pixel based methods
The system was tested on Google Earth images of IIIT-A taken in 2004 and 2008 and was found to give high accuracies of over 95% with both methodologies
Publications
Abhineet Singh, Justin Rozeboom, and Nilanjan Ray, "Tokenizing Semantic Segmentation with Run Length Encoding",
arxiv 2602.21627v2, February 2026
[pdf][code][models]
Abhineet Singh, and Nilanjan Ray, "Improving Token-Based Object Detection With Video",
IEEE Access, August 2025
[pdf][code][models]
Nidheesh Dadheech, Mario Bermúdez de León, Zofia Czarnecka, Nerea Cuesta-Gomez, Ila Tewari Jasra, Rena Pawlick, Braulio Marfil-Garza, Sandhya Sapkota, Kevin Verhoeff, Haide Razavy, Perveen Anwar, Abhineet Singh, Nilanjan Ray, Doug O’ Gorman, Glen Jickling, James Lyon, Patrick MacDonald, and A. M. James Shapiro,"Scale up manufacturing approach for production of human induced pluripotent stem cell-derived islets using Vertical Wheel® bioreactors",
npj Regenerative Medicine, May 2025
Abhineet Singh, Ila Jasra, Omar Mouhammed, Nidheesh Dadheech, Nilanjan Ray, James Shapiro, "
Towards Early Prediction of Human iPSC Reprogramming Success",
MELBA, November 2023
(also accepted in MIDL 2025)
[pdf][supplementary][code][data and models]
Abhineet Singh, "Deep MDP: A Modular Framework for Multi-Object Tracking", arXiv:2310.14294, October 2023 [pdf][code]
Sara Elkerdawy, Mostafa Elhoushi, Abhineet Singh, Hong Zhang and Nilanjan Ray, "To filter prune, or to layer prune, that is the question", 15th Asian Conference on Computer Vision (ACCV), December 2020 [pdf]
Sara Elkerdawy, Mostafa Elhoushi, Abhineet Singh, Hong Zhang and Nilanjan Ray, "One-Shot Layer-Wise Accuracy Approximation for Layer Pruning", in IEEE International Conference on Image Processing (ICIP), October 2020 [pdf]
Abhineet Singh, Hayden Kalke, Mark Loewen and Nilanjan Ray, "River Ice Segmentation with Deep Learning", in IEEE Transactions on Geoscience and Remote Sensing, February 2020
[pdf][supplementary][report][code]
Abhineet Singh, Marcin Pietrasik, Gabriell Natha, Nehla Ghouaiel, Ken Brizel and Nilanjan Ray, "Animal Detection in Man-made Environments", in the IEEE Winter Conference on Applications of Computer Vision (WACV), March 2020
[pdf][supplementary][code][labeling tool demo]
[wacv spotlight]
[poster]
Abhineet Singh and Martin Jagersand, "Modular Tracking Framework: A Fast Library for High Precision Tracking", IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), September 2017 [pdf][video][code]
Xuebin Qin, Shida He, Camilo Alfonso Perez Quintero, Abhineet Singh, Masood Dehghan, Martin Jagersand, "Real-Time Salient Closed Boundary Tracking via Line Segments Perceptual Grouping ", IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), September 2017 [pdf][video][code]
Mennatullah Siam, Abhineet Singh, Camilo Perez and Martin Jagersand, "4-DoF Tracking for Robot Fine Manipulation Tasks", in the 14th Conference on Computer and Robot Vision (CRV), May 2017 [pdf]
Abhineet Singh, Mennatullah Siam and Martin Jagersand, "Unifying Registration based Tracking: A Case Study with Structural Similarity", in the IEEE Winter Conference on Applications of Computer Vision (WACV), March 2017
[pdf][supplementary]
Abhineet Singh, Ankush Roy, Xi Zhang and Martin Jagersand, "Modular Decomposition and Analysis of Registration based Trackers", in 13th Conference on Computer and Robot Vision (CRV), 2016, pp.85-92, June 2016 [pdf][ppt]
Xi Zhang, Abhineet Singh and Martin Jagersand, "RKLT: 8 DOF Real-Time Robust Video Tracking Combing Coarse Ransac Features and Accurate Fast Template Registration", in 12th Conference on Computer and Robot Vision (CRV), 2015, pp.70-77, June 2015
[pdf][code]
Abdul Quaiyum Ansari, Madasu Hanmandlu, Jaspreet Kour and Abhineet Singh, "Online signature verification using segment-level fuzzy modelling", in IET Biometrics, vol.3, no.3, pp.113-127, Sept. 2014
[pdf][code]
Abhineet Singh and Anupam Agrawal., "An interactive framework for abandoned and removed object detection in video", in 2013 Annual IEEE India Conference (INDICON), pp.1-6, 13-15 Dec. 2013
[pdf][code]
Abhineet Singh, Savita Verma, Mangal Raj and Anupam Agrawal, "An Assessment of the Impact of Dimensionality Reduction on the Speed and Accuracy of Hyperspectral Image Classification", International Journal of Advanced Computer Research, ACCENTS Pub., Vol. 3, No. 3, pp. 436 - 441, Sept. 2013
[pdf][report][code]
