publications

2025

1. Wiley

   Deep Learning on Embedded Systems: A Hands-On Approach Using Jetson Nano and Raspberry Pi

   Tariq M Arif

   2025
2. Procedia

   Benchmarking deep learning models on nvidia jetson nano for real-time systems: An empirical investigation

   Tushar Prasanna Swaminathan, Christopher Silver, Thangarajah Akilan, and 1 more author

   Procedia Computer Science, 2025
3. ACM

   Kernel Float: Unlocking Mixed-Precision GPU Programming

   Stijn Heldens, and Ben Werkhoven

   ACM Transactions on Mathematical Software, 2025

2024

1. Springer

   Wild Animal Recognition Using an Edge Device

   Vincenzo Russo, Paola Barra, Augusto Tortora, and 4 more authors

   In Intelligent Computing, 2024

   Abs HTML

   Neural networks and deep learning are in rapid development; new technologies and increasingly high-performance computing centres allow operations to be carried out that, until a few years ago, were impossible due to excessive processing times. The possibility of exploiting an Edge/Cloud configuration allows speed in training neural networks, ability to operate in real-time, elasticity, and resistance of the entire system in the event of a failure. This configuration helps reduce costs by using less expensive tools in the sensing and edge regions. In this work, an edge computing system was implemented to recognise wild animals such as goats and wild boars. The image recognition problem was therefore addressed by exploiting transfer learning techniques on two state-of-the-art methods: YOLOv5 and EfficientNet. The comparison of the results highlighted the pros and cons of the two methods.

2. IEEE

   AI and Memory Wall

   Amir Gholami, Zhewei Yao, Sehoon Kim, and 3 more authors

   IEEE Micro, 2024

   Abs HTML PDF

   The availability of unprecedented unsupervised training data, along with neural scaling laws, has resulted in an unprecedented surge in model size and compute requirements for serving/training large language models. However, the main performance bottleneck is increasingly shifting to memory bandwidth. Over the past 20 years, peak server hardware floating-point operations per second have been scaling at 3.0 times per two years, outpacing the growth of dynamic random-access memory and interconnect bandwidth, which have only scaled at 1.6 and 1.4 times every two years, respectively. This disparity has made memory, rather than compute, the primary bottleneck in AI applications, particularly in serving. Here, we analyze encoder and decoder transformer models and show how memory bandwidth can become the dominant bottleneck for decoder models. We argue for a redesign in model architecture, training, and deployment strategies to overcome this memory limitation.

2023

1. MDPI

   Road Condition Monitoring Using Vehicle Built-in Cameras and GPS Sensors: A Deep Learning Approach

   Cuthbert Ruseruka, Judith Mwakalonge, Gurcan Comert, and 2 more authors

   Vehicles, 2023

   Abs

   Road authorities worldwide can leverage the advances in vehicle technology by continuously monitoring their roads’ conditions to minimize road maintenance costs. The existing methods for carrying out road condition surveys involve manual observations using standard survey forms, performed by qualified personnel. These methods are expensive, time-consuming, infrequent, and can hardly provide real-time information. Some automated approaches also exist but are very expensive since they require special vehicles equipped with computing devices and sensors for data collection and processing. This research aims to leverage the advances in vehicle technology in providing a cheap and real-time approach to carry out road condition monitoring (RCM). This study developed a deep learning model using the You Only Look Once, Version 5 (YOLOv5) algorithm that was trained to capture and categorize flexible pavement distresses (FPD) and reached 95% precision, 93.4% recall, and 97.2% mean Average Precision. Using vehicle built-in cameras and GPS sensors, these distresses were detected, images were captured, and locations were recorded. This was validated on campus roads and parking lots using a car featured with a built-in camera and GPS. The vehicles’ built-in technologies provided a more cost-effective and efficient road condition monitoring approach that could also provide real-time road conditions.

2. IEEE

   Vehicle Damage Severity Estimation for Insurance Operations Using In-The-Wild Mobile Images

   Dimitrios Mallios, Li Xiaofei, Niall McLaughlin, and 3 more authors

   IEEE Access, 2023

   HTML PDF
3. MDPI

   A Systematic Review on Deep Learning with CNNs Applied to Surface Defect Detection

   Esteban Cumbajin, Nuno Rodrigues, Paulo Costa, and 7 more authors

   Journal of Imaging, 2023

   Abs HTML

   Surface defect detection with machine learning has become an important tool in industries and a large field of study for researchers or workers in recent years. It is necessary to have a simplified source of information that helps us to better focus on one type of surface. In this systematic review, we present a classification for surface defect detection based on convolutional neural networks (CNNs) focused on surface types. Findings: Out of 253 records identified, 59 primary studies were eligible. Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we analyzed the structures of each study and the concepts related to defects and their types on surfaces. The presented review is mainly focused on finding a classification for the types of surfaces most used in industry (metal, building, ceramic, wood, and special). We delve into the specifics of each surface category, offering illustrative examples of their applications within both industrial and laboratory settings. Furthermore, we propose a new taxonomy of machine learning based on the obtained results and collected information. We summarized the studies and extracted the main characteristics such as type of surface, problem types, timeline, type of network, techniques, and datasets. Among the most relevant results of our analysis, we found that the metallic surface is the most used, as it is the one found in 62.71% of the studies, and the most prevalent problem type is classification, accounting for 49.15% of the total. Furthermore, we observe that transfer learning was employed in 83.05% of the studies, while data augmentation was utilized in 59.32%. Our findings also provide insights into the cameras most frequently employed, along with the strategies adopted to address illumination challenges present in certain articles and the approach to creating datasets for real-world applications. The main results presented in this review allow for a quick and efficient search of information for researchers and professionals interested in improving the results of their defect detection projects. Finally, we analyzed the trends that could open new fields of study for future research in the area of surface defect detection.

4. Elsevier

   A Literature Review on Digital Twins in Warehouses

   Marie-Jane Bélanger, Robert Pellerin, and Samir Lamouri

   Procedia Computer Science, 2023

   CENTERIS – International Conference on Enterprise Information Systems / ProjMAN – International Conference on Project MANagement / HCist – International Conference on Health and Social Care Information Systems and Technologies 2022

   Abs HTML

   Due to the high cost of their warehousing operations, many manufacturing companies are looking to increase the efficiency of their warehouse. To this end, Industry 4.0 technologies offer several solutions to address this issue. One of them is the digital twin (DT) technology which is relatively new. This paper presents a literature review on DTs in warehousing. The analysis framework used to classify the papers includes the general description of the DT, the possible uses, and the required data. Our results show that several limitations remain to exploit the full potential of a DT. The limitations mainly concern the characterization of the data required.

5. arXiv

   Report of the DOE/NSF Workshop on Correctness in Scientific Computing, June 2023, Orlando, FL

   Maya Gokhale, Ganesh Gopalakrishnan, Jackson Mayo, and 3 more authors

   Dec 2023

   Abs PDF

   It has been observed in an ongoing study that the floating-point details of GPUs—especially Tensor Cores—can vary in subtle ways with respect to their rounding behaviors, which can hinder direct cross-platform software porting with assurance.

2022

1. MDPI

   A Systematic Review of Traffic Incident Detection Algorithms

   Osama ElSahly, and Akmal Abdelfatah

   Sustainability, Dec 2022

   Abs HTML

   Traffic incidents have negative impacts on traffic flow and the gross domestic product of most countries. In addition, they may result in fatalities and injuries. Thus, efficient incident detection systems have a vital role in restoring normal traffic conditions on the roads and saving lives and properties. Researchers have realized the importance of Automatic Incident Detection (AID) systems and conducted several studies to develop AID systems to quickly detect traffic incidents with an acceptable performance level. An incident detection system mainly consists of two modules: a data collection module and a data processing module. The performance of AID systems is assessed using three performance measures; Detection Rate (DR), False Alarm Rate (FAR) and Mean Time to Detect (MTTD). Based on data processing and incident detection algorithms, AID can be categorized into four categories: comparative, statistical, artificial intelligence-based and video–image processing algorithms. The aim of this paper is to investigate and summarize the existing AID systems by assessing their performance, strengths, limitations and their corresponding data collection and data processing techniques. This is useful in highlighting the shortcomings of these systems and providing potential solutions that future research should focus on. The literature is sought through an extensive review of the existing refereed publications using the Google Scholar search engine and Scopus database. The methodology adopted for this research is a systematic literature review following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. This study can serve as a reference for researchers who are interested in developing new AID systems.

2. Convolutional Neural Networks for vehicle damage detection

   R.E. van Ruitenbeek, and S. Bhulai

   Machine Learning with Applications, Dec 2022

   Abs HTML

   Vehicle damages are increasingly becoming a liability for shared mobility services. The large number of handovers between drivers demands for an accurate and fast inspection system, which locates small damages and classifies these into the correct damage category. To address this, a damage detection model is developed to locate vehicle damages and classify these into twelve categories. Multiple deep learning algorithms are used, and the effect of different transfer learning and training strategies is evaluated, to optimize the detection performance. The final model, trained on more than 10,000 damage images, is able to accurately detect small damages under various conditions such as water and dirt. A performance evaluation with domain experts shows, that the model achieves comparable performance. In addition, the model is evaluated in a specially designed light street, indicating that strong reflections complicate the detection performance.

2021

1. ViViT: A Video Vision Transformer

   A. Arnab, M. Dehghani, G. Heigold, and 3 more authors

   In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Oct 2021

   Abs HTML PDF

   We present pure-transformer based models for video classification, drawing upon the recent success of such models in image classification. Our model extracts spatiotemporal tokens from the input video, which are then encoded by a series of transformer layers. In order to handle the long sequences of tokens encountered in video, we propose several, efficient variants of our model which factorise the spatial- and temporal-dimensions of the input. Although transformer-based models are known to only be effective when large training datasets are available, we show how we can effectively regularise the model during training and leverage pretrained image models to be able to train on comparatively small datasets. We conduct thorough ablation studies, and achieve state-of-the-art results on multiple video classification benchmarks including Kinetics 400 and 600, Epic Kitchens, Something-Something v2 and Moments in Time, outperforming prior methods based on deep 3D convolutional networks.

2. Physics-based Deep Learning

   Nils Thuerey, Philipp Holl, Maximilian Mueller, and 3 more authors

   Sep 2021

   PBDL v0.2, available online at: https://www.physicsbaseddeeplearning.org/

   Abs PDF

   This digital book contains a practical and comprehensive introduction of everything related to deep learning in the context of physical simulations. As much as possible, all topics come with hands-on code examples in the form of Jupyter notebooks to quickly get started. Beyond standard supervised learning from data, we’ll look at physical loss constraints, more tightly coupled learning algorithms with differentiable simulations, as well as reinforcement learning and uncertainty modeling. We live in exciting times: these methods have a huge potential to fundamentally change what computer simulations can achieve.

3. IEEE

   Deep Learning’s Diminishing Returns: The Cost of Improvement is Becoming Unsustainable

   Neil C. Thompson, Kristjan Greenewald, Keeheon Lee, and 1 more author

   IEEE Spectrum, Sep 2021

   Abs HTML

   Deep learning is now being used to translate between languages, predict how proteins fold, analyze medical scans, and play games as complex as Go, to name just a few applications of a technique that is now becoming pervasive. Success in those and other realms has brought this machine-learning technique from obscurity in the early 2000s to dominance today. • Although deep learning’s rise to fame is relatively recent, its origins are not. In 1958, back when mainframe computers filled rooms and ran on vacuum tubes, knowledge of the interconnections between neurons in the brain inspired Frank Rosenblatt at Cornell to design the first artificial neural network, which he presciently described as a “pattern-recognizing device.” But Rosenblatt’s ambitions outpaced the capabilities of his era—and he knew it. Even his inaugural paper was forced to acknowledge the voracious appetite of neural networks for computational power, bemoaning that “as the number of connections in the network increases…the burden on a conventional digital computer soon becomes excessive.” • Fortunately for such artificial neural networks—later rechristened “deep learning” when they included extra layers of neurons—decades of Moore’s Law and other improvements in computer hardware yielded a roughly 10-million-fold increase in the number of computations that a computer could do in a second. So when researchers returned to deep learning in the late 2000s, they wielded tools equal to the challenge.

4. Springer

   Software Engineering as an Alchemical Process: Establishing a Philosophy of the Discipline

   Manuel Mazzara, Mirko Farina, Adéla Krylová, and 2 more authors

   In Frontiers in Software Engineering, Sep 2021

   Abs

   Far from being a bizarre pastime, alchemy played a crucially important role in the history of science, being supported and promoted by leading political and scientific figures (such as Rudolf II, Jābir ibn Hayyān, Gerard of Cremona, Adelard of Bath, Roger Bacon, Paracelsus, and even Newton). To understand alchemy, however, one has to approach it from both a material and a spiritual (perhaps philosophical) perspective. On the one hand, alchemists wanted to transform, or better transmute, materials (such as lead into gold). On the other hand, though, alchemists were also aiming at transforming qualities and aspects of themselves. In this paper, we show that Computer Science, and in particular Software Engineering, can be partly understood as alchemical processes. We thus draw analogies and specify points of contact between these two, prima facie, distinct and very distant worlds. In doing so, we also formulate and discuss a number of important questions regarding the nature and metaphysics of computation, that can be of interests to many researchers in computer science.

5. Springer

   Deep learning, deep change? Mapping the evolution and geography of a general purpose technology

   Joel Klinger, Juan Mateos-Garcia, and Konstantinos Stathoulopoulos

   Scientometrics, Sep 2021

   HTML

2020

1. MDPI

   The Neural Network Zoo

   Stefan Leijnen, and Fjodor van Veen

   Proceedings, Sep 2020

   Abs HTML PDF

   An overview of neural network architectures is presented. Some of these architectures have been created in recent years, whereas others originate from many decades ago. Apart from providing a practical tool for comparing deep learning models, the Neural Network Zoo also uncovers a taxonomy of network architectures, their chronology, and traces back lineages and inspirations for these neural information processing systems.

2. AAAI

   Energy and Policy Considerations for Modern Deep Learning Research

   Emma Strubell, Ananya Ganesh, and Andrew McCallum

   Proceedings of the AAAI Conference on Artificial Intelligence, Apr 2020

   Abs HTML PDF

   The field of artificial intelligence has experienced a dramatic methodological shift towards large neural networks trained on plentiful data. This shift has been fueled by recent advances in hardware and techniques enabling remarkable levels of computation, resulting in impressive advances in AI across many applications. However, the massive computation required to obtain these exciting results is costly both financially, due to the price of specialized hardware and electricity or cloud compute time, and to the environment, as a result of non-renewable energy used to fuel modern tensor processing hardware. In a paper published this year at ACL, we brought this issue to the attention of NLP researchers by quantifying the approximate financial and environmental costs of training and tuning neural network models for NLP (Strubell, Ganesh, and McCallum 2019). In this extended abstract, we briefly summarize our findings in NLP, incorporating updated estimates and broader information from recent related publications, and provide actionable recommendations to reduce costs and improve equity in the machine learning and artificial intelligence community

3. arXiv

   Yolov4: Optimal speed and accuracy of object detection

   Alexey Bochkovskiy, Chien-Yao Wang, and Hong-Yuan Mark Liao

   arXiv preprint arXiv:2004.10934, Apr 2020

   Abs PDF

   There are a huge number of features which are said to improve Convolutional Neural Network (CNN) accuracy. Practical testing of combinations of such features on large datasets, and theoretical justification of the result, is required. Some features operate on certain models exclusively and for certain problems exclusively, or only for small-scale datasets; while some features, such as batch-normalization and residual-connections, are applicable to the majority of models, tasks, and datasets. We assume that such universal features include Weighted-Residual-Connections (WRC), Cross-Stage-Partial-connections (CSP), Cross mini-Batch Normalization (CmBN), Self-adversarial-training (SAT) and Mish-activation. We use new features: WRC, CSP, CmBN, SAT, Mish activation, Mosaic data augmentation, CmBN, DropBlock regularization, and CIoU loss, and combine some of them to achieve state-of-the-art results: 43.5% AP (65.7% AP50) for the MS COCO dataset at a realtime speed of  65 FPS on Tesla V100.

2019

1. Elsevier

   Calculating the costs of animal-vehicle accidents involving ungulate in Sweden

   Ing-Marie Gren, and Annika Jägerbrand

   Transportation Research Part D: Transport and Environment, Apr 2019

   Abs HTML

   Animal-vehicle collisions (AVCs) involving ungulate species pose a serious problem in many countries, and the prediction of accidents and costs on a regional and national spatial scale is important for efficient accident mitigation. Based on the assumption that AVCs are determined by traffic volume and ungulate population dynamics, this study developed a relatively simple method for calculating and predicting the costs of current and future traffic accidents involving moose, roe deer and wild boar in Sweden. A logistic population model was assumed for all three ungulate species and econometric methods were applied to obtain population growth models based on panel data on traffic accidents, traffic load, hunting bags, hunting licenses and landscape characteristics for each Swedish county and year from 2003 to 2015. The population growth models were used to predict vehicle accidents and costs. The predicted annual discounted costs of AVCs over a 15-year period based on projected ungulate populations and traffic volume fell by 25% from 406 million USD in 2015, however the allocation of costs between ungulates differed. AVCs involving roe deer accounted for the largest share of the costs (54%), but collisions involving wild boar showed the most rapid increase over the study period because of a relatively high estimated growth rate and recent expansion of wild boar populations to several new counties. However, the predicted costs were sensitive to assumptions regarding population dynamics as well as assumptions about future hunting pressure and traffic volume.

2. Arxiv

   Surface defect classification in real-time using convolutional neural networks

   Selim Arikan, Kiran Varanasi, and Didier Stricker

   arXiv preprint arXiv:1904.04671, Apr 2019

   HTML PDF
3. MIT

   Training a single AI model can emit as much carbon as five cars in their lifetimes

   Karen Hao

   Apr 2019

   Abs HTML

   The artificial-intelligence industry is often compared to the oil industry: once mined and refined, data, like oil, can be a highly lucrative commodity. Now it seems the metaphor may extend even further. Like its fossil-fuel counterpart, the process of deep learning has an outsize environmental impact.

4. Elsevier

   Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

   M. Raissi, P. Perdikaris, and G.E. Karniadakis

   Journal of Computational Physics, Apr 2019

   Abs HTML PDF

   We introduce physics-informed neural networks – neural networks that are trained to solve supervised learning tasks while respecting any given laws of physics described by general nonlinear partial differential equations. In this work, we present our developments in the context of solving two main classes of problems: data-driven solution and data-driven discovery of partial differential equations. Depending on the nature and arrangement of the available data, we devise two distinct types of algorithms, namely continuous time and discrete time models. The first type of models forms a new family of data-efficient spatio-temporal function approximators, while the latter type allows the use of arbitrarily accurate implicit Runge–Kutta time stepping schemes with unlimited number of stages. The effectiveness of the proposed framework is demonstrated through a collection of classical problems in fluids, quantum mechanics, reaction–diffusion systems, and the propagation of nonlinear shallow-water waves.

2018

1. IEEE

   Municipal infrastructure anomaly and defect detection

   David Abou Chacra, and John Zelek

   In 2018 26th European Signal Processing Conference (EUSIPCO), Apr 2018

   PDF

2017

1. ACM

   ImageNet classification with deep convolutional neural networks

   Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton

   Commun. ACM, May 2017

   Abs HTML PDF

   We trained a large, deep convolutional neural network to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes. On the test data, we achieved top-1 and top-5 error rates of 37.5% and 17.0%, respectively, which is considerably better than the previous state-of-the-art. The neural network, which has 60 million parameters and 650,000 neurons, consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully connected layers with a final 1000-way softmax. To make training faster, we used non-saturating neurons and a very efficient GPU implementation of the convolution operation. To reduce overfitting in the fully connected layers we employed a recently developed regularization method called "dropout" that proved to be very effective. We also entered a variant of this model in the ILSVRC-2012 competition and achieved a winning top-5 test error rate of 15.3%, compared to 26.2% achieved by the second-best entry.

2. My take on Ali Rahimi’s ‘Test of Time’ award talk at NIPS

   Yann LeCun

   Facebook, https://www. facebook. com/yann. lecun/posts/101 54938130592143, May 2017

   PDF

2016

1. IEEE

   You Only Look Once: Unified, Real-Time Object Detection

   Joseph Redmon, Santosh Divvala, Ross Girshick, and 1 more author

   In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun 2016

   Abs HTML PDF

   We present YOLO, a new approach to object detection. Prior work on object detection repurposes classifiers to perform detection. Instead, we frame object detection as a regression problem to spatially separated bounding boxes and associated class probabilities. A single neural network predicts bounding boxes and class probabilities directly from full images in one evaluation. Since the whole detection pipeline is a single network, it can be optimized end-to-end directly on detection performance. Our unified architecture is extremely fast. Our base YOLO model processes images in real-time at 45 frames per second. A smaller version of the network, Fast YOLO, processes an astounding 155 frames per second while still achieving double the mAP of other real-time detectors. Compared to state-of-the-art detection systems, YOLO makes more localization errors but is less likely to predict false positives on background. Finally, YOLO learns very general representations of objects. It outperforms other detection methods, including DPM and R-CNN, when generalizing from natural images to other domains like artwork.

2015

1. SNL-NM

   Getting the right answer despite incorrect hardware.

   Mark Frederick Hoemmen

   Jun 2015

2008

1. The pothole patrol: using a mobile sensor network for road surface monitoring

   Jakob Eriksson, Lewis Girod, Bret Hull, and 3 more authors

   In Proceedings of the 6th International Conference on Mobile Systems, Applications, and Services, Breckenridge, CO, USA, Jun 2008

   Abs HTML

   This paper investigates an application of mobile sensing: detecting and reporting the surface conditions of roads. We describe a system and associated algorithms to monitor this important civil infrastructure using a collection of sensor-equipped vehicles. This system, which we call the Pothole Patrol (P2), uses the inherent mobility of the participating vehicles, opportunistically gathering data from vibration and GPS sensors, and processing the data to assess road surface conditions. We have deployed P2 on 7 taxis running in the Boston area. Using a simple machine-learning approach, we show that we are able to identify potholes and other severe road surface anomalies from accelerometer data. Via careful selection of training data and signal features, we have been able to build a detector that misidentifies good road segments as having potholes less than 0.2% of the time. We evaluate our system on data from thousands of kilometers of taxi drives, and show that it can successfully detect a number of real potholes in and around the Boston area. After clustering to further reduce spurious detections, manual inspection of reported potholes shows that over 90% contain road anomalies in need of repair.

2005

1. SIAM

   SRT division algorithms as dynamical systems

   Mark McCann, and Nicholas Pippenger

   SIAM Journal on Computing, Jun 2005

1995

1. IEEE

   Computational aspects of the Pentium affair

   Tim Coe, Terje Mathisen, Cleve Moler, and 1 more author

   IEEE Computational Science and Engineering, Jun 1995

1935

1. PhysRev

   Can Quantum-Mechanical Description of Physical Reality Be Considered Complete?

   A. Einstein^*†, B. Podolsky^*, and N. Rosen^*

   Phys. Rev., New Jersey. More Information can be found here , May 1935

   Abs HTML PDF Video

   

   In a complete theory there is an element corresponding to each element of reality. A sufficient condition for the reality of a physical quantity is the possibility of predicting it with certainty, without disturbing the system. In quantum mechanics in the case of two physical quantities described by non-commuting operators, the knowledge of one precludes the knowledge of the other. Then either (1) the description of reality given by the wave function in quantum mechanics is not complete or (2) these two quantities cannot have simultaneous reality. Consideration of the problem of making predictions concerning a system on the basis of measurements made on another system that had previously interacted with it leads to the result that if (1) is false then (2) is also false. One is thus led to conclude that the description of reality as given by a wave function is not complete.

1920

1. Relativity: the Special and General Theory

   Albert Einstein

   May 1920

   HTML