Occluded Object Classification With mmWave MIMO Radar IQ Signals Using Dual-Stream Convolutional Neural Networks

Haegele, Stefan; Seguel, Fabian; Kahya, Sabri Mustafa; Steinbach, Eckehard

Abstract

The ability of millimeter-wave (mmWave) radar to penetrate lightweight materials and provide nonvisual insights into obscured areas represents a significant advantage over camera or LiDAR sensors. This capability enables mmWave radar to detect humans behind thin walls or identify occluded objects stored within luggage or packages. The latter capability is particularly valuable in industrial, logistics, and manufacturing applications, where the ability to "look inside the box without opening it" can greatly enhance the efficiency and security. However, the current state of the art in these applications relies on expensive custom-built large antenna array imaging scanners, coupled with image-based object detection algorithms, to detect and classify occluded or concealed objects. To address this challenge more efficiently, we propose a lightweight classification approach for detecting various occluded objects inside a cardboard box. We employ a standard off-the-shelf mmWave 4-D frequency-modulated continuous wave (FMCW) imaging radar. This is combined with a deep learning-based classification method in the form of a dual-stream convolutional neural network (CNN) approach to process complex in-phase and quadrature (IQ) radar signals. This approach reaches in our experiments an overall accuracy of 95.15% on average over a collection of ten different concealed objects.

Más información

Título según WOS: ID WOS:001508081100002 Not found in local WOS DB
Título de la Revista: IEEE TRANSACTIONS ON RADAR SYSTEMS
Volumen: 3
Editorial: IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Fecha de publicación: 2025
Página de inicio: 789
Página final: 798
DOI:

10.1109/TRS.2025.3571284

Notas: ISI