Eine Plattform für die Wissenschaft: Bauingenieurwesen, Architektur und Urbanistik
Eine Plattform für die Wissenschaft: Bauingenieurwesen, Architektur und Urbanistik
Enriched and Discriminative Human Features for Person Re-Identification Based on Explainable Behaviors of Convolutional Neural Networks
https://orcid.org/http://orcid.org/0000-0003-1758-675X
https://orcid.org/http://orcid.org/0000-0001-8900-6692
https://orcid.org/http://orcid.org/0000-0003-2622-1939
https://orcid.org/http://orcid.org/0000-0002-1722-2617
Understanding pedestrian behaviors such as their movement patterns in urban areas could contribute to the design of pedestrian-friendly facilities. With the commonly deployed surveillance cameras, pedestrian movement in a wide region could be identified by the person re-identification (ReID) technique across multiple cameras. Convolutional neural networks (CNNs) have been widely studied to automate the ReID task. CNN models equipped with deep learning techniques could extract discriminative human features from images and show promising ReID performance. However, some common challenges such as occlusion and appearance variation are still unsolved. Specifically, our study infers that over-relying on discriminative features only may compromise ReID performance. Therefore, this paper proposes a new model that extracts enriched features, which is more reliable against those ReID challenges. By adding a feature dropping strategy during model training, our model learns to focus on rich human features from different body parts. Moreover, this paper presents an explainable approach of model design, by visualizing which human parts a deep learning model focuses on. Based on an intuitive interpretation of model behaviors that lead to inaccurate results, specific improvement of model architecture is inspired. Our improved results suggest that making existing models explainable could effectively shed light on designing more robust models.
Enriched and Discriminative Human Features for Person Re-Identification Based on Explainable Behaviors of Convolutional Neural Networks
https://orcid.org/http://orcid.org/0000-0003-1758-675X
https://orcid.org/http://orcid.org/0000-0001-8900-6692
https://orcid.org/http://orcid.org/0000-0003-2622-1939
https://orcid.org/http://orcid.org/0000-0002-1722-2617
Understanding pedestrian behaviors such as their movement patterns in urban areas could contribute to the design of pedestrian-friendly facilities. With the commonly deployed surveillance cameras, pedestrian movement in a wide region could be identified by the person re-identification (ReID) technique across multiple cameras. Convolutional neural networks (CNNs) have been widely studied to automate the ReID task. CNN models equipped with deep learning techniques could extract discriminative human features from images and show promising ReID performance. However, some common challenges such as occlusion and appearance variation are still unsolved. Specifically, our study infers that over-relying on discriminative features only may compromise ReID performance. Therefore, this paper proposes a new model that extracts enriched features, which is more reliable against those ReID challenges. By adding a feature dropping strategy during model training, our model learns to focus on rich human features from different body parts. Moreover, this paper presents an explainable approach of model design, by visualizing which human parts a deep learning model focuses on. Based on an intuitive interpretation of model behaviors that lead to inaccurate results, specific improvement of model architecture is inspired. Our improved results suggest that making existing models explainable could effectively shed light on designing more robust models.
Enriched and Discriminative Human Features for Person Re-Identification Based on Explainable Behaviors of Convolutional Neural Networks
https://orcid.org/http://orcid.org/0000-0003-1758-675X
https://orcid.org/http://orcid.org/0000-0001-8900-6692
https://orcid.org/http://orcid.org/0000-0003-2622-1939
https://orcid.org/http://orcid.org/0000-0002-1722-2617
Understanding pedestrian behaviors such as their movement patterns in urban areas could contribute to the design of pedestrian-friendly facilities. With the commonly deployed surveillance cameras, pedestrian movement in a wide region could be identified by the person re-identification (ReID) technique across multiple cameras. Convolutional neural networks (CNNs) have been widely studied to automate the ReID task. CNN models equipped with deep learning techniques could extract discriminative human features from images and show promising ReID performance. However, some common challenges such as occlusion and appearance variation are still unsolved. Specifically, our study infers that over-relying on discriminative features only may compromise ReID performance. Therefore, this paper proposes a new model that extracts enriched features, which is more reliable against those ReID challenges. By adding a feature dropping strategy during model training, our model learns to focus on rich human features from different body parts. Moreover, this paper presents an explainable approach of model design, by visualizing which human parts a deep learning model focuses on. Based on an intuitive interpretation of model behaviors that lead to inaccurate results, specific improvement of model architecture is inspired. Our improved results suggest that making existing models explainable could effectively shed light on designing more robust models.
Enriched and Discriminative Human Features for Person Re-Identification Based on Explainable Behaviors of Convolutional Neural Networks
Lecture Notes in Civil Engineering
Toledo Santos, Eduardo (Herausgeber:in) / Scheer, Sergio (Herausgeber:in) / Wong, Peter Kok-Yiu (Autor:in) / Luo, Han (Autor:in) / Wang, Mingzhu (Autor:in) / Cheng, Jack C. P. (Autor:in)
International Conference on Computing in Civil and Building Engineering ; 2020 ; São Paulo, Brazil
14.07.2020
13 pages
Aufsatz/Kapitel (Buch)
Elektronische Ressource
Englisch
Explainable Neural Networks: Achieving Interpretability in Neural Models
| Springer Verlag | 2024
Waveform‐based fracture identification of steel beam ends using convolutional neural networks
| Wiley | 2021