Please use this identifier to cite or link to this item:
Type: Artigo
Title: Multi-stream convolutional neural networks for action recognition in video sequences based on adaptive visual rhythms
Author: Concha, Darwin Ttito
Maia, Helena De Almeida
Pedrini, Helio
Tacon, Hemerson
Brito, André De Souza
Chaves, Hugo De Lima
Vieira, Marcelo Bernardes
Abstract: Advances in digital technology have increased event recognition capabilities through the development of devices with high resolution, small physical dimensions and high sampling rates. The recognition of complex events in videos has several relevant applications, particularly due to the large availability of digital cameras in environments such as airports, banks, roads, among others. The large amount of data produced is the ideal scenario for the development of automatic methods based on deep learning. Despite the significant progress achieved through image-based deep networks, video understanding still faces challenges in modeling spatio-temporal relations. In this work, we address the problem of human action recognition in videos. A multi-stream network is our architecture of choice to incorporate temporal information, since it may benefit from pre-trained deep networks for images and from handcrafted features for initialization. Furthermore, its training cost is usually lower than video-based networks. We explore visual rhythm images since they encode longer-term information when compared to still frames and optical flow. We propose a novel method based on point tracking for deciding the best visual rhythm direction for each video. Experiments conducted on the challenging UCF101 and HMDB51 data sets indicate that our proposed stream improves network performance, achieving accuracy rates comparable to the state-of-the-art approaches
Subject: Aprendizado de máquina
Redes neurais (Computação)
Ritmo visual
Country: Estados Unidos
Editor: Institute of Electrical and Electronics Engineers
Rights: Fechado
Identifier DOI: 10.1109/ICMLA.2018.00077
Date Issue: 2019
Appears in Collections:IC - Artigos e Outros Documentos

Files in This Item:
File Description SizeFormat 
2-s2.0-85062233868.pdf566.65 kBAdobe PDFView/Open

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.