CPL - Chalmers Publication Library
| Utbildning | Forskning | Styrkeområden | Om Chalmers | In English In English Ej inloggad.

Multi-View Hand Tracking using Epipolar Geometry-Based Consistent Labeling for an Industrial Application

Yixiao Yun (Institutionen för signaler och system, Signalbehandling) ; Irene Y.H. Gu (Institutionen för signaler och system, Signalbehandling) ; Julien Provost (Institutionen för signaler och system, Automation) ; Knut Åkesson (Institutionen för signaler och system, Automation)
Seventh ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC 2013), Oc.29-Nov.1, Palm Springs, California, USA p. 6. (2013)
[Konferensbidrag, refereegranskat]

This paper addresses a visual tracking and analysis method for automatic monitoring of an industrial manual assembly process, where each worker sequentially picks up components from different boxes during an assembling process. Automatic surveillance of assembling process would enable to reduce assembling errors by giving early warning. We propose a hand tracking and trajectory analysis method from videos captured by several uncalibrated cameras with overlapping views. The proposed method consists of three modules through single-view hand tracking, consistent labeling across views, and optimal decision from multi-view temporal dynamics. The main novelties of the paper include: (a) target model learning with multiple instances through K-means clustering applied to accommodate different levels of light reflection; (b) optimal criterion for consistent labeling of tracked hands across views, based on the symmetric epipolar distance; (c) backward correction of mis-detection by combining epipolar lines with previously tracked results; (d) a multi-view voting scheme for analyzing hand trajectory using binary hand location maps. Experiments have been conducted on videos by multiple uncalibrated cameras, where a person performs assembly operations. Test results and performance evaluation have shown the effectiveness of this method, in terms of multi-view consistent estimation of hand trajectories and accurate interpretation of component assembly actions.

Nyckelord: multi-view hand tracking, hand trajectory analysis, epipolar geometry, multiple view tracking, consistent labeling

Den här publikationen ingår i följande styrkeområden:

Läs mer om Chalmers styrkeområden  

Denna post skapades 2013-09-10. Senast ändrad 2013-09-10.
CPL Pubid: 182978