A 3D Point Cloud Gesture Estimation Method Based on EdgeConv Reconstruction of Joint Features.

Gesture interaction allows users to interact with objects through natural hand movements without direct physical contact. However, in gesture interaction, the hand moves frequently with large variations in direction, and hand joints are prone to self-occlusion. The accuracy of existing 3D point cloud gesture estimation methods is insufficient to meet the requirements of natural gesture interaction. This article proposes a 3D point cloud gesture estimation method based on EdgeConv to reconstruct joint features. The method first converts depth maps into point cloud data to reduce the impact of viewpoint variations on depth map representation of the same gesture, thereby mitigating the effect on estimation accuracy. Then, the global features are reconstructed using EdgeConv in the initial joint estimation module so that the reconstructed features contain structural information between hand joints. Finally, local joint refinement is performed by constructing local features centered around the refined joint twice using EdgeConv. These features include reference information from within group points to group center points and structural information between joint points. Using EdgeConv to enrich hand joint feature information can effectively improve the performance of hand joint estimation. Comparative experimental analysis was conducted on the 3D point cloud datasets ICVL, NYU, and MSRA, and complex scene experimental analysis was conducted on the InterHand2.6M dataset. Furthermore, the development of virtual-real interaction applications was carried out. The experimental results show that the 3D point cloud gesture estimation method proposed in this paper has high accuracy, strong generalization and robustness, providing solid support for natural gesture interaction applications.