Deformable 3D Shape Matching to Try on Virtual Clothes via Laplacian-Beltrami Descriptor | ||
| Journal of AI and Data Mining | ||
| دوره 10، شماره 1، فروردین 2022، صفحه 63-74 اصل مقاله (2.21 M) | ||
| نوع مقاله: Original/Review Paper | ||
| شناسه دیجیتال (DOI): 10.22044/jadm.2021.10749.2212 | ||
| نویسندگان | ||
| H. Fathi؛ A.R. Ahmadyfard* ؛ H. Khosravi | ||
| Faculty of Electrical Engineering, Shahrood University of Technology, Shahrood, Iran. | ||
| چکیده | ||
| Recently, significant attention has been paid to the development of virtual reality systems in several fields such as commerce. Trying on virtual clothes is becoming a solution for the online clothing industry. In this paper, we propose a method for the problem of virtual clothing using 3D point matching of a selected cloth and the customer body. For this purpose, we provide a 3D model of the customer and the selected clothes, put up on the mannequin, using a Kinect camera. As the size of the abdominal part of the customer is different from the mannequin, after pre-processing of the two captured point clouds, the 3D point cloud of the selected clothes is deformed to fit the 3D point cloud of the customer’s body. We use Laplacian-Beltrami curvature as a descriptor to find the abdominal part in the two point clouds. Then, the abdominal part of the mannequin is deformed in 3D space to fit the abdominal part of the customer. Finally, the head and neck of the customer are attached to the mannequin point. The proposed method has two main advantages over the existing methods for virtual clothing. First, no need for an expert to design a 3D model for the customer body and the selected clothes in advanced graphical software such as Unity. Second, there is no restriction for the style of the selected clothes and their texture while existing methods have such restrictions. The experimental results justify the ability of the proposed method for virtual clothing. | ||
| کلیدواژهها | ||
| Virtual Clothes؛ 3D Mapping؛ Laplace-Beltrami؛ Shape Deformation | ||
| مراجع | ||
|
[1] A Hilsmann, P Eisert, "Tracking and Retexturing Cloth for Real-Time Virtual Clothing Applications," Computer Vision/Computer Graphics Collaboration Techniques, pp. 94-105, 2009.
[2] BKP Horn, BG Schunck, "Determining optical flow," Artificial Intelligence, Vol. 17, No. 1-3, pp. 185-203, 1981.
[3] P. E. A Hilsmann, "Deformable Object Tracking using Optical Flow Constraints," Visual Media Production CVMP, 2007.
[4] W Zhang, T Matsumoto, J Liu, and M Chu,“An Intelligent Fitting Room using Multi-Camera Perception,” International Conference on Intelligent User Interfaces, pp. 60-69, 2008.
[5] M Kotan, C Öz, "Virtual Dressing Room Application with Virtual Human using Kinect Sensor," Journal of Mechanics Engineering and Automation, pp. 322-326, 2015.
[6] M Yuan, IR Khan, F Farbiz, and S Yao, "A Mixed Reality Virtual Clothes Try-On System," IEEE Transactions on Multimedia, Vol. 15, No. 18, pp. 1958 - 1968, 2013.
[7] P Volino, N Magnenat Thalmann, and F Faure, "A simple approach to non-linear tensile stiffness for accurate cloth simulation," ACM Transactions on Graphics, Vol. 28, No. 4, 2009.
[8] S Milborrow, F Nicolls,“Locating facial features with an extended active shape model,” European Conference on Computer Vision, pp. 504-513, 2008.
[9] E Reinhard, M Adhikhmin, and B Gooch, "Color Transfer between Images," IEEE Computer Graphics and Applications, Vol. 21, No. 5, 2001.
[10] M Özuysal, V Lepetit, F Fleuret, and P Fua,“Feature Harvesting for Tracking-by-Detection,” European Conference on Computer Vision, pp. 592-605, 2006.
[11] DW Marquardt, "An Algorithm for Least-Squares Estimation of Non-linear Parameters," Journal of the Society for Industrial and Applied Mathematics, Vol. 11, No. 2, p. 431–441, 1963.
[12] SB Adikari, NC Ganegoda, RGN Meegama, and IL Wanniarachchi, "Applicability of a Single Depth Sensor in Real-Time 3D Clothes Simulation: Augmented Reality Virtual Dressing Room Using Kinect Sensor," Advances in Human-Computer Interaction, Vol. 2020, 2020.
[13] KW Mok, CT Wong, SK Choi, and LM Zhang, "Design and Development of Virtual Dressing Room System Based on Kinect," I.J. Information Technology and Computer Science, pp. 39-46, 2018.
[14] S Yang, ZH Pan, T Amert, KE Wang, L Yu, and T Berg, "Physics-Inspired Garment Recovery from a Single-View Image," ACM Transactions on Graphics, Vol. 37, No. 5, 2018.
[15] G Pons-Moll, S Pujades, S Hu, and MJ Black, "ClothCap: Seamless 4D Clothing Capture and Retargeting," ACM Transactions on Graphics, Vol. 36, No. 4, 2017.
[16] Y Xu, S Yang, W Sun, L Tan, K Li, and H Zhou, "3D Virtual Garment Modeling from RGB Images," IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2019.
[17] C Li, F Cohen, "In-home application (App) for 3D virtual garment fitting dressing room,” Springer Multimedia Tools and Applications, 2020.
[18] M Desbrun, M Meyer, P Schröder, and AH Barr,“implicit fairing of irregular meshes using diffusion and curvature flow,” in Profceedings of the 26th Annual Conference on Computer Graphics and Interactive Ttechniques, pp. 317-324, 1999.
[19] X David Gu, R Guo, F Luo, and W Zeng, "Discrete Laplace-Beltrami Operator Determines Discrete Riemannian Metric," ArXiv, Vol. 1010.4070, 2010.
[20] S. Bayatpour Seyed M. H. Hasheminejad, "Object Segmentation using Local Histograms, Invasive Weed Optimization Algorithm and Texture Analysis," Journal of Artificial Intelligence and Data Mining (JAIDM), Vol. 9, No. 4, 2021.
[21] Y Kleiman, M Ovsjanikov, "Robust Structure‐Based Shape Correspondence," Computer Graphics Forum, Vol. 38, pp. 7-20, 2019.
[22] H Wang, T Birdal, M Sung, F Arrigoni,SM Hu, and L Guibas, "MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan Synchronization," Computer Vision and Pattern Recognition, 2021.
[23] S Yuan, Y Fang,“ROSS: Robust Learning of One-shot 3D Shape Segmentation,” in 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), 2020.
[24] C Zhu, K Xu, S Chaudhuri, L Yi, LJ Guibas, and H Zhang,“AdaCoSeg: Adaptive Shape Co-Segmentation With Group Consistency Loss,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[25] D George, X Xie, and GKL Tam, "3D mesh segmentation via multi-branch 1D convolutional neural networks," Graphical Models, Vol. 96, pp. 1-10, 2018.
[26] J Ren, J Schneider, M Ovsjanikov, and P Wonka, "Joint Graph Layouts for Visualizing Collections of Segmented Meshes," IEEE Transactions on Visualization and Computer Graphics, Vol. 24, No. 9, pp. 2546 - 2558, 2018.
[27] A Poulenard, M Ovsjanikov, "Multi-directional geodesic neural networks via equivariant convolution," ACM Transactions on Graphics (TOG), Vol. 37, No. 6, 2018.
[28] L Yi, H Su, X Guo, and LJ Guibas,“SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
[29] K Xu, VG Kim, Q Huang, and N Mitra, E Kalogerakis, "Data-driven shape analysis and processing," SIGGRAPH ASIA, pp. 1-38, 2016.
[30] E Kalogerakis, M Averkiou, S Maji, and S Chaudhuri,“3D Shape Segmentation With Projective Convolutional Networks,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
[31] P Skraba, M Ovsjanikov, F Chazal, and L Guibas, “Persistence-based segmentation of deformable shapes,” in IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, 2010.
[32] RM Rustamov, "Laplace-Beltrami eigenfunctions for deformation invariant shape representation," Proceedings of the fifth Eurographics symposium on Geometry processing, pp. 225-233, 2007.
[33] A Sharma, “Representation, Segmentation and Matching of 3D Visual Shapes using Graph Laplacian and Heat-Kernel,” Computer Vision and Pattern Recognition [cs.CV], Institut National Polytechnique de Grenoble - INPG, 2012. | ||
|
آمار تعداد مشاهده مقاله: 770 تعداد دریافت فایل اصل مقاله: 1,029 |
||