Hybrid Image Inpainting: Combining Low-rank Minimization and Spline-based Approach | ||
| Journal of AI and Data Mining | ||
| دوره 13، شماره 1، فروردین 2025، صفحه 75-84 اصل مقاله (1.18 M) | ||
| نوع مقاله: Original/Review Paper | ||
| شناسه دیجیتال (DOI): 10.22044/jadm.2025.14744.2576 | ||
| نویسنده | ||
| Kimia Peyvandi* | ||
| Faculty of Computer Science, Semnan University, Semnan, Iran. | ||
| چکیده | ||
| Image inpainting is one of the important topics in the field of image processing, and various methods have been proposed in this area. However, this problem still faces multiple challenges, as an inpainting algorithm may perform well for a specific class of images but may have poor performance for other images. In this paper, we attempt to decompose the image into a low-rank component and a sparse component using (Principal Component Analysis) PCA, and then independently restore each component. For inpainting the low-rank component, we use an algorithm based on low-rank minimization, and for restoring the sparse component, we use the concept of splines. Using splines, we can effectively restore edges and lines, whereas the restoration of these regions is challenging in most algorithms. Also, in restoring the low-rank component, we construct a tensor at each step and approximate the missing pixels in the tensor, thereby significantly improving the efficiency of the low-rank minimization idea in image inpainting. Finally, we have applied our proposed method to restore various types of images, which demonstrates the effectiveness of our proposed method compared to other inpainting methods based on PSNR and SSIM. | ||
| کلیدواژهها | ||
| Target region؛ Spline؛ Low-rank minimization؛ Tensor | ||
| مراجع | ||
|
[1] M. Bertalmio, G. Sapiro, V. Caselles, C. Ballester, “Image inpainting,” in Proceedings of the 27th annual conference on Computer graphics and interactive techniques, pp. 417-424, 2000.
[2] The Berkeley Segmentation Dataset and Benchmark, http://www.eecs.berkeley.edu/Research/Projects/CS/vision/grouping/segbench/.
[3] A. Criminisi, P. Pérez, K. Toyama, “Region filling and object removal by exemplar-based image inpainting,” IEEE Transactions on Image Processing, vol. 13, pp. 1200-1212, 2004.
[4] N. Zhang, H. Ji, L. Liu, G. Wang, “Exemplar-based image inpainting using angle-aware patch matching,” EURASIP Journal on Image and Video Processing, 2019.
[5] Z. Xu, J. Sun, “Image Inpainting by Patch Propagation Using Patch Sparsity,” IEEE Transactions on image processing, vol. 19, no. 5, MAY 2010.
[6] T.-H. Kwok, H. Sheung, C. C. Wang, "Fast query for exemplarbased image completion," IEEE Transaction on Image Processing, vol. 19, no. 12, pp. 3106-3115, 2010.
[7] H. Wang, L. Jiang, R. Liang, X. X. Li, “exemplar based image inpainting using structure consisten patch matching,” Neuro computing, vol. 269, pp. 90-96, 2017.
[8] A. A. Efros, T. K. Leung, “Texture Synthesis by Non-Parametric Sampling,” ICCV '99 Proceedings of the International Conference on Computer Vision, 1999.
[9] Z. Chen et al, “Structure aware image inpainting using patch scale optimization,” Journal of Visual Communication and Image Representation, vol. 40. pp. 312-323, 2016.
[10] A. Levin, A. Zomet, Y. Weiss, “Learning how to inpaint from global image statistics, International Conference on Computer Vision (ICCV), pp. 305–312, 2003.
[11] J. Shen, T. F. Chan, “Mathematical Models for Local Nontexture Inpaintings,” SIAM, vol. 62, pp. 1019–1043, 2002.
[12] C. Ballester, M. Bertalmio, V. Caselles, G. Sapiro, and J. Verdera, "Filling-in by joint interpolation of vector fields and gray levels," IEEE Transactions on Image Processing, vol. 10, no. 8, pp. 1200-1211, 2001.
[13] J. Shen, S. H. Kang, T. F. Chan, “Euler's Elastica and Curvature-Based Inpainting,” SIAM J. Appl. Math, vol. 63, Issue. 2, pp. 564–592, 2003.
[14] M. Fazel, “Matrix rank minimization with applications,” PhD thesis, Stanford University, 2002.
[15] J. F. Cai, E. J. Candès, Z. Shen, “A singular value thresholding algorithm for matrix completion,” SIAM Journal on Optimization, vol. 20, no. 4, pp. 1956–1982, 2010.
[16] T. F. Chan, J. Shen, “Nontexture Inpainting by Curvature-Driven Diffusions,” Journal of Visual Communication and Image Representation, vol. 12, issue. 4, PP. 436-449, 2001.
[17] Q. Guo, S. Gao, X. Zhang. Y. Yin, C. Zhang, “Patch-Based Image Inpainting via Two-Stage Low Rank Approximation”, IEEE Transactions on Visualization and Computer Graphics, 2017.
[18] V. K. Alilou, F. Yaghmaee, “Non-texture image inpainting using histogram of oriented gradients,” Journal of Visual Communication and Image Representation, vol. 48, pp. 43-53, 2017.
[19] G. Liu, F. A. Reda, K. J. Shih, T.Chun. Wang, A, Tao, B. Catanzaro, “Image Inpainting for Irregular Holes Using Partial Convolutions,” Proceedings of the European Conference on Computer Vision, (ECCV), 2018.
[20] V. Fedorov, G. Facciolo, P. Arias, “Variational framework for non-local inpainting,” Image Processing OnLine, vol. 5, pp. 362-386, 2015.
[21] Y. Chen, R. Xia, K. Zou, K. Yang, “FFTI: Image inpainting algorithm via features fusion and two-steps inpainting”, Journal of Visual Communication and Image Representation, vol.91, 2023.
[22] Y. Chen, R. Xia, K. Yang, K. Zou, MFMAM: Image inpainting via multi-scale feature module with attention module, Computer Vision and Image Understanding, Vol. 238, January 2024.
[23] Y. Zeng and et al, High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsampling, Computer Vision – ECCV, pp. 1-17, 2020.
[24] C. Liu and et al, Towards Interactive Image Inpainting via Robust Sketch Refinement, IEEE Transactions on Multimedia, PP. 1-15, 2024.
[25] F. Yaghmaee, K. Pevandi, Efficient Image Inpainting Using Dimensional Space Reduction via Adaptive Patch-based Concept and Rank Lowering Technique, International Journal on Artificial Intelligence Tools, vol. 30, 2021.
[26] V. Kumar, J. Mukherjee, SK. DasMandal, “Image Inpainting through metric Labelling via guided patch mixing,” IEEE Transactions on Image Processing, vol. 25, issue. 11, pp. 5212–5226, 2016.
[27] M. Ghorai, S. Mandal, B. Chanda, “A Two-Step Image Inpainting Algorithm Using Tensor SVD,” Workshops on Computer Vision (ACCV), pp. 63-77, 2014.
[28] W. Qin, Nonconvex Robust High-Order Tensor Completion Using Randomized Low-Rank Approximation, IEEE Transactions on Image Processing , vol. 33, pp. 2835 – 2850, 2024.
[29] Y. Weng, S. Ding, T. Zhou, A Survey on Improved GAN based Image Inpainting, International Conference on Consumer Electronics and Computer Engineering (ICCECE), 2022.
[30] C. Corneanu, R. Gadde, A. Martinez, LatentPaint: Image Inpainting in Latent Space with Diffusion Models, Conference on Applications of Computer Vision (WACV), 2024.
[31] E. Sahragard, H. Farsi, S. Mohammadzadeh, “Image Restoration by Variable Splitting based on Total Variant Regularizer,” Journal of AI & Data Mining (JADM), vol. 6, no. 1, 2018. | ||
|
آمار تعداد مشاهده مقاله: 121 تعداد دریافت فایل اصل مقاله: 230 |
||