Skip to Main content Skip to Navigation
Journal articles

3D visual saliency and convolutional neural network for blind mesh quality assessment

Abstract : A number of full reference and reduced reference methods have been proposed in order to estimate the perceived visual quality of 3D meshes. However, in most practical situations, there is a limited access to the information related to the reference and the distortion type. For these reasons, the development of a no-reference mesh visual quality (MVQ) approach is a critical issue, and more emphasis needs to be devoted to blind methods. In this work, we propose a no-reference convolutional neural network (CNN) framework to estimate the perceived visual quality of 3D meshes. The method is called SCNN-BMQA (3D visual saliency and CNN for blind mesh quality assessment). The main contribution is the usage of a CNN and 3D visual saliency to estimate the perceived visual quality of distorted meshes. To do so, the CNN architecture is fed by small patches selected carefully according to their level of saliency. First, the visual saliency of the 3D mesh is computed. Afterward, we render 2D projections from the 3D mesh and its corresponding 3D saliency map. Then the obtained views are split into 2D small patches that pass through a saliency filter in order to select the most relevant patches. Finally, a CNN is used for the feature learning and the quality score estimation. Extensive experiments are conducted on four prominent MVQ assessment databases, including several tests to study the effect of the CNN parameters, the effect of visual saliency and comparison with existing methods. Results show that the trained CNN achieves good rates in terms of correlation with human judgment and outperforms the most effective state-of-the-art methods. Keywords Mesh visual quality assessment Á Mean opinion score Á Mesh visual saliency Á Convolutional neural network
Document type :
Journal articles
Complete list of metadatas

Cited literature [45 references]  Display  Hide  Download

https://hal-univ-orleans.archives-ouvertes.fr/hal-02384188
Contributor : Aladine Chetouani <>
Submitted on : Thursday, December 26, 2019 - 11:55:03 AM
Last modification on : Tuesday, January 7, 2020 - 11:12:14 AM
Long-term archiving on: : Friday, March 27, 2020 - 2:20:46 PM

File

 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : 2020-12-26

Please log in to resquest access to the document

Identifiers

Citation

Ilyass Abouelaziz, Aladine Chetouani, Mohammed El Hassouni, Lj Latecki, Hocine Cherifi. 3D visual saliency and convolutional neural network for blind mesh quality assessment. Neural Computing and Applications, Springer Verlag, 2019, ⟨10.1007/s00521-019-04521-1(⟩. ⟨hal-02384188⟩

Share

Metrics

Record views

91