基于特征核相关的单张图像三维人脸重建方法
DOI:
作者:
作者单位:

作者简介:

通讯作者:

基金项目:


3D Face Reconstruction from a Single Image Based on Feature Kernel Correlation
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    目的 解决现有基于弱监督学习的单张图像三维人脸重建方法聚焦于全局监督信息,缺少对局部特征的约 束,导致人脸局部区域重建效果较差的问题。 方法 提出一种基于特征核相关的单张图像三维人脸重建方法,在由 低层级感知损失、中层级人脸关键点损失、高层级身份损失和形状一致性损失等构成的全局多层级损失函数基础 上,构造特征核相关损失函数,对局部进行深层次约束,旨在提高三维人脸的重建精度。 结果 将所提损失函数用于 对嘴部形状的约束,在 REALY 公开基准上进行定量对比实验,整体重建的误差均值为 2. 102 mm,嘴部重建误差为 2. 206 mm;在 FFHQ 公开数据集上进行定性对比实验;最后在 FaceScape 数据集和 LYHM 数据集上进行消融实验 和可视化展示,以验证所提损失函数的有效性和模型鲁棒性。 结论 实验表明:在不同视角中,所提的重建方法整体 和局部重建效果均优于其他方法,面对不同姿态、表情和光照环境,所提模型均有较好的性能表现。

    Abstract:

    Objective This paper aims to address the issue that existing single-image 3D face reconstruction methods based on weakly supervised learning focus on global supervision information and lack constraints on local features which leads to poor reconstruction results in local facial regions. Methods A single-image 3D face reconstruction method based on feature kernel correlation is proposed. On the basis of a global multi-level loss function composed of low-level perceptual loss mid-level facial key-point loss high-level identity loss and shape consistency loss a feature kernel correlation loss function was constructed to better constrain local parts aiming to improve the reconstruction accuracy of 3D faces. Results The proposed loss function was used to constrain the shape of the mouth. Quantitative comparison experiments were conducted on the REALY public benchmark with the mean error of the overall reconstruction being 2. 102 mm and the mouth reconstruction error being 2. 206 mm. Qualitative comparison experiments were carried out on the FFHQ public dataset. Finally ablation experiments and visual demonstrations were performed on the FaceScape dataset and the LYHM dataset to verify the effectiveness of the proposed loss function and the robustness of the model. Conclusion Experimental results demonstrate that the proposed reconstruction method outperforms other methods from different viewpoints in both overall and local reconstruction. Moreover the proposed model also exhibits outstanding performance in various poses expressions and lighting environments.

    参考文献
    相似文献
    引证文献
引用本文

王阿龙,戴家树,倪斌帆,曹 韬.基于特征核相关的单张图像三维人脸重建方法[J].重庆工商大学学报(自然科学版),2026,43(4):18-27
WANG Along DAI Jiashu NI Binfan CAO Tao.3D Face Reconstruction from a Single Image Based on Feature Kernel Correlation[J]. Journal of Chongqing Technology and Business University(Natural Science Edition),2026,43(4):18-27

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-07-07
×
2025年《中国学术期刊影响因子年报》发布