Advanced Textile Technology ›› 2024, Vol. 32 ›› Issue (1): 54-63.

Previous Articles     Next Articles

2D Image reconstruction of nonwoven fabrics based on generative adversarial networks

  

  1. 1.a. Zhejiang Provincial Research Center of Clothing Engineering Technology; b. School of Fashion Design & Engineering; c.International Institute of Fashion Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China ; 2.  Wuhan Textile and Apparel Digital Engineering Technology Research Center, Wuhan Textile University, Wuhan 430073, China
  • Online:2024-01-10 Published:2024-01-30

基于生成对抗网络的非织造布二维图像重建

  

  1. 1. 浙江理工大学,a.浙江省服装工程技术研究中心;b.服装学院;c.国际时装技术学院,杭州 310018;2. 武汉纺织大学武汉纺织服装数字化工程技术研究中心,武汉 430073
  • 通讯作者: 刘正,E-mail: koala@zstu.edu.cn
  • 作者简介:王志禄(1998- ),男,江西信丰人,硕士研究生,主要从事计算机视觉方面研究。
  • 基金资助:
    武汉纺织服装数字化工程技术研究中心开放基金(SZH202201),嘉兴市重点研发计划项目(2021BZ10001)

Abstract:  Nonwovens are used in a wide range of applications, including medical and health care, tourism, construction and waterproofing, and agriculture, for a variety of filtration materials, gas or particle adsorption materials, sound insulation, and more. The functions of nonwovens are closely related to the structure of their fiber collections. Based on the premise that nonwovens are randomly arranged in the layers of the fiber network, researchers usually use parametric simulation, fractal theory or image generation algorithms to simulate the fibers of nonwovens. However, the fiber structure generated in this way has the following problems: (1) The fiber morphology based on parametric simulation is linear and does not agree with the actual fiber curl state. (2) The fractal theory-based simulations cannot reconstruct the real nonwoven fabric structure concretely. (3) The single fiber morphology reconstructed based on the generation algorithm is different from the real state of the fiber morphology.
In order to reconstruct a realistic image of the nonwoven fiber structure, this paper constructs a generative adversarial network (FGAN) with a multiscale training strategy on the GAN base framework. In order to improve the stability of model training, a multi-scale training strategy is used to train the model, and PixelwiseNormalization layer and standardization layer are also introduced in the construction of the model. The reconstructed fiber structure is randomly arranged, which is consistent with the real nonwoven fiber arrangement. To increase the diversity of fiber structures in the generated images, a weight diversity loss WMI Loss is proposed. the model is trained for a long time, and the final generator is stable to generate nonwoven images that are consistent with the real images. Compared with other generative models, FGAN has better stability and the reconstructed nonwoven images have higher quality and more diverse fiber structures. Also, to verify the effectiveness of multiple-degree training strategy and weight diversity loss, ablation experiments are performed on the model. The experimental results show that the evaluation index FID of the model-generated images is reduced by 24.52% under the effect of the multiscale training strategy and by 20.31% under the effect of the weight diversity loss. Finally, in order to verify the structural consistency between the generated images and the real images, the average porosity of the real images is calculated to be 30.87% and the average porosity of the generated images is 30.02%, which are very close to each other. And the pore number distribution curves of the generated image and the real image have a high overlap. From the above analysis, it can be verified that the porosity and pore distribution of the nonwoven fabric images generated by the model are consistent with the real images.
FGAN can reconstruct high quality 2D images of nonwovens, from which detailed information on fiber distribution and morphology can be obtained. This information can be used for nonwoven performance analysis, optimization of production processes, etc. The method is able to reconstruct a diverse range of thin nonwoven structures, while the analysis of thicker nonwoven structures is yet to be investigated.

Key words: Nonwoven fabric, pore, generate adversarial networks, diversity loss, image generation

摘要: 非织造布纤维结构的准确表征是其性能分析的重要基础。为了解决基于近似模拟的表征结果中纤维形态、结构与真实样本不一致的问题,提出了一种基于生成对抗网络的非织造布二维图像重建方法。使用全自动光学显微镜对非织造布图像进行抓取,并在此基础上构建纤维生成对抗网络(Fiber generation adversarial network,FGAN)对图像样本进行建模。针对高分辨率图像重建时存在的失真问题,采用多尺度训练策略,同时引入权重多样性损失。采用图像质量评估指标FID作为实验评价指标,分别与DCGAN、WGAN-GP、BEGAN、PROGAN等生成模型进行对比实验。结果表明:FGAN重建的非织造布图像质量更高;消融实验证明,多尺度训练策略与权重多样性损失函数中FID数值分别降低24.52%、20.31%。FGAN模型的提出,使非织造布结构分析摆脱对近似模拟方法的依赖,提供了准确的纤维分布信息,对非织造布的质量评估、性能优化等应用具有重要意义。

关键词: 非织造布, 孔隙, 生成对抗网络, 多样性损失, 图像重建

CLC Number: