Stable diffusion for high-quality image reconstruction in digital rock analysis

Abstract

Digital rock analysis is a promising approach for visualizing geological microstructures and understanding transport mechanisms for underground geo-energy resources exploitation. Accurate image reconstruction methods are vital for capturing the diverse features and variability in digital rock samples. Stable diffusion, a cutting-edge artificial intelligence model, has revolutionized computer vision by creating realistic images. However, its application in digital rock analysis is still emerging. This study explores the applications of stable diffusion in digital rock analysis, including enhancing image resolution, improving quality with denoising and deblurring, segmenting images, filling missing sections, extending images with outpainting, and reconstructing three-dimensional rocks from two-dimensional images. The powerful image generation capability of diffusion models shed light on digital rock analysis, showing potential in filling missing parts of rock images, lithologic discrimination, and generating network parameters. In addition, limitations in existing stable diffusion models are also discussed, including the lack of real digital rock images, and not being able to fully understand the mechanisms behind physical processes. Therefore, it is suggested to develop new models tailored to digital rock images for further progress. In sum, the integration of stable diffusion into digital core analysis presents immense research opportunities and holds the potential to transform the field, ushering in groundbreaking advances.

Document Type: Original article

Cited as: Ma, Y., Liao, Q., Yan, Z., You, S., Song, X., Tian, S., Li, G. Stable diffusion for high-quality image reconstruction in digital rock analysis. Advances in Geo-Energy Research, 2024, 12(3): 168-182. https://doi.org/10.46690/ager.2024.06.02

References

Ahuja, V. R., Gupta, U., Rapole, S. R., et al. Siamese-SR: A siamese super-resolution model for boosting resolution of digital rock images for improved petrophysical property estimation. IEEE Transactions on Image Processing, 2022, 31: 3479-3493.

Bar-Tal, O., Yariv, L., Lipman, Y., et al. Multidiffusion: Fusing diffusion paths for controlled image generation. Paper Presented at Proceedings of the 40th International Conference on Machine Learning, Honolulu, Hawaii, USA, 23-29 July, 2023.

Brooks, T., Peebles, B., Homes, C., et al. Video generation models as world simulators. OpenAI, 2024.

Chang, C., Peng, J., Safari, M., et al. High-resolution MRI synthesis using a data-driven framework with denoising diffusion probabilistic modeling. Physics in Medicine & Biology, 2024, 69(4): 045001.

Chen, H., He, X., Teng, Q., et al. Super-resolution of realworld rock microcomputed tomography images using cycle-consistent generative adversarial networks. Physical Review E, 2020, 101(2): 023305.

Chi, P., Sun, J., Luo, X., et al. Reconstruction of 3D digital rocks with controllable porosity using CVAE-GAN. Geoenergy Science and Engineering, 2023, 230: 212264.

Croitoru, F., Hondru, V., Ionescu, R., et al. Diffusion models in vision: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45(9): 10850-10869.

Feng, J., Teng, Q., Li, B., et al. An end-to-end threedimensional reconstruction framework of porous media from a single two-dimensional image based on deep learning. Computer Methods in Applied Mechanics and Engineering, 2020, 368: 113043.

Gong, K., Johnson, K., El Fakhri, G., et al. PET image denoising based on denoising diffusion probabilistic model. European Journal of Nuclear Medicine and Molecular Imaging, 2023, 51: 358-368.

Goral, J., Panja, P., Deo, M., et al. Confinement effect on porosity and permeability of shales. Scientific Reports, 2020, 10(1): 49.

Ho, J., Jain, A., Abbeel, P. Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems, 2020, 33: 6840-6851.

Hu, E. Deforum stable diffusion local version, 2023. Imamverdiyev, Y., Sukhostat, L. Lithological facies classification using deep convolutional neural network. Journal of Petroleum Science and Engineering, 2019, 174: 216-228.

Kazerouni, A., Aghdam, E. K., Heidari, M., et al. Diffusion models in medical imaging: A comprehensive survey. Medical Image Analysis, 2023, 88: 102846.

Li, X., Li, B., Liu, F., et al. Advances in the application of deep learning methods to digital rock technology. Advances in Geo-Energy Research, 2023, 8(1): 5-18.

Li, Z., Deng, S., Hong, Y., et al. A novel hybrid CNN-SVM method for lithology identification in shale reservoirs based on logging measurements. Journal of Applied Geophysics, 2024, 223: 105346.

Liao, Q., Xue, L., Wang, B., Lei, G. A new upscaling method for microscopic fluid flow based on digital rocks. Advances in Geo-Energy Research, 2022, 6(4): 357-358.

Liu, X., Su, S., Gu, W., et al. Super-resolution reconstruction of ct images based on multi-scale information fused generative adversarial networks. Annals of Biomedical Engineering, 2024, 52(1): 57-70.

Lu, C., Zhou, Y., Bao, F., et al. DPM-solver: A fast ODE solver for diffusion probabilistic model sampling in around 10 steps. Advances in Neural Information Processing Systems, 2022, 35: 5775-5787.

Lugmayr, A., Danelljan, M., Romero, A., et al. Repaint: Inpainting using denoising diffusion probabilistic models. Paper Presented at Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, Los Angeles, 18-24 June, 2022.

Ma, Z., He, X., Kwak, H., et al. Enhancing rock image segmentation in digital rock physics: A fusion of generative ai and state-of-the-art neural networks. ArXiv Preprint ArXiv: 2311.06079, 2023a.

Ma, Z., Sun, S., Yan, B., et al. Enhancing the resolution of micro-CT images of rock samples via unsupervised machine learning based on a diffusion model. Paper SPE 214883 Presented at SPE Annual Technical Conference and Exhibition, San Antonio, Texas, 16-18 October, 2023b.

Mao, S., He, Y., Chen, H., et al. High-quality and highdiversity conditionally generative ghost imaging based on denoising diffusion probabilistic model. Optics Express, 2023, 31(15): 25104-25116.

Pan, S., Wang, T., Qiu, R. L., et al. 2D medical image synthesis using transformer-based denoising diffusion probabilistic model. Physics in Medicine & Biology, 2023, 68(10): 105004.

Rombach, R., Blattmann, A., Lorenz, D., et al. High-resolution image synthesis with latent diffusion models. Paper Presented at Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, Los Angeles, 18-24 June, 2022.

Shan, L., Bai, X., Liu, C., et al. Super-resolution reconstruction of digital rock CT images based on residual attention mechanism. Advances in Geo-Energy Research, 2022, 6(2): 157-168.

Wang, K., Xu, Z., Zhou, Y., et al. Neural network diffusion.

Wang, Y. D., Armstrong, R. T., Mostaghimi, P. Enhancing resolution of digital rock images with super resolution convolutional neural networks. Journal of Petroleum Science and Engineering, 2019, 182: 106261.

Xie, S., Zhang, Z., Lin, Z., et al. Smartbrush: Text and shape guided object inpainting with diffusion model. Paper Presented at Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, Canada, 18-22 June, 2023.

Yan, Z., Zhou, C., Li, X. A survey on generative diffusion model. Computer Science, 2024, 51(1): 273-283. (in Chinese)

Zeng, B., Liu, X., Gao, S., et al. Face animation with an attribute-guided diffusion model. Paper Presented at Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, Canada, 18-22 June, 2023.

Zha, W., Li, X., Li, D., et al. Shale digital core image generation based on generative adversarial networks. Journal of Energy Resources Technology, 2021, 143(3): 033003.

Zhang, K., Li, Y., Liang, J., et al. Practical blind image denoising via Swin-Conv-UNet and data synthesis. Machine Intelligence Research, 2023a, 20(6): 822-836.

Zhang, L., Rao, A., Agrawala, M. Adding conditional control to text-to-image diffusion models. Paper Presented at Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France, 1-6 October, 2023b.

Zhao, J., Chen, H., Li, N., et al. Research advance of petrophysical application based on digital core technology. Progress in Geophysics, 2020, 35(3): 1099-1108.

Zhao, J., Wang, F., Cai, J. 3D tight sandstone digital rock reconstruction with deep learning. Journal of Petroleum Science and Engineering, 2021, 207: 109020.

Zheng, Q., Zhang, D. RockGPT: Reconstructing threedimensional digital rocks from single two-dimensional slice with deep learning. Computational Geosciences, 2022, 26(3): 677-696