🟠 音效合成流程
✔️ 视频画面分析理解
✔️ 内容、材质等静态属性分析
✔️ 运动等时序动态属性分析
✔️ 音频合成（物理建模+数据驱动）
音效合成Demo
💠 水声
基于流体3D信息建模水声
💠 烟花声
💠 脚步声（视频配音）
基于画面理解合成脚步声
💠 脚步声（VR场景）
基于VR场景与用户交互合成脚步声
Paper List
[1] Haonan Cheng and Shiguang Liu. 2019. Haptic force guided sound synthesis in multisensory virtual reality (VR) simulation for rigid-fluid interaction. In Proceedings of IEEE VR. 111–119.（CCF A）
[2] Shiguang Liu, Haonan Cheng and Yiying Tong. 2019. Physically-based statistical simulation of rain sound. ACM Transactions on Graphics (SIGGRAPH 2019) 38 4 (2019) 123:1–123:14.（SCI一区，CCF A）
[3] Haonan Cheng and Shiguang Liu. 2019. Liquid-solid interaction sound synthesis. Graphical Models 103 (2019) 101028:1–101028:11.（CCF B）
[4] Haonan Cheng, Sijia Li Shiguang Liu. Deep cross-modal synthesis of environmental sound. Journal of Computer-Aided Design & Computer Graphics 2019 31(12): 2047-2055.（CCF A）
[5] Qiutang Qi, Haonan Cheng*, Yang Wang, Long Ye, Shaobin Li. A Rule-Data Hybrid Framework for Fine-grained Footstep Sound Synthesis from Visual Guidance. In Proceedings of ACM MM, 2023.（CCF A）
[6] Kai Wang, Haonan Cheng and Shiguang Liu. Efficient sound synthesis for natural scenes. In Proceedings of IEEE Virtual Reality (VR 2017) poster 2017 pp. 303-304.（CCF A）
[7] Shiguang Liu, Sijia Li and Haonan Cheng. 2021. Towards an end-to-end visual-to-raw-audio generation with GANs. IEEE Transactions on Circuits and Systems for Video Technology.（SCI 1区）
[8] Haonan Cheng, Shiguang Liu, Jiawan Zhang. 2023. Lightweight Scene-aware Rain Sound Simulation for Interactive Virtual Environments. In Proceedings of IEEE VR.（CCF A）
[9] Haonan Cheng, Zhaoye Wang Hengyan Huang Juanjuan Cai Long Ye. 2023. Behaviourally-based Synthesis of Scene-aware Footstep Sound. In Proceedings of IEEE VR. （CCF A）
[10] 程皓楠, 张加万. 虚拟场景中环境声源仿真技术综述. 计算机学报, 2022, 45 (2): 369-392.
AI-Sound 