LIDNeRF: Language-Guided NeRF Editing With InstructDiffusion

Vaishali Kulkarni, Khushal Hemant Sharma, Manan Shah and Aniruddh Vinay Kulkarni
Additional contact information
Vaishali Kulkarni: MPSTME, NMIMS University, India
Khushal Hemant Sharma: Arizona State University, USA
Manan Shah: Indiana University, USA
Aniruddh Vinay Kulkarni: NMIMS University, India

International Journal of Intelligent Information Technologies (IJIIT), 2025, vol. 21, issue 1, 1-18

Abstract: Advances in neural radiance fields (NeRF) have revolutionized the field of 3D scene reconstruction, enabling high-fidelity rendering of complex environments from sparse input data. However, the ability to edit and manipulate such scenes remains a significant challenge. This work introduces an innovative approach to instruction-based image editing by leveraging the capabilities of InstructDiffusion and Lang-SAM models. By combining these models, the system enables precise and context-aware edits to real-world images based on natural language instructions. The core methodology involves an iterative dataset update process where images are rendered from NeRF scenes, updated using diffusion models, and used to supervise scene reconstruction. This approach allows for targeted and localized edits, enabling tasks such as object addition, removal, and replacement while optimizing the underlying 3D scene. The effectiveness of the method is demonstrated through compelling qualitative results, showcasing its versatility and ability to achieve diverse and complex image edits.

Date: 2025
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/IJIIT.369336 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jiit00:v:21:y:2025:i:1:p:1-18

Access Statistics for this article

International Journal of Intelligent Information Technologies (IJIIT) is currently edited by Vijayan Sugumaran

More articles in International Journal of Intelligent Information Technologies (IJIIT) from IGI Global
Bibliographic data for series maintained by Journal Editor ().