Institute for Metaverse was built on the "Metaverse and Intelligent Technology Innovation Forum" and Modern Industrial College Construction Seminar in Nanjing

Publication Frequency

Semi-annual

Journal Content

Search scope

Journal Center

Asia Pacific Academy of Science Pte. Ltd. (APACSCI) specializes in international journal publishing. APACSCI adopts the open access publishing model and provides an important communication bridge for academic groups whose interest fields include engineering, technology, medicine, computer, mathematics, agriculture and forestry, and environment.

more

Volume Arrangement

2024

Vol 5, No 1 (2024)

2023

Vol 4, No 2 (2023)

Vol 4, No 1 (2023)

more

Featured Articles

Content creation or interpolation: AI generative digital art in the classroom

The integration of generative artificial intelligence (AI) tools in art and design has disrupted the traditional creative landscape, leading to debates on the legitimacy of AI-generated art and the emergence of new markets such as non-fungible tokens (NFTs). The US Copyright Office’s February 21, 2023, ruling withdrawing copyright protection for AI-generated comic artwork, while protecting the accompanying text and arrangement, highlights the contested nature of AI art and suggests that significant human intervention in the creative process will be required for monetization. Whether considered content interpolation or content creation, AI generative content for the creation of art and design is here with human-AI collaboration. To explore the potential of AI tools in creative practice, this study introduced students in a digital art course to Craiyon and Midjourney generative AI tools, with DALL-E 2 selected as the primary tool due to its varied output. The students were tasked with selecting a preferred prompt from one tool and then reproducing the output from both tools. The results revealed significant variations in replicating the outputs of different AI tools and limited exploration of prompt engineering, leading to restrictions in the iterative process of artmaking. The students agreed that generative AI tools are not a substitute for human creativity and should be used for final projects. The study demonstrates the potential and limitations of integrating AI tools in art and design and suggests the need for further research in developing effective prompt engineering strategies.

From motion to magic: Real-time virtual-real stage effects via 3D motion capture

Immersive cultural performances with virtual-real fusion effects are the future development trend in the exhibition and stage industry. However, current virtual-real stage performances heavily rely on traditional sequential design and arrangements. During the performance, actors must move to specific positions based on the musical beat and execute predetermined actions with a pre-designed amplitude and frequency to synchronize with the fixedly played stage visual effects; otherwise, major performance accidents such as plot inconsistencies or continuity errors may occur. To address the problem, this paper introduces a real-time generation system for stage visual effects based on multi-view multi-person 3D motion capture. The system utilizes multi-view 3D motion capture technique to achieve non-intrusive real-time interaction perception of target actors in the stage space. By perceiving the spatial position and performance actions of the target actors, corresponding stage visual effects are generated in real-time. This is followed by the seamless integration of sound effects and immersive high-definition display, ultimately realizing multidimensional real-time interaction between real actors and virtual visual effects in the stage space. We conducted an experimental virtual-real stage performance, lasting approximately two minutes, in a physical theater to validate the effectiveness of our proposed method. The experiment not only produced a unique innovative effect of blending stage and technology but also effectively enhanced the sense of presence and interactivity of the stage performance, providing actors with more freedom and control in their performances.

On August 21st, Nanjing University of Information Science & Technology and other institutes co-hosted the "Metaverse and Intelligent Technology Innovation Forum" and Modern Industrial College Construction Seminar in Nanjing. On the spot, the university and enterprises jointly built Institute for Metaverse to further explore a new mode of discipline construction and talent training with deep integration.

The conference focused on the two themes of “innovation of industry-education integration” and “construction of modern industrial college”, and brought together many experts in the field of artificial intelligence to enjoy a feast of ideas and gain insight into innovative thoughts. The invited reports, special reports and thematic reports were all brilliant. Dean of School of Artificial Intelligence (School of Future Technology) at Nanjing University of Information Science & Technology, editor-in-chief of our journal Metaverse Zhigeng Pan said, the “Metaverse training" of artificial intelligence talents, on one hand, is the training of the grassroots technology, so that students can comprehensively master the application of the underlying chip, network and operating system; on the other hand, the actual teaching conditions can be changed by the “Metaverse training”.

At the forum, Prof. Zhigeng Pan accepted the invitation of Qing Li, the vice president of the Asia Pacific Academy of Science, to be the editor-in-chief of our journal Metaverse. The journal and NUIST will make progress shoulder by shoulder from now on in the field of Metaverse, hoping to open a new world from the point of virtual education and virtual hospitals.

Academic Supporter

Institute for Metaverse, School of Artificial Intelligence (School of Future Technology), Nanjing University of Information Science & Technology (NUIST), China

Editor-in-Chief

Prof. Zhigeng Pan

Director, Institute for Metaverse, Nanjing University of Information Science & Technology, China

Honorary Editor-in-Chief

Prof. Jianrong Tan

Academician, Chinese Academy of Engineering, China

News & Announcements

2024-05-13

Call for papers for Special Issue "Metaverse and Intelligent Education"

Metaverse is a technology that projects the real world into a virtual environment using virtual reality, augmented reality, and the internet. It provides opportunities for people to engage in work, learning, life, socializing, and even economic activities, thereby achieving the integration of the real world and the virtual world.

2024-03-19

Metaverse Partners with ACM SIGGRAPH Asia 2024 Educator's Forum

Information details for who could submit or how to submit: Educator's Forum - SIGGRAPH Asia 2024.

2024-02-21

Notification of Metaverse Forum: Metaverse, ChatGPT and Sora

One of the series of forums, Metaverse and ChatGPT and Sora, led by the Editor-in-Chief...

More Announcements...

Special Issues

Proposal a Special Issue

Deadline: 2024-12-31

Metaverse and Intelligent Education

Guest Editor: Prof. Danli Wang, Prof. Mingmin Zhang

Keywords: Metaverse; Intelligent Education...

Deadline: 2024-12-31

Advancements in VR, State Estimation, and SLAM: Navigating Immersive Environments

Guest Editor: Dr. Xiaowen Tao

Keywords: Virtual Reality...