Open Journal Systems

Publication Frequency

Semi-annual

Journal Content

Search scope

Journal Center

Asia Pacific Academy of Science Pte. Ltd. (APACSCI) specializes in international journal publishing. APACSCI adopts the open access publishing model and provides an important communication bridge for academic groups whose interest fields include engineering, technology, medicine, computer, mathematics, agriculture and forestry, and environment.

more

Volume Arrangement

2024

Vol 5, No 1 (2024)

2023

Vol 4, No 2 (2023)

Vol 4, No 1 (2023)

more

Featured Articles

Content creation or interpolation: AI generative digital art in the classroom

The integration of generative artificial intelligence (AI) tools in art and design has disrupted the traditional creative landscape, leading to debates on the legitimacy of AI-generated art and the emergence of new markets such as non-fungible tokens (NFTs). The US Copyright Office’s February 21, 2023, ruling withdrawing copyright protection for AI-generated comic artwork, while protecting the accompanying text and arrangement, highlights the contested nature of AI art and suggests that significant human intervention in the creative process will be required for monetization. Whether considered content interpolation or content creation, AI generative content for the creation of art and design is here with human-AI collaboration. To explore the potential of AI tools in creative practice, this study introduced students in a digital art course to Craiyon and Midjourney generative AI tools, with DALL-E 2 selected as the primary tool due to its varied output. The students were tasked with selecting a preferred prompt from one tool and then reproducing the output from both tools. The results revealed significant variations in replicating the outputs of different AI tools and limited exploration of prompt engineering, leading to restrictions in the iterative process of artmaking. The students agreed that generative AI tools are not a substitute for human creativity and should be used for final projects. The study demonstrates the potential and limitations of integrating AI tools in art and design and suggests the need for further research in developing effective prompt engineering strategies.

From motion to magic: Real-time virtual-real stage effects via 3D motion capture

Immersive cultural performances with virtual-real fusion effects are the future development trend in the exhibition and stage industry. However, current virtual-real stage performances heavily rely on traditional sequential design and arrangements. During the performance, actors must move to specific positions based on the musical beat and execute predetermined actions with a pre-designed amplitude and frequency to synchronize with the fixedly played stage visual effects; otherwise, major performance accidents such as plot inconsistencies or continuity errors may occur. To address the problem, this paper introduces a real-time generation system for stage visual effects based on multi-view multi-person 3D motion capture. The system utilizes multi-view 3D motion capture technique to achieve non-intrusive real-time interaction perception of target actors in the stage space. By perceiving the spatial position and performance actions of the target actors, corresponding stage visual effects are generated in real-time. This is followed by the seamless integration of sound effects and immersive high-definition display, ultimately realizing multidimensional real-time interaction between real actors and virtual visual effects in the stage space. We conducted an experimental virtual-real stage performance, lasting approximately two minutes, in a physical theater to validate the effectiveness of our proposed method. The experiment not only produced a unique innovative effect of blending stage and technology but also effectively enhanced the sense of presence and interactivity of the stage performance, providing actors with more freedom and control in their performances.

Empirical insights into AI-assisted game development: A case study on the integration of generative AI tools in creative pipelines

Andrew Begemann, James Hutson

Article ID: 2568
Vol 5, Issue 2, 2024

DOI: https://doi.org/10.54517/m.v5i2.2568
VIEWS - 18 (Abstract)

Abstract

This study conducts an empirical exploration of generative Artificial Intelligence (AI) tools across the game development pipeline, from concept art creation to 3D model integration in a game engine. Employing AI generators like Leonardo AI, Scenario AI, Alpha 3D, and Luma AI, the research investigates their application in generating game assets. The process, documented in a diary-like format, ranges from producing concept art using fantasy game prompts to optimizing 3D models in Blender and applying them in Unreal Engine 5. The findings highlight the potential of AI to enhance the conceptualization phase and identify challenges in producing optimized, high-quality 3D models suitable for game development. This study reveals the current limitations and ethical considerations of AI in game design, suggesting that while generative AI tools hold significant promise for transforming game development, their full integration depends on overcoming these hurdles and gaining broader industry acceptance.

Keywords

generative AI; game development pipeline; conceptualization; 3D modeling; ethical considerations

Full Text:

PDF

References

1. Zweig B. Forgotten Genealogies: Brief Reflections on the History of Digital Art History. International Journal for Digital Art History. 2015; (1).

2. Mikalonytė ES, Kneer M. Can Artificial Intelligence Make Art? Folk Intuitions as to whether AI-driven Robots Can Be Viewed as Artists and Produce Art. ACM Transactions on Human-Robot Interaction. 2022; 11(4): 1–19. doi: 10.1145/3530875

3. Li S, Zhou Y. Pipeline 3D Modeling Based on High-Definition Rendering Intelligent Calculation. Mathematical Problems in Engineering. 2022; 2022: 1–11. doi: 10.1155/2022/4580363

4. Tchomdji LOK, Park SJ, Kim R. Developing Virtual Tour Content for the Inside and Outside of a Building using Drones and Matterport. International Journal of Contents. 2022; 18(3): 74–84.

5. Harrington MCR, Jones C, Peters C. Course on virtual nature as a digital twin: botanically correct 3D AR and VR optimized low-polygon and photogrammetry high-polygon plant models. ACM SIGGRAPH 2022 Courses. 2022; 1–69. doi: 10.1145/3532720.3535663

6. Brittain B. Artists take new shot at Stability, Midjourney in updated copyright lawsuit. Reuters. Available online: https://www.reuters.com/legal/litigation/artists-take-new-shot-stability-midjourney-updated-copyright-lawsuit-2023-11-30/updated-copyright-lawsuit-2023-11-30/ (accessed on 30 January 2024).

7. Schmidt R, Isenberg T, Jepp P, et al. Sketching, scaffolding, and inking: a visual history for interactive 3D modeling. In: Proceedings of the 5th international symposium on Non-photorealistic animation and rendering; 2007. doi: 10.1145/1274871.1274875

8. Madhavadas V, Srivastava D, Chadha U, et al. A review on metal additive manufacturing for intricately shaped aerospace components. CIRP Journal of Manufacturing Science and Technology. 2022; 39: 18–36. doi: 10.1016/j.cirpj.2022.07.005

9. Cheng R, Wu N, Chen S, et al. Reality Check of Metaverse: A First Look at Commercial Social Virtual Reality Platforms. In: Proceedings of the 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW); 2022. doi: 10.1109/vrw55335.2022.00040

10. Korbel JJ, Siddiq UH, Zarnekow R. Towards Virtual 3D Asset Price Prediction Based on Machine Learning. Journal of Theoretical and Applied Electronic Commerce Research. 2022; 17(3): 924–948. doi: 10.3390/jtaer17030048

11. Zhang Y. Cross-Platform Methods in Computer Graphics That Boost Experimental Film Making. Available online: https://scholarworks.rit.edu/cgi/viewcontent.cgi?article=12190&context=theses (accessed on 10 September 2022).

12. Favreau J. The Mandalorian. Disney; 2019.

13. Anderson K. The mandalorian’s virtual sets are wild. Nerdist. Available online: https://nerdist.com/article/mandalorian-virtual-production-star-wars/ (accessed on 10 September 2022).

14. Dent S. See how ‘the mandalorian’ used Unreal Engine for its real-time digital sets. Engadget. Available online: https://www.engadget.com/2020-02-21-mandalorian-ilm-stagecraft-real-time-digital-sets.html (accessed on 10 September 2022).

15. Ronfard R. Film Directing for Computer Games and Animation. Computer Graphics Forum. 2021; 40(2): 713–730. doi: 10.1111/cgf.142663

16. Cohen JL. Film/Video-Based TherapyTM and Virtual Reality. In: Film/Video-Based Therapy and Trauma. Routledge; 2022. pp. 3–13. doi: 10.4324/9781315622507

17. Kuusela V. 3D modeling pipeline for games. Turku University of Applied Sciences; 2022.

18. Hevko I, Potapchuk O, Lutsyk I, et al. The Method of Teaching Graphic 3D Reconstruction of Architectural Objects for Future IT Specialists. In: Proceedings of the 1st Symposium on Advances in Educational Technology; 2020. doi: 10.5220/0010921800003364

19. Open AI. Dall·E 2. DALL·E 2. Available online: https://openai.com/dall-e-2/ (accessed on 25 September 2022).

20. Blance A. Using AI to generate 3D models, fast! Medium. Available online: https://towardsdatascience.com/using-ai-to-generate-3d-models-2634398c0799 (accessed on 25 September 2022).

21. Ha H, Song S. Semantic abstraction: Open-world 3d scene understanding from 2d vision-language models. In: Proceedings of the 6th Annual Conference on Robot Learning; 2022.

22. McKenzie T. Kaedim: A cool AI for turning 2D images into 3D models. Available online: https://80.lv/articles/kaedim-a-cool-ai-for-turning-2d-images-into-3d-models/ (accessed on 10 October 2022).

23. Salian I. Nerf research turns 2D photos into 3D scenes. NVIDIA Blog. Available online: https://blogs.nvidia.com/blog/2022/03/25/instant-nerf-research-3d-ai/ (accessed on 12 October 2022).

24. Fiske T. What does it take to AI-generate VR games? Immersive Wire. Available online: https://www.immersivewire.com/p/take-aigenerate-vr-games (accessed on 7 March 2024).

Refbacks

There are currently no refbacks.

This site is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).

Academic Supporter

Institute for Metaverse, School of Artificial Intelligence (School of Future Technology), Nanjing University of Information Science & Technology (NUIST), China

Editor-in-Chief

Prof. Zhigeng Pan

Director, Institute for Metaverse, Nanjing University of Information Science & Technology, China

Honorary Editor-in-Chief

Prof. Jianrong Tan

Academician, Chinese Academy of Engineering, China

News & Announcements

2024-05-13

Call for papers for Special Issue "Metaverse and Intelligent Education"

Metaverse is a technology that projects the real world into a virtual environment using virtual reality, augmented reality, and the internet. It provides opportunities for people to engage in work, learning, life, socializing, and even economic activities, thereby achieving the integration of the real world and the virtual world.

2024-03-19

Metaverse Partners with ACM SIGGRAPH Asia 2024 Educator's Forum

Information details for who could submit or how to submit: Educator's Forum - SIGGRAPH Asia 2024.

2024-02-21

Notification of Metaverse Forum: Metaverse, ChatGPT and Sora

One of the series of forums, Metaverse and ChatGPT and Sora, led by the Editor-in-Chief...

More Announcements...

Special Issues

Proposal a Special Issue

Deadline: 2024-12-31

Metaverse and Intelligent Education

Guest Editor: Prof. Danli Wang, Prof. Mingmin Zhang