WayangWayang 2.0 featured an interactive chatbot, enhanced character animations, and a children’s game, successfully merging technology with cultural preservation, highlighted APU’s commitment to nurturing talent and fostering innovation while safeguarding Malaysia’s rich heritage.

Asia Pacific University of Technology & Innovation’s (APU) School of Computing (SoC) students have made an impressive debut at the 35th International Invention, Innovation, Technology Competition & Exhibition (ITEX’24).

This exhibition, held in conjunction with the World Young Inventors Exhibition (WYIE), Asian Young Inventors Exhibition (AYIE), and Malaysian Young Inventors Exhibition (MYIE), serves as a platform for showcasing ground-breaking inventions and cutting-edge technologies from across Asia.

James Wong Chai Fuu, Johnson Chin Hong Wei, and Ng Zi Yuan, studying Software Engineering, Artificial Intelligence, and Cyber Security respectively, earned the MYIE’s Best Young Inventor Tertiary Level Award and a Gold Medal for their innovative project, WayangWayang 2.0.

Their Gold Medal-winning project, ‘WayangWayang 2.0’, breathes new life into the traditional art of Wayang Kulit, a form of shadow puppetry deeply rooted in Malaysian culture.

This latest iteration builds upon its predecessor by adding five central characters from the Ramayana epic, offering a richer storytelling experience.

The Interactive Shadower Chatbot, capable of communicating with users in 68 languages, is an attraction. It features dynamic conversations enriched with video and voice integration.

The WayangWayang 2.0 utilised a sophisticated pose animator to provide a visually spectacular rendition of the Ramayana characters, bringing the ancient stories to life with greater detail and vibrancy.

Together with a unique children’s game developed for young audiences, it is the first of its kind globally.

The journey from concept to triumph

The journey began with James and Ng, Introduction to AI students in 2023, who pioneered the initial chatbot platform using JavaScript, integrating a Wayang Kulit knowledge base.

Their innovation ‘Discovering Cultural Tourism Via Vertical Chatbot - The Shadow Puppet Theatre’ won a gold medal at the International University Carnival on E-Learning (IUCEL) 2023 together with new members, Johnson; mentored by Assoc. Prof. Ts. Dr. Vinothini Kasinathan and Dr. Julia Juremi, setting the stage for the project’s evolution.

Later on, the trio received a gold award in the Information and Communication Technologies (ICT) category at the prestigious Malaysia Technology Expo (MTE) 2024 Asian Youth Innovation Awards (AYIA).

As they progressed, James, Ng, and Johnson, guided by Dr. Vino, Dr. Julia, and Ms. Nur Amira Abdul Majid, developed ‘WayangWayang 2.0’, setting a new benchmark for innovation and cultural preservation.

They aim to utilize AI not only to tackle current challenges but also to preserve Malaysia’s cultural heritage, which is on the verge of being lost.

By integrating AI with cultural preservation, they hope to educate the future generation about forgotten traditions and foster a stronger bond with Malaysian heritage.

“This is our first time at ITEX, and we made sure to improve our solution from the previous version by incorporating fresh elements like gamification to reach a larger audience.

“Basically, it is the same project but made better and we performed well amongst other competitors as we are integrating technology into cultural preservation which not a lot of people are doing it,” said Johnson, representing his team.

He added that APU courses helped them to solidify their fundamentals, allowing them to acquire new knowledge easily and connect people with technology.

“AI is a powerful tool for solving global challenges and saving lives. But why stop there? It can also be a guardian of our past,” Dr. Vino asserted.

“By educating the next generation about fading cultures, we are not just preserving history; we are nurturing a deeper connection to our roots. That is the heart of our work at APU ― merging AI and technology with cultural heritage.”

APU proudly celebrates this achievement, underscoring our commitment to pushing boundaries and honouring traditions through the power of technology.