LipSync generation based on discrete cosine transform

Xie, N; Yuan, TY; Nakajima, M; Shen, H

LipSync generation based on discrete cosine transform

Xie, N Yuan, TY Nakajima, M Shen, H

Permalink

Publication Type:: Conference Proceeding
Citation:: Proceedings - 2017 NICOGRAPH International, NICOInt 2017, 2017, pp. 76 - 79
Issue Date:: 2017-09-19

Closed Access

	Filename	Description	Size
	08047398.pdf	Published version	846.16 kB	Adobe PDF	View/Open

Copyright Clearance Process

Recently Added
In Progress
Closed Access

This item is closed access and not available.

Full metadata record

Field	Value	Language
dc.contributor.author	Xie, N	en_US
dc.contributor.author	Yuan, TY	en_US
dc.contributor.author	Nakajima, M	en_US
dc.contributor.author	Shen, H	en_US
dc.date.issued	2017-09-19	en_US
dc.identifier.citation	Proceedings - 2017 NICOGRAPH International, NICOInt 2017, 2017, pp. 76 - 79	en_US
dc.identifier.isbn	9781509053322	en_US
dc.identifier.uri	http://hdl.handle.net/10453/126447
dc.description.abstract	© 2017 IEEE. Nowadays, voice acting plays more advanced in the video games, especially for the role-playing games, anime-based games and serious games. In order to enhance the communication, synchronizing the lip and mouth movements naturally is an important part of convincing 3D character performance [XFMS13]. In this paper, we propose a lightweight LipSync generation algorithm. According to the heuristic knowledge on the mouth movement in game, extracting the value of voice frequency domain is essential for LipSync in game. Therefore, we analytically convert the problem into Discrete Cosine Transform (DCT) that focuses on extracting the voice frequency domain value by absolute value computing operation so as to avoid redundant computation on phases and modulus of operation in Fourier Transform (FT) voice model. Our experimental results demonstrate that our DCT based method enables to achieve good performance for game making.	en_US
dc.relation.ispartof	Proceedings - 2017 NICOGRAPH International, NICOInt 2017	en_US
dc.relation.isbasedon	10.1109/NICOInt.2017.45	en_US
dc.title	LipSync generation based on discrete cosine transform	en_US
dc.type	Conference Proceeding
utslib.for	0801 Artificial Intelligence and Image Processing	en_US
pubs.embargo.period	Not known	en_US
pubs.organisational-group	/University of Technology Sydney
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology/School of Software
utslib.copyright.status	closed_access
pubs.publication-status	Published	en_US

Abstract:

© 2017 IEEE. Nowadays, voice acting plays more advanced in the video games, especially for the role-playing games, anime-based games and serious games. In order to enhance the communication, synchronizing the lip and mouth movements naturally is an important part of convincing 3D character performance [XFMS13]. In this paper, we propose a lightweight LipSync generation algorithm. According to the heuristic knowledge on the mouth movement in game, extracting the value of voice frequency domain is essential for LipSync in game. Therefore, we analytically convert the problem into Discrete Cosine Transform (DCT) that focuses on extracting the voice frequency domain value by absolute value computing operation so as to avoid redundant computation on phases and modulus of operation in Fourier Transform (FT) voice model. Our experimental results demonstrate that our DCT based method enables to achieve good performance for game making.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/126447