Artikel in einem Konferenzbericht,

Synthesizing visual speech trajectory with minimum generation error

, , , und .
Proceedings of the 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seite 4580-4583. Prague, Czech Republic, (Mai 2011)
DOI: 10.1109/ICASSP.2011.5947374

Zusammenfassung

In this paper, we propose a minimum generation error (MGE) training method to refine the audio-visual HMM to improve visual speech trajectory synthesis. Compared with the traditional maximum likelihood (ML) estimation, the proposed MGE training explicitly optimizes the quality of generated visual speech trajectory, where the audio-visual HMM modeling is jointly refined by using a heuristic method to find the optimal state alignment and a probabilistic descent algorithm to optimize the model parameters under the MGE criterion. In objective evaluation, compared with the ML-based method, the proposed MGE-based method achieves consistent improvement in the mean square error reduction, correlation increase, and recovery of global variance. It also improves the naturalness and audio-visual consistency perceptually in the subjective test.

Tags

Nutzer

  • @m-toman
  • @dblp

Kommentare und Rezensionen