Using Deepfake Technologies for Word Emphasis Detection

In this work, we consider the task of automated emphasis detection for spoken language. This problem is challenging in that emphasis is affected by the particularities of speech of the subject, for example the subject’s accent, dialect or pitch. To address this task, we propose to utilize generative speech deep nets to produce an emphasis-devoid speech sample for the speaker. This requires extracting the text of the spoken voice, and then using a pre-recorded voice sample from the speaker to produce an emphasis-devoid speech for this task. By comparing the generated speech with the spoken voice, we are able to isolate patterns of emphasis which are relatively easy to detect.