City Research Online

Visualisation and Analysis of Speech Production with Electropalatography

Verhoeven, J. ORCID: 0000-0002-0738-8517, Miller, N. R., Daems, L. & Reyes-Aldasoro, C. C. ORCID: 0000-0002-9466-2018 (2019). Visualisation and Analysis of Speech Production with Electropalatography. Journal of Digital Imaging, 5(3), article number 40. doi: 10.3390/jimaging5030040

Abstract

The process of speech production, i.e., the compression of air in the lungs, the vibration activity of the larynx, and the movement of the articulators, is of great interest in phonetics, phonology, and psychology. One technique by which speech production is analysed is electropalatography, in which an artificial palate, moulded to the speaker’s hard palate, is introduced in the mouth. The palate contains a grid of electrodes, which monitor the spatial and temporal pattern of contact between the tongue and the palate during speech production. The output is a time sequence of images, known as palatograms, which show the 2D distribution of electrode activation. This paper describes a series of tools for the visualisation and analysis of palatograms and their associated sound signals. The tools are developed as Matlab® routines and released as an open-source toolbox. The particular focus is the analysis of the amount and direction of left–right asymmetry in tongue–palate contact during the production of different speech sounds. Asymmetry in the articulation of speech, as measured by electropalatography, may be related to the language under consideration, the speaker’s anatomy, irregularities in the palate manufacture, or speaker handedness (i.e., left or right). In addition, a pipeline for the segmentation and analysis of a three-dimensional computed tomography data set of an artificial palate is described and demonstrated. The segmentation procedure provides quantitative information about asymmetry that is due to a combination of speaker anatomy (the shape of the hard palate) and the positioning of the electrodes during manufacture of the artificial palate. The tools provided here should be useful in future studies of electropalatography.

Publication Type: Article
Additional Information: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
Publisher Keywords: computed tomography; segmentation; speech production; electropalatography; spectrograms; articulation asymmetry
Subjects: P Language and Literature > P Philology. Linguistics
T Technology > TK Electrical engineering. Electronics Nuclear engineering
Departments: School of Health & Psychological Sciences > Language & Communication Science
School of Science & Technology > Computer Science > giCentre
School of Science & Technology > Engineering
SWORD Depositor:
[thumbnail of jimaging-05-00040.pdf]
Preview
Text - Published Version
Available under License Creative Commons Attribution.

Download (15MB) | Preview

Export

Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login