Artificial sound change: Language change and deep convolutional neural networks in iterative learning
Gasper Begus
November 2020
 

This paper proposes a framework for modeling sound change that combines deep convolutional neural networks and iterative learning. Acquisition and transmission of speech across generations is modeled by training generations of Generative Adversarial Networks on unannotated raw speech data. The paper argues that several properties of sound change emerge from the proposed architecture. Generative Adversarial Networks (Goodfellow et al. 2014, Donahue et al. 2019) are uniquely appropriate for modeling language change because the networks are trained on raw unsupervised acoustic data, contain no language-specific devices and, as argued in Beguš (2020b), encode phonetic and phonological representations in their latent space and generate innovative data that are linguistically highly informative. Four generations of Generative Adversarial Networks were trained on an allophonic distribution in English where voiceless stops are aspirated word-initially before stressed vowels except if preceded by [s]. The first generation of networks is trained on the relevant sequences in human speech from the TIMIT database. The subsequent generations are not trained on TIMIT, but on generated outputs from the previous generation and thus start learning from each other in an iterative learning task. The initial allophonic distribution is progressively being lost with each generation, likely due to pressures. from the global distribution of aspiration in the training data that resembles phonological pressures in natural language. The networks show signs of a gradual shift in phonetic targets characteristic of a gradual phonetic sound change. At endpoints, the networks' outputs superficially resemble a phonological change --- rule loss --- driven by imperfect learning. The model features signs of stability, one of the more challenging aspects of computational models of sound change. The results suggest that the proposed Generative Adversarial models of phonetic and phonological acquisition have the potential to yield new insights into the long-standing question of how to model language change.
Format: [ pdf ]
Reference: lingbuzz/005558
(please use that when you cite this article)
Published in:
keywords: artificial intelligence, deep convolutional neural networks, generative adversarial networks, speech, phonetic learning, phonological learning, historical linguistics, sound change, phonology
Downloaded:139 times

 

[ edit this article | back to article list ]