<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD with OASIS Tables with MathML3 v1.1 20151215//EN" "JATS-journalpublishing-oasis-article1-mathml3.dtd">
<article article-type="research-article" dtd-version="1.1" xml:lang="en" xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
	<front>
		<journal-meta>
			<journal-id journal-id-type="publisher-id">Loquens</journal-id>
			<journal-title-group>
				<journal-title>Loquens</journal-title>
				<abbrev-journal-title abbrev-type="publisher">Loquens</abbrev-journal-title>
			</journal-title-group>
			<issn publication-format="electronic">2386-2637</issn>
			<issn-l>2386-2637</issn-l>
			<publisher>
				<publisher-name>Consejo Superior de Investigaciones Cient&#xed;ficas</publisher-name>
			</publisher>
		</journal-meta>
		<article-meta>
			<article-id pub-id-type="publisher-id">loquens.2023.e104</article-id>
			<article-id pub-id-type="doi">10.3989/loquens.2023.e104</article-id>
			<article-categories>
				<subj-group subj-group-type="heading">
					<subject>Articles</subject>
				</subj-group>
			</article-categories>
			<title-group>
				<article-title>Software-assisted identification of non-native pitch elements for Russian-speaking learners of Spanish</article-title>
				<trans-title-group xml:lang="es">
					<trans-title>Identificaci&#xf3;n de elementos del contorno entonativo en habla no nativa asistida por software para estudiantes rus&#xf3;fonos de espa&#xf1;ol.</trans-title>
				</trans-title-group>
			</title-group>
			<contrib-group>
				<contrib contrib-type="author" corresp="yes">
					<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-0381-0239</contrib-id>
					<name>
						<surname>Sarymsakova</surname>
						<given-names>Albina</given-names>
					</name>
					<email xlink:href="albina.sarymsakova@usc.es">albina.sarymsakova@usc.es</email>
					<aff id="aff1"><institution content-type="research-center">Centro Singular de Investigaci&#xf3;n en Tecnolox&#xed;as Intelixentes (CiTIUS)</institution>, <institution content-type="university">Universidade de Santiago de Compostela</institution></aff>
				</contrib>
				<contrib contrib-type="author">
					<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-1540-883X</contrib-id>
					<name>
						<surname>Mart&#xed;n-Rodilla</surname>
						<given-names>Patricia</given-names>
					</name>
					<email xlink:href="patricia.martin.rodilla@udc.es">patricia.martin.rodilla@udc.es</email>
					<aff id="aff2"><institution content-type="research-center">Centro de Investigaci&#xf3;n en Tecnolog&#xed;as de la Informaci&#xf3;n y las Comunicaciones (CITIC)</institution>, <institution content-type="university">Universidade da Coru&#xf1;a</institution></aff>
				</contrib>
			</contrib-group>
			<pub-date pub-type="epub">
				<day>01</day>
				<month>12</month>
				<year>2023</year>
			</pub-date>
			<pub-date pub-type="collection">
				<month>12</month>
				<year>2023</year>
			</pub-date>
			<volume>10</volume>
			<issue>1-2</issue>
			<elocation-id>e104</elocation-id>
			<history>
				<date date-type="received">
					<day>27</day>
					<month>11</month>
					<year>2023</year>
				</date>
				<date date-type="accepted">
					<day>09</day>
					<month>01</month>
					<year>2024</year>
				</date>
				<date date-type="pub">
					<day>01</day>
					<month>02</month>
					<year>2024</year>
				</date>
			</history>
			<permissions>
				<copyright-statement>&#xa9; 2023 CSIC</copyright-statement>
				<copyright-year>2023</copyright-year>
				<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
					<license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International (CC BY 4.0) License.</license-p>
				</license>
			</permissions>
			<self-uri xlink:href="https://loquens.revistas.csic.es/index.php/loquens/article/view/XXXX/XXXX"/>
			<abstract>
				<title>Abstract</title>
				<p>In this paper we present the results of an automatic comparative-contrastive analysis of functional elements of intonational contour (anacrusis, first peak, body, nucleus and final inflection) produced by non-native speakers of Spanish, whose first language is Russian. This analysis was carried out with the Plugin for phonetic-phonological analysis in Spanish (PAFe), a software tool for an instant comparative analysis of a non-native speakers&#x2019; pronunciation which takes audio recordings as input and implements multiple intonation comparison algorithms between native and non-native speakers of Spanish to calculate the percentage of similarity in intonation production. We used the intersyllabic analysis function of PAFe in order to identify which functional pitch elements of Russian speaking learners of Spanish -male and female- present more tonal deviations. Our results show that most tonal differences occurred in the body of the <italic>f</italic>
					<sub>
						<italic>0</italic>
					</sub> contour for female speakers whereas for male speakers the greatest tonal contrast was in the first peak. The obtained data indicate that these pitch elements are potentially challenging for Russian speaking learners of Spanish in their pursuit of acquiring phonetic-phonological competence. In addition, this study allowed us to identify which parameters of PAFe analysis per syllables require further refinement, such as processing of limited intonational spectrum values.</p>
			</abstract>
			<trans-abstract xml:lang="es">
				<title>Resumen</title>
				<p>Presentamos en este art&#xed;culo los resultados del an&#xe1;lisis autom&#xe1;tico comparativo-contrastivo de elementos funcionales del contorno entonativo (anacrusis, primer pico, cuerpo, n&#xfa;cleo e inflexi&#xf3;n final) producidos por hablantes no nativos de espa&#xf1;ol, cuya primera lengua es ruso. Dicho an&#xe1;lisis fue realizado con el Plugin para el an&#xe1;lisis fon&#xe9;tico-fonol&#xf3;gico en espa&#xf1;ol (PAFe), una herramienta de software para el an&#xe1;lisis comparativo instant&#xe1;neo de la pronunciaci&#xf3;n de hablantes no nativos que toma grabaciones de audio como entrada e implementa m&#xfa;ltiples algoritmos de comparaci&#xf3;n de entonaci&#xf3;n entre hablantes nativos y no nativos de espa&#xf1;ol para calcular el porcentaje de similitud en la producci&#xf3;n de su entonaci&#xf3;n. Empleamos el algoritmo de an&#xe1;lisis intersil&#xe1;bico de PAFe para identificar qu&#xe9; elementos entonativos de los aprendientes rusos del espa&#xf1;ol -masculinos y femeninos- presentan m&#xe1;s desviaciones tonales. Nuestros resultados estad&#xed;sticamente probados muestran que la mayor&#xed;a de diferencias tonales, en el caso de las hablantes femeninas, ocurre en el cuerpo del contorno entonativo y, para los hablantes masculinos, un mayor contraste tonal presenta el primer pico. Los datos obtenidos indican que estos son los elementos potencialmente desafiantes para los estudiantes rusos a la hora de adquirir la competencia fon&#xe9;tico-fonol&#xf3;gica en espa&#xf1;ol. Adem&#xe1;s, el presente estudio nos permiti&#xf3; detectar ciertos par&#xe1;metros del an&#xe1;lisis intersil&#xe1;bico de PAFe para su perfeccionamiento, como procesamiento de valores limitados del espectro entonativo.</p>
			</trans-abstract>
			<kwd-group>
				<kwd>prosody</kwd>
				<kwd>pitch</kwd>
				<kwd>software</kwd>
				<kwd>Spanish L2</kwd>
				<kwd>Russian speakers</kwd>
			</kwd-group>
			<kwd-group xml:lang="es">
				<kwd>prosodia</kwd>
				<kwd>tono</kwd>
				<kwd>software</kwd>
				<kwd>espa&#xf1;ol como L2</kwd>
				<kwd>aprendientes rus&#xf3;fonos</kwd>
			</kwd-group>
			<funding-group id="fw-01">
				<award-group id="aw1">
					<funding-source>
						<institution>MCIN</institution>
					</funding-source>
					<funding-source>
						<institution-wrap>
							<institution>AEI</institution>
							<institution-id institution-id-type="doi">10.13039/501100011033</institution-id>
						</institution-wrap>
					</funding-source>
					<award-id>TED2021-130295B-C33</award-id>
				</award-group>
				<award-group id="aw2">
					<funding-source>
						<institution>MCIN</institution>
					</funding-source>
					<funding-source>
						<institution-wrap>
							<institution>AEI</institution>
							<institution-id institution-id-type="doi">10.13039/501100011033</institution-id>
						</institution-wrap>
					</funding-source>
					<award-id>PID2020-114758RB-I00</award-id>
				</award-group>
				<funding-statement>The authors are extremely grateful to Doctor Marcos Garc&#xed;a-Gonz&#xe1;lez, Doctor Jose Mar&#xed;a Alonso-Moral and Doctor Pablo Gamallo-Otero for their technical support. An earlier version of this paper was presented at 9th International Conference on Experimental Phonetics (Vigo, June 21-23, 2023), and we want to thank the audience there for their feedback. This study is funded by Grant TED2021-130295B-C33 funded by MCIN/AEI/10.13039/501100011033 and by the &#x201c;European Union NextGenerationEU/PRTR&#x201d;. The authors also thank AEI (Agencia Estatal de Investigaci&#xf3;n) for funding of PID2020-114758RB-I00 project within MCIN/AEI/10.13039/501100011033 Grants.</funding-statement>
			</funding-group>
			<counts>
				<fig-count count="10"/>
				<table-count count="2"/>
				<equation-count count="0"/>
				<ref-count count="29"/>
				<page-count count="9"/>
			</counts>
		</article-meta>
	</front>
	<body>
		<sec id="sec1" sec-type="intro">
			<label>1.</label>
			<title>Introduction</title>
			<p>Improvement of the phonetic-phonological competence of second language learners constitutes a multifaceted challenge for educators and learners alike. As posited by <xref ref-type="bibr" rid="B23">Patil and Rao (2012)</xref>, the fluency of second language speakers is commonly evaluated by comparing their articulation and prosody with those of native speakers. To facilitate the acquisition of acoustic and prosodic features and to identify potential errors in the pronunciation of second language learners, various tools have been developed. Noteworthy examples include the tool introduced by <xref ref-type="bibr" rid="B9">Elvira-Garc&#xed;a, Farr&#xfa;s, and Garrido-Almi&#xf1;ana (2023)</xref>, which enables the automatic computation of speech rate; the tools by <xref ref-type="bibr" rid="B23">Patil and Rao (2012)</xref> and <xref ref-type="bibr" rid="B21">Oplustil and Toledo (2019)</xref>, designed for displaying phonetic-phonological similarity; and the tool by <xref ref-type="bibr" rid="B28">Strik, Truong, De Wet, and Cucchiarini (2009)</xref>, tailored for error detection in pronunciation. Despite these valuable contributions, there is currently an absence of a unified tool that encompasses the dual functionality of identifying tonal deviations and providing insights into differences and similarities in L2 learners&#x2019; prosody. Moreover, these existing tools fall short in documenting and tracking the progress of second language learners&#x2019; phonetic-phonological competence acquisition.</p>
			<p>In light of this, <xref ref-type="bibr" rid="B7">Couto-Fern&#xe1;ndez, Sarymsakova, Condori-Fern&#xe1;ndez, and Mart&#xed;n-Rodilla (2022)</xref> have developed a software tool titled PAFe (in Spanish: <italic>Plugin para el an&#xe1;lisis fon&#xe9;tico-fonol&#xf3;gico en espa&#xf1;ol</italic>; in English: <italic>Plugin for phonetic-phonological analysis in Spanish</italic>) in order to amend phonetic-phonological competence of second language learners and streamline the efforts of L2 educators. This tool is versatile, serving both didactic and autodidactic purposes. As the latest studies by <xref ref-type="bibr" rid="B6">Couto-Fern&#xe1;ndez (2021)</xref>, <xref ref-type="bibr" rid="B26">Sarymsakova (2022)</xref> and <xref ref-type="bibr" rid="B7">Couto-Fern&#xe1;ndez et al. (2022)</xref> show, the current version of PAFe provides comparative-contrastive melodic analysis in terms of suprasegmental speech characteristics for native and non-native speakers, their intonational features in concrete. The tool calculates the similarity of intonation production and detects tonal deviations between native and non-native speakers of Spanish. PAFe provides feedback to learners via both percentage similarity and graphs of pitch contrast, and stores data recorded by reference speakers and learners.</p>
			<p>The empirical approach for evaluating the usability of PAFe was employed by <xref ref-type="bibr" rid="B6">Couto-Fern&#xe1;ndez (2021)</xref> in order to test this tool targeting both Spanish L2 students and educators. The assessment included various metrics, namely efficiency (percentage of task completion relative to allocated time), effectiveness (degree of task completion during tool testing), user satisfaction, and usefulness (alignment with user expectations). The outcomes of this evaluation, as reported in the cited work, were derived from survey responses, revealing a notable level of efficiency, effectiveness, and user satisfaction. Notwithstanding, the usefulness metrics underscored the imperative for enhancing the tool&#x2019;s usability, emphasizing the need for further testing across diverse domains, extending beyond didactics.</p>
			<p>The later studies by <xref ref-type="bibr" rid="B7">Couto-Fern&#xe1;ndez et al. (2022)</xref> and <xref ref-type="bibr" rid="B26">Sarymsakova (2022)</xref> have found that, among other results, PAFe provides the most accurate intonational production feedback through its approach of intersyllabic analysis. Based on the outcomes and with the objective of extending contributions to the field of contrastive-comparative prosody studies between Russian and Spanish through the PAFe tool, we address the problem of phonetic-phonological competence acquisition among Russian speaking learners of Spanish We formulate our hypothesis in the present investigation as follows: The application of the PAFe tool automates the discernment of pitch functional elements in both male and female Russian speaking learners of Spanish and serves to furnish valuable insights into potential challenges encountered by these learners in their pursuit of acquiring phonetic-phonological competence of Spanish.</p>
			<p>To test this hypothesis, this study aims to achieve the following objectives:</p>
			<list list-type="alpha-lower">
				<list-item>
					<p>By comparing the empirical data obtained via intersyllabic intonation analysis of native and Russian speaking learners of Spanish performed by PAFe tool, to define the <italic>f</italic>
						<sub>0</sub> functional elements where the most pitch deviations occurred.</p>
				</list-item>
				<list-item>
					<p>To identify which parameters of intersyllabic analysis offered by PAFe require further refinement and implementation in future versions.</p>
				</list-item>
			</list>
			<p>The subsequent sections of this manuscript are organized as follows. Section 2 provides a brief overview of the intonational systems of Russian and Spanish, alongside an operation of the PAFe tool and its application in second language didactic studies. Section 3 presents the terminology used throughout our study, poses the research questions, and describes the methodology employed to address the given questions. Section 4 presents the experiment description and the main findings collected within the PAFe tool intersyllabic analysis. Finally, we conclude in Section 5.</p>
		</sec>
		<sec id="sec2">
			<label>2.</label>
			<title>Background</title>
			<sec id="sec2.1">
				<label>2.1.</label>
				<title>Russian and Spanish prosodic systems</title>
				<p>In the context of prior contrastive-comparative investigations into the phonetic-phonological systems of Russian or Spanish, noteworthy contributions have been made by <xref ref-type="bibr" rid="B12">Garc&#xed;a-River&#xf3;n (1980</xref>, <xref ref-type="bibr" rid="B13">1987)</xref>, <xref ref-type="bibr" rid="B20">Mazina (1984)</xref>, <xref ref-type="bibr" rid="B8">Dm&#xed;trieva (2017)</xref>, and <xref ref-type="bibr" rid="B26">Sarymsakova (2022)</xref>. The elucidations provided by these authors distinct dissimilarities in the functioning of melodic patterns within the respective linguistic frameworks of Russian or Spanish. As explained in subsection 4.1, we have selected four speech acts representing pragmatic categories identified as challenging by <xref ref-type="bibr" rid="B26">Sarymsakova (2022)</xref>. These acts -namely, threat, politeness, irony, and request- have been deemed challenging due to the pivotal role of pitch in activating implicit meaning. Accordingly, we focus on delineating distinctions in the melodic patterns characterizing these utterances within contributions made by Garc&#xed;a River&#xf3;n, Mazina, Dmitrieva, and Sarymsakova, dedicated to the undertaking of contrastive-comparative analyses within the domain of phonetic-phonological systems in Russian and Spanish.</p>
				<p>Henceforth, these authors concur in the observed distinctions in melodic patterns within the Russian and Spanish intonational systems. Regarding the melodic characteristics of speech acts such as threat and request, the Russian intonational system manifests an ascending pitch movement at the centre of its intonational construction. As defined by <xref ref-type="bibr" rid="B2">Bryzgunova (1977)</xref>, the centre of its intonational construction signifies a pitch functional element denoting semantic-pragmatic alterations within an utterance, wherein a declarative statement transitions into an interrogative through the modulation of the centre of intonational construction. Nevertheless, the authors mentioned above underline the incompleteness in the characterization of melodic patterns pertaining to irony and politeness within the Russian intonational system.</p>
				<p>Moreover, <xref ref-type="bibr" rid="B14">Hidalgo-Navarro (2019)</xref> and <xref ref-type="bibr" rid="B5">Cantero-Serena and Mateo-Ruiz (2013)</xref> emphasize the employment of circumflex (ascending-descending) tonal movements in the tonemes associated with politeness and irony (which are not entirely delineated within the Spanish system). Additionally, they identify the utilization of plain tonemes in threat expressions and ascending tonemes in politeness utterances.</p>
				<p>In summary, the aforementioned authors delineate fundamental challenges encountered by Russian speakers in the acquisition of Spanish melodic patterns. Certain pitch features associated with speech acts, such as irony and politeness, lack a clear definition within the Russian intonational system. While the Russian intonational system exhibits modulation of the pitch functional element known as the center of intonational construction, Spanish pitch features are distinctly specified for particular speech acts.</p>
				<p>Drawing upon the abovementioned dissimilarities of melodic patterns of Russian or Spanish and possible challenge for phonetic-phonological competence acquisition among Russian speaking learners of Spanish, we aim to contribute to the field of comparative-contrastive studies of intonational systems of Russian or Spanish by employing the PAFe tool, which is expounded upon below.</p>
			</sec>
			<sec id="sec2.2">
				<label>2.2.</label>
				<title>PAFe operation and usage</title>
				<p>The PAFe tool has been created as an extension to an existing desktop application for acoustic speech analysis, Praat, developed by <xref ref-type="bibr" rid="B1">Boersma and Weenink (2019)</xref>. PAFe consists of a series of scripts in the Python programming language and implements three intonation comparison algorithms of an ELE learner (in Spanish: <italic>Espa&#xf1;ol como Lengua Extranjera</italic>; in English: <italic>Spanish as Foreign Language</italic>) and a native Spanish speaker. This software tool is based on the Praat architecture (<xref ref-type="bibr" rid="B1">Boersma &amp; Weenink, 2019</xref>), to which a new module (PAFe, as an extension of Praat) is coupled (see <xref ref-type="fig" rid="f1">Figure 1</xref>) made up of Praat scripts, Python code and a PostgreSQL database. Praat, through its scripting, allows command line calls to other systems, as described by <xref ref-type="bibr" rid="B24">Pop and Altar (2014)</xref>, making it possible to extend the application through the use of other languages and technologies external to Praat.</p>
				<fig id="f1">
					<label>Figure 1</label>
					<caption>
						<title>PAFe global architecture.</title>
					</caption>
					<graphic id="gra-1" xlink:href="LOQUENS-10-1-2-e104-gf1.png"/>
					<attrib>Image credit: <xref ref-type="bibr" rid="B7">Couto-Fern&#xe1;ndez et al. (2022)</xref></attrib>
				</fig>
				<p>This new module (PAFe) communicates with the original system by means of new Praat scripts associated with the application&#x2019;s menu items (see <xref ref-type="fig" rid="f2">Figure 2</xref>), from which these files are executed. Sometimes, the new module dispenses with calls to Praat and generates information windows directly from Python code files.</p>
				<fig id="f2">
					<label>Figure 2</label>
					<caption>
						<title>User Interface visualising the new functionalities added to Praat.</title>
					</caption>
					<graphic id="gra-2" xlink:href="LOQUENS-10-1-2-e104-gf2.png"/>
				</fig>
				<p>Natural language processing and audio processing techniques are used in the PAFe tool, taking as the main source the human voice recordings of native speakers and students. This tool allows three different types of analysis: global, tonal tendency, and intersyllabic, as <xref ref-type="bibr" rid="B7">Couto-Fern&#xe1;ndez et al. (2022)</xref> describe. In addition, PAFe provides its users with (a) a database containing their user profile, pronunciation exercises and WAV. audios, and (b) a graphical interface including reports on their progress, such as improvement of their pronunciation in Praat.</p>
				<p>Concerning its application, the PAFe tool has predominantly undergone testing within the domain of second language didactics. As previously anticipated in Section 1, subsequent evaluations of the PAFe tool underscore its merits as a computer-assisted instrument for enhancing phonetic-phonological competence among both second language educators and learners (<xref ref-type="bibr" rid="B6">Couto-Fern&#xe1;ndez, 2021</xref>; <xref ref-type="bibr" rid="B26">Sarymsakova, 2022</xref>). A notable outcome from prior PAFe evaluations, in addition to presenting feedback similarity percentages in intonational production, is the participants&#x2019; recognition of its capacity for graphical visualization of native and non-native melodic curves that indicate each syllable tonal movement (<xref ref-type="bibr" rid="B6">Couto-Fern&#xe1;ndez, 2021</xref>). This feature was deemed a valuable resource for aiding in the improvement and acquisition of melodic patterns in the target language.</p>
				<p>Following a brief overview of relevant background related to our study and connected to comparative-contrastive studies on Russian and Spanish intonation, as well as aligned with the PAFe operation and testing, the ensuing section will focus on delineating the methodologies and techniques employed in the processing and interpretation of our data.</p>
			</sec>
		</sec>
		<sec id="sec3" sec-type="methods">
			<label>3.</label>
			<title>Methodology</title>
			<p>Due to its widespread use in the design of experiments and empirical studies in information systems and software engineering (<xref ref-type="bibr" rid="B17">Martin-Rodilla, Panach, Gonzalez-Perez, &amp; Pastor, 2018</xref>; <xref ref-type="bibr" rid="B22">Panach, Espa&#xf1;a, Dieste, Pastor, &amp; Juristo, 2015</xref>), we chose Wohlin&#x2019;s framework (<xref ref-type="bibr" rid="B29">Wohlin et al., 2012</xref>) for the design of an experiment to test our hypothesis as formulated in the Section 1. Specifically, Wohlin&#x2019;s framework includes diverse phases inherent to experimental design, such as scoping, hypothesis formulation, experimental design, operation, analysis and interpretation, hypothesis testing, and conclusion. This framework, in addition to being used for software validation and methodological proposals in various domains, has been used for the initial validation of tools and methodologies in areas such as Digital Humanities and/or Natural Language Processing as in <xref ref-type="bibr" rid="B16">Martin-Rodilla and Gonzalez-Perez (2023)</xref>. Therefore, we consider it appropriate as a reference for our experimentation.</p>
			<p>Considering the Wohlin&#x2019;s framework, we chose to test our hypothesis as formulated in Section 1 following the summary of our scoping, i.e. we analyse the pitch deviation of Russian speaking learners&#x2019; of Spanish for the purpose of identification of potential challenges in phonetic-phonological competence acquisition with respect to the background on previous comparative-contrastive studies from the point of view of PAFe users in the context of the linguistic studies. This study also aims to identify areas for improvement in the tool&#x2019;s operability.</p>
			<p>In order to provide accurate contrastive-comparative intonation analysis data of native and non-native speakers through PAFe tool, we base our study on the Melodic Speech Analysis methodology of <xref ref-type="bibr" rid="B3">Cantero-Serena (2002</xref>, <xref ref-type="bibr" rid="B4">2019)</xref> and employ the following essential principles from speech processing:</p>
			<list list-type="alpha-lower">
				<list-item>
					<p>We annotate the syllables of each speech act in a Praat textgrid (<xref ref-type="bibr" rid="B1">Boersma &amp; Weenink, 2019</xref>); we identify pitch values of all vowels in the syllables (voiced or voiced consonants are also measured), using the Praat Script developed by <xref ref-type="bibr" rid="B18">Mateo (2010a</xref>, <xref ref-type="bibr" rid="B19">2010b)</xref>, which extracts the absolute values in Hz, relativises them and draws the graph of the standardised melody;</p>
				</list-item>
				<list-item>
					<p>We select relevant frequency values between tonal segments from irrelevant values; according to <xref ref-type="bibr" rid="B3">Cantero-Serena (2002</xref>, <xref ref-type="bibr" rid="B4">2019)</xref>, <xref ref-type="bibr" rid="B10">Font-Rotch&#xe9;s and Cantero-Serena (2008</xref>, <xref ref-type="bibr" rid="B11">2009)</xref>, less than 10 percent difference between segments is considered imperceptible.</p>
				</list-item>
			</list>
			<p>As for the classification of the functional elements of pitch contour, we refer to <xref ref-type="bibr" rid="B3">Cantero-Serena (2002</xref>, <xref ref-type="bibr" rid="B4">2019)</xref>, <xref ref-type="bibr" rid="B10">Font-Rotch&#xe9;s and Cantero-Serena (2008</xref>, <xref ref-type="bibr" rid="B11">2009)</xref> studies. We assume body to be the part of the melody that goes from the first peak (the first tonic vowel) to the last tonic vowel of the contour, which we call the core (or toneme). In our study we also distinguish the final inflection, which refers to the syllables after the last tonic syllable or core. Finally, the anacrusis, represents the unstressed syllables preceding the first peak.</p>
			<p>In order to reach the objectives of the study as formulated in Section 1 and apply the aforementioned methods and approaches, the following research questions were specified:</p>
			<list list-type="order">
				<list-item>
					<p>Which pitch functional elements, identified by the PAFe tool, pose particular challenges for male and female Russian speaking learners of Spanish as a second language (L2) striving to enhance their phonetic-phonological competence?</p>
				</list-item>
				<list-item>
					<p>Does the tool provide sufficient data for intonational analysis of native and Russian speaking learners&#x2019; of Spanish melodic curve?</p>
				</list-item>
			</list>
		</sec>
		<sec id="sec4" sec-type="results">
			<label>4.</label>
			<title>Experimental design and data processing results</title>
			<sec id="sec4.1">
				<label>4.1.</label>
				<title>Data collection</title>
				<p>In accordance to the Wohlin&#x2019;s stage of experimental design, the preliminary data on assessment of pitch functional elements via PAFe feedback has been obtained through multiple recording sessions with Russian speaking learners of Spanish. In order to carry out these recordings, we have chosen four indirect speech acts that have been identified as &#x201c;challenging&#x201d; by <xref ref-type="bibr" rid="B26">Sarymsakova (2022)</xref> due to the main role of intonation in activation of implicit meaning. These speech acts (SA) are presented in <xref ref-type="table" rid="t1">Table 1</xref> and <xref ref-type="table" rid="t2">Table 2</xref> include the following lexical-syntactic structures and pragmatic functions (PF):</p>
				<list list-type="bullet">
					<list-item>
						<p>SA 1: &#x201c;Y, claro, luego usted ser&#xe1; responsable&#x201d;; PF: indirect threat.<xref ref-type="fn" rid="fn1">
								<sup>1</sup>
							</xref>
						</p>
					</list-item>
					<list-item>
						<p>SA 2: &#x201c;No tengo ninguna duda de que sois buenas gu&#xed;as, eso ya lo s&#xe9;&#x201d;; PF: negative politeness.</p>
					</list-item>
					<list-item>
						<p>SA 3: &#x201c;Con eso entiendo que es usted muy listo para dar las explicaciones&#x201d;; PF: irony.</p>
					</list-item>
					<list-item>
						<p>SA 4: &#x201c;Pero, eso no puede volver a repetirse&#x201d;; PF: indirect request.</p>
					</list-item>
				</list>
				<p>In English: SA 1: "And, of course, then you will be responsible"; SA 2: "I have no doubt that you are good guides, I know that"; SA 3: "Saying that I understand that you are very smart to give explanations"; SA 4: "But, that can't happen again".</p>
				<p>The recording procedure design consists of the following steps:</p>
				<list list-type="alpha-lower">
					<list-item>
						<p>Preparation: the students are required to complete certain exercises in order to train and test their phonetical-phonological competence in Spanish as L2.<xref ref-type="fn" rid="fn2">
								<sup>2</sup>
							</xref>
						</p>
					</list-item>
					<list-item>
						<p>Beginning: listening to the audios we have previously recorded with two native speakers of Spanish (young female and male primary and secondary school teachers from urban area of Galicia). This stage is repeated at least 5-10 times or until the students memorise and freely reproduce the utterance and intonation of the reference audio. It is worth mentioning that we have not provided the written text of the utterances in order for the participants to show their level of listening comprehension and, in this way, confirm their command of intermediate-advanced level of spoken Spanish.</p>
					</list-item>
					<list-item>
						<p>Recording of the utterances: the obtained result represents four audios of four reproduced utterances (maximum duration 2-4 seconds) for each of our students.</p>
					</list-item>
					<list-item>
						<p>Data collection: in total, 5 female learners (24-34 years old) and 4 male learners (18-35 years old) whose L1 is also Russian have participated in this empirical study. All our students are B1-B2 level and do not currently reside in a Spanish-speaking country. We have recorded 36 audios, thus, throughout this step, we have produced 36 files in the .TextGrid format containing the syllable-by-syllable of each of the utterances respectively. For the TextGrid annotations, we used the <xref ref-type="bibr" rid="B27">Schiel (1999)</xref>; <xref ref-type="bibr" rid="B15">Kisler, Reichel, and Schiel (2017)</xref> software tools to automatize TextGrid generation. In order to perform the intersyllabic type of intonational analysis offered by PAFe, we stored both the audios and the .TextGrids of our learners and native speakers in PAFe memory using the &#x201c;Upload .WAV file&#x201d; and &#x201c;Upload.TEXTGRID file&#x201d; options.</p>
					</list-item>
				</list>
			</sec>
			<sec id="sec4.2">
				<label>4.2.</label>
				<title>Data analysis outcomes</title>
				<p>Hereafter, we present the results obtained after synthesis of collected data. <xref ref-type="table" rid="t1">Table 1</xref> shows the outcomes we got after the recordings with our five female non-native speakers (Sp 1F, 2F, 3F, 4F, 5F) and intersyllabic analysis performed by PAFe tool. <xref ref-type="table" rid="t1">Table 1</xref> illustrates five Russian female learners took part in the aforementioned recordings, which were used for PAFe intersyllabic tests; the task was to reproduce four indirect speech acts pronounced by a native speaker of Spanish as accurately as possible, conveying the pragmatic feature indicated before (first paragraph of the present section). By comparing the results obtained from PAFe&#x2019;s automatic calculations when running the intersyllabic analysis algorithm, we observe that the results range for these speakers is from 80.93% to 93.41% of intonation accuracy, which we consider closely similar to the intonation of the native speaker.</p>
				<table-wrap id="t1">
					<label>Table 1</label>
					<caption>
						<title>Results of the intersyllabic analysis by PAFe tool for female Russian speaking learners. Intonation similarity percentage. SA = speech act. Sp = speaker. F = female.</title>
					</caption>
					<table>
						<colgroup>
							<col/>
							<col/>
							<col/>
							<col/>
							<col/>
							<col/>
						</colgroup>
						<thead>
							<tr>
								<th align="center">SA</th>
								<th align="center">Sp 1F</th>
								<th align="center">Sp 2F</th>
								<th align="center">Sp 3F</th>
								<th align="center">Sp 4F</th>
								<th align="center">Sp 5F</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="center">1</td>
								<td align="center">88.23</td>
								<td align="center">88.69</td>
								<td align="center">86.38</td>
								<td align="center">88.69</td>
								<td align="center">88.23</td>
							</tr>
							<tr>
								<td align="center">2</td>
								<td align="center">86.05</td>
								<td align="center">87.05</td>
								<td align="center">90.60</td>
								<td align="center">91.10</td>
								<td align="center">91.65</td>
							</tr>
							<tr>
								<td align="center">3</td>
								<td align="center">88.55</td>
								<td align="center">88.77</td>
								<td align="center">87.86</td>
								<td align="center">93.41</td>
								<td align="center">89.68</td>
							</tr>
							<tr>
								<td align="center">4</td>
								<td align="center">80.93</td>
								<td align="center">90.71</td>
								<td align="center">90.57</td>
								<td align="center">88.71</td>
								<td align="center">89.79</td>
							</tr>
						</tbody>
					</table>
				</table-wrap>
				<table-wrap id="t2">
					<label>Table 2</label>
					<caption>
						<title>Results of the intersyllabic analysis by PAFe tool for male Russian speaking learners. Intonation similarity percentage. SA = speech act. Sp = speaker. M = male.</title>
					</caption>
					<table>
						<colgroup>
							<col/>
							<col/>
							<col/>
							<col/>
							<col/>
						</colgroup>
						<thead>
							<tr>
								<th align="center">SA</th>
								<th align="center">Sp 1M</th>
								<th align="center">Sp 2M</th>
								<th align="center">Sp 3M</th>
								<th align="center">Sp 4M</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="center">1</td>
								<td align="center">80.20</td>
								<td align="center">79.90</td>
								<td align="center">78.70</td>
								<td align="center">83.30</td>
							</tr>
							<tr>
								<td align="center">2</td>
								<td align="center">90.70</td>
								<td align="center">80.10</td>
								<td align="center">74.00</td>
								<td align="center">74.20</td>
							</tr>
							<tr>
								<td align="center">3</td>
								<td align="center">87.18</td>
								<td align="center">77.50</td>
								<td align="center">74.77</td>
								<td align="center">78.14</td>
							</tr>
							<tr>
								<td align="center">4</td>
								<td align="center">87.67</td>
								<td align="center">81.92</td>
								<td align="center">83.25</td>
								<td align="center">76.00</td>
							</tr>
						</tbody>
					</table>
				</table-wrap>
				<p>Regarding the intersyllabic analysis results of our male non-native speakers (Sp 1M, 2M, etc.), see <xref ref-type="table" rid="t2">Table 2</xref>. Taking the same considerations about the stages of the recording performance as described above, the similarity percentages for our male Russian speaking learners of Spanish range from 74% to 90.70%. These results show slightly lower similarity in reproducing the intonation of the native speaker compared to the percentage of female learners. However, we still consider them quite satisfactory because none of our participants showed less than 70% similarity. Regarding the pitch difference per syllable of each reproduced speech act, see <xref ref-type="fig" rid="f3 f4 f5 f6 f7 f8">Figures 3-8</xref>.</p>
				<p>
					<xref ref-type="fig" rid="f3">Figure 3</xref> indicates the major difference (from here onwards marked in red for female speakers) for SA 1 produced by female non-native speakers appears in the final inflection (last unstressed syllable) <italic>ble</italic> (33%). Likewise, in the body of SA 1, the unstressed syllable <italic>us</italic> in the body of the pitch contour indicates a percentage of differentiation of 18.2%.</p>
				<fig id="f3">
					<label>Figure 3</label>
					<caption>
						<title>Average difference of pitch deviation by syllables for SA 1 reproduced by female non-native students. Red is used to highlight the syllables with the largest difference.</title>
					</caption>
					<graphic id="gra-3" xlink:href="LOQUENS-10-1-2-e104-gf3.png"/>
				</fig>
				<p>Regarding the SA 1 by male non-native speakers, <xref ref-type="fig" rid="f4">Figure 4</xref> shows the largest difference (from here onwards marked in green for male speakers) in the body, the unstressed syllable <italic>se</italic> (36%) and the stressed syllable <italic>r&#xe1;</italic> (29.5%) of the nucleus of the verbal syntagm.</p>
				<fig id="f4">
					<label>Figure 4</label>
					<caption>
						<title>Average difference of pitch deviation by syllables for SA 1 reproduced by male non-native students. Green is used to highlight the syllables with the largest difference.</title>
					</caption>
					<graphic id="gra-4" xlink:href="LOQUENS-10-1-2-e104-gf4.png"/>
				</fig>
				<fig id="f5">
					<label>Figure 5</label>
					<caption>
						<title>Average difference percentage of pitch deviation by syllables for SA 2 reproduced by both female and male non-native students. Red is used to highlight the syllables with the largest difference in female speakers. Green is used to highlight the syllables with the largest difference in male speakers.</title>
					</caption>
					<graphic id="gra-5" xlink:href="LOQUENS-10-1-2-e104-gf5.png"/>
				</fig>
				<fig id="f6">
					<label>Figure 6</label>
					<caption>
						<title>Average difference percentage of pitch deviation by syllables for SA 3 reproduced by both female and male non-native students. Red is used to highlight the syllables with the largest difference in female speakers. Green is used to highlight the syllables with the largest difference in male speakers.</title>
					</caption>
					<graphic id="gra-6" xlink:href="LOQUENS-10-1-2-e104-gf6.png"/>
				</fig>
				<fig id="f7">
					<label>Figure 7</label>
					<caption>
						<title>Average difference of pitch deviation by syllables for SA 4 reproduced by female non-native students. Red is used to highlight the syllables with the largest difference in female speakers.</title>
					</caption>
					<graphic id="gra-7" xlink:href="LOQUENS-10-1-2-e104-gf7.png"/>
				</fig>
				<fig id="f8">
					<label>Figure 8</label>
					<caption>
						<title>Average difference of pitch deviation by syllables for SA 4 reproduced by male non-native students. Green is used to highlight the syllables with the largest difference in male speakers.</title>
					</caption>
					<graphic id="gra-8" xlink:href="LOQUENS-10-1-2-e104-gf8.png"/>
				</fig>
				<p>As for SA 2 with negative politeness pragmatic function, <xref ref-type="fig" rid="f5">Figure 5</xref> displays the largest syllabic difference for female speakers in the subordinate part, in the nexus <italic>que</italic> (18.2%) and the unstressed syllable <italic>nas</italic> (29.6%), both of them included to the body of the SA 2 utterance. Likewise, the male speakers showed 24.5% in the same pitch contour element (syllables <italic>na</italic> and <italic>bue</italic>).</p>
				<p>The data from <xref ref-type="fig" rid="f6">Figure 6</xref> presents pitch contour elements which has the major pith difference for SA 3. The ironical speech act by female speakers distinguishes three main tonal deviations: the body of the utterance formed by <italic>do</italic> (19%) and <italic>to</italic> (16%), and the final inflection <italic>nes</italic> (15.8%). On the other hand, the male Russian speaking learners&#x2019; of Spanish utterance reveals only two main points of pitch contrast: <italic>tien</italic> (26.5%) and <italic>pa</italic> (27.3%) syllables, both from the body of ironical speech act. It should be noted that, in the case of the final inflection <italic>nes</italic>, the difference shown by PAFe is 0.01 due to imperceptible pith values of this segment (less than 75 Hz, due to PAFe default settings, as an extension of Praat).</p>
				<p>Finally, <xref ref-type="fig" rid="f7">Figure 7</xref> shows the pitch difference in the body of indirect request speech act 4, namely in the unstressed syllable <italic>vol</italic> (23.8%), and in the final inflection represented by the syllable <italic>se</italic> (34%). Regarding the male speakers&#x2019; tonal contrast found for SA 4, <xref ref-type="fig" rid="f8">Figure 8</xref> shows it in the first peak (first stressed vowel), specifically in the stressed syllable <italic>e</italic> of the demonstrative pronoun (33.5%), as well as in the beginning of the body of the same pitch contour, concretely in the unstressed syllable <italic>pe</italic> (22%).</p>
				<p>In order to adequately interpret the provided empirical data obtained via intersyllabic intonation analysis of native and Russian speaking learners of Spanish performed by PAFe tool, we have obtained the pitch functional elements where the most of <italic>f</italic>
					<sub>0</sub> deviations occurred for female and male Russian speaking learners of Spanish. <xref ref-type="fig" rid="f9">Figure 9</xref> shows the most of the pitch deviations detected by PAFe, in the case of female Russian learners, occurs in the body (10.71%) and in the final inflection (27.60%) of the pitch contour, while our male non-native participants (<xref ref-type="fig" rid="f10">Figure 10</xref>) showed a greater pitch contrast in the body (20.73%) and in the first peak (20.13%).</p>
				<fig id="f9">
					<label>Figure 9</label>
					<caption>
						<title>Pitch difference percentage detected by PAFe for functional elements in the Russian female pitch contour.</title>
					</caption>
					<graphic id="gra-9" xlink:href="LOQUENS-10-1-2-e104-gf9.png"/>
				</fig>
				<fig id="f10">
					<label>Figure 10</label>
					<caption>
						<title>Pitch difference percentage detected by PAFe for functional elements in the Russian male pitch contour.</title>
					</caption>
					<graphic id="gra-10" xlink:href="LOQUENS-10-1-2-e104-gf10.png"/>
				</fig>
				<p>Nevertheless, <xref ref-type="fig" rid="f9">Figure 9</xref> and <xref ref-type="fig" rid="f10">Figure 10</xref> illustrate that there were instances where the comparison was deemed inapplicable, evident by tone values equivalent to 0.01. Given the emergence of such data, statistical testing became imperative. Consequently, we employed the software tool proposed by <xref ref-type="bibr" rid="B25">Rodr&#xed;guez-Fern&#xe1;ndez, Canosa, Mucientes, and Bugar&#xed;n (2015)</xref> to assess the statistical significance of the experimental data. We opted for the Friedman Aligned Ranks test due to the fact that the experimental data are not normally distributed and the property of homocedasticity is not satisfied. The resulting p-value, determined to be 0.03769 (with a significance level of 0.05), was observed for male first peak values, as well as female body tonal values. This implies that these pitch functional elements bear statistical significance within our study.</p>
				<p>After all, the data obtained on Russian speaking learners of Spanish via intersyllabic analysis provided by PAFe tool and tested statistically have revealed the percentage of tonal deviations in functional elements of intonational contour (anacrusis, first peak, body, nucleus and final inflection) and have shown slight differences in those elements in speech acts produces by male and female speakers.</p>
			</sec>
		</sec>
		<sec id="sec5" sec-type="conclusions">
			<label>5.</label>
			<title>Conclusions</title>
			<p>The study we have carried out showed that the PAFe tool facilitates identification of non-native pitch deviation patterns of the pitch contour and provides quantitative data on it automatically.</p>
			<p>In summary, we highlight the following key aspects which we have set out in the Introduction section and which meet the initial objectives aroused within our hypothesis formulated in Section 1:</p>
			<list list-type="order">
				<list-item>
					<p>According to the empirical data obtained within the intersyllabic PAFe tests carried out with our Russian speaking learners of Spanish, we have identified that most of the tone deviation, in the case of female learners, occurs in the body of the four reproduced speech acts, while male Russian participants&#x2019; pitch contour elements with greater melodic contrast was the first peak. The findings also imply that the pitch functional elements in question pose noteworthy challenges for Russian speaking learners of Spanish attempting to acquire phonetic-phonological proficiency in Spanish, as they manifest the most prominent tonal deviations. These outcomes substantiate the validity of our hypothesis, as the application of PAFe in the current research has effectively automated the discrimination of pitch functional elements and has yielded valuable data elucidating the potential impediments faced by Russian speaking learners of Spanish.</p>
				</list-item>
				<list-item>
					<p>The intersyllabic functionality of PAFe tool enables automatization of melodic contrastive-comparative analysis for native and non-native speakers. However, there is a sequence of aspects that may limit melodic elements identification. The range of tonal values does not permit the analysis of pitch bellow 75 Hz. Also, as we indicated in Data collection subsection, audio and annotation files for native and non-native speakers (PAFe&#xb4;s input files) are obtained separately. In to ease the intersyllabic analysis, the process of input files collection should be automatized and integrated to the PAFe interface, which we intend to develop in its future versions and include these variables in future experiments to be carried out.</p>
				</list-item>
			</list>
			<p>Regarding future lines of research, we expect to deepen the study of gender differences in functional speech element and explain why female Russian speakers present more tonal deviance in final inflection, while male non-natives show the greatest contrast in first peak. Finally, our future purpose is to collect more data on functional speech element pitch contrast for Spanish native and non-native speakers by carrying out studies with Spanish students with different L1 and, on the basis of synthesis of this data with the PAFe tool, generate a dataset for Spanish non-native speakers voice recognition software.</p>
		</sec>
	</body>
	<back>
		<ack>
			<label>6.</label>
			<title>Acknowledgements</title>
			<p>The authors are extremely grateful to Doctor Marcos Garc&#xed;a-Gonz&#xe1;lez, Doctor Jose Mar&#xed;a Alonso-Moral and Doctor Pablo Gamallo-Otero for their technical support. An earlier version of this paper was presented at 9th International Conference on Experimental Phonetics (Vigo, June 21-23, 2023), and we want to thank the audience there for their feedback. This study is funded by Grant TED2021-130295B-C33 funded by MCIN/AEI/10.13039/501100011033 and by the &#x201c;European Union NextGenerationEU/PRTR&#x201d;. The authors also thank AEI (Agencia Estatal de Investigaci&#xf3;n) for funding of PID2020-114758RB-I00 project within MCIN/AEI/10.13039/501100011033 Grants.</p>
		</ack>
		<fn-group>
			<title>Notas</title>
			<fn fn-type="other" id="fn1">
				<label>
					<sup>1</sup>
				</label>
				<p>In case of male non-native speakers, the text of the reproduced SA 1 and SA 4 is slightly different due to native speakers&#x2019; recordings which represent semi-spontaneous communicative interaction: &#x201c;Luego usted ser&#xe1; responsable&#x201d; and &#x201c;Eso no puede volver a repetirse&#x201d;. The lexical-syntactic structure of these SA does not affect the results of intonational similarity because SA have the same functional elements of the pitch contour.</p>
			</fn>
			<fn fn-type="other" id="fn2">
				<label>
					<sup>2</sup>
				</label>
				<p>The didactical sequence for the mentioned exercises has been proposed by <xref ref-type="bibr" rid="B26">Sarymsakova (2022)</xref>.</p>
			</fn>
		</fn-group>
		<ref-list>
			<label>7.</label>
			<title>References</title>
			<ref id="B1">
				<mixed-citation publication-type="software">
					<person-group person-group-type="author">
						<string-name>
							<surname>Boersma</surname>
							<given-names>P.</given-names>
						</string-name>
						<string-name>
							<surname>Weenink</surname>
							<given-names>D.</given-names>
						</string-name>
					</person-group>
					<year>2019</year>
					<article-title>Praat: doing phonetics by computer</article-title>
					<version>6.0. 52</version>
					<comment>windows</comment>
					<ext-link ext-link-type="uri" xlink:href="https://www.fon.hum.uva.nl/praat/">https://www.fon.hum.uva.nl/praat/</ext-link>
				</mixed-citation>
			</ref>
			<ref id="B2">
				<mixed-citation publication-type="book">
					<person-group person-group-type="author">
						<string-name>
							<surname>Bryzgunova</surname>
							<given-names>E. A.</given-names>
						</string-name>
					</person-group>
					<year>1977</year>
					<source>Zvuki i intonatsiya russkoi rechi</source>
					<publisher-name>Russkii yazyk</publisher-name>
				</mixed-citation>
			</ref>
			<ref id="B3">
				<mixed-citation publication-type="book">
					<person-group person-group-type="author">
						<string-name>
							<surname>Cantero-Serena</surname>
							<given-names>F. J.</given-names>
						</string-name>
					</person-group>
					<year>2002</year>
					<source>Teor&#xed;a y an&#xe1;lisis de la entonaci&#xf3;n</source>
					<volume>54</volume>
					<publisher-name>Edicions Universitat Barcelona</publisher-name>
				</mixed-citation>
			</ref>
			<ref id="B4">
				<mixed-citation publication-type="book">
					<person-group person-group-type="author">
						<string-name>
							<surname>Cantero-Serena</surname>
							<given-names>F. J.</given-names>
						</string-name>
					</person-group>
					<year>2019</year>
					<chapter-title>An&#xe1;lisis pros&#xf3;dico del habla: m&#xe1;s all&#xe1; de la melod&#xed;a</chapter-title>
					<source>Comunicaci&#xf3;n Social: Ling&#xfc;&#xed;stica, Medios Masivos, Arte, Etnolog&#xed;a, Folclor y otras ciencias afines</source>
					<volume>2</volume>
					<fpage>485</fpage>
					<lpage>498</lpage>
				</mixed-citation>
			</ref>
			<ref id="B5">
				<mixed-citation publication-type="book">
					<person-group person-group-type="author">
						<string-name>
							<surname>Cantero-Serena</surname>
							<given-names>F. J.</given-names>
						</string-name>
						<string-name>
							<surname>Mateo-Ruiz</surname>
							<given-names>M.</given-names>
						</string-name>
					</person-group>
					<year>2013</year>
					<chapter-title>La entonaci&#xf3;n preling&#xfc;&#xed;stica del espa&#xf1;ol: implicaciones did&#xe1;cticas</chapter-title>
					<source>Aportaciones para una educaci&#xf3;n ling&#xfc;&#xed;stica y literaria en el siglo xxi</source>
					<fpage>2</fpage>
					<lpage>11</lpage>
				</mixed-citation>
			</ref>
			<ref id="B6">
				<mixed-citation publication-type="book">
					<person-group person-group-type="author">
						<string-name>
							<surname>Couto-Fern&#xe1;ndez</surname>
							<given-names>T.</given-names>
						</string-name>
					</person-group>
					<year>2021</year>
					<source>Una herramienta de an&#xe1;lisis del habla de audio para proporcionar retroalimentaci&#xf3;n autom&#xe1;tica a los estudiantes en la pronunciaci&#xf3;n en espa&#xf1;ol</source>
				</mixed-citation>
			</ref>
			<ref id="B7">
				<mixed-citation publication-type="confproc">
					<person-group person-group-type="author">
						<string-name>
							<surname>Couto-Fern&#xe1;ndez</surname>
							<given-names>T.</given-names>
						</string-name>
						<string-name>
							<surname>Sarymsakova</surname>
							<given-names>A.</given-names>
						</string-name>
						<string-name>
							<surname>Condori-Fern&#xe1;ndez</surname>
							<given-names>N.</given-names>
						</string-name>
						<string-name>
							<surname>Mart&#xed;n-Rodilla</surname>
							<given-names>P.</given-names>
						</string-name>
					</person-group>
					<year>2022</year>
					<source>Plugin for automatisation of phonetic-phonological analysis and obtaining analytical feedback for Spanish learners</source>
					<conf-name>Sepln-pd 2022: Annual Conference of the Spanish Association for Natural Language Processing 2022: Projects and Demonstrations</conf-name>
					<fpage>83</fpage>
					<lpage>87</lpage>
					<ext-link ext-link-type="uri" xlink:href="https://bit.ly/48yNqz2">https://bit.ly/48yNqz2</ext-link>
				</mixed-citation>
			</ref>
			<ref id="B8">
				<mixed-citation publication-type="thesis">
					<person-group person-group-type="author">
						<string-name>
							<surname>Dm&#xed;trieva</surname>
							<given-names>A.</given-names>
						</string-name>
					</person-group>
					<year>2017</year>
					<source>Estudio rec&#xed;proco de la fon&#xe9;tica y fonolog&#xed;a del espa&#xf1;ol y el ruso desde el punto de vista de su adquisici&#xf3;n y de su ense&#xf1;anza como lenguas extranjeras</source>
					<comment content-type="degree">Doctoral dissertation</comment>
					<publisher-name>Universidad Pablo de Olavide</publisher-name>
					<ext-link ext-link-type="uri" xlink:href="https://bit.ly/47sVi3G">https://bit.ly/47sVi3G</ext-link>
				</mixed-citation>
			</ref>
			<ref id="B9">
				<mixed-citation publication-type="journal">
					<person-group person-group-type="author">
						<string-name>
							<surname>Elvira-Garc&#xed;a</surname>
							<given-names>W.</given-names>
						</string-name>
						<string-name>
							<surname>Farr&#xfa;s</surname>
							<given-names>M.</given-names>
						</string-name>
						<string-name>
							<surname>Garrido-Almi&#xf1;ana</surname>
							<given-names>J. M.</given-names>
						</string-name>
					</person-group>
					<year>2023</year>
					<month>Jun.</month>
					<article-title>Comparison of intensity-based methods for automatic speech rate computation</article-title>
					<source>Loquens</source>
					<volume>9</volume>
					<issue>1-2</issue>
					<elocation-id>e090</elocation-id>
					<pub-id pub-id-type="doi">10.3989/loquens.2022.e090</pub-id>
				</mixed-citation>
			</ref>
			<ref id="B10">
				<mixed-citation publication-type="journal">
					<person-group person-group-type="author">
						<string-name>
							<surname>Font-Rotch&#xe9;s</surname>
							<given-names>D.</given-names>
						</string-name>
						<string-name>
							<surname>Cantero-Serena</surname>
							<given-names>F. J.</given-names>
						</string-name>
					</person-group>
					<year>2008</year>
					<article-title>La melod&#xed;a del habla: acento, ritmo y entonaci&#xf3;n</article-title>
					<source>Eufon&#xed;a. Did&#xe1;ctica de la m&#xfa;sica</source>
					<volume>43</volume>
					<fpage>19</fpage>
					<lpage>39</lpage>
					<ext-link ext-link-type="uri" xlink:href="https://bit.ly/3NYz0zF">https://bit.ly/3NYz0zF</ext-link>
				</mixed-citation>
			</ref>
			<ref id="B11">
				<mixed-citation publication-type="journal">
					<person-group person-group-type="author">
						<string-name>
							<surname>Font-Rotch&#xe9;s</surname>
							<given-names>D.</given-names>
						</string-name>
						<string-name>
							<surname>Cantero-Serena</surname>
							<given-names>F. J.</given-names>
						</string-name>
					</person-group>
					<year>2009</year>
					<article-title>Melodic analysis of speech method (MAS) applied to Spanish and Catalan</article-title>
					<source>Phonica</source>
					<volume>5</volume>
					<fpage>33</fpage>
					<lpage>47</lpage>
				</mixed-citation>
			</ref>
			<ref id="B12">
				<mixed-citation publication-type="thesis">
					<person-group person-group-type="author">
						<string-name>
							<surname>Garc&#xed;a-River&#xf3;n</surname>
							<given-names>R.</given-names>
						</string-name>
					</person-group>
					<year>1980</year>
					<source>Sistema sobstvenno voprositel&#xb4;nyj predlozhenii v sopostovlenii s ispanskim</source>
					<comment content-type="degree">MGU</comment>
				</mixed-citation>
			</ref>
			<ref id="B13">
				<mixed-citation publication-type="book">
					<person-group person-group-type="author">
						<string-name>
							<surname>Garc&#xed;a-River&#xf3;n</surname>
							<given-names>R.</given-names>
						</string-name>
					</person-group>
					<year>1987</year>
					<source>La interrogaci&#xf3;n. Introducci&#xf3;n a su estudio</source>
					<publisher-loc>Editorial Cient&#xed;fico-T&#xe9;cnica</publisher-loc>
				</mixed-citation>
			</ref>
			<ref id="B14">
				<mixed-citation publication-type="book">
					<person-group person-group-type="author">
						<string-name>
							<surname>Hidalgo-Navarro</surname>
							<given-names>A.</given-names>
						</string-name>
					</person-group>
					<year>2019</year>
					<source>Sistema y uso de la entonaci&#xf3;n en espa&#xf1;ol hablado: aproximaci&#xf3;n interactivo-funcional</source>
					<publisher-name>Ediciones Universidad Alberto Hurtado</publisher-name>
				</mixed-citation>
			</ref>
			<ref id="B15">
				<mixed-citation publication-type="journal">
					<person-group person-group-type="author">
						<string-name>
							<surname>Kisler</surname>
							<given-names>T.</given-names>
						</string-name>
						<string-name>
							<surname>Reichel</surname>
							<given-names>U.</given-names>
						</string-name>
						<string-name>
							<surname>Schiel</surname>
							<given-names>F.</given-names>
						</string-name>
					</person-group>
					<year>2017</year>
					<article-title>Multilingual processing of speech via web services</article-title>
					<source>Computer Speech &amp; Language</source>
					<volume>45</volume>
					<fpage>326</fpage>
					<lpage>347</lpage>
					<pub-id pub-id-type="doi">10.1016/j.csl.2017.01.005</pub-id>
				</mixed-citation>
			</ref>
			<ref id="B16">
				<mixed-citation publication-type="journal">
					<person-group person-group-type="author">
						<string-name>
							<surname>Martin-Rodilla</surname>
							<given-names>P.</given-names>
						</string-name>
						<string-name>
							<surname>Gonzalez-Perez</surname>
							<given-names>C.</given-names>
						</string-name>
					</person-group>
					<year>2023</year>
					<article-title>Same text, same discourse? Empirical validation of a discourse analysis methodology for cultural heritage</article-title>
					<source>Digital Scholarship in the Humanities</source>
					<volume>38</volume>
					<issue>1</issue>
					<fpage>224</fpage>
					<lpage>239</lpage>
					<pub-id pub-id-type="doi">10.1093/llc/fqac038</pub-id>
				</mixed-citation>
			</ref>
			<ref id="B17">
				<mixed-citation publication-type="journal">
					<person-group person-group-type="author">
						<string-name>
							<surname>Martin-Rodilla</surname>
							<given-names>P.</given-names>
						</string-name>
						<string-name>
							<surname>Panach</surname>
							<given-names>J. I.</given-names>
						</string-name>
						<string-name>
							<surname>Gonzalez-Perez</surname>
							<given-names>C.</given-names>
						</string-name>
						<string-name>
							<surname>Pastor</surname>
							<given-names>O.</given-names>
						</string-name>
					</person-group>
					<year>2018</year>
					<article-title>Assessing data analysis performance in research contexts: An experiment on accuracy, efficiency, productivity and researchers&#x2019; satisfaction</article-title>
					<source>Data &amp; Knowledge Engineering</source>
					<volume>116</volume>
					<fpage>177</fpage>
					<lpage>204</lpage>
					<pub-id pub-id-type="doi">10.1016/j.datak.2018.06.003</pub-id>
				</mixed-citation>
			</ref>
			<ref id="B18">
				<mixed-citation publication-type="journal">
					<person-group person-group-type="author">
						<string-name>
							<surname>Mateo</surname>
							<given-names>M.</given-names>
						</string-name>
					</person-group>
					<year>2010a</year>
					<article-title>Protocolo para la extracci&#xf3;n de datos tonales y curva est&#xe1;ndar en an&#xe1;lisis mel&#xf3;dico del habla (AMH)</article-title>
					<source>Phonica</source>
					<volume>6</volume>
					<fpage>49</fpage>
					<lpage>90</lpage>
					<pub-id pub-id-type="doi">10.1344/phonica.2010.6.49-90</pub-id>
				</mixed-citation>
			</ref>
			<ref id="B19">
				<mixed-citation publication-type="journal">
					<person-group person-group-type="author">
						<string-name>
							<surname>Mateo</surname>
							<given-names>M.</given-names>
						</string-name>
					</person-group>
					<year>2010b</year>
					<article-title>Scrips en Praat para la extracci&#xf3;n de datos tonales y curva est&#xe1;ndar</article-title>
					<source>Phonica</source>
					<volume>6</volume>
					<fpage>91</fpage>
					<lpage>111</lpage>
					<pub-id pub-id-type="doi">10.1344/phonica.2010.6.91-111</pub-id>
				</mixed-citation>
			</ref>
			<ref id="B20">
				<mixed-citation publication-type="thesis">
					<person-group person-group-type="author">
						<string-name>
							<surname>Mazina</surname>
							<given-names>L.</given-names>
						</string-name>
					</person-group>
					<year>1984</year>
					<source>&#x41c;&#x435;&#x442;&#x43e;&#x434;&#x438;&#x43a;&#x430; &#x43e;&#x431;&#x443;&#x447;&#x435;&#x43d;&#x438;&#x44f; &#x441;&#x442;&#x443;&#x434;&#x435;&#x43d;&#x442;&#x43e;&#x432;-&#x438;&#x43d;&#x43e;&#x441;&#x442;&#x440;&#x430;&#x43d;&#x446;&#x435;&#x432; &#x438;&#x43d;&#x442;&#x43e;&#x43d;&#x430;&#x446;&#x438;&#x438; &#x440;&#x443;&#x441;&#x441;&#x43a;&#x43e;&#x433;&#x43e; &#x44f;&#x437;&#x44b;&#x43a;&#x430; (&#x43d;&#x430;&#x447;&#x430;&#x43b;&#x44c;&#x43d;&#x44b;&#x439; &#x44d;&#x442;&#x430;&#x43f; &#x43a;&#x43e;&#x43d;&#x442;&#x430;&#x43a;&#x442;&#x430; &#x438;&#x441;&#x43f;&#x430;&#x43d;&#x441;&#x43a;&#x43e;&#x433;&#x43e; &#x44f;&#x437;&#x44b;&#x43a;&#x430; &#x441; &#x440;&#x443;&#x441;&#x441;&#x43a;&#x438;&#x43c;)</source>
					<comment content-type="degree">Doctoral dissertation, &#x41c;&#x43e;&#x441;&#x43a;&#x43e;&#x432;&#x441;&#x43a;&#x438;&#x439; &#x433;&#x43e;&#x441;&#x443;&#x434;&#x430;&#x440;&#x441;&#x442;&#x432;&#x435;&#x43d;&#x43d;&#x44b;&#x439; &#x43f;&#x435;&#x434;&#x430;&#x433;&#x43e;&#x433;&#x438;&#x447;&#x435;&#x441;&#x43a;&#x438;&#x439; &#x438;&#x43d;&#x441;&#x442;&#x438;&#x442;&#x443;&#x442; &#x438;&#x43d;&#x43e;&#x441;&#x442;&#x440;&#x430;&#x43d;&#x43d;&#x44b;&#x445; &#x44f;&#x437;&#x44b;&#x43a;&#x43e;&#x432; &#x438;&#x43c;&#x435;&#x43d;&#x438; &#x41c;&#x43e;&#x440;&#x438;&#x301;&#x441;&#x430; &#x422;&#x43e;&#x440;&#x435;&#x301;&#x437;&#x430;</comment>
					<ext-link ext-link-type="uri" xlink:href="https://bit.ly/47tWcge">https://bit.ly/47tWcge</ext-link>
				</mixed-citation>
			</ref>
			<ref id="B21">
				<mixed-citation publication-type="report">
					<person-group person-group-type="author">
						<string-name>
							<surname>Oplustil</surname>
							<given-names>P.</given-names>
						</string-name>
						<string-name>
							<surname>Toledo</surname>
							<given-names>G.</given-names>
						</string-name>
					</person-group>
					<year>2019</year>
					<source>Uso de una herramienta did&#xe1;ctica para la pr&#xe1;ctica de la entonaci&#xf3;n en hablantes no nativos de espa&#xf1;ol</source>
					<fpage>37</fpage>
					<lpage>50</lpage>
					<pub-id pub-id-type="doi">10.21001/sintagma.2019.31.03</pub-id>
				</mixed-citation>
			</ref>
			<ref id="B22">
				<mixed-citation publication-type="journal">
					<person-group person-group-type="author">
						<string-name>
							<surname>Panach</surname>
							<given-names>J. I.</given-names>
						</string-name>
						<string-name>
							<surname>Espa&#xf1;a</surname>
							<given-names>S.</given-names>
						</string-name>
						<string-name>
							<surname>Dieste</surname>
							<given-names>O.</given-names>
						</string-name>
						<string-name>
							<surname>Pastor</surname>
							<given-names>&#xd3;.</given-names>
						</string-name>
						<string-name>
							<surname>Juristo</surname>
							<given-names>N.</given-names>
						</string-name>
					</person-group>
					<year>2015</year>
					<article-title>In search of evidence for model-driven development claims: An experiment on quality, effort, productivity and satisfaction</article-title>
					<source>Information and software technology</source>
					<volume>62</volume>
					<fpage>164</fpage>
					<lpage>186</lpage>
					<pub-id pub-id-type="doi">10.1016/j.infsof.2015.02.012</pub-id>
				</mixed-citation>
			</ref>
			<ref id="B23">
				<mixed-citation publication-type="confproc">
					<person-group person-group-type="author">
						<string-name>
							<surname>Patil</surname>
							<given-names>V.</given-names>
						</string-name>
						<string-name>
							<surname>Rao</surname>
							<given-names>P.</given-names>
						</string-name>
					</person-group>
					<year>2012</year>
					<source>Automatic pronunciation assessment for language learners with acoustic-phonetic features</source>
					<conf-name>Proceedings of the workshop on speech and language processing tools in education,</conf-name>
					<fpage>17</fpage>
					<lpage>24</lpage>
				</mixed-citation>
			</ref>
			<ref id="B24">
				<mixed-citation publication-type="journal">
					<person-group person-group-type="author">
						<string-name>
							<surname>Pop</surname>
							<given-names>D.-P.</given-names>
						</string-name>
						<string-name>
							<surname>Altar</surname>
							<given-names>A.</given-names>
						</string-name>
					</person-group>
					<year>2014</year>
					<article-title>Designing an MVC model for rapid web application development</article-title>
					<source>Procedia Engineering</source>
					<volume>69</volume>
					<fpage>1172</fpage>
					<lpage>1179</lpage>
					<pub-id pub-id-type="doi">10.1016/j.proeng.2014.03.106</pub-id>
				</mixed-citation>
			</ref>
			<ref id="B25">
				<mixed-citation publication-type="confproc">
					<person-group person-group-type="author">
						<string-name>
							<surname>Rodr&#xed;guez-Fern&#xe1;ndez</surname>
							<given-names>I.</given-names>
						</string-name>
						<string-name>
							<surname>Canosa</surname>
							<given-names>A.</given-names>
						</string-name>
						<string-name>
							<surname>Mucientes</surname>
							<given-names>M.</given-names>
						</string-name>
						<string-name>
							<surname>Bugar&#xed;n</surname>
							<given-names>A.</given-names>
						</string-name>
					</person-group>
					<source>STAC: a web platform for the comparison of algorithms using statistical tests</source>
					<conf-name>Proceedings of the 2015 ieee international conference on fuzzy systems (fuzz-ieee)</conf-name>
				</mixed-citation>
			</ref>
			<ref id="B26">
				<mixed-citation publication-type="thesis">
					<person-group person-group-type="author">
						<string-name>
							<surname>Sarymsakova</surname>
							<given-names>A.</given-names>
						</string-name>
					</person-group>
					<year>2022</year>
					<source>La ense&#xf1;anza del espa&#xf1;ol a rusohablantes por medio de interacciones profesionales simuladas (role-play): el an&#xe1;lisis del conflicto comunicativo e intercultural y su relaci&#xf3;n con la prosodia y el gesto</source>
					<comment content-type="degree">Doctoral dissertation</comment>
					<publisher-name>Universidade da Coru&#xf1;a</publisher-name>
					<ext-link ext-link-type="uri" xlink:href="https://bit.ly/3kAevOf">https://bit.ly/3kAevOf</ext-link>
				</mixed-citation>
			</ref>
			<ref id="B27">
				<mixed-citation publication-type="confproc">
					<person-group person-group-type="author">
						<string-name>
							<surname>Schiel</surname>
							<given-names>F.</given-names>
						</string-name>
					</person-group>
					<year>1999</year>
					<source>Automatic phonetic transcription of non-prompted speech</source>
					<conf-name>Proceedings of the XIVth International Congress of Phonetic Sciences: ICPhS 99</conf-name>
					<conf-loc>San Francisco</conf-loc>
					<conf-date>1-7 August 1999</conf-date>
					<fpage>607</fpage>
					<lpage>610</lpage>
					<ext-link ext-link-type="uri" xlink:href="https://bit.ly/3TRkLQX">https://bit.ly/3TRkLQX</ext-link>
				</mixed-citation>
			</ref>
			<ref id="B28">
				<mixed-citation publication-type="journal">
					<person-group person-group-type="author">
						<string-name>
							<surname>Strik</surname>
							<given-names>H.</given-names>
						</string-name>
						<string-name>
							<surname>Truong</surname>
							<given-names>K.</given-names>
						</string-name>
						<string-name>
							<surname>De Wet</surname>
							<given-names>F.</given-names>
						</string-name>
						<string-name>
							<surname>Cucchiarini</surname>
							<given-names>C.</given-names>
						</string-name>
					</person-group>
					<year>2009</year>
					<article-title>Comparing different approaches for automatic pronunciation error detection</article-title>
					<source>Speech communication</source>
					<volume>51</volume>
					<issue>10</issue>
					<fpage>845</fpage>
					<lpage>852</lpage>
					<pub-id pub-id-type="doi">10.1016/j.specom.2009.05.007</pub-id>
				</mixed-citation>
			</ref>
			<ref id="B29">
				<mixed-citation publication-type="book">
					<person-group person-group-type="author">
						<string-name>
							<surname>Wohlin</surname>
							<given-names>C.</given-names>
						</string-name>
						<string-name>
							<surname>Runeson</surname>
							<given-names>P.</given-names>
						</string-name>
						<string-name>
							<surname>H&#xf6;st</surname>
							<given-names>M.</given-names>
						</string-name>
						<string-name>
							<surname>Ohlsson</surname>
							<given-names>M. C.</given-names>
						</string-name>
						<string-name>
							<surname>Regnell</surname>
							<given-names>B.</given-names>
						</string-name>
						<string-name>
							<surname>Wessl&#xe9;n</surname>
							<given-names>A.</given-names>
						</string-name>
					</person-group>
					<year>2012</year>
					<source>Experimentation in software engineering</source>
					<publisher-loc>Springer Science &amp; Business Media</publisher-loc>
					<pub-id pub-id-type="doi">10.1007/978-3-642-29044-2</pub-id>
				</mixed-citation>
			</ref>
		</ref-list>
	</back>
</article>