Article

Name: Uniqueness and Typicality Effects in Heterosemiotic Units: Algorithm and Analysis Procedure

Authors: M. I. Kiose 1 , O. N. Prokofyeva 2 , A. A. Rzhevesskaya 3 , T. G. Kharlamova

Moscow State Linguistic University (Moscow, Russian Federation)

Abstract: The study develops the algorithm of typicality analysis within heterosemiotic units which integrate various semiotic systems and subsystems (multimodal and polycode). The algorithm is tested in four heterosemiotic units of text and image, speech and gesture, multi-discourse and multistylistic unities. The algorithm is a six-step procedure, it defines the type and character of the unit, its parametric activity, parametric synchronization and resonance, and finally diagnoses the typicality of the unit representatives. The study proves that despite the differences within the heterosemiotic units structure, the developed algorithm is productive and can be applied to distinguish the more and less typical unit representatives.

Keywords: semiotic systems, uniqueness and typicality, parametric synchro- nization and resonance, focusing

Bibliography:

Bakhtin M. M. Voprosy literatury i estetiki [Issues of Literature and Aesthetics]. Moscow, 1975. (in Russ.)

Bochaver S. Yu. Transformatsiya dramaticheskogo teksta v kontse XIX – nachale XX v. [Transformations in drama at the end of the 19 th – beginning of the 20 th century]. Critique and Semiotics, 2012, no. 17, p. 274–280. (in Russ.)

Cienki A. Multimodal Metaphor Analysis. In: Cameron L., Maslen R. (eds.). Metaphor Analysis: Research Practice in Applied Linguistics, Social Sciences and the Humanities. London, 2010, p. 195–214.

Eco U. Kant and the Platypus: Essays on language and cognition. Boston, 2000.

Grishina E. A. Russkaya zhestikulyatsiya s lingvisticheskoj tochki zreniya (korpusnye issledovaniya) [Russian gestures in linguistic aspect (corpus studies)]. Moscow, 2017. (in Russ.)

Iriskhanova O. K. Igry fokusa v yazyke. Semantika, sintaksis i pragmatika defokusirovaniya [Focus Games in Language. Semantics, Syntax and Pragmatics of Focusing]. Moscow, 2014. (in Russ.)

Iriskhanova O. K., Prokofieva O. N. Fokusirovanie v ustnom opisatel'nom diskurse: analiz vizual'noj pertseptsii, rechi i zhestov [Focusing in oral descriptive discourse: visual perception, speech and gesture analysis]. Kognitivnye issledovaniya yazyka [Cognitive Studies of Language], 2017, iss. 29, p. 80–94. (in Russ.)

Iriskhanova O. K., Cienki A. The semiotics of gestures in cognitive linguistics: contribution and challenges. Issues in Cognitive Linguistics, 2018, no. 4 (57), p. 25–36.

Jakobson R. O. Lingvistika i poetika [Linguistics and poetics]. In: Strukturalizm: “za” i “protiv” [Structuralism: Pro and Contra]. Moscow, 1975, p. 193–230. (in Russ.)

Kendon A. Gesture: Visible action as utterance. Cambridge, 2004.

Kiose M. I. The interplay of syntactic and lexical salience and its effect on default figurative responses. Studies in Logic, Grammar and Rhetoric, 2020, vol. 61 (74), p. 161–178.

Kirtley C. How images draw the eye: an eye-tracking study of composition. Empirical Studies of the Arts, 2018, vol. 36 (1), p. 41–70.

Kress G. Multimodality. A Social Semiotic Approach to Contemporary Communication. London, 2010.

Langacker R. Grammar and Conceptualisation. Berlin, New York, 2000.

Loginova E. G. Podobie i kontrast elementov semioticheskikh sistem v polimodal'nom diskurse [Similarity and contrast of semiotic system units in multimodal discourse]. Vestnik Moskovskogo gosudarstvennogo lingvisticheskogo universiteta. Gumanitarnye nauki [Vestnik of Moscow State Linguistic University. Humanities], 2017, p. 216–226. (in Russ.)

Mueller C., Tag S. The dynamics of metaphor: Foregrounding and activating metaphoricity in conversational interaction. Cognitive Semiotics, 2010, vol. 10 (6), p. 85–120.

Petrilli S. The Global World and its Manifold Faces. Otherness as the Basis for Communication. Bern, 2016.

Petrova N. Yu. Postroenie perspektivy v tekste p'esy [Perspective Construal in Plays]. Moscow, 2017. (in Russ.)

Rauscher F. H., Krauss R. M., Chen Y. Gesture, speech, and lexical access: The role of lexical movements in speech production. Psychological Science, 1996, no. 7, p. 226–231.

Rayner K., Rotello C. M., Stewart A. J., Keir J., Duffy S. A. Integrating text and pictorial information: Eye movements when looking at print advertisements. Journal of Experimental Psychology: Applied, 2001, vol. 7 (3), p. 219–226.

Schmid H.-J. (ed.). Entrenchment and the psychology of language learning. How we reorganize and adapt linguistic knowledge. Washington DC, 2016.

Sinha C. (Dis-)Continuity, (inter-)corporeality and conventionality in dialogical development. Commentary on Gratier & Bertau and Lyra. In: Bertau M.-C., Gonçalves M. M., Raggatt P. T. F. (eds.). Dialogic Formations. Investigations into the Origins and Development of the Dialogical Self. Charlotte NC, 2012, p. 145–153.

Sonin A. G. Ponimanie polikodovykh tekstov: kognitivnyj aspect [Polycode Texts Comprehension: Cognitive Aspects]. Moscow, 2005. (in Russ.)

Sonneson G. The Varieties of Interpretation: A view from semiotics. Galáxia, 2002, vol. 4, p. 67–99.

Sorokin Yu. A., Tarasov E. F. Kreolizovannye teksty i ikh kommunikativnaya funktsiya [Creolized Texts and their Communicative Function]. In: Optimizatsiya rechevogo vozdejstviya [Optimization in Speech Impact]. Moscow, 1990, p. 180–186. (in Russ.)

Trifonas P. Image and Text. In: Trifonas P. (ed.). International Handbook of Semiotics. New York, 2015, p. 1139–1154.

Wårwik B. What is foregrounded in narratives? Hypotheses for the cognitive basis of foregrounding. In: Virtanen T. (ed.). Approaches to Cognition through Text and Discourse. Berlin, New York, 2002, p. 99–122.

Zlatev J., Racine T. P., Sinha C., Itkonen E. (eds.). The Shared Mind. Perspectives on Intersubjectivity. Amsterdam, 2012.

Zlatev J., Sonneson G., Konderak P. (eds.). Meaning, Mind and Communication: Explorations in Cognitive Semiotics. Berlin, 2016.

Zykova I. V., Kiose M. I. Parametrizatsiya lingvisticheskoj kreativnosti v mezhdiskursivnom aspekte: kinodiskurs vs diskurs detskoj literatury [Linguistic creativity parametrization in contrasting discourse types: cinematic discourse vs. discourse of children’s literature]. Voprosy kognitivnoj lingvistiki [Issues in Cognitive Linguistics], 2020, no. 2, p. 26–40. (in Russ.)