Natural Language & Visual Narrative

Notes:

Visual narrative is a storytelling technique that uses visual elements, such as images, graphics, and videos, to convey a story or message. Visual narrative can be used in a variety of contexts, including movies, television shows, video games, and other media, and it is an effective way to engage and captivate an audience.

Natural language processing (NLP) is a field of computer science that focuses on the interaction between computers and human languages, and it is often used in conjunction with visual narrative to enhance the storytelling experience. Some of the ways in which NLP is used in visual narrative include:

Text recognition: NLP can be used to recognize and extract text from images and videos, which can be used to provide context and information about the visual elements of the narrative.
Sentiment analysis: NLP can be used to analyze the sentiment, or emotion, of text, which can be used to provide insight into the mood and tone of the narrative.
Text-to-speech: NLP can be used to convert text into speech, which can be used to provide voiceovers or narration for visual narratives.

Computational visual storytelling is the use of computational techniques and algorithms to create and present visual narratives, such as movies, video games, and other media.

Narrative visualisation is the use of visual elements, such as images, graphics, and charts, to convey a story or message.

Virtual storyteller is a computer-generated character or agent that is designed to create and present visual narratives, such as movies or video games.

Visual narratology is the study of the ways in which visual elements, such as images and graphics, are used to convey stories and meaning.

Visual storytelling is the use of visual elements, such as images, graphics, and videos, to convey a story or message. It is a technique that is used in a variety of contexts, including movies, television shows, video games, and other media.

Wikipedia:

Visual narrative

References:

A Hierarchical Approach for Visual Storytelling Using Image Description
MS Al Nahian, T Tasrin, S Gandhi, R Gaines… – … on Interactive Digital …, 2019 – Springer
… them to create human-like coherent visual narratives. The major contributions of our work can be summarized as follows: An end-to-end hierarchical deep neural network to generate open story from visual content. Exploration into the use of natural language image descriptions …

A Hierarchical Approach for Visual Storytelling Using Image Description
B Harrison – … : 12th International Conference on Interactive Digital …, 2019 – books.google.com
… to create human-like coherent visual narratives. The major contributions of our work can be summarized as follows: –An end-to-end hierarchical deep neural network to generate open story from visual content. –Exploration into the use of natural language image descriptions in …

Sensing Affective Response to Visual Narratives
M Burzo, V Perez-Rosas, D McDuff… – IEEE Computational …, 2019 – ieeexplore.ieee.org
… In Section 3, we introduce our methodology to compile the corpus of visual narratives … build upon previous work in natural language processing, com- puter vision, affective computing, and computational physiolo- gy, as well as our own previous experience in related areas. 2.1 …

Understanding Users of Cross-media Information: Contexts, motivations, and information features focusing on visual narrative materials
H Cho – 2019 – digital.lib.washington.edu
… interview, and a larger-scale content analysis of natural language queries collected from online fan communities. The researcher addresses three main themes in this dissertation: 1) the motivations, context, and situational information of users who consume visual narrative …

Narrative Generation to Support Causal Exploration of Directed Graphs
A Choudhry – 2020 – vtechworks.lib.vt.edu
… while enabling the user to see the effect of interventions on the target nodes, 2) the use of natural language generation techniques … A visual narrative is a story told primarily using visual media, such as illus- trations, photographs, animations, video, and—now—visualization [21 …

Computational Intelligence for Affective Computing and Sentiment Analysis [Guest Editorial]
E Cambria, S Poria, A Hussain… – IEEE Computational …, 2019 – ieeexplore.ieee.org
… relevant episodes, emo- tions, and sensory experiences, all of which enable the completion of complex natural language processing tasks … In “Sensing Affective Response to Visual Narratives”, Mihai Burzo, Verónica Pérez- Rosas, Daniel McDuff, Louis-Philippe Morency, Alexis …

Visual and verbal narrative comprehension in children and adolescents with autism spectrum disorders: An ERP study
M Manfredi, N Cohn, PS Mello, E Fernandez… – Journal of Autism and …, 2020 – Springer
… Abstract We examined semantic processing in ASD children by presenting sentences with congruent or incongruent final words and visual narratives with congruent or incongruent final panels … Keywords Autism · Semantic processing · N400 · LP · Visual narrative …

Visuo-spatial construals that aid in understanding activity in visual-centred narrative
DJ Napoli, L Leeson – Language, Cognition and Neuroscience, 2020 – Taylor & Francis
… We identify seven construals used in ordinary human understanding of the physical world that help account for how viewers interpret activity in static visual narratives and that we propose form the foundation of the activity constraint …

Visual narrativity and the creation of a text world: a semiotic study of selected cases of transmediality
E Chrzanowska-Kluczewska – Studia Linguistica Universitatis …, 2019 – ruj.uj.edu.pl
… Wolf 2005) denotes a semiotic code/system, a language, for instance a verbal/natural language realized as speech or writing; image … notion of experientality;2 Sonesson 19973), postulated originally for verbal texts and extrapolated onto visual narratives, will differ according to …

Towards Visual Explorations of Forums’ Collective Dynamics in Learning Management Systems
M Koné, M May, S Iksal, S Oumtanaga – 2019 – hal.archives-ouvertes.fr
… Each model the students’ dynam- ics with a mixture of Natural Language Processing (NLP) techniques such as LDA or Latent Semantic … Page 7. awareness, ie rapid feedback about collective ac- tion, and visual narratives (Yousuf and Conlan, 2015) are beneficial to the students …

Pictorial narratives and temporal refinement
T Fernando – Semantics and Linguistic Theory, 2019 – journals.linguisticsociety.org
… Be that as it may, we will not dwell on the choice of ? below, focusing rather on the temporal relations between pictures in a narrative. Kamp (2013) expresses a guiding intuition about natural language that arguably applies to a narrative with pictures in place of sentences …

Frame-Based Annotation of Multimodal Corpora: Tracking (A) Synchronies in Meaning Construction
F Belcavello, M Viridiano, AD da Costa… – Proceedings of the …, 2020 – aclweb.org
… (2017) present a review of the state of art on linking natural language and vision … He thus classifies the relations between text and image in visual narratives, evaluating the presence or absence of grammar structuring each of the modalities and also the presence or absence of …

Narrative dimensions for the design of contemporary visual identities
C Lelis, EA Kreutz – 2019 – academia.edu
… assumption that a brand is a live construction (Neumeier, 2006), and grounded on Zadeh’s (1996) idea that natural language is not … stand-alone static imagery are not understood as having narrative content (idem), seemingly contradicting what others define as visual narratives …

Why There Is No Language of Comics
F Bramlett – The Oxford Handbook of Comic Book Studies, 2019 – academia.edu
… (See more below on modes such as sign language and writing systems.) However, comics are not used as a natural language or as an artificial language as a system of … Bateman, John, and Janina Wildfeuer. “A Multimodal Discourse Theory of Visual Narrative.” Journal of …

The Place of Holocaust Survivor Videotestimony: Navigating the Landmarks of First-Person Audio-Visual Representation
OB Stier – The Palgrave Handbook of Holocaust Literature and …, 2020 – Springer
… them, and the Internet and virtual spaces that extend and exceed those archival containers, bringing these audio-visual narratives into the … to the eerie image of one of the sixteen survivors; the survivors “answer” them in turn through adaptive natural-language technology that …

The interactions of rational, pragmatic agents lead to efficient language structure and use
BN Peloquin, ND Goodman… – Topics in Cognitive …, 2020 – Wiley Online Library
… and use more broadly. 1 Introduction. Why do languages look the way they do? Zipf (1949) proposed that distributional properties found in natural language were evidence of speaker–listener effort minimization. In his own words …

Children’s acquisition of discourse markers in English, Hindi, Mandinka and Spanish: Effects of optionality, grammaticalization and narrative elicitation
V Shukla, M Long, P Rubio-Fernandez – 2020 – psyarxiv.com
Page 1. 1 Children’s acquisition of discourse markers in English, Hindi, Mandinka and Spanish: Effects of optionality, grammaticalization and narrative elicitation Vishakha Shukla, Madeleine Long and Paula Rubio-Fernandez University of Oslo …

Children and adults as language learners: Rules, variation, and maturational change
EL Newport – Topics in cognitive science, 2020 – Wiley Online Library
… more consistent form. This is apparently what Simon does in natural language learning, and perhaps what children exposed to young languages or inconsistent language communities do as well. 4 Summary so far. Thus far we …

Geographical Information Systems and Textual Sources
LL Paterson, IN Gregory – Representations of Poverty and Place, 2019 – Springer
… This can be achieved using a technique called geoparsing which uses techniques from Natural Language Processing (NLP) to identify candidate … From Oral Histories to Visual Narratives: Re-presenting the Post-September 11 Experiences of the Muslim Women in the United …

Indexing across media
M Rooth, D Abusch – 2019 – ecommons.cornell.edu
… 2014. Temporal succession and aspectual type in visual narrative. The Art and Craft of Semantics: A Festschrift for Irene Heim 1. 9–29. Abusch, Dorit. to appear … 1975. Adverbs of quantification. In Formal Semantics of Natural Language, 178–188. Cambridge University Press …

Designing Narrative Slideshows for Learning Analytics
Q Chen, Z Li, TC Pong, H Qu – 2019 IEEE Pacific Visualization …, 2019 – ieeexplore.ieee.org
… The use cases further demonstrate the potential of employing this visual narrative approach in the e-learning context … This paper builds on this ideology as we propose a visual narrative solution to learning analytics in MOOCs …

Multimodality and Materiality: The Interplay of Textuality and Texturality in the Aesthetics of Film
JA Bateman – Poetics Today, 2019 – read.dukeupress.edu
… research include the semiotic foundations of multimodality and the use of empirical methods for their investigation, formal ontology, and computational linguistics (particularly natural language generation, discourse … A Multimodal Discourse Theory of Visual Narrative. .” Journal of …

Leveraging Machinima to Characterize Comprehension of Character Motivation
K Cassell, RM Young – International Conference on Interactive Digital …, 2019 – Springer
… The work described in this paper seeks to provide experimental insight into the ways that visual narrative making use of … Systems that view cinematic generation as narrative discourse construction use methods similar to those in the natural language generation community …

Computational Approaches to Comics Analysis
J Laubrock, A Dunst – Topics in Cognitive Science, 2020 – Wiley Online Library
… While focusing on comics analysis, these sections also illustrate modern techniques in digital image and natural language processing (NLP … Cohn and Magliano (this volume; see also Cohn, 2013b) propose a framework of the structures involved in visual narratives: A modality of …

The Inferential Semantics of Comics: Panels and Their Meanings
J Wildfeuer – Poetics Today, 2019 – read.dukeupress.edu
… devel- oped a linguistics-based view of the processes of film interpretation that draws on several well-articulated theories of dynamic semantics in the context of natural language pragmatics. Bateman and Wildfeuer (2014) provide an extension to visual narratives which also …

Integrating character networks for extracting narratives from multimodal data
OJ Lee, JJ Jung – Information Processing & Management, 2019 – Elsevier
JavaScript is disabled on your browser. Please enable JavaScript to use all the features on this page. Skip to main content Skip to article …

Picturing words: the semantics of speech balloons
E Maier – 2019 – philpapers.org
… 2015. Action starring narratives and events: Structure and inference in visual narrative comprehension. Journal of Cognitive Psychology 27(7). 812–828 … 2018. Iconic pragmatics. Natural Language & Linguistic Theory 36(3). 877–936. doi:10.1007/s11049-017-9392-x …

Caption as a Coherence Relation: Evidence and Implications
M Alikhani, M Stone – Proceedings of the Second Workshop on …, 2019 – aclweb.org
… To measure different verb forms, we used part- of-speech tags, parses, and dependency labels, computed using the SpaCy natural language pro- cessing toolkit (Honnibal and Johnson, 2015), to find verbs and their associated auxiliaries … 2013. Visual narrative structure …

CITE: a corpus of image-text discourse relations
M Alikhani, SN Chowdhury, G de Melo… – arXiv preprint arXiv …, 2019 – arxiv.org
… William Morrow, 1993. [11] Neil Cohn. Visual narrative structure … In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2-Volume 2, pages 674–682 …

Mental representations for language
R Jackendoff – Human language: From genes and brains to …, 2019 – books.google.com
Page 16. 2 Mental Representations for Language RAY JACKENDOFF 1. What Is a Mental Representation? Before discussing specifically linguistic representa- tions—phonological, syntactic, and semantic/conceptual structures …

Controllable attention for structured layered video decomposition
JB Alayrac, J Carreira… – Proceedings of the …, 2019 – openaccess.thecvf.com
… 2. Related work Attention control. Attention in neural network modelling has had a significant impact in natural language processing, such as machine translation, [6, 49] and vision [54], where it is implemented as a soft masking of features …

Dynamic Generation of Narrative Discourse that Communicates Character Decision Making
KB Cassell – 2019 – search.proquest.com
… One important aspect of visual narrative is character development … 2.2.1 Darshak Systems that view cinematic generation as narrative construction use methods similar to those in the natural language generation community …

CHAPTER THIRTEEN DIGITAL SPACES OF COLLABORATION IN AESTHETIC COUNTER NARRATIVES: HAMEDULLAH. THE ROAD HOME AND THE MIRROR …
A RIZZO – The Language of Art and Cultural Heritage: A …, 2020 – books.google.com
… The Road Home (2012) and German philosopher Kevin McElvaney’s The Mirror Project (2017), with the objective of highlighting how the unfolding of verbal and visual narratives can be treated as the principle and “inescapable”(Baker 2006: 9) mode by means of which …

Learning Hierarchical Representations of Stories by Using Multi-Layered Structures in Narrative Multimedia
O Lee, JJ Jung, JT Kim – Sensors, 2020 – mdpi.com
… the kinds of media. There have been a few studies [16,17] for learning hierarchical representations of utterances in natural language documents by extending Word2Vec [18] and Doc2Vec [19]. These studies commonly employed …

Neural Correlates of Event Segmentation
JM Zacks – Ten Lectures on the Representation of Events in …, 2020 – brill.com
Jump to Content Jump to Main Navigation …

2018 Index IEEE Transactions on Learning Technologies Vol. 11
S Adlof, E Aivaloglou, R Alarcon… – IEEE Transactions …, 2019 – ieeexplore.ieee.org
… 2018 342-347 Yin, C., see Shimada, A., TLT April -June 2018 165-178 Yousuf, B., and Conlan, O., Supporting Student Engagement Through Explor- able Visual Narratives; TLT July -Sept … March 2018 2-4 Supporting Student Engagement Through Explorable Visual Narratives …

Informal Logic and the Nature of Argument
CW Tindale – Windsor Studies in Argumentation, 2019 – windsor.scholarsportal.info
… And they all involve arguments embedded in natural language, requiring the student to extract the argument from the discourse and identify its … Is the propositional the “paradigm” case that anything (visual, narrative, and so forth) that purports to be an argument must reflect in …

Beyond the word and image: III. Neurodynamic properties of the semantic network
AL Jouen, N Cazin, S Hidot, C Madden-Lombardi… – BioRxiv, 2019 – biorxiv.org
… neural mechanisms. Written and visual narratives have been investigated separately using EEG in protocols … This can be seen during violation of the expectation or goal in visual narrative (Cohn et al 2014, Sitnikova et al 2008), and violation of semantic …

Emoji invasion: The semiotic
C Thurlow, V Jaroski – Visualizing Digital Discourse: Interactional …, 2020 – books.google.com
… 2013. The visual language of comics: Introduction to the structure and cognition of sequential images. London, UK: Bloomsbury. Cohn, Neil. 2016. The visual narrative reader. London, UK: Bloomsbury. De Certeau, Michel. 1984. The practice of everyday life.[S. Rendall, Trans.] …

Aognets: Compositional grammatical architectures for deep learning
X Li, X Song, T Wu – Proceedings of the IEEE conference on …, 2019 – openaccess.thecvf.com
… Xilai Li†, Xi Song§ and Tianfu Wu†,‡? Department of ECE† and the Visual Narrative Initiative‡, North Carolina State University {xli47, tianfu wu}@ncsu.edu, xsong.lhi@gmail.com … Grammar models are well known in both natural language processing and computer vision …

Multimodal Discourse on BRICS Produced by Diverse Stakeholders: Identifying Attitudes, Cultures and Perspectives
AA Atabekova, RG Gorbatenko… – Space and Culture …, 2020 – spaceandculture.in
… A multimodal discourse analysis of the interactive meaning in public service advertisement. Journal of Advances in Linguistics, 10, 1523-1534. Mannay, D. (2016) Visual, narrative and creative research methods. Application, Reflection and Ethics. Abingdon: Routledge …

CookGAN: Causality based Text-to-Image Synthesis
B Zhu, CW Ngo – Proceedings of the IEEE/CVF Conference …, 2020 – openaccess.thecvf.com
… Text-to-image synthesis aims to generate images from natural language description … Different from visual narrative sentences that describe the visual con- tent expected in an image, recipes provide ingredients as entities and cooking steps to textually instruct preparation of a dish …

Moral metaphor and gender in Arab visual culture: Debunking Western myths
A Abdel-Raheem – Social Semiotics, 2019 – Taylor & Francis
… “Conceptual Metaphor Theory, Blending Theory, and Other Cognitivist Perspectives on Comics.” In The Visual Narrative Reader, edited by N. Cohn, 89–114. London : Bloomsbury … 2013. “Natural Language Metaphors Covertly Influence Reasoning.” PLoS ONE 8 (1): e52961 …

Measuring centrality in film narratives using dynamic character interaction networks
P Jones, E Quinn, J Koskinen – Social Networks, 2020 – Elsevier
… to guide audience attention to salient narrative events from moment to moment” (Thompson 1999, 1). Work in this area has aimed to pair an analysis of film narratives with a deep understanding of narrative comprehension and how viewers process visual narratives, and has …

Computer Animation: A Medium for Improving Catechesis in the Archdiocese of Port of Spain the Digital Age
J Lindsay – 2019 – uwispace.sta.uwi.edu
… The story takes the form of a time-based visual narrative (Buchan vii). Jay Telotte suggests that the narrative unfolds in the … The main theme – the harmful effects of child sexual abuse – were illustrated throughout the visual narrative (with some supporting verbal dialogue) …

The historical present in Spanish and semantic/pragmatic structure
C Benavides – Pragmatics, 2019 – jbe-platform.com
… up’, mete ‘puts in’ …). Finally, it is important to discuss Neil Cohn’s work on visual narrative structure, in particular Cohn (2013, 2014a, b), given that these studies are based in part on the Parallel Architecture. According to Cohn …

formal term, used in rhetoric and literary criticism.” Its current prominence in
WO Hendricks – The Semiotic Web 1990: Recent Developments …, 2019 – books.google.com
… what- soever, whereas the substance of expression consists of the various media that can communicate stories (eg, a natural language such as … Hopefully the current interest in “visual narrative’will eventually resolve the issue of whether narrativity is intrinsically a nonverbal or …

Understanding retrospection: Blended joint attention and the multimodal construction of film flashbacks
A Gordejuela – Language and Literature, 2019 – journals.sagepub.com
The analysis of film discourse from a multimodal and cognitive perspective has shown in recent years that such an approach to the study of cinema is a very fruitful one. Among the various cinematic…

Understanding how language-specific and domain-general resources support comprehension
RD Kopatich, JP Magliano, KK Millis… – Discourse …, 2019 – Taylor & Francis
… was less affected by the load. However, Magliano, Larson, Higgs, and Loschky (2016) found that a working memory load disrupted bridging inferences in the context of visual narrative. They argued that the discrepancy in their …

Emergent stories written by children while coding: How do these emerge and are they valid compositions?
C Price, R Price-Mohr – Journal of Writing Research, 2019 – eprints.worc.ac.uk
… 3.2.1 Clause Structure and Process Types As mentioned in the Theoretical Framework, the basic quantum of natural language is the clause … Third, while the lexicon of code words is quite small, each of these can map onto a large number of words in natural language …

Narrative Virtual Reality Filmmaking: A Communication Conundrum
RJ Rome – 2019 – search.proquest.com
… Throughout this study, I will examine certain facets of this VR phenomenon in detail, through an assessment of how this technology specifically relates to and potentially will influence visual narrative media. The purpose of this study is to analyze the production process …

Eliciting Process Knowledge Through Process Stories
P Antunes, JA Pino, M Tate, A Barros – Information Systems Frontiers, 2019 – Springer
… To understand and address these gaps, we propose and evaluate process stories, a method to capture knowledge from end users based on organizational storytelling and visual narrative theories … 2012). Visual narrative uses our cognitive abilities to interpret visual information …

Extraction and analysis of fictional character networks: A survey
V Labatut, X Bost – ACM Computing Surveys (CSUR), 2019 – dl.acm.org
… who speaks to whom exactly. They detect not only proper nouns, but also nominals, including titles and placeholder names (eg, “bro,” “dude,” “sir”). 3.2.3 Visual Narratives. In audiovisual narratives, detecting character occurrences …

Linking and Layout: Exploring the Integration of Text and Visualization in Storytelling
Q Zhi, A Ottley, R Metoyer – Computer Graphics Forum, 2019 – Wiley Online Library
… spatially arranging (layout). Segel and Heer present a design space consisting of genres or types of narrative visualizations [SH10]. These genres are different approaches to communicating the visual narratives. One of the key …

Event perception and memory
JM Zacks – Annual Review of Psychology, 2020 – annualreviews.org
Events make up much of our lived experience, and the perceptual mechanisms that represent events in experience have pervasive effects on action control, language use, and remembering. Event represe…

The language network is recruited but not required for non-verbal semantic processing
AA Ivanova, Z Mineroff, V Zimmerer, N Kanwisher… – BioRxiv, 2019 – biorxiv.org
Page 1. 1 The language network is recruited but not required for non-verbal semantic processing Anna A. Ivanova1, Zachary Mineroff1, Vitor Zimmerer2, Nancy Kanwisher1,3, Rosemary Varley2, Evelina Fedorenko1,3,4 1Department …

Interactive guidelines: Public communication of data-based research in cities
S Trilles, C Granell, A Degbelo, D Bhattacharya – Plos one, 2020 – journals.plos.org
… guidelines. The main component of the IGT (Fig 1) is the “Visual Narrative Design” (VND). It allows to create/edit and compose the outline of a guideline … journalists. They use visual narrative styles to communicate scientific findings …

Military techno-vision: Technologies between visual ambiguity and the desire for security facts
R Saugmann – European Journal of International Security, 2019 – cambridge.org
Page 1. RESEARCH ARTICLE Military techno-vision: Technologies between visual ambiguity and the desire for security facts Rune Saugmann* University of Tampere, Finland *Corresponding author. Email: rune.saugmann@uta.fi …

Story-telling maps generated from semantic representations of events
L Tateosian, M Glatz, M Shukunobe – Behaviour & Information …, 2020 – Taylor & Francis
… 2013; Rishes et al. 2013; Cheong and Young 2015; O’Neill and Riedl 2014). At the same time, natural language processing is evolving to enable automatic extraction of spatial events from stories authored by humans (Li et al. 2006; Kordjamshidi, Otterlo, and Moens 2011) …

Towards critical multimodal discourse analysis: a response to Ledin and Machin
JA Bateman – Critical Discourse Studies, 2019 – Taylor & Francis
… His main fields of research range over computational linguistics (particularly natural language generation, discourse and dialogue), formal ontology, and the theory and practice of multimodality … A multimodal discourse theory of visual narrative …

Tale, performance, and culture in EFL storytelling with young learners: Stories meant to be told
L Masoni – 2019 – books.google.com
Page 1. LICIAMAS (ONI Tale, Performance, and Culture in EFL Storytelling with Young Learners Stories Mean? to be Told Page 2. Tale, Performance, and Culture in EFL Storytelling with Young Learners Page 3. Page 4. Tale, Performance …

Visual abstraction and exploration of large-scale geographical social media data
Z Zhou, X Zhang, Z Guo, Y Liu – Neurocomputing, 2020 – Elsevier
… social media data. Hong et al. [29] proposed a novel feature extraction approach named FLDA, by means of LDA based on an analogy between features in a flow field and words in natural language processing. A boosting-based …

Testing a Social Aggression and Translational Storytelling Intervention
EK Willer, JK Kellas – Communicating Mental Health: History …, 2019 – books.google.com
Page 112. Chapter Six Testing a Social Aggression and Translational Storytelling Intervention The Impact of Communicated Narrative Sense-Making on Adolescent Girls’ Mental Health Erin K. Willer Jody Koenig Kellas INTRODUCTION …

What is Symbolic Cognition?
RJ Planer – Topoi, 2019 – Springer
… 4 Talking to Ourselves A more interesting way of understanding “symbolic cogni- tion” is this: it is our conscious experience of internally-pro- duced, natural language sentences. Such cognition is sym- bolic simply because natural language is symbolic …

There Are Open Learner Models About!
S Bull – IEEE Transactions on Learning Technologies, 2020 – ieeexplore.ieee.org
… The learner model is usually automatically inferred and dynamically updated, for example, based on responses to questions, attempts at problem-solving, time viewing material or completing tasks, navigation routes, hints requested, natural language discussions about learning …

Literature and linguistics
N Fabb – Oxford Research Encyclopedia of Linguistics, 2019 – oxfordre.com
The linguistic study of literature addresses the ways in which language is differently organized in verbal art (literature): form is added to language, altered, attenuated, and differently grouped. These different kinds of organization are normatively subject to limits, some derived from …

Story embedding: Learning distributed representations of stories based on character networks
OJ Lee, JJ Jung – Artificial Intelligence, 2020 – Elsevier
JavaScript is disabled on your browser. Please enable JavaScript to use all the features on this page. Skip to main content Skip to article …

Semantic-Aware Visual Abstraction of Large-Scale Social Media Data With Geo-Tags
Z Zhou, X Zhang, X Zhou, Y Liu – IEEE Access, 2019 – ieeexplore.ieee.org
… In our previous work, a word2vec model widely used in the field of natural language processing(NLP) is employed to characterize the semantic correlation of OD flows, and a multi-objective blue noise sampling method is designed to select a subset of OD flows in the …

Modeling affective character network for story analytics
OJ Lee, JJ Jung – Future Generation Computer Systems, 2019 – Elsevier
… Different than the former two approaches, a few studies have attempted to analyze the stories of the narrative works directly by applying SNA (Social Network Analysis) methods and partially using NLP (Natural Language Processing) [[8], [9]] and image processing [[10], [11 …

Multimodal mental health analysis in social media
AH Yazdavar, MS Mahdavinejad, G Bajaj, W Romine… – Plos one, 2020 – journals.plos.org
… to automatically detect depression from social media content utilizing machine learning, deep learning, and natural language processing approaches … such as Instagram has attracted researchers’ attention to study individual’s behavior from their visual narratives—ranging from …

Interactive guidelines
S Trilles, C Granell, A Degbelo, D Bhattacharya – PLoS ONE, 2020 – run.unl.pt
… guidelines. The main component of the IGT (Fig 1) is the “Visual Narrative Design” (VND). It allows to create/edit and compose the outline of a guideline … journalists. They use visual narrative styles to communicate scientific findings …

Scenarios of countercultural representation: an analysis of inventory books’ visualities
L Henrickson – Visual Communication, 2019 – journals.sagepub.com
This article explores the social implications of the page layouts of ‘inventory books’, a series of non-fiction mass-market paperbacks published during the 1960s and 70s that employed eccentric pri…

Buddha Bot: The Exploration of Embodied Spiritual Machine in Chatbot
P Pataranutaporn, B Ngamarunchot… – Proceedings of the …, 2019 – Springer
… (3) The prior exploratory study on natural language processing (NLP) for giving answers from religious texts demonstrates a promising opportunity for using the … The visual narrative and the avatar image of the Buddha Bot is a combination of symbols from Buddhism and glitch …

Interactive guidelines: Public communication of data-based research in cities
S Trilles Oliver, C Granell, A Degbelo, D Bhattacharya – 2020 – repositori.uji.es
… guidelines. The main component of the IGT (Fig 1) is the “Visual Narrative Design” (VND). It allows to create/edit and compose the outline of a guideline … journalists. They use visual narrative styles to communicate scientific findings …

Curating Interest in Open Story Generation
M Behrooz – 2019 – escholarship.org
… 30 3.3.1 A Focus on Visual Narrative Comprehension … Recurrent Neural Networks (RNNs) [113] or Language Models [138], have prompted the use of evaluation metrics borrowed from the related field of Natural Language Processing (NLP), such …

Deep Learning for Dynamic Music Generation
JMC Simões – 2019 – estudogeral.sib.uc.pt
… June 2019 Page 2. Page 3. Abstract In the last decade, Deep Learning (DL) algorithms have been increasing their popularity in several fields such as computer vi- sion, speech recognition, natural language processing and many others …

Axiology and affording attitude in Australia’s ‘invasion’
YJ Doran – … Functional Linguistics and Legitimation Code Theory, 2019 – books.google.com
… Inscribed attitudes occur when there is a definite token of evaluation, such as crucial in one crucial area of natural language research. In contrast, invoked attitudes arise through a range of linguistic resources that offer various degrees of implicitness …

A survey of visualization for smart manufacturing
F Zhou, X Lin, C Liu, Y Zhao, P Xu, L Ren, T Xue… – Journal of …, 2019 – Springer
… We need to further consider how to integrate machine learning, natural language processing and other methods to facilitate the collection, extraction and identification of knowledge, so as to enable human–computer collaborative intelligent data analysis …

Why images cannot be arguments, but moving ones might
M Champagne, AV Pietarinen – Argumentation, 2019 – Springer
… He confessed that “I do not think I ever reflect in words: I employ visual diagrams […] because this way of thinking is my natural language of self-communion […]” (MS 619, p. 8).6 So, while other logicians around him were pioneering the symbolic notations we know today,7 …

Afterword: Legitimating Multimodality
JA Bateman – … : Disciplinary Thoughts and the Challenge of …, 2019 – books.google.com
… The chapter by Harnett on graphic novels also takes an expanded L1, presup- posing imports of Groensteen’s notion of braiding in visual narrative, discourse- oriented interpretative critiques, and accounts of ‘agentive readers’ and narrative functions …

Inferencing in deaf adolescents during sign-supported speech comprehension
E Mastrantuono, D Saldaña… – Discourse …, 2019 – Taylor & Francis
We tested the capability of deaf adolescents, including a group of users of cochlear implants, to generate inferences during spoken language comprehension and whether they benefited from the use of…

Morphology and memory: toward an integrated theory
R Jackendoff, J Audring – Topics in Cognitive Science, 2020 – Wiley Online Library
… It must be borne in mind that the general rules of a grammar are not invalidated by the existence of exceptions. … It is for this reason that the discovery of peculiarities and exceptions (which are rarely lacking, in a system of the complexity of a natural language) is generally so …

Slow Time and Sticky Media: Frank Beard’s Political Cartoons, Chalk Talks, and Hieroglyphic Bibles, 1860–1905
B Lindquist – Winterthur Portfolio, 2019 – journals.uchicago.edu

How infographics can enhance business
M Vassallo – 2019 – 157.138.7.91
Page 1. Master’s Degree in Management – Innovation & Marketing Final Thesis How infographics can enhance business Supervisor Ch. Prof. Fabrizio Panozzo Graduand Mattia Vassallo Matriculation number 871753 Academic Year 2018 / 2019 Page 2. Page 3 …

The Oxford Handbook of Event Structure
R Truswell – 2019 – books.google.com
… phrase manner—result complementarity millisecond neuter neutral In OUII) Historia Naturalis negation neutral natural language processing nominative … His books, The Visual Language of Comics (Bloomsbury, 2013) and The Visual Narrative Reader (Bloomsbury, 2016 …

Integration of a music generator and a song lyrics generator to create Spanish popular songs
M Navarro-Cáceres, HG Oliveira, P Martins… – Journal of Ambient …, 2020 – Springer
Page 1. Vol.:(0123456789) 1 3 Journal of Ambient Intelligence and Humanized Computing https://doi.org/10.1007/s12652-020-01822-5 ORIGINAL RESEARCH Integration of a music generator and a song lyrics generator to create Spanish popular songs …

The Status of Data Journalism in Iranian Media
M Salimi – Data Journalism in the Global South, 2019 – Springer
… Reviewing visual narrative in the design of survey websites … In Iran, companies such as “Life Web” are currently exploring, extracting and analyzing data that can be used for text mining, processing natural language, machine learning, statistical analysis of data, organizing and …

How Animacy and Verbal Information Influence V2 Sentence Processing: Evidence from Eye Movements
P De Swart, G Van Bergen – Open Linguistics, 2019 – degruyter.com
Page 1. Open Linguistics 2019; 5: 630–649 Peter de Swart*, Geertje van Bergen How Animacy and Verbal Information Influence V2 Sentence Processing: Evidence from Eye Movements https://doi.org/10.1515/opli-2019-0035 …

Information visualization: perception for design
C Ware – 2019 – books.google.com
… Page 10. Contents ix Animated versus Static Presentations ….. 344 Visual Narrative for Explanation ….. 346 Introduction and Initial Framing …

Situating social policy analysis: possibilities from quantitative and qualitative GIS
S Orford, B Webb – Towards a Spatial Social Policy: Bridging the …, 2019 – books.google.com
… Recent developments in natural language processing, fuzzy matching and querying, and crowd-sourced mapping products such as OSM are helping … Kwan, MP.(2008) From oral histories to visual narratives: re- presenting the post-September 11 experiences of Muslim women …

Children’s online use of word order and morphosyntactic markers in Tagalog thematic role assignment: an eye-tracking study
R Garcia, J Roeser, B Höhle – Journal of Child Language, 2020 – cambridge.org
Page 1. ARTICLE Children’s online use of word order and morphosyntactic markers in Tagalog thematic role assignment: an eye-tracking study Rowena GARCIA1,2* , Jens ROESER3, and Barbara HÖHLE2,4 1International …

Timeline design for visualising cultural heritage data
O Vane – 2020 – researchonline.rca.ac.uk
Page 1. Timeline design for visualising cultural heritage data OLIVIA VANE PhD Thesis, Innovation Design Engineering Royal College of Art 2019 Page 2. Timeline design for visualising cultural heritage data OLIVIA VANE PhD Thesis, Innovation Design Engineering …

Generating Concepts: Guiding Computational Conceptual Blending with Image Schemas
MM Hedblom – Image Schemas and Concept Invention, 2020 – Springer
Page 1. Chapter 6 Generating Concepts: Guiding Computational Conceptual Blending with Image Schemas Abstract In the previous chapters, the formal aspects of representing image schemas were dealt with. Likewise, the …

TalkTraces: real-time capture and visualization of verbal content in meetings
S Chandrasegaran, C Bryan, H Shidara… – Proceedings of the …, 2019 – dl.acm.org
… Such information can help moderators intervene and steer discussions towards a more desirable outcome. Recent advances in speech recogni- tion and natural language processing (NLP) have made the streaming capture of spoken information feasible …

The Meddle of the Muddle: How many captains does it take to steer a story and whose course is it anyway?
M Macneill – 2019 – repository.falmouth.ac.uk
… and bio-culturally aware. Being natural language and biofeedback the most evident ones. This transformed the human computer interaction in a seemingly pervasive and naturally perceived experience. The immersion of the …

Mood granularity for design: Introducing a holistic typology of 20 mood states
H Xue, PMA Desmet, SF Fokkinga – International Journal of …, 2020 – index.ijdesign.org
… The holistic mood typology was generated through two complementary studies. Study 1 was an initial exploration. We first employed a lexical approach2, which is a method that takes natural language as a valuable source for creating typologies of Page 4. www.ijdesign.org …

Open learner models in supporting self-regulated learning in higher education: A systematic literature review
D Hooshyar, M Pedaste, K Saks, Ä Leijen… – Computers & …, 2020 – Elsevier
JavaScript is disabled on your browser. Please enable JavaScript to use all the features on this page. Skip to main content Skip to article …

Structured Event Memory: A neuro-symbolic model of event cognition.
NT Franklin, KA Norman, C Ranganath… – Psychological …, 2020 – psycnet.apa.org
Humans spontaneously organize a continuous experience into discrete events and use the learned structure of these events to generalize and organize memory. We introduce the Structured Event Memory (SEM) model of event cognition, which accounts for human abilities in event …

Immersed into constant change: usage of generative systems in immersive & interactive installation art
A Bozkurt – 2019 – repository.bilkent.edu.tr
… system, such as a set of natural language rules, a computer program, a machine, or other procedural invention, which is set into motion with some degree of autonomy contributing to or resulting in a completed work of art.” (Galanter, 2003) …

Deep neural networks and kernel density estimation for detecting human activity patterns from Geo-tagged images: A case study of birdwatching on Flickr
C Koylu, C Zhao, W Shao – ISPRS International Journal of Geo …, 2019 – mdpi.com
… Deep learning, which allows extraction of high level abstractions in data by utilizing a hierarchical architecture [32], have been widely used in a variety of applications such as natural language processing, semantic parsing, transfer learning, and computer vision …

Events as intersecting object histories: A new theory of event representation.
G Altmann, Z Ekves – Psychological review, 2019 – psycnet.apa.org
We offer a new account of event representation based on those aspects of object representation that encode an object’s history, and which convey the distinct states that an object has experienced across time—minimally reflecting the before and after of whatever changes the object …

Or, the Question of Emoji as ‘Universal’Expression
JE Abel – Emoticons, Kaomoji, and Emoji: The Transformation of …, 2019 – books.google.com
Page 33. 2 Not Everyone s Or, the Question of Emoji as ‘Universal’Expression Jonathan E. Abel Katy Perry’s second video for her 2013 song “Roar” depicts the star waking to the sound of her phone, which she then grabs; immediately …

Sharing emotions: determining films’ evoked emotional experience from their online reviews
O Mokryn, D Bodoff, N Bader, Y Albo, J Lanir – INFORMATION RETRIEVAL …, 2020 – Springer
Page 1. Vol.:(0123456789) Information Retrieval Journal https://doi.org/10.1007/ s10791-020-09373-1 1 3 MINING ACTIONABLE INSIGHTS FROM ONLINE USER GENERATED CONTENT Sharing emotions: determining films …

The grammar of Chinese characters: Productive knowledge of formal patterns in an orthographic system
J Myers – 2019 – books.google.com
Page 1. Rºedge Studies in East Asian Linguistics THE GRAMMAR OF CHINESE CHARACTERS PRODUCTIVE KNOWLEDGE OF FORMAL PATTERNS IN AN 0RTHOGRAPHIC SYSTEM James Myers Page 2. The Grammar …

Analyzing the Intersections of Saxophone and Digital Media Through Media Theory
N Zoulek – 2019 – rave.ohiolink.edu
Page 1. ANALYZING THE INTERSECTIONS OF SAXOPHONE AND DIGITAL MEDIA THROUGH MEDIA THEORY Nicholas Zoulek A Dissertation Submitted to the Graduate College of Bowling Green State University in partial fulfillment of the requirements for the degree of …

Syntax and processing in Seediq: a behavioral study
H Ono, J Kim, M Sato, AA Tang, M Koizumi – JOURNAL OF EAST ASIAN …, 2020 – Springer
Page 1. Syntax and processing in Seediq: a behavioral study Hajime Ono1 · Jungho Kim2 · Manami Sato3 · Apay Ai-yu Tang4 · Masatoshi Koizumi5,6 Received: 1 August 2018 / Accepted: 27 February 2020 © The Author(s) 2020 …

The predictive value of Tagalog voice morphology in filler-gap dependency formation
JS Pizarro-Guevara, M Wagers – Frontiers in Psychology, 2020 – frontiersin.org
Research has shown that when processing filler-gap dependencies, comprehenders do not wait until they encounter all of the bottom-up information in the input. Instead, they use various types of linguistic information to predictively posit a gap that would allow the dependency to …

Maps of the Moon: Lunar Cartography from the Seventeenth Century to the Space Age
TAS Haddad – Brill Research Perspectives in Map History, 2019 – brill.com
Jump to Content Jump to Main Navigation. Languages. Languages: English; ??; français; Deutsch. User Account: Login; Not registered? Create Account. Viewed / Saved (0). My Searches (0). Cart (0). brill. Menu: Browse; Subjects …

Reading and Mapping Fiction: Spatialising the Literary Text
S Bushell – 2020 – books.google.com
… She asserts: The insertion of spatial diagrams into the verbal text produces a creative interplay between the verbal and the visual narrative which is generated by the juxtaposition of the two media. Shifting between them [are] attentive readers …

Data-driven Storytelling for Casual Users
Z Zhao – 2019 – search.proquest.com
… 2], often using visual media [149,150]. A visual narrative is a story told primarily using visual media, such as illus- trations, photographs, animations, video, and—now— visualization [149, 150]. In particular, visualization has a …

Understanding associative vs. abstract pictorial relations: An ERP study
L Zucker, L Mudrik – Neuropsychologia, 2019 – Elsevier
JavaScript is disabled on your browser. Please enable JavaScript to use all the features on this page. Skip to main content Skip to article …

Forms of stimuli and their effects on idea generation in terms of creativity metrics and non-obviousness
Y Borgianni, L Maccioni, L Fiorineschi… – International Journal of …, 2020 – Taylor & Francis
… The Retriever (Han et al., 2018b); for this, idea generation is supported by analogies triggered by ontologies. In He et al. (2019), stimuli are extracted as a result of submitting crowdsourced material to a natural language processing system …

Prolegomena to music semantics
P Schlenker – Review of Philosophy and Psychology, 2019 – Springer
… Despite these initial qualms, we explore the view that music has a semantics, albeit a very different one from natural language: first, music semantics usually conveys much more abstract information than language does; second, and more importantly, its informational content is …

Information Visualization in the Era of Innovative Journalism
C Toural-Bran, Á Vizoso, S Pérez-Seijo… – 2020 – books.google.com
… His most recent obsessions are emotional connections in data visualization, automation of data-driven visual narratives, and new formats … Jones, 2019) and of complex stories drafted from machines capable of processing data and using Natural Language Generation (Caswell …

DaPIS: a Data Protection Icon Set to Improve Information Transparency under the GDPR
A Rossi, M Palmirani – Knowledge of the Law in the Big …, 2019 – gdprbydesign.cirsfid.unibo.it
… The description of legal information in a machine-interpretable format also allows automated reasoning on the legal text (eg to draw inferences to match expressions in natural language to the corresponding ontological instance) …

The Deaf Lens: Making Meaning through Photoliteracy
CE Bolen – 2019 – search.proquest.com
… This study utilized a conceptual framework comprised of aesthetic inquiry and visual narrative inquiry and multimodal social semiotics according to Kress … born. Their exposure to the natural language of their community is limited given the auditory …

Frontline employees automated social presence (ASP) cocreation orientation
G Laud, C Ranaweera, C Leo… – The 16th International …, 2019 – ecite.utas.edu.au
Page 1. QUIS16Advancing Service Research and Practice JUNE 10-13 2019 KARLSTAD SWEDEN Edited by: BO EDVARDSSON ANDERS GUSTAFSSON MARY JO BITNER ROHIT VERMA Page 2. PREFACE QUIS is one …

The Spatial Historian: Creating a Spatially Aware Historical Research System
JP SCHINDLING – 2020 – researchrepository.wvu.edu
Page 1. Graduate Theses, Dissertations, and Problem Reports 2020 The Spatial Historian: Creating a Spatially Aware Historical Research System JAMES P. SCHINDLING jpschindling@mail.wvu.edu Follow this and additional works at: https://researchrepository.wvu …

Implementation of a web-based platform for Data Analysis, Visualization and Machine Learning
K Mouratidis – 2020 – repository.ihu.edu.gr
Page 1. DECEMBER 2019 THESSALONIKI – GREECE Implementation of a web- based platform for Data Analysis, Visualization and Machine Learning Konstantinos Mouratidis SID: 8180012 Supervisor: Prof. Ioannis Magnisalis Supervising Committee Members: Assoc. Prof …

Human Movement Patterns of Different Racial-Ethnic and Economic Groups In US Top 50 Cities: What Can Social Media Tell Us About Segregation?
M Wu – 2019 – minds.wisconsin.edu
Page 1. Human Movement Patterns of Different Racial-Ethnic and Economic Groups In US Top 50 Cities: What Can Social Media Tell Us About Segregation? Meiliu Wu Advisor: Qunying Huang A thesis submitted in partial fulfillment of the requirements for the degree of …

History of the International Telecommunication Union: Transnational techno-diplomacy from the telegraph to the Internet
A Fickers, G Balbi – 2020 – books.google.com
Page 1. History of the International Telecommunication Union Page 2. Innovation and Diplomacy in Modern Europe Volume 1 Page 3. History of the International Telecommunication Union Transnational techno-diplomacy from …

Love in Lyrics: An Exploration of Supporting Textual Manifestation of Affection in Social Messaging
T Kim, JS Lee, Z Peng, X Ma – Proceedings of the ACM on Human …, 2019 – dl.acm.org
Page 1. 79 Love in Lyrics: An Exploration of Supporting Textual Manifestation of Affection in Social Messaging TAEWOOK KIM, Hong Kong University of Science and Technology, Hong Kong SAR JUNG SOO LEE, Korea University …

A Quantitative Portrait of Wikipedia’s High-Tempo Collaborations during the 2020 Coronavirus Pandemic
BC Keegan, C Tan – arXiv preprint arXiv:2006.08899, 2020 – arxiv.org
Page 1. TBD A Quantitative Portrait of Wikipedia’s High-Tempo Collaborations during the 2020 Coronavirus Pandemic BRIAN C. KEEGAN, Department of Information Science, University of Colorado Boulder, United States CHENHAO …