Visual Narrative & Natural Language 2018


Notes:

  • Computational visual storytelling
  • Virtual storyteller
  • Visual narratology
  • Visual storytelling

Wikipedia:

References:

See also:

AI Storytelling Bibliography | Computational Narrative 2017 | Neural Mind Mapping 2017 | SHRDLU 2018 | Text-to-Image & Natural Language 2017 | Virtual Storyteller & Natural Language Processing | Virtual Storytelling 2017


No metrics are perfect: Adversarial reward learning for visual storytelling
X Wang, W Chen, YF Wang, WY Wang – arXiv preprint arXiv:1804.09160, 2018 – arxiv.org
… Recently, a more sophisticated dataset for visual storytelling (VIST) has been released to explore a more human-like understanding of … The naive overlap-counting methods are not able to reflect many semantic properties in natural language, such as coherence, expressiveness …

A pipeline for creative visual storytelling
SM Lukin, R Hobbs, CR Voss – arXiv preprint arXiv:1807.08077, 2018 – arxiv.org
… Computational visual storytelling produces a textual description of events and interpreta- tions depicted in a sequence of images. These texts are made possible by advances and cross- disciplinary approaches in natural language processing, generation, and computer vision …

A skeleton-based model for promoting coherence among sentences in narrative story generation
J Xu, X Ren, Y Zhang, Q Zeng, X Cai, X Sun – arXiv preprint arXiv …, 2018 – arxiv.org
… We use the recently introduced visual storytelling dataset (Huang et al., 2016) in our experiments … The K in Equa- tion 5 is set to 1. Due to the lack of annotated enti- ties and dependency parsing labels, we use a pop- ular natural language processing toolkit, Spacy2, to extract …

Edit me: A corpus and a framework for understanding natural language image editing
R Manuvinakurike, J Brixey, T Bui, W Chang… – Proceedings of the …, 2018 – aclweb.org
… of distractors (Paetzel et al., 2015; de Vries et al., 2016), visual question answer- ing (Antol et al., 2015), visual storytelling (Huang et al., 2016 … However, to our knowledge, no work has yet attempted to tackle the specific task of automated image editing through natural language …

Exploring coherence in visual explanations
M Alikhani, M Stone – 2018 IEEE Conference on Multimedia …, 2018 – ieeexplore.ieee.org
… [24] use similar tech- niques to interpret and solve natural language algebra prob- lems … Finally, we draw on work on the interpretation of visual narrative [17, 1, 8]. This work analyzes images as show- ing general kinds of things (attributive content, according to [17]) …

Once upon a spacetime: Visual storytelling in cognitive and geotemporal information spaces
E Mayr, F Windhager – ISPRS International Journal of Geo-Information, 2018 – mdpi.com
… section, we discuss hybrid visualization techniques that integrate geographical and temporal data aspects—and thereby, facilitate visual storytelling in a … By the means of natural language processing techniques (Appendix C), a variety of entities and relations are extracted from …

Deep learning in natural language generation from images
X He, L Deng – Deep Learning in Natural Language Processing, 2018 – Springer
… 2015), visual storytelling (Huang et al. 2016), visually grounded dialog (Das et al. 2017), and image synthesis from text description (Zhang et al. 2017). The progress in multimodal intelligence involving natural language is critical for building general artificial intelligence abilities …

Look before you leap: Bridging model-free and model-based reinforcement learning for planned-ahead vision-and-language navigation
X Wang, W Xiong, H Wang… – Proceedings of the …, 2018 – openaccess.thecvf.com
… assistants. Vision-and-Language Navigation (VLN) is the task of training an embodied agent which has the first-person view as humans to carry out natural language ? Equal contribution Page 2. 2 X. Wang et al. (1) (2) (3) (4) (5) (6) …

Stories for images-in-sequence by using visual and narrative components
M Smilevski, I Lalkovski, G Madjarov – International Conference on …, 2018 – Springer
… Huang, TK, et al.: Visual storytelling. CoRR abs/1604.03968 (2016). http://arxiv.org/abs/ 1604.03968. 14 … Pennington, J., Socher, R., Manning, CD: GloVe: global vectors for word representation. In: Empirical Methods in Natural Language Processing (EMNLP), pp …

Show, reward and tell: Automatic generation of narrative paragraph from photo stream by adversarial training
J Wang, J Fu, J Tang, Z Li, T Mei – Thirty-Second AAAI Conference on …, 2018 – aaai.org
… puter vision and natural language processing. In this pa- per, we refer to this task as “visual storytelling”, which can specifically generate one natural language sentence for each photo. This is challenging because of the difficulty …

Contextualize, show and tell: a neural visual storyteller
D Gonzalez-Rico, G Fuentes-Pineda – arXiv preprint arXiv:1806.00738, 2018 – arxiv.org
… years, generating text from im- ages and videos has gained a lot of attention in the Computer Vision and Natural Language Process- ing … which may reflect experiences, rather than just listing objects and their attributes, has given rise to tasks such as visual storytelling (Huang et …

Aesop: A Visual Storytelling Platform for Conversational AI.
T Meo, A Raghavan, DA Salter, A Tozzo… – IJCAI, 2018 – pdfs.semanticscholar.org
… com Abstract We present a new collaborative visual storytelling platform, Aesop, for direction and animation. Ae- sop … ing structures. Their system combines natural language un- derstanding, planning, and dialogue management. It …

In defense of a “grammar” in the visual language of comics
N Cohn – Journal of Pragmatics, 2018 – Elsevier
… 2. Different basic narrative schemas within Visual Narrative Grammar … the notion of ‘grammar’…is in many respects deeply problematic” (Bateman and Wildfeuer, 2014a, p. 373) and subsequently that “Very few of the properties exhibited by grammars of natural language …

Adversarial Learning for Visual Storytelling with Sense Group Partition
L Mo, C Zhang, Y Ji, Z Hu – Asian Conference on Computer Vision, 2018 – Springer
… 1 Introduction. Generating a natural story for an ordered image sequence, known as visual storytelling, is a challenging task in the field of both computer vision and natural language processing. Compared with image caption …

Managing Multitasking in Software Development Tasks Using Visual Analytics and Machine Learning
Z Shakeri Hossein Abad – 2018 – prism.ucalgary.ca
… psychology, information visualization, and machine learning researches. Moreover, recent advances in visual analytics, eg visual storytelling, natural language processing, and clas- sification methods offer an opportunity to advance the understanding of and support for …

The Case for Systematically Derived Spatial Language Usage
B Dorr, C Voss – Proceedings of the First International Workshop on …, 2018 – aclweb.org
… 2018. A pipeline for creative visual storytelling. In NAACL 2018 StoryNLP … 2018. Evaluating robot behavior in re- sponse to natural language. In HRI ’18 Companion: ACM/IEEE International Conference on Human- Robot Interaction Companion …

A System for Automated Image Editing from Natural Language Commands
J Brixey, R Manuvinakurike, N Le, T Lai… – arXiv preprint arXiv …, 2018 – arxiv.org
… Visual storytelling … Image-grounded conversations: multimodal context for natural question and response generation. In Proceed- ings of the International Joint Conference on Natural Language Processing (IJCNLP), Taipei, Taiwan …

Meetingvis: Visual narratives to assist in recalling meeting context and content
Y Shi, C Bryan, S Bhamidipati, Y Zhao… – IEEE transactions on …, 2018 – ieeexplore.ieee.org
… This visual-based approaches can also potentially enhance the productivity of both individuals and the whole team. Index Terms—Design study, information visualization, meeting summarization, natural language processing, visual narrative, voice recognition Ç …

Swag: A large-scale adversarial dataset for grounded commonsense inference
R Zellers, Y Bisk, R Schwartz, Y Choi – arXiv preprint arXiv:1808.05326, 2018 – arxiv.org
… In this paper, we introduce the task of grounded com- monsense inference, unifying natural language inference and commonsense reasoning. We present Swag, a new dataset with 113k multiple choice questions about a rich spec- trum of grounded situations …

Coreference and disjoint reference in the semantics of narrative dance
P Patel-Grosz, PG Grosz, T Kelkar… – Proceedings of Sinn …, 2018 – researchgate.net
… disjoint reference is a very basic and fundamental distinction in natural language semantics … As a figurative dance, it is more similar to language (and silent visual narrative) than other dance forms (such as ballet, contemporary or street dance), yet more conventionalized than …

Proceedings of the First Workshop on Storytelling
M Mitchell, TH Huang, F Ferraro, I Misra – Proceedings of the First …, 2018 – aclweb.org
… The Visual Storytelling challenge provided teams with the VIST visual storytelling dataset1 to generate stories from sequences of five images … Building AI systems that can process natural language input, comprehend it, and generate an engaging and contextually relevant output …

Customized Image Narrative Generation via Interactive Visual Question Generation and Answering
A Shin, Y Ushiku, T Harada – Proceedings of the IEEE …, 2018 – openaccess.thecvf.com
… Natural Language Processing: We are now given mul- tiple pairs of questions and answers about the image … Regions are further ex- tracted, visual questions are generated and answered, and rule-based natural language processing techniques are ap- plied to organize them …

Deep reinforcement learning for NLP
WY Wang, J Li, X He – Proceedings of the 56th Annual Meeting of the …, 2018 – aclweb.org
… Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Li- hong Li, Li Deng, and Mari Ostendorf. 2016a. Deep reinforcement learning with a natural language ac- tion space. ACL. Page 3. 21 … 2018a. No metrics are perfect: Adversarial reward learning for visual storytelling. In ACL …

LitStoryTeller+: an interactive system for multi-level scientific paper visual storytelling with a supportive text mining toolbox
Q Ping, C Chen – Scientometrics, 2018 – Springer
… previous work (Ping and Chen 2017), we have proposed LitStoryTeller, an interactive system that supports visual storytelling of a … Related work”, we review existing work on two areas, namely multiple/single document visualization, and natural language processing algorithms …

Vision And Natural Language For Creative Applications, And Their Analysis
V Manjunatha – 2018 – drum.lib.umd.edu
… Recent advances in machine learning, specifically problems in Computer Vision and Natural Language, have involved training deep neural networks with enormous amounts of data … Visual narrative is often a combination of explicit information and judicious …

Learning to color from language
V Manjunatha, M Iyyer, J Boyd-Graber… – arXiv preprint arXiv …, 2018 – arxiv.org
… We introduce the task of col- orization from natural language, a previously unex- plored source of color specifications. Many use cases for automatic colorization in- volve images paired with language … 2016. Visual storytelling …

A dataset for telling the stories of social media videos
S Gella, M Lewis, M Rohrbach – … Empirical Methods in Natural Language …, 2018 – aclweb.org
… One goal of auto- matically understanding and describing such videos with natural language is to generate multi-sentence descriptions which convey the story, making them accessible to situationally (eg bandwidth) or phys- ically (“blind”) disabled people … Visual storytelling …

GLAC Net: GLocal Attention Cascading Networks for Multi-image Cued Story Generation
T Kim, MO Heo, S Son, KW Park, BT Zhang – arXiv preprint arXiv …, 2018 – arxiv.org
… 2016. Visual storytelling … In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), vol- ume 1, pages 1681–1691 …

Video Storytelling
J Li, Y Wong, Q Zhao, MS Kankanhalli – arXiv preprint arXiv:1807.09418, 2018 – arxiv.org
… Driven by the advent of large datasets pairing images and videos with natural language descriptions, encouraging progress has been made in both image and video captioning task … Therefore, in this paper we introduce a new problem: visual storytelling of long videos …

Conversational image editing: Incremental intent identification in a new dialogue task
R Manuvinakurike, T Bui, W Chang… – Proceedings of the 19th …, 2018 – aclweb.org
… Here the goal is to provide a natural language an- swer, given an image and a natural language ques- tion about the image … (2017) extended this work to natural language question and response generation in the context of image-grounded conversations …

Seethevoice: Learning from Music to Visual Storytelling of Shots
WL Wei, JC Lin, TL Liu, YH Yang… – … on Multimedia and …, 2018 – ieeexplore.ieee.org
… To model the shot-based visual storytelling of a piece of mu- sic, MF-RNNs is constructed to not only individually model the extracted music … [9] S. Venugopalan, H. Xu, J. Donahue, M. Rohrbach, R. Mooney, and Saenko K., “Translating videos to natural language using deep …

From image to language and back again
A Belz, TL Berg, L Yu – Natural Language Engineering, 2018 – cambridge.org
Page 1. Natural Language Engineering 24 (3): 325–362 … Work in computer vision and natural language processing involving images and text has been experiencing explosive growth over the past decade, with a particular boost coming from the neural network revolution …

DialEdit: Annotations for Spoken Conversational Image Editing
R Manuvinakurike, J Brixey, T Bui, W Chang… – Proceedings 14th Joint …, 2018 – aclweb.org
… These requests are formulated in an abstract manner using natural language (Ex: “I love this photo from our trip to Rome … Furthermore, Huang et al. (2016) built a data set of images with corresponding descriptions in sequence, for the task of visual storytelling …

Venice Through the Lens of Instagram: A Visual Narrative of Tourism in Venice
L Rossi, E Boscaro, A Torsello – … of the The Web Conference 2018, 2018 – dl.acm.org
… 2018. Venice through the Lens of Instagram: A Visual Narrative of Tourism in Venice … More interestingly, one could use natural language processing techniques to understand the mood associated with a certain picture, adding an additional layer of analysis …

Statistical language modelling for automatic story generation
M Vicente, C Barros, E Lloret – Journal of Intelligent & Fuzzy …, 2018 – content.iospress.com
… of the 9th International Natural Language Generation Conference, Association for Comutational Linguistics (2016), 26–30. [2]. Akimoto T. , Ono J. , Ogata T. , in: Narrative Forest: An Automatic Narrative Generation System with a Visual Narrative Operation Mechanism, The 6th …

Generating natural language summary for image sets
A Abdu Jyothi – 2018 – summit.sfu.ca
Page 1. Generating Natural Language Summaries for Image Sets by Akash Abdu Jyothi … Akash Abdu Jyothi Master of Science (Computing Science) Generating Natural Language Summaries for Image Sets Chair: Parmit Chilana Assistant Professor Date Defended …

Comic Books: A Learning Tool for Meaningful Acquisition of Written Sign Language.
C Guimarães, MC Oliveira Machado… – Journal of Education and …, 2018 – ERIC
… addresses the open research problem of teaching the Deaf to acquire the written form of SL by proposing visual narrative as a … people have the right to access all human possibilities, such as symbolic communications, social interactions and the use of SL, their natural language …

Learning to Listen: Critically Considering the Role of AI in Human Storytelling and Character Creation
A Kasunic, G Kaufman – Proceedings of the First Workshop on …, 2018 – aclweb.org
… Just as recent work in natural language process- ing has criticized and sought ways to rectify the amplification of negative biases (eg gender bi- ases) in NLP techniques (Dwork et al., 2012; Zhao et al., 2017; Bolukbasi et al., 2016; Voigt et al., 2017), AI storytelling has the …

A Knowledge-Grounded Multimodal Search-Based Conversational Agent
S Agarwal, O Dusek, I Konstas, V Rieser – arXiv preprint arXiv:1810.11954, 2018 – arxiv.org
… vi- sion and language, such as image captioning (Xu et al., 2015; Vinyals et al., 2015; Karpathy and Fei- Fei, 2015), visual storytelling (Huang et … Cho et al., 2014; Sutskever et al., 2014; Bahdanau et al., 2015) have become the de-facto standard for natural language generation …

Quality signals in generated stories
M Sagarkar, J Wieting, L Tu, K Gimpel – Proceedings of the Seventh Joint …, 2018 – aclweb.org
… the context. Neural networks are increasingly employed for natural language generation, most often with encoder-decoder architectures based on recurrent neural networks (Cho et al., 2014; Sutskever et al., 2014). However …

Competitive Analysis System for Theatrical Movie Releases Based on Movie Trailer Deep Video Representation
M Campo, CK Hsieh, M Nickens, JJ Espinoza… – arXiv preprint arXiv …, 2018 – arxiv.org
… A previous version of Merlin that uses natural language plot descrip … approaches for movie trailers that iden- tify appropriate video representations and that take into ac- count event sequence or higher order constructs like cine- matography and visual storytelling are expected …

Learning to Color from Language
M Iyyer, V Manjunatha, J Boyd-Graber… – … American Association of …, 2018 – par.nsf.gov
… We introduce the task of col- orization from natural language, a previously unex- plored source of color specifications. Many use cases for automatic colorization in- volve images paired with language … 2016. Visual storytelling …

Let’s Fake News’
L McCarthy – Proceedings of the Twelfth International Conference …, 2018 – researchgate.net
… ACM Classification Keywords • Collaborative and social computing • Visualization • Applied computing • Media arts • Natural Language Processing … and performer collaborated & conversed through the 2nd-screen, leading to an emergent audio-visual narrative; an aesthetic well …

Neural event extraction from movies description
A Tozzo, D Jovanovi?, MR Amer – Proceedings of the First Workshop on …, 2018 – aclweb.org
… Our model serves as an intermediate step towards ques- tion answering systems, visual storytelling, and story completion tasks. We evaluate our approach on MovieQA dataset. 1 Introduction … 2009. Natural Language Processing with Python. OReilly Media Inc …

Learning to Globally Edit Images with Textual Description
H Wang, JD Williams, SB Kang – arXiv preprint arXiv:1810.05786, 2018 – arxiv.org
… To extract meaningful information from text, they use the attention mechanism [8]. They demonstrate two editing tasks of image segmenta- tion and colorization with natural language; different losses are used for training the different tasks. The work of Seitaro et al …

Robot experience stories: First person generation of robotic task narratives in SitLog
JG Flores, I Meza, É Colin, C Gardent… – Journal of Intelligent …, 2018 – content.iospress.com
… J. , Girshick R. , He X. , Kohli P. , Batra D. , Zitnick CL , Parikh D. , Vanderwende L. , Galley M. and Mitchell M. , Visual Storytelling … Hemachandra S. , Homberg B. , Tellex S. and Teller S. , A framework for learning semantic maps from grounded natural language descriptions, Int J …

Understanding visual scenes
C Silberer, J Uijlings, M Lapata – Natural Language Engineering, 2018 – cambridge.org
… natural language answer given a question about an image, eg, by predicting the form the answer might take (Kafle and Kanan 2016) … Schuster et al. (2015) extend this approach with a parser which maps dependency-parsed natural language descriptions to scene graphs …

Proceedings 14th Joint ACL-ISO Workshop on Interoperable Semantic Annotation
H Bunt – Proceedings 14th Joint ACL-ISO Workshop on …, 2018 – aclweb.org
… These requests are formulated in an abstract manner using natural language (Ex:“I love this photo from our trip to Rome … Furthermore, Huang et al.(2016) built a data set of images with corresponding descriptions in sequence, for the task of visual storytelling …

Towards Understanding End-of-trip Instructions in a Taxi Ride Scenario
D Karkada, R Manuvinakurike, K Georgila – arXiv preprint arXiv …, 2018 – arxiv.org
… 2010. A linguistic ontology of space for natural language processing. Artificial Intelligence, 174(14):1027–1071 … 2016. Visual storytelling. In Proceedings of NAACL–HLT, pages 1233–1239, San Diego, California, USA. Page 10 …

Children’s Story Books: Introducing Cultural Hybridity, Shaping Intercultural Sensitivity for Foreign Language Young Learners (An Observation to Gramedia Books in …
MG Maru, A Tulus, EM Dukut, N Liando… – … on Social Sciences …, 2018 – atlantis-press.com
… children; in terms of providing a motivating, meaningful context for language learning, since children are naturally drawn to stories, and presenting natural language, language at … [8] M. Popova, “A Brief History of Children’s Picture Books and the Art of Visual Storytelling,” Atl., vol …

Images2Poem: Generating Chinese Poetry from Image Streams
L Liu, X Wan, Z Guo – 2018 ACM Multimedia Conference on Multimedia …, 2018 – dl.acm.org
… Machines can generate natural language descriptions [5, 27, 28], dialogue responses [4] and stories [43] from visual content. It is expected to generate much more diversified and creative texts for … Visual storytelling tries to tell a coherent story with an image stream as input …

Grounding natural language phrases in images and video
BA Plummer – 2018 – ideals.illinois.edu
… Page 2. GROUNDING NATURAL LANGUAGE PHRASES IN IMAGES AND VIDEO BY … where the goal is to localize an entity known to exist in an image when provided with a natural language query. To address this task, I introduce a model which learns a set of …

Visual representations of goods and services through their brandings: The semiotic foundations of a language of brands
F Bobrie – Recherche et Applications en Marketing (English …, 2018 – journals.sagepub.com
While marketing literature has been concerned primarily with the concept of the ‘brand’, it has neglected the study of branding in its most concrete figurative …

Narrative visualizations: using interactive data stories in strategic brand communication
T Proskurina – 2018 – lup.lub.lu.se
… Keywords: narrative visualization, infographics, data visualization, brand communication, visual communication, visual storytelling. Page 3 … sign systems. Music, math symbols, and natural language make up the first group of signs, related to auditory information …

Creating Digital Collages Inspired by English Texts
V Kannan, N Khuri – 2018 Thirteenth International Conference …, 2018 – ieeexplore.ieee.org
… I., Agrawal A., Devlin J., Girshick RB, He X., Kohli P., Batra D., Zitnick CL, Parikh D., Vanderwende L., Galley M., and Mitchell M. Visual storytelling … [37] Pirani Z., Amru R., Thakur A., Tapadia S., and Wagh M. Article: Image illustration of text using natural language processing …

Multi-task Learning for Universal Sentence Representations: What Syntactic and Semantic Information is Captured?
WU Ahmad, X Bai, Z Huang, C Jiang, N Peng… – CoRR, 2018 – researchgate.net
… lan- guage inference (NLI) which determines whether a natural language hypothesis can be inferred from a natural language premise … We conduct the semantic analysis experiment based on the ROC- Stories (Mostafazadeh et al., 2016) and the Visual Storytelling (VIST) (Huang …

Storytelling and visualization: An extended survey
C Tong, R Roberts, R Borgo, S Walton, R Laramee… – Information, 2018 – mdpi.com
… It can create story plots automatically based on the actions of intelligent agents living in a virtual story world. The derived plots are converted to natural language, and presented to the user by an embodied agent that makes use of text-to-speech …

Journalism, media and technology trends and predictions 2018
N Newman – 2018 – ora.ox.ac.uk
… Mobile and Visual Storytelling … Visual storytelling has continued to become more important, particularly in audio this year: some of radio’s biggest hits during the UK election came through social video with Radio 4’s Woman’s Hour and Nick Ferrari’s LBC interviews …

Deep attentive sentence ordering network
B Cui, Y Li, M Chen, Z Zhang – … Empirical Methods in Natural Language …, 2018 – aclweb.org
Page 1. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4340–4349 Brussels, Belgium, October 31 – November 4, 2018 … 1 Introduction Modeling a coherent text is one of the key prob- lems in natural language processing …

Organizational Research: Storytelling in Action
DM Boje – 2018 – content.taylorfrancis.com
Page 1. Page 2. ‘Organizational research methods’ (ORM) are making an ontological turn by studying the nature of Being, becoming, and the meaning of existence in the world. For example, without ontology, there is no ‘ground’ and no ‘theory’ in Grounded Theory (GT) …

Eliciting and modeling business process stories
D Simões, P Antunes, L Carriço – Business & Information Systems …, 2018 – Springer
… Furthermore, we integrated the concept of process story with a visual narrative scheme inspired by comic strips, using textual/visual elements and … During S-BPM analysis, natural language and its structuring elements are used to identify activities and the intervening actors and …

Generating Description for Sequential Images with Local-Object Attention Conditioned on Global Semantic Context
J Su, C Lin, M Zhou, Q Dai, H Lv – Proceedings of the Workshop on …, 2018 – aclweb.org
… Such a task is easy to humans but highly non-trivial for machines as it requires not only capturing the semantic information from images (eg, objects and actions) but also needs to gener- ate human-like natural language descriptions … 2016. Visual storytelling …

Learning Generative Models of Social Interactions with Humans-in-the-Loop
D Feng, P Sequeira, E Carstensdottir… – 2018 17th IEEE …, 2018 – ieeexplore.ieee.org
… R. Socher, and CD Manning, “Glove: Global vectors for word representation,” in Empirical Methods in Natural Language Processing (EMNLP … Wang, W. Chen, Y.-F. Wang, and WY Wang, “No metrics are perfect: Adversarial reward learning for visual storytelling,” in Proceedings …

Narrative Visualization of Sequential Data Models
MK Jaama – research.tue.nl
… Page 23. 22 3. Methodology In this section focus on the key considerations related to creating a visual narrative solution that … key drivers of the output. Then we look into the machine learning pipeline to identify the crucial parts that should be presented in the visual narrative …

A survey of comics research in computer science
O Augereau, M Iwata, K Kise – Journal of Imaging, 2018 – mdpi.com
… To fully analyze and understand the content of comics, we need to consider natural language processing to understand the story and the dialogues; and computer vision to understand the line drawings, characters, locations, actions, etc …

Design thinking as a dynamic methodology for information science
N Nakano, JADB Oliveira… – Information and Learning …, 2018 – emeraldinsight.com
… Visual storytelling Another way to represent an existing problem and what factors are in play, we can create a visual storytelling piece that … stage of the ideation consisted in the application of faceted analysis for the treatment and categorization of terms in natural language in the …

Once Upon an Assessment
S Culligan – 2018 – digitalcommons.lesley.edu
… to be done around visual storytelling and the researcher acknowledges this fact, their study did not have a comparison or control group to compare the results of the visual storytelling group to, and Drew et al … Children have a natural language of play and Psychodrama …

Cohesion in Comics and Graphic Novels: An Empirical Comparative Approach to Transmedia Adaptation in City of Glass
CI Tseng, JA Bateman – Adaptation, 2018 – academic.oup.com
… Here, we show further not only that this may serve as a general tool for static visual narrative of the kind found in comics and graphic novels, but also that it provides an appropriate level of abstraction for cross-media comparisons of the kind needed in adaptation research …

Neural Networks for Narrative Continuation
M Roemmele – 2018 – roemmele.github.io
… On the other hand, gaining agency in this type of environment via natural language interaction still exists more in science fiction than in real technology. Among existing systems … recognizing only a few utterances for advancing the story. Natural language input …

Learning by asking questions
I Misra, R Girshick, R Fergus… – Proceedings of the …, 2018 – openaccess.thecvf.com
… pro- duce answers. As this oracle only understands questions in the form of programs (as opposed to natural language), our question proposal and answering modules both repre- sent questions as programs. However, unlike …

Other ways of seeing: film as digital materiality and interlocutor for community-based tourism relationships in Bali
B Boyer – International Journal of Tourism Anthropology, 2018 – academia.edu
… a more serious tone as well as demarcating and separating them from more poetic approach to the visual narrative in the … interviewees in their ‘natural environments’ the filmmaker was able to develop first-hand understanding of habits, rituals, natural language and meanings …

A Framework for the Consideration of Narrative in Creative Arts Practice
P Green – 2018 – pearl.plymouth.ac.uk
… Figure A1.2.2 Tween system 2008 (Online) Figure A1.2.3 Example output from Tween 2008 showing a transition that infers a visual narrative which is unconnected with any content implied in the source imagery used to generate it. Figure A1.3.1 Pulse 2010 (Video Installation) …

From Analysis to Communication: Supporting the Lifecycle of a Story
F Chevalier, M Tory, B Lee, J van Wijk… – Data-Driven …, 2018 – content.taylorfrancis.com
Page 1. 151 CHAPTER 7 From Analysis to Communication Supporting the Lifecycle of a Story Fanny Chevalier University of Toronto Melanie Tory Tableau Research Bongshin Lee Microsoft Research Jarke van Wijk Eindhoven University of Technology Giuseppe Santucci …

A memory network approach for story-based temporal summarization of 360 videos
S Lee, J Sung, Y Yu, G Kim – Proceedings of the IEEE …, 2018 – openaccess.thecvf.com
… long input sequences. As another related task, visual storytelling is to gener- ate coherent story sentences from an image set. Huang et al. [22] recently release the visual storytelling VIST dataset, and Yu et al. [51] propose a …

Visual perception and signed oral language in deafness.
E Mastrantuono – 2018 – idus.us.es
… by United Kingdom and United States (Spencer, 2016). The advantage of developing a natural language, no matter which, spoken or sign language, is the opportunity to access to the complex devices of a real language. The …

Encoding of event roles from visual scenes is rapid, spontaneous, and interacts with higher-level visual processing
A Hafri, JC Trueswell, B Strickland – Cognition, 2018 – Elsevier
Skip to main content …

The language of tourism
SM Maci, M Sala, Š Godni? Vi?i? – 2018 – aisberg.unibg.it
Page 1. 1 Tourism is a complex phenomenon with psychological, sociological and cultural dimensions (Urry, 2002). Regarding the latter, tourism involves direct contact between cultures with a particular emphasis on the importance …

Practice-Based Reflections of Enabling Agency through Arts-Based Methodological Ir/Responsibility
DZ Belluigi – Arts-Based Methods in Education Around the World, 2018 – books.google.com
… In what I have since called ‘visual narrative focus group interviews’, participants author their own stories using found images and text, which they then explain in small group discussions with their peers … Figure 7.3 A reproduction of Joe’s visual narrative with my analysis …

Towards Tweet Content Suggestions for Museum Media Managers
M Furini, F Mandreoli, R Martoglia… – Proceedings of the 4th …, 2018 – dl.acm.org
… The prototype implementation of our system is written in Python and exploits the Natural Language Toolkit (NLTK) library1. The first experiment (E1) is conducted by … 2016. PlayTheCityRE: A visual storytelling system that transforms recorded film memories into visual history …

Designing The Virtual Reality Narrative
M Søndergaard, P Dahlstedt, S Palitov – 2018 – projekter.aau.dk
… Others senses, such as smell and heat, may also be included. Natural language processing and general artificial 17 Pimentel, Ken and Teixeira, Kevin. “Virtual Reality: Through the New Looking Glass” New York: Intel/Windcrest McGraw Hill, 1993. pg. 11 18 Laurel, Brenda …

A Memory Network Approach for Story-based Temporal Summarization of 360 {\deg} Videos
S Lee, J Sung, Y Yu, G Kim – arXiv preprint arXiv:1805.02838, 2018 – arxiv.org
… long input sequences. As another related task, visual storytelling is to gener- ate coherent story sentences from an image set. Huang et al. [22] recently release the visual storytelling VIST dataset, and Yu et al. [51] propose a …

Cognitive Disability Aesthetics
B Fraser – 2018 – oapen.org
… and Staring: Icon, Index, and Symbol in Visual Media 49 3 Disability Scholarship at the Seam: The Materiality of Visual Narrative 73 Part … The wider capital-D Deaf community takes cochlear implants to be dismissive of ASL’s status as a natural language, harmful and invasive …

Wearing Data: from McLuhan’s “Extended Skin” to the Integration Between Wearable Technologies and a New Algorithmic Sensibility
N Barile, S Sugiyama – Fashion Theory, 2018 – Taylor & Francis
… One of the most representative cases of the integration of brand image, technological innovation and visual storytelling techniques is that of Dutch designer Iris Van Herpen, who is known for dressing Bjork and Lady Gaga, and already started her experiments with now popular …

Colorful insights supporting the modeling of creative processes across language, music and emotion
F Lebowsky, M López-González – Electronic Imaging, 2018 – ingentaconnect.com
… This inspires a couple of questions: Is this dynamic phenomenon we see in music (and natural language no less) less operational in other human creative behaviors? Can we extend this structurally efficient mindset to other creative domains …

The role of narrative units in the design of coherent plot structures for single-player action video games
N Funk – 2018 – summit.sfu.ca
Page 1. The Role of Narrative Units in the Design of Coherent Plot Structures for Single-Player Action Video Games by Natalie Gene Funk M.Sc., Georgia Institute of Technology, 2006 BA, Antioch University, 1999 Thesis Submitted …

Multimodal User Interaction for GIS Applications (MUI_GIS)
Z Mustafa, J Flores, JM Cotos – … of the XIX International Conference on …, 2018 – dl.acm.org
… are shown below (Table 2), where these words have been attentively selected to indicate their functional reality, as it is in the natural language; also see … Consequently, we can employ our system in other domains, for example geo-visual storytelling and the education framework …

Implication of N400 and P600 waves in the Linguistic Code Change in Monolinguals and Bilinguals
D Achanccaray, J Astucuri, M Hayashibe… – 2018 40th Annual …, 2018 – ieeexplore.ieee.org
… 43, pp. 133-165, 2017/08/01/ 2017. [4] M. Manfredi, N. Cohn, and M. Kutas, “When a hit sounds like a kiss: An electrophysiological exploration of semantic processing in visual narrative,” (in eng), Brain Lang, vol. 169, pp. 28-38, 06 2017 …

Multimodal machine learning: A survey and taxonomy
T Baltrušaitis, C Ahuja… – IEEE Transactions on …, 2018 – ieeexplore.ieee.org
… In this paper we focus primarily, but not exclusively, on three modalities: natural language which can be both written or spoken; visual signals which are often represented with images or videos; and vocal signals which encode sounds and para-verbal information such as …

Collaborative Context-Aware Visual Question Answering
AS Toor – 2018 – search.proquest.com
… [10] where objects in their context are used to apply natural language (such as image tags) to describe the point or place of the image [15] … Additionally, more high-level approaches like Visual Storytelling have focused on going beyond captions …

Towards personalized image captioning via multimodal memory networks
CC Park, B Kim, G Kim – IEEE transactions on pattern analysis …, 2018 – ieeexplore.ieee.org
… There have been many studies about personalization in computer vision and natural language processing [29], [30], [31], [32], [33], [34] … [17] propose one of the earliest memory network models for natural language question answering (QA), and later Sukhbaatar et al …

Supervised and Unsupervised Learning for Semantics Distillation in Multimedia Processing
Y Liu – 2018 – ubir.buffalo.edu
… This Problem will be discussed in Chapter 2. • Vision to Language Domain: Visual Storytelling Automatic generation of natural language description for individual images (aka image cap- tioning) has attracted extensive research attentions. However, none of …

Digital Capabilities
D Arkhipova, C Bozzoli – CIOs and the Digital Transformation, 2018 – Springer
… Even though soft skills such as “an eye for design,” user experience, good writing and visual storytelling skills are still invaluable … ROSS Intelligence has developed the first “artificially intelligent lawyer” that uses natural language processing (NLP) to understand and process the …

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
I Gurevych, Y Miyao – Proceedings of the 56th Annual Meeting of the …, 2018 – aclweb.org
… Science, University of Adelaide Abstract: Deep Neural Networks have had an incredible impact in a variety of areas within machine learning, including computer vision and natural language processing. Deep Neural Networks …

Mental models,(de) compressions, and the actor’s process in body-swap movies
A Abdel-Raheem – Cognitive Linguistic Studies, 2018 – jbe-platform.com
Abstract The body-swap comedy, where someone finds themselves inhabiting an entirely different body, is a well-established Hollywood tradition. Crucially, American filmmakers have tried every twist and contortion of this genre premise at a point or another over the past few decades …

Racism in the Machine: Visualization Ethics in Digital Humanities Projects.
K Hepworth, C Church – DHQ: Digital Humanities Quarterly, 2018 – search.ebscohost.com
… community and subsequently learn from the tweets of users mentioning it, in order to improve its natural language communication abilities … of the American West depicted in Map of White Supremacy Mob Violence in Figure 6b provides a compelling visual narrative that lynchings …

Designing Pervasive Virtual Worlds
E Reyes-Garcia – Digital Multimedia: Concepts, Methodologies, Tools …, 2018 – igi-global.com
… instance, in the fashion industry trends can be celebrated from year to year, but this is not the case in natural language where changes … this gap between the introduction of the cinématographe, by Louis and Auguste Lumière in 1895, and the use of visual narrative techniques by …

A deep learning approach for automatically generating descriptions of images containing people
TF de Grado – 2018 – eprints.ucm.es
… people. However, it is a complex task for computers: it requires Computer Vision algorithms, to understand what the image depicts, and Natural Language Processing algorithms, to generate a well-formed sentence. Nowadays …

An Argument from Sublime Literature: How Language, Beauty, and Literature Point Toward the Existence of God
D Blackaby – 2018 – repository.sbts.edu
Page 1. Copyright © 2018 Daniel Richard Blackaby All rights reserved. The Southern Baptist Theological Seminary has permission to reproduce and disseminate this document in any form by any means for purposes chosen …

Developing an instructional design for the design of infographics and the evaluation of infographic usage in teaching based on teacher and student opinions
F Ozdamli, H Ozdal – Eurasia Journal of Mathematics, Science and …, 2018 – ejmste.com
Page 1. © Authors. Terms and conditions of Creative Commons Attribution 4.0 International (CC BY 4.0) apply. fezileozdamli@hotmail.com (*Correspondence) hasan.ozdal@neu.edu.tr OPEN ACCESS EURASIA Journal of Mathematics …

The state of the art in sentiment visualization
K Kucher, C Paradis, A Kerren – Computer Graphics Forum, 2018 – Wiley Online Library
… Researchers in linguistics and natural language processing (NLP) have access to the data that can be drastically different from traditional corpora or literature with regard to content, scale, and corresponding analyses, for instance, customer reviews or social media messages …

The Theory and Practice of Motion Design: Critical Perspectives and Professional Practice
RB Stone, L Wahlin – 2018 – content.taylorfrancis.com
Page 1. Page 2. The Theory and Practice of Motion Design Critical Perspectives and Professional Practice Page 3. Taylor & Francis Taylor & Francis Group http:/taylorandfrancis.com Page 4. The Theory and Practice of Motion Design Critical Perspectives and …

Learning from the History of Business Intelligence and Analytics Research at HICSS: A Semantic Text-mining Approach
O Marjanovic, B Dinter – … of the Association for Information Systems, 2018 – aisel.aisnet.org
Page 1. Communications of the Association for Information Systems Volume 43 Article 40 12-2018 Learning from the History of Business Intelligence and Analytics Research at HICSS: A Semantic Text-mining Approach Olivera …

KD 10 Public Open City Toolkit prototype
DB UNL, ST UJI, CG UJI, AD WWU – 2018 – geo-c.eu
… architecture to materialise our IGT approach (Figure 5). The main component of the IGT tool is called “Visual storytelling design”, and … first component, an app, is to test the possibilities to create emotional and empathic relationships with objects using natural language processing …

Transcending the panels: varieties of experience and selfhood in comics.
WD Simpson – 2018 – ir.library.louisville.edu
… So, those theorists who have used the metaphor of “language” to describe comics are, according to Cohn, making a category error. Visual language, being a natural language, is amenable to linguistic and psychological examination that is broadly a …

An Analysis of Multimodality in Selected Advertisements in Nigerian Newspapers
OR Asaolu – 2018 – search.proquest.com
… are verbally mediated, writing is a visual form, algebra shares much of the syntax and semantics of natural language…” (Lemke 2002, p. 3), and thus any communication is a constant process of resemiotization, as “meaning making shifts from context to context, from …

Mixed metaphors: Electrophysiological brain responses to (un) expected concrete and abstract prepositional phrases
E Zane, V Shafer – Brain research, 2018 – Elsevier
… The Metaphoric Mapping Theory proposes that spatial semantics is applied to abstract concepts during natural language processing, and that there is something cognitively natural and/or acceptable about the relationship between certain abstract concepts and certain …

Who Is the Muslim? Discursive Representations of the Muslims and Islam in Indian Prime-Time News
O Drabu – Religions, 2018 – mdpi.com
… With this pattern, the anchor chooses to perpetuate a specific visual narrative—the oppressed Muslim woman, anonymized by religion, needs saving, and this can only be achieved if she denounces Islam completely; the bearded Muslim man represents ultra-conservative …

Fashion Weeks, Power and Instagram: A Content Analysis of the Big Four Fashion Weeks and Their Audiences on Instagram
GV Dunn – 2018 – search.proquest.com
… According to Instagram’s website, Instagram is “…a community of more than 800 million who capture and share the world’s moments.” The website also points out that it is the “home of visual storytelling for … has its own set of rules like that of a natural language (Boero 303) …

Social Media in Earthquake-Related Communication: Shake Networks
F Comunello, S Mulargia – 2018 – emeraldinsight.com
Page 1. Page 2. SOCIAL MEDIA IN EARTHQUAKE-RELATED COMMUNICATION: SHAKE NETWORKS Page 3. This page intentionally left blank Page 4. SOCIAL MEDIA IN EARTHQUAKE-RELATED COMMUNICATION: SHAKE NETWORKS BY …

Peircean Semiotics and Multimodality: Towards a New Synthesis
JA Bateman – Multimodal Communication, 2018 – degruyter.com
Page 1 …

Definite descriptions and the alleged east–west variation in judgments about reference
Y Izumi, M Kasaki, Y Zhou, S Oda – Philosophical Studies, 2018 – Springer
Machery et al. (2004) presented data suggesting the existence of cross-cultural variation in judgments about the reference of proper names. In this paper, we examine a previously overlooked confound…

Screen stories: emotion and the ethics of engagement
C Plantinga – 2018 – books.google.com
Page 1. STORIES Emotion and the Ethics of Engagement CARL PLANT | NGA Page 2. Screen Stories Page 3. Page 4. Screen Stories EMOTION AND THE ETHICS OF ENGAGEMENT Carl Plantinga 1 Page 5. 1 Oxford University Press is a department of the University of Oxford …

from leading professors and researchers, and develop a strong peer network for career support
A CHANDRAKASAN, ASU OZDAGLAR – pdfs.semanticscholar.org
… My research goal is to develop artificial intelligence (AI) systems that can “see” (ie, understand the contents of an image: who, what, where, doing what?) and “talk” (ie, communicate the understanding to humans in free-form natural language) …

Reification as the key to augmenting software development
T Dal Sasso – 2018 – doc.rero.ch
… 8 2.2.2 Visual Storytelling … Page 22. 2 Introduction 1.1 Dealing With Software It is easy to sense why understanding software is hard: Reading code means reading text containing structured information, in a language that does not follow the same logic of natural language …

How do authoritarian states react when targeted by the use of information as a foreign policy tool?: case studies of Russia and North Korea
S Fisher – 2018 – rucore.libraries.rutgers.edu
Page 1. How Do Authoritarian States React When Targeted by the Use of Information as a Foreign Policy Tool? Case Studies of Russia and North Korea by Scott Fisher A Dissertation submitted to the Graduate School-Newark Rutgers, The State University of New Jersey …

Fred Davis, René Riedl, Jan vom Brocke, Pierre-Majorique Léger, Adriane Randolph (Eds.)
PM Léger – neurois.org
Page 1. Proceedings NeuroIS Retreat 2018 Vienna, Austria | June 19-21 | www.NeuroIS.org Fred Davis, René Riedl, Jan vom Brocke, Pierre-Majorique Léger, Adriane Randolph (Eds.) Proceedings of the NeuroIS Retreat 2018: Abstracts …

Word order preferences of Tagalog-speaking adults and children
R Garcia, JE Dery, J Roeser, B Höhle – First Language, 2018 – journals.sagepub.com
This article investigates the word order preferences of Tagalog-speaking adults and five- and seven-year-old children. The participants were asked to complete s…

American literature and the culture wars
GS Jay – 2018 – books.google.com
Page 1. AMERICAN i’ – – – – Page 2. º e º Se & ¿ eºa sa X: º º ¿- sºe …

Comic strips as a multimodal teaching tool to promote literacies
ESS Oliveira – 2018 – repositorio-aberto.up.pt
Page 1. Comic strips as a multimodal teaching tool to promote literacies Ema Sofia Silva Oliveira M 2018 2º CICLO DE ESTUDOS ENSINO DO INGLÊS NO 3º CICLO DO ENSINO BÁSICO E ENSINO SECUNDÁRIO Page 2. Ema Sofia Silva Oliveira …

Catching glimpses
R Delso Gutierrez, M Kärrholm, P Prieto De La Fuente – pdfs.semanticscholar.org
Page 1. Catching glimpses the fragment-anthology as a strategy for architectural research Delso Gutierrez, Rodrigo; Kärrholm, Mattias; Prieto De La Fuente, Paulina 2018 Document Version: Publisher’s PDF, also known as Version of record Link to publication …

ORACLE: An Ontology Reasoner for Affective Conversation in Long-term Engagement
AJ de Mooij – 2018 – dspace.library.uu.nl
… NLP Natural Language Processing NLU Natural Language Understanding … Secondly, a sentiment mining module has been added to the PAL system recently, which can annotate strings of natural language with the sentiments positive, negative or neutral …

Retelling Dmitri Karamazov’s Story in an Interactive Graphic Novel
W Tan – 2018 – dukespace.lib.duke.edu
Page 1. i Retelling Dmitri Karamazov’s Story in an Interactive Graphic Novel by Wei Tan Department of Art, Art History and Visual Studies Duke University Date:_____ Approved: _____ Victoria Szabo, Supervisor …

Youth and News in a Digital Media Environment: Nordic-Baltic Perspectives
Y Andersson, U Dalquist, J Ohlsson – 2018 – diva-portal.org
Page 1. YOUTH AND NEWS IN A DIGITAL MEDIA ENVIRONMENT Nordic-Baltic Perspectives Yvonne Andersson, Ulf Dalquist & Jonas Ohlsson (eds.) NORDICOM YOUTH AND NEW S IN A DIGIT AL MEDIA ENVIRONMENT …

Faktuell: Youths as journalists in online newspapers and magazines in Norway
RW Vaagan, H Biseth… – Youth and news in a digital …, 2018 – openarchive.usn.no
Page 1. YOUTH AND NEWS IN A DIGITAL MEDIA ENVIRONMENT Nordic-Baltic Perspectives Yvonne Andersson, Ulf Dalquist & Jonas Ohlsson (eds.) NORDICOM YOUTH AND NEW S IN A DIGIT AL MEDIA ENVIRONMENT …

When tú Is Too friendly: Insights intothe Effects of Task-Supported Instruction on Beginning Spanish Learners’ PragmaticComprehension of Forms of Address
PA Saunders – 2018 – search.proquest.com
Page 1. When tú Is Too friendly: Insights into the Effects of Task-Supported Instruction on Beginning Spanish Learners’ Pragmatic Comprehension of Forms of Address A Thesis submitted in partial fulfillment of the requirements …

Data science for undergraduates: Opportunities and options
National Academies of Sciences, Engineering, and … – 2018 – books.google.com
Page 1. THE NATIONAL ACADEMIES PRESS This PDFisavailableathttp://nap.edu/ 25104 SHARE ? ? ? ? Data Science for Undergraduates: Opportunities and Options (2018) DETAILS 138 pages | 6 x 9 |PAPERBACK ISBN …

Teaching and Learning to Risk: Design Pedagogy as a Catalyst for Innovation and Creative Risk-Taking in Secondary School Learning Environments
PM Pease – 2018 – search.proquest.com
… My teaching experiences include both undergraduate design foundations courses as well as planning and facilitating graduate level special topics courses intended to enliven connections between content and visual storytelling. I have mentored young people seeking …

(Visited 20 times, 1 visits today)