Text-to-Scene 2017


Notes:

  • 3D reasoning
  • Narrative visualization
  • Scene generation
  • Story visualization
  • Text-To-Scene Conversion System (TTSCS)
  • Text-to-scene system
  • Text2scene

See also:

SceneMaker | Text-to-Image & Natural Language 2017Text-to-Image Systems


Translating text into pictographs
V Vandeghinste, ISL Sevens… – Natural Language …, 2017 – cambridge.org
… The Sclera and Beta pictograph sets are specifically designed to facilitate communication with this user group. Another area of work that is somewhat related is text-to-scene conversion, such as WordsEye (Coyne and Sproat 2001), a natural language interface for a 3D editor …

SceneSeer: 3D Scene Design with Natural Language
AX Chang, M Eric, M Savva, CD Manning – arXiv preprint arXiv …, 2017 – arxiv.org
… Despite the conceptual simplicity of generating pic- tures from descriptions, systems for text-to-scene generation have only achieved limited success. How might we allow people to create 3D scenes using simple natural language …

A Step Toward Automated Simulation in Industry
H Sarma, R Porzel, R Malaka – Dynamics in Logistics, 2017 – Springer
… 9.4 Best visualization. Rather than the above works, there are also certain works which somehow are related to our approach. A group of researchers (Chang et al. 2014) introduced a text to scene engine where user can also change the scene if it is not perfect …

Spatial role labeling annotation scheme
P Kordjamshidi, M van Otterlo, MF Moens – Handbook of Linguistic …, 2017 – Springer
… 204 Downloads. Abstract. Spatial information extraction from natural language is important for many applications including geographical information systems, human computer interaction, providing navigational instructions to robots and visualization or text-to-scene conversion …

Object embodiment in a multimodal simulation
J Pustejovsky, N Krishnaswamy, T Do – AAAI Spring Symposium …, 2017 – cs.utexas.edu
… arXiv preprint arXiv:1505.06289. Coyne, B., and Sproat, R. 2001. Wordseye: an automatic text-to-scene conversion system. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, 487–496. ACM …

Breakingnews: Article annotation by image and text processing
A Ramisa, F Yan, F Moreno-Noguer… – IEEE transactions on …, 2017 – ieeexplore.ieee.org
Page 1. 0162-8828 (c) 2017 IEEE. Personal use is permitted, but republication/ redistribution requires IEEE permission. See http://www.ieee.org/ publications_standards/publications/rights/index.html for more information. This …

A Step towards Textual Instructions to Virtual Actions
H Sarma, R Porzel, R Malaka… – … (IACC), 2017 IEEE 7th …, 2017 – ieeexplore.ieee.org
… single action verb only. Another text to scene developed by a group of Stanford researchers [11], where the system generates animation using semantic information of input text and generate 3D scene. This system addresses …

CLEF 2017: Multimodal spatial role labeling (mSpRL) task overview
P Kordjamshidi, T Rahgooy, MF Moens… – … Conference of the Cross …, 2017 – Springer
… It is also essential for some specific tasks such as text to scene conversion (or vice-versa), scene understanding as well as general information retrieval tasks when using a huge amount of available multimodal data from various resources …

Frame-Semantic Parsing with Softmax-Margin Segmental RNNs and a Syntactic Scaffold
S Swayamdipta, S Thomson, C Dyer… – arXiv preprint arXiv …, 2017 – arxiv.org
… An example sentence and its frame-semantic annotations are shown in Figure 1. Frame-semantics has shown to be useful in ques- tion answering (Shen and Lapata, 2007), text-to- scene generation (Coyne et al., 2012), dialog sys- tems (Chen et al., 2013) and social-network ex …

Text-to-3D Scene Generation using Semantic Parsing and Spatial Knowledge with Rule Based System
MS Hossain, A Salam – International Journal of Computer …, 2017 – search.proquest.com
… Semantic parsing process can also impose too many perspectives of text to scene generation. However, there are many inexistent issues in this area … 7. Limitation. There are still many objections to rise in the text to scene generation while the framework shows commitment …

The virtual representation of the World City Project: from text to 3D model
V Bova, F Parisi – AIUCD 2016 – amsacta.unibo.it
… description. An interesting aspect of text-to-scene conversion that regards the knowledge of how human actions, described in a text, are effectively realized in the reality has also been dealt in the paper (Coyne et al. 2012). A …

First steps in the investigation of automated text annotation with pictures
JK Poots, N Cercone – Big Data & Information Analytics, 2017 – aimsciences.org
… doi: 10.3934/bdia.2017001. References: [1], B. Coyne, R. Sproat, WordsEye: An automatic text-to-scene conversion system, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, 3 (2003), 487-496. [2] …

Visualization of Free Body Diagrams
V Jain, A Hinge, K Laddha… – International …, 2017 – pdfs.semanticscholar.org
… units and direction. The system also deals with human assistance, error handling with real time interaction. 2. RELATED WORK Text-to-scene generation using NLP has been a topic of research for quite a while. One such web …

Visualization of Patient Behavior from Natural Language Recommendations
J Siddle, A Lindsay, JF Ferreira, J Porteous… – Proceedings of the …, 2017 – dl.acm.org
… Text-to-Scene visualization systems aim primarily at using NL for image and graphics generation [2] or at render- ing spatial information conveyed in a text (such as road accidents description [8]). Other systems have aimed at generating 3D an- imations from NL, driving virtual …

Overview of Text Annotation with Pictures
JK Poots, E Bagheri – IT Professional, 2017 – ieeexplore.ieee.org
… 1520-9202/$26.00 2017 IEEE Page 14. Page 14 [18] B. Coyne and R. Sproat, “WordsEye: an automatic text-to-scene conversion system,” in Proceedings of the 28th annual conference on Computer graphics and interactive techniques, 2001, pp. 487-496 …

Spatial intelligence from hindi language text for scene generation
P Jain, H Darbari, VC Bhavsar – Convergence in Technology …, 2017 – ieeexplore.ieee.org
… pp. 31-39. IEEE Computer Graphics and Applications. 1996. [6] Coyne, B., Sproat, R., and Hirschberg, J.: “Spatial relations in text-to-scene conversion”. pp … 2010. [7] Coyne, B., Sproat, R.: “WordsEye: An automatic text-to-scene conversion system”. pp. 487-496 …

Cognitive support by language visualization: A case study with hindi language
P Jain, H Darbari, VC Bhavsar – Convergence in Technology …, 2017 – ieeexplore.ieee.org
… WordsEye [2] is the most talked about text visualization system for automatic text-to-scene conversion system.A text- to-picture synthesis system is proposed in [27] for augmenting communication. This system synthesizes a picture from general, unrestricted natural language …

Acquiring Common Sense Spatial Knowledge through Implicit Spatial Templates
G Collell, L Van Gool, MF Moens – arXiv preprint arXiv:1711.06821, 2017 – arxiv.org
… 2007). More specif- ically, spatial understanding is essential in tasks involving text-to-scene conversion such as robots’ understanding of natural language commands (Guadarrama et al. 2013; Moratz and Tenbrink 2006) or robot navigation. Spatial templates …

CLEF 2017: Multimodal Spatial Role Labeling Task Working Notes
P Kordjamshidi, T Rahgooy, MF Moens, J Pustejovsky… – pdfs.semanticscholar.org
… It is also essential for some specific tasks such as text to scene conversion (or vice-versa), scene understanding as well as general information retrieval tasks when using a huge amount of available multimodal data from various resources …

From computational narrative analysis to generation: a preliminary review
J Valls-Vargas, J Zhu, S Ontañón – … on the Foundations of Digital Games, 2017 – dl.acm.org
… 2010. Frame semantics in text-to-scene generation. In Knowledge-Based and Intelligent Infor- mation and Engineering Systems. Springer, 375–384. [5] David K. Elson. 2012 … 2005. Automatic Text-to-Scene Conversion in the Tra c Accident Domain. In IJCAI, Vol. 5. 1073–1078 …

Analysis and Modeling of 3D Indoor Scenes
R Ma – arXiv preprint arXiv:1706.09577, 2017 – arxiv.org
… of the window”. A series of papers by Chang et al. [9, 10, 7] have provided improvements over the early text-to-scene systems by utilizing spatial knowledge, learned from 3D scene data, to better constrain scene generations

Visual-Effect Dictionary for Converting Words into Visual Images
S Hirai, K Sumi – International Conference on Entertainment Computing, 2017 – Springer
… Thus, by investigating from the common sense knowledge of the object, we found that it is possible to provide an appropriate visual effect to the modifier using the system. References. 1. Bob, C., Richard, S.: WordsEye: An automatic text-to-scene conversion system …

Hopfield Net spreading activation for grounding of abstract action words in cognitive robot
N Rasheed, SHM Amin, U Sultana, AR Bhatti – Biologically Inspired …, 2017 – Elsevier
Skip to main content …

Deep Matching Autoencoders
T Mukherjee, M Yamada, TM Hospedales – arXiv preprint arXiv …, 2017 – arxiv.org
Page 1. Deep Matching Autoencoders Tanmoy Mukherjee University of Edinburgh mukherjee.tanmoy@gmail.com Makoto Yamada RIKEN AIP, JST PRESTO makoto.yamada@ riken.jp Timothy M. Hospedales University of Edinburgh t.hospedales@ed.ac.uk Abstract …

Zero-shot learning with generative latent prototype model
Y Li, D Wang – arXiv preprint arXiv:1705.09474, 2017 – arxiv.org
… 2016. [17] B. Coyne and R. Sproat, “Wordseye: an automatic text-to-scene conver- sion system,” in Proceedings of the 28th annual conference on Computer graphics and interactive techniques. ACM, 2001, pp. 487–496. [18 …

Commonsense Knowledge for 3D Modeling: A Machine Learning Approach
K Hassani – 2017 – ruor.uottawa.ca
… plays an import role in Artificial Intelligence (AI) applications [2]. These applications include but are not limited to robotics [3], conversational agents [4], text–to–scene conversion systems … spatial relations in describing 3D scenes in text–to–scene [5] and text–to–animation [7] …

Disambiguating Spatial Prepositions Using Deep Convolutional Networks.
K Hassani, WS Lee – AAAI, 2017 – aaai.org
… These applications include human-robot inter- actions, natural language interfaces, machine vision, text- to-scene conversion systems, geographical information systems, question answering systems, search engines, and spatial databases …

Multimodal Machine Learning: A Survey and Taxonomy
T Baltrušaitis, C Ahuja, LP Morency – arXiv preprint arXiv:1705.09406, 2017 – arxiv.org
Page 1. 1 Multimodal Machine Learning: A Survey and Taxonomy Tadas Baltrušaitis, Chaitanya Ahuja, and Louis-Philippe Morency Abstract—Our experience of the world is multimodal – we see objects, hear sounds, feel texture, smell odors, and taste flavors …

Understanding-Oriented Multimedia News Retrieval
Z Li – Understanding-Oriented Multimedia Content Analysis, 2017 – Springer
Online news reading becomes an important channel for information acquisition in our daily lives. Users have to consume much time in finding the news they are interested in from such huge volumes of in.

A Bibliography of Publications in ACM SIGGRAPH Computer Graphics: 2000–2009
NHF Beebe – Computer Graphics, 2017 – ctan.math.utah.edu
… teens [DKJ06]. tele [Dia09]. tele-presence [Dia09]. television [Eds08, Ell00c]. testing [HLM01]. text [CS01, Tho04a]. text-to-scene [CS01]. Texture [SSGH01, Tur01, WL01, EF01, Lév01, LYS01, MGW01]. texturing [LDG01]. themed [RV00]. theory [TFNC01]. There [Wes02c] …

Learning Algorithms for Broad-Coverage Semantic Parsing
S Swayamdipta – 2017 – cs.cmu.edu
Page 1. Learning Algorithms for Broad-Coverage Semantic Parsing Swabha Swayamdipta September 2017 School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 Thesis Committee: Noah A. Smith, Chair …

Data?Driven Shape Analysis and Processing
K Xu, VG Kim, Q Huang… – Computer Graphics …, 2017 – Wiley Online Library
By continuing to browse this site you agree to us using cookies as described in About Cookies. Remove maintenance message …

Painting Pictures with Words-From Theory to System
R Coyne – 2017 – search.proquest.com
… In doing so, we describe WordsEye, our text-to-scene system, and touch upon many fascinating issues of lexical semantics, knowledge representation, and what we call “graphical semantics.” We introduce the notion of vignettes as a way to bridge between function and form …

A multilingual FrameNet-based grammar and lexicon for controlled natural language
N Gruzitis, D Dannélls – Language Resources and Evaluation, 2017 – Springer
Berkeley FrameNet is a lexico-semantic resource for English based on the theory of frame semantics. It has been exploited in a range of natural language processing applications and has inspired the de.

Towards Robust, Interpretable and Scalable Visual Representations
A Li – 2017 – search.proquest.com
Towards Robust, Interpretable and Scalable Visual Representations. Abstract. Visual representation is one of the central problems in computer vision. The essential problem is to develop a unified representation that effectively …

Monte Carlo Simulation Generation Through Operationalization of Spatial Primitives
N Krishnaswamy – 2017 – search.proquest.com
Abstract. Much existing work in text to scene generation focuses on generating static scenes, which leaves aside entire word classes such as motion verbs … by Nikhil Krishnaswamy. Much existing work in text to scene generation focuses on generating static scenes, which leaves …

Automated Extraction of Action Semantics for Embodied Virtual Agent Using Textual Knowledge Bases
JT Balint – 2017 – search.proquest.com
… other representations. provide and what information would still be needed for that particular application. While text-to-scene is an interesting application in that it requires an understanding of both human. communicable language …

(Visited 9 times, 1 visits today)