Notes:
Word segmentation is the process of identifying and separating individual words in a piece of text. This is typically a complex and challenging task, especially for languages that do not use spaces to delimit words, such as Chinese or Japanese.
Word segmentation is a crucial step in many natural language processing (NLP) tasks, such as part-of-speech tagging, syntactic parsing, and machine translation. In these tasks, the ability to accurately identify and segment words is essential for accurate and effective processing of the text.
Word segmentation algorithms typically use a combination of techniques, such as dictionary lookup, statistical models, and heuristics, to identify and segment words in the text. These algorithms may be trained on large corpora of annotated text, in order to learn the patterns and rules that are used to segment words in a particular language.
Word segmentation can be used in a variety of applications, including chatbots. For example, a chatbot might use word segmentation to accurately process user input and generate appropriate responses. This can help the chatbot to understand the meaning and intent of the user’s input, and to generate more natural and coherent responses.
Wikipedia:
See also:
100 Best Word Embedding Videos | Word Lattice
Detecting Entities of Works for Chinese Chatbot
C Wu, F Wu, T Qi, J Liu, Y Huang, X Xie – ACM Transactions on Asian …, 2020 – dl.acm.org
… Fortunately, some users use quote marks (“??? to explicitly mention the entities of works in the conversations with chatbots … In addition, although Lattice-LSTM can exploit both word and character information, the word segmentation on Chinese chatbot conversations is …
The design and implementation of xiaoice, an empathetic social chatbot
L Zhou, J Gao, D Li, HY Shum – Computational Linguistics, 2020 – MIT Press
… we propose to use expected Conversation-turns Per Session (CPS) as the success metric for social chatbots … The larger the CPS is, the better engaged the social chatbot is … A social chat- bot navigates in an MDP, interacting with its environment (human users) over a sequence …
IntelliBot: A Dialogue-based chatbot for the insurance industry
M Nuruzzaman, OK Hussain – Knowledge-Based Systems, 2020 – Elsevier
… techniques such as lower-casing, punctuation filtering, stop words removal and word segmentation are used … 1. Different components required in a response-generating chatbot application … Such chatbots work on determining patterns using rules and are commonly used in the …
University Chatbot using Artificial Intelligence Markup Language
NN Khin, KM Soe – 2020 IEEE Conference on Computer …, 2020 – ieeexplore.ieee.org
… Word Segmentation … are many chatbots in English and other languages by using different algorithms and models but there is little chatbot using Myanmar … This is one of the University Chatbots using Myanmar Language to fulfill the information gaps between the university and …
Integrating machine learning and open data into social Chatbot for filtering information rumor
IC Hsu, CC Chang – Journal of Ambient Intelligence and Humanized …, 2020 – Springer
… Page 5. Integrating machine learning and open data into social Chatbot for filtering information rumor 1 3 platforms, and chatbots … The four steps in data preprocessing in this study were data cleaning, Chinese word segmentation, punctuation removal, and stop word removal …
Chatbot Design Method Using Hybrid Word Vector Expression Model Based on Real Telemarketing Data
J Zhang, J Zhang, S Ma, J Yang… – KSII Transactions on …, 2020 – koreascience.or.kr
… The objective of this paper is to propose a Chinese-based commercial automated chatbot system, which includes word segmentation, word tagging, word code as vector representation, and uses the hybrid retrieval model and generate model to meet the needs of daily …
Understanding what the users say in chatbots: A case study for the Vietnamese language
OT Tran, TC Luong – Engineering Applications of Artificial Intelligence, 2020 – Elsevier
… tasks: one corpus is about user intents and the other three corpora are about three typical types of contexts existing in ordering chatbots … This paper 1 presents a study on understanding what the users say in chatbot systems: the situation where users input utterances bots would …
Pchatbot: A Large-Scale Dataset for Personalized Chatbot
X Li, H Zhong, Y Guo, Y Ma, H Qian, Z Liu… – arXiv preprint arXiv …, 2020 – arxiv.org
… we can move from personality based models to personalized models: a chatbot which learn … To make chatbots maintain a co- herent personality, other classic strategies mainly … steps, anonymization, filtering sensitive words, fil- tering utterances by length and word segmentation …
An Approach for Building Effective Real Estate Chatbots in Vietnamese
TD Cao, QH Nguyen – Soft Computing for Biomedical Applications and …, 2020 – Springer
… Word segmentation: As presented in previous section, the input sentence will be separated into meaningful … presents an artificial intelligence-based method for building real estate chatbots who can … The chatbot is trained with data set collected on Facebook groups and from the …
Investigation of Sentiment Controllable Chatbot
H Lee, CH Ho, CF Lin, CC Chang, CW Lee… – arXiv preprint arXiv …, 2020 – arxiv.org
… are jointly trained with the translators F and G. During testing, for any chatbot output y … Here we propose two metrics: semantic coherence 1 and 2 (COH1, COH2) for chatbots, which are … best results of all architectures shown in Table I, GRU-last with word segmentation yielded the …
Chatbot: A Deep Neural Network Based Human to Machine Conversation Model
GK Vamsi, A Rasool, G Hajela – 2020 11th International …, 2020 – ieeexplore.ieee.org
… Word segmentation implemented by using Natural Language ToolKit (NLTK) was proposed by Naeun Lee et al … research, investigation of other enhanced methods can be done, that would further raise the standards of chatbots … [1] B. Setiaji and FW Wibowo, “Chatbot Using a …
Dzongkha Word Segmentation using Deep Learning
Y Jamtsho, P Muneesawang – 2020 12th International …, 2020 – ieeexplore.ieee.org
… Abstract—Natural Language Processing (NLP) has been applied to machine translation, chatbots, speech recognition, question and answer systems, document summarization and so … Thus, Dzongkha word segmentation is the essential first step in building the NLP applications …
Adaptive Machine Learning Chatbot for Code-Mix Language (English and Hindi)
R Sancheti, S Upare, N Bhirud, S Tatale – researchgate.net
… On the whole, the use of NLP and ML in domain specific chatbots boosts its … Siddharth Gupta, Ajay Modi, Pratik Pandey, Simon Shim, Chang Choo, “Intelligent Travel Chatbot for Predictive … Soo H. Kim, Chang B. Jeong, Hee K.Kwag, , Chin Y. Suen, “Word Segmentation of Printed …
A Survey on Modularization of Chatbot Conversational Systems
X Zhang, S He, Z Huang, A Zhang – International Conference on Database …, 2020 – Springer
… Researches relevant to the field of chatbot conversational systems have been developing … representation fusion network for multi-turn response selection in retrieval-based chatbots … J., Sun, X.: Dependency-based gated recursive neural network for Chinese word segmentation …
A Review of Current Trends in the Development of Chatbot Systems
TP Nagarhalli, V Vaze, NK Rana – 2020 6th International …, 2020 – ieeexplore.ieee.org
… For this purpose the paper proposes to develop a template by using CKIP toolkit for word segmentation and parts of … for College Website [19] Content-Oriented User Modeling for Personalized Response Ranking in Chatbots [20 … AI-based Chatbot Service for Financial Industry …
High Accuracy Conversational AI Chatbot Using Deep Recurrent Neural Networks Based on BiLSTM Model
P Anki, A Bustamam, HS Al-Ash… – 2020 3rd International …, 2020 – ieeexplore.ieee.org
… Smutny and P. Schreiberova, Ichatbots for learning: a review of educational chatbots for the … [6] D. Shao HW DO., IDomainYSpecific chinese Word Segmentation Based on … 4. [13] J. Yin, Ia compressionYbased BiLSTM for Treating Teenagers? Depression chatbot,” aMMSO, Guilin …
EduBot: An Unsupervised Domain-Specific Chatbot for Educational Institutions
M Nayeem Ahmed, T Habib… – Artificial Intelligence and …, 2020 – books.google.com
… in the purpose of matching similarity that’s why it is always removed from the word segmentation … Addressing (the) challenges of Chatbot application for meal recommendation … Kar, R., Haldar, R.: Applying Chatbots to the internet of things: Opportunities and architectural elements …
EduBot: An Unsupervised Domain-Specific Chatbot for Educational Institutions
MA Al Muid, MM Reza, RB Kalim, N Ahmed… – … Conference on Artificial …, 2020 – Springer
… unnecessary in the purpose of matching similarity that’s why it is always removed from the word segmentation … However, domain specific Chatbots are still a concern in education sector … that can achieve a satisfactory level in terms of relevant responses by the Chatbot about a …
Survey on psychotherapy chatbots
B Xu, Z Zhuang – Concurrency and Computation: Practice and … – Wiley Online Library
… Figure 1 shows the basic framework of current psychotherapy chatbots. A psychotherapy chatbot normally consists of five modules: input preprocessing module, natural language … to convert the input into a standardized form, such as word segmentation, lemmatization, or stop …
Recommender?as?a?service with chatbot guided domain?science knowledge discovery in a science gateway
K Vekaria, P Calyam, SS Sivarathri… – Concurrency and …, 2020 – Wiley Online Library
… RESEARCH ARTICLE. Recommender?as?a?service with chatbot guided domain?science knowledge discovery in a science gateway. Komal Vekaria … The guidance for use of the recommender modules in a science gateway is aided by a chatbot plug?in viz., Vidura Advisor …
Joint Word Segmentation and Part-of-Speech Tagging for Myanmar Language
DL Cing, KM Soe – 2020 – onlineresource.ucsy.edu.mm
Page 1. JOINT WORD SEGMENTATION AND PART-OF- SPEECH TAGGING FOR MYANMAR LANGUAGE DIM LAM CING UNIVERSITY OF COMPUTER STUDIES, YANGON August, 2020 Page 2. Joint Word Segmentation and Part-of-Speech Tagging for Myanmar Language …
9 REAL-TIME 2D AVATAR LIP SYNCING FOR THE ON DEMAND INTERACTIVE CHATBOTS
VS Lalam, A Dayal, SVR Sheik… – Recent Advances in …, 2020 – books.google.com
… and the recent use in the education and the business domains for interactive chat-bots … Time 2D Avatar Lip Syncing for the on Demand Interactive Chatbots REFERENCES 10 … Stahlberg, F., Schlippe, T., Vogel, S., Schultz, T. Word segmentation and pronunciation extraction from …
Thai Words Segmentation Using an Unsupervised Learning Technique
J Sunkpho, M Hofmann – International Conference on Computing and …, 2020 – Springer
… It is one of the first tasks in performing text analytics such as document classification, sentiment analysis, or chatbots. For most Latin-based languages such as English or German, word segmentation is rather trivial because words can be separated by white spaces or other …
System design of cloud search engine based on rich text content
H Chan, L Xu, H Liu, R Zhang, AK Sangaiah – Mobile Networks and …, 2020 – Springer
… On the basis of traditional search engine hardware system, several hardware devices such as Solr index server, collector, Chinese word segmentation device and searcher are installed, and the data interface is adjusted … Chinese word segmentation in rich text …
Interpretable Natural Language Segmentation Based on Link Grammar
V Ramesh, A Kolonin – 2020 Science and Artificial Intelligence …, 2020 – ieeexplore.ieee.org
… Text segmentation encompasses a variety of problems, such as word segmentation, intent segmentation, topic segmentation, and more; our work is … to-text (STT) recognition engines, which are often used to preprocess the inputs of question answering or chatbot pipelines, and …
Research and Implementation of Seq2Seq Model Chat Robot Based on Attention Mechanism
W Luo, D Wu – Journal of Physics: Conference Series, 2020 – iopscience.iop.org
… segment question and answer sentences in the corpus [9], and the word segmentation results are … would like to see that through this technology, the intelligence of chatbots can be … Research and Implementation of Chatbot Based on Deep Learning [D]. Beijing University of Posts …
The Neural Network Conversation Model enables the Commonly Asked Student Query Agents
N Muangnak, N Thasnas, T Hengsanunkul… – researchgate.net
… Most of the articles mentioned the useful of chatbots to assist human querying self … The data preparation for the chatbot model training process is based on the intents and … 1) Word segmentation [26] is the most significantly pre- processing of natural language processing (NLP) …
A healthcare?oriented mobile question?and?answering system for smart cities
Y Xu, Y Jiang, R Li, H Gao, J Guo, Y Liu… – Transactions on …, 2020 – Wiley Online Library
… mobile QA system contains three components, which are classifier, QA module, and chatbots APIs … ordinary question, the answer to the question will be given by a chatbot that is … contains three subtasks that are finished using NLP technique, which are word segmentation, part?of …
A Study on Natural Language Processing Classified News
MJ Wu, TY Fu, YC Chang… – 2020 Indo–Taiwan 2nd …, 2020 – ieeexplore.ieee.org
… [4] W. Tsuen-Jang, “Design and Implementation of Topic-oriented Chatbot on Instant Messenger Using Web Crawler Technology:A Case Study of Basketball Consulting on Line APP,” Master Thesis, Comm. Inf. Dig … [8] T. Jo-Hua, “POS-based Word Segmentation for Improving …
Computational Linguistics: 16th International Conference of the Pacific Association for Computational Linguistics, PACLING 2019, Hanoi, Vietnam, October 11 …
LM Nguyen, XH Phan, K Hasida, S Tojo – 2020 – books.google.com
… Page 12. Contents xiii Question and Answering, Dialog Analyzing Is the Simplest Chatbot Effective in English Writing Learning Assistance … Page 13. xiv Contents Vietnamese Word Segmentation with SVM: Ambiguity Reduction and Suffix Capture …
Question Chunk Extraction for Improving Question Similarity
C Damrongrat, C Sangkeettrakarn… – Proceedings of the 11th …, 2020 – dl.acm.org
… Word Embedding (TWE) and the second model was our Question Chunk based Word Embedding (QCWE.) The difference between these two models was only set of vocabu- laries for word segmentation … For example, for improving an intent classification on a Chatbot …
Research on Named Entity Structure Information for Machine Translation
D Zhu, Q Guo, D Zhang, F Wan – … International Symposium on …, 2020 – ieeexplore.ieee.org
… made without word segmentation, taNing the current accuracy rate information of word segmentation into consideration, the word segmentation effect of … An intelligent Chatbot using deep learning with Bidirectional RNN and attention model[J]. Materials Today: Proceedings,2020 …
Understanding EFL Linguistic Models through Relationship between Natural Language Processing and Artificial Intelligence Applications
M Salim Keezhatta – Arab World English Journal (AWEJ) Volume, 2020 – papers.ssrn.com
… Simialrly, word segmentation requires distributing a text into distinct units and part-of-speech tagging requires identifying the part of … NLP engages in reading, deciphering, and making sense of the human languages by machine operations like online chatbots, text summarization …
THE RUSSIAN LANGUAGE PIPELINE IN THE LIMA MULTILINGUAL ANALYZER
B VV, G de Chalendar – dialog-21.ru
… DeepPavlov is an open source framework for chatbots and virtual assistants de- velopment. It includes dependency parsing module with RuBERT-based encoder [13] … pp. 1532–1543 (2014). 18. Shao, Y. et al.: Universal word segmentation: Implementation and interpreta- tion …
TexSmart: A Text Understanding System for Fine-Grained NER and Enhanced Semantic Analysis
H Zhang, L Liu, H Jiang, Y Li, E Zhao, K Xu… – arXiv preprint arXiv …, 2020 – arxiv.org
… For example, when a chatbot is processing query “please book an air ticket to London at … Figure 5: An example of Chinese word segmentation and part-of-speech tagging … 2019, 2]}. Deep semantic representation is important for applications like task-oriented chatbots, where the …
Time to Transfer: Predicting and Evaluating Machine-Human Chatting Handoff
J Liu, Z Gao, Y Kang, Z Jiang, G He, C Sun… – arXiv preprint arXiv …, 2020 – arxiv.org
… Huang, Chang, and Bigham 2018), integrated crowds with multi- ple chatbots and voting … When the customer or chatbot repeats semantically similar utterances, the repeated utterance may … of-speech tagging are per- formed by a popular Chinese word segmentation utility called …
Machine Learning and Natural Language Processing: Review of Models and Optimization Problems
E Mankolli, V Guliashki – International Conference on ICT Innovations, 2020 – Springer
… https://www.cmswire.com/digital-experience/machine-learning-or-linguistic-rules-two-approaches- to-building-a-chatbot … Zheng, X., Chen, H., Xu, T.: Deep learning for Chinese word segmentation and pos tagging. In: Proceedings of the Conference on EMNLP-ACL-2013, pp …
A Systematic Literature Review of Natural Language Processing: Current State, Challenges and Risks
E Ghazizadeh, P Zhu – Proceedings of the Future Technologies …, 2020 – Springer
… To achieve correct word segmentation, it is necessary to combine the context and fully understand the semantics of the … Its application fields include machine translation, text, voice, image conversion, chatbots, sentimental analysis, text categorization, and information extraction …
DSQA: A Domain Specific QA System for Smart Health Based on Knowledge Graph
M Sheng, A Li, Y Bu, J Dong, Y Zhang, X Li, C Li… – … Conference on Web …, 2020 – Springer
… First, the system will execute word segmentation using Jieba word segmentation tool … https://doi.org/10.1145/3326163CrossRefGoogle Scholar. 4. Bao, Q., Ni, L., Liu, J.: HHH: an online medical chatbot system based on knowledge graph and hierarchical bi-directional attention …
DBOS: A Dialog-Based Object Query System for Hospital Nurses
ETH Chu, ZZ Huang – Sensors, 2020 – mdpi.com
… query system, is proposed, which simulates a real conversation with users via the Line messaging app’s chatbot interface [6 … In the implementation, Jieba [8], a Chinese word segmentation tool, is adopted for preprocessing, which includes sentence segmentation, lowercase …
A building regulation question answering system: A deep learning methodology
B Zhong, W He, Z Huang, PED Love, J Tang… – Advanced Engineering …, 2020 – Elsevier
… The paper’s contribution is therefore twofold as it develops a: (1) methodology that combines NLP and deep learning to be able to address queries raised about the building regulations; and (2) chatbot of question answering system, which we refer to as QAS4CQAR …
Event Extraction for Criminal Legal Text
Q Li, Q Zhang, J Yao, Y Zhang – 2020 IEEE International …, 2020 – ieeexplore.ieee.org
… proposed NPNs [6]. The research constructed a trigger block centered on each word to solve the problem of difficult matching of trigger words caused by the difficulty of Chinese word segmentation … It enhance chatbots and efficient queries but lack of dynamic information …
Artificial Intelligence Powered Smart Refrigerator to Arrest Food Wastage
T Nagaraju, S BR – Available at SSRN 3565256, 2020 – papers.ssrn.com
… Syntax techniques includes parsing, word segmentation, sentence breakout, morphological sub divisions and stemming … data in CRM or Inventory: CRM AI features such as Chatbots, etc today … NLP APIs to process natural language query before CRM chatbot could respond …
AliMeKG: Domain Knowledge Graph Construction and Application in E-commerce
FL Li, H Chen, G Xu, T Qiu, F Ji, J Zhang… – Proceedings of the 29th …, 2020 – dl.acm.org
… With the fast development of Deep Learning (DL) techniques, chatbot has become a natural choice for E-commerce customer service as it is able to automatically answer customers’ questions and largely improve the efficiency of customer support service …
Reasoning in Dialog: Improving Response Generation by Context Reading Comprehension
X Chen, Z Cui, J Zhang, C Wei, J Cui, B Wang… – arXiv preprint arXiv …, 2020 – arxiv.org
… has become a research hotspot in Natural Lan- guage Processing due to its broad application prospect, in- cluding chatbots, virtual personal … There are a large quantity of natural language processing tasks based on multi-task learning, such as word segmentation, POS tagging …
Developing Emotion-Aware Human–Robot Dialogues for Domain-Specific and Goal-Oriented Tasks
JY Huang, WP Lee, CC Chen, BW Dong – Robotics, 2020 – mdpi.com
… In contrast to the open-domain conversation performed by the general purpose chatbots, the domain-specific dialogue presented here aims to provide knowledge services of a certain domain (eg, finance or insurance) through a question-answering manner between the user …
A Pilot Study on Multiple Choice Machine Reading Comprehension for Vietnamese Texts.
K Van Nguyena, KV Trana, ST Luua… – arXiv preprint arXiv …, 2020 – academia.edu
… artificial intelli- gence applications such as next-generation search engines, intelligent agents (Alexa, Google Assistant, Siri, Cortana, etc), chatbots and robots … We used the word segmentation pyvi2. We found that the number of reading texts for the 1st grade is small, which is …
What If Bots Feel Moods?
L Qiu, Y Shiu, P Lin, R Song, Y Liu, D Zhao… – Proceedings of the 43rd …, 2020 – dl.acm.org
… systems have had promising application prospects ranging from open-domain chat- bots like Microsoft … with a specific emotion, specifying the emotional state of a chatbot, and controlling … ing emotion transition in large-scale conversation data for retrieval- based chatbots and the …
The Progess That Natural Language Processing Has Made Towards Human-level AI
M Sun, J Wang, D Zhang – Journal of Artificial Intelligence …, 2020 – clausiuspress.com
… At the same time, chatbots need natural learning and processing to quickly identify the semantics and … Such as chatbot, service bot and P2P e-commerce … in detail in the establishment of the knowledge base, language processing, clauses, word segmentation, semantic analysis …
Enhancing lexical-based approach with external knowledge for Vietnamese multiple-choice reading comprehension
K Van Nguyena, KV Trana, ST Luua… – arXiv preprint arXiv …, 2020 – academia.edu
… into various artificial intelligence applications such as next-generation search engines, AI agents (Alexa, Google Assistant, Siri, Cortana, etc.), chatbots, and robots … We used the word segmentation pyvi2. We found that the number of reading texts for the 1st grade is small, which …
Future Data-Driven Regulation
P Treleaven, S Sfeir-Tait – gateway.newton.ac.uk
… Data Technologies ? Big data ? Internet of Things (IoT) ? Chatbots … Techniques cover a) syntax analysis for segmenting and tagging words and units, including Word segmentation, Parsing, Lemmatization, Morphological segmentation etc.; and semantic analysis for …
Zipf’s Law in Human-Machine Dialog
GM Linders, MM Louwerse – Proceedings of the 20th ACM International …, 2020 – dl.acm.org
… The WOCHAT corpus includes dialogs between users and chat- bots [12]. In this corpus, there was no goal and the users could freely interact with the chatbots about anything they liked. These dialogs where held in chat form and are thus written …
Cue-word Driven Neural Response Generation with a Shrinking Vocabulary
Q Wang, Y Liu, C Lv, Z Wang, G Fu – arXiv preprint arXiv:2010.04927, 2020 – arxiv.org
… Daniel Adiwardana, Minh-Thang Luong, David R So, Jamie Hall, Noah Fiedel, Romal Thoppilan, Zi Yang, Apoorv Kulshreshtha, Gaurav Nemade, Yifeng Lu, et al. 2020. Towards a human-like open-domain chatbot. arXiv pre- print arXiv:2001.09977 …
GETTING YOUR CONVERSATION ON TRACK: ESTIMATION OF RESIDUAL LIFE FOR CONVERSATIONS
Z Lu, J Li, Y Zhang, H Zhang – polyusmart.net
… quality and point out our potential to benefit response selection for chatbots … the chatting logs between anonymous users and a Chinese online chatbot (henceforth ChatbotCN … For Chinese (ChatbotCN), we applied NLPIR tool [30] for Chinese word segmentation.10 Comparison …
Knowledge-guided unsupervised rhetorical parsing for text summarization
S Hou, R Lu – Information Systems, 2020 – Elsevier
JavaScript is disabled on your browser. Please enable JavaScript to use all the features on this page. Skip to main content Skip to article …
Last Utterance-Context Attention Model for Multi-Turn Response Generation
G Zhang, L Mao, J Sun – 2020 19th International Symposium on …, 2020 – ieeexplore.ieee.org
… data. Generative chatbot can generate new response for the current conversation mainly using deep learning methods … noise. Moreover, due to the need of word segmentation, the vocabulary is much larger than that in English …
A novel approach to generate a large scale of supervised data for short text sentiment analysis
X Sun, J He – Multimedia Tools and Applications, 2020 – Springer
… Data-driven representation learning via deep learning model is effective in many field of application such as text classification, chatbot,speech recognition … each input sample sentence S(w 1 ,w 2 …w m ), we use IK Analyzer Footnote 3 to conduct word segmentation and stitch …
Enhancing Multi-turn Dialogue Modeling with Intent Information for E-Commerce Customer Service
R Liu, M Chen, H Liu, L Shen, Y Song, X He – … International Conference on …, 2020 – Springer
… Then, we adopt Jieba 3 toolkit to perform Chinese word segmentation … Sequential matching network: a new architecture for multi-turn response selection in retrieval-based chatbots … Yan, Z., et al.: Docchat: an information retrieval approach for chatbot engines using unstructured …
An Experimental Study of Deep Neural Network Models for Vietnamese Multiple-Choice Reading Comprehension
ST Luu, K Van Nguyen, AGT Nguyen… – arXiv preprint arXiv …, 2020 – arxiv.org
… In this paper, we use the Pyvi tool2 for word segmentation. Table II shows statistical information about the ViMMRC corpus … One of the potential applications is building a chat- bot in which can understand humans’ reading texts and answer the questions based on reading texts …
Improvement of a dedicated model for open domain persona-aware dialogue generation
Q Han – arXiv preprint arXiv:2008.11970, 2020 – arxiv.org
… 2https://github.com/huggingface/transformers/tree/master/exam 3The chatbot has specific and fixed personality … Instead, we uses word segmentation and memory mecha- nism to process it, result in better performance, and … Towards a Human-like Open-Domain Chat- bot. 2020 …
Research and implementation of intelligent question answering system based on knowledge Graph of traditional Chinese medicine
Y Zou, Y He, Y Liu – 2020 39th Chinese Control Conference …, 2020 – ieeexplore.ieee.org
… graph-based question answering system is better at answering knowledge questions What differs from template-based chat bots is that it … algorithm implementation corpus of word segmentation and part-of-speech tagging, and then build more detailed knowledge of TCM graph …
A fusion model for multi-label emotion classification based on BERT and topic clustering
F Ding, X Kang, S Nishide, Z Guan… – … Symposium on Artificial …, 2020 – spiedigitallibrary.org
… and other fields. As a important branch of affective computing, emotion classification is also an upstream task of many other NLP tasks, such as style transfer, 6,7 emotional text generation, 8 and chatbot. 9. However, text emotion …
Mandarinograd: A Chinese Collection of Winograd Schemas
T Bernard, T Han – Proceedings of The 12th Language Resources and …, 2020 – aclweb.org
… b. Who were so [advanced/stupid]? c. the chatbots/the judges … Ad- ditionally, there is no agreement between a verb and its subject. Tense or mode are marked with particles that are not part of the verbs (at least not with the word segmentation scheme that we use) …
Latent emotion memory for multi-label emotion classification
H Fei, Y Zhang, Y Ren, D Ji – Proceedings of the AAAI Conference on …, 2020 – ojs.aaai.org
… Automatically inferencing the emotions is the initial step for downstream applications such as emotional chatbots (Zhou et al … 1For Chinese, we perform word segmentation first, by using the gensim package: https://radimrehurek.com/gensim 2http://nlp.stanford.edu/projects/glove …
Improving Sequence Tagging for Vietnamese Text Using Transformer-based Neural Models
VB The, OT Thi, P Le-Hong – arXiv preprint arXiv:2006.15994, 2020 – arxiv.org
… in the Vietnamese language processing community.5 A variant and more advanced version of this model is currently deployed as a core component of our commercial chatbot engine FPT.AI … [12] DQ Nguyen, “A neural joint model for vietnamese word segmentation, POS tagging …
Dynamic Updating of the Knowledge Base for a Large-Scale Question Answering System
XY Liu, Y Zhang, Y Liao, L Jiang – ACM Transactions on Asian and Low …, 2020 – dl.acm.org
… that are suitable for many common occasions, and this feature enables the ability to deploy chatbots for a … First, we conduct word segmentation to build an inverted index for the set of all QA pairs in the KB … The AL-B has been applied to our chatbot in the real-word and it uses bold …
Management of Data in AI Age
A Kaur, AM Aslam, M Wiberg, PK Paul, A Bhuimali… – 2020 – books.google.com
… AI powered chat bots are helping the customers to provide the services. Chatbot named Erica- A virtual financial assistant was piloted by Bank of America in the year 2017 which made available in June 2018 to download the Erica app …
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings
T Cohn, Y He, Y Liu – Proceedings of the 2020 Conference on Empirical …, 2020 – aclweb.org
… Optimizing Word Segmentation for Downstream Task Tatsuya Hiraoka, Sho Takase, Kei Uchiumi, Atsushi Keyaki and Naoaki Okazaki … Filtering before Iteratively Referring for Knowledge- Grounded Response Selection in Retrieval-Based Chatbots Jia-Chen Gu, Zhenhua Ling …
New vietnamese corpus for machine readingcomprehension of health news articles
K Van Nguyen, DV Nguyen, AGT Nguyen… – arXiv preprint arXiv …, 2020 – arxiv.org
… has few studies so far, although it could be implemented into various potential for practical appli- cations such as chatbot and virtual … 6We used the pyvi library https://pypi.org/project/pyvi/ for word segmentation to calculate the average, maximum and minimum lengths of articles …
The Construction and Annotation of a Semantically Enriched Database: The Mandarin VerbNet and Its NLP Applications
M Liu – From Minimal Contrast to Meaning Construct, 2020 – Springer
… Earlier efforts in linguistic annotation and automatic processing of word segmentation, POS tagging, and syntactic parsing have achieved quite impressive results … For instance, in developing chatbots, it requires good semantic matching and identification of discourse acts …
KnowPoetry: A Knowledge Service Platform for Tang Poetry Research Based on Domain-Specific Knowledge Graph
L Hong, W Hou, L Zhou – Library Trends, 2020 – muse.jhu.edu
… 2010. “A Chinese Word Segmentation Algorithm Based on Maximum Entropy.” In International Conference on Machine Learning and Cybernetics (ICMLC), Qingdao, IEEE, 1264–67 … “The Design and Implementation of XiaoIce, an Empathetic Social Chatbot.” arXiv:1812.08989 …
Language Modeling for Journalistic Robot based on Generative Pretrained Transformer 2
RH Suraperwata, S Suyanto – 2020 8th International …, 2020 – ieeexplore.ieee.org
… They are then widely applied for images, text, sound, and video, such as text summarization [8], [9], chatbot [10], [11], [12], image captioning [13], classification of snake … 2) BLEU is language independent for evaluating and tuning text, but not for word segmentation decisions …
A Hybrid GCN and RNN Structure Based on Attention Mechanism for Text Classification
L Gao, J Wang, Z Pi, H Zhang, X Yang… – Journal of Physics …, 2020 – iopscience.iop.org
… Common machine translations, Chatbot and human-computer conversations are all the applications of natural language processing … toolkit developed by the Natural Language Processing Group of Fudan University, including Chinese word segmentation, named entity …
A Vietnamese Dataset for Evaluating Machine Reading Comprehension
K Van Nguyen, DV Nguyen, AGT Nguyen… – arXiv preprint arXiv …, 2020 – arxiv.org
… such as question answering, next-generation search engines, intelligent agents (Alexa, Google Assistant, Siri, and Cortana), chatbots and robots … io/page/computing-wikipedias-internal- pageranks 6We use the pyvi library https://pypi.org/project/pyvi/ for word segmentation …
Deep Learning Development Status in China
… Academy of Engineering chenliang@ wri. com … – The Development of …, 2020 – Springer
… Traditional NLU consists of various techniques including word segmentation, part-of-speech tagging (ie, identifying a word as a noun, verb, or preposition, etc.), named entity recognition (such as people, places, and organizations) and syntactic parsing and semantic analysis …
Analysis of the communication of smart city features through social media
JP Fontanilles – deim.urv.cat
… 10 3.1.5. n-gram collocation model….. 11 3.1.6. Word segmentation ….. 12 3.2 … 12 Table 5: Word segmentation example ….. 13 …
Topic-enhanced capsule network for multi-label emotion classification
H Fei, D Ji, Y Zhang, Y Ren – IEEE/ACM Transactions on Audio …, 2020 – ieeexplore.ieee.org
… in natural language processing (NLP) [1]–[5], which facil- itates a wide range of downstream applications such as chat- bots [6], [7 … Available: https://code.google.com/archive/p/word2vec/ 3For Chinese, we perform word segmentation first, by using the gen- sim package: [Online] …
Efficient Urdu Caption Generation using Attention based LSTMs
I Ilahi, HMA Zia, A Ehsan, R Tabassam… – arXiv preprint arXiv …, 2020 – arxiv.org
… 1*** This is a project report for the Deep Learning Course (Spring 2020) being taught at Information Technology University, Lahore, Pak- istan *** automated chat-bots in native languages … [9] propose a good workflow of Urdu lan- guage word segmentation …
A survey of state-of-the-art approaches for emotion recognition in text
N Alswaidan, MEB Menai – Knowledge and Information Systems, 2020 – Springer
Page 1. Knowledge and Information Systems https://doi.org/10.1007/s10115-020-01449- 0 REGULAR PAPER A survey of state-of-the-art approaches for emotion recognition in text Nourah Alswaidan1 · Mohamed El Bachir Menai1 …
KddRES: A Multi-level Knowledge-driven Dialogue Dataset for Restaurant Towards Customized Dialogue System
H Wang, M Li, Z Zhou, KF Wong – arXiv preprint arXiv:2011.08772, 2020 – arxiv.org
… Rose Mocha” instead of ”Tofu Cheese”, ”Rose” and ”Mocha”; For the second issue, the chatbot can usually … a pre-trained model like BERT(Devlin et al., 2018) but it also adds word segmentation information … From eliza to xiaoice: Challenges and opportunities with social chatbots …
Image to Modern Chinese Poetry Creation via a Constrained Topic-aware Model
L Wu, M Xu, S Qian, J Cui – ACM Transactions on Multimedia Computing …, 2020 – dl.acm.org
… on. It can also enrich the function of chatbot system on phone/tablet/PC terminals … In Reference [47], Xing et al. proposed to generate interesting responses for chatbots by incorporating topic words in the sequence model [35]. Therefore …
Do cognitive and affective expressions matter in purchase conversion? A live chat perspective
L Kang, CH Tan, JL Zhao – Journal of the Association for …, 2020 – Wiley Online Library
… Especially, with the advancement of artificial intelligence, chatbots (also known as smart bots, IM bots, or artificial conversational entity) are replacing human representatives to chat with customers in many business cases (Ho, Hancock, & Miner, 2018) …
Target Guided Emotion Aware Chat Machine
W Wei, J Liu, X Mao, G Guo, F Zhu, P Zhou… – arXiv preprint arXiv …, 2020 – arxiv.org
… In fact, several empirical studies have proven that chatbots with the ability of emotional communication with humans are essential for enhancing user satisfaction [2, 22, 29]. To this end, it is highly valuable and desirable to develop an emotion-aware chatbot that is capable of …
Protein Sequence Classification using Machine Learning and Deep Learning
SS Siddha – 2020 – norma.ncirl.ie
… NLP involves understanding, analysing and processing of human language. With the advancement in Machine Learning techniques, NLP is used primarily in different organizations for chatbots, sentiment analysis, market intelligence, etc …
Matching Questions and Answers in Dialogues from Online Forums
Q Jia, M Zhang, S Zhang, KQ Zhu – arXiv preprint arXiv:2005.09276, 2020 – arxiv.org
… 5.3 Implementation Details We use Jieba9 to do Chinese word segmentation and pre-train the 100 dimentional word embeddings with Skip-gram model [24] on all of the dialogues (including the unlabeled ones) we have collected online …
Active Aging AI Community Care Ecosystem Design
HT Tseng, HH Huang, CC Hsieh – International Conference on Human …, 2020 – Springer
… Finally, through the integrated application of chatbots, they interact with the elders and retain … Finally, the development of a chatbot model and the analysis results of the … and negative scores of each sentence, combined with the Chinese word segmentation system developed by …
Text?based emotion detection: Advances, challenges, and opportunities
FA Acheampong, C Wenyu… – Engineering …, 2020 – Wiley Online Library
… These include the detection and offering of untimely assistance to individuals who may be considered suicidal,7, 8 detecting insulting sentences in conversations,10 chatbots for psychiatric counseling,29 and so on, although these are still at their infantile stage …
Best way for collecting data for low-resourced languages
H Karim – 2020 – diva-portal.org
… among multiple strategies, including those that employ only target language speech data and some that utilize transcribed speech from other languages, and assess by the means of two intrinsic measures and a downstream unsupervised word segmentation and clustering task …
The art of natural language processing: classical, modern and contemporary approaches to text document classification
A Ferrario, M Naegelin – … to Text Document Classification (March 1 …, 2020 – papers.ssrn.com
… notifications, as well as the possibility of recording customers’ interactions with corporate con- versational assistants (‘chatbots’), provide data … have to take care of punctuation (eg commas, periods, apostrophes and hyphens), language specific word segmentation rules and …
ReBoost: a retrieval-boosted sequence-to-sequence model for neural response generation
Y Zhu, Z Dou, JY Nie, JR Wen – Information Retrieval Journal, 2020 – Springer
Human–computer conversation is an active research topic in natural language processing. One of the representative methods to build conversation syste.
On the Generation of Medical Dialogues for COVID-19
W Yang, G Zeng, B Tan, Z Ju, S Chakravorty… – arXiv preprint arXiv …, 2020 – arxiv.org
… In this work, we develop mod- els directly on Chinese characters without performing word segmentation … GPT2-chitchat5 is a GPT-2 model pretrained on Chinese Chatbot Corpus6 which contains about 14M dialogues and 500k-Chinese-Dialog7 which contains 500K Chinese …
DEEP NEURAL NETWORK MODELS FOR SEQUENCE LABELING AND COREFERENCE TASKS
BM Sergeevich – mipt.ru
… 3.9 Annotating step of a voice-enabled chatbot … attention from researchers and widely covered in the media. 1966 ELIZA ELIZA was one of the earliest chatbots, developed by Joseph … Speech (POS), Speech Recognition, as well as Word Segmentation. Therefore, solving the …
A systematic review of automatic question generation for educational purposes
G Kurdi, J Leo, B Parsia, U Sattler… – International Journal of …, 2020 – Springer
While exam-style questions are a fundamental educational tool serving a variety of purposes, manual construction of questions is a complex process that req.
TECo: Automatic Selection and Adaptation of Creative Text in Context
RPP Mendes – 2020 – estudogeral.sib.uc.pt
… 1.1 Context While it is obvious that computers have not yet achieved the full capability of commu- nicating exclusively in natural language, there have been many attempts, such as chatbots or mobile phone personal assistants (eg Siri, Alexa,…) …
EXPLOITING AREA-SPEED-POWER TRADEOFF OF FPGA DESIGNS ON MULTILAYER PERCEPTRON (MLP) NEURAL NETWORK
A Reed – 2020 – uhcl-ir.tdl.org
Page 1. Copyright by April Reed 2020 Page 2. EXPLOITING AREA-SPEED-POWER TRADEOFF OF FPGA DESIGNS ON MULTILAYER PERCEPTRON (MLP) NEURAL NETWORK by April Lora Reed, MS THESIS Presented to the Faculty of The University of Houston-Clear Lake …
Practical Machine Learning in JavaScript
C Gerard – Springer
Page 1. Practical Machine Learning in JavaScript TensorFlow.js for Web Developers — Charlie Gerard Page 2. Practical Machine Learning in JavaScript TensorFlow.js for Web Developers Charlie Gerard Page 3. Practical Machine …
Natural Language Interfaces to Databases: A Survey on Recent Advances
G Rivera Zarate – Instituto de Ingeniería y Tecnología, 2020 – 148.210.21.170
… Mexico Chapter 5 ChatbotfortheImprovementofConversationalSkillsofJapaneseLanguage Learners … Mexico Chapter 6 DevelopingChatbotsforSupportingHealthSelf-Management …
ARTIFICIAL INTELLIGENCE (AI) APPLICATIONS IN AUTOMATING CUSTOMER SERVICES AND EMPLOYEE SUPERVISION
S Tong – 2020 – scholarshare.temple.edu
… 20. The Flow of Python “Jieba” Package for Word Segmentation …..113 21 … when they know that their conversational partner is not human because they perceive the disclosed AI chatbots as less empathetic. I uncover two mechanisms of AI voicebots’ …
A Sentiment Analysis model to evaluate people’s opinion about artificial intelligence
MNS Buzaglo – 2020 – run.unl.pt
… Although the majority of the European languages has whitespaces as delimiters of tokens, there are many languages such as Japanese and Chinese that do not use word spaces. So, in such languages, word segmentation is a much more major and challenging task …
Artificial Intelligence in a Throughput Model: Some Major Algorithms
W Rodgers – 2020 – books.google.com
… APPLICATIONS Image recognition, speech recognition, chatbots, natural language generation … Further, chatbots are already becoming part of big business. Chatbots are implemented to replace automated telephone systems …
Using ePUB3 eBook-based SNS to Enhance Students’ Learning Effects in Flipped Classes
TP Tsai, J Lin, C Hsu – Journal of Internet Technology, 2020 – jit.ndhu.edu.tw
… The ‘TF-IDF’ and ‘TextRank’ schemes provided by the ‘Jieba’ Chinese word segmentation program module [31] is used to extract the keywords in their … [20] S. Pérez-Soler, E. Guerra, J. de Lara, Collaborative Modeling and Group Decision Making Using Chatbots in Social …
Multilingual identification of offensive content in social media
M Pàmies Massip – 2020 – diva-portal.org
… Among the applications of NLP are machine translators, spell checkers, virtual assistants, chatbots and interactive voice response applications … In addition, word segmentation is performed using the WordPiece algorithm [65], which initialises a vocabulary with single characters …
Adaptive Fusion Techniques for Effective Multimodal Deep Learning
G Sahu – 2020 – uwspace.uwaterloo.ca
Page 1. Adaptive Fusion Techniques for Effective Multimodal Deep Learning by Gaurav Sahu A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master of Mathematics in Computer Science Waterloo, Ontario, Canada, 2020 …
Natural Language Processing and Chinese Computing: 9th CCF International Conference, NLPCC 2020, Zhengzhou, China, October 14-18, 2020 …
X Zhu, M Zhang, Y Hong, R He – 2020 – books.google.com
Page 1. Xiaodan Zhu Min Zhang Yu Hong Ruifang He (Eds.) Natural Language Processing and Chinese Computing 9th CCF International Conference, NLPCC 2020 Zhengzhou, China, October 14–18, 2020 Proceedings, Part I 123 Page 2 …
Does Language Drive the Crowd? Case of Czech Reward-Based Crowdfunding
T Hudcová – 2020 – dspace.cuni.cz
Page 1. CHARLES UNIVERSITY FACULTY OF SOCIAL SCIENCES Institute of Economic Studies Does Language Drive the Crowd? Case of Czech Reward-Based Crowdfunding Master’s thesis Author: Bc. Tereza Hudcová Study program: Economics and Finance …
Machine Learning analysis of text in a Clinical Decision Support System
D Gharam – 2020 – diva-portal.org
… Goal: language modeling, predicting previous or upcoming words, text generation • Application: translation, chat bots and predict POS tags for each word in sequence … and building words at a character level can help avoid events such as “word segmentation” and …