PaddleNLP+Paddlehub create your venting robot

Chat robot Chat robots can be used for practical purposes, such as customer service or information acquisition. Some chat robots will be equipped with natural language processing systems, but most simple systems will only retrieve the input keywords and find the most appropriate response sentences from the database. Chat robots are part of vir ...

Added by Leonardo Dantas on Mon, 03 Jan 2022 01:19:05 +0200

"Python instance" was shocked and realized the dirty words and advertisement detection of the chat system in Python

catalogue 1. Demand analysis: 2. Algorithm principle: 3. Technical analysis 4. Source code 5. Expand 6. Problems encountered 7. Summary: Like to watch and form a habit In the game, the chat function is almost a necessary function. There are some problems with this function, that is, it will cause the world channel to be very chao ...

Added by EriRyoutan on Sun, 02 Jan 2022 14:36:54 +0200

Part of speech prediction by Python note42 LSTM

Part of speech prediction by Python note42 LSTM Summary of all notes: Pytoch note Happy Planet Model introduction For a word, there will be different parts of speech. First, we can make a preliminary judgment according to the suffix of a word. For example, the suffix - ly is very likely to be an adverb. In addition, a same word can repre ...

Added by nishmgopla on Sun, 02 Jan 2022 06:59:17 +0200

Emotion analysis based on support vector machine SVM and naive Bayesian NBM

1, Overview About 100000 microblog comments are used as training data. Data 1 represents positive comments and 0 represents negative comments. pandas and jieba are used to pre process the data. TFIDF vectorizes the processed data, and then uses support vector machine and naive Bayes to train the processed data set. The algorithm is implemented ...

Added by Stegs on Tue, 28 Dec 2021 15:14:29 +0200

Using deep learning model to perform text emotion analysis in Java

positive? inactive? Neutral? Sentences can be analyzed using the Stanford CoreNLP component and a few lines of code. This article describes how to implement such tasks in Java using emotion tools integrated into Stanford CoreNLP, an open source library for natural language processing. Stanford CoreNLP emotion classifier To perfor ...

Added by derrtyones on Mon, 27 Dec 2021 14:08:52 +0200

Summary of Study on Jieba Word Separation Code

2021SC@SDUSC Algorithms used for jieba word segmentation: Efficient word map scanning based on Trie tree structure generates a directed acyclic graph (DAG) of all possible word-forming situations of Chinese characters in a sentence. Dynamic programming is used to find the maximum probability path to find the maximum tangent combination based on ...

Added by OilSheikh on Mon, 27 Dec 2021 07:40:49 +0200

BART summary implementation

Refer to the original website[ https://github.com/pytorch/fairseq/blob/master/examples/bart/README.summarization.md ] Pre Training Model Download: Download the pre trained model Bart base. tar: [ https://dl.fbaipublicfiles.com/fairseq/models/bart.base.tar.gz ] Dataset Download: Download CNN/DM: http://cs.nyu.edu/~kcho/DMQA / (download sto ...

Added by mevasquez on Thu, 23 Dec 2021 22:57:31 +0200

Using transformers library to fine tune Bert for text classification

Recently tried to use HuggingFace 🤗 The transformers library fine tuned the Bert text classification under pytorch, and found many Chinese blog s, mainly for the processing of data. There is no detailed description, and I don't know how to deal with the format of dataset, so I make a record here.Dependent packagepytorchtransformersscikit-learn ...

Added by Calvin770D on Sat, 11 Dec 2021 10:46:23 +0200

Advanced deep learning: introduction to natural language processing: Chapter 3 word2vec

Chapter 3 word2vec The topic of this chapter is still the distributed representation of words. In the previous chapter, we obtained the distributed representation of words by using the counting based method. In this chapter, we will discuss the alternative method of this method, that is, the reasoning based method. As the name suggests, t ...

Added by lansing on Thu, 09 Dec 2021 15:31:47 +0200

Chinese English translation based on Transformer

Machine translation based on Transformer Machine translation is the process of using computers to convert one natural language (source language) into another natural language (target language). This project is the PaddlePaddle implementation of Machine Translation's mainstream model Transformer, including model training, prediction, and use o ...

Added by vent on Sun, 05 Dec 2021 02:21:57 +0200