PaddleNLP+Paddlehub create your venting robot
Chat robot
Chat robots can be used for practical purposes, such as customer service or information acquisition. Some chat robots will be equipped with natural language processing systems, but most simple systems will only retrieve the input keywords and find the most appropriate response sentences from the database. Chat robots are part of vir ...
Added by Leonardo Dantas on Mon, 03 Jan 2022 01:19:05 +0200
"Python instance" was shocked and realized the dirty words and advertisement detection of the chat system in Python
catalogue
1. Demand analysis:
2. Algorithm principle:
3. Technical analysis
4. Source code
5. Expand
6. Problems encountered
7. Summary:
Like to watch and form a habit
In the game, the chat function is almost a necessary function. There are some problems with this function, that is, it will cause the world channel to be very chao ...
Added by EriRyoutan on Sun, 02 Jan 2022 14:36:54 +0200
Part of speech prediction by Python note42 LSTM
Part of speech prediction by Python note42 LSTM
Summary of all notes:
Pytoch note Happy Planet
Model introduction
For a word, there will be different parts of speech. First, we can make a preliminary judgment according to the suffix of a word. For example, the suffix - ly is very likely to be an adverb. In addition, a same word can repre ...
Added by nishmgopla on Sun, 02 Jan 2022 06:59:17 +0200
Emotion analysis based on support vector machine SVM and naive Bayesian NBM
1, Overview
About 100000 microblog comments are used as training data. Data 1 represents positive comments and 0 represents negative comments. pandas and jieba are used to pre process the data. TFIDF vectorizes the processed data, and then uses support vector machine and naive Bayes to train the processed data set. The algorithm is implemented ...
Added by Stegs on Tue, 28 Dec 2021 15:14:29 +0200
Using deep learning model to perform text emotion analysis in Java
positive? inactive? Neutral? Sentences can be analyzed using the Stanford CoreNLP component and a few lines of code.
This article describes how to implement such tasks in Java using emotion tools integrated into Stanford CoreNLP, an open source library for natural language processing.
Stanford CoreNLP emotion classifier
To perfor ...
Added by derrtyones on Mon, 27 Dec 2021 14:08:52 +0200
Summary of Study on Jieba Word Separation Code
2021SC@SDUSC Algorithms used for jieba word segmentation: Efficient word map scanning based on Trie tree structure generates a directed acyclic graph (DAG) of all possible word-forming situations of Chinese characters in a sentence. Dynamic programming is used to find the maximum probability path to find the maximum tangent combination based on ...
Added by OilSheikh on Mon, 27 Dec 2021 07:40:49 +0200
BART summary implementation
Refer to the original website[ https://github.com/pytorch/fairseq/blob/master/examples/bart/README.summarization.md ]
Pre Training Model Download: Download the pre trained model Bart base. tar: [ https://dl.fbaipublicfiles.com/fairseq/models/bart.base.tar.gz ]
Dataset Download: Download CNN/DM: http://cs.nyu.edu/~kcho/DMQA / (download sto ...
Added by mevasquez on Thu, 23 Dec 2021 22:57:31 +0200
Using transformers library to fine tune Bert for text classification
Recently tried to use HuggingFace 🤗 The transformers library fine tuned the Bert text classification under pytorch, and found many Chinese blog s, mainly for the processing of data. There is no detailed description, and I don't know how to deal with the format of dataset, so I make a record here.Dependent packagepytorchtransformersscikit-learn ...
Added by Calvin770D on Sat, 11 Dec 2021 10:46:23 +0200
Advanced deep learning: introduction to natural language processing: Chapter 3 word2vec
Chapter 3 word2vec
The topic of this chapter is still the distributed representation of words. In the previous chapter, we obtained the distributed representation of words by using the counting based method. In this chapter, we will discuss the alternative method of this method, that is, the reasoning based method.
As the name suggests, t ...
Added by lansing on Thu, 09 Dec 2021 15:31:47 +0200
Chinese English translation based on Transformer
Machine translation based on Transformer
Machine translation is the process of using computers to convert one natural language (source language) into another natural language (target language).
This project is the PaddlePaddle implementation of Machine Translation's mainstream model Transformer, including model training, prediction, and use o ...
Added by vent on Sun, 05 Dec 2021 02:21:57 +0200