Optimizer and training process (can't learn to hit me)

Learning Summary (1) Each optimizer is a class and must be instantiated before it can be used, for example: class Net(nn.Moddule): ··· net = Net() optim = torch.optim.SGD(net.parameters(), lr=lr) optim.step() (2) optimizer implements the following two steps in epoch of a neural network: Gradient zero, gradient update. optimizer = torch ...

Added by juhl on Sat, 16 Oct 2021 19:35:25 +0300

Explanation of BILSTM-CRF code

BILSTM-CRF code Code from Named entity recognition (NER): introduction to the principle of BiLSTM-CRF + pytoch_ Tutorial code parsing Part I: Guide Package 1.torch.nn package mainly contains Modules used to build each layer, such as full connection, two-dimensional convolution, pooling, etc; The torch.nn package also contains a series of usefu ...

Added by msurabbott on Fri, 15 Oct 2021 23:47:19 +0300

Easy understanding of torch.utils.data.DataLoader (for beginners)

Official explanation: Dataloader combines dataset & sampler to provide iterable data Main parameters: 1. Dataset: this dataset must be torch.utils.data.Dataset itself or a class inherited from it The main method is  __ getitem__(self, index) used to retrieve data according to the index index 2,batch_size: how many pieces of data sh ...

Added by nedpwolf on Fri, 15 Oct 2021 06:27:59 +0300

Text classification based on MLP

Recently, I learned the MLP, CNN and RNN network models based on pytoch framework, and conducted text classification experiments using the commodity comment data obtained on GitHub. This paper introduces how to establish MLP under the pytoch framework to classify the data. The data sets are roughly as follows: 1. Import module import pandas ...

Added by pagod on Thu, 14 Oct 2021 22:33:17 +0300

Detailed explanation of target detection using paddleX

preface Using Baidu's open source paddleX tool, we can easily and quickly train a deep network model of target detection, image classification, instance segmentation and semantic segmentation using our own labeled data. This paper mainly records how to use pddleX to train a simple ppyolo for detecting cats and dogs in the whole process_ Tiny m ...

Added by 01chris on Wed, 13 Oct 2021 21:42:36 +0300

Transformer hardware implementation part 3: supplement to pytoch basic knowledge

This article is a supplement to the knowledge of pytorch before training Transformer. Thank blogger Mo fan for his video course on Python https://www.youtube.com/watch?v=lAaCeiqE6CE&feature=emb_title , whose home page is: Don't bother Python It is recommended to directly watch the blogger's video tutorial to complete the knowledge suppleme ...

Added by unidox on Tue, 12 Oct 2021 21:42:29 +0300

Wu Enda's in-depth learning programming assignment section 1 - Revolution model step by step V1 / V2

1. Gradually construct convolution network The basic network architecture built this time: Note: for each forward propagation operation, there will be corresponding backward propagation. The parameters of forward propagation will be stored, and these parameters will be used to calculate the gradient in the backward propagation process. 2. Conv ...

Added by PHPBewildered on Tue, 12 Oct 2021 01:33:38 +0300

Two irregular quadrilateral IOU calculation methods

1 Introduction Our common target detection is rectangular box detection, but sometimes the box we detect is an irregular quadrilateral. The following figure is a common remote sensing image. At this time, the way we use rectangular box to calculate IOU is no longer applicable. We can abstract the problem. Is there a way to calculate two irregu ...

Added by jigsawsoul on Sat, 09 Oct 2021 09:44:45 +0300

[NLP] news topic classification task

preface Learning objectives Learn about news topic classification and relevant data Master the implementation process of constructing news topic classifier using shallow network About news topic classification tasks: Taking the text description content of a news report as the input, the model is used to help us judge which type of n ...

Added by ragear on Tue, 05 Oct 2021 22:26:59 +0300

[pytoch series-24]: neural network foundation - simple linear regression of single neuron without activation function - 2

  Author home page( Silicon based workshop of slow fire rock sugar): Slow fire rock sugar (Wang Wenbing) blog silicon based workshop of slow fire rock sugar _csdnblog Website of this article: https://blog.csdn.net/HiWangWenBing/article/details/120600611 catalogue Introduction deep learning model framework Chapter 1 business area analy ...

Added by ftrudeau on Sun, 03 Oct 2021 23:39:05 +0300