Transformer source code explanation (PyTorch) that ordinary people can understand

PyTorch chapter of Transformer source code interpretation chapter Word embeddingLocation codingLong attentionBuild Transformer Insert picture description here Word embedding Transformer is essentially an Encoder. Taking the translation task as an example, the original data set is composed of one line in two languages. In application, ...

Added by ChetUbetcha on Tue, 08 Feb 2022 17:36:24 +0200

How to improve the classification accuracy of cifar-10 data set

How to improve the classification accuracy of cifar-10 data set 1, Problem description When dealing with image recognition or image classification or other machine learning tasks, we are always confused about what improvements can improve the performance of the model (recognition rate, classification accuracy)... Or what parameters are we adj ...

Added by alex2046 on Tue, 08 Feb 2022 12:10:37 +0200

Python - Deep Learning Series 22 - Electra parallel processing modification

explain The scene is entity recognition. The original version is one by one prediction, which is too inefficient. Here it is changed to parallel prediction. content 1 processing flow For each document (from a sentence to a large article), we need to cut sentences first. The goal is to generate short sentences (SS), which will be the input p ...

Added by makeshift_theory on Tue, 08 Feb 2022 04:21:48 +0200

MobileNet actual combat: tensorflow2 Version x, MobileNetV3 image classification task (small data set)

abstract This example extracts part of the data in the plant seedling data set as the data set. The data set has 12 categories. Today, I work with you to implement tensorflow2 For the X version image classification task, the classification model uses MobileNetV3. Through this article, you can learn: 1. Understand the characteristics of M ...

Added by daggardan on Sun, 06 Feb 2022 04:09:22 +0200

[wsl2 windows10/11 installation configuration cuda and pytorch]

Reference Configure Cuda and Pytorch under Windows 11/10 WSL2 Ubuntu 20.04 Official Installation of wsl2 Official wsl2 connection gpu This article is basically a synthesis of some of the above articles, which I did not intend to post, but I even paid a system price for it since I really referenced too many experience stickers to compl ...

Added by srboj on Sat, 05 Feb 2022 19:46:20 +0200

Application of transfer learning in breast cancer detection

Multiscale perception V3 method with efficient fine tuning introduce Every year, there are more than 230 people in the United States,000 The diagnosis of a person with breast cancer depends on whether the cancer has metastases. Metastasis detection is performed by pathologists examining large areas of biological tissue. This process is labo ...

Added by TheDumbNerd on Sat, 05 Feb 2022 12:32:17 +0200

Hand in hand to teach you face recognition, hand on the line

application area Financial sector. At present, face recognition is the most widely used in the financial field. At present, the domestic financial field has strict regulatory requirements. Financial related products need real name authentication and have high security requirements. Living body recognition, bank card ocr recognition, ID card o ...

Added by lxndr on Sat, 05 Feb 2022 10:29:07 +0200

Introduction to detectron2 learning 2: realize the conversion between Mask and coco format of FruitsNut fruit and nut segmentation task data set

Learning objectives: Convert the data set into Mask, coco annotation and other different formats 1, The coco annotation and Mask of a single instance are converted to each other: There are many ways of mask conversion. One mask is generated for each instance or one mask is generated for each picture. For beginners, it is better to use the ...

Added by secret007 on Sat, 05 Feb 2022 04:02:13 +0200

Deep Learning Notes 017 Convolution Layer

In a word, convolution layer is actually a kind of filter. It makes sense to enlarge its interest and reduce its uninteresting.   Mathematical representation of a two-dimensional convolution layer:   The W here is actually the kernel, the parameter that you learned here in this way, and what you see is a matrix. b is deviation and acts on Y by ...

Added by Shai-Hulud on Fri, 04 Feb 2022 20:08:06 +0200

Summary of face alignment and face key point detection based on Tensorflow framework with code (continuously updated)

Summary of face alignment and face key point detection based on Tensorflow framework with code (continuously updated)    Summary of face detection based on Tensorflow framework with code (continuously updated)    Summary of face matching based on Tensorflow framework with code (continuously updated)    recently used the open sourc ...

Added by NotMrT on Fri, 04 Feb 2022 09:10:23 +0200