Transformer source code explanation (PyTorch) that ordinary people can understand
PyTorch chapter of Transformer source code interpretation
chapter
Word embeddingLocation codingLong attentionBuild Transformer
Insert picture description here
Word embedding
Transformer is essentially an Encoder. Taking the translation task as an example, the original data set is composed of one line in two languages. In application, ...
Added by ChetUbetcha on Tue, 08 Feb 2022 17:36:24 +0200
How to improve the classification accuracy of cifar-10 data set
How to improve the classification accuracy of cifar-10 data set
1, Problem description
When dealing with image recognition or image classification or other machine learning tasks, we are always confused about what improvements can improve the performance of the model (recognition rate, classification accuracy)... Or what parameters are we adj ...
Added by alex2046 on Tue, 08 Feb 2022 12:10:37 +0200
Python - Deep Learning Series 22 - Electra parallel processing modification
explain
The scene is entity recognition. The original version is one by one prediction, which is too inefficient. Here it is changed to parallel prediction.
content
1 processing flow
For each document (from a sentence to a large article), we need to cut sentences first. The goal is to generate short sentences (SS), which will be the input p ...
Added by makeshift_theory on Tue, 08 Feb 2022 04:21:48 +0200
MobileNet actual combat: tensorflow2 Version x, MobileNetV3 image classification task (small data set)
abstract
This example extracts part of the data in the plant seedling data set as the data set. The data set has 12 categories. Today, I work with you to implement tensorflow2 For the X version image classification task, the classification model uses MobileNetV3.
Through this article, you can learn:
1. Understand the characteristics of M ...
Added by daggardan on Sun, 06 Feb 2022 04:09:22 +0200
[wsl2 windows10/11 installation configuration cuda and pytorch]
Reference
Configure Cuda and Pytorch under Windows 11/10 WSL2 Ubuntu 20.04
Official Installation of wsl2 Official wsl2 connection gpu This article is basically a synthesis of some of the above articles, which I did not intend to post, but I even paid a system price for it since I really referenced too many experience stickers to compl ...
Added by srboj on Sat, 05 Feb 2022 19:46:20 +0200
Application of transfer learning in breast cancer detection
Multiscale perception V3 method with efficient fine tuning
introduce
Every year, there are more than 230 people in the United States,000 The diagnosis of a person with breast cancer depends on whether the cancer has metastases. Metastasis detection is performed by pathologists examining large areas of biological tissue. This process is labo ...
Added by TheDumbNerd on Sat, 05 Feb 2022 12:32:17 +0200
Hand in hand to teach you face recognition, hand on the line
application area
Financial sector. At present, face recognition is the most widely used in the financial field. At present, the domestic financial field has strict regulatory requirements. Financial related products need real name authentication and have high security requirements. Living body recognition, bank card ocr recognition, ID card o ...
Added by lxndr on Sat, 05 Feb 2022 10:29:07 +0200
Introduction to detectron2 learning 2: realize the conversion between Mask and coco format of FruitsNut fruit and nut segmentation task data set
Learning objectives:
Convert the data set into Mask, coco annotation and other different formats
1, The coco annotation and Mask of a single instance are converted to each other:
There are many ways of mask conversion. One mask is generated for each instance or one mask is generated for each picture. For beginners, it is better to use the ...
Added by secret007 on Sat, 05 Feb 2022 04:02:13 +0200
Deep Learning Notes 017 Convolution Layer
In a word, convolution layer is actually a kind of filter. It makes sense to enlarge its interest and reduce its uninteresting.
Mathematical representation of a two-dimensional convolution layer:
The W here is actually the kernel, the parameter that you learned here in this way, and what you see is a matrix. b is deviation and acts on Y by ...
Added by Shai-Hulud on Fri, 04 Feb 2022 20:08:06 +0200
Summary of face alignment and face key point detection based on Tensorflow framework with code (continuously updated)
Summary of face alignment and face key point detection based on Tensorflow framework with code (continuously updated)
Summary of face detection based on Tensorflow framework with code (continuously updated) Summary of face matching based on Tensorflow framework with code (continuously updated)
recently used the open sourc ...
Added by NotMrT on Fri, 04 Feb 2022 09:10:23 +0200