Programming VIP

CaDDN code debugging - my computer I translated CaDDN, Link address Let's talk about the configuration of my computer first: HP shadow sprite 5 Dual system: win10 + ubuntu 1804 (the later code debugging process is carried out in ubuntu system) Memory: 8+16G () Hard disk: 512G SSD + 1TB mechanical Graphics card: RTX 2060 (6G) 1. Env ...

Tensor detach() This is used when you want to freeze some parameters in the network model and do not participate in training. And it will return a new tensor. y = x.detach() In this case, y and X share the same memory, that is, one will change and the other will change. At this point, X can still take its derivative normally. So x = x.deta ...

1. The Role of File Operations Storing some data allows the program to be used directly the next time it executes without having to make a new copy, which saves time and effort. 2. Basic Operation of Files 2.1 File operation steps 1. Open the file 2,. Read and write operations 3. Close the file 2.1. 1 Open Using the open function, open an ex ...

Supervised learning is a traditional method of training machine learning model. During training, every observed data needs to be labeled. What if we had a way to train machine learning models without collecting labels? What if we extract tags from the same data collected? This type of learning algorithm is called self supervised learning. This ...

Recently tried to use HuggingFace 🤗 The transformers library fine tuned the Bert text classification under pytorch, and found many Chinese blog s, mainly for the processing of data. There is no detailed description, and I don't know how to deal with the format of dataset, so I make a record here.Dependent packagepytorchtransformersscikit-learn ...

7. Loss function loss Loss usually refers to the difference between the predicted value and the real value of the output of the neural network, which is used to: ① Calculate the gap between the actual output and the target ② Provide some basis for us to update the output (back propagation) For example: the specific definitions of each functio ...

2021SC@SDUSC preface This article analyzes torch in yolov5 code_ Utils.py file is mainly some encapsulated tool classes. torch_distributed_zero_frist function @contextmanager def torch_distributed_zero_first(local_rank: int): """ Decorator to make all processes in distributed training wait for each local_master to do something. ...

[source code analysis] PyTorch distributed optimizer (1) -- Cornerstone 0x00 summary Let's look at the distributed optimizer in a few articles. This series is divided into three articles: the cornerstone, the data parallel optimizer in DP/DDP/Horovod, and the PyTorch distributed optimizer, which are progressive in depth. This article is ...

order It took me so long to help the teacher with a new topic, but fortunately, the bug that could not be detected before yolov3 has been repaired. After 3-4 days of discontinuous debug ging and thinking, I feel that I have a deeper understanding of yolov3's detection framework, including the format of pytorch data, the transmission of data in ...

Original address: pytorch_lightning whole journey notes - Zhihu preface This article will be updated continuously. After my algorithm is trained, I will write another record about the experience of pytorch lightning in reinforcement learning. There's already a lot about pytorch_lightning (pl). In a word, this framework is really fragrant, in ...