- 2020-02-18 20:34
*views 17*- PyTorch
- BCEWithLogitsLoss
- BCELoss

stay Pytorch in ,BCELoss and BCEWithLogitsLoss It is a set of commonly used binary cross entropy loss functions , It is often used in binary classification , The difference is that the input of the former is done

sigmoid Processed value , The latter is sigmoid function 1 1 + exp ( − x ) \frac{1}{1+\exp(-x)} 1+exp(−x)1

In x x x.

Here is a simple example ：

import torch import torch.nn as nn predicts = torch.tensor([[0.4,0.7,1.2,0.3],

[1.1,0.6,0.9,1.6]]) labels = torch.tensor([[1,0,1,0],[0,1,1,0]],

dtype=torch.float) # adopt BCELoss calculation sigmoid Processed value criterion1 = nn.BCELoss() loss1=

criterion1(torch.sigmoid(predicts), labels) # adopt BCEWithLogitsLoss Directly calculate the input value

criterion2 = nn.BCEWithLogitsLoss() loss2 = criterion2(predicts, labels) #

You'll find out loss1=loss2

BCELoss and BCEWithLogitsLoss Two important parameters are also provided ：

* weight： It can be used to control the weight of each sample , It is often used to align the data mask operation （ Set to 0）

* reduction

： Control loss output mode . Set to "sum" Represents the loss sum of the sample ; Set to "mean" Represents the average of the sample losses ; And set to "none" It means to calculate the loss of samples one by one , The relationship between output and input shape equally .

in addition BCEWithLogitsLoss Parameters are also provided pos_weight For setting losses class weight , To alleviate the imbalance of samples .

Technology

- Python122 blogs
- Java114 blogs
- Flow Chart79 blogs
- Vue66 blogs
- MySQL35 blogs
- javascript33 blogs
- programing language33 blogs
- Linux32 blogs
- more...

Daily Recommendation

views 7

©2020 ioDraw All rights reserved

【webpack】DLL plugin Principle analysis Combined with source code Transformer The most comprehensive , The deepest analysis filemanager-webpack-plugin Turn resources into zip Package and archive JavaScript study （ Function declaration and parameters ） mean value - Implementation and application of variance model _python_ Data analysis _9JAVA Snake games （ Source code + notes ）SpringBoot integrate Redisson Implement delay queue python code , Easy to complete Snake games Thread.setDaemon Set up the Daemons Unity Code dynamic creation of preform in editor expansion function