tensorflow MDA custom loss and ValueError: No gradients provided for any variable Question: I would like to use the MDA (mean direction accuracy) as a custom loss function for a tensorflow neural network. I am trying to implement this as described in here: Custom Mean Directional Accuracy loss function in Keras def mda(y_true, y_pred): s …
How to debug a custom loss function during model fitting? Question: I would like to see what is happening in my loss function during model fitting. However, I cannot figure out how to do that. This is what I am trying but it does not work: def custom_loss(label : tf.Tensor, pred : tf.Tensor) -> tf.Tensor: …
Interpreting the effect of LK Norm with different orders on training machine learning model with the presence of outliers Question: ( Both the RMSE and the MAE are ways to measure the distance between two vectors: the vector of predictions and the vector of target values. Various distance measures, or norms, are possible. Generally speaking, …
How to save/load a model checkpoint with several losses in Pytorch? Question: Using Ubuntu 20.04, Pytorch 1.10.1. I am trying to solve a music generation task with a transformer architecture and multi-embeddings, for processing tokens with several characteristics. In each training iteration, I have to calculate the loss of each token characteristic and store it …
Tensorflow: Issues with determining batch size in custom loss function during model fitting (batch size of "None") Question: I’m trying to create a custom loss function, in which I have to slice the tensors multiple times. One example is listed below: # Since different nodes need different activations, I decided to just do it like …
Keras Custom loss Penalize more when actual and prediction are on opposite sides of Zero Question: I’m training a model to predict percentage change in prices. Both MSE and RMSE are giving me up to 99% accuracy but when I check how often both actual and prediction are pointing in the same direction ((actual >0 …
Why is my loss function increasing with each epoch? Question: I’m new to ML, so I’m sorry if this is some stupid question anyone could have figured out. I am using TensorFlow and Keras here. So here’s my code: import tensorflow as tf import numpy as np from tensorflow import keras model = keras.Sequential([ keras.layers.Dense(units=1, …
how to add tensorflow loss functions? Question: I can not add these two losses as follows real_loss = tf.losses.BinaryCrossentropy(tf.ones_like(train_images[0]),train_images[0]) fake_loss = tf.losses.BinaryCrossentropy(tf.zeros_like(train_images[0]),train_images[0]) fake_loss+real_loss the error is: TypeError: unsupported operand type(s) for +: ‘BinaryCrossentropy’ and ‘BinaryCrossentropy’ Asked By: Ali N777 || Source Answers: You can just add them as multiple losses in model.compile model.compile(loss = [loss1,loss2], …
Define custom loss (perceptual loss) in CNN autoencoder with pre-train vgg19 tensorflow,Keras Question: i want to define perceptual_loss in autoencoder that build in keras. my autoencoder is look like this : Encoder: input_encoder = Input((32,32,3),name = ‘encoder_input’) encoder = Conv2D(16,(3,3),activation = ‘relu’,name = ‘encoder_layer1’)(input_encoder) encoder = Flatten(name = ‘encoder_layer2’)(encoder) latent_encoding = Dense(128 , activation = …
Size of y_true in custom loss function of Keras Question: I am trying to write a custom loss function for U-net in Keras and the objective of it is to compute not only the mean square error (MSE) of the predicted image and the true image, but also the MSE of their gradients. I am …
