Skip to main content

All Questions

Filter by
Sorted by
Tagged with
0 votes
1 answer
52 views

Would a neural network trained on extracted features have the same accuracy as a full network with frozen layers?

Let's say that I train two neural networks on the exact same dataset. The first network is a VGG19 model with frozen convolutional layers so only the top dense ...
FloppyC0de's user avatar
0 votes
1 answer
177 views

which scoring function for validation_curve (regression)?

Is there any thumb of rule which scoring function should be used for e.g. the validation_curve? Atm I try to study the difference between several optimizers: ...
Ben's user avatar
  • 570
3 votes
3 answers
565 views

Choosing an optimizer to perfectly fit a neural networks to training data

In short, my query is: Which optimizer(s) should one choose to experiment for a fully connected neural network if she wants perfect fitting (mae < 1e-04) on the training data? Details: In my ...
Bahauddin Omar's user avatar
2 votes
2 answers
3k views

How to deal with a constant value as an output from neural network?

I am using feedforward neural network for regression and what I get as a result of prediction is a constant value visible on the graph below: Data I use are typical standardised tabular numbers. The ...
GKozinski's user avatar
  • 131
1 vote
1 answer
319 views

Optimization based on validation and not training

Hello neural network programmers, I am currently creating a neural network with keras, as I am not that familiar with tensorflow and it's a bit more difficult. I want my optimization to optimize the ...
Keren's user avatar
  • 81
9 votes
1 answer
14k views

clipping the reward for adam optimizer in keras

I would like to clip the reward in keras. I saw it is possible to clip the norm and clip the value is sgd as follows: ...
user10296606's user avatar
  • 1,896
6 votes
1 answer
3k views

Loss function for optimising precision & recall / sensitivity & specificity?

I've been using precision and recall as my metrics, as per keras-team/keras/pull/9393/files Sensitivity & specificity is what I want to optimise for. Every epoch I output it: ...
A T's user avatar
  • 181