All Questions
7 questions
0
votes
1
answer
52
views
Would a neural network trained on extracted features have the same accuracy as a full network with frozen layers?
Let's say that I train two neural networks on the exact same dataset.
The first network is a VGG19 model with frozen convolutional layers so only the top dense ...
0
votes
1
answer
177
views
which scoring function for validation_curve (regression)?
Is there any thumb of rule which scoring function should be used for e.g. the validation_curve?
Atm I try to study the difference between several optimizers:
...
3
votes
3
answers
565
views
Choosing an optimizer to perfectly fit a neural networks to training data
In short, my query is: Which optimizer(s) should one choose to experiment for a fully connected neural network if she wants perfect fitting (mae < 1e-04) on the training data?
Details: In my ...
2
votes
2
answers
3k
views
How to deal with a constant value as an output from neural network?
I am using feedforward neural network for regression and what I get as a result of prediction is a constant value visible on the graph below:
Data I use are typical standardised tabular numbers. The ...
1
vote
1
answer
319
views
Optimization based on validation and not training
Hello neural network programmers,
I am currently creating a neural network with keras, as I am not that familiar with tensorflow and it's a bit more difficult.
I want my optimization to optimize the ...
9
votes
1
answer
14k
views
clipping the reward for adam optimizer in keras
I would like to clip the reward in keras. I saw it is possible to clip the norm and clip the value is sgd as follows:
...
6
votes
1
answer
3k
views
Loss function for optimising precision & recall / sensitivity & specificity?
I've been using precision and recall as my metrics, as per keras-team/keras/pull/9393/files
Sensitivity & specificity is what I want to optimise for. Every epoch I output it:
...