Skip to content
#

neural-architecture-search

Here are 186 public repositories matching this topic...

nni
autokeras
jankrynauw
jankrynauw commented Jun 6, 2019

We would like to forward a particular 'key' column which is part of the features to appear alongside the predictions - this is to be able to identify to which set of features a particular prediction belongs to. Here is an example of predictions output using the tensorflow.contrib.estimator.multi_class_head:

{"classes": ["0", "1", "2", "3", "4", "5", "6", "7", "8", "9"],
 "scores": [0.068196
RudyChin
RudyChin commented Jun 25, 2020

Hi Jiahui,

Thanks for the great work. I'm trying to reproduce AutoSlim for CIFAR-10 (Table 2).
Could you please provide a detailed hyperparameter you used for it?

I'm able to train the baseline MobileNetV2 1.0x to 7.9 Top-1 error using the following hyperparameters:

  • 0.1 initial learning rate
  • linear learning rate decay
  • 128 batch size
  • 300 epochs of training
  • 5e-4 weight decay

A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hyperparameter Optimization, 5.) Automated Feature Engineering.

  • Updated Jun 19, 2021
Hyperactive
julycetc
julycetc commented Jan 8, 2020

In the code, it seems that you use the model stored in ema to do the validation and get the final result.Here i have two questions:
1.Why do you use the ema model to do the validation, but do not use the model_wrapper which is directely preuned?
2.Is it supposed that ema model will get better result than model_wrapper?And why?
Thanks very much for your reply!

Improve this page

Add a description, image, and links to the neural-architecture-search topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the neural-architecture-search topic, visit your repo's landing page and select "manage topics."

Learn more