AI Basic Terms (1) / AI 기본 용어 (1)

• learning_rate : hyperparameter. (related with Gradient Descent.)
  
  • tf.keras.optimizers.Adagrad : adaptive learning rate optimizer that adjusts learning rate for each parameter.
    • High variance > a smaller learning_rate
    • Low varience > a larger learning_rate

 

 

• batch_size : the size of data processed at once.
  • Too High : slower, took a lot of memory
  • Too Low : Unstable training

 

 

• epochs : the number of times of dataset training
  • Too High : overfitting