본문 바로가기
  • Home

Hyper Parameter Tuning Method based on Sampling for Optimal LSTM Model

  • Journal of The Korea Society of Computer and Information
  • Abbr : JKSCI
  • 2019, 24(1), pp.137-143
  • DOI : 10.9708/jksci.2019.24.01.137
  • Publisher : The Korean Society Of Computer And Information
  • Research Area : Engineering > Computer Science
  • Received : December 4, 2018
  • Accepted : December 7, 2018
  • Published : January 31, 2019

KIM HYEMEE 1 RyeJi Jeong 1 Hyerim Bae 1

1부산대학교

Accredited

ABSTRACT

As the performance of computers increases, the use of deep learning, which has faced technical limitations in the past, is becoming more diverse. In many fields, deep learning has contributed to the creation of added value and used on the bases of more data as the application become more divers. The process for obtaining a better performance model will require a longer time than before, and therefore it will be necessary to find an optimal model that shows the best performance more quickly. In the artificial neural network modeling a tuning process that changes various elements of the neural network model is used to improve the model performance. Except Gride Search and Manual Search, which are widely used as tuning methods, most methodologies have been developed focusing on heuristic algorithms. The heuristic algorithm can get the results in a short time, but the results are likely to be the local optimal solution. Obtaining a global optimal solution eliminates the possibility of a local optimal solution. Although the Brute Force Method is commonly used to find the global optimal solution, it is not applicable because of an infinite number of hyper parameter combinations. In this paper, we use a statistical technique to reduce the number of possible cases, so that we can find the global optimal solution.

Citation status

* References for papers published after 2022 are currently being built.