閱讀全文 | |
篇名 |
Performance Predict Method Based on Neural Architecture Search
|
---|---|
並列篇名 | Performance Predict Method Based on Neural Architecture Search |
作者 | Meili Zhou、Zongwen Bai、Tingting Yi、Xiaohuan Chen、Wei Wei |
英文摘要 | Deep learning has granted remarkable breakthroughs on various tasks over the past few years, such as image segmentation, speech recognition, and nature language processing. One vital aspect of progress is the emergence of advanced neural architectures. However, Currently used architectures have frequently been developed manually by human experts, which is a time-consuming and laborious process. Because of this, more and more research is now involved in automated neural architecture search techniques. This paper studies the process of Neural Architecture Search (NAS) technology, summarizes the previous work in this research field and classifies it according to three aspects: search space, search strategy, and acceleration method. In addition, this study selects the performance prediction method in the NAS acceleration strategy as a breakthrough direction and inherits the works of MetaQNN network structure and the sequential regression prediction model (SRMs), which were proposed by the previous research. Firstly, based on our hypothesis, we successfully use the idea of the N-grams model of natural language processing to extract the sequence features belonging to the chain neural network. Then, based on the extracted network structure features, referring to the steps of SRMs, we give a new recipe for predicting the accuracy score of neural network models on the training set. Finally, through experiments and comparison, we prove the accuracy of this prediction model and the effectiveness of accelerating the neural architecture search process. |
起訖頁 | 385-392 |
關鍵詞 | Neural architecture search、Sequence regression models、Performance prediction、Network structure feature |
刊名 | 網際網路技術學刊 |
期數 | 202003 (21:2期) |
出版單位 | 台灣學術網路管理委員會 |
DOI |
|
QR Code | |
該期刊 上一篇
| A Secure Core-Assisted Multicast Routing Protocol in Mobile Ad-Hoc Network |
該期刊 下一篇
| Big Data Service Architecture: A Survey |