Basically, the time spent on testing depends on:
- the complexity of the neural network
- For example, the fastest network should be the fully-connected network.
- CNN should be faster than LSTM because LSTM is sequential (sequential = slow)
- Currently, there are many ways to compress deep learning model (remove nodes with lighter weight)
- the complexity of data
- Try to build parallel models.
Analyze of different deep learning models:
- RNN
- CNN
- LSTM
- GRU
- Seq2seq:
- used for NLP
- Autoencoder:
- learn the features and reduce dimension’
Other machine learning models:
- random forest
- used for classification
Machine learning thought: