LITMIR.BIZ

3.5Assessments of Encoding Methods for Protein Fold Recognition

      In addition to the protein sequence labeling tasks, protein sequence classification tasks have also received a lot of attention, such as protein remote homology detection⁶⁰ and protein fold recognition.^61,62 Here, we perform another assessment of the selected 16 amino acid encoding methods based on the protein fold recognition task. Many machine learning methods have been developed to classify protein sequences into different fold categories for protein fold recognition.⁶⁰ The deep learning methods can automatically extract discriminative patterns from variable-length protein sequences and achieve significant success.⁶¹ Referring to Hou’s work,⁶¹ we used the one-dimensional deep convolution neural network (DCNN) to assess the usefulness of 16 selected encoding methods for protein fold recognition. As shown in Fig. 3-5, the deep convolution neural network used here has 10 hidden layers of convolution, 10 filters of each convolution layer with two window sizes (6 and 10), 20 maximum values at the max pooling layer and a flatter layer which is fully connected with the output layer to output the corresponding probability of each fold type.

      Figure 3-5 The architecture of the one-dimensional deep convolution neural network for protein fold recognition.

       3.5.1 Benchmark datasets for protein fold recognition

      The most commonly used dataset to evaluate protein fold recognition methods is the SCOP database⁶³ and its extended version, the SCOPe database.⁶⁴ The SCOP is a manual structural classification of proteins whose three-dimensional structures have been determined. All of the proteins in SCOP are classified into four hierarchy levels: class, fold, superfamily and family. Folds represent the main characteristics of protein structures, and the protein fold could reveal the evolutionary process between the protein sequence and its corresponding tertiary structure.⁶⁵ Here we use the F184 dataset which was constructed by Xia et al.⁶⁶ based on the SCOPe database. The F184 dataset contains 6451 sequences with less than 25% sequence identity from 184 folds. Each fold contains at least 10 sequences, which could ensure that there are enough sequences for training and test purposes. Then we randomly selected 20% of the sequences as test data from each fold, leaving 80% of the sequences as training data. Finally, we got 5230 sequences for training and 1221 sequence for testing.

       3.5.2 Performances of different encodings on protein fold recognition task

      The comparison results of 16 selected encoding methods for protein fold recognition are listed in Table 3-5. It should be noted that the training process for each encoding method is repeated 10 times to eliminate stochastic effects. Different from the performances of protein secondary structure prediction, the performances of most position-independent encoding methods are similar. All of the binary, physicochemical and machine-learning-based encoding methods (except the ProtVec) achieve about 30% mean accuracies, demonstrating that the position-independent encodings could just offer limited information for protein fold classification. The two structure-based encodings have better accuracies — near 33% — demonstrating that the structure potential is more related with the protein fold type. The two evolution-based methods PAM250 and BLOSUM62 perform best among the 12 position-independent encoding methods, which means the evaluation information is more coupled with the protein structure. The position-dependent encoding methods PSSM and HMM achieve better performances, especially PSSM. It again indicates that the protein evaluation information is tightly coupled with the protein structure, and the homologous information is more useful than remote homologous information. The machine-learning-based AESNN3 and ANN4D encodings achieve comparable performances with other position-independent encoding methods but have much lower dimensions (3 for the AESNN3 and 4 for the ANN4D), showing its potential for further application. The performance of the ProtVec encoding is poor, and this could be caused by the overlapping strategy that has also been mentioned by the author.⁹ The ProtVec-3mer encoding has better performance, demonstrating the effectiveness of the combination of ProtVec and 3-mer.

Table 3-5 The performance differences between the various kinds of encodings.