Abstract

All drugs usually have side effects, which endanger the health of patients. To identify potential side effects of drugs, biological and pharmacological experiments are done but are expensive and time-consuming. So, computation-based methods have been developed to accurately and quickly predict side effects. To predict potential associations between drugs and side effects, we propose a novel method called the Triple Matrix Factorization- (TMF-) based model. TMF is built by the biprojection matrix and latent feature of kernels, which is based on Low Rank Approximation (LRA). LRA could construct a lower rank matrix to approximate the original matrix, which not only retains the characteristics of the original matrix but also reduces the storage space and computational complexity of the data. To fuse multivariate information, multiple kernel matrices are constructed and integrated via Kernel Target Alignment-based Multiple Kernel Learning (KTA-MKL) in drug and side effect space, respectively. Compared with other methods, our model achieves better performance on three benchmark datasets. The values of the Area Under the Precision-Recall curve (AUPR) are 0.677, 0.685, and 0.680 on three datasets, respectively.

1. Introduction

Drug treatment of patients’ diseases may be accompanied by side effects, endangering the life and health of patients. Therefore, how to quickly and accurately find potential drug side effect information becomes an important step in the drug development process. The traditional methods to detect the side effects of drugs are usually biological and pharmacological experiments. These approaches often take a long time and huge capital investment. So, it is necessary to accurately and quickly predict the potential side effects of drugs through computation-based methods [1]. Most computation-based methods for predicting drug side effects used Machine Learning (ML) classification models to predict side effect categories by extracted features from the biochemical characteristics of drugs. ML has been widely used in the field of computational biology, containing potential disease-associated microRNAs [2, 3] or circRNAs [4], O-GlcNAcylation sites [5], prediction of DNA or RNA methylcytosine sites [6, 7], protein function identification [812], protein remote homology [13], analyzing microbiology [14], electron transport proteins [15], drug-target interactions [16], drug-side effect association [17, 18], protein-protein interactions [19, 20], and lncRNA-miRNA interactions [21].

Pauwels and Stoven develop a predictive model of drug-side effect association by Ordinary Canonical Correlation Analysis (OCCA) and Sparse Canonical Correlation Analysis (SCCA) [1, 22]. The input feature of OCCA and SCCA is extracted from chemical structures of drugs. Cheng and Wang proposed the Phenotypic Network Inference Model (PNIM) [23] to detect new potential drug-side effect associations. Mizutani and Stoven [24] utilized cooccurrence of drug profiles and protein interaction profiles to predict side effects. The Support Vector Machine (SVM) was used to build Adverse Drug Reaction (ADR) prediction, which is based on chemical structures, biological properties of drugs, and phenotypic characteristics [25]. Zhang et al. [2628] built an ensemble method, which was based on the Integrated Neighborhood-Based Method (INBM) and Restricted Boltzmann Machine-Based Method (RBMBM). Matrix Factorization- (MF-) based methods have been widely used for link prediction in bipartite networks of systems biology. To predict drug-target interactions, Neighborhood Regularized Logistic Matrix Factorization (NRLMF) [29], Collaborative Matrix Factorization (CMF) [30], and Graph Regularized Matrix Factorization (GRMF) [31] were developed via the MF theory.

In our study, we develop a Triple Matrix Factorization- (TMF-) based model to identify the associations of drug and side effect. TMF employs the biprojection matrix and two latent feature matrices (from drug and side effect space) to estimate the strength of new drug-side effect associations. Latent feature matrices are built via Low Rank Approximation (LRA), which could construct a lower rank matrix to approximate the original matrix. To improve the performance of prediction, Kernel Target Alignment-based Multiple Kernel Learning (KTA-MKL) is used to integrate multiple kernel matrices in drug and side effect space, respectively. Our method can fuse multivariate information (multiple kernels) and obtain new associations through matrix projection. Compared with other existing methods, our model obtains better performance on three benchmark datasets.

2. Method

2.1. Problem Description

The dataset of drug-side effect association can be regarded as a bipartite network, which has drugs and side effects. The relationships of drug and side effect can be represented as a adjacent matrix . and are the drug and side effect sets, respectively. denotes that drug and side effect are related; otherwise, it is 0. The associations between drugs and side effect terms are shown in Figure 1. The solid lines link the known drug-side effect associations. The hollow circles and filled squares are drugs and side effects, respectively. The prediction of new associations is a recommender task.

2.2. Drug Kernels and Side Effect Kernels

To predict the associations of drugs and side effects, we need to construct the relationship between drugs (or side effects). In this study, we build different kernels (similarity matrices) to describe the relationships of drugs (or side effects). In drug space, the fingerprint of 881 chemical substructures is employed to encode the drug chemical structure, which is shown in Figure 2. The fingerprint represents whether some substructures are present (1) or absent (0). What is more, the known links between drugs and side effect terms (a side effect profile for a specific drug) are also used to represent the information of the subjacent network, which is shown on the right side of Figure 1. In side effect space, the drug profile for a side effect also represents the subjacent network of side effects.

There are four different types of measure functions, including Gaussian Interaction Profile (GIP) kernel [3235], COsine Similarity (COS) [26], Correlation coefficient (Corr) [26], and Mutual Information (MI) [36, 37], which are employed to calculate the similarity between the drugs (or side effects).

For drug and , the GIP kernel is defined as follows: where is the bandwidth of the Gaussian kernel. is set as in our study. and are the side effect profile of drug and , respectively.

The COS is defined as follows:

The Corr kernel is calculated as follows:

In order to describe the degree of correlation between two random variables, we further use Mutual Information (MI) to measure the similarity between the two random variables: where () denotes the observed frequency of value () in profile (). is the observed relative frequency. Similarly, the kernels of the fingerprint (drug space: , , , and ) and drug profile of side effects (side effect space: , , , and ) can be constructed via the above functions. The drug space has 8 kernels, and the side effect space has 4 kernels, which are listed in Table 1.

2.3. Kernel Target Alignment-Based Multiple Kernel Learning

In our study, the kernel sets for drug space and side effect space are combined via multiple kernel learning, respectively. and are the number of kernels in drug and side effect space, respectively. A heuristic approach of Kernel Target Alignment-based Multiple Kernel Learning (KTA-MKL) [38, 39] is employed to calculate the weights of each kernel. The optimal kernels of and can be obtained as follows: where and are the weights of kernels in drug and side effect space, respectively. KTA-MKL estimates the weight of each kernel by COsine Similarity of matrices (drug space): where denotes the Frobenius norm. is the Frobenius inner product. The value of kernel alignment can describe similarity of two kernels. KTA-MKL estimates the value between the ideal kernel matrix and the drug kernel (or side effect kernel) as follows: where and are the ideal kernels of drug and side effect, respectively, which are built via the training label (known associations).

2.4. Triple Matrix Factorization-Based Model

Inspired by MF [2931, 40], the similarity between drugs (or side effects) can be approximated by the inner product of two drug (or side effect) features as follows: where and are the matrices of Low Rank Approximation and and are the dimensions of the latent feature space in drug and side effect space, respectively. The objective function of TMF is defined as follows: where is the biprojection matrix. is the regularization coefficient of . In our study, is set as 1.

Let , so we can obtain functions as follows: where Equation (14) is a Sylvester equation. The final prediction can be constructed by

The overview of our proposed method is shown in Figure 3 and Algorithm 1.

Require: A training matrix (known associations), the fingerprint vector for the drug; Two parameters: the and for TMF;
Ensure: The prediction of ;
 1: Constructing the drug and side effect kernels, which are listed in Table 1;
 2: Utilizing Equation (7) (KTA-MKL) to obtain the weights and for drug and side effect, respectively;
 3: Building and via Equation (5), respectively;
 4: Calculating and by Singular Value Decomposition (SVD);
 5: Solving Equation (14) (TMF) to estimate ;
 6: Calculating ;

3. Result

In this section, we employed benchmark dataset to evaluate our approach and compared it with other existing methods.

3.1. Datasets

In order to test the performance of our model, three types of datasets are employed in our study. They are Pauwels’s dataset, Liu’s dataset, and Mizutani’s dataset, which are collected from the DrugBank [41], SIDe Effect Resource (SIDER) [42], KEGG DRUG [43], and PubChemCompound [44, 45]. Table 2 lists benchmark datasets of this study.

3.2. Evaluation Measurements

The training adjacent matrix can be obtained via randomly setting known associations as 0. In this study, we use 5-fold Cross-Validation (5-CV) and 5-fold local Cross-Validation (5 local CV) to test our method. 5-CV randomly sets known associations as 0 in the whole matrix. 5 local CV is employed to evaluate the prediction of new drugs, which do not have any side effect information. 5 local CV sets some rows of the adjacent matrix as 0 to test related drugs. The Area Under the Precision-Recall curve (AUPR) and Area Under the receiver operating Characteristic curve (AUC) are utilized to evaluate the performance of prediction.

3.3. Selecting Optimal Parameters

In this section, we use the grid search method to get the optimal and . We test different values of and from 100 to the max value with the step of 100. The results of the grid search method are shown in Figure 4 (on Mizutani’s dataset by 5-CV). and are the best parameters (AUPR) on Mizutani’s dataset. In Figure 4, the lower value of AURP and AUC is blue, and the higher value is yellow. On the other two datasets, we use the same parameters of and .

3.4. Performance of Different Kernels

We evaluate the performance of multiple kernels and single kernel on three datasets. The results of prediction are listed in Table 3 and Figure 5. Obviously, the kernels of and have better performance on Pauwels’s dataset (AUPR: 0.6557, AUC: 0.9079), Mizutani’s dataset (AUPR: 0.6615, AUC: 0.9369), and Liu’s dataset (AUPR: 0.6587, AUC: 0.9408). In addition, the KTA-MKL model achieves the best results on Pauwels’s dataset (AUPR: 0.6765, AUC: 0.9434), Mizutani’s dataset (AUPR: 0.6847, AUC: 0.9409), and Liu’s dataset (AUPR: 0.6801, AUC: 0.9426), respectively. KTA-MKL could combine kernels from different sources via the heuristic method, which is better mean weighted.

In Table 4, we list the weight of each kernel on three datasets. We can find that the weights of and are the highest than other kernels. At the same time, their performance is also the best. KTA-MKL could reduce bias of kernels by the low weights.

3.5. Comparison with Existing Methods

To evaluate the performance of the TMF model, we compare it with other methods. The results are listed in Table 5. Obviously, our method (TMF) achieves the best results on Pauwels’s dataset (AUPR: 0.677), Mizutani’s dataset (AUPR: 0.685), and Liu’s dataset (AUPR: 0.680). Zhang et al.’s work (ensemble model) [26] obtained the good performance of AUPRs (0.660, 0.666, and 0.661). The best AUCs (0.954, 0.950, and 0.953) are achieved by Neighborhood Regularized Logistic Matrix Factorization (NRLMF) [29], which is also based on Matrix Factorization (MF). The results of other MF-based models, including Collaborative Matrix Factorization (CMF) [30] and Graph Regularized Matrix Factorization (GRMF) [31], are competitive. Local and Global Consistency (LGC) [18] is our previous work. LGC obtains the second best results of AUPR (0.668, 0.673, and 0.670) on three datasets, respectively.

3.6. Local CV and Case Study

In some cases, certain drugs are new and have no information of side effects. The 5 local CV is employed to test the performance of the side effect prediction for new drugs. In this section, we also compare TMF with other MF-based models, including NRLMF, CMF, and GRMF. The results are listed in Table 6 and Figure 6.

The proposed method (TMF) achieves the best results of AUPRs on Pauwels’s dataset (AUPR: 0.392), Mizutani’s dataset (AUPR: 0.399), and Liu’s dataset (AUPR: 0.401). Other MF-based models also are still comparable with our results. NRLMF obtains AUPRs of 0.374, 0.390, and 0.398 on three datasets, respectively.

To predict the side effects of a new drug, our model calculates the strength of associations between the new drug and all existing side effects. The predictive strength scores of TMF will be ranked by descending order. The higher the value of the score, the higher the possibility of associations. In this section, we discuss two cases (drug caffeine and captopril on Mizutani’s dataset) of top 10 associations predicted. The details are listed in Tables 7 and 8. Results are checked by the masked associations between drug caffeine (or captopril) and side effects.

3.7. Running Time

We evaluate the performance for predictive models of running time. The results of test are listed in Table 9. The running time of CMF is less than our method (TMF), LGC, GRMF, and NRLMF on Pauwels’s dataset (910 seconds), Mizutani’s dataset (757 seconds), and Liu’s dataset (846 seconds). TMF costs 977, 873, and 929 seconds, which are less than the ensemble model [26].

4. Conclusion and Discussion

In this study, we develop a Triple Matrix Factorization-based model to predict the associations between drugs and side effect terms. In drug space, several kernels are constructed from the chemical substructure fingerprint and known side effect-associated subnet. The side effect kernels are built from the known drug-associated subnet. The kernel functions include GIP, COS, Corr, and MI. Above kernels are combined by KTA-MKL in drug and side effect space, respectively. The integrated kernel matrices (including drug and side effect) are Low Rank Approximation in the TMF model. Our model (TMF) is tested on three benchmark datasets of drug-side effect association. Compared with other excellent methods, TMF achieves the best results (5-CV) on Pauwels’s dataset (AUPR: 0.677), Mizutani’s dataset (AUPR: 0.685), and Liu’s dataset (AUPR: 0.680), respectively. In addition, our model is also compared with CMF, GRMF, and NRLMF under 5 local CV. The best AUPRs are achieved on Pauwels’s dataset (AUPR: 0.392), Mizutani’s dataset (AUPR: 0.399), and Liu’s dataset (AUPR: 0.401). However, our method does not consider the topological relationship of drugs or side effects. In the future, a graph- or hypergraph-embedded MF-based model will be developed to improve the predictive performance of drug-side effect association.

Data Availability

The datasets, codes and corresponding results are available at https://figshare.com/s/10ee9c07123304a0ef82.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work is supported by a grant from the National Science Foundation of China (NSFC 61772362, 61902271, and 61972280) and the Natural Science Research of Jiangsu Higher Education Institutions of China (19KJB520014). The authors also thank professor Wen Zhang for kindly providing the datasets on his website.