ABSTRACT
Heterogenous information network embedding aims to embed heterogenous information networks (HINs) into low dimensional spaces, in which each vertex is represented as a low-dimensional vector, and both global and local network structures in the original space are preserved. However, most of existing heterogenous information network embedding models adopt the dot product to measure the proximity in the low dimensional space, and thus they can only preserve the first-order proximity and are insufficient to capture the global structure. Compared with homogenous information networks, there are multiple types of links (i.e., multiple relations) in HINs, and the link distribution w.r.t relations is highly skewed. To address the above challenging issues, we propose a novel heterogenous information network embedding model PME based on the metric learning to capture both first-order and second-order proximities in a unified way. To alleviate the potential geometrical inflexibility of existing metric learning approaches, we propose to build object and relation embeddings in separate object space and relation spaces rather than in a common space. Afterwards, we learn embeddings by firstly projecting vertices from object space to corresponding relation space and then calculate the proximity between projected vertices. To overcome the heavy skewness of the link distribution w.r.t relations and avoid "over-sampling'' or "under-sampling'' for each relation, we propose a novel loss-aware adaptive sampling approach for the model optimization. Extensive experiments have been conducted on a large-scale HIN dataset, and the experimental results show superiority of our proposed PME model in terms of prediction accuracy and scalability.
- Amr Ahmed, Nino Shervashidze, Shravan Narayanamurthy, Vanja Josifovski, and Alexander J Smola. 2013. Distributed large-scale natural graph factoriza- tion. In WWW. 37--48. Google ScholarDigital Library
- Mukund Balasubramanian and Eric L Schwartz. 2002. The isomap algorithm and topological stability. Science 295, 5552 (2002), 7--7.Google Scholar
- Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Ok- sana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. In NIPS. 2787--2795. Google ScholarDigital Library
- Antoine Bordes, Jason Weston, Ronan Collobert, Yoshua Bengio, et al. 2011. Learning Structured Embeddings of Knowledge Bases.. In AAAI, Vol. 6. 6. Google ScholarDigital Library
- Shiyu Chang, Wei Han, Jiliang Tang, Guo-Jun Qi, Charu C Aggarwal, and Thomas S Huang. 2015. Heterogeneous network embedding via deep architec- tures. In KDD. 119--128. Google ScholarDigital Library
- Ting Chen, Yizhou Sun, Yue Shi, and Liangjie Hong. 2017. On Sampling Strate- gies for Neural Network-based Collaborative Filtering. In KDD. 767--776. Google ScholarDigital Library
- Paolo Cremonesi, Yehuda Koren, and Roberto Turrin. 2010. Performance of rec- ommender algorithms on top-n recommendation tasks. In RecSys. ACM, 39--46. Google ScholarDigital Library
- Peng Cui, Xiao Wang, Jian Pei, and Wenwu Zhu. 2017. A Survey on Network Embedding. CoRR abs/1711.08752 (2017).Google Scholar
- Yuxiao Dong, Nitesh V Chawla, and Ananthram Swami. 2017. metapath2vec: Scalable representation learning for heterogeneous networks. In KDD. 135--144. Google ScholarDigital Library
- Tom Fawcett. 2006. An introduction to ROC analysis. Pattern recognition letters 27, 8 (2006), 861--874. Google ScholarDigital Library
- Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In KDD. 855--864. Google ScholarDigital Library
- Cheng-Kang Hsieh, Longqi Yang, Yin Cui, Tsung-Yi Lin, Serge Belongie, and Deborah Estrin. 2017. Collaborative metric learning. In WWW. 193--201. Google ScholarDigital Library
- Zhipeng Huang and Nikos Mamoulis. 2017. Heterogeneous Information Net- work Embedding for Meta Path based Proximity. arXiv preprint arXiv:1701.05291 (2017).Google Scholar
- Yann Jacob, Ludovic Denoyer, and Patrick Gallinari. 2014. Learning latent repre- sentations of nodes for classifying in heterogeneous social networks. In WSDM. 373--382. Google ScholarDigital Library
- Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learn- ing entity and relation embeddings for knowledge graph completion.. In AAAI, Vol. 15. 2181--2187. Google ScholarDigital Library
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In NIPS. 3111--3119. Google ScholarDigital Library
- Andrew Y Ng, Michael I Jordan, and Yair Weiss. 2002. On spectral clustering: Analysis and an algorithm. In NIPS. 849--856. Google ScholarDigital Library
- Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: Online learn- ing of social representations. In KDD. 701--710. Google ScholarDigital Library
- Steffen Rendle and Christoph Freudenthaler. 2014. Improving pairwise learning for item recommendation from implicit feedback. In WSDM. 273--282. Google ScholarDigital Library
- Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt- Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In uncertainty in artificial intelligence. 452--461. Google ScholarDigital Library
- Yizhou Sun, Rick Barber, Manish Gupta, Charu C Aggarwal, and Jiawei Han. 2011. Co-author relationship prediction in heterogeneous bibliographic net- works. In ASONAM. IEEE, 121--128. Google ScholarDigital Library
- Yizhou Sun, Jiawei Han, Charu C Aggarwal, and Nitesh V Chawla. 2012. When will it happen?: relationship prediction in heterogeneous information networks. In WSDM. 663--672. Google ScholarDigital Library
- Yizhou Sun, Jiawei Han, Xifeng Yan, Philip S Yu, and TianyiWu. 2011. Pathsim: Meta path-based top-k similarity search in heterogeneous information networks. VLDB 4, 11 (2011), 992--1003.Google ScholarDigital Library
- Yizhou Sun, Brandon Norick, Jiawei Han, Xifeng Yan, Philip S Yu, and Xiao Yu. 2013. Pathselclus: Integrating meta-path selection with user-guided object clus- tering in heterogeneous information networks. TKDD 7, 3 (2013), 11. Google ScholarDigital Library
- Jian Tang, Meng Qu, and Qiaozhu Mei. 2015. Pte: Predictive text embedding through large-scale heterogeneous text networks. In KDD. 1165--1174. Google ScholarDigital Library
- Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. 2015. Line: Large-scale information network embedding. InWWW. 1067--1077. Google ScholarDigital Library
- Lei Tang and Huan Liu. 2009. Scalable learning of collective behavior based on sparse social dimensions. In CIKM. 1107--1116. Google ScholarDigital Library
- Yi Tay, Anh Tuan Luu, and Siu Cheung Hui. 2017. Translational Recommender Networks. CoRR abs/1707.05176 (2017).Google Scholar
- Myo Thida, How-Lung Eng, and Paolo Remagnino. 2013. Laplacian eigenmap with temporal constraints for local abnormality detection in crowded scenes. IEEE Transactions on Cybernetics 43, 6 (2013), 2147--2156.Google ScholarCross Ref
- Zhen Wang, Jianwen Zhang, Jianlin Feng, and Zheng Chen. 2014. Knowledge Graph Embedding by Translating on Hyperplanes.. In AAAI, Vol. 14. 1112--1119. Google ScholarDigital Library
- Min Xie, Hongzhi Yin, Hao Wang, Fanjiang Xu, Weitong Chen, and Sen Wang. 2016. Learning graph-based poi embedding for location-based recommendation. In CIKM. 15--24. Google ScholarDigital Library
- Linchuan Xu, Xiaokai Wei, Jiannong Cao, and Philip S Yu. 2017. Embedding of Embedding (EOE): Joint Embedding for Coupled Heterogeneous Networks. In WSDM. 741--749. Google ScholarDigital Library
- Hongzhi Yin, Hongxu Chen, Xiaoshuai Sun, Hao Wang, Yang Wang, and Quoc Viet Hung Nguyen. 2017. SPTF: A Scalable Probabilistic Tensor Factorization Model for Semantic-Aware Behavior Prediction. In ICDM. 585--594.Google Scholar
- Hongzhi Yin, Bin Cui, Yizhou Sun, Zhiting Hu, and Ling Chen. 2014. LCARS: A spatial item recommender system. TOIS (2014), 11. Google ScholarDigital Library
- Hongzhi Yin, Bin Cui, Xiaofang Zhou, Weiqing Wang, Zi Huang, and Shazia Sadiq. 2016. Joint modeling of user check-in behaviors for real-time point-of- interest recommendation. TOIS (2016). Google ScholarDigital Library
- Hongzhi Yin, Weiqing Wang, Hao Wang, Ling Chen, and Xiaofang Zhou. 2017. Spatial-Aware Hierarchical Collaborative Deep Learning for POI Recommenda- tion. TKDE (2017), 2537--2551.Google Scholar
- Hongzhi Yin, Xiaofang Zhou, Bin Cui, Hao Wang, Kai Zheng, and Quoc Viet Hung Nguyen. 2016. Adapting to user interest drift for poi recommendation. ICDE 28, 10 (2016), 2566--2581. Google ScholarDigital Library
- Hongzhi Yin, Lei Zou, Quoc Viet Hung Nguyen, Zi Huang, and Xiaofang Zhou. 2018. Joint eventpartner recommendation in event-based social networks. ICDE.Google Scholar
- Lubomir Zlatkov. 1978. Multidimensional Scaling (MDS). (1978).Google Scholar
Index Terms
- PME: Projected Metric Embedding on Heterogeneous Networks for Link Prediction
Recommendations
An Efficient Link Prediction Model in Dynamic Heterogeneous Information Networks Based on Multiple Self-attention
Knowledge Science, Engineering and ManagementAbstractThe existing link prediction researches of information networks mainly focus on the dynamic homogeneous network or the static heterogeneous network. It has always been a challenge to predict future relationships between nodes while learning both ...
W-MMP2Vec: Topic-driven network embedding model for link prediction in content-based heterogeneous information network
Link prediction on heterogeneous information network (HIN) is considered as a challenge problem due to the complexity and diversity in types of nodes and links. Currently, there are remained challenges of meta-path-based link prediction in HIN. ...
SENA: Preserving Social Structure for Network Embedding
HT '17: Proceedings of the 28th ACM Conference on Hypertext and Social MediaNetwork embedding transforms a network into a continuous feature space. Network augmentation, on the other hand, leverages this feature representation to obtain a more informative network by adding potentially plausible edges while removing noisy edges. ...
Comments