稀疏正则化最小类散度半监督分类机
PDF下载 (347)刘建华,吴冬燕.稀疏正则化最小类散度半监督分类机[J].宁波大学学报(理工版),2014,27(02):44-48.DOI:
LIU Jian-hua,WU Dong-yan.Sparse Regularization for Minimum Class Variance Semi-supervised Classifier[J].Journal of Ningbo University(Natural Science & Engineering Edition),2014,27(02):44-48.DOI:
| Title: | Sparse Regularization for Minimum Class Variance Semi-supervised Classifier |
| 作者: | 刘建华, 吴冬燕 |
| Author(s): | LIU Jian-hua, WU Dong-yan |
| 关键词: | 半监督学习; 稀疏表示; 支持向量机; 最小类散度; 核技巧 |
| Keywords: | semi-supervised learning; sparse representation; support vector machine; minimum class scatter; kernel trick |
| 分类号: | TP181 |
| 文献标识码: | A |
| 摘要: | 基于稀疏表示理论提出一种稀疏正则化最小类散度半监督分类机(SRMCV), 且对于模式分类问题, SRMCV通过引入稀疏Laplacian正则化项和类内散度信息以实现预测空间函数在全局稀疏表示结构下平滑变化, 同时通过类内数据散度结构进一步优化决策函数的判别方向, 此方法能解决现有SSL方法对模型参数敏感和在噪声学习环境下缺乏鲁棒性等问题, 其有效性已在实际数据集上通过实验验证. |
| Abstract: | This paper presents a sparse regularization minimum class scatter semi-supervised classifier (SRMCV) based on the theory of sparse representation. For the problems of pattern classification, SRMCV aims at achieving smooth changes of the predicted spatial function in the structure of the global sparse representation by introducing sparse Laplacian regularization term and the information of inner class scatter. In addition, through the scatter structure of inner class data, it is intended to further optimize the discriminant direction of the decision-making function. This method can solve some problems existing in the SSL method such as sensitivity to the model parameters, the lack of robustness in the noisy learning environment, etc. On the real data set, the experimental results manifest the effectiveness of the proposed method. |
| 参考文献 /References: | [1].regulari- zation: A geometric framework for learning from examples [J]. Journal of Machine Learning Research, 2006(7): 2399-2434. [2].Zhu Xiaojin. Semi-supervised learning literature survey [R]. University of Wisconsin-Madison: Computer Scien- ces Technical Report 1530, 2005:1-60. [3].Cristianini N, Shawe-Taylor J. An introduction to support vector machines and other kernel-based learning methods [M]. Cambridge: Cambridge University Press, 2000:235- 248. [4].Zafeiriou S, Tefas A, Pitas I. Minimum class variance support vector machines[J]. IEEE Transactions on Image processing, 2007, 16(10):2551-2564. [5].皋军, 王士同, 邓赵红. 基于全局和局部保持的半监督支持向量机[J]. 电子学报, 2010(7):1626-1633. [6].Wright J, Ma Y, Mairal J, et al. Sparse representation for computer vision and pattern recognition[J]. Proceedings of IEEE, Special Issue on Applications of Compressive Sensing & Sparse Representation, 2010, 98(6):1031-1044. [7].Shivaswamy P, Jebara T. Maximum relative margin and data-dependent regularization[J]. Journal of Machine Learning Research, 2010, 11:747-788. [8].Fan Mingyu, Gu Nannan, Qiao Hong, et al. Sparse regularization for semi-supervised classification[J]. Pattern Recognition, 2011, 44(8):1777-1784. [9].陶剑文, 王士同. 局部保留最大信息差v-支持向量机[J]. 自动化学报, 2012, 38(1):97-108. [10].He Xiaofei, Yan Shuicheng, Hu Yuxiao, et al. Face recognition using Laplacianfaces[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27 (3):328-340. [11].Scholkopf B, Mika S, Burges C J C, et al. Input space vs feature space in Kernel-based methods[J]. IEEE Trans- actions on Neural Network, 1999, 10(5):1000-1017. |
| 备注/Memo: | 收稿日期: 2014-01-15. 宁波大学学报（理工版）网址 http://journallg.nbu.edu.cn/ 基金项目: 浙江省自然科学基金（LY13F020011）; 教育部人文社会科学研究规划基金（13YJAZH084）. 第一作者: 刘建华（1979－）, 男, 江西九江人, 硕士/讲师, 主要研究方向: 数据挖掘. E-mail: ljh791231@163.com 宁波大学学报（理工版）网址：http://journallg.nbu.edu.cn/ |
