Abstract
The problem of determining optimal decision model is a difficult combinatorial task in the fields of pattern classification, machine learning, and especially bioinformatics. Recently, support vector machine (SVM) has shown a better performance than conventional learning methods in many applications. This paper proposes a weighted kernel function for support vector machine and its learning method with a fast convergence and a good classification performance. We defined the weighted kernel function as the weighted sum of a set of different types of basis kernel functions such as neural, radial, and polynomial kernels, which are trained by a learning method based on genetic algorithm. The weights of basis kernel functions in proposed kernel are determined in learning phase and used as the parameters in the decision model in classification phase. The experiments on several clinical datasets such as colon cancer, leukemia cancer, and lung cancer datasets indicate that our weighted kernel function results in higher and more stable classification performance than other kernel functions. Our method also has comparable and sometimes better classification performance than other classification methods for certain applications.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Cristianini, N., Shawe-Taylor, J.: An introduction to Support Vector Machines and other kernel-based learning methods, Cambridge (2000)
Vapnik, V.N., et al.: Theory of Support Vector Machines, Technical Report CSD TR-96-17, Univ. of London (1996)
Kecman, V.: Learning and Soft Computing: Support Vector Machines. Neural Networks, and Fuzzy Logic Models (Complex Adaptive Systems), The MIT press (2001)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. John Wiley & Sons, Chichester (2001)
Joachims, T.: Making large-Scale SVM Learning Practical, ch. 11. In: Advances in Kernel Methods - Support Vector Learning, MIT Press, Cambridge (1999)
Schökopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond (Adaptive Computation and Machine Learning). MIT Press, Cambridge (2002)
Minsky, M.L., Papert, S.A.: Perceptrons. MIT Press, Cambridge (1969)
Michalewicz, Z.: Genetic Algorithms + Data structures = Evolution Programs, 3 re rev. and extended ed. Springer, Heidelberg (1996)
Goldberg, D.E.: Genetic Algorithms in Search, Optimization & Machine Learning. Addison-Wesley, Reading (1989)
Mitchell, M.: Introduction to genetic Algorithms, fifth printing. MIT press, Cambridge (1999)
Alon, U., Barkai, N., Notterman, D., Gish, K., Ybarra, S., Mack, D., Levine, A.: Broad Patterns of Gene Expression Revealed by Clustering Analysis of Tumor and Normal Colon Tissues Probed by Oligonucleotide Arrays. Proceedings of National Academy of Sciences of the United States of American 96, 6745–6750 (1999)
Golub, T.R., Slonim, D.K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J.P., Coller, H., Loh, M.L., Downing, J.R., Caligiuri, M.A., Bloomfield, C.D., Lander, E.S.: Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring. Science 286, 531–537 (1999)
Fröhlich, H., Chapelle, O., Scholkopf, B.: Feature selection for support vector machines by means of genetic algorithm, Tools with Artificial Intelligence. In: Proceedings 15th IEEE International Conference, pp. 142–148 (2003)
Chen, X.-w.: Gene selection for cancer classification using bootstrapped genetic algorithms and support vector machines. In: The Computational Systems, Bioinformatics Conference, Proceedings IEEE International Conference, pp. 504–505 (2003)
Park, C., Cho, S.-B.: Genetic search for optimal ensemble of feature-classifier pairs in DNA gene expression profiles. In: Neural Networks, Proceedings of the International Joint Conference, vol. 3, pp. 1702–1707 (2003)
Rüping, S.: mySVM-Manual, University of Dortmund, Lehrstuhl Informatik (2000), online available: http://www-ai.cs.uni-dortmund.de/SOFTWARE/MYSVM
Kohavi, R., John, G.H.: Wrappers for Feature Subset Selection. Artificial Intelligence, 273–324 (1997)
Blum, A.L., Langley, P.: Selection of Relevant Features and Examples in Machine Learning. Artificial Intelligence, 245–271 (1997)
Michell, T.M.: Machine Learning. McGraw-Hill, New York (1997)
Liu, C.-C., Chen, W.-S.E., Lin, C.-C., Liu, H.-C., Chen, H.-Y., Yang, P.-C., Chang, P.-C., Chen, J.J.W.: Topology-based cancer classification and related pathway mining using microarray data. Nucleic Acids Res., gkl583v1 (August 16, 2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nguyen, HN., Ohn, SY., Chae, SH., Song, D.H., Lee, I. (2006). Optimizing Weighted Kernel Function for Support Vector Machine by Genetic Algorithm. In: Gelbukh, A., Reyes-Garcia, C.A. (eds) MICAI 2006: Advances in Artificial Intelligence. MICAI 2006. Lecture Notes in Computer Science(), vol 4293. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11925231_55
Download citation
DOI: https://doi.org/10.1007/11925231_55
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-49026-5
Online ISBN: 978-3-540-49058-6
eBook Packages: Computer ScienceComputer Science (R0)