An Implementation of Support Vector Macidnes and Generalized Discriminant Analysis on Iris and Hepatitis Datasets

Abstract

Support Vector Machines (SVM) is a supervised learning method used for classification. The teaming strategy of SVM is based on structural risk minimization principle, so SVM has a better ability to generalize than other methods which depend on empirical risk minimization principle. However, when any classification methods face a dataset which is linearity inseparable, they will face a difficulty to classify the dataset. This problem results in low classification rate a\•erages. To anticipate this problem, it is desirable to use Generalized Discriminant Analysis (GOA) as feature extractor. We expect that using GOA will give a better classification rate averages because it can minimize the distances of data within the same classes and maximize the distance between the different classes. This paper presents a comparison of Support Vector Machines with and without using GOA for Iris and Hepatitis datasets classification. It is shown that the use of GDA can yield a classification rate averages of more than 93% for Iris dataset and 95% for Hepatitis dataset