10/20/24, 1:39 PM expt7
In [1]: #Support Vector Machines (SVM) are a powerful supervised machine learning techni
In [2]: # Install the 'e1071' package for SVM
install.packages("e1071")
# If you are working with tidyverse-style data manipulation
install.packages("caret") # For model training and validation
Installing package into 'C:/Users/HP/AppData/Local/R/win-library/4.4'
(as 'lib' is unspecified)
package 'e1071' successfully unpacked and MD5 sums checked
The downloaded binary packages are in
C:\Windows\Temp\RtmpWIYS57\downloaded_packages
Installing package into 'C:/Users/HP/AppData/Local/R/win-library/4.4'
(as 'lib' is unspecified)
package 'caret' successfully unpacked and MD5 sums checked
The downloaded binary packages are in
C:\Windows\Temp\RtmpWIYS57\downloaded_packages
In [3]: # Load necessary libraries
library(e1071)
library(caret)
# Load the iris dataset
data(iris)
head(iris)
Warning message:
"package 'e1071' was built under R version 4.4.1"
Warning message:
"package 'caret' was built under R version 4.4.1"
Loading required package: ggplot2
Warning message:
"package 'ggplot2' was built under R version 4.4.1"
Loading required package: lattice
A data.frame: 6 × 5
Sepal.Length Sepal.Width Petal.Length Petal.Width Species
<dbl> <dbl> <dbl> <dbl> <fct>
1 5.1 3.5 1.4 0.2 setosa
2 4.9 3.0 1.4 0.2 setosa
3 4.7 3.2 1.3 0.2 setosa
4 4.6 3.1 1.5 0.2 setosa
5 5.0 3.6 1.4 0.2 setosa
6 5.4 3.9 1.7 0.4 setosa
localhost:8888/lab/tree/expt7/expt7.ipynb 1/4
10/20/24, 1:39 PM expt7
In [4]: # Split the dataset into training (70%) and test (30%) sets
set.seed(123) # For reproducibility
index <- createDataPartition(iris$Species, p = 0.7, list = FALSE)
train_data <- iris[index, ]
test_data <- iris[-index, ]
In [5]: # Train the SVM model using a linear kernel
svm_model <- svm(Species ~ ., data = train_data, kernel = "linear", cost = 1,
scale = TRUE)
# View the summary of the model
summary(svm_model)
Call:
svm(formula = Species ~ ., data = train_data, kernel = "linear",
cost = 1, scale = TRUE)
Parameters:
SVM-Type: C-classification
SVM-Kernel: linear
cost: 1
Number of Support Vectors: 22
( 2 10 10 )
Number of Classes: 3
Levels:
setosa versicolor virginica
In [6]: # Predict the species for the test data
predictions <- predict(svm_model, test_data)
# Print the predictions
print(predictions)
1 2 6 16 18 20 22
setosa setosa setosa setosa setosa setosa setosa
23 34 35 38 39 44 46
setosa setosa setosa setosa setosa setosa setosa
47 51 53 54 64 72 74
setosa versicolor versicolor versicolor versicolor versicolor versicolor
78 81 85 87 90 91 94
versicolor versicolor versicolor versicolor versicolor versicolor versicolor
99 100 101 106 109 111 116
versicolor versicolor virginica virginica virginica virginica virginica
117 120 124 127 133 134 136
virginica virginica virginica virginica virginica versicolor virginica
137 149 150
virginica virginica virginica
Levels: setosa versicolor virginica
In [7]: # Confusion Matrix to evaluate accuracy
conf_matrix <- confusionMatrix(predictions, test_data$Species)
localhost:8888/lab/tree/expt7/expt7.ipynb 2/4
10/20/24, 1:39 PM expt7
print(conf_matrix)
Confusion Matrix and Statistics
Reference
Prediction setosa versicolor virginica
setosa 15 0 0
versicolor 0 15 1
virginica 0 0 14
Overall Statistics
Accuracy : 0.9778
95% CI : (0.8823, 0.9994)
No Information Rate : 0.3333
P-Value [Acc > NIR] : < 2.2e-16
Kappa : 0.9667
Mcnemar's Test P-Value : NA
Statistics by Class:
Class: setosa Class: versicolor Class: virginica
Sensitivity 1.0000 1.0000 0.9333
Specificity 1.0000 0.9667 1.0000
Pos Pred Value 1.0000 0.9375 1.0000
Neg Pred Value 1.0000 1.0000 0.9677
Prevalence 0.3333 0.3333 0.3333
Detection Rate 0.3333 0.3333 0.3111
Detection Prevalence 0.3333 0.3556 0.3111
Balanced Accuracy 1.0000 0.9833 0.9667
In [8]: # Train using radial basis function (RBF) kernel and tune parameters
tuned_model <- tune.svm(Species ~ ., data = train_data,
kernel = "radial",
cost = 10^(-1:2), gamma = c(0.1, 0.5, 1))
# View best model parameters
print(tuned_model$best.parameters)
# Train final model with tuned parameters
svm_model_tuned <- svm(Species ~ ., data = train_data,
kernel = "radial",
cost = tuned_model$best.parameters$cost,
gamma = tuned_model$best.parameters$gamma)
# Evaluate on test data
predictions_tuned <- predict(svm_model_tuned, test_data)
conf_matrix_tuned <- confusionMatrix(predictions_tuned, test_data$Species)
print(conf_matrix_tuned)
localhost:8888/lab/tree/expt7/expt7.ipynb 3/4
10/20/24, 1:39 PM expt7
gamma cost
5 0.5 1
Confusion Matrix and Statistics
Reference
Prediction setosa versicolor virginica
setosa 15 0 0
versicolor 0 14 2
virginica 0 1 13
Overall Statistics
Accuracy : 0.9333
95% CI : (0.8173, 0.986)
No Information Rate : 0.3333
P-Value [Acc > NIR] : < 2.2e-16
Kappa : 0.9
Mcnemar's Test P-Value : NA
Statistics by Class:
Class: setosa Class: versicolor Class: virginica
Sensitivity 1.0000 0.9333 0.8667
Specificity 1.0000 0.9333 0.9667
Pos Pred Value 1.0000 0.8750 0.9286
Neg Pred Value 1.0000 0.9655 0.9355
Prevalence 0.3333 0.3333 0.3333
Detection Rate 0.3333 0.3111 0.2889
Detection Prevalence 0.3333 0.3556 0.3111
Balanced Accuracy 1.0000 0.9333 0.9167
In [ ]:
localhost:8888/lab/tree/expt7/expt7.ipynb 4/4
