The main aim of this lab is to apply machine learning pipelines and the MultilayerPerceptron algorithm to various datasets. Several tasks are completed including applying pipelines to the iris dataset, tuning a MultilayerPerceptron model on a fashion dataset using GridSearchCV, and comparing model performance on breast cancer data.
The main aim of this lab is to apply machine learning pipelines and the MultilayerPerceptron algorithm to various datasets. Several tasks are completed including applying pipelines to the iris dataset, tuning a MultilayerPerceptron model on a fashion dataset using GridSearchCV, and comparing model performance on breast cancer data.
The main aim of this lab is to apply machine learning pipelines and the MultilayerPerceptron algorithm to various datasets. Several tasks are completed including applying pipelines to the iris dataset, tuning a MultilayerPerceptron model on a fashion dataset using GridSearchCV, and comparing model performance on breast cancer data.
The main aim of this lab is to apply machine learning pipelines and the MultilayerPerceptron algorithm to various datasets. Several tasks are completed including applying pipelines to the iris dataset, tuning a MultilayerPerceptron model on a fashion dataset using GridSearchCV, and comparing model performance on breast cancer data.
The main aim of this lab is to deal with the pipeline technique and MultilayerPerceptron algorithm
keyboard_arrow_down Import libraries
from sklearn.pipeline import Pipeline import numpy as np import pandas as pd import matplotlib.pyplot as plt import seaborn as sns from sklearn.impute import SimpleImputer from sklearn import preprocessing from sklearn.preprocessing import StandardScaler from sklearn.decomposition import PCA from sklearn.model_selection import train_test_split from sklearn.linear_model import LinearRegression,LogisticRegression from sklearn.neighbors import KNeighborsClassifier from sklearn.ensemble import RandomForestClassifier from sklearn.naive_bayes import GaussianNB from sklearn import metrics from prettytable import PrettyTable from sklearn import svm, datasets from sklearn.feature_selection import SelectKBest, chi2 from sklearn.model_selection import GridSearchCV from sklearn import set_config from sklearn.metrics import accuracy_score from sklearn.metrics import precision_score from sklearn.metrics import f1_score from sklearn.metrics import recall_score from sklearn.neural_network import MLPClassifier
Drive already mounted at /content/gdrive; to attempt to forcibly remount, call drive.mount("/content/gdrive", force_remount=True). /content/gdrive/MyDrive/ML_Data/lab6
keyboard_arrow_down Task 1. With iris dataset
Apply pipeline including preprocessing steps (i.e., StandardScaler, SimpleImputer, feature selection, KBinsDiscretizer, …) and classification algorithms (i.e., Random forest, kNN, Naïve Bayes).
} data = datasets.load_iris() X,y = data.data, data.target # y = data.target X_train, X_test, y_train, y_test = train_test_split(X,y,test_size = 0.3,random_state=42) for name,al in map.items(): pipe_lr = Pipeline([('scl', StandardScaler()),('si', SimpleImputer(strategy='mean')),(name, al)]) pipe_lr.fit(X_train, y_train) # predict the X_test y_pred=pipe_lr.predict(X_test) # get accuracy of the trained model print(pipe_lr.score(X_test, y_test)) # or using accuracy_score from metrics print(accuracy_score(y_test, y_pred))
/usr/local/lib/python3.10/dist-packages/sklearn/neural_network/_multilayer_perceptron.py:1098: DataConversionWarning: A column-vector y
y = column_or_1d(y, warn=True) /usr/local/lib/python3.10/dist-packages/sklearn/neural_network/_multilayer_perceptron.py:541: ConvergenceWarning: lbfgs failed to conver STOP: TOTAL NO. of ITERATIONS REACHED LIMIT.
Increase the number of iterations (max_iter) or scale the data as shown in: https://scikit-learn.org/stable/modules/preprocessing.html self.n_iter_ = _check_optimize_result("lbfgs", opt_res, self.max_iter) 0.522
2.2. Apply MultilayerPerceptron algorithm with the following settings (the first hidden layer has 250 neuron, the second one has 100 neurons).
2.4. Compare the MultilayerPerceptron using the best hyperparameters in 2.3 and other classification algorithms (i.e., Random forest, kNN, Naïve Bayes) in termns of accuracy, precision, recall, and F1
+--------------------------------------------------------------------------------+----------+---------------------+--------------------- | algo | Accuracy | Precision | Recall +--------------------------------------------------------------------------------+----------+---------------------+--------------------- | RandomForestClassifier() | 0.472 | 0.5078111784127922 | 0.46880913502793514 | KNeighborsClassifier() | 0.516 | 0.541269501536488 | 0.5154440130909421 | GaussianNB() | 0.175 | 0.069421918767507 | 0.16362223756303312 | MLPClassifier(activation='tanh', hidden_layer_sizes=(100, 50), max_iter=10000) | 0.391 | 0.40307983346332776 | 0.3904590904545075 +--------------------------------------------------------------------------------+----------+---------------------+--------------------- /usr/local/lib/python3.10/dist-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision is ill-defined and be _warn_prf(average, modifier, msg_start, len(result)) /usr/local/lib/python3.10/dist-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision is ill-defined and be _warn_prf(average, modifier, msg_start, len(result)) /usr/local/lib/python3.10/dist-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision is ill-defined and be _warn_prf(average, modifier, msg_start, len(result))
keyboard_arrow_down Task 3. With breast cancer dataset
3.1. Apply GridSearchCV to MultilayperPerceptron to find the best hyperparameters (the setting of hyperparameters chosen by students)
canncer = datasets.load_breast_cancer() X = canncer.data y = canncer.target X = SelectKBest(chi2,k=10).fit_transform(X,y) X_train,X_test,y_train,y_test = train_test_split(X,y,test_size=0.2)
3.2. Compare the MultilayerPerceptron using the best hyperparameters in 3.1) and other classification algorithms (i.e., Random forest, kNN, Naïve Bayes) in termns of accuracy, precision, recall, and F1
