03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

CoursesTutorialsData SciencePractice

Gradient Descent Optimization

in Tensorflow
Last Updated : 09 Feb, 2023
Gradient descent is an optimization algorithm used to find
the values of parameters (coefficients) of a function (f) that
minimizes a cost function. In other words, gradient descent
is an iterative algorithm that helps to find the optimal
solution to a given problem.

In this blog, we will discuss gradient descent optimization in

TensorFlow, a popular deep-learning framework.
TensorFlow provides several optimizers that implement
different variations of gradient descent, such as stochastic
gradient descent and mini-batch gradient descent.

Before diving into the details of gradient descent in

TensorFlow, let’s first understand the basics of gradient
descent and how it works.

What is Gradient Descent?

Gradient descent is an iterative optimization algorithm that
is used to minimize a function by iteratively moving in the
direction of the steepest descent as defined by the negative
of the gradient. In other words, the gradient descent

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 1/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

algorithm takes small steps in the direction opposite to the

gradient of the function at the current point, with the goal of
reaching a global minimum.

The gradient of a function tells us the direction in which the

function is increasing or decreasing the most. For example,
if the gradient of a function is positive at a certain point, it
means that the function is increasing at that point, and if the

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 2/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

gradient is negative, it means that the function is decreasing

at that point.

The gradient descent algorithm starts with an initial guess

for the parameters of the function and then iteratively
improves these guesses by taking small steps in the
direction opposite to the gradient of the function at the
current point. This process continues until the algorithm
reaches a local or global minimum, where the gradient is
zero (i.e., the function is not increasing or decreasing).

How does Gradient Descent work?

The gradient descent algorithm is an iterative algorithm that
updates the parameters of a function by taking steps in the
opposite direction of the gradient of the function. The
gradient of a function tells us the direction in which the
function is increasing or decreasing the most. The gradient
descent algorithm uses the gradient to update the
parameters in the direction that reduces the value of the
cost function.

The gradient descent algorithm works in the following way:

1. Initialize the parameters of the function with some

random values.
2. Calculate the gradient of the cost function with respect
to the parameters.
3. Update the parameters by taking a small step in the
opposite direction of the gradient.

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 3/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

4. Repeat steps 2 and 3 until the algorithm reaches a local

or global minimum, where the gradient is zero.
5. Here is a simple example to illustrate the gradient
descent algorithm in action. Let’s say we have a function
f(x) = x2, and we want to find the value of x that
minimizes the function. We can use the gradient descent
algorithm to find this value.

First, we initialize the value of x with some random value,

say x = 3. Next, we calculate the gradient of the function
with respect to x, which is 2x. In this case, the gradient is 6
(2 * 3). Since the gradient is positive, it means that the
function is increasing at x = 3, and we need to take a step in
the opposite direction to reduce the value of the function.

We update the value of x by subtracting a small step size

(called the learning rate) from the current value of x. For
example, if the learning rate is 0.1, we can update the value
of x as follows:

x = x - 0.1 * gradient
= 3 - 0.1 * 6
= 2.7

We repeat this process until the algorithm reaches a local or

global minimum. To implement gradient descent in
TensorFlow, we first need to define the cost function that
we want to minimize. In this example, we will use a simple
linear regression model to illustrate how gradient descent
works.
https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 4/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

Linear regression is a popular machine learning algorithm

that is used to model the relationship between a dependent
variable (y) and one or more independent variables (x). In a
linear regression model, we try to find the best-fit line that
describes the relationship between the dependent and
independent variables. To create a linear regression model
in TensorFlow, we first need to define the placeholders for
the input and output data. A placeholder is a TensorFlow
variable that we can use to feed data into our model.

Here is the code to define the placeholders for the input and
output data:

Python3

# Import tensorflow 2 as tensorflow 1

import tensorflow.compat.v1 as tf
tf.disable_v2_behavior()

# Define the placeholders for

# the input and output data
x = tf.placeholder(tf.float32)
y = tf.placeholder(tf.float32)

# Define the placeholders for

# the input and output data
x = tf.placeholder(tf.float32)
y = tf.placeholder(tf.float32)

Next, we need to define the variables that represent the

parameters of our linear regression model. In this example,
https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 5/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

we will use a single variable (w) to represent the slope of

the best-fit line. We initialize the value of w with a random
value, say 0.5.

Here is the code to define the variable for the model

parameters:

Python3

# Define the model parameters

w = tf.Variable(0.5, name="weights")

Once we have defined the placeholders and the model

parameters, we can define the linear regression model by
using the TensorFlow tf.add() and tf.multiply() functions.
The tf.add() function is used to add the bias term to the
model, and the tf.multiply() function is used to multiply the
input data (x) and the model parameters (w).

Here is the code to define the linear regression model:

Python3

# Define the linear regression model

model = tf.add(tf.multiply(x, w), 0.5)

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 6/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

Once we have defined the linear regression model, we need

to define the cost function that we want to minimize. In this
example, we will use the mean squared error (MSE) as the
cost function. The MSE is a popular metric that is used to
evaluate the performance of a linear regression model. It
measures the average squared difference between the
predicted values and the actual values.

To define the cost function, we first need to calculate the

difference between the predicted values and the actual
values using the TensorFlow tf.square() function. The
tf.square() function squares each element in the input
tensor and returns the squared values.

Here is the code to define the cost function using the MSE:

Python3

# Define the cost function (MSE)

cost = tf.reduce_mean(tf.square(model - y))

Once we have defined the cost function, we can use the

TensorFlow tf.train.GradientDescentOptimizer() function to
create an optimizer that uses the gradient descent algorithm
to minimize the cost function. The
tf.train.GradientDescentOptimizer() function takes the
learning rate as an input parameter. The learning rate is a
hyperparameter that determines the size of the steps that

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 7/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

the algorithm takes to reach the minimum of the cost

function.

Here is the code to create the gradient descent optimizer:

Python3

# Create the gradient descent optimizer

optimizer = tf.train.GradientDescentOptimizer(learning_rat

Once we have defined the optimizer, we can use the

minimize() method of the optimizer to minimize the cost
function. The minimize() method takes the cost function as
an input parameter and returns an operation that, when
executed, performs one step of gradient descent on the cost
function.

Here is the code to minimize the cost function using the

gradient descent optimizer:

Python3

# Minimize the cost function

train = optimizer.minimize(cost)

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 8/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

Once we have defined the gradient descent optimizer and

the train operation, we can use the TensorFlow Session
class to train our model. The Session class provides a way
Python
to BasicsTensorFlow
execute Interview Questions Python
operations. Quiz the
To train Popular Packages
model, we Py
need to initialize the variables that we have defined earlier
(i.e., the model parameters and the optimizer) and then run
the train operation in a loop for a specified number of
iterations.

Here is the code to train the linear regression model using

the gradient descent optimizer:

Python3

# Define the toy dataset

x_train = [1, 2, 3, 4]
y_train = [2, 4, 6, 8]

# Create a TensorFlow session

with tf.Session() as sess:
# Initialize the variables
sess.run(tf.global_variables_initializer())

# Training loop
for i in range(1000):
sess.run(train,
feed_dict={x: x_train,
y: y_train})

# Evaluate the model

w_val = sess.run(w)

# Mean Squared Error (MSE) between

# the predicted and true output values
print(w_val)

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 9/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

In the above code, we have defined a Session object and

used the global_variables_initializer() method to initialize
the variables. Next, we have run the train operation in a
loop for 1000 iterations. In each iteration, we have fed the
input and output data to the train operation using the
feed_dict parameter. Finally, we evaluated the trained
model by running the w variable to get the value of the
model parameters. This will train a linear regression model
on the toy dataset using gradient descent. The model will
learn the weights w that minimizes the mean squared error
between the predicted and true output values.

Visualizing the convergence of Gradient

Descent using Linear Regression
Linear regression is a method for modeling the linear
relationship between a dependent variable (also known as
the response or output variable) and one or more
independent variables (also known as the predictor or input
variables). The goal of linear regression is to find the values
of the model parameters (coefficients) that minimize the
difference between the predicted values and the true values
of the dependent variable.

The linear regression model can be expressed as follows:

where:

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 10/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

is the predicted value of the dependent variable

are the independent variables

are the coefficients (model parameters) associated with

the independent variables.
b is the intercept (a constant term).

To train the linear regression model, you need a dataset

with input features (independent variables) and labels
(dependent variables). You can then use an optimization
algorithm, such as gradient descent, to find the values of
the model parameters that minimize the loss function.

The loss function measures the difference between the

predicted values and the true values of the dependent
variable. There are various loss functions that can be used
for linear regression, such as mean squared error (MSE) and
mean absolute error (MAE). The MSE loss function is
defined as follows:

where:

is the predicted value for the

th
sample

is the true value for the

th sample
https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 11/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

N is the total number of samples

The MSE loss function measures the average squared
difference between the predicted values and the true
values. A lower MSE value indicates that the model is
performing better.

Python3

import tensorflow as tf
import matplotlib.pyplot as plt

# Set up the data and model

X = tf.constant([[1.], [2.], [3.], [4.]])
y = tf.constant([[2.], [4.], [6.], [8.]])

w = tf.Variable(0.)
b = tf.Variable(0.)

# Define the model and loss function

def model(x):
return w * x + b

def loss(predicted_y, true_y):

return tf.reduce_mean(tf.square(predicted_y - true_y)

# Set the learning rate

learning_rate = 0.001

# Training loop
losses = []
for i in range(250):
with tf.GradientTape() as tape:
predicted_y = model(X)
current_loss = loss(predicted_y, y)
gradients = tape.gradient(current_loss, [w, b])
w.assign_sub(learning_rate * gradients[0])

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 12/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

b.assign_sub(learning_rate * gradients[1])

losses.append(current_loss.numpy())

# Plot the loss

plt.plot(losses)
plt.xlabel("Iteration")
plt.ylabel("Loss")
plt.show()

Output:

Loss vs Iteration

The loss function calculates the mean squared error (MSE)

loss between the predicted values and the true labels. The
model function defines the linear regression model, which is
a linear function of the form .
https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 13/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

The training loop performs 250 iterations of gradient

descent. At each iteration, the with tf.GradientTape() as
tape: block activates the gradient tape, which records the
operations for computing the gradients of the loss with
respect to the model parameters.

Inside the block, the predicted values are calculated using

the model function and the current values of the model
parameters. The loss is then calculated using the loss
function and the predicted values and true labels.

After the loss has been calculated, the gradients of the loss
with respect to the model parameters are computed using
the gradient method of the gradient tape. The model
parameters are then updated by subtracting the learning
rate multiplied by the gradients from the current values of
the parameters. This process is repeated until the training
loop is completed.

Finally, the model parameters will contain the optimized

values that minimize the loss function, and the model will
be trained to predict the dependent variable given the
independent variables.

A list called losses store the loss at each iteration. After the
training loop is completed, the losses list contains the loss
values at each iteration.

The plt.plot function plots the losses list as a function of the

iteration number, which is simply the index of the loss in the
list. The plt.xlabel and plt.ylabel functions add labels to the

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 14/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

x-axis and y-axis of the plot, respectively. Finally, the

plt.show function displays the plot.

The resulting plot shows how the loss changes over the
course of the training process. As the model is trained, the
loss should decrease, indicating that the model is learning
and the model parameters are being optimized to minimize
the loss. Eventually, the loss should converge to a minimum
value, indicating that the model has reached a good
solution. The rate at which the loss decreases and the final
value of the loss will depend on various factors, such as the
learning rate, the initial values of the model parameters, and
the complexity of the model.

Visualizing the Gradient Descent

Gradient descent is an optimization algorithm that is used to

find the values of the model parameters that minimize the
loss function. The algorithm works by starting with initial
values for the parameters and then iteratively updating the
values to minimize the loss.

The equation for the gradient descent algorithm for linear

regression can be written as follows:

where:

w_i is the ith model parameter.

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 15/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

is the learning rate (a hyperparameter that determines

the step size of the update).

is the partial derivative of the MSE loss function with

respect to the ith model parameter.

This equation updates the value of each parameter in the

direction that reduces the loss. The learning rate determines
the size of the update, with a smaller learning rate resulting
in smaller steps and a larger learning rate resulting in larger
steps.

The process of performing gradient descent can be

visualized as taking small steps downhill on a loss surface,
with the goal of reaching the global minimum of the loss
function. The global minimum is the point on the loss
surface where the loss is the lowest.

Here is an example of how to plot the loss surface and the

trajectory of the gradient descent algorithm:

Python3

import numpy as np
import matplotlib.pyplot as plt

# Generate synthetic data

np.random.seed(42)
X = 2 * np.random.rand(100, 1) - 1
y = 4 + 3 * X + np.random.randn(100, 1)

# Initialize model parameters

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 16/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

w = np.random.randn(2, 1)
b = np.random.randn(1)[0]

# Set the learning rate

alpha = 0.1

# Set the number of iterations

num_iterations = 20

# Create a mesh to plot the loss surface

w1, w2 = np.meshgrid(np.linspace(-5, 5, 100),
np.linspace(-5, 5, 100))

# Compute the loss for each point on the grid

loss = np.zeros_like(w1)
for i in range(w1.shape[0]):
for j in range(w1.shape[1]):
loss[i, j] = np.mean((y - w1[i, j] \
* X - w2[i, j] * X**2)**2)

# Perform gradient descent

for i in range(num_iterations):
# Compute the gradient of the loss
# with respect to the model parameters
grad_w1 = -2 * np.mean(X * (y - w[0] \
* X - w[1] * X**2))
grad_w2 = -2 * np.mean(X**2 * (y - w[0] \
* X - w[1] * X**2))

# Update the model parameters

w[0] -= alpha * grad_w1
w[1] -= alpha * grad_w2

# Plot the loss surface

fig = plt.figure(figsize=(10, 6))
ax = fig.add_subplot(projection='3d')
ax.plot_surface(w1, w2, loss, cmap='coolwarm')
ax.set_xlabel('w1')
ax.set_ylabel('w2')
ax.set_zlabel('Loss')

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 17/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

# Plot the trajectory of the gradient descent algorithm

ax.plot(w[0], w[1], np.mean((y - w[0]\
* X - w[1] * X**2)**2),
'o', c='red', markersize=10)
plt.show()

Output:

Gradient Descent finding global minima

This code generates synthetic data for a quadratic

regression problem, initializes the model parameters, and
performs gradient descent to find the values of the model
parameters that minimize the mean squared error loss. The
code also plots the loss surface and the trajectory of the
gradient descent algorithm on the loss surface.

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 18/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

The resulting plot shows how the gradient descent

algorithm takes small steps downhill on the loss surface
and eventually reaches the global minimum of the loss
function. The global minimum is the point on the loss
surface where the loss is the lowest.

It is important to choose an appropriate learning rate for the

gradient descent algorithm. If the learning rate is too small,
the algorithm will take a long time to converge to the global
minimum. On the other hand, if the learning rate is too
large, the algorithm may overshoot the global minimum and
may not converge to a good solution.

Another important consideration is the initialization of the

model parameters. If the initialization is too far from the
global minimum, the gradient descent algorithm may take a
long time to converge. It is often helpful to initialize the
model parameters to small random values.

It is also important to choose an appropriate stopping

criterion for the gradient descent algorithm. One common
stopping criterion is to stop the algorithm when the loss
function stops improving or when the improvement is below
a certain threshold. Another option is to stop the algorithm
after a fixed number of iterations.

Overall, gradient descent is a powerful optimization

algorithm that can be used to find the values of the model
parameters that minimize the loss function for a wide range
of machine learning problems.

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 19/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

Conclusion
In this blog, we have discussed gradient descent
optimization in TensorFlow and how to implement it to train
a linear regression model. We have seen that TensorFlow
provides several optimizers that implement different
variations of gradient descent, such as stochastic gradient
descent and mini-batch gradient descent.

Gradient descent is a powerful optimization algorithm that

is widely used in machine learning and deep learning to find
the optimal solution to a given problem. It is an iterative
algorithm that updates the parameters of a function by
taking steps in the opposite direction of the gradient of the
function. TensorFlow makes it easy to implement gradient
descent by providing built-in optimizers and functions for
computing gradients.

"This course is very well structured and easy to learn.

Anyone with zero experience of data science, python or ML
can learn from this. This course makes things so easy that
anybody can learn on their own. It's helping me a lot.
Thanks for creating such a great course."- Ayushi Jain |
Placed at Microsoft

Now's your chance to unlock high-earning job opportunities

as a Data Scientist! Join our Complete Machine Learning &
Data Science Program and get a 360-degree learning
experience mentored by industry experts.

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 20/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

Get hands on practice with 40+ Industry Projects, regular

doubt solving sessions, and much more. Register for the
Program today!

S swap… 3

Previous Article Next Article

Similar Reads
Applications of Gradient Descent in TensorFlow
To reduce a model's cost function, machine learning
practitioners frequently employ the gradient descent…
7 min read

Stochastic Gradient Descent Classifier

One essential tool in the data science and machine learning
toolkit for a variety of classification tasks is the stochastic…
14 min read

Stochastic Gradient Descent Regressor

A key method in data science and machine learning is the
stochastic gradient descent (SGD) regression. It is essential t…
10 min read

Python - tensorflow.GradientTape.gradient()

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 21/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

TensorFlow is open-source Python library designed by Google

to develop Machine Learning models and deep learning neur…
2 min read

PyQt5 QSpinBox - Getting descent of the font

In this article we will see how we can get the descent of the
spin box's font i.e text. The descent is the distance from the…
2 min read

View More Articles

Article Tags :

Technical Scripter 2022 Tensorflow Python Technical Scripter

+1 More

Practice Tags : python

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 22/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

A-143, 9th Floor, Sovereign Corporate

Tower, Sector-136, Noida, Uttar Pradesh -
201305

Company Explore
About Us Job-A-Thon Hiring Challenge
Legal Hack-A-Thon
Careers GfG Weekly Contest
In Media Offline Classes (Delhi/NCR)
Contact Us DSA in JAVA/C++
Advertise with us Master System Design
GFG Corporate Solution Master CP
Placement Training Program GeeksforGeeks Videos
Geeks Community

Languages DSA
Python Data Structures

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 23/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks
Java Algorithms
C++ DSA for Beginners
PHP Basic DSA Problems
GoLang DSA Roadmap
SQL DSA Interview Questions
R Language Competitive Programming
Android Tutorial

Data Science & ML Web Technologies

Data Science With Python HTML
Data Science For Beginner CSS
Machine Learning Tutorial JavaScript
ML Maths TypeScript
Data Visualisation Tutorial ReactJS
Pandas Tutorial NextJS
NumPy Tutorial NodeJs
NLP Tutorial Bootstrap
Deep Learning Tutorial Tailwind CSS

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 24/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

Python Tutorial Computer Science

Python Programming Examples GATE CS Notes
Django Tutorial Operating Systems
Python Projects Computer Network
Python Tkinter Database Management System
Web Scraping Software Engineering
OpenCV Tutorial Digital Logic Design
Python Interview Question Engineering Maths

DevOps System Design

Git High Level Design
AWS Low Level Design
Docker UML Diagrams
Kubernetes Interview Guide
Azure Design Patterns
GCP OOAD
DevOps Roadmap System Design Bootcamp
Interview Questions

School Subjects Commerce

Mathematics Accountancy
Physics Business Studies
Chemistry Economics
Biology Management
Social Science HR Management
English Grammar Finance
Income Tax

Databases Preparation Corner

SQL Company-Wise Recruitment Process
MYSQL Resume Templates
PostgreSQL Aptitude Preparation
PL/SQL Puzzles
MongoDB Company-Wise Preparation
Companies
Colleges

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 25/26
03/06/2024, 11:06 Gradient Descent Optimization in Tensorflow - GeeksforGeeks

Competitive Exams More Tutorials

JEE Advanced Software Development
UGC NET Software Testing
UPSC Product Management
SSC CGL Project Management
SBI PO Linux
SBI Clerk Excel
IBPS PO All Cheat Sheets
IBPS Clerk

Free Online Tools Write & Earn

Typing Test Write an Article
Image Editor Improve an Article
Code Formatters Pick Topics to Write
Code Converters Share your Experiences
Currency Converter Internships
Random Number Generator
Random Password Generator

@GeeksforGeeks, Sanchhaya Education Private Limited, All rights reserved

https://www.geeksforgeeks.org/gradient-descent-optimization-in-tensorflow/?ref=lbp 26/26