Chap.

5 Introduction to Optimization in Engineering

Contents (12.09 and 13.09, 2024)

◼ Introduction

◼ Optimization in Engineering

◼ Review of vectors and matrices

◼ References:
◼ J.S. Arora, Introduction to Optimum Design, Academic Press, Elsevier, 3rd Ed. 2012.
◼ K.-H. Chang, Design Theory and Methods using CAD/CAE, Chap. 3 – 5;
Academic Press, Elsevier, 2015.

CAD/CAM & Additive Manufacturing 1

 Introduction and Concepts
Engineering application of optimization

◼ Optimization, in its broadest sense,

can be applied to solve any
engineering problem.

◼ Any problem in which certain parameters need to be

determined to satisfy constraints can be formulated as one
optimization problem.

CAD/CAM & Additive Manufacturing 2

 Optimization in Engineering: Introduction and Concepts
To indicate the wide scope of the subject, some typical applications from different
engineering disciplines are given below.
(Source: S.S. Rao, Engineering optimization, John Wiley & Sons, Inc (2004))

1. Design of aircraft and aerospace structures for minimum weight

2. Finding the optimal trajectories of space vehicles

3. Design of civil engineering structures such as frames, foundations, bridges, towers,

chimneys, and dams for minimum cost

4. Minimum-weight design of structures for earthquake, wind, and other types of

random loading

5. Design of water resources systems for maximum benefit

6. Optimal plastic design of structures

7. Optimum design of linkages, cams, gears, machine tools, and other mechanical
components (→ Mechanism optimization)

CAD/CAM & Additive Manufacturing 3

 Optimization in Engineering: Introduction and Concepts
some typical applications from different engineering disciplines ….
(Source: S.S. Rao, Engineering optimization, John Wiley & Sons, Inc (2004))

8. Selection of machining conditions in metal-cutting processes for minimum

production cost
9. Design of material handling equipment such as conveyors, trucks, and cranes for
minimum cost
10.Design of pumps, turbines, and heat transfer equipment for maximum efficiency

11.Optimum design of electrical machinery such as motors, generators, and

transformers

12.Optimum design of electrical networks

13.Shortest route taken by a salesperson visiting various cities during one tour
14.Optimal production planning, controlling, and scheduling

CAD/CAM & Additive Manufacturing 4

 Optimization in Engineering: Introduction and Concepts

System evolution model of a design process

The designed object must be cost-effective, efficient, reliable, and durable.

➔ Optimization concepts and methods are helpful at every stage of the process

CAD/CAM & Additive Manufacturing 5

 Introduction …

So, what is an optimization problem?

A problem in which certain parameters

(design variables) need to be
determined to achieve the best
measureable performance (objective
function) while satisfying given
constraints!

Among others, it involves

- Problem formulation
- Devising solution techniques and
- Interpretation of results CAE in design optimization
Courtesy: B. Louhichi, et al 2014: DOI: 10.1007/s00170-014-6248-y

CAD/CAM & Additive Manufacturing 6

 Review of Matrix and Vector Algebra
Matrix and vector algebra

❑ Matrices are necessary tool to develop methods for optimum design.

❑ Linear optimization problems (linear algebra) involve understnding of the

solution process of linear equations

➔Important to understand the operations of matrix and vector algebra and be

confortable with their notations

➔ We review some fundamenta properties of matrices and vectors such as

▪ Basic notations
▪ Special matrices
▪ Determinants
▪ Matrix rank
▪ Solution to linear equation systems

CAD/CAM & Additive Manufacturing 7

 Review of Matrix and Vector Algebra
Vectors and points

❑ A point is an ordered list of numbers:

❑ (x1, x2) is a point consisting of two numbers

❑ (x1, x2, . . ., xn) is a point consisting of n numbers.

❑ The n components x1, x2, . . ., xn are collected into a column vector as

Each number xi is called a component of the (point) vector.

CAD/CAM & Additive Manufacturing 8

 Review of Matrix and Vector Algebra
Vectors and points ...

❑ In 3-dimensional space, the vector

x = [x1 x2 x3]T represents a point P

❑ When there are n components in a vector,

x is interpreted as a point in the n-dimensional
space, denoted as Rn.

The terms vector and point are used interchangeably, and denoted by
lowercase letters in boldface

Matrices are multi-dimensional vectors and denoted by uppercase letters in

boldface
CAD/CAM & Additive Manufacturing 9
 Review of Matrix and Vector Algebra
Sets

❑ Points satisfying certain conditions, for instance

all points having three components,

with the last having a fixed value of 3,

Members of a set are sometimes called elements

Represents an inequality constraints

CAD/CAM & Additive Manufacturing 10

 Review of Matrix and Vector Algebra
Superscripts/Subscripts and Summation Notation

❑ Superscripts are used to represent different vectors and matrices,

example

❑ x(i) represents the ith vector of a set and

❑ A(k) represents the kth matrix.

❑ Subscripts represent components of vectors and matrices, example

❑ xj is the jth component of x and

❑ aij is the i-jth element of matrix A

➔ Double subscripts are used to denote elements of a matrix
CAD/CAM & Additive Manufacturing 11
 Review of Matrix and Vector Algebra
Summation notation

❑ y = Ax ➔ multiplication of an n-dimensional vector x by an m x n matrix A to

obtain an m-dimensional vector y

OR

❑ For m-dimensional vectors a(i); i = 1 to n, y is given as a linear combination of

columns of matrix A

CAD/CAM & Additive Manufacturing 12

 Review of Matrix and Vector Algebra
Matrix notation

❑ A matrix is defined as a rectangular array of quantities that can be real

numbers, complex numbers, or functions of several variables.

❑ Entries (aij) in the rectangular array are

called the elements of the matrix

❑ Compact notation a matrix A of order m ╳ n with aij as its elements

OR

❑ An element of a matrix can be a real number, a complex number or an

expression. For example, 1 2i 
B= 
3 4 + x 
CAD/CAM & Additive Manufacturing 13
 Review of Matrix and Vector Algebra
System of simultaneous linear equations

Example 1:

❑ Where: x1, x2, x3 represent the solution variables for the system of equations.

Class Work:

Formulate the simultaneous equations in matrix form of the form Ax = b

CAD/CAM & Additive Manufacturing 14

 Review of Matrix and Vector Algebra
System of simultaneous linear equations

Example:

❑ Alternative formulation in augmented matrix:

Note: each column of the matrix is identified with a variable;

For example, the first column is associated with the variable x1
Homogenuous system of equation: if b = 0
Nonhomogenuous system of equation: if b  0 (i.e. any one element in b  0)

CAD/CAM & Additive Manufacturing 15

 Review of Matrix and Vector Algebra
System of simultaneous linear equations

Example 2: x1 + 2x 2 + x 3 = 4
3x1 + 8x 2 + 7 x 3 = 20
2x1 + 7 x 2 + 9x 3 = 23

❑ Class Work:

Formulate the simultaneous equations in matrix form of the form Ax = b

How would you solve for the vector x?

CAD/CAM & Additive Manufacturing 16

 Review of Matrix and Vector Algebra
Matrix types and their operation …

❑ Vector and matrix: What is the difference?

❑ Row vector and column vector

❑ Null matrix: A matrix with all its entries equal to zero (0)

❑ Identity matrix: a square matrix with all elements along the main diagonal
equal to one (1) and the rest null

❑ Triangular matrices: There are two variants:

Lower triangular – all null entries over the main diagonal

Upper triangular – all null entries below the main diagonal

CAD/CAM & Additive Manufacturing 17
 Review of Matrix and Vector Algebra
Matrix types and their operation …

What is the difference between the two

multiplication operations A*B and A.*B ?

What conditions should be fulfilled

to execute the two operations?

CAD/CAM & Additive Manufacturing 18

 Review of Matrix and Vector Algebra
Different forms of matrix multiplication

1. Multiplication of a matrix A(m ╳ n) by a scalar k:

2. Multiplication of two matrices A(m ╳ n) and B(r ╳ p) i.e. AB = C: demands that the
matrices are conformable, i.e. n = p. The product C has the order of m ╳ p

where elements cij are calculated as

CAD/CAM & Additive Manufacturing 19

 Review of Matrix and Vector Algebra
2. Matrix multiplication, Examples

❑ Calculate C = AB and D = BA for the following matrices A and B

Case 1

Case 2

Is AB = BA in any of the two cases given above? Have they the same order?

What condition(s) must be fulfilled to get AB and BA have the same order?
CAD/CAM & Additive Manufacturing 20
 Review of Matrix and Vector Algebra
Two important laws that matrix multiplication can satisfy

CAD/CAM & Additive Manufacturing 21

 Review of Matrix and Vector Algebra
3. Scalar product or dot product

◼ A scalar product is a special case of matrix multiplication: the multiplication of a row vector
by a column vector.

◼ If x and y are two n-component vectors, then their dot product (x.y) is expressed as

The dot product is a sum of the product of

corresponding elements of the vectors x and y.

The product is called the scalar or dot product of x and y

CAD/CAM & Additive Manufacturing 22

 Review of Matrix and Vector Algebra

Ttranspose of a matrix

If matrix A is given as

The transpose of matrix A,

denoted as AT is given as

Some important properties of a transpose matrix

CAD/CAM & Additive Manufacturing 23

 Review of Matrix and Vector Algebra

Functions
◼ A function of n independent variables x1, x2, . . ., xn is written as

◼ For functions of vector variables, the ith function is given by

◼ For m functions gi(x), i = 1 to m, g(x) is expressed as

CAD/CAM & Additive Manufacturing 24

 Review of Matrix and Vector Algebra

Functions …
◼ Continuous and discontinuous functions

Not differentiable at x1, x2 and x3

Differentiable everywhere
Continuous functions

Not a functions
Discontinuous
functions

CAD/CAM & Additive Manufacturing 25

 Review of Matrix and Vector Algebra

Derivatives of Functions of several variables

◼ First partial derivatives:

Notation: If f(x) has n variables

OR

Where each component of the gradient is a function of vector x.

CAD/CAM & Additive Manufacturing 26

 Review of Matrix and Vector Algebra

Derivatives of Functions of several variables …

◼ Second partial derivatives:

Notation: If f(x) has n variables

Contains n2 partial derivatives

OR arranged in matrix form

Called Hessian matrix or matrix of second derivatives

CAD/CAM & Additive Manufacturing 27

 Review of Matrix and Vector Algebra

The Determinant
◼ Determinants are scalar values associated with every square matrix

◼ Determinants are important in solving systems of n linear equations

with n unknowns:
Ax = b

◼ Let n = 2 Find the determinants of A

Class work
Solve also for x1 and x2 by elimination method

CAD/CAM & Additive Manufacturing 28

 Summary and Questions

In this lecture, among others, the following issues are discussed

◼ Introduction to Engineering optimization concept

◼ Review of vectors and matrices

?
Next: Chap. 5.2: Design optimization
CAD/CAM & Additive Manufacturing 29