0% found this document useful (0 votes)

22 views82 pages

Slides Module2 1

Module 2 of the Bachelor of Science (Honours) in Data Science and Artificial Intelligence focuses on understanding agents and their environments, including definitions, rationality, and types of agents. It emphasizes the importance of specifying task environments using the PEAS (Performance, Environment, Actuators, Sensors) framework for designing rational agents. The module also discusses the evaluation of agent behavior and the concept of rationality in relation to performance measures.

Uploaded by

jyrfjidjjhstull

We take content rights seriously. If you suspect this is your content, claim it here.

Available Formats

Download as PDF, TXT or read online on Scribd

0% found this document useful (0 votes)

22 views82 pages

Slides Module2 1

Uploaded by

jyrfjidjjhstull

We take content rights seriously. If you suspect this is your content, claim it here.

Available Formats

Download as PDF, TXT or read online on Scribd

You are on page 1/ 82

Bachelor of Science (Honours) in Data Science and Artificial Intelligence

DA109: AI Basics

Module 2

Agents and Environment

Learning objective of Module 2

➢ To understand the fundamental concepts of different agents,

including their basic definitions, evaluate the behavior of agents in
different environments.

2
Parts
➢ Agents and Environments
❑ Brief overview of agents and environment

➢ Good Behavior: The Concept of Rationality

❑ Comprehensive understanding Concept of Rationality.

➢ The Nature of Environments

❑ Detailed analysis on types of environments.

➢ The Structure of Agents

❑ Aim to provide kind of agents with combination of particular components

➢ Knowledge-Based Agents
❑ Detailed discussion on knowledge-based agents with practical examples
3
Part - I
Agents and Environments

4
Agents and Environments

➢ An agent is anything that can be viewed as perceiving its environment through sensors and acting upon that
environment through actuators.

➢ We use the term percept to refer to the agent’s perceptual inputs at any given instant.

➢ An agent’s percept sequence is the complete history of everything the agent has ever perceived.

➢ In general, an agent’s choice of action at any given instant can depend on the entire percept sequence
observed to date, but not on anything it hasn’t perceived.

➢ By specifying the agent’s choice of action for every possible percept sequence, we have said more or less
everything there is to say about the agent.

➢ Mathematically speaking, we say that an agent’s behavior is described by the agent function that maps any
given percept sequence to an action.

5
Agents and Environments

➢ An agent is anything that can be viewed as perceiving its environment through sensors and acting upon that
environment through actuators

Agents interact with environments through sensors and actuators

6
Standard Embedded System
Agents and Environments
Structure

ADC microcontroller DAC

ASIC FPGA

sensors actuators

Agents interact with environments ASIC: application-specific integrated circuit

through sensors and actuators FPGA: field programmable gate array

7
Agents and Environments

Types of Agents

Human-Agent: A human Robotic Agent: A Software Agent: Software

agent has eyes, ears, robotic agent can have agent can have
and other organs which cameras, infrared keystrokes, file contents as
work for sensors and range finder, NLP for sensory input and act on
hand, legs, vocal tract sensors and various those inputs and display
work for actuators. motors for actuators. output on the screen.

8
Rationality

➢ Consider the simple vacuum-cleaner agent,

❑ cleans a square if it is dirty and moves to the other square if not; this is the agent function tabulated.

❑ This particular world has just two locations: squares A and B. The vacuum agent perceives which
square it is in and whether there is dirt in the square.

❑ It can choose to move left, move right, suck up the dirt, or do nothing.

❑ One very simple agent function is the following: if the current square is dirty, then suck; otherwise,
move to the other square.

9
Rationality

➢ Consider the simple vacuum-cleaner agent,

➢ We see that various vacuum-world

agents can be defined simply by filling in
the right-hand column in various ways.

➢ What is the right way to fill out the table?

In other words, what makes an agent
good or bad, intelligent or stupid?

Partial tabulation of a simple agent function for the vacuum-

cleaner world

10
Part - II
Good Behavior: The Concept of Rationality

11
Good Behavior: The Concept of Rationality

➢ A rational agent is one that does the right thing—conceptually speaking, every entry in the table for the agent
function is filled out correctly.

➢ Obviously, doing the right thing is better than doing the wrong thing, but what does it mean to do the right
thing?

12
Good Behavior: The Concept of Rationality

➢ When an agent is plunked down in an environment, it generates a sequence of actions according to the
percepts it receives.

➢ This sequence of actions causes the environment to go through a sequence of states. If the sequence is
desirable, then the agent has performed well.

➢ This notion of desirability is captured by a performance measure that evaluates any given sequence of
environment states.

➢ Notice that we said environment states, not agent states. If we define success in terms of agent’s opinion of
its own performance, an agent could achieve perfect rationality simply by deluding itself that its performance
was perfect.

13
Good Behavior: The Concept of Rationality

➢ Obviously, there is not one fixed performance measure for all tasks and agents; typically, a designer will
devise one appropriate to the circumstances.

➢ Consider, for example, the vacuum-cleaner agent from the preceding section. We might propose to measure
performance by the amount of dirt cleaned up in a single eight-hour shift.

➢ With a rational agent, of course, what you ask for is what you get. A rational agent can maximize this
performance measure by cleaning up the dirt, then dumping it all on the floor, then cleaning it up again, and
so on. A more suitable performance measure would reward the agent for having a clean floor.

➢ For example, one point could be awarded for each clean square at each time step (perhaps with a penalty for
electricity consumed and noise generated). As a general rule, it is better to design performance measures
according to what one actually wants in the environment, rather than according to how one thinks the agent
should behave.

14
Rationality

What is rational at any given time depends on four things:

❑ The performance measure that defines the criterion of success.
❑ The agent’s prior knowledge of the environment.
❑ The actions that the agent can perform.
❑ The agent’s percept sequence to date.

➢ Rational Agent: For each possible percept sequence, a rational agent should select an action that is
expected to maximize its performance measure, given the evidence provided by the percept sequence and
whatever built-in knowledge the agent has.

15
Rationality

➢ Is this a rational agent?

➢ That depends! First, we need to say what the performance measure is, what is known about the environment,
and what sensors and actuators the agent has.

➢ Let us assume the following:

❑ The performance measure awards one point for each clean square at each time step, over a “lifetime”
of 1000 time steps.

❑ The “geography” of the environment is known a priori but the dirt distribution and the initial location of
the agent are not. Clean squares stay clean and sucking cleans the current square. The Left and
Right actions move the agent left and right except when this would take the agent outside the
environment, in which case the agent remains where it is.

❑ The only available actions are Left , Right, and Suck.

❑ The agent correctly perceives its location and whether that location contains dirt.
16
Part - III
The Nature of Environments

17
The Nature of Environments

➢ Now that we have a definition of rationality, we are almost ready to think about building rational agents.

➢ First, however, we must think about task environments, which are essentially the “problems” to which rational
agents are the “solutions.”

➢ We begin by showing how to specify a task environment, illustrating the process with a number of examples.

➢ We then show that task environments come in a variety of flavors. The flavor of the task environment directly
affects the appropriate design for the agent program.

18
Specifying the task Environment

➢ In our discussion of the rationality of the simple vacuum-cleaner agent, we had to specify the performance
measure, the environment, and the agent’s actuators and sensors.

➢ We group all these under the heading of the task environment. For the acronymically minded, we call this the
PEAS (Performance, Environment, Actuators, Sensors) description.

➢ In designing an agent, the first step must always be to specify the task environment as fully as possible.

➢ The vacuum world was a simple example; let us consider a more complex problem: an automated taxi driver.

19
Specifying the task Environment

➢ An automated taxi driver:

Agent Type
Taxi Driver Performance,
Environment,
Actuators,
Sensors

PEAS description of the task environment for an automated taxi.

20
Specifying the task Environment

➢ An automated taxi driver:

Agent Type Performance

Taxi Driver Safe, fast, legal,
comfortable trip,
maximize profits

PEAS description of the task environment for an automated taxi.

21
Specifying the task Environment

➢ An automated taxi driver:

Agent Type Performance Environment

Taxi Driver Safe, fast, legal, Roads, other
comfortable trip, traffic,
maximize profits pedestrians,
customers

PEAS description of the task environment for an automated taxi.

22
Specifying the task Environment

➢ An automated taxi driver:

Agent Type Performance Environment Actuators

Taxi Driver Safe, fast, legal, Roads, other Steering, accelerator,
comfortable trip, traffic, brake, signal, horn,
maximize profits pedestrians, display
customers

PEAS description of the task environment for an automated taxi.

23
Specifying the task Environment

➢ An automated taxi driver:

Agent Type Performance Environment Actuators Sensors

Taxi Driver Safe, fast, legal, Roads, other Steering, accelerator, Cameras, sonar,
comfortable trip, traffic, brake, signal, horn, speedometer, GPS,
maximize profits pedestrians, display accelerometer,
customers engine sensors,
keyboard

PEAS description of the task environment for an automated taxi.

24
Specifying the task Environment
➢ An automated taxi driver:
❑ First, what is the performance measure to which we would like our automated driver to aspire?
Desirable qualities include getting to the correct destination; minimizing fuel consumption; minimizing the
trip time or cost; minimizing violations of traffic laws and disturbances to other drivers; maximizing safety
and passenger comfort; maximizing profits.

❑ Next, what is the driving environment that the taxi will face? Any taxi driver must deal with a variety of
roads, ranging from rural lanes and urban alleys to 12-lane freeways. The roads contain other traffic,
pedestrians, stray animals, road works, police cars, puddles, and potholes.

❑ The actuators for an automated taxi include those available to a human driver: control over the engine
through the accelerator and control over steering and braking. In addition, it will need output to a display
screen or voice synthesizer to talk back to the passengers, and perhaps some way to communicate with
other vehicles, politely or otherwise.

❑ The basic sensors for the taxi will include one or more controllable video cameras so that it can see the
road; it might augment these with infrared or sonar sensors to detect distances to other cars and
obstacles. To avoid speeding tickets, the taxi should have a speedometer, and to control the vehicle
properly, especially on curves, it should have an accelerometer 25
Specifying the task Environment

➢ An Medical diagnosis system:

Agent Type Performance Environment Actuators Sensors

Medical Healthy patient, Patient, hospital, Screen display Keyboard (entry of
diagnosis system minimize costs, staff (questions, tests, symptoms, findings,
lawsuits diagnoses, patient's answers)
treatments, referrals)