0 ratings0% found this document useful (0 votes) 25 views9 pagesReinforcement Learning
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content,
claim it here.
Available Formats
Download as PDF or read online on Scribd
Reinke mon} Learn ney
Redn forcewent Leecrnmy ts Beedioack ase ML
APPreach, heve an agen} Dowsns to which actions
Perera \y Senne at He eavironmens cond the.
Tesulls oF achions
* Por each correct achon | aval apgeny wk on
Broach omc Ber Cach @ncorrect action the agent
ORS Ve Reeclback or Penally .
Fuel ora!
poo. with Jeb a Sve or ve
back basal on achon
suppor He gent E will move
jf a Reng Bhar! Path wel dag peal
og cx token Vee ager goes fon Se
2 he Wik BEF CR Sead ce Eto
Paths ove nok Wloued ty Other
Now Brom B,he can yo we Co or LT ig ve
Brom go c tee WRakwack CS given buh ag ne
mots Brom BA Ta —ve pealbac, is s
Oy avplgng Pe abe tule , cme
un:
tom
~The
aareracts wath Whe environmen} and
EN ostipda. actions We can Fey :
pen ht ce oom OBI TH YE Ay
othe er 4 Reena Sa
IME
by Roomme. ab
SRN icorarren F ak 9 tiene) vg tomas ayo 2 Qn Tei*Rerceme nn} Learn.
» re agen} Moary,
geayomer i coals us Seodbacys on :
UNDMNeE — Sapervese
Sime Ahere SS 9 Lechalod tala go he a :
tpamd tp Learn ba Us experience end ae
LAL ts used Ad salve specific i) Qe probern
where decision mama NS se SSeS» cond the goal 2s
dong lesen, Such AS Gome-Plagmg , oboe et.
vw THEE ATC boo Saves Q RL = ave and -Ug
1. PosHve BRL:
Am ye YRWards .
« TRewords inoreases sieeng}h anh the Foequ ere ap
a sveaie behaviary
This enccurges do execuje simifoy action thal,
Biesdd maw ewer ,
wah
Booey se any Da vode lata
Ts Q vecurtencg GQ be Favieuy dug
SrmiBactg | dn ~vel RRL, “Ue rewards ewe use
as a Aelerrer |} Go Weaken 1,
e nehavik
Pen a Vicuy aocldo
« Reward Clecreases streaih and the Sreqvonesy Ro
Sheet vehaviaae. ,
1, Ona mare game, Hhere mag. he a danger sot tiny
Sead Jo Loss
wna J
“"o rewards can be designed Ser such Spoils so the b
Hero. age doe rod visit tak Se)
r Ave and ~be reads cre; Simutated th RL, say
HHO BA tue reward and milo, Fey Some chon, ow
Hve veward -
, RL VS om ercample of Semi -superured SLsaxnm
yechaique and ts used AD mode seqrontial
ACI Sien- NAKMg, Process. e TAL den
r 6 Whe aye she ciducdsens Where Pi
/ ve used 4
} A RB c¢
* Comsicley Mine Setourrny gid 0
i
|
=
gore sna Ty Rigs) wre re, ”
2 R
A Tebo}
Can mow |
& ris. G
| " Astume She sharing node
~ 8 crag, youl ode ts
Ye geere tS acu} fog
Ahe Shovtes} Payy
Stim, 19 goad Shute. ae
+ Consider aQnolhey Br,
Gore ass shown My ig. GoaQ
an Dye oid, gare, the |
reg Fi8e tndicartes the Tangy
changer ydacn ts a docx
OMA Pe Hoe ain Aiagomeut Sires
YS Fe gear,
» The aim es yo Stuy4. 1 Sag, Brom bottom Legs,
oe, asma she actions Sees, 2a top
and Yoltorn do reach He good.
RL ts Wgndy subknk Bor saitat
Soue sis) es pecia the_ones uty$
/ BAL cs foi Sunn Bu environ
where compRo le inFermation
onfams Rive objec}
re deeigicioa grid derection cam po.
velley Sabved using. a eLass fie, Shon RL
Pro horas
“cer hin
PES
ts ave a7 WOW dees RL wery
Lo undersiund the. wooning Preciss
8 dhe TL, ve neod do eonsidoy
yoo mai FHS 5
_ Gavisonmens ; ga can be
angrrg such asa room maze ,
gooy bal grand et,
~ Age ¢ An PMreWyeny agent such as AP sow
- Lek us tune om exemple of a mane eavivmrens !
Who} Me agen} reeds to explore, ,
> TRE mare Ps consisthgy eB an SE phocw wWhrh Ro
walk Ss a Bre pty an SY a diamen| lnloc,
- The agent cannop cross He SE bhocn as cy Re
SeLtd coal
~ BF Fre agen} eaches He, SY block | Shen 423 The
a) weward TR TL weaches ne Fre PTF Men geks
=\ reward pom). and
9s can dace Y AcHims: move up, move down
move REI and move’ Yh).
Mubhipre paths ave theve Jo veach the!
Gpak Sdule t-e Sy’!
- The -—hLhLrLUmr oma Poth do reach Lr Brad
Pom) pay he weeds do make 1 im’ Possible | Lower
Sitps
= ees Me e3enk considers Me yaly SA 85-51-3253
ge he (wise gey Phe FU reward Poy Cre Path
The agent wild Ae. do yemember Fhe Preseding Sees
Arak + has dunen ap Peach He Pad siep
~ TO memorize yre SHS, ib assigns \ value dy
each Yrevicus SIP:~ Wow, re gene has
Previas sreps flay
previaas bDocw . Sach
Buy wha} wid He agen} do iQ h
moving Brom She block which a Shorts
hoc! on both sides) ~* AS) | Vadue
= Oy WIDL be g AYRerLh comdih'on By Prel
agent whelher he shuld Jo YP or doom as
each \plocw has we Same vedug _
~ So, He evove aPpprcach 2s nol gis
Gor ye, agent fo reach Pe hestineyn i tRze
_ ence Fo sotve! HHO Problem, WS ht Uce the.
PreMvnan eprartor, which *s the. vngin cree ph
vemindk BL:
success. Saeed 4!
assignm™g dhe or, ‘sBekman fFqwrahy
e w2j —ellewends usek wBeaornn equations are;
fiction Per§orwedl bg Fe agen) és rregerved toas ‘a’
_ ge occarred, ba pes Sorry sre. acHom ts s
_ awe severed /Seedoacn obi ned ur, each geod ane}
oad aclion ts qu fi
ah
o Aiscam) Bact 2 Gromma
The Bellen equatn con pe witlen as;
VG) > max [RG44 very
whet? >
VG) = value cadcudaled al, a, Pariiculay Poy
| read = Reward ab a particuey s jute is by
Pex germina, an ack) a
Vic Discams Qaucdw
VG) = The value ad Ihe’ Previcus ste
-~ On ve atove equa we are dinmg the
mar of he compiete Values wecause +ho_ agen
kates tp Bad Pre OP mak | saan allongs
Ror $3 who
v 639 nen (REO4V VET)
herve V(SI2 0 pecause Hhere is
no Barthey she do Mae
V 6292 mnen(PED}
D> VE2> Faxdd
>vO 21
oor Sr Woon
[2
VG) 2 man Go +vve JV
were V 209, VEE) eet RESO pecuse thew
A a Ais) Sule ,
v2qy83
Ma [Yeas
S173)
6 0°73
S10
Vast
TS MO yewayy V52) 2 mat {o-G Da)
SVEN => maxfo-9J
> VE22=0-4
Por st bloc
V6) = max (R GOA VET]
| Neve Vz0-4 » VU20-4 and RE=0, because
there tS. ne wdvakdlak Iie Shaye alse
| VEIN > max 09694 3 VOI max Gory
> VQ) 20-9]
Por So \phock
YEs9> max (AGA 4VVG/S)
Weve vf 20-9 VI I26'2| andl PGs),
z
wheve ts no veourd at this
vS5) = max (0°9@81)
SS VE8I= max(o-739
D> V6SI2 0-73
or Sq whew ;
2 max {A GID VS)
a V 204 eee and REG) =0, because
— Ds ae reward: A4 this Ste alty
V64) 2 vax 2 @939),
> V 6992 wnax © 66)
— -—
Cor Slo yoo
“VGio 2 mae £ R&D VED)
62066 and Rk ag bemuse
neve V 204, Neusord OF This, Shad ato
Ahere 4S
VGl9) 2 rar G:1G62D)
S nar (2 $9.)
> Vv(sio) ae
20, because
Shue alseFor sil pBocn
VOU I = max [R&sav ve)
ere Reaca VEO=0-89, and PY D0, becaus,
Phere YF NO weaved ay Jie Shuse also 7
v 6nd ynax fo esa)
DV GV > max ss) - o-gs yi
Foy Sit p&ock,
VED = max READY Ws")
nee Y= 0°97 VED=0-5q Sa
ts no wewarcal 3 and. REA, wecase there
Oe bis She also 1,
NISL 2 max 2 9@:ssT\
> VEN 2 mar 487) x ae f
ZOUS ' {
For St biocw
V 697 = max [REI 4¥ VES)
mere VY 20-4) Veo) and TEM 20) Bectise there a
no reward, QL Wis Ste ‘eds'd ‘|’ :
VOIDS Mar @-aaD
V(G97 2 6 7
or sit blow
oe es :
Veug= mex(Resreyive a)
here ¥
20-4, VE IF0-4F AMA E20
Vu D2 max bay Te (
Ey v 612 0:8)
yur Slo worn
‘pol 512 boc
v.19 = max [RG 4y,
1a A VSI Jur 7 9
cee ed Ce. ae PES:9) Wise a
eee ae
v(s107 2 ven (0:91)
MSoz0-9)
amg(o: 93)
V RIAs o FB
and RO )20
VGIX). 2 mar
eI@
2" “8 3
\ DvVERI= 0-7V20°66 | Vo0-74
© SuPRoe MWe ageny os presen} on the calls)
Dy has boo possi i hey he Storss
3! stds aving Wig her Valve than $6
So th wrt ye yp su
> From s2 iy has 3 Posh Le,
$1 70-8)
sé - walh
$3 ~0)
$3 Ts Wihress valve
> 9) wih Go dd S32
Wow Prom sa th WL weacl dhe el aynenet i Ee
y
DO Suvpose He agent 03 Preseny ae
2} het % posebAtdre, 10
@ S9-O Ce
Sul =e 3)
SIL ss Wighey
so Th wilt Jo to si
Rrom sy thr hes % possrbidhe
S10 ~ 0-73
S1L > 0-73
St- OF
St is highs}, So Ty wil go to sz
Th has vo PossTbi My. .
su - ors)
so tt .
Th WiLL Yo fogoa
. ~ sO
Saris wmighey Le
ow Brom 53 Fp WHOL Veh the
you syuye ie SY
vom St