View metadata, citation and similar papers at core.ac.uk
brought to you by
CORE
provided by Elsevier - Publisher Connector
Available online at www.sciencedirect.com
ScienceDirect
Procedia Computer Science 58 (2015) 113 – 120
6HFRQG,QWHUQDWLRQDO6\PSRVLXPRQ&RPSXWHU9LVLRQDQGWKH,QWHUQHW 9LVLRQ1HW¶
9LVXDOL]LQJVRFLDOQHWZRUNVXVLQJDWUHHPDSRYHUODLGZLWKDJUDSK
0LWKLOH\VK6DWKL\DQDUD\DQDQD 1LNROD\%XUOXWVNL\D
6FKRRORI&RPSXWLQJ(QJLQHHULQJDQG0DWKHPDWLFV
8QLYHUVLW\RI%ULJKWRQ8.
D
$EVWUDFW
,Q WKH ODVW IHZ \HDUV VRFLDO QHWZRUNV KDYH UHDFKHG LWV KLJKHVWOHYHO RI FRPSOH[LW\ DQG VFDOH EXW WKHUH LV VWLOO D JDS LQKRZ WR
UHSUHVHQWWKHVHQHWZRUNVWRDXVHUIRUH[SORUDWLRQDQGDQDO\VLV $VDUHVXOWLWLVRIWHQ FKDOOHQJLQJIRUDXVHUWRXQGHUVWDQGWKH
UHODWLRQVKLSVLQWKHVRFLDOQHWZRUNVDQGPDNHDQLQIRUPHGGHFLVLRQRYHULW*UDSKVKDYHEHFRPHDVWDQGDUGIRUVRFLDOQHWZRUNV
YLVXDOL]DWLRQDQGDQDO\VLV+RZHYHULQWKLVSDSHUDIHZYLVXDOL]DWLRQVEDVHGRQDWUHHPDSRYHUODLGE\DJUDSKZLWKDGLIIHUHQW
QXPEHURIFXUYHVHGJHVDQGQRGHVZHUHGHVLJQHGDQGHYDOXDWHG$VDFDVHVWXG\D7ZLWWHUQHWZRUNZDVYLVXDOL]HGZKHUHWKH
WUHHPDS RYHUODLG ZLWK D JUDSK FRQYH\HG LQIRUPDWLRQ RQ SHRSOH LQ D QHWZRUN WKHLU UHODWLRQVKLSV DQG FRPPRQ LQWHUHVWV 7KH
SHUIRUPDQFHRIWKHWUHHPDSYLVXDOL]DWLRQVLQFOXGLQJWKHDFFXUDF\DQGWLPHRIDQVZHULQJTXHVWLRQVZDVHYDOXDWHGE\WZHQW\WKUHH
SDUWLFLSDQWVLQFRPSDULVRQWRDQRWKHUZHOONQRZQYLVXDOL]DWLRQEDVHGRQ(XOHUGLDJUDP)LQDOO\WKHUHVXOWVRIWKHSHUIRUPDQFH
HYDOXDWLRQOLPLWDWLRQVDQGXVHIXOQHVVRIWKHGHVLJQHGYLVXDOL]DWLRQVZHUHGLVFXVVHG
7KH$XWKRUV3XEOLVKHGE\(OVHYLHU%9
©
2015 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license
(http://creativecommons.org/licenses/by-nc-nd/4.0/).
3HHUUHYLHZXQGHUUHVSRQVLELOLW\RIRUJDQL]LQJFRPPLWWHHRIWKH6HFRQG,QWHUQDWLRQDO6\PSRVLXPRQ&RPSXWHU9LVLRQDQGWKH
Peer-review
under responsibility
of organizing committee of the Second International Symposium on Computer Vision and the Internet
,QWHUQHW 9LVLRQ1HW¶
(VisionNet’15)
.H\ZRUGV6RFLDOQHWZRUNYLVXDOL]DWLRQWUHHPDSV(XOHUGLDJUDPVJUDSKV
,QWURGXFWLRQ
6RFLDOQHWZRUNVKDYHEHHQDQLPSRUWDQWWRROIRUKXPDQFRPPXQLFDWLRQVLQFHWKHILUVWGD\VRIWKH,QWHUQHW7KHVH
GD\VSHRSOHXVHVRFLDOQHWZRUNVLQWKHLUFRPPXQLFDWLRQHYHU\GD\)RUH[DPSOH)DFHERRN7ZLWWHU/LQNHG,QDQG
,QVWDJUDP DUH ZLGHO\ XVHG E\ SHRSOH DOO DURXQG WKH ZRUOG +RZHYHU WKH FRPSOH[LW\ DQG VFDOH RI WKHVH QHWZRUNV
PRWLYDWHVSHRSOHWRGHVLJQYDULRXVYLVXDOL]DWLRQVIRUWKHH[SORUDWLRQRIGDWD>@)XUWKHUPRUHXVHUVKDYHWULHGWR
&RUUHVSRQGLQJDXWKRU7HO
(PDLODGGUHVV06DWKL\DQDUD\DQDQ#EULJKWRQDFXN
1877-0509 © 2015 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license
(http://creativecommons.org/licenses/by-nc-nd/4.0/).
Peer-review under responsibility of organizing committee of the Second International Symposium on Computer Vision and the Internet (VisionNet’15)
doi:10.1016/j.procs.2015.08.037
114
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
YLVXDOL]HWKHLUGDWDXVLQJGLIIHUHQWYLVXDOL]DWLRQWRROVIRUH[DPSOHVXFKDV*RRJOH)XVLRQ7DEOHV,%00DQ\(\HV
6SRWILUH 9LVXDOL]LQJ VRFLDO QHWZRUNV LQYROYHV VXFK WDVNV DV WR FRQYH\ LQIRUPDWLRQ DERXW SHRSOH LQYROYHG LQ WKH
QHWZRUNDQGWKHLUUHODWLRQVKLSV
*UDSKVDUHDFRPPRQDQGSRZHUIXOWRROIRUVRFLDOQHWZRUNYLVXDOL]DWLRQ5HVHDUFKHUVKDYHLQYHVWLJDWHGDQGXVHG
JUDSKVDVDYLVXDOL]DWLRQWRROIRUORQJWLPH>@$VDUHVXOWVHYHUDOJUDSKEDVHGOD\RXWVIRUGLIIHUHQWVRFLDOQHWZRUNV
KDYH EHHQ SURSRVHG DQG GHYHORSHG > @ ,Q WKH VRFLDO QHWZRUN FRQWH[W HDFK QRGH RI D JUDSK FRUUHVSRQGV WR D
SHUVRQRIDVRFLDOQHWZRUNDQGHDFKHGJHFRUUHVSRQGVWRDSDUWLFXODUUHODWLRQVKLSEHWZHHQWZRSHUVRQVUHSUHVHQWHG
E\WKHQRGHV7KHPDLQDGYDQWDJHRIXVLQJJUDSKVIRUVRFLDOQHWZRUNYLVXDOL]DWLRQLVVFDODELOLW\VLPSOLFLW\DQG DQ
H[LVWHQFHRIZHOOGHYHORSHGIRUPDOJUDSKWKHRU\IRUDQDO\VLVRIVRFLDOQHWZRUNV
'HVSLWH WKH SRZHU RI JUDSKV IRU VRFLDO QHWZRUN YLVXDOL]DWLRQ RWKHU YLVXDOL]DWLRQ W\SHV VKRZHG XVHIXOQHVV IRU
VRFLDOQHWZRUNYLVXDOL]DWLRQIRUH[DPSOH9HQQRU(XOHUGLDJUDPVDQGWUHHPDSV>@8VLQJ9HQQGLDJUDPVIRU
JUDSKLFDO UHSUHVHQWDWLRQ RI KLHUDUFKLFDO ILOH V\VWHPV ZDV SURSRVHG LQ >@ 3ODFHPHQW RI QRGHV RQ WKH SODQH LQVLGH
9HQQ FXUYHV DOORZHG XVHUV WR XVH SUR[LPLW\ EHWZHHQ FDWHJRULHV DQG ILOHV WR UHSUHVHQW FORVHQHVV DQG VLPLODULW\
$QRWKHUYLVXDOL]DWLRQW\SHWUHHPDSDOORZVYLVXDOL]LQJKLHUDUFKLFDOGDWD6HYHUDOYLVXDOL]DWLRQVKDYHEHHQSURSRVHG
XVLQJWUHHPDSVIRUGLIIHUHQWFRQWH[WDQGDSSOLFDWLRQV)RULQVWDQFHLQ>@WKHDXWKRUVSURSRVHGXVLQJDWUHHPDSLQ
VRFLDO QHWZRUN VHWWLQJV ,Q WKLV YLVXDOL]DWLRQ D UHFWDQJOH FRUUHVSRQGHG WR D SDUWLFXODU PRQWK DQG WKH VL]H RI WKH
UHFWDQJOHZDVSURSRUWLRQDOWRWKHQXPEHURIHPDLOVVHQWE\WKHDFWRU
+RZHYHU XVLQJ D JUDSK LQ FRPELQDWLRQ ZLWK RWKHU YLVXDOL]DWLRQ WHFKQLTXHV FDQ OHDG WR LPSURYHPHQW LQ XVHUV¶
SHUIRUPDQFHXVLQJWKHVHIXVHGYLVXDOL]DWLRQV,QGHHGVXFKYLVXDOL]DWLRQVDUHFDSDEOHWRYLVXDOL]HERWKVHWVDQGWKHLU
HOHPHQWV)RULQVWDQFHWH[WDQDO\VLVPD\LQYROYHYLVXDOL]LQJERWKWKHNH\ZRUGVDQGWKHGRFXPHQWVWKH\EHORQJWR
H[SORUDWLRQRISLFWXUHV PD\UHTXLUH YLVXDOL]LQJERWKLPDJHVDQGWKHLUWRSLFV$QRWKHUH[DPSOHLVDQDO\]LQJVRFLDO
QHWZRUNV ZKHUH LW LV LPSRUWDQW WR YLVXDOL]H SHRSOH¶V QDPHV DQG WKH FRPPXQLWLHV WKH\ DUH DIILOLDWHG ZLWK )RU
H[DPSOH LQ >@ WKH DXWKRUV SURSRVHG D FRPELQDWLRQ RI D JUDSK ZLWK ERXQGLQJ ER[HV LQ RUGHU WR LPSURYH WKH
XQGHUVWDQGLQJ RI VRFLDO QHWZRUNV ,Q WKHLU YLVXDOL]DWLRQ HDFK UHFWDQJOH UHSUHVHQWHG DQ DFWRU ZKHUH WKH VL]H RI WKH
UHFWDQJOHZDVSURSRUWLRQDOWRWKHQXPEHURIFRQQHFWLRQVRIWKHDFWRUWRRWKHUDFWRUV$YLVXDOL]DWLRQEDVHGRQ(XOHU
GLDJUDPVZDVSURSRVHGDQGWKHQHYDOXDWHGLQ>@,QWKHLUSDSHUWKHDXWKRUVXVHGDFRPELQDWLRQRI(XOHUGLDJUDPV
ZLWKJUDSKOLNHVWUXFWXUHVWRFRQYH\LQIRUPDWLRQ$VDFDVHVWXG\WKLVW\SHRIYLVXDOL]DWLRQZDVHYDOXDWHGXVLQJD
VRFLDOQHWZRUNH[DPSOH7KHPDLQJRDORIWKHSDSHUZDVWRLPSURYHWKHUHDGDELOLW\RI(XOHUGLDJUDPVDQGHYDOXDWH
WKHSHUIRUPDQFHRIWKHGHVLJQHGYLVXDOL]DWLRQV7KXVRWKHUUHVHDUFKHUVWULHGWRLGHQWLI\SURSHUWLHVWKDWPD\FRUUHODWH
ZLWK HIIHFWLYH OD\RXWV RI (XOHU GLDJUDPV FRPELQHG ZLWK JUDSKV >@ ,Q >@ WKH DXWKRUV SURSRVHG XVLQJ D
YLVXDOL]DWLRQ WHFKQLTXH WKDW GLVSOD\V WKH WUHH VWUXFWXUH DV D WUHHPDS DQG WKH FRQQHFWLRQ EHWZHHQ LWV UHFWDQJOHV E\
FXUYHGOLQNVRYHUODLGRQWKHWUHHPDS+RZHYHUWKHVHOLQNVVKRZHGFRQQHFWLRQRQO\EHWZHHQWKHUHFWDQJOHVEXWQRW
WKHHOHPHQWVRIWKHUHFWDQJOHV2QFRQWUDU\ZHSURSRVHGXVLQJYLVXDOL]DWLRQZKHUHDWUHHPDSLVRYHUODLGE\DJUDSK
DQG WKH HOHPHQWV RI WKH JUDSK EHORQJ WR D SDUWLFXODU UHFWDQJOH RI WKH WUHHPDS +RZHYHU WKH GHVLJQ RI VXFK
YLVXDOL]DWLRQ ZDV QRW FRQFHUQHG WKRURXJKO\ DV ZHOO DV RQO\ XVHUV¶ SUHIHUHQFH ZDV HYDOXDWHG >@ $ JXLGHOLQH IRU
FUHDWLQJUHFWDQJXODUWUHHPDS ZDV SURSRVHGLQ>@2QH RIWKH LPSRUWDQWVXJJHVWLRQVE\WKH DXWKRUV ZDVWRDYRLG
H[WUHPHDVSHFWUDWLRVZKLFKZHXVHGLQGHVLJQLQJRXUWUHHPDSEDVHGYLVXDOL]DWLRQVLQWKLVSDSHU
,QWKLVSDSHUDQRYHOYLVXDOL]DWLRQIRUVRFLDOQHWZRUNVDWUHHPDSRYHUODLGZLWKDJUDSKLVGHVLJQHGDQGWKHQWKH
SHUIRUPDQFH RI WKH GHVLJQHG YLVXDOL]DWLRQ LV HYDOXDWHG ,Q RXU GHVLJQ ZH YDU\ WKH QXPEHU RI UHFWDQJOHV LQ WKH
WUHHPDSDVZHOODVWKHQXPEHURIQRGHVDQGHGJHVLQWKHJUDSKRYHUODLGZLWKWKHWUHHPDSLQRUGHUWRFRPSDUHWKH
SHUIRUPDQFHRIGLIIHUHQW WUHHPDSVRYHUODLG ZLWK JUDSKV7KHSHUIRUPDQFHRIWKHVHWUHHPDSEDVHG YLVXDOL]DWLRQVLV
HYDOXDWHGLQDQHPSLULFDO H[SHULPHQW)RUWKLVSXUSRVH ZHFRPSDUHWKH GHVLJQHGYLVXDOL]DWLRQVWR (XOHUGLDJUDP
EDVHG YLVXDOL]DWLRQV ZKLFK VKRZHG XVHIXOQHVV DQG HIIHFWLYHQHVV LQ VRFLDO QHWZRUN YLVXDOL]DWLRQ > @ 7KH
FRPSDULVRQLVGRQHIRUDGLIIHUHQWQXPEHURIFXUYHVQRGHVDQGHGJHVLQWKH(XOHUEDVHGYLVXDOL]DWLRQV
7KH DGGUHVVHG SUREOHP LQ WKLV SDSHU LV WR HYDOXDWH WKH SHUIRUPDQFH RI WKH QRYHO WUHHPDSEDVHG YLVXDOL]DWLRQ
(LJKWHHQWUHHPDSEDVHGDQG(XOHUGLDJUDPEDVHGYLVXDOL]DWLRQVZHUHGHVLJQHGDQGWKHQFRPSDUHGE\WZHQW\ WKUHH
SDUWLFLSDQWVLQDQHPSLULFDOHYDOXDWLRQ$WWKHHQGRIWKLVSDSHUWKHUHVXOWVIRUWKHHYDOXDWLRQRI D7ZLWWHUQHWZRUN
YLVXDOL]DWLRQDUHGHPRQVWUDWHGDQGGLVFXVVHG
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
115
6RFLDO1HWZRUN9LVXDOL]DWLRQ
3ULRU WR YLVXDOL]LQJ D VRFLDO QHWZRUN WKH PRVW FRPPRQ SUREOHPV SHRSOH HQFRXQWHU ZKHQ H[SORULQJ D VRFLDO
QHWZRUNZHUHDQDO\]HG)RUWKLVSXUSRVHWKHOLWHUDWXUHRQYLVXDOL]DWLRQRIVRFLDOQHWZRUNVZDVVWXGLHG>
@ $V D UHVXOW WZR JRDOV RI VRFLDO QHWZRUN YLVXDOL]DWLRQV ZHUH IRUPXODWHG ,Q RXU SDSHU ZH DVVXPHG WKDW D
YLVXDOL]DWLRQRIVRFLDOQHWZRUNVHUYHVWKHIROORZLQJJRDOV>@
x ,GHQWLI\LQJWKHDFWRUVRIDQHWZRUNDXVHUQHHGVWRXQGHUVWDQGZKRWKHDFWRUVRIWKHQHWZRUNDUH,QRUGHU
WRLGHQWLI\WKHDFWRUVRIWKHQHWZRUNWKHDFWRUVPXVWEHHDVLO\GLVWLQJXLVKDEOHDQGFRXQWDEOH8VXDOO\DQ
DFWRULVUHSUHVHQWHGDVDQRGHDFLUFOHRUDUHFWDQJOHLQYLVXDOL]DWLRQEXWWKHUHDUHPDQ\RWKHUZD\VWRPDS
DFWRUVWRJUDSKLFDOSULPLWLYHVRIYLVXDOL]DWLRQ
x 8QGHUVWDQGLQJUHODWLRQVKLSVLQDQHWZRUNDXVHUFDQEHGLUHFWHGWRZDUGDQDQVZHUUHJDUGLQJWKHZD\LQ
ZKLFKKHRUDSHUVRQRIKLVLQWHUHVWLVFRQQHFWHGWRSHRSOHLQWKHQHWZRUNE\SURYLGLQJWKHXVHUZLWK
YLVXDOL]DWLRQVZKHUHUHODWLRQVKLSVEHWZHHQSHRSOHLQWKHQHWZRUNDUHUHSUHVHQWHGH[SOLFLWO\)RUH[DPSOH
DQHGJHRUDQLQWHUVHFWLRQFDQEHDYLVXDOUHSUHVHQWDWLRQRIVXFKUHODWLRQVKLS
,QWKLVSDSHUWKHSHUIRUPDQFHRIYLVXDOL]DWLRQVIRUDVRFLDOQHWZRUNZDVFRQVLGHUHGUHJDUGLQJWRWKHWZR
DIRUHPHQWLRQHGJRDOV
7UHHPDSVDQG(XOHUGLDJUDPIRUYLVXDOL]DWLRQRIVRFLDOQHWZRUNV
,QWKLVZRUNDWUHHPDSRYHUODLGE\DJUDSK 70* ZDVGHVLJQHGIRUYLVXDOL]DWLRQRIVRFLDOQHWZRUNVDQGWKHQLW
ZDVFRPSDUHGWRDQ(XOHUGLDJUDPRYHUODLGE\DJUDSK ('* $VDFDVHVWXG\IRUYLVXDOL]DWLRQRIVRFLDOQHWZRUNV
D 7ZLWWHU QHWZRUN ZDV FKRVHQ $Q (XOHU GLDJUDP DQG D WUHHPDS ZHUH DXJPHQWHG E\ JUDSKV IRU FRQYH\LQJ
LQIRUPDWLRQRQSHRSOHLQWHUHVWVLQWKHLUQHWZRUN7KHGHVLJQDQGVHPDQWLFVRIWKHGLDJUDPVDUHGLVFXVVHGEHORZ
(XOHUGLDJUDPVUHSUHVHQWUHODWLRQVKLSEHWZHHQFXUYHV$QRYHUODSRIWKHFXUYHVUHSUHVHQWVDUHODWLRQVKLSEHWZHHQ
WKHFXUYHVZKLOHQRRYHUODSUHSUHVHQWVDEVHQFHRIDUHODWLRQVKLSEHWZHHQWKHFXUYHV$QH[DPSOHRI(XOHUGLDJUDP
LQ D VRFLDO QHWZRUN VHWWLQJ LV VKRZQ LQ )LJXUH D ,Q WKLV FDVH HDFK FXUYH UHSUHVHQWV DQ DFWRU DQG WKH RYHUODSV
EHWZHHQWKHFXUYHVUHSUHVHQWIULHQGVKLSUHODWLRQVKLSV
7UHHPDSVYLVXDOL]HKLHUDUFKLFDOWUHHVWUXFWXUHGGDWDDVDVHWRIQHVWHGUHFWDQJOHV VHH)LJXUHE (DFKUHFWDQJOH
RQDWUHHPDSFRUUHVSRQGVWRDEUDQFKRIDWUHH$OVRHDFKUHFWDQJOHWLOHGZLWKVPDOOHUUHFWDQJOHVUHSUHVHQWLQJVXE
EUDQFKHV RI WKH WUHH ,Q WKLV ZRUN D FRPPRQ ERXQGDU\ EHWZHHQ UHFWDQJOHV LQ D WUHHPDS UHSUHVHQWV D UHODWLRQVKLS
EHWZHHQWKHUHFWDQJOHVDQDORJRXVO\WRDQRYHUODSRIWKHFXUYHVLQ(XOHUGLDJUDPV,QWKHFDVHRID7ZLWWHUQHWZRUN
HDFKUHFWDQJOHUHSUHVHQWVDQDFWRUDQGWKHH[LVWHQFHRIDFRPPRQERXQGDU\EHWZHHQWZRUHFWDQJOHVFRUUHVSRQGVWR
DIULHQGVKLSUHODWLRQVKLSEHWZHHQWKHVHWZRDFWRUVUHSUHVHQWHGDVUHFWDQJOHV
1H[W VWHS LQ WKH GHVLJQ RI WKH SURSRVHG YLVXDOL]DWLRQ D WUHHPDS ZDV RYHUODLG ZLWK QRGHV DV D UHVXOW WKH
YLVXDOL]DWLRQZDVH[WHQGHGWRFRPPXQLFDWHPRUHLQIRUPDWLRQ,QFDVHRID7ZLWWHUQHWZRUNWKHQRGHVLQDIRUPRI
WH[W FRUUHVSRQG WR LQWHUHVWV RI WKH DFWRUV UHSUHVHQWHG DV UHFWDQJOHV LQ WKH YLVXDOL]DWLRQV )RU H[DPSOH WZR DFWRUV
-RKQDQG/XNHDUHIULHQGVVLQFHWKHUHFWDQJOHVUHSUHVHQWLQJWKHPKDYHDFRPPRQHGJH VHH)LJXUHE $OVRLWFDQ
EHLQKHULWHGIURPWKHGLDJUDPWKDW-RKQOLNHVPRYLHVDQGFULFNHWZKHWKHU/XNHLVIRQGRIVRFLDOQHWZRUNVFKRFRODWH
)RUPXODDQGFULFNHW7KHLQWHUHVWVZULWWHQLQWKHUHFWDQJOHVVKRZFRPPRQLQWHUHVWVIRUERWK-RKQDQG/XNHZKLFK
LVFULFNHW$QDORJLFDOO\WRWKHWUHHPDSZLWKQRGHVLQ)LJXUHEDQ(XOHUGLDJUDPZLWKQRGHVFDQEHXVHGWRFRQYH\
SHRSOH VLQWHUHVW )LJXUHD
)LQDOO\ WKH WUHHPDS ZDV RYHUODLG E\ D JUDSK 70* IRU YLVXDOL]DWLRQ RI VHWV UHFWDQJOHV HOHPHQWV QRGHV
UHODWLRQVKLS EHWZHHQ HOHPHQWV HGJHV DQG UHODWLRQVKLS EHWZHHQ VHWV FRPPRQ ERXQGDULHV $Q DQDORJRXV (XOHU
GLDJUDPRYHUODLGE\DJUDSK ('* LVVKRZQLQ)LJXUHDZKHUHWKHFXUYHVUHSUHVHQWDFWRUVDQGWKHLUUHODWLRQVKLSV
DQGWKHQRGHVLQVLGHWKHFXUYHVUHSUHVHQWSHUVRQDOLWLHVIROORZHGE\WKHDFWRUV7KHSHUVRQDOLWLHVDUHLQWHUFRQQHFWHG
E\OLQNV)RUH[DPSOH-RKQLVDIULHQGRI/XNHZKRIROORZV/DG\*DJD)XUWKHUPRUHIURPWKHDXJPHQWHGGLDJUDP
LWLVSRVVLEOHWRFRQFOXGHWKDW/DG\*DJDLVDIULHQGRI0HVVLDQG0HVVLLVIROORZHGE\ERWK-RKQDQG/XNH±WKLV
FDQEHDFFRPSOLVKHGE\IROORZLQJWKHHGJHVEHWZHHQWKHSHUVRQDOLWLHV%RWKYLVXDOL]DWLRQVLQ)LJXUHFRPPXQLFDWH
WKH VDPH LQIRUPDWLRQ DERXW DFWRUV FHOHEULWLHV WKH\ IROORZ DQG FRQQHFWLRQV EHWZHHQ WKH FHOHEULWLHV +RZHYHU
FRPPRQSHUVRQDOLWLHVIRU('*DUHUHSUHVHQWHGLQLQWHUVHFWLRQRIWKHFXUYHVZKHUHDVWKHFRPPRQSHUVRQDOLWLHVIRU
116
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
)LJXUH(XOHUGLDJUDP D DQG7UHHPDS E
)LJXUH(XOHUGLDJUDP D DQG7UHHPDS E ZLWKQRGHV
)LJXUH('* D DQGWKHGHVLJQHG70* E
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
70* DUH GXSOLFDWHG 7KLV IDFW JDYH XV D K\SRWKHVLV WKDW ORRNLQJ IRU FRPPRQ SHUVRQDOLWLHV LQ 70* ZRXOG WDNH
ORQJHUWLPHVLQFHLWUHTXLUHVVHDUFKLQJIRUWKHGXSOLFDWLRQV
,QRUGHUWRHYDOXDWHWKH SHUIRUPDQFHRIWKHSURSRVHGWUHHPDSEDVHGGLDJUDP 70* DVZHOODVWRFRPSDUHLWV
SHUIRUPDQFHZLWK(XOHUGLDJUDPEDVHGYLVXDOL]DWLRQ ('* DWKUHHOHYHOHYDOXDWLRQZLWKWZHQW\WKUHHSDUWLFLSDQWV
ZDVFRQGXFWHG7KHGHVLJQDQGSURFHVVRIWKHHYDOXDWLRQLVLQWKHQH[WVHFWLRQ
(YDOXDWLRQ
7KHJRDORIWKHGHVLJQHGHYDOXDWLRQZDV
7RHYDOXDWHDQGFRPSDUHWKHWDVNSHUIRUPDQFHRIWKHSURSRVHG70*ZLWKWKHWDVNSHUIRUPDQFHRI('*
DQG
7RHYDOXDWHWKHLPSDFWRIWKHQXPEHURIFXUYHVUHFWDQJOHVSUHVHQFHRIQRGHVHGJHVLQ70*DQG('*
YLVXDOL]DWLRQRQWKHLUSHUIRUPDQFH
7RIRUPXODWHDQGXQGHUVWDQGOLPLWDWLRQVRI70*LQYLVXDOL]LQJVRFLDOQHWZRUNVDQHPSLULFDOVWXG\ZDVGHVLJQHG
%RWK WUHHPDS DQG (XOHU GLDJUDP YLVXDOL]DWLRQV UHSUHVHQW WKH VDPH LQIRUPDWLRQ 7KH VWXG\ LV D FRQWUROOHG RQH
FRQGXFWHGZLWKLQDJURXSWRHYDOXDWHWKHSHUIRUPDQFHRI7UHHPDSZLWKJUDSKDQG(XOHUGLDJUDPVZLWKJUDSKWKHQ
WZHQW\ WKUHH SDUWLFLSDQWV ZHUH UDQGRPO\ VHOHFWHG IURP WKH VWXGHQWV RI WKH 8QLYHUVLW\ RI %ULJKWRQ DW &RPSXWLQJ
(QJLQHHULQJDQG0DWKHPDWLFVGHSDUWPHQW$OOWKHSDUWLFLSDQWVZHUHFRPSXWHUOLWHUDWHV(LJKWHHQRIWKHSDUWLFLSDQWV
ZHUH PDOHILYH IHPDOHDQGWKHLUDJHYDULHGIURPWR\HDUV ZLWK\HDUVDVWKHPHDQYDOXHIRUWKHLUDJH
0RVWRIWKHSDUWLFLSDQWVKDYHQRWVHHQVXFKGLDJUDPVLQWKHILHOGRIVRFLDOQHWZRUNDQDO\VLVWKRXJKWKH\KDYHKHDUG
DERXW(XOHUGLDJUDPVDQG9HQQGLDJUDPVEXWQRW7UHHPDSV
(DFKSDUWLFLSDQWZDVWDNHQWRWKHXVDELOLW\ODEDQGZDVWUDLQHGZLWKVDPSOHGLDJUDPV ERWK(XOHUDQG7UHHPDS
W\SHV PXOWLSOHFKRLFHTXHVWLRQW\SHVRSWLRQVDQGWKHVRIWZDUH,QWKH8QLYHUVLW\RI%ULJKWRQZHKDYHDGHGLFDWHG
XVDELOLW\ODEIRUFRQGXFWLQJVWXGLHV7KHURRPKDGDJRRGYHQWLODWLRQXSJUDGHGFRPSXWHUDQGDFRPIRUWDEOHFKDLU
VRWKDWDOOSDUWLFLSDQWVXVHWKHVDPHFRPSXWHULQWKHODE:HXVHGDVRIWZDUHGHYHORSHGE\$QGUHZ%ODNHFDOOHGDV
5HVHDUFK9HKLFOH ZKHUH GLDJUDPVDORQJ ZLWKTXHVWLRQVDQGRSWLRQVFRXOGEH ORDGHGWRFDWFK UHVSRQVHWLPHDQG
HUURUVFRPPLWWHGE\SDUWLFLSDQWVGXULQJWKHVWXG\7KHTXHVWLRQVZHUHUDQGRPL]HGZKLFKKDGDPL[RI(XOHUEDVHG
GLDJUDPVDQG7UHHPDSEDVHGGLDJUDPVWRDYRLGOHDUQLQJHIIHFW7RIXUWKHUUHGXFHWKLVHIIHFWSDUWLFLSDQWVZHUHJLYHQ
DSSURSULDWH WUDLQLQJEHIRUH WKH\VWDUWHG ZLWKWKH PDLQVWXG\ XVLQJWKH VRIWZDUH$OVRWRDYRLGGLDJUDPHIIHFW ZH
FRQVLGHUHGFHUWDLQOHYHOVRIFRPSOH[LW\VXFKDVFXUYHVQRGHVDQGHGJHVVRWKDWSDUWLFLSDQWVVSHQG
VXIILFLHQWWLPHLQUHDGLQJDQGXQGHUVWDQGLQJWKHGLDJUDPV
'LDJUDP&KDUDFWHULVWLFV
)RU(XOHUEDVHGGLDJUDPV ZH XVHG FLUFOHVRI YDULRXVVL]HVDQGIRU7UHHPDSEDVHGGLDJUDPV ZH XVHG
UHFWDQJOHVRIYDULRXVVKDSHV
&XUYHFRORUVZHUHUDQGRPO\SLFNHGZLWKRXWDQ\SULRULW\RURUGHUVRWKDWHDFKFXUYHZDVGLVWLQFWLQERWK
(XOHUGLDJUDPVDQG7UHHPDSV
&XUYHODEHOVZHUHSODFHGDVFORVHDVSRVVLEOHWRWKHFXUYHVLQERWK(XOHUGLDJUDPVDQG7UHHPDSV
1RGHVZHUHGLVWULEXWHGUDQGRPO\DQGHGJHVFRQQHFWLQJWKHPZHUHUDQGRPWRR
:H HQVXUHG (XOHU GLDJUDP DQG 7UHHPDS FXUYHV UHSUHVHQWHG VHW SURSHUWLHV VXFK DV FRQWDLQPHQW
GLVMRLQWQHVVDQGLQWHUVHFWLRQ
4XHVWLRQ7\SHV
)RUHYDOXDWLRQRIWKHSURSRVHGWUHHPDSEDVHGYLVXDOL]DWLRQZHVHOHFWHGWKUHHWDVNVIRFXVLQJRQVHWVQRGHVDQG
WKHLUUHODWLRQVKLSV)RUHDFKWDVNSDUWLFLSDQWVKDGWRDQVZHUWKHIROORZLQJTXHVWLRQV
117
118
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
&RXQWLQJLQWHUVHFWLRQVFRPPRQERXQGDULHV +RZPDQ\FRQQHFWLRQV$GDPKDV"
,GHQWLI\LQJQRGHV :KDWDUHWKHFRPPRQLQWHUHVWVEHWZHHQ$GDPDQG/XNH"
,GHQWLI\LQJQRGHVE\IROORZLQJHGJHV :KDWDUHWKHFRPPRQSHRSOH$GDPDQG/XNHDUHIROORZLQJ"
)RUWKHILUVWW\SHRITXHVWLRQVDSDUWLFLSDQWKDGWRILQGDFXUYHRUDUHFWDQJOHFRUUHVSRQGLQJWRDQDFWRU7KHQD
SDUWLFLSDQWLGHQWLILHGKRZPDQ\LQWHUVHFWLRQVWKHFXUYHKDGRUKRZPDQ\FRPPRQERXQGDULHVWKHUHFWDQJOHKDG)RU
WKH VHFRQG W\SH RI TXHVWLRQV D SDUWLFLSDQW KDG WR LGHQWLI\ QRGHV LQ LQWHUVHFWLRQV RI FXUYHV RU LQ UHFWDQJOHV
FRUUHVSRQGLQJWRSDUWLFXODUDFWRUV)LQDOO\WKHODVWW\SHRITXHVWLRQVUHTXLUHGDSDUWLFLSDQWWRIROORZHGJHVRIQRGHV
LQFXUYHVRUUHFWDQJOHV
9DU\LQJFXUYHVQRGHVDQGHGJHV
7KHQXPEHURIUHFWDQJOHVDQGFXUYHVIRUWUHHPDSVDQG(XOHUGLDJUDPVFRUUHVSRQGLQJO\YDULHGIURPIRXUWRVL[
DQGWKHQHLJKWFXUYHVDQGUHFWDQJOHV VHH)LJXUHV $OVRWKHFRPSOH[LW\RIWKHYLVXDOL]DWLRQVKDGWKUHHOHYHOV
WKH ILUVW OHYHO LQFOXGHG RQO\ SXUH (XOHU GLDJUDPV DQG WUHHPDSV VHH )LJXUH WKH VHFRQG OHYHO LQFOXGHG (XOHU
GLDJUDPVDQGWUHHPDSVZLWKQRGHVLQVLGHWKHFXUYHVDQGUHFWDQJOHV VHH)LJXUH DQGWKHWKLUGOHYHOFRPSULVHGWKH
GHVLJQHG70*ZLWK('*IRUFRPSDULVRQ VHH)LJXUH
1LQH WUHHPDS GLDJUDPV LQFOXGLQJ GLDJUDPV ZLWK IRXU VL[ DQG HLJKW UHFWDQJOHV RI WKH WKUHH FRPSOH[LW\ OHYHOV
DORQJZLWKWKHQLQHDQDORJRXV(XOHUGLDJUDPVZHUHUDQGRPO\VKRZQWRWKHSDUWLFLSDQWV,QWRWDOGLDJUDPVZHUH
SUHVHQWHGWRWKHSDUWLFLSDQWV
7DEOH5HVXOWVIRU7UHHPDSDQG(XOHUYLVXDOL]DWLRQV
&RQILJXUDWLRQ
7UHHPDS
(XOHU'LDJUDPV
0(
6G (
07
6G 7
0(
6G (
07
6G 7
)RXUFXUYHV
6L[FXUYHV
(LJKWFXUYHV
)RXUFXUYHVQRGHV
6L[FXUYHVQRGHV
(LJKWFXUYHVQRGHV
)RXUFXUYHVQRGHVHGJHV
6L[FXUYHVQRGHVHGJHV
(LJKWFXUYHVQRGHVHGJHV
$YHUDJHIRUDOOYLVXDOL]DWLRQ
5HVXOWV
7KH UHVXOWV IRU SDUWLFLSDQWV XVLQJ WKH YDULDWLRQV RI WUHHPDSV DORQJ ZLWK WKH YDULDWLRQV RI (XOHU GLDJUDP
YLVXDOL]DWLRQVDUHVKRZQLQ7DEOHZKHUH0 ( LVWKHPHDQYDOXHIRUWKHHUURUDQG6G ( LVDVWDQGDUGGHYLDWLRQIRU
WKH HUURU )RU DFFXUDF\ SHUIRUPDQFH ZH XVHG WWHVW LQ RUGHU WR GHWHUPLQH ZKHWKHU WKHUH ZDV DQ\ VWDWLVWLFDOO\
VLJQLILFDQW GLIIHUHQFH LQ DFFXUDF\ SHUIRUPDQFH EHWZHHQ XVLQJ WUHHPDSEDVHG YLVXDOL]DWLRQV DQG (XOHUEDVHG
YLVXDOL]DWLRQV$VDUHVXOWWWHVWGLGQRWUHYHDODQ\VLJQLILFDQWGLIIHUHQFHEHWZHHQWUHHPDSVDQG(XOHUGLDJUDPV DW
DQ\RIWKHWKUHHOHYHOV
7KH DFFXUDF\ IRU (XOHU GLDJUDPV ZDV VOLJKWO\ KLJKHU WKDQ WKH DFFXUDF\ RI WUHHPDSV 1HYHUWKHOHVV RXW RI
SDUWLFLSDQWV PDGH PRUH PLVWDNHV XVLQJ ('*V RXW RI SDUWLFLSDQWV PDGH PRUH PLVWDNHV XVLQJ 70*V DQG
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
SDUWLFLSDQWVPDGHWKHVDPHRUQRPLVWDNHVXVLQJWKHYLVXDOL]DWLRQV7KXVWKHSDUWLFLSDQWVSHUIRUPHGZLWKWKHVDPH
DFFXUDF\XVLQJ70*VRU('*VLQWHUPVRIWKHQXPEHURIPLVWDNHVSHUYLVXDOL]DWLRQW\SH
7KHUHVXOWVIRUWKHUHVSRQVHWLPHDUHVKRZQLQ7DEOHZKHUH 0 7 LVWKHPHDQYDOXHIRUWKHUHVSRQVHWLPHDQG
6G 7 LV D VWDQGDUG GHYLDWLRQ 7KHUH LV QR PXFK GLIIHUHQFH LQ UHVSRQVH WLPH EHWZHHQ WKH GHVLJQHG YLVXDOL]DWLRQV
7DEOH EXWZHXVHGDQDO\VLVRIYDULDQFH $129$ LQRUGHUWRUHYHDODQ\VWDWLVWLFDOO\VLJQLILFDQWGLIIHUHQFHVLQWKH
UHVSRQVH WLPHV XVLQJ WKH GHVLJQHG YLVXDOL]DWLRQV $V ZDV H[SHFWHG $129$ GLG QRW UHYHDO DQ\ VLJQLILFDQW
GLIIHUHQFHEHWZHHQWKHWZRYLVXDOL]DWLRQW\SHV1HYHUWKHOHVVZLWKLQFUHDVHLQWKHFRPSOH[LW\RIWKHYLVXDOL]DWLRQV
LQWHUPVRIWKHQXPEHURIFXUYHVRUUHFWDQJOHVQRGHVDQGHGJHV WKHUHVSRQVHWLPHLQFUHDVHGDVZHOO2QRYHUDOO
WUHHPDSVVKRZHGEHWWHUUHVSRQVHWLPHRIFRPSDUHGWRIRU('*)XUWKHUPRUH RXWRISDUWLFLSDQWV
DQVZHUHGIDVWHUXVLQJWUHHPDSVFRPSDUHGWRRXWRISDUWLFLSDQWVZKRSHUIRUPHGIDVWHUXVLQJ(XOHUGLDJUDPV
'LVFXVVLRQDQG)XWXUH:RUN
7RRXUVXUSULVHDQRYHUODLGWUHHPDSVKRZHGDOPRVWWKHVDPHSHUIRUPDQFHDVDQRYHUODLG(XOHUGLDJUDPVLQWHUPV
RIERWKDFFXUDF\DQGWLPHSHUIRUPDQFH(YHQPRUHSDUWLFLSDQWVVKRZHGSUHIHUHQFHWR(XOHUGLDJUDPVRYHUWUHHPDS
EDVHGYLVXDOL]DWLRQVLQWKLVHYDOXDWLRQGHVSLWHWKHIDFWWKDWWUHHPDSVVKRZHGWKHVDPHDFFXUDF\DQGVOLJKWO\EHWWHU
WLPHSHUIRUPDQFH(YHQWKRXJKWKHGLIIHUHQFHLQWLPHSHUIRUPDQFHLVQRWVLJQLILFDQWLQDEVROXWHYDOXHVWKHQXPEHU
RISDUWLFLSDQWVZKRDQVZHUHGTXHVWLRQVIDVWHUXVLQJWUHHPDSEDVHGYLVXDOL]DWLRQVRXWRISDUWLFLSDQWVLVPRUH
WKDQODUJHUWKDQWKHQXPEHURISDUWLFLSDQWVZKRDQVZHUHGIDVWHUXVLQJ(XOHUEDVHGYLVXDOL]DWLRQVMXVWRXWRI
SDUWLFLSDQWV7KLVLVDSURPLVLQJUHVXOWIRUIXUWKHUUHVHDUFK LQFRPELQLQJWUHHPDSVZLWKJUDSKV,QDGGLWLRQWKH
GHVLJQHG70*UHTXLUHGVPDOOHUDUHDFRPSDUHGWR('*WKHLQIOXHQFHRIWKLVSDUDPHWHUPXVWEHDGGUHVVHGLQIXUWKHU
VWXGLHV
)RUWKHIXWXUH ZRUNLWLVSODQQHGWR HODERUDWHRQWKHGHVLJQRIDWUHHPDSRYHUODLGZLWKDJUDSK+RZHYHULWLV
UHTXLUHGWRLQFOXGHLQWHUDFWLRQLQWKHYLVXDOL]DWLRQLQRUGHUWRSRSXODUL]HWKHYLVXDOL]DWLRQDVDWRROIRUVRFLDOQHWZRUN
DQDO\VLV1HYHUWKHOHVVIXVLRQRIGLIIHUHQWYLVXDOL]DWLRQVW\OHVEDVHGRQWUHHPDSDQGJUDSKLVWKHPDLQUHVHDUFKJRDO
IRUWKHIXWXUHVLQFHLWFDQVSDUNHIILFLHQF\RIVRFLDOQHWZRUNYLVXDOL]DWLRQ&XUUHQWVRFLDOQHWZRUNYLVXDOL]DWLRQVDUH
PRVWO\ EDVHG RQ VLQJOH JUDSKV VLQFH WKH JUDSKV DUH DEOH WR PDQDJH PLOOLRQV RI QRGHV 7KH PDLQ LVVXH RI IXVLQJ
JUDSKV ZLWK WUHHPDSV DQG (XOHU GLDJUDPV LV LQ VFDODELOLW\ WKXV LW LV QHFHVVDU\ WR DGGUHVV WKLV LVVXH LQ IXUWKHU
UHVHDUFK
7KLVZRUNFDQEHFRQVLGHUHGDVDSHUIRUPDQFHHYDOXDWLRQIRUWKHQRYHOW\SHRIVRFLDOQHWZRUNYLVXDOL]DWLRQEDVHG
RQDFRPELQDWLRQRIDWUHHPDSDQGDJUDSK,QWKHQH[WVWXG\LWLVSODQQHGWRFRQVLGHUGLIIHUHQWOD\RXWVWRSRORJLFDO
SURSHUWLHVDQGDHVWKHWLFSURSHUWLHVIRUHYDOXDWLQJWKHVHYLVXDOL]DWLRQV
$FNQRZOHGJHPHQWV
:HVLQFHUHO\WKDQN$QGUHZ%ODNHRI8QLYHUVLW\RI%ULJKWRQ8.IRUSURYLGLQJXVKLV RZQVRIWZDUH 5HVHDUFK
9HKLFOH WRFRQGXFWWKLVHPSLULFDOVWXG\
5HIHUHQFHV
' 9HQROLD DQG & 1HXVWDHGWHU 8QGHUVWDQGLQJ VHTXHQFH DQG UHSO\ UHODWLRQVKLSV ZLWKLQ HPDLO FRQYHUVDWLRQV $ 0L[HGPRGHO YLVXDOL]DWLRQ
0LFURVRIW5HVHDUFK7HFK5HS06575-DQXDU\
0$6PLWK DQG$7)LRUH9LVXDOL]DWLRQ FRPSRQHQWVIRUSHUVLVWHQWFRQYHUVDWLRQV,Q3URFHHGLQJVRIWKH6,*&+,&RQIHUHQFH RQ+XPDQ
)DFWRUVLQ&RPSXWLQJ6\VWHPVSS±
6-RYLFLF5ROHRIPHPRU\LQHPDLOPDQDJHPHQW,Q&+,¶([WHQGHG$EVWUDFWVRQ+XPDQ)DFWRUVLQ&RPSXWLQJ6\VWHPVS±
1%XUOXWVNL\03HWULGLV$)LVKDQG1$OL(QDEOLQJWKHYLVXDOL]DWLRQIRUUHDVRQLQJDERXWWHPSRUDOGDWD,Q,(((6\PSRVLXPRQ9LVXDO
/DQJXDJHVDQG+XPDQ&HQWULF&RPSXWLQJ 9/+&& S±
,+HUPDQ*0HODQoRQDQG06FRWW0DUVKDOO*UDSKYLVXDOL]DWLRQDQGQDYLJDWLRQLQLQIRUPDWLRQYLVXDOL]DWLRQD6XUYH\,QIRUPDWLRQ
9LVXDOL]DWLRQS
119
120
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
0%DVWLDQ6+H\PDQQDQG0-DFRP\*HSKL $QRSHQVRXUFHVRIWZDUHIRUH[SORULQJDQGPDQLSXODWLQJQHWZRUNV7KLUG,QWHUQDWLRQDO$$$,
&RQIHUHQFHRQ:HEORJVDQG6RFLDO0HGLD
0 6PLWK % 6KQHLGHUPDQ 1 0LOLF)UD\OLQJ ( 5RGULJXHV 9 %DUDVK & 'XQQH 7 &DSRQH $ 3HUHU DQG ( *OHDYH $QDO\]LQJ VRFLDO
PHGLD QHWZRUNV ZLWK 1RGH;/ ,Q & 7 3URFHHGLQJV RI WKH )RXUWK ,QWHUQDWLRQDO &RQIHUHQFH RQ &RPPXQLWLHV DQG 7HFKQRORJLHV
6SULQJHU
'H&KLDUD5(UUD86FDUDQR99(11)6D9HQQGLDJUDPILOHPDQDJHU,QIRUPDWLRQ9LVXDOL]DWLRQS
7/)UDQW]DQG.0&DUOH\7UHHPDSVDVDWRROIRUVRFLDOQHWZRUNDQDO\VLVS
6 &KDWXUYHGL & 'XQQH = $VKNWRUDE 5 =DFKDULDK DQG % 6KQHLGHUPDQ *URXSLQDER[ PHWDOD\RXWV IRU WRSRORJLFDO FOXVWHUV DQG
DWWULEXWHEDVHGJURXSV6SDFHHIILFLHQWYLVXDOL]DWLRQVRIQHWZRUNFRPPXQLWLHVDQGWKHLUWLHV&RPSXWHU*UDSKLFV)RUXP
5LFKH1+'Z\HU78QWDQJOLQJ(XOHUGLDJUDPV,(((7UDQVDFWLRQVRQ9LVXDOL]DWLRQDQG&RPSXWHU*UDSKLFVYROQRS
06DWKL\DQDUD\DQDQ*6WDSOHWRQ - %XUWRQ DQG - +RZVH3URSHUWLHVRI(XOHUGLDJUDPVDQGJUDSKVLQFRPELQDWLRQ,Q,(((6\PSRVLXP
RQ9LVXDO/DQJXDJHVDQG+XPDQ&HQWULF&RPSXWLQJ 9/+&& S±
-' )HNHWH ' :DQJ 1 'DQJ $ $ULV DQG & 3ODLVDQW 2YHUOD\LQJ JUDSK OLQNV RQ 7UHHPDSV ,((( 6\PSRVLXP RQ ,QIRUPDWLRQ
9LVXDOL]DWLRQ ,1)29,6 S±
06DWKL\DQDUD\DQDQ1%XUOXWVNL\'HVLJQDQGHYDOXDWLRQRI(XOHUGLDJUDPDQG7UHHPDSIRUVRFLDOQHWZRUNYLVXDOLVDWLRQWK,QWHUQDWLRQDO
&RQIHUHQFHRQ&RPPXQLFDWLRQ6\VWHPV 1HWZRUNVS
1 .RQJ - +HHU 0 $JUDZDOD 3HUFHSWXDO *XLGHOLQHV IRU &UHDWLQJ 5HFWDQJXODU 7UHHPDSV ,((( 7UDQVDFWLRQV RQ 9LVXDOL]DWLRQ DQG
&RPSXWHU*UDSKLFVYROQRS