WO2017144089A1 - Method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, electronic device for analyzing the people behaviour in a physical space and related program product - Google Patents
Method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, electronic device for analyzing the people behaviour in a physical space and related program product Download PDFInfo
- Publication number
- WO2017144089A1 WO2017144089A1 PCT/EP2016/053838 EP2016053838W WO2017144089A1 WO 2017144089 A1 WO2017144089 A1 WO 2017144089A1 EP 2016053838 W EP2016053838 W EP 2016053838W WO 2017144089 A1 WO2017144089 A1 WO 2017144089A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electronic device
- physical space
- processing unit
- data processing
- plugins
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000033001 locomotion Effects 0.000 claims abstract description 6
- 230000006399 behavior Effects 0.000 claims description 35
- 238000004891 communication Methods 0.000 claims description 13
- 238000012544 monitoring process Methods 0.000 claims description 6
- 239000013598 vector Substances 0.000 claims description 5
- 239000011159 matrix material Substances 0.000 claims description 3
- 230000004931 aggregating effect Effects 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000037237 body shape Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 229920001690 polydopamine Polymers 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/96—Management of image or video recognition tasks
Definitions
- Method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space electronic device for analyzing the people behaviour in a physical space and related program product
- the present invention relates to electronic devices for analyzing the people behaviour in a physical space, in particular to a method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, an electronic device for analyzing the people behaviour in a physical space and a related program product.
- An electronic device for analyzing the people behaviour in a physical space is typically provided with a data processing unit (CPU) configured to execute program codes or algorithms of video analysis and Wi-Fi analysis by which, from the captured images and Wi-Fi patterns, it is possible to obtain and make available a large amount of data representative of an analyzed physical space, to be used for market analyzing, advertising, marketing operations, polling, and so on.
- CPU data processing unit
- the "physical space” can be, as an example, a shop or store, a shopping center, a living area, a public area, and so on.
- the program codes to be executed by an electronic device for analyzing the people behaviour in a physical space are called, in the computing field, plugins, i.e. not autonomous program codes that interact with a main program code to expand or extend the main functionalities of the main program code.
- Examples of plugin can be advanced graphics program codes interacting to a main program code, allowing a microprocessor to perform additional advanced graphical features which are not present in the main program code .
- the object of the present invention is to provide a method for managing advanced plugins in an electronic device for analyzing the in a physical space which allows to overcome the drawbacks above complained with reference to the known prior art and in particular which is able to provide processed data with high accuracy and precision despite the use of a microprocessor with reduced computational power.
- Further object of the present invention is to make available a electronic device for analyzing the people behaviour in a physical space.
- Further object of the present invention is to make available a system comprising a plurality of physical spaces wherein each physical space comprises at least one electronic device for analyzing the people behaviour in a physical space.
- Further object of the present invention is to make available a product program loadable in a memory unit of an electronic calculator (e.g. an electronic device for analyzing the people behaviour in a physical space) , the program product being executable by the data processing unit of the electronic calculator.
- an electronic calculator e.g. an electronic device for analyzing the people behaviour in a physical space
- FIG. 1 shows a diagrammatic view of an electronic device for analyzing the people behaviour in a physical space, according to an embodiment of the present invention
- figure 2 diagrammatically shows a system comprising a plurality of physical spaces wherein each physical space comprises at least one electronic device for analyzing the people behaviour in a physical space, according to the embodiment of figure 1;
- FIG. 3 shows a block diagram representative of a method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, according to an embodiment of the invention.
- analyzing the people behaviour in a physical space means performing any kind of analysis of the behaviour of the people approaching or entering a physical space, such as video analysis, tracking analysis, Beacon analysis, a combination thereof, and so on, as it will be explained in the following.
- physical space means any space within which or in the proximity of which people can pass or stay, i.e. a store, a shop, a shopping center, a market, a public living area, a public area, and so on.
- the electronic device 1 can be installed, e.g. fixed to a ceiling or to a wall, within or close to a physical space to be monitored.
- the electronic device 1 comprises a data processing unit 2, for example a microprocessor (CPU) or a microcontroller.
- a data processing unit 2 for example a microprocessor (CPU) or a microcontroller.
- the electronic device 1 also comprises a memory unit 3, operatively connected to the data processing unit 2.
- the memory unit 3 can be external to the data processing unit 2.
- the memory unit 3 can be internal to the data processing unit 2.
- the memory unit 3 is configured to store one or more program codes executable by the data processing unit 2 for controlling the electronic device 1, for executing in the electronic device 1 analysis of the people behaviour in a physical space and one or more advanced plugins (e.g. related to people behaviour analysis) , for managing in the electronic device 1 advanced plugins, and so on.
- plugin means, as known in the computing field, any program code to be executed by an electronic calculator (e.g. the electronic device 1 for analyzing the people behaviour in a physical space) which is not an autonomous program code per se but it needs to interact with a main program code to expand or extend the main functionalities of the main program code itself.
- the electronic device 1 also comprises a first data communication module 4, operatively associated with the data processing unit 2, configured to allow the electronic device 1 to be connected to a remote server (Cloud) (not shown in figure 1) .
- a remote server (Cloud) (not shown in figure 1) .
- the first data communication module 4 is for example a module of the 4G type.
- the electronic device 1 further comprises a Wi-Fi tracking module 5, operatively associated with the data processing unit 2, configured to detect the presence of any other electronic portable device, such as mobile phones, smartphones, tablets, PADs, and so on, within or close to the physical space to be monitored by the electronic device 1.
- a Wi-Fi tracking module 5 operatively associated with the data processing unit 2, configured to detect the presence of any other electronic portable device, such as mobile phones, smartphones, tablets, PADs, and so on, within or close to the physical space to be monitored by the electronic device 1.
- the electronic device 1 also comprises a camera module 6, operatively associated with the data processing unit 2, configured to perform video analysis of the physical space to be monitored by the electronic device 1.
- the electronic device 1 further comprises a video projection module 7, operatively associated with the data processing unit 2, configured to project into or close the physical space to be monitored by the electronic device 1 digital contents related to the context of the physical space.
- the video projection module can be in laser technology, e.g. a pico-pro jector laser.
- the electronic device 1 can comprise a second data communication module 8, operatively associated with the data processing unit 2, configured to perform proximity marketing actions related to the physical space (for example, by sending promotional messages, advertising messages, and so on) towards one or more electronic portable devices which have been detected to be in the proximity of the electronic device 1.
- a second data communication module 8 operatively associated with the data processing unit 2, configured to perform proximity marketing actions related to the physical space (for example, by sending promotional messages, advertising messages, and so on) towards one or more electronic portable devices which have been detected to be in the proximity of the electronic device 1.
- the proximity marketing actions can be performed by means of a communication channel, e.g. in a Bluetooth technology, which can be established between the electronic device 1 and one or more electronic portable devices which have been detected to be in proximity of the electronic device 1.
- a communication channel e.g. in a Bluetooth technology
- the second data communication module 8 comprises a sensor 9 for detecting the presence of electronic portable devices in proximity to the electronic device 1 with which the electronic device can establish a communication channel, e.g. in Bluetooth technology .
- the second data communication module 8 is preferably in the BTLE (Bluetooth Low Energy) technology using the "Beacon” standard (e.g. "i- Beacon” or “eddystone”) .
- the data processing unit 2 is configured to execute program codes for analyzing the people behaviour in a physical space to be monitored by the electronic device 1.
- the data processing unit 2 is configured to perform a plurality of advanced plugins Pl-PN for analyzing the people behaviour in a physical space .
- the plurality of advanced plugins Pl-PN comprises a plugin for detecting face and classifying the people that are in the physical space under monitoring .
- the plurality of advanced plugins Pl-PN further comprises a plugin for recognizing face of the persons that are within or close to the physical space under monitoring.
- the plurality of advanced plugins Pl-PN further comprises a plugin for counting the persons that are within or close to a physical space, limited to a set first maximum number of persons.
- the plurality of advanced plugins Pl-PN further comprises a plugin for counting the persons that are within or close a physical space, up to a set second maximum number of persons (in the case of highly crowded physical space) .
- the plurality of advanced plugins Pl-PN further comprises a plugin for counting the vehicles that are in the physical space.
- the plurality of advanced plugins Pl-PN further comprises a plugin for analyzing fashion fingerprint of the people.
- Fashion fingerprint analysis is performed through the analysis of the human body shape and/or size
- the dressing type of the people detected i.e. type and/or colour of dressing
- the data processing unit 2 of the electronic device 1 is further configured to perform a plurality of additional advanced plugins APl-APN.
- the plurality of additional advanced plugins APl-APN comprises a plugin for Wi-Fi tracking .
- the data processing unit 2 is arranged to track electronic portable devices (e.g., mobile phones, smartphones, tablets, PDAs and so on) , in proximity to the electronic device 1, which can be traced by the Wi-Fi tracking module 5.
- electronic portable devices e.g., mobile phones, smartphones, tablets, PDAs and so on
- the plurality of additional advanced plugins APl- APN further comprises a plugin for performing proximity marketing actions.
- the data processing unit 2 is arranged to set a detection sensor 9 and to perform the proximity marketing actions towards other electronic portable devices, e.g. via the Beacon standard, which can be detected by the detection sensor 9.
- the plurality of additional advanced plugins AP1- APN further comprises a plugin for delivering digital contents related to a context of the physical space monitored by the electronic device 1.
- the data processing unit 2 is arranged to download from a remote server (Cloud) data representative of digital contents related to a context of the monitored physical space and to provide the people into or close to the physical space with such data representative of digital contents related to a context of the monitored physical space .
- a remote server Cloud
- the data processing unit 2 is arranged to provide the people into or close to the physical space with such data representative of digital contents related to a context of the monitored physical space using the video projection module 7.
- digital contents are preferably stored in a digital content database operatively associated to the remote server (Cloud) .
- Digital contents can be images, video, slideshows (text plus images) , a combination thereof, and so on.
- context of a physical space can be a customer target visiting the physical space or a specific zone of the physical space at a specific daytime and/or weekday.
- context of a physical space can be a customer target such as a cluster of physical space visitors profiled according to the classification allowed by the use of the plugin set.
- An example of cluster is: female, with slim size, and of a fashion fingerprint type (dressing black jeans and sneakers shoes) , between 18 and 40 years old, visiting the store for an average time of 10 minutes.
- One or more digital contents are associated to one or more contexts of physical spaces.
- the data processing unit 2 is further configured to execute a program code in order to implement a method for managing advanced plugins of the electronic device 1 for analyzing the people behaviour in a physical space, as it will be described in the following.
- each physical space 101 comprises at least one electronic device for analyzing the people behaviour in a physical space, in the following also simply called system 100 only, is now described.
- the system 100 comprises a plurality of physical spaces 101 to be monitored.
- Each physical space 101 of such plurality comprises at least one electronic device 1 for analyzing the people behaviour in a physical space.
- a physical space e.g. a large physical space
- the system 100 further comprises a remote server (Cloud) 102, operatively associated to each physical space of said plurality of physical spaces 101, via a data communication network (not shown in the figure) , such as Internet .
- a remote server (Cloud) 102 operatively associated to each physical space of said plurality of physical spaces 101, via a data communication network (not shown in the figure) , such as Internet .
- the remote server 102 comprising a digital content database 103, also previously described, in which digital contents are stored, one or more of the digital contents being associated to one or more contexts of physical spaces.
- the remote server 102 is configured to make available to the data processing unit 2 of the electronic device 1 data representative of digital contents related to a context of the monitored physical space .
- a method 300 for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space hereinafter also simply method 300, according to an embodiment of the present invention.
- the method 300 comprises a symbolic step of starting ST.
- the method 300 further comprises a step of analyzing and classifying 301, by the data processing unit 2, a video scene of a physical space, monitored by the electronic device 1, on the basis of the number of persons present in the physical space and on the basis of the directions of movement of each person, with respect to the electronic device 1, while they are approaching the electronic device 1.
- people present in the physical space means people approaching, passing by, people staying in or close to the physical space, people looking for something in the physical space, and so on.
- the method 300 also comprises a step of determining 302, by the data processing unit 2, a matching between the analyzed and classified video scene of the physical space 101 and a plurality of advanced plugins Pl-PN available to the data processing unit 2.
- the method 300 also comprises a step of selecting 303, by the data processing unit 2, a first group of said plurality of advanced plugins Pl-PN to be enabled and a second group of said plurality of advanced plugins to be disabled, on the basis of the determined matching between the analyzed and classified video scene of the physical space 101 and the plurality of advanced plugins Pl-PN available to the data processing unit 2.
- the method 300 also comprises a step of enabling 304, by the data processing unit 2, the first group of the plurality of advanced plugins Pl-PN, selected to be enabled.
- the method 300 further comprises a step of disabling 305, by the data processing unit 2, the second group of the plurality of advanced plugins Pl-PN, selected to be disabled.
- the step of determining 302 further comprises a step of adjusting 304 in real time, by the data processing unit 2, the parameters of the advanced plugins of the first portion of advanced plugins to be enabled, on the basis of data the first group of the plurality of advanced plugins Pl-PN to be enabled on the basis of data previously stored corresponding to video scenes previously analyzed and classified.
- the step of determining 302 further comprises a step of adjusting 304 in real time, by the data processing unit 2, the parameters of the advanced plugins of the first portion of advanced plugins to be enabled, on the basis of data the first group of the plurality of advanced plugins Pl-PN to be enabled on the basis of data previously stored corresponding to video scenes previously analyzed and classified.
- the step of analyzing and classifying 301 the video scene comprises a step of counting 307, by the data processing unit 2, the number of persons present in the physical space monitored by the electronic device 1.
- the step of analyzing and classifying 301 the video scene further comprises a step of detecting 308, by the data processing unit 2, the features of the face of each person passing within the physical space monitored by the electronic device 1.
- the step of analyzing and classifying 301 the video scene comprises a step of tracking 309, by the data processing unit 2, a matrix of motion vectors of the persons passing within the physical space monitored by the electronic device 1.
- each vectors of the matrix of motion vectors is represented by intensity, direction and orientation of the same vectors within the physical space 101 monitored by the electronic device 1.
- the method 300 ends with a symbolic step of ending ED.
- the method 300 further comprises a step of downloading in real time from said remote server (Cloud) 102, by the data processing unit 2, data representative of a digital content related to a context of the physical space monitored by the electronic device 1, said data representative of a content comprising geographic coordinates of geo-localization and identification of the instant of time of generation.
- Cloud remote server
- the method 300 further comprises a step of generating, by the data processing unit 2, a digital image representative of the data representative of a digital content related to a context of the physical space monitored by the electronic device 1, downloaded from the remote server 102.
- the method 300 further comprises a step of displaying in the monitored physical space 101, by a video projection module 7 of the electronic device 1, the digital image representative of the data downloaded from the remote server generated by the data processing unit 2.
- the data representative of a digital content related to a context of a physical space are generated, by a further data processing unit of the remote server 102, aggregating data collected and sent to the remote server 102 by each electronic device 1 installed in each of the physical spaces of the plurality of physical space 101 under monitoring to the geographical coordinates of geo- localization and identification of the instant of time of generation.
- the data collected and sent by each electronic device 1 may be:
- a program product can be loaded into a memory unit (for example, the memory unit 3 of the electronic device 1) of an electronic calculator (for example, the data processing unit 2 of the electronic device 1) .
- the product program can be executed by the data processing unit 2 of the electronic calculator (electronic device 1) to perform the steps of the method 300 for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, according to the embodiments previously described with reference also to figure 3.
- the object of the invention is achieved because the above described method advantageously allows to balance the advanced plugins in charge to a data processing unit, also of reduced performance, such as the data processing unit which can be used in the electronic device 1.
- the method advantageously allows to optimize in real time the number of advanced plugins to be enabled, guaranteeing at the same time excellent performance in terms of accuracy of the processed data.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Method (300) for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, comprising steps of: - analyzing and classifying (301), by a data processing unit of an electronic device for analyzing the people behaviour in a physical space, a video scene of a physical space, monitored by the electronic device, on the basis of the number of persons present in the physical space and on the basis of the directions of movement of each person, with respect to the electronic device, while they are approaching the electronic device; - determining (302), by the data processing unit, a matching between the analyzed and classified video scene of the physical space and a plurality of advanced plugins available to the data processing unit; - selecting (303), by the data processing unit, a first group of said plurality of advanced plugins to be enabled and a second group of said plurality of advanced plugins to be disabled, on the basis of the determined matching between the analyzed and classified video scene of the physical space and the plurality of advanced plugins available to the data processing unit; - enabling (304), by the data processing unit, the first group of the plurality of advanced plugins, selected to be enabled; - disabling (305), by the data processing unit, the second group of the plurality of advanced plugins, selected to be disabled.
Description
DESCRIPTION
"Method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, electronic device for analyzing the people behaviour in a physical space and related program product"
[0001] The present invention relates to electronic devices for analyzing the people behaviour in a physical space, in particular to a method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, an electronic device for analyzing the people behaviour in a physical space and a related program product.
[0002] An electronic device for analyzing the people behaviour in a physical space is typically provided with a data processing unit (CPU) configured to execute program codes or algorithms of video analysis and Wi-Fi analysis by which, from the captured images and Wi-Fi patterns, it is possible to obtain and make available a large amount of data representative of an analyzed physical space, to be used for market analyzing, advertising, marketing operations, polling, and so on.
[0003] The "physical space" can be, as an example, a shop or store, a shopping center, a living area, a public area, and so on.
[0004] The program codes to be executed by an electronic device for analyzing the people behaviour in a physical space are called, in the computing field, plugins, i.e. not autonomous program codes that interact with a main program code to expand or extend the main functionalities of the main program code.
[0005] Examples of plugin can be advanced graphics program codes interacting to a main program code, allowing a microprocessor to perform additional advanced graphical features which are not present in the main program code .
[0006] The execution by a microprocessor of one single or more concurrent advanced plugins is rather intensive and requires the use of a microprocessor with a high computational power, therefore with high costs.
[0007] In the case a low-cost low-complexity microprocessor, i.e. with reduced computational power, be used, it would be very difficult to perform the concurrent execution of advanced plugins, also in the same time, preserving the accuracy and the precision of the processed data.
[0008] The object of the present invention is to provide a method for managing advanced plugins in an electronic device for analyzing the in a physical space which allows to overcome the drawbacks above complained
with reference to the known prior art and in particular which is able to provide processed data with high accuracy and precision despite the use of a microprocessor with reduced computational power.
[0009] Such an object is achieved by means of an method for managing advanced plugins as defines in the independent claim 1 in its most general form and in the dependent claims in some of its particular embodiment.
[0010] Further object of the present invention is to make available a electronic device for analyzing the people behaviour in a physical space.
[0011] Further object of the present invention is to make available a system comprising a plurality of physical spaces wherein each physical space comprises at least one electronic device for analyzing the people behaviour in a physical space.
[0012] Further object of the present invention is to make available a product program loadable in a memory unit of an electronic calculator (e.g. an electronic device for analyzing the people behaviour in a physical space) , the program product being executable by the data processing unit of the electronic calculator.
[0013] Further features and advantages of the method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space,
according to the present invention, will become apparent in the following description which shows preferred embodiments, given by way of indicative, non-limiting examples, with reference to the accompanying drawings, in which:
[0014] - figure 1 shows a diagrammatic view of an electronic device for analyzing the people behaviour in a physical space, according to an embodiment of the present invention;
[0015] - figure 2 diagrammatically shows a system comprising a plurality of physical spaces wherein each physical space comprises at least one electronic device for analyzing the people behaviour in a physical space, according to the embodiment of figure 1;
[0016] - figure 3 shows a block diagram representative of a method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, according to an embodiment of the invention.
[0017] In the figures, elements which are the same or similar will be indicated using the same reference numerals and/or alphanumeric references.
[0018] With reference to Figure 1, an electronic device 1 for analyzing the people behaviour in a physical space, hereinafter also simply electronic
device 1, according to an embodiment of the present invention, is now described.
[0019] For the purposes of the present invention, "analyzing the people behaviour in a physical space" means performing any kind of analysis of the behaviour of the people approaching or entering a physical space, such as video analysis, tracking analysis, Beacon analysis, a combination thereof, and so on, as it will be explained in the following.
[0020] In addition, "physical space" means any space within which or in the proximity of which people can pass or stay, i.e. a store, a shop, a shopping center, a market, a public living area, a public area, and so on.
[0021] Turning back to figure 1, it should be noted that the electronic device 1 can be installed, e.g. fixed to a ceiling or to a wall, within or close to a physical space to be monitored.
[0022] The electronic device 1 comprises a data processing unit 2, for example a microprocessor (CPU) or a microcontroller.
[0023] The electronic device 1 also comprises a memory unit 3, operatively connected to the data processing unit 2.
[0024] According to the embodiment of figure 1, the memory unit 3 can be external to the data processing
unit 2.
[ 0025 ] According to another embodiment, not shown in the figures, the memory unit 3 can be internal to the data processing unit 2.
[ 0026] As will be described in the following, it should be noted that the memory unit 3 is configured to store one or more program codes executable by the data processing unit 2 for controlling the electronic device 1, for executing in the electronic device 1 analysis of the people behaviour in a physical space and one or more advanced plugins (e.g. related to people behaviour analysis) , for managing in the electronic device 1 advanced plugins, and so on.
[ 0027 ] For the purpose of the present description, "plugin" means, as known in the computing field, any program code to be executed by an electronic calculator (e.g. the electronic device 1 for analyzing the people behaviour in a physical space) which is not an autonomous program code per se but it needs to interact with a main program code to expand or extend the main functionalities of the main program code itself.
[ 0028 ] Returning again to figure 1, the electronic device 1 also comprises a first data communication module 4, operatively associated with the data processing unit 2, configured to allow the electronic
device 1 to be connected to a remote server (Cloud) (not shown in figure 1) .
[0029] The first data communication module 4 is for example a module of the 4G type.
[0030] The electronic device 1 further comprises a Wi-Fi tracking module 5, operatively associated with the data processing unit 2, configured to detect the presence of any other electronic portable device, such as mobile phones, smartphones, tablets, PADs, and so on, within or close to the physical space to be monitored by the electronic device 1.
[0031] The electronic device 1 also comprises a camera module 6, operatively associated with the data processing unit 2, configured to perform video analysis of the physical space to be monitored by the electronic device 1.
[0032] The electronic device 1 further comprises a video projection module 7, operatively associated with the data processing unit 2, configured to project into or close the physical space to be monitored by the electronic device 1 digital contents related to the context of the physical space.
[0033] The video projection module can be in laser technology, e.g. a pico-pro jector laser.
[0034] According to an embodiment, the electronic
device 1 can comprise a second data communication module 8, operatively associated with the data processing unit 2, configured to perform proximity marketing actions related to the physical space (for example, by sending promotional messages, advertising messages, and so on) towards one or more electronic portable devices which have been detected to be in the proximity of the electronic device 1.
[0035] It should be observed that the proximity marketing actions can be performed by means of a communication channel, e.g. in a Bluetooth technology, which can be established between the electronic device 1 and one or more electronic portable devices which have been detected to be in proximity of the electronic device 1.
[0036] In more detail, the second data communication module 8 comprises a sensor 9 for detecting the presence of electronic portable devices in proximity to the electronic device 1 with which the electronic device can establish a communication channel, e.g. in Bluetooth technology .
[0037] In this regard, the second data communication module 8 is preferably in the BTLE (Bluetooth Low Energy) technology using the "Beacon" standard (e.g. "i- Beacon" or "eddystone") .
[0038] Turning back to the embodiment of figure 1, as previously mentioned, the data processing unit 2 is configured to execute program codes for analyzing the people behaviour in a physical space to be monitored by the electronic device 1.
[0039] In this regard, the data processing unit 2 is configured to perform a plurality of advanced plugins Pl-PN for analyzing the people behaviour in a physical space .
[0040] According to an embodiment the present invention, the plurality of advanced plugins Pl-PN comprises a plugin for detecting face and classifying the people that are in the physical space under monitoring .
[0041] According to an embodiment of the present invention, alternatively to or in combination with the previous one, the plurality of advanced plugins Pl-PN further comprises a plugin for recognizing face of the persons that are within or close to the physical space under monitoring.
[0042] According to an embodiment of the present invention, alternatively to or in combination with the previous ones, the plurality of advanced plugins Pl-PN further comprises a plugin for counting the persons that are within or close to a physical space, limited to a
set first maximum number of persons.
[ 0043 ] According to an embodiment, the present invention, alternatively to or in combination with the previous one, the plurality of advanced plugins Pl-PN further comprises a plugin for counting the persons that are within or close a physical space, up to a set second maximum number of persons (in the case of highly crowded physical space) .
[ 0044 ] According to a further embodiment of the present invention, alternatively to or in combination with the previous one, the plurality of advanced plugins Pl-PN further comprises a plugin for counting the vehicles that are in the physical space.
[ 0045 ] According to a further embodiment of the present invention, alternatively to or in combination with the previous one, the plurality of advanced plugins Pl-PN further comprises a plugin for analyzing fashion fingerprint of the people.
[ 0046] Fashion fingerprint analysis is performed through the analysis of the human body shape and/or size
(e.g. slim, medium, large, xx-large, and so on) and the dressing type of the people detected (i.e. type and/or colour of dressing) .
[ 0047 ] Turning back to the embodiment of figure 2, the data processing unit 2 of the electronic device 1 is
further configured to perform a plurality of additional advanced plugins APl-APN.
[0048] In a more detail, according to an embodiment of the present invention, the plurality of additional advanced plugins APl-APN comprises a plugin for Wi-Fi tracking .
[0049] Executing the plugin for Wi-Fi tracking, the data processing unit 2 is arranged to track electronic portable devices (e.g., mobile phones, smartphones, tablets, PDAs and so on) , in proximity to the electronic device 1, which can be traced by the Wi-Fi tracking module 5.
[0050] According to a further embodiment, alternatively to or in combination with the previous one, the plurality of additional advanced plugins APl- APN further comprises a plugin for performing proximity marketing actions.
[0051] Executing the plugin for performing proximity marketing actions, the data processing unit 2 is arranged to set a detection sensor 9 and to perform the proximity marketing actions towards other electronic portable devices, e.g. via the Beacon standard, which can be detected by the detection sensor 9.
[0052] According to a further embodiment, alternatively to or in combination with the previous
ones, the plurality of additional advanced plugins AP1- APN further comprises a plugin for delivering digital contents related to a context of the physical space monitored by the electronic device 1.
[0053] Executing such plugin for delivering digital contents related to a context of the physical space, the data processing unit 2 is arranged to download from a remote server (Cloud) data representative of digital contents related to a context of the monitored physical space and to provide the people into or close to the physical space with such data representative of digital contents related to a context of the monitored physical space .
[0054] In detail, according to an embodiment of the present invention, the data processing unit 2 is arranged to provide the people into or close to the physical space with such data representative of digital contents related to a context of the monitored physical space using the video projection module 7.
[0055] It should be noted that the digital contents are preferably stored in a digital content database operatively associated to the remote server (Cloud) .
[0056] Digital contents can be images, video, slideshows (text plus images) , a combination thereof, and so on.
[0057] As a first example, context of a physical space can be a customer target visiting the physical space or a specific zone of the physical space at a specific daytime and/or weekday.
[0058] As a further example, context of a physical space can be a customer target such as a cluster of physical space visitors profiled according to the classification allowed by the use of the plugin set.
[0059] An example of cluster is: female, with slim size, and of a fashion fingerprint type (dressing black jeans and sneakers shoes) , between 18 and 40 years old, visiting the store for an average time of 10 minutes.
[0060] One or more digital contents are associated to one or more contexts of physical spaces.
[0061] Turning back to figure 1, the data processing unit 2 is further configured to execute a program code in order to implement a method for managing advanced plugins of the electronic device 1 for analyzing the people behaviour in a physical space, as it will be described in the following.
[0062] With reference now to figure 2, a system 100 comprising a plurality of physical spaces 101 wherein each physical space 101 comprises at least one electronic device for analyzing the people behaviour in a physical space, in the following also simply called
system 100 only, is now described.
[0063] As mentioned above, the system 100 comprises a plurality of physical spaces 101 to be monitored.
[0064] Each physical space 101 of such plurality comprises at least one electronic device 1 for analyzing the people behaviour in a physical space.
[0065] According to an embodiment, a physical space (e.g. a large physical space) can comprise more than two electronic device 1 in order to obtain a more complete monitoring of the whole physical space.
[0066] Turning back to figure 2, the system 100 further comprises a remote server (Cloud) 102, operatively associated to each physical space of said plurality of physical spaces 101, via a data communication network (not shown in the figure) , such as Internet .
[0067] The remote server 102 comprising a digital content database 103, also previously described, in which digital contents are stored, one or more of the digital contents being associated to one or more contexts of physical spaces.
[0068] In detail, the remote server 102 is configured to make available to the data processing unit 2 of the electronic device 1 data representative of digital contents related to a context of the monitored physical
space .
[0069] With reference now also to figure 3, a method 300 for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, hereinafter also simply method 300, according to an embodiment of the present invention.
[0070] The method 300 comprises a symbolic step of starting ST.
[0071] The method 300 further comprises a step of analyzing and classifying 301, by the data processing unit 2, a video scene of a physical space, monitored by the electronic device 1, on the basis of the number of persons present in the physical space and on the basis of the directions of movement of each person, with respect to the electronic device 1, while they are approaching the electronic device 1.
[0072] It should be noted that "people present in the physical space" means people approaching, passing by, people staying in or close to the physical space, people looking for something in the physical space, and so on.
[0073] The method 300 also comprises a step of determining 302, by the data processing unit 2, a matching between the analyzed and classified video scene of the physical space 101 and a plurality of advanced plugins Pl-PN available to the data processing unit 2.
[ 0074 ] The method 300 also comprises a step of selecting 303, by the data processing unit 2, a first group of said plurality of advanced plugins Pl-PN to be enabled and a second group of said plurality of advanced plugins to be disabled, on the basis of the determined matching between the analyzed and classified video scene of the physical space 101 and the plurality of advanced plugins Pl-PN available to the data processing unit 2.
[ 0075 ] The method 300 also comprises a step of enabling 304, by the data processing unit 2, the first group of the plurality of advanced plugins Pl-PN, selected to be enabled.
[ 0076] The method 300 further comprises a step of disabling 305, by the data processing unit 2, the second group of the plurality of advanced plugins Pl-PN, selected to be disabled.
[ 0077 ] According to a further embodiment, shown in figure 3, the step of determining 302 further comprises a step of adjusting 304 in real time, by the data processing unit 2, the parameters of the advanced plugins of the first portion of advanced plugins to be enabled, on the basis of data the first group of the plurality of advanced plugins Pl-PN to be enabled on the basis of data previously stored corresponding to video scenes previously analyzed and classified.
[0078] In this way, it is advantageously possible to generate plugins arranged to allow the data processing unit 2 to obtain a maximum and more effective efficiency of the recovering in real time the video scene.
[0079] With reference again to figure 3, according to an embodiment, the step of analyzing and classifying 301 the video scene comprises a step of counting 307, by the data processing unit 2, the number of persons present in the physical space monitored by the electronic device 1.
[0080] In addition, the step of analyzing and classifying 301 the video scene further comprises a step of detecting 308, by the data processing unit 2, the features of the face of each person passing within the physical space monitored by the electronic device 1.
[0081] Moreover, the step of analyzing and classifying 301 the video scene comprises a step of tracking 309, by the data processing unit 2, a matrix of motion vectors of the persons passing within the physical space monitored by the electronic device 1.
[0082] It should be noted that the each vectors of the matrix of motion vectors is represented by intensity, direction and orientation of the same vectors within the physical space 101 monitored by the electronic device 1.
[0083] Returning to Figure 3, the method 300 ends
with a symbolic step of ending ED.
[0084] According to a further embodiment, not shown in the figures, the method 300 further comprises a step of downloading in real time from said remote server (Cloud) 102, by the data processing unit 2, data representative of a digital content related to a context of the physical space monitored by the electronic device 1, said data representative of a content comprising geographic coordinates of geo-localization and identification of the instant of time of generation.
[0085] The method 300 further comprises a step of generating, by the data processing unit 2, a digital image representative of the data representative of a digital content related to a context of the physical space monitored by the electronic device 1, downloaded from the remote server 102.
[0086] In addition, the method 300 further comprises a step of displaying in the monitored physical space 101, by a video projection module 7 of the electronic device 1, the digital image representative of the data downloaded from the remote server generated by the data processing unit 2.
[0087] It should be observed that the data representative of a digital content related to a context of a physical space are generated, by a further data
processing unit of the remote server 102, aggregating data collected and sent to the remote server 102 by each electronic device 1 installed in each of the physical spaces of the plurality of physical space 101 under monitoring to the geographical coordinates of geo- localization and identification of the instant of time of generation.
[0088] In this regard, the data collected and sent by each electronic device 1 may be:
- number of persons passing through or entering a physical space (shop, store, living area, public area, and so on) ;
flow(s) of persons through a physical space (where the persons move and stay) ;
demographics of the persons (gender, ethnicity, average age, and so on) ;
attention time of the person in the physical space (how long the persons pass before a window, a shelf, a screen, and so on) ;
- persons as new visitors versus persons as turning visitors (how many times the same group of visitors back within the same physical space or of a specific area of a physical space) ;
staying time (how long the average number of persons spends its time within the physical space) .
[0089] According to a further aspect of the present invention, a program product can be loaded into a memory unit (for example, the memory unit 3 of the electronic device 1) of an electronic calculator (for example, the data processing unit 2 of the electronic device 1) .
[0090] The product program can be executed by the data processing unit 2 of the electronic calculator (electronic device 1) to perform the steps of the method 300 for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, according to the embodiments previously described with reference also to figure 3.
[0091] As apparent, the object of the invention is achieved because the above described method advantageously allows to balance the advanced plugins in charge to a data processing unit, also of reduced performance, such as the data processing unit which can be used in the electronic device 1.
[0092] Furthermore, according to an embodiment, the method advantageously allows to optimize in real time the number of advanced plugins to be enabled, guaranteeing at the same time excellent performance in terms of accuracy of the processed data.
[0093] In addition, in the case of adjustment in real time of the parameters of the advanced plugins of the
first portion of advanced plugins to be enabled, on the basis of the data previously stored corresponding to video scenes previously analyzed and classified, it is advantageously possible to enable in real time more effective advanced plugins.
[0094] Finally, the fact to have the possibility to download from a remote server data representative of digital contents related to the context of the physical space under monitoring allows to display in real time in the physical space digital image representative of updated and customized digital contents related to the context of the physical space to the persons staying in the physical space itself.
[0095] Those skilled in the art may make changes and adaptations to the above-described embodiments of the method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space or can replace elements with others which are functionally equivalent in order to meet contingent needs without departing from the scope of the following claims. Each of the features described as belonging to one possible embodiment may be implemented independently of the other embodiments described.
Claims
1. Method (300) for managing advanced plugins (Pl-PN) in an electronic device (1) for analyzing the people behaviour in a physical space (101), comprising steps of:
analyzing and classifying (301), by a data processing unit (2) of an electronic device (1) for analyzing the people behaviour in a physical space (101), a video scene of a physical space (101), monitored by the electronic device (1), on the basis of the number of persons present in the physical space (101) and on the basis of the directions of movement of each person, with respect to the electronic device (1), while they are approaching the electronic device (1); determining (302), by the data processing unit (2), a matching between the analyzed and classified video scene of the physical space (101) and a plurality of advanced plugins (Pl-PN) available to the data processing unit (2);
selecting (303), by the data processing unit (2), a first group of said plurality of advanced plugins (Pl- PN) to be enabled and a second group of said plurality of advanced plugins (Pl-PN) to be disabled, on the basis of the determined matching between the analyzed and classified video scene of the physical space (101) and
the plurality of advanced plugins (Pl-PN) available to the data processing unit (2);
enabling (304), by the data processing unit (2), the first group of the plurality of advanced plugins (Pl-PN) , selected to be enabled;
disabling (305), by the data processing unit (2), the second group of the plurality of advanced plugins (Pl-PN) , selected to be disabled.
2. Method (3) according to claim 1, wherein the step of determining (302) further comprises a step of adjusting (304) in real time, by the data processing unit (2), the parameter of the advanced plugins of the first portion of advanced plugins to be enabled, on the basis of data previously stored corresponding to video scenes previously analyzed and classified.
3. Method (300) according to any of the previous claims, wherein the step of analyzing and classifying (301) the video scene comprises a step of counting (307), by the data processing unit (2), the number of persons present in the physical space monitored by the electronic device 1.
4. Method (300) according to claim 3, wherein the step of analyzing and classifying (301) the video scene further comprises a step of detecting (308), by the data processing unit (2), the features of the face of each
person passing within the physical space monitored by the electronic device (1).
5. Method (300) according to claim 4, wherein the step of analyzing and classifying (301) the video scene comprises a step of tracking (309), by the data processing unit (2), a matrix of motion vectors of the persons passing within the physical space monitored by the electronic device (1).
6. Method (300) according to any of the previous claims, further a step of downloading in real time from a remote server (102), by the data processing unit (2), data representative of a digital content related to a context of the physical space monitored by the electronic device (1), said data representative of a digital content comprising geographic coordinates of geo-localization and identification of the instant of time of generation.
7. Method (300) according to claim 6, further comprises a step of generating, by the data processing unit (2), a digital image representative of the data representative of a digital content related to a context of the physical space monitored by the electronic device (1), downloaded from the remote server (102) .
8. Method (300) according to claim 7, further comprises a step of displaying in the monitored physical
space (101), by a video projection module (7) of the electronic device (1), the digital image representative of the data downloaded from the remote server generated by the data processing unit (2) .
9. Method (300) according to any of the previous claims 6-8, wherein the data representative of a digital content related to a context of a physical space are generated, by a further data processing unit of the remote server (102), aggregating data collected and sent to the remote server (102) by each electronic device (1) installed in each of the physical spaces of the plurality of physical space (101) under monitoring to the geographical coordinates of geo-localization and identification of the instant of time of generation.
10. An electronic device (1) for analyzing the people behaviour in a physical space (101), comprising:
a data processing unit (2);
a memory unit (3) , operatively connected to the data processing unit (2);
first data communication module (4), operatively associated with the data processing unit (2), configured to allow the electronic device (1) to be connected to a remote server (102);
a Wi-Fi tracking module (5) , operatively associated with the data processing unit (2), configured to detect
the presence of any other electronic portable device within or close to the physical space (101) to be monitored by the electronic device (1);
a camera module (6), operatively associated with the data processing unit (2), configured to perform video analysis of the physical space (101) to be monitored by the electronic device (1);
a video projection module (V), operatively associated with the data processing unit (2), configured to project into or close the physical space (101) to be monitored by the electronic device (1) digital contents related to the context of the physical space (101),
the data processing unit 2 is further configured to perform the method (300) for managing advanced plugins of the electronic device (1) for analyzing the people behaviour in a physical space (101) according to any of the previous claims.
11. Electronic device (1) of claim 10, further comprises a second data communication module (8), operatively associated with the data processing unit (2), configured to perform proximity marketing actions related to the physical space (101) towards one or more electronic portable devices which have been detected to be in the proximity of the electronic device (1) .
12. Electronic device (1) of claim 11, wherein the
second data communication module (8) comprises a sensor (9) for detecting the presence of electronic portable devices in proximity to the electronic device (1) with which the electronic device can establish a communication channel.
13. Electronic device (1) of any of the claims 11 and
12. wherein the data processing unit (2) is configured to execute program codes for analyzing the people behaviour in a physical space (10) to be monitored by the electronic device (1), the data processing unit (2) being configured to perform a plurality of advanced plugins (Pl-PN) for analyzing the people behaviour in a physical space (101).
13. Electronic device (1) according to claim 12, wherein the data processing unit (2) is further configured to perform a plurality of additional advanced plugins (AP1-APN) .
14. A system (100) comprising:
a plurality of physical spaces (101) to be monitored, each physical space (101) comprising at least one electronic device (1) for analyzing the people behavior in a physical space (101) according to any of the previous claims 10-13;
a remote server (102), operatively associated with each physical space of said plurality of physical spaces
(101) via a data communication network, the remote server (102) comprising a digital content database (103) .
15. Program product loadable in a memory unit (3) of an electronic calculator (1), the program product being executable by the data processing unit (2) of the electronic calculator (1) to perform the method (300) in accordance with any of the previous claims 1-9.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/EP2016/053838 WO2017144089A1 (en) | 2016-02-24 | 2016-02-24 | Method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, electronic device for analyzing the people behaviour in a physical space and related program product |
EP16708374.0A EP3420494A1 (en) | 2016-02-24 | 2016-02-24 | Method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, electronic device for analyzing the people behaviour in a physical space and related program product |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/EP2016/053838 WO2017144089A1 (en) | 2016-02-24 | 2016-02-24 | Method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, electronic device for analyzing the people behaviour in a physical space and related program product |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017144089A1 true WO2017144089A1 (en) | 2017-08-31 |
Family
ID=55484960
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2016/053838 WO2017144089A1 (en) | 2016-02-24 | 2016-02-24 | Method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, electronic device for analyzing the people behaviour in a physical space and related program product |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP3420494A1 (en) |
WO (1) | WO2017144089A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108334775A (en) * | 2018-01-23 | 2018-07-27 | 阿里巴巴集团控股有限公司 | One kind is escaped from prison plug-in detecting method and device |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090201850A1 (en) * | 2008-02-08 | 2009-08-13 | Yahoo! Inc. | Location tracking based on proximity-based ad hoc network |
WO2012020510A1 (en) * | 2010-08-11 | 2012-02-16 | Telefonaktiebolaget L M Ericsson (Publ) | Face-directional recognition driven display control |
-
2016
- 2016-02-24 WO PCT/EP2016/053838 patent/WO2017144089A1/en active Application Filing
- 2016-02-24 EP EP16708374.0A patent/EP3420494A1/en not_active Withdrawn
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090201850A1 (en) * | 2008-02-08 | 2009-08-13 | Yahoo! Inc. | Location tracking based on proximity-based ad hoc network |
WO2012020510A1 (en) * | 2010-08-11 | 2012-02-16 | Telefonaktiebolaget L M Ericsson (Publ) | Face-directional recognition driven display control |
Non-Patent Citations (2)
Title |
---|
BINS J ET AL: "An Intelligent and Task-Independent Controller for Video Sequence Analysis", COMPUTER ARCHITECTURE FOR MACHINE PERCEPTION, 2005. CAMP 2005. PROCEED INGS. SEVENTH INTERNATIONAL WORKSHOP ON PALERMO, ITALY 04-06 JULY 2005, PISCATAWAY, NJ, USA,IEEE, LOS ALAMITOS, CA, USA, 4 July 2005 (2005-07-04), pages 172 - 177, XP010835501, ISBN: 978-0-7695-2255-5, DOI: 10.1109/CAMP.2005.12 * |
GEORIS B ET AL: "Real-time control of video surveillance systems with program supervision techniques", MACHINE VISION AND APPLICATIONS, SPRINGER, BERLIN, DE, vol. 18, no. 3-4, 24 January 2007 (2007-01-24), pages 189 - 205, XP019510953, ISSN: 1432-1769, DOI: 10.1007/S00138-006-0053-Z * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108334775A (en) * | 2018-01-23 | 2018-07-27 | 阿里巴巴集团控股有限公司 | One kind is escaped from prison plug-in detecting method and device |
CN108334775B (en) * | 2018-01-23 | 2022-09-23 | 创新先进技术有限公司 | Method and device for detecting jail-crossing plug-in |
Also Published As
Publication number | Publication date |
---|---|
EP3420494A1 (en) | 2019-01-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10943126B2 (en) | Method and apparatus for processing video stream | |
US11631253B2 (en) | People counting and tracking systems and methods | |
US11481571B2 (en) | Automated localized machine learning training | |
US11295139B2 (en) | Human presence detection in edge devices | |
KR102710757B1 (en) | Method for providing parking location information of a vehicle and electronic device thereof | |
US8855369B2 (en) | Self learning face recognition using depth based tracking for database generation and update | |
KR102333143B1 (en) | System for providing people counting service | |
Cheng et al. | Real-time pedestrian crossing lights detection algorithm for the visually impaired | |
US11263472B2 (en) | On-demand visual analysis focalized on salient events | |
US20140365644A1 (en) | Internet traffic analytics for non-internet traffic | |
KR102788911B1 (en) | Electronic device and method for providing recognition result of object | |
Redžić et al. | Image and WLAN bimodal integration for indoor user localization | |
KR102465437B1 (en) | Apparatus and method for tracking object based on artificial intelligence | |
Martinez‐Alpiste et al. | Smartphone‐based object recognition with embedded machine learning intelligence for unmanned aerial vehicles | |
US10997474B2 (en) | Apparatus and method for person detection, tracking, and identification utilizing wireless signals and images | |
JP2019185236A (en) | Guiding system | |
Rehman et al. | Human tracking robotic camera based on image processing for live streaming of conferences and seminars | |
WO2017144089A1 (en) | Method for managing advanced plugins in an electronic device for analyzing the people behaviour in a physical space, electronic device for analyzing the people behaviour in a physical space and related program product | |
US10360573B1 (en) | Interactions platform | |
Nambiar et al. | Person re-identification in frontal gait sequences via histogram of optic flow energy image | |
WO2019193817A1 (en) | Analysis system | |
Low et al. | Multi-audience tracking with RGB-D camera on digital signage | |
Nancy et al. | Thermal image-based object classification for guiding the visually impaired | |
US20240062408A1 (en) | Method, device, and non-transitory computer-readable recording medium for analyzing visitor on basis of image in edge computing environment | |
Srinivasan et al. | Artificial Intelligence Based Efficient Activity Recognition with Real Time Implementation for ATM Security |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2016708374 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2016708374 Country of ref document: EP Effective date: 20180924 |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16708374 Country of ref document: EP Kind code of ref document: A1 |