DE102019209847A1 - Passenger detection system for passenger movement systems - Google Patents

Abstract

The present invention relates to a security system for a passenger conveyor system with a monitoring device which is suitable for identifying a body profile of a passenger.

Description

The invention relates to a security system for a passenger conveyor system which comprises a monitoring means which is suitable for identifying a body profile of a passenger.

Safety devices that can be used to determine whether a passenger on a passenger transportation system is a wheelchair user or a child in a stroller are known in the art. Such devices are useful and important to ensure the safety of passengers, since passengers with wheelchairs or strollers very often need more time when using a passenger conveyor system, e.g. when getting on and off an elevator.

JP 2012176833 discloses a wheelchair recognition device and a bicycle recognition device, the recognition device generating an image of the object as it passes between the doors of an elevator. The device works by recognizing the presence of a circular figure in a captured image, the circular figure corresponding to a wheel.

JP 2016050088 reveals a wheelchair elevator with a wheelchair user detection device. The detection device is designed so that it detects the amount of load applied to a wheelchair user detection area in the vicinity of the cabin control panel assigned to the wheelchair user. When the car arrives at the destination floor due to the call process which is carried out on the car control panel provided for the wheelchair user, the control device loads the wheelchair user load amount detected by the wheelchair user detection device. If the amount is within a certain range, it is determined that the wheelchair user is in the car and control is made to open the car door of the car on the destination floor for an extended period of time.

Both systems, however, assume that the passenger is either just entering the passenger system or is already in the passenger system before he can carry out a detection. Neither system provides a way of determining the status of passengers before boarding a passenger system, nor any way of determining whether a passenger is in a sitting or standing position.

It is therefore the object of the invention to provide a security system which, instead of detecting an object such as a wheelchair, is suitable for recognizing a person / passenger, in particular it is suitable for recognizing whether a passenger is seated or standing Position is, preferably before entering a moving passenger system.

In addition, it is an object of the invention to provide a method with which it can be determined whether a passenger is in a seated position before he gets into a passenger system. The invention thus advantageously offers an alternative solution for determining whether a passenger needs special assistance and whether the operation of the passenger system should be adapted accordingly.

A passenger in a seated position preferably consists of a person in a chair with easy mobility, e.g. a wheelchair or a stroller; or from a person in a mobility vehicle, e.g. a mobility scooter or an indoor airport taxi, which is used to support the transport of less disabled people through an airport.

The inventive safety system, a passenger movement system comprising the inventive safety system, and a method for determining whether a passenger is in a seating position are the subject of the appended claims and are described in more detail in the following embodiments and descriptions of the figures.

Representations

• Ein Sicherheitssystem für ein Passagierbewegungssystem mit einer Überwachungseinrichtung, wobei das Sicherheitssystem dazu ausgelegt ist, ein Körperprofil eines Passagiers zu identifizieren, vorzugsweise bevor der Passagier das Passagierbewegungssystem betritt, vorzugsweise ist es dazu ausgelegt, ein Körperprofil während der Annäherung der Passagiere an das Passagierbewegungssystem zu identifizieren.

The invention relates to:

• A security system for a passenger movement system with a monitoring device, wherein the security system is designed to identify a body profile of a passenger, preferably before the passenger enters the passenger movement system, preferably it is designed to identify a body profile as the passengers approach the passenger movement system.

If the passenger movement system is an escalator or a moving walkway, the system is preferably arranged at any point from which the landing areas can be viewed without obstruction. It should preferably be arranged in such a way that it can recognize a passenger who is approaching either from the landing area of the escalator or from the moving walkway. The landing area preferably refers to the lower and upper landing areas that a passenger must traverse before entering the escalator or moving walk and when leaving the escalator or moving walk.

• - auf einem dafür errichteten Pfosten am Eingang der Fahrtreppe oder des Fahrsteigs;
• - auf einem Fachwerkträger über der Fahrtreppe oder dem Fahrsteig;
• - an der Decke über der Fahrtreppe oder dem Fahrsteig hängend; vorzugsweise über dem Eingang der Fahrtreppe oder des Fahrsteigs; vorzugsweise über dem Ausgang der Fahrtreppe oder des Fahrsteigs; vorzugsweise sowohl über dem Eingang als auch über dem Ausgang der Fahrtreppe oder des Fahrsteigs.

For example, it can be localized:

• - on a post erected for this purpose at the entrance to the escalator or moving walk;
• - on a truss above the escalator or moving walk;
• - hanging from the ceiling above the escalator or moving walk; preferably above the entrance of the escalator or moving walk; preferably above the exit of the escalator or moving walk; preferably above both the entrance and the exit of the escalator or moving walk.

• - Fahrgäste, die die Aufzugskabine betreten und verlassen, wenn sich die Kabinentüren gerade öffnen oder schließen und wenn die Türen für einen beliebigen Zeitraum in der geöffneten Stellung gehalten werden;
• - Fahrgäste, die in einem Bereich warten, vorzugsweise in einem Bereich in unmittelbarer Nähe der Aufzugskabinentüren.

If the passenger transport system is an elevator, the inventive system can be positioned inside an elevator car or outside an elevator car. If the system is positioned within an elevator car, it is preferably aimed at the elevator doors for monitoring;

• Passengers entering and exiting the elevator car when the car doors are about to open or close and when the doors are held in the open position for any period of time;
• - Passengers waiting in an area, preferably in an area in the immediate vicinity of the elevator car doors.

If the system is positioned outside an elevator car, it is preferably arranged in the vicinity of the elevator car doors so that the monitoring device can monitor the area in front of the car doors as well as the area that is shared between the area in front of the car doors and the elevator car if the Open or close elevator car doors or be held in the open position for any length of time.

• - eine Steuereinheit, die vorzugsweise so beschaffen ist, dass sie auf Informationen reagiert, die ihr über die Überwachungsmittel übermittelt werden;
• - ein Stück Hardware, das vorzugsweise so beschaffen ist, dass es zumindest Informationen bezüglich der von den Überwachungsmitteln erfassten Bilder verarbeitet, speichert und überträgt. Ein Stück Hardware umfasst jede Art von Verarbeitungschip, z.B. einen Mikroprozessor;
• - mindestens einen Anschlusspunkt zum Anschluss des Systems an eine Energiequelle, vorzugsweise zur Stromversorgung des Systems und/oder zur Erleichterung der Bilderfassung.

The system preferably further comprises

• a control unit, which is preferably designed to react to information transmitted to it via the monitoring means;
• a piece of hardware, which is preferably designed so that it at least processes, stores and transmits information relating to the images captured by the monitoring means. A piece of hardware includes any type of processing chip, such as a microprocessor;
• - At least one connection point for connecting the system to an energy source, preferably for powering the system and / or to facilitate image capture.

• - einen 3D-Sensor, z.B. eine 3D-Kamera;
• - einer Flugzeit-(ToF-)Kamera;
• - einer 360°-Kamera;
• - einer beliebigen Kombination aus einem oder mehreren der oben genannten Elemente.

The monitoring device preferably comprises a sensor, the sensor preferably comprising at least one of the following elements:

• - a 3D sensor, for example a 3D camera;
• - a time-of-flight (ToF) camera;
• - a 360 ° camera;
• - Any combination of one or more of the above.

The monitoring means is preferably a sensor, the sensor optionally comprising at least one energy source. The monitoring means is preferably an image sensor, the image sensor optionally comprising at least one energy source.

The monitoring means, preferably the sensor, has a monitoring range of preferably 0.5 m to 8 m from its location, preferably it has a monitoring range of 2 m to 4 m from its location. In order to cover a greater distance, the system preferably consists of a monitoring device with a higher-resolution sensor.

• - eine gegebene Umgebung, z.B. ein Bereich, der das Personenbeförderungssystem umfasst;
• - verschiedene Körperprofile potenzieller Passagiere, vorzugsweise in der genannten gegebenen Umgebung, bevor es in den Betriebsmodus versetzt werden kann.

In one embodiment of the invention, the system is learning-based, ie it is designed such that it first goes through a training phase in order to recognize

• a given environment, for example an area that includes the passenger transport system;
• different body profiles of potential passengers, preferably in the given environment, before it can be switched to the operating mode.

A training phase can be time-consuming, but offers the system, in particular the monitoring means, e.g. a 3D sensor, the advantage that it receives a better-defined, identified environment and is thus able to determine the position of a passenger who enters this identified environment , easier to capture and identify. The hardware preferably transmits this information to the control unit, which preferably triggers a corresponding event and thus improves the safety of the passengers.

During a training phase, each image captured by the system is compared with data that was collected during the training phase and stored in a database. The database can be a remote database, for example located in a cloud, or a database that is contained in the hardware of the monitoring device, or it can be an external piece Hardware, such as a computer hard drive or a data storage device such as a USB memory stick.

In one embodiment of the invention, the system is algorithm-based, ie it preferably works with estimates that are obtained from one or more algorithms, the one or more algorithms making it possible to obtain a complete body profile representation of the passenger, in particular from a captured image of a passenger a complete skeleton representation to be derived. The one or more algorithms are preferably stored in the hardware contained in the monitoring means. The hardware preferably transmits information to the control unit, which preferably triggers a corresponding event and thus improves the safety of the passengers.

The human skeleton and its shape are preferably already defined by the one or more algorithms. The use of one or more algorithms, e.g. condensation algorithms, in combination with other tools such as Kalman filtering, Bayesian networks and any other data acquisition tool advantageously enables automatic monitoring and avoids the need for a training phase. Thus, the system can advantageously be put into operating mode immediately after installation, and the identification of a passenger with a certain body profile, e.g. sitting, is quick and reliable, which consequently improves the response time of the passenger movement system.

• - eine stehende Position
• - horizontale Lage;
• - eine Sitzposition, wobei die Sitzposition von einem Passagier in einem Stuhl mit erleichterter Mobilität, z.B. einem Rollstuhl oder einem Kinderwagen, gehalten werden kann; oder von einem Passagier in einem Mobilitätsfahrzeug, z.B. einem Mobilitätsroller oder einem Hallen-Flughafentaxi, das verwendet wird, um den Transport von weniger Behinderten durch einen Flughafen zu unterstützen;
• - jede beliebige Position dazwischen.

In one embodiment of the invention comprises the body profile of the passenger

• - a standing position
• - horizontal position;
• a seating position, the seating position being able to be held by a passenger in a chair with easier mobility, for example a wheelchair or a stroller; or by a passenger in a mobility vehicle such as a mobility scooter or an indoor airport taxi that is used to assist in the transportation of less disabled people through an airport;
• - any position in between.

This advantageously ensures that the safety system is able to derive a corresponding body profile regardless of the manner in which a passenger approaches a moving passenger system.

In one embodiment of the invention, the security system is activated to trigger an event when a passenger is detected in a seated position. The triggered event preferably varies depending on the type of passenger system concerned.

• - Auslösung eines Rufs für den Aufzug bis zu dem Stockwerk, auf dem der Fahrgast erkannt wurde, so dass der Fahrgast den Ruftaster nicht mehr benutzen muss;
• - Auslösung einer Geschwindigkeitsreduzierung des Türschließvorgangs der Türen, wodurch der Fahrgast mehr Zeit hat, sich sicher in die Aufzugskabine zu begeben;
• - Aktivierung eines Sprachsteuerungsbefehlsprogramms, das es dem Fahrgast ermöglicht, den Aufzug über seine Stimme zu steuern, ohne sich selbst neben der Schalttafel in der Aufzugskabine manövrieren zu müssen. Dadurch wird vorteilhaft sichergestellt, dass ein Fahrgast in sitzender Position bei der Benutzung eines Aufzugs angemessen untergebracht ist.

In one embodiment of the invention, the passenger transportation system is an elevator. The triggered event is preferably one or more selected from the group of which they are composed:

• - Triggering a call for the elevator to the floor on which the passenger was recognized, so that the passenger no longer has to use the call button;
• Triggering a reduction in the speed of the door closing process of the doors, as a result of which the passenger has more time to safely get into the elevator car;
• - Activation of a voice control command program that enables the passenger to control the elevator via their voice without having to maneuver themselves next to the control panel in the elevator car. This advantageously ensures that a passenger is appropriately accommodated in a seated position when using an elevator.

• - die Aktivierung eines Alarmsignals, z.B. eines akustischen oder visuellen Alarmsignals;
• - Anhalten des Fahrgastbewegungssystems.

In one embodiment of the invention, the passenger conveyor system is a moving walkway or escalator. The triggered event is preferably one or more selected from the group of which they are composed:

• the activation of an alarm signal, for example an acoustic or visual alarm signal;
• - stopping the passenger movement system.

If the passenger movement system is a moving walkway or an escalator, the triggered event occurs preferably in two stages. When a passenger approaches the elevator in a seated position and is detected in the area by the inventive system, the area referring to the area that the passenger must traverse to reach and enter the passenger movement system, a first reaction is the Triggering the alarm signal. This can be done for informational purposes to inform the passenger of the risks involved in continuing to move towards the moving passenger system. If the passenger ignores this first warning signal, a second response is triggered in which the passenger movement system is stopped, preventing the passenger from using it to drive from point A to point B, thereby eliminating any potential safety risk is reduced.

• - einem Knöchel;
• - ein Knie;
• - eine Hüfte, einschließlich des Beckenbereichs;
• - einen Ellenbogen;
• - einen Hals;
• - eine Schulter;
• - jede Kombination davon.

In one embodiment of the invention, the security system is adapted to have an angle ( θ ) measures between one or more bones on the passenger's body,
wherein the one or more bones on the passenger's body are connected at a joint, the joint preferably being rotatable about at least one axis (x, y, z),
wherein the compound is preferably at least one selected from the group consisting of:

• - an ankle;
• - a knee;
• - one hip, including the pelvic area;
• - an elbow;
• - a neck;
• - one shoulder;
• - any combination of these.

In this way it can be advantageously determined whether the passenger is in a seated position or not.

• - der Winkel zwischen dem Fuß und dem Unterschenkel (θ1), vorzugsweise mit dem Sprunggelenk;
• - der Winkel zwischen dem Unterschenkel und dem Oberschenkel (θ2), vorzugsweise mit dem Kniegelenk;
• - der Winkel zwischen dem Oberschenkel und dem Rumpf (θ3), vorzugsweise mit dem Hüftgelenk;
• - der Winkel zwischen dem Oberarm und dem Unterarm (θ4), vorzugsweise mit dem Ellbogengelenk;
• - der Winkel zwischen dem Rumpf und dem Kopf (θ5), vorzugsweise mit dem Halsgelenk.

In one embodiment of the invention, the measured angle is ( θ ) at least one selected from the group comprising the invention:

• - the angle between the foot and the lower leg (θ1), preferably with the ankle;
• - the angle between the lower leg and the thigh (θ2), preferably with the knee joint;
• - the angle between the thigh and the trunk (θ3), preferably with the hip joint;
• - the angle between the upper arm and the forearm (θ4), preferably with the elbow joint;
• - the angle between the trunk and the head (θ5), preferably with the neck joint.

In one embodiment of the invention, the monitoring means is adapted so that the passenger can be monitored in real time. This advantageously ensures that the reaction of the system reflects the most up-to-date information relating to the passenger and preferably enables the system to trigger an event on the basis of “live” information. This helps to improve the safety of passengers.

• - das Körperprofil des Passagiers in Echtzeit; und/oder
• - alle Änderungen des Körperprofils des Passagiers in Echtzeit.

In one embodiment of the invention, the monitoring means is adapted to the monitoring,

• - the passenger's body profile in real time; and or
• - all changes in the passenger's body profile in real time.

In this way, it is advantageously ensured that the reaction of the system reflects the most up-to-date information relating to the passenger and preferably enables the system to trigger an event on the basis of “live” information. This helps improve the safety of passengers.

• - einen Aufzug;
• - eine Rolltreppe;
• - einen Fahrsteig.

In one embodiment of the invention, the passenger transportation system comprises:

• - an elevator;
• - an escalator;
• - a moving walkway.

• Ein Personenbeförderungssystem, das ein Sicherheitssystem entsprechend einer der vorhergehenden Ausführungsformen umfasst.

The invention also relates to:

• A passenger transportation system comprising a security system according to one of the preceding embodiments.

• Ein Verfahren zur Feststellung, ob sich ein Fahrgast eines Fahrgastbewegungssystems in einer stehenden oder sitzenden Position befindet, umfassend die Verfahrensschritte:
  • - Positionieren eines Sicherheitssystems gemäß einer der vorhergehenden Ausführungsformen an einer Stelle, an der es einen Bereich überwachen kann, der das Fahrgast-Bewegungssystem umfasst, z.B. den Bereich, durch den der Fahrgast reisen muss, um das Fahrgast-Bewegungssystem zu erreichen und in dieses einzutreten;
  • - das Überwachen der Passagiere, während sie sich durch den Bereich in Richtung des sich bewegenden Passagiersystems bewegen;
  • - Erfassen von mindestens einem Bild des Fahrgastes, insbesondere des Körperprofils des Fahrgastes, durch ein Überwachungsmittel;
  • - Segmentierung des mindestens einen aufgenommenen Bildes des Körperprofils des Passagiers in menschliche und nichtmenschliche Bereiche;
  • - Klassifizieren und Identifizieren der segmentierten Regionen, vorzugsweise unter Verwendung eines Formklassifikationsalgorithmus;
  • - Implementierung eines oder mehrerer Datenwerkzeuge, die in dem System enthalten sind, um die identifizierten Regionen des Körperprofils des Passagiers mit Teilen des menschlichen Skeletts abzugleichen;
  • - Identifizieren und Messen mindestens eines Winkels (θ1, θ2, θ3, θ4, θ5) zwischen einem oder mehreren Knochen auf dem Körperprofil des Passagiers, wobei der eine oder die mehreren Knochen auf dem Körper des Passagiers an einem Gelenk verbunden sind, wobei das Gelenk vorzugsweise um mindestens eine Achse (x, y, z) drehbar ist;
  • - Bestimmen, ob der mindestens eine gemessene Winkel (θ1, θ2, θ3, θ4, θ5) einem Körperprofil mit einer sitzenden oder stehenden Position entspricht;
  • - Auslösen eines Ereignisses, wenn der mindestens eine gemessene Winkel (θ1, θ2, θ3, θ4, θ5) einem Körperprofil mit einer sitzenden oder stehenden Position entspricht.

The invention also relates to:

• A method for determining whether a passenger of a passenger movement system is in a standing or sitting position, comprising the steps of:
  • Positioning a security system according to one of the preceding embodiments at a location where it can monitor an area that includes the passenger movement system, e.g. the area through which the passenger must travel to reach and enter the passenger movement system ;
  • the monitoring of passengers as they move through the area towards the moving passenger system;
  • - Detecting at least one image of the passenger, in particular the body profile of the passenger, by a monitoring means;
  • Segmentation of the at least one recorded image of the passenger's body profile into human and non-human areas;
  • Classifying and identifying the segmented regions, preferably using a shape classification algorithm;
  • - Implementation of one or more data tools included in the system to match the identified regions of the passenger's body profile with parts of the human skeleton;
  • - Identifying and measuring at least one angle (θ1, θ2, θ3, θ4, θ5) between one or more bones on the body profile of the passenger, the one or more bones on the body of the passenger being connected at a joint, the joint preferably is rotatable about at least one axis (x, y, z);
  • - determining whether the at least one measured angle (θ1, θ2, θ3, θ4, θ5) corresponds to a body profile with a sitting or standing position;
  • Triggering of an event if the at least one measured angle (θ1, θ2, θ3, θ4, θ5) corresponds to a body profile with a sitting or standing position.

• - ein Knöchel;
• - ein Knie;
• - eine Hüfte, einschließlich des Beckenbereichs;
• - ein Hals;
• - eine Schulter;
• - einen Ellenbogen;
• - eine beliebige Kombination davon.

In one embodiment of the invention, the hinge on the passenger's body is at least one hinge selected from the group that makes it up:

• - an ankle;
• - a knee;
• - one hip, including the pelvic area;
• - a neck;
• - one shoulder;
• - an elbow;
• - any combination of these.

In one embodiment of the invention, the security system monitors the area ( W. ) in real time and reacts accordingly to changes in the passenger's body profile. This advantageously ensures that the reaction of the system reflects the most up-to-date information relating to the passenger and thus improves the safety of the passenger.

• - einen Aufzug;
• - eine Rolltreppe;
• - ein Fahrsteig.

In one embodiment of the invention, the passenger movement system comprises

• - an elevator;
• - an escalator;
• - a moving walkway.

Figure list

• Die Bilder 1a bis 1c zeigen eine schematische Darstellung eines Fahrgastes, der sich einem Personenbeförderungssystem nähert, wobei das Personenbeförderungssystem ein Aufzug, eine Fahrtreppe bzw. ein Fahrsteig ist;
• Die und zeigen Skelettdarstellungen eines Fahrgastes in verschiedenen stehenden und sitzenden Positionen;
• ist ein Prozessschrittdiagramm, das zeigt, wie das erfinderische System ein Ereignis auslöst;
• zeigt die im menschlichen Körper enthaltenen Rotationspunkte und ihre jeweiligen Achsen.

The invention is described in more detail with the aid of the figures:

• Figures 1a to 1c show a schematic representation of a passenger approaching a passenger conveyor system, the passenger conveyor system being an elevator, an escalator or a moving walk;
• The and show skeletal representations of a passenger in various standing and sitting positions;
• Figure 3 is a process step diagram showing how the inventive system raises an event;
• shows the rotation points contained in the human body and their respective axes.

In Figure 3 is a schematic representation of an area W. shown outside of a moving passenger system. In this particular example the people moving system is an elevator 100 . The elevator 100 consists of the elevator doors 102 , a corridor lantern and the floor designation 101 and a call button 103 . The area consists of a system according to the invention 10 that is above the elevator doors 102 is arranged so that it is aimed at the prospective passengers. In the area W. a passenger approaches 2 the elevator 100 . The passenger 2 in this particular version is a person who is in a wheelchair 3 sits.

The chosen monitoring medium 11 of the system 10 in this particular example is a time-of-flight (ToF) camera 11. The ToF camera 11 monitors the area W. Real time. The system 10 is equipped with one or more algorithms that enable him to create a full body representation 4th of the passenger 2 to capture, in particular a complete skeleton representation of the passenger 2 . The human skeleton and its shape is already within the system 10 defined by the one or more algorithms. The system 10 is adapted to recognize a skeleton and its position and to further differentiate between “human” and “non-human parts” of the captured body representation. The passenger 2 represents “human” parts, while the wheelchair 3 in which he sits represents “non-human” parts. The one or more algorithms enable the system 10 also, activities of the passenger 2 to recognize, e.g. pushing the wheelchair 3 with the arms, see . The monitoring takes place in real time, so there is no need to compare the collected data, e.g. the captured image (s), with the information stored in a database. So there is no delayed response time and the system 10 automatically triggers an event based on "live" information.

• - Auslösen eines Rufs für den Aufzug 100 zu dem Stockwerk, auf dem der Fahrgast 2 erkannt wurde, so dass der Fahrgast 2 den Ruftaster 103 nicht mehr benutzen muss;
• - Auslösen einer Verringerung der Geschwindigkeit des Türschließvorgangs der Türen 102, wodurch der Fahrgast 2 mehr Zeit hat, sich sicher in die Aufzugskabine zu begeben;
• - Aktivierung eines Sprachsteuerungsbefehlsprogramms, das es dem Fahrgast 2 ermöglicht, den Aufzug 100 über seine Stimme zu steuern, ohne sich neben der Schalttafel im Inneren der Aufzugskabine manövrieren zu müssen.

In in which the passenger transportation system is an elevator 100 is, the triggered event can be any one or more events selected from the group:

• - Triggering a call for the elevator 100 to the floor where the passenger is 2 was recognized so that the passenger 2 the call button 103 no longer have to use;
• - Triggering a decrease in the speed of the door closing process 102 , making the passenger 2 has more time to get safely into the elevator car;
• - Activation of a voice control command program that it gives the passenger 2 allows the elevator 100 can be controlled via his voice without having to maneuver next to the control panel inside the elevator car.

• - die Aktivierung eines Alarmsignals, z.B. eines akustischen oder visuellen Alarmsignals;
• - das Anhalten der Fahrtreppe 200 oder des Fahrsteigs 300.

In or , the passenger conveyor system being an escalator 200 with speed steps 201 or a moving walk 300 with driving pallets 301 is, the triggered event can be any one or more events selected from the group:

• the activation of an alarm signal, for example an acoustic or visual alarm signal;
• - stopping the escalator 200 or the moving walk 300 .

If the passenger movement system is an escalator 200 or a moving walkway 300 acts, the triggered event consists of two stages. When the passenger is 2 in the seated position of the escalator 200 or the moving walkway 300 approaches and in the area W through the inventive system 10 is detected, an initial reaction is to trigger an alarm signal. This can be done for informational purposes to the passenger 2 Inform of the risks involved in moving further towards the escalator 200 or the moving walk 300 emotional. If the passenger 2 Ignoring this first warning signal, a second reaction is triggered in which the escalator 200 or the moving walkway 300 is stopped, causing the passenger 2 is prevented from using them to travel from point A to point B (not shown), thereby reducing any potential safety risk.

In order to come back: when the passenger 2 approaches the elevator doors 12, the system identifies 10 the passenger 2 and is able to make a representation 4th the body profile of the passenger 2 to construct. The system 10 recognizes the passenger 2 , especially its representation 4th than in a sitting position and presses the call button 103 to call the elevator car (not shown) to the floor on which the passenger is located 2 is located. The passenger 2 recognizes the call from the information on the hall lantern and the floor identifier 101 is shown. As soon as the elevator car arrives, the car doors open 102 . When the passenger is 2 approaches the cabin, the system is activated 10 a control on the cabin doors 102 so that their closing speed is reduced and the closing time increases, preferably by 3 to 20 seconds. As soon as the passenger 2 safely in the elevator car activates the system 10 also a voice control that enables the passenger to verbally select the desired floor number with the elevator 100 to communicate. The passenger 2 can be requested by a first computer-controlled voice command from the elevator control panel located in the elevator car, orally with the elevator 100 to communicate. When the passenger 2 exits the elevator car, the control of the closing speed of the car doors remains 102 persist until the passenger 2 has left the elevator car completely and is traveling in a direction away from area W of the floor in question.

The system 10 is able to trigger an event and achieves this by adapting it to reconstruct the 3D voxel for each image or individual image captured by the ToF camera 11. The system 10 translates the reconstructed 3D voxel into a model skeletal representation, as shown in the images. 2a and 2b. Since the monitoring is carried out in real time, the movement of the potential elevator passenger becomes 2 towards the elevator 100 constantly tracked so that every change in movement is also displayed. The change in movement is shown as a dotted line around the original full line.

shows a passenger 2 in various standing positions while a passenger 2 shows in a sitting position with various arm movements. The system is able to distinguish between the body shape when sitting and the body shape when standing and react appropriately when the body shape is in the sitting position.

• - Segmentierung des aufgenommenen Bildes oder der aufgenommenen Bilder in „menschliche“ Regionen und „nicht-menschliche“ Regionen, wobei die „menschlichen“ Regionen das menschliche Skelett des Passagiers 2 und die „nicht-menschlichen“ Regionen das sich bewegende Objekt, z.B. den Rollstuhl 3, umfassen;
• - Klassifizierung und Identifizierung der segmentierten Regionen unter Verwendung eines Formklassifikationsalgorithmus, um die Regionen des Skeletts des Passagiers 2 präzise aus dem Rest des sich bewegenden Rollstuhls 3 zu extrahieren;
• - Implementierung eines oder mehrerer Datenerfassungswerkzeuge, z.B. eines Kalman-Filters, eines Bayessche Netzwerks, eines Kondensationsalgorithmus oder jedes anderen geeigneten Datenerfassungswerkzeugs, um die identifizierten Knochen mit Teilen des menschlichen Skeletts abzugleichen, z.B. Knochen, die den Armen entsprechen, Knochen, die den Beinen entsprechen, Knochen, die der Wirbelsäule entsprechen, Knochen, die dem Schädel oder Kopf entsprechen, um eine Strichmännchen Darstellung des Passagiers 2 zu erzeugen;
• - Identifizierung und Bestimmung relevanter Winkel (θ) zwischen den Knochen des Skeletts, z.B. der Winkel zwischen Oberschenkelknochen und Becken, d.h. Oberschenkelknochen und Hüftknochen; oder der Winkel zwischen Oberschenkelknochen und Tibia oder Fibula oder sowohl Tibia als auch Fibula, d.h. Oberschenkelknochen und Knochen im Unterschenkel.

The method for recognizing a human pose or a body profile for reconstructing the corresponding 3D voxel is shown in FIG and includes the following process steps:

• - Segmentation of the recorded image or images into “human” regions and “non-human” regions, the “human” regions being the human skeleton of the passenger 2 and the "non-human" regions the moving object, eg the wheelchair 3 , include;
• Classification and identification of the segmented regions using a shape classification algorithm to identify the regions of the passenger's skeleton 2 precise from the rest of the moving wheelchair 3 to extract;
• - Implementation of one or more data acquisition tools, e.g. a Kalman filter, a Bayesian network, a condensation algorithm or any other suitable data acquisition tool to match the identified bones with parts of the human skeleton, e.g. bones corresponding to the arms, bones corresponding to the legs , Bones that correspond to the spine, bones that correspond to the skull or head, around a stick figure representation of the passenger 2 to create;
• - Identification and determination of relevant angles ( θ ) between the bones of the skeleton, e.g. the angle between the thigh bone and the pelvis, that is, the thigh bone and the hip bone; or the angle between the femur and the tibia or fibula, or both the tibia and fibula, that is, the femur and bone in the lower leg.

• - einen Winkel θ2 zwischen dem Oberschenkelknochen und der Tibia oder Fibula oder sowohl Tibia als auch Fibula, d.h. Oberschenkelknochen und die Knochen im Unterschenkel, wobei der Winkel θ2 das Kniegelenk umfasst;
• - einen Winkel θ3 zwischen dem Oberschenkelknochen und der Wirbelsäule, d.h. dem Oberschenkelknochen und dem Rumpf, wobei der Winkel θ3comprises das Hüftgelenk umfasst (siehe Referenznummer 5 der bis ).

The passenger 2 in the wheelchair 3 consists

• an angle θ2 between the femur and the tibia or fibula, or both tibia and fibula, ie the femur and the bones in the lower leg, the angle θ2 including the knee joint;
• - an angle θ3 between the femur and the spine, ie the femur and the trunk, the angle θ3comprises encompassing the hip joint (see reference number 5 the to ).

The respective angle θ2, θ3 falls within the range that corresponds to a person in a sitting position. If the passenger is missing one or more limbs, the system can establish correlations with angles from other parts of the skeletal representation, for example arms, in order to recognize whether the passenger is 2 in a sitting position or not.

When the angle θ The device detects between the thighbone and the shinbone or the fibula or both the tibia and fibula, ie the thighbone and the bones in the lower leg, this angle including the knee joint being in the range from 70 ° to 150 ° 10 this picture as a passenger in a seated position.

If the angle between the thighbone and the tibia or fibula, or both the tibia and fibula, ie the thighbones and the bones in the lower leg, the angle including the knee joint, is greater than 150 °, the device detects 10 this picture as a passenger standing position.

If the angle between the thigh bone and the spine, i.e. the thigh bone and the trunk, this angle including the hip joint, is in the range of 120 ° to 220 °, the device recognizes this image as a passenger standing position. If the angle between the thigh bone and the spine, i.e. the thigh bone and the trunk, this angle including the hip joint, is less than 120 °, the device recognizes this image as a passenger in a sitting position.

The process of recognizing a human pose or body profile in order to reconstruct the corresponding 3D voxel if the system 10 is learning-based, comprises the same procedural steps as described above. The inventive system 10 uses the same procedures as described above, ie algorithm based and learning based, if the passenger system is an escalator 200 ( or the passenger system is a moving walk 300 ( ) is.

shows the different points of rotation within the human body 20th that the system 10 and can use it to determine whether a person is sitting or standing. A variety of algorithms can be used in the system 10 can be introduced to account for the numerous combinations of body rotations about the x, y, and z axes at one or more rotation points. Such rotations are reflected in the skeleton representation that the system 10 detects and, if necessary, used to trigger an event.

It is to be understood that aspects of one embodiment described above can be combined with aspects of another embodiment while still falling within the scope of the present disclosure.

List of reference symbols

2

Passengers

3

wheelchair

4th

Representation of a body profile

5

angle

10

system

11

Monitoring means

20th

human body

100

Elevator

101

Hall lantern and floor identifier

102

Elevator doors

103

Call button

200

Escalator

201

moving steps

300

Moving walkway

301

movable pallets

θ

Joint angle W area

QUOTES INCLUDED IN THE DESCRIPTION

This list of the documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• JP 2012176833 [0003]
• JP 2016050088 [0004]

Claims (13)

Safety system (10) for a passenger transport system (100, 200, 300) with a monitoring device (11) characterized in, that it is adapted to identify a body profile of a passenger (2). The security system (10) according to Claim 1 , characterized in that the body profile of the passenger (2) comprises - a standing position; - a sitting position; - any position in between. The security system (10) according to one of the preceding claims, characterized in, that it is adapted to measure an angle (θ) between one or more bones on the passenger's body (2), wherein the one or more bones on the body of the passenger (2) are connected at a joint, the joint being rotatable about at least one axis (x, y, z). The security system (10) according to Claim 3 is characterized in that the measured angle (θ) is at least one selected from the group consisting of: - the angle between the foot and the lower leg (θ1); - the angle between the lower leg and the upper leg (θ2); - the angle between the thigh and the trunk (θ3); - the angle between the upper arm and the forearm (θ4); - the angle between the torso and the head (θ5). The security system (10) according to any one of the preceding claims, characterized in that the monitoring means (11) is adapted to monitor the passenger (2) in real time. The security system (10) according to one of the preceding claims, characterized in that the monitoring means (11) is suitable for monitoring: - the body profile of the passenger (2); and / or - all changes in the body profile of the passenger (2) in real time. The security system (10) according to any one of the preceding claims, characterized in that the monitoring device (11) comprises a sensor, the sensor preferably comprising at least one of the following elements: a 3D sensor; - a time-of-flight camera; - a 360 ° camera; - Any combination of one or more of the above. The security system (10) according to one of the preceding claims, characterized in, which includes the passenger transport system: - an elevator (100); - an escalator (200); - a moving walkway (300). A passenger conveyor system (100, 200, 300) comprising a security system (10) according to one of the preceding claims. A method for detecting whether a passenger (2) of a passenger movement system (100, 200, 300) is in a standing or sitting position, comprising the method steps: - Positioning a security system (10) according to one of the Claims 1 to 8th at a location capable of monitoring an area (W) including the passenger movement system (100, 200, 300); - Acquisition of at least one image of the passenger (2), in particular the body profile of the passenger (2), via a monitoring means (11); - segmenting the at least one captured image of the body profile of the passenger (2) into human and non-human areas; - Implementation of one or more data tools contained in the system (10) in order to compare the identified regions of the body profile of the passenger (2) with parts of the human skeleton; - identifying and measuring at least one angle (θ1, θ2, θ3, θ4, θ5) between one or more bones on the body profile of the passenger (2), the one or more bones being connected at a joint; - determining whether the at least one measured angle (θ1, θ2, θ3, θ4, θ5) corresponds to a body profile with a sitting or standing position; Triggering of an event if the at least one measured angle (θ1, θ2, θ3, θ4, θ5) corresponds to a body profile with a sitting or standing position. Procedure according to Claim 10 , characterized in that the joint on the body of the passenger (2) is at least one joint selected from the group comprising: - an ankle; - a knee; - a hip; - a neck; -any combination of these. Method according to one of the Claims 10 to 11 , characterized in that the security system (10) monitors the area (W) in real time and reacts accordingly to changes in the body profile of the passenger (2). Method according to one of the Claims 10 to 12th , characterized in that the passenger movement system comprises - an elevator (100); - an escalator (200); - a moving walkway (300).

Images