[go: up one dir, main page]

EP3531392B1 - Method for managing the passage of a vehicle through a toll station of a road - Google Patents

Method for managing the passage of a vehicle through a toll station of a road Download PDF

Info

Publication number
EP3531392B1
EP3531392B1 EP19159523.0A EP19159523A EP3531392B1 EP 3531392 B1 EP3531392 B1 EP 3531392B1 EP 19159523 A EP19159523 A EP 19159523A EP 3531392 B1 EP3531392 B1 EP 3531392B1
Authority
EP
European Patent Office
Prior art keywords
vehicle
image
category
vehicles
barrier
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19159523.0A
Other languages
German (de)
French (fr)
Other versions
EP3531392A1 (en
Inventor
Paul MAAREK
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CyclopeAi
Original Assignee
CyclopeAi
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CyclopeAi filed Critical CyclopeAi
Publication of EP3531392A1 publication Critical patent/EP3531392A1/en
Application granted granted Critical
Publication of EP3531392B1 publication Critical patent/EP3531392B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/015Detecting movement of traffic to be counted or controlled with provision for distinguishing between two or more types of vehicles, e.g. between motor-cars and cycles
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07BTICKET-ISSUING APPARATUS; FARE-REGISTERING APPARATUS; FRANKING APPARATUS
    • G07B15/00Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points
    • G07B15/06Arrangements for road pricing or congestion charging of vehicles or vehicle users, e.g. automatic toll systems
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/04Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors

Definitions

  • the invention relates to a method for managing the passage of a vehicle to a toll station of a road.
  • the roads are dotted with several toll stations, having barriers able to pass from a blocking configuration to a passage configuration.
  • the barrier In the blocking configuration, the barrier extends in a substantially horizontal direction and in the passage configuration the barrier has pivoted upwards, from the blocking configuration, to extend in a substantially vertical direction.
  • a road usually comprising two or three lanes on its rolling sections is generally subdivided into a larger number of lanes at each toll station.
  • Each of these lanes thus comprises a barrier, and when a vehicle arrives at the toll station, a display indicates an amount to be paid according to the category of said vehicle arriving at the barrier.
  • This category can for example be a car, a truck or a two-wheeler. An occupant of the vehicle then pays the amount indicated, and the barrier opens automatically to let the vehicle pass.
  • the category of vehicle is not correctly identified at the level of the toll station. Indeed, the identification is currently carried out on the basis of the acquisition of an image taken by a camera, said image being focused on the registration plate of the vehicle presenting itself at the level of the barrier. If, for example, a motorcycle is inserted between the barrier and a car placed behind this motorcycle, it is possible that the camera picks up the license plate of the car at the moment when the motorcycle driver is about to pay the amount for to pass. He will then have to pay a biased amount, corresponding to that of a car.
  • the document FR2903519 A1 discloses an automatic vehicle classification device intended to equip a manual toll or electronic toll station for charging and collecting the amount of the toll, said device determining the class of a vehicle from its image and its height.
  • a management method makes it possible to effectively process the passage of a vehicle at a toll station of a road, by systematically and without error identifying the category of the vehicle presenting itself at the toll barrier.
  • the subject of the invention is a method for managing the passage of a vehicle to a toll station of a road, said station being crossed by at least one lane and each of said lanes having a barrier able to pass from a position of closure preventing a vehicle from passing to an open position allowing said vehicle to pass.
  • the invention is defined by a management method according to claim 1.
  • the main originality of such a management method is to host at least one server in the Internet network also called "cloud", said server having software capable of processing the image of the vehicle and the parameter representing the height of said vehicle , in order to restore information on the category of the vehicle arriving at the toll barrier.
  • the server is centralized on the Internet network, and thus promotes general updates of the software, without having to multiply the interventions on local servers. Indeed, it suffices to update the version of the software once on the server hosted in the Internet network, to operate all the payment terminals, and thus avoids having to intervene several times on local servers.
  • the image acquisition system is a digital or analog camera.
  • the parameter representative of the height of the vehicle can for example be represented by the height of the vehicle itself, or by any electrical signal or of another nature, representative of said height.
  • a specific category of vehicle can for example be constituted by motorcycles, or by cars or by heavy goods vehicles.
  • the payment terminal comprises means for displaying the amount to be paid and corresponding to a given category of vehicle and means capable of collecting means of payment, such as for example cash or a credit card.
  • the image of the vehicle is discretized (each point of the images corresponds to a pixel), and the software algorithm uses the pixels of said image to process it.
  • the step of acquiring at least one image of the vehicle is carried out by means of a camera placed close to the barrier and in front of the vehicle arriving at the level of the barrier.
  • This camera is triggered as soon as the presence of a vehicle placed just in front of the barrier is detected, this detection being able for example to be carried out by means of an electromagnetic sensor.
  • the camera is capable of acquiring an image whose resolution is greater than 244 ⁇ 244.
  • the higher the definition of the camera the better the image processing quality and the more certain the information relating to the category of the vehicle.
  • the step of acquiring the parameter is a step of direct measurement of the height of the vehicle, carried out by means of at least one optical sensor.
  • the step of measuring the height of the vehicle is carried out by means of two optical sensors, placed on either side of the vehicle upstream of the barrier.
  • a management method comprises a step of developing five different categories of vehicle, a first category corresponding to light vehicles, a second category corresponding to intermediate vehicles, a third category corresponding to heavy and other 2-axle vehicles, a fourth category corresponding to heavy goods vehicles and other three-axle vehicles, a fifth category corresponding to motorcycles, sidecars and trikes, said management method restoring the information making it possible to classify each vehicle in one of these five categories.
  • the five previous categories refer to vehicles that are very different from each other, which can justify a difference in payment at a toll station.
  • the step of restoring the information relating to the category of the vehicle occurs less than 100 ms after the step of sending said at least one image and said parameter. This time is extremely short, and reduces the waiting time for each vehicle at the toll station.
  • the step of restoring the information relating to the category of the vehicle occurs 50 ms after the step of sending said at least one image and said parameter.
  • Another object of the invention is a management device for carrying out a management method according to the invention.
  • the main technical characteristic of a device is that it comprises an image acquisition system intended to acquire at least one image of the vehicle, at least one optical sensor intended to measure the height of the vehicle, a payment terminal and at least one server hosted on the Internet network and comprising software able to process the image of the vehicle and the information relating to the height of the vehicle, then to send to said terminal information relating to the category of the vehicle .
  • a management device comprises transmission means capable of routing the various information between the assembly formed by the image acquisition system and said at least one sensor, and the server, and means of transmission between said server and the payment terminal.
  • a method for managing the passage of a vehicle to a toll station of a road has the advantage of being managed quickly and easily by centralizing on the Internet network, the server equipped with the identification software of the vehicle category. It is therefore sufficient to intervene only once on said server to update or modify the software. It also has the advantage of reducing the risk of contamination of said software by a virus, by reducing to one, the server controlling the software.
  • some roads are equipped with a toll station 1 intended to compel a user to pay a sum of money corresponding to the length of the section of said road taken by this user, said sum also corresponding to the category of vehicle of said user.
  • the PTAC is the total authorized weight in charge.
  • the PTAC is the total authorized weight in charge.
  • a toll station 1 comprises an automatic barrier 2 placed on a road lane 3 and equipment 4, 5, 6 making it possible to identify the category of the vehicle 7 advancing to said automatic barrier 2.
  • the automatic barrier 3 is capable of passing from a closed position for which it extends in a substantially horizontal direction and blocks the passage of the vehicle, to an open position for which it extends in a substantially vertical direction after having performed a rotation of approximately 90° from its closed position. In the open position, the automatic barrier 3 allows the vehicle, which was parked behind it, to pass.
  • the passage from one position to another is reversible, and can be controlled by an electrical signal, which can for example be triggered as soon as the payment has been made.
  • the principle of a management method according to the invention is that it is based on an image of the vehicle and on a measurement of its height, and no longer on the acquisition of an image of the license plate of the vehicle, which can be a source of error. Indeed, if a motorcyclist presents himself with his 2-wheeled vehicle at the level of the barrier 2, and if a car is placed just behind him, the methods currently implemented risk taking into account the license plate of this vehicle, and the biker will then have to pay a lump sum corresponding to a motor vehicle.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Finance (AREA)
  • Devices For Checking Fares Or Tickets At Control Points (AREA)
  • Traffic Control Systems (AREA)

Description

L'invention se rapporte à un procédé de gestion du passage d'un véhicule à une station de péage d'une route.The invention relates to a method for managing the passage of a vehicle to a toll station of a road.

Généralement, les routes sont jalonnées de plusieurs stations de péages, possédant des barrières aptes à passer d'une configuration de blocage à une configuration de passage. Dans la configuration de blocage, la barrière s'étend selon une direction sensiblement horizontale et dans la configuration de passage la barrière a pivoté vers le haut, depuis la configuration de blocage, pour s'étendre selon une direction sensiblement verticale. Plus précisément, une route comportant habituellement deux ou trois voies sur ses tronçons de roulage, se subdivise généralement en un nombre plus important de voies au niveau de chaque station de péage. Chacune de ces voies comporte ainsi une barrière, et lorsqu'un véhicule arrive à la station de péage, un afficheur indique un montant à payer en fonction de la catégorie dudit véhicule se présentant au niveau de la barrière. Cette catégorie peut par un exemple être une voiture, un camion ou un deux-roues. Un occupant du véhicule s'acquitte alors du montant indiqué, et la barrière s'ouvre automatiquement pour laisser passer le véhicule.Generally, the roads are dotted with several toll stations, having barriers able to pass from a blocking configuration to a passage configuration. In the blocking configuration, the barrier extends in a substantially horizontal direction and in the passage configuration the barrier has pivoted upwards, from the blocking configuration, to extend in a substantially vertical direction. More precisely, a road usually comprising two or three lanes on its rolling sections is generally subdivided into a larger number of lanes at each toll station. Each of these lanes thus comprises a barrier, and when a vehicle arrives at the toll station, a display indicates an amount to be paid according to the category of said vehicle arriving at the barrier. This category can for example be a car, a truck or a two-wheeler. An occupant of the vehicle then pays the amount indicated, and the barrier opens automatically to let the vehicle pass.

Or, il peut arriver que la catégorie de véhicule ne soit pas correctement identifiée au niveau de la station de péage. En effet, l'identification est réalisée actuellement sur la base de l'acquisition d'une image prise par une caméra, ladite image étant focalisée sur la plaque d'immatriculation du véhicule se présentant au niveau de la barrière. Si par exemple, une moto est insérée entre la barrière et une voiture placée derrière cette moto, il est possible que la caméra prenne la plaque d'immatriculation de la voiture au moment où le pilote de la moto s'apprête à payer le montant pour passer. Il va alors devoir acquitter un montant biaisé, correspondant à celui d'une voiture. Il peut, soit contester le montant sur place et engendrer un ralentissement voire une interruption du trafic le temps qu'une personne habilitée constate l'erreur et la corrige, soit le contester ultérieurement en mobilisant au moins une personne appartenant à l'entreprise chargée d'encaisser le paiement. Autrement dit, une mauvaise identification du véhicule engendre des dommages, qui ont un coût élevé.However, it may happen that the category of vehicle is not correctly identified at the level of the toll station. Indeed, the identification is currently carried out on the basis of the acquisition of an image taken by a camera, said image being focused on the registration plate of the vehicle presenting itself at the level of the barrier. If, for example, a motorcycle is inserted between the barrier and a car placed behind this motorcycle, it is possible that the camera picks up the license plate of the car at the moment when the motorcycle driver is about to pay the amount for to pass. He will then have to pay a biased amount, corresponding to that of a car. He can either contest the amount on the spot and cause a slowdown or even an interruption of traffic while an authorized person notices the error and corrects it, or contest it later by mobilizing at least one person belonging to the company in charge of collect payment. In other words, a wrong identification of the vehicle generates damage, which has a high cost.

Le document FR2903519 A1 divulgue un dispositif de classification automatique de véhicules destiné à équiper un poste de péage manuel ou de télépéage pour la tarification et la perception du montant du péage, ledit dispositif déterminant la classe d'un véhicule à partir de son image et de sa hauteur.The document FR2903519 A1 discloses an automatic vehicle classification device intended to equip a manual toll or electronic toll station for charging and collecting the amount of the toll, said device determining the class of a vehicle from its image and its height.

Un procédé de gestion selon l'invention, permet de traiter efficacement le passage d'un véhicule à une station de péage d'une route, en identifiant systématiquement et sans erreur la catégorie du véhicule se présentant à la barrière de péage.A management method according to the invention makes it possible to effectively process the passage of a vehicle at a toll station of a road, by systematically and without error identifying the category of the vehicle presenting itself at the toll barrier.

L'invention a pour objet un procédé de gestion du passage d'un véhicule à une station de péage d'une route, ladite station étant traversée par au moins une voie et chacune desdites voies possédant une barrière apte à passer d'une position de fermeture empêchant un véhicule de passer à une position d'ouverture permettant audit véhicule de passer.The subject of the invention is a method for managing the passage of a vehicle to a toll station of a road, said station being crossed by at least one lane and each of said lanes having a barrier able to pass from a position of closure preventing a vehicle from passing to an open position allowing said vehicle to pass.

L'invention est définie par un procédé de gestion selon la revendication 1.The invention is defined by a management method according to claim 1.

La principale originalité d'un tel procédé de gestion est d'héberger au moins un serveur dans le réseau internet encore appelé « cloud », ledit serveur possédant un logiciel apte à traiter l'image du véhicule et le paramètre représentatif de la hauteur dudit véhicule, afin de restituer une information sur la catégorie du véhicule se présentant au niveau de la barrière du péage. Le serveur se retrouve centralisé sur le réseau internet, et favorise ainsi les mises à jour générales du logiciel, sans avoir à multiplier les interventions sur des serveurs locaux. En effet, il suffit de mettre une fois à jour la version du logiciel sur le serveur hébergé dans le réseau internet, pour faire fonctionner toutes les bornes de paiement, et évite ainsi d'avoir à intervenir plusieurs fois sur des serveurs locaux. Le système d'acquisition d'image est une caméra numérique ou analogique. Le paramètre représentatif de la hauteur du véhicule peut par exemple être représenté par la hauteur elle-même du véhicule, ou par tout signal électrique ou d'autre nature, représentatif de ladite hauteur. Une catégorie spécifique de véhicule peut par exemple être constituée par les motos, ou par les voitures ou par les poids lourds. Afin de ne pas trop ralentir le débit des véhicules au niveau de la station de péage, il est indispensable que la restitution de l'information relative à la catégorie du véhicule à la borne de paiement s'effectue sur un temps très court, typiquement inférieur à une seconde. La borne de paiement comprend des moyens d'affichage du montant à payer et correspondant à une catégorie de véhicule donnée et des moyens aptes à recueillir des moyens de paiement, tels que par exemple des espèces ou une carte de crédit. Préférentiellement, l'image du véhicule est discrétisée (chaque point de l'images correspond à un pixel), et l'algorithme du logiciel utilise les pixels de ladite image pour la traiter.The main originality of such a management method is to host at least one server in the Internet network also called "cloud", said server having software capable of processing the image of the vehicle and the parameter representing the height of said vehicle , in order to restore information on the category of the vehicle arriving at the toll barrier. the server is centralized on the Internet network, and thus promotes general updates of the software, without having to multiply the interventions on local servers. Indeed, it suffices to update the version of the software once on the server hosted in the Internet network, to operate all the payment terminals, and thus avoids having to intervene several times on local servers. The image acquisition system is a digital or analog camera. The parameter representative of the height of the vehicle can for example be represented by the height of the vehicle itself, or by any electrical signal or of another nature, representative of said height. A specific category of vehicle can for example be constituted by motorcycles, or by cars or by heavy goods vehicles. In order not to slow down the flow of vehicles too much at the toll station, it is essential that the return of information relating to the category of the vehicle to the payment terminal takes place over a very short time, typically less one second away. The payment terminal comprises means for displaying the amount to be paid and corresponding to a given category of vehicle and means capable of collecting means of payment, such as for example cash or a credit card. Preferably, the image of the vehicle is discretized (each point of the images corresponds to a pixel), and the software algorithm uses the pixels of said image to process it.

Avantageusement, l'étape d'acquisition d'au moins une image du véhicule est réalisée au moyen d'une caméra placée à proximité de la barrière et devant le véhicule se présentant au niveau de la barrière. Cette caméra se déclenche, dès que la présence d'un véhicule placé juste devant la barrière est détectée, cette détection pouvant par exemple s'effectuer au moyen d'un capteur électromagnétique.Advantageously, the step of acquiring at least one image of the vehicle is carried out by means of a camera placed close to the barrier and in front of the vehicle arriving at the level of the barrier. This camera is triggered as soon as the presence of a vehicle placed just in front of the barrier is detected, this detection being able for example to be carried out by means of an electromagnetic sensor.

De façon préférentielle, la caméra est apte à acquérir une image dont la résolution est supérieure à 244x244. Plus la définition de la caméra sera élevée, meilleure sera la qualité de traitement d'image et plus sûre sera l'information relative à la catégorie du véhicule.Preferably, the camera is capable of acquiring an image whose resolution is greater than 244×244. The higher the definition of the camera, the better the image processing quality and the more certain the information relating to the category of the vehicle.

Préférentiellement, l'étape d'acquisition du paramètre est une étape de mesure directe de la hauteur du véhicule, réalisée au moyen d'au moins un capteur optique.Preferably, the step of acquiring the parameter is a step of direct measurement of the height of the vehicle, carried out by means of at least one optical sensor.

De façon avantageuse, l'étape de mesure de la hauteur du véhicule est réalisée au moyen de deux capteurs optiques, placés de part et d'autre du véhicule en amont de la barrière.Advantageously, the step of measuring the height of the vehicle is carried out by means of two optical sensors, placed on either side of the vehicle upstream of the barrier.

Avantageusement, un procédé de gestion selon l'invention, comprend une étape d'élaboration de cinq catégories de véhicule différentes, une première catégorie correspondant à des véhicules légers, une deuxième catégorie correspondant à des véhicules intermédiaires, une troisième catégorie correspondant à des poids lourds et autres véhicules à 2 essieux, une quatrième catégorie correspondant à des poids lourds et autres véhicules à trois essieux, une cinquième catégorie correspondant à des motos, side-cars et trikes, ledit procédé de gestion restituant l'information permettant de classer chaque véhicule dans l'une de ces cinq catégories. En effet, les cinq catégories précédentes se réfèrent à des véhicules bien différents les uns des autres, pouvant justifier d'une différence de paiement à une station de péage.Advantageously, a management method according to the invention comprises a step of developing five different categories of vehicle, a first category corresponding to light vehicles, a second category corresponding to intermediate vehicles, a third category corresponding to heavy and other 2-axle vehicles, a fourth category corresponding to heavy goods vehicles and other three-axle vehicles, a fifth category corresponding to motorcycles, sidecars and trikes, said management method restoring the information making it possible to classify each vehicle in one of these five categories. Indeed, the five previous categories refer to vehicles that are very different from each other, which can justify a difference in payment at a toll station.

De façon préférentielle, l'étape de restitution de l'information relative à la catégorie du véhicule intervient moins de 100ms après l'étape d'envoi de ladite au moins une image et dudit paramètre. Ce temps est extrêmement court, et diminue le temps d'attente de chaque véhicule à la station de péage.Preferably, the step of restoring the information relating to the category of the vehicle occurs less than 100 ms after the step of sending said at least one image and said parameter. This time is extremely short, and reduces the waiting time for each vehicle at the toll station.

Préférentiellement, l'étape de restitution de l'information relative à la catégorie du véhicule intervient 50ms après l'étape d'envoi de ladite au moins une image et dudit paramètre.Preferably, the step of restoring the information relating to the category of the vehicle occurs 50 ms after the step of sending said at least one image and said parameter.

L'invention a pour autre objet un dispositif de gestion pour la réalisation d'un procédé de gestion selon l'invention.Another object of the invention is a management device for carrying out a management method according to the invention.

La principale caractéristique technique d'un dispositif selon l'invention, est qu'il comprend un système d'acquisition d'image destiné à acquérir au moins une image du véhicule, au moins un capteur optique destiné à mesurer la hauteur du véhicule, une borne de paiement et au moins un serveur hébergé sur le réseau internet et comprenant un logiciel apte à traiter l'image du véhicule et l'information relative à la hauteur du véhicule, puis à envoyer vers ladite borne une information relative à la catégorie du véhicule.The main technical characteristic of a device according to the invention is that it comprises an image acquisition system intended to acquire at least one image of the vehicle, at least one optical sensor intended to measure the height of the vehicle, a payment terminal and at least one server hosted on the Internet network and comprising software able to process the image of the vehicle and the information relating to the height of the vehicle, then to send to said terminal information relating to the category of the vehicle .

Avantageusement, un dispositif de gestion selon l'invention comprend des moyens de transmission aptes à acheminer les différentes informations entre l'ensemble constitué par le système d'acquisition d'image et ledit au moins un capteur, et le serveur, et des moyens de transmission entre ledit serveur et la borne de paiement.Advantageously, a management device according to the invention comprises transmission means capable of routing the various information between the assembly formed by the image acquisition system and said at least one sensor, and the server, and means of transmission between said server and the payment terminal.

Un procédé de gestion du passage d'un véhicule à une station de péage d'une route selon l'invention, présente l'avantage d'être géré rapidement et facilement en centralisant sur le réseau internet, le serveur doté du logiciel d'identification de la catégorie de véhicule. Il suffit donc d'intervenir une seule fois sur ledit serveur pour mettre à jour ou modifier le logiciel. Il a de plus l'avantage de diminuer le risque de contamination dudit logiciel par un virus, en réduisant à un, le serveur pilotant le logiciel.A method for managing the passage of a vehicle to a toll station of a road according to the invention, has the advantage of being managed quickly and easily by centralizing on the Internet network, the server equipped with the identification software of the vehicle category. It is therefore sufficient to intervene only once on said server to update or modify the software. It also has the advantage of reducing the risk of contamination of said software by a virus, by reducing to one, the server controlling the software.

On donne, ci-après, une description détaillée d'un mode de réalisation préféré d'un procédé de gestion du passage d'un véhicule à une station de péage selon l'invention, en se référant aux figures suivantes :

  • La figure 1 est une vue en perspective simplifiée d'une station de péage dans laquelle est apte à être appliqué un procédé de gestion du passage d'un véhicule selon l'invention,
A detailed description of a preferred embodiment of a method for managing the passage of a vehicle to a toll station according to the invention is given below, with reference to the following figures:
  • The figure 1 is a simplified perspective view of a toll station in which a method for managing the passage of a vehicle according to the invention can be applied,

En se référant à la figure 1, certaines routes sont équipées d'une station de péage 1 destinée à contraindre un usager de payer une somme d'argent correspondant à la longueur du tronçon de ladite route empruntée par cet usager, ladite somme correspondant également à la catégorie de véhicule dudit usager.By referring to the figure 1 , some roads are equipped with a toll station 1 intended to compel a user to pay a sum of money corresponding to the length of the section of said road taken by this user, said sum also corresponding to the category of vehicle of said user.

De cette manière, il existe cinq catégories de véhicules identifiées :

  • La classe 1 correspondant aux véhicules légers : véhicules d'une hauteur totale inférieure ou égale à 2m et d'un PTAC inférieur ou égal à 3, 5 tonnes,
  • La classe 2 correspondant aux véhicules intermédiaires : véhicules d'une hauteur totale supérieure à 2m et inférieure à 3m et d'un PTAC inférieur ou égal à 3, 5 tonnes, ou ensemble roulant d'une hauteur totale supérieure à 2m et inférieure à 3m avec un véhicule tracteur d'un PTAC inférieur ou égal à 3, 5 tonnes,
  • La classe 3 correspondant aux véhicules à 2 essieux ayant soit une hauteur totale supérieure ou égale à 3m, soit un PTAC supérieur à 3, 5 tonnes,
  • La classe 4 correspondant aux véhicules à 3 essieux et plus, c'est-à-dire véhicules ayant une hauteur supérieure ou égale à 3m ou un PTAC supérieur à 3, 5 tonnes, ou ensembles roulants ayant une hauteur totale supérieure ou égale à 3m, ou ensembles roulants ayant un PTAC supérieur à 3, 5 tonnes,
  • La classe 5 correspondant aux motos, side-cars et aux trikes.
In this way, there are five categories of vehicles identified:
  • Class 1 corresponding to light vehicles: vehicles with a total height less than or equal to 2m and a GVW less than or equal to 3.5 tonnes,
  • Class 2 corresponding to intermediate vehicles: vehicles with a total height greater than 2m and less than 3m and a GVW less than or equal to 3.5 tonnes, or rolling assembly with a total height greater than 2m and less than 3m with a towing vehicle with a GVW less than or equal to 3.5 tonnes,
  • Class 3 corresponding to vehicles with 2 axles having either a total height greater than or equal to 3m, i.e. a GVW greater than 3.5 tonnes,
  • Class 4 corresponding to vehicles with 3 axles or more, i.e. vehicles with a height greater than or equal to 3m or a GVW greater than 3.5 tonnes, or rolling assemblies with a total height greater than or equal to 3m , or rolling sets with a GVW greater than 3.5 tons,
  • Class 5 corresponding to motorcycles, sidecars and trikes.

Pour rappel, le PTAC est le poids total autorisé en charge. Ainsi, en fonction du kilométrage parcouru sur un tronçon payant, et de la catégorie de son véhicule, un usager devra s'acquitter à la station de péage 1, d'une somme d'argent forfaitaire.As a reminder, the PTAC is the total authorized weight in charge. Thus, depending on the mileage traveled on a paid section, and the category of his vehicle, a user will have to pay at the toll station 1, a lump sum of money.

En se référant à la figure 1, une station de péage 1 comprend une barrière automatique 2 placé sur une voie routière 3 et des équipements 4, 5, 6 permettant d'identifier la catégorie du véhicule 7 s'avançant jusqu'à ladite barrière automatique 2. La barrière automatique 3 est apte à passer d'une position de fermeture pour laquelle elle s'étend dans une direction sensiblement horizontale et bloque le passage du véhicule, à une position d'ouverture pour laquelle elle s'étend dans une direction sensiblement verticale après avoir effectuée une rotation d'environ 90° depuis sa position de fermeture. Dans la position d'ouverture, la barrière automatique 3 permet de laisser passer le véhicule, qui stationnait derrière elle. Le passage d'une position à l'autre est réversible, et peut être commandée par un signal électrique, pouvant par exemple être déclenché dès que le paiement a été effectué.By referring to the figure 1 , a toll station 1 comprises an automatic barrier 2 placed on a road lane 3 and equipment 4, 5, 6 making it possible to identify the category of the vehicle 7 advancing to said automatic barrier 2. The automatic barrier 3 is capable of passing from a closed position for which it extends in a substantially horizontal direction and blocks the passage of the vehicle, to an open position for which it extends in a substantially vertical direction after having performed a rotation of approximately 90° from its closed position. In the open position, the automatic barrier 3 allows the vehicle, which was parked behind it, to pass. The passage from one position to another is reversible, and can be controlled by an electrical signal, which can for example be triggered as soon as the payment has been made.

Un procédé selon l'invention, permettant de gérer le passage d'un véhicule 7 à une station de péage 1, comprend schématiquement les étapes suivantes :

  • Figure imgb0001
    Une étape d'avancée du véhicule 7 jusqu'à la barrière automatique 2 en position fermée.
  • Figure imgb0001
    Figure imgb0003
    Une étape de détection de la présence d'un véhicule juste derrière la barrière. Cette étape peut être réalisée au moyen d'un capteur.
  • Figure imgb0001
    Figure imgb0005
    Une étape d'acquisition d'au moins une image du véhicule 7 se présentant au niveau de la barrière automatique 2, au moyen d'un système d'acquisition 4 d'image placé sur le côté de la voie 3 sur laquelle évolue le véhicule 7. Ce système d'acquisition d'images est préférentiellement une caméra apte à réaliser des images ayant une résolution supérieure à 244x244.
  • Figure imgb0001
    Figure imgb0007
    Une étape de mesure de la hauteur totale du véhicule 7. Cette étape de mesure est réalisée au moyen de deux capteurs optiques 5, 6 placés de part et d'autre du véhicule 7 en amont de la barrière 2. Ces deux capteurs 5, 6 sont alignés suivant un axe transversal de la voie 3, qui est perpendiculaire à un axe longitudinal de celle-ci.
  • Figure imgb0001
    Figure imgb0009
    Une étape d'envoi de ladite au moins une image et d'une information représentative de la hauteur totale du véhicule 7 mesurée, sur au moins un serveur hébergé sur le réseau internet. Autrement dit, le serveur est hébergé dans le cloud, et une multiplicité de stations de péage 1 sont connectées à ce serveur pour identifier la catégorie de véhicule se présentant à une barrière automatique, de ces stations de péage 1. Ce serveur se retrouve ainsi centralisé pour toutes les stations de péage 1, et il est alors facile d'intervenir sur un seul serveur pour procéder à des corrections de logiciel ou à des mises à jour de celui-ci. L'utilisation d'un seul serveur à la place d'une multiplicité de serveurs locaux évite la propagation de virus dans le système gérant lesdits serveurs locaux et réduit les risques de pannes ou de mauvais fonctionnement. Il suffit juste de se brancher sur une application dédiée sans avoir à toucher aux infrastructures.
  • Figure imgb0001
    Figure imgb0011
    Une étape d'identification de la catégorie du véhicule 7 au moyen d'un logiciel situé sur ledit au moins un serveur, et apte à traiter ladite au moins une image et ladite information relative à la hauteur totale du véhicule 7 mesurée. Ce logiciel s'appuie sur une méthode consistant à détecter les caractéristiques de chaque image de chaque classe de véhicules d'une base de données d'images traitées a priori par des personnes. Une fois cette étape d'extraction de caractéristiques réalisée de manière précise, la frontière qui sépare les différentes classes est ensuite modélisée. Par conséquent, pour chaque image en entrée, ses caractéristiques sont extraites, puis sur la base de ces dernières, sa classe est renvoyée.
  • Figure imgb0001
    Figure imgb0013
    Une étape de restitution d'une information relative à la catégorie du véhicule, au niveau d'une borne 8 de paiement situé en amont de la barrière. Cette information va indiquer le montant à payer par l'usager, ainsi qu'éventuellement, la catégorie de son véhicule. Il est bien entendu que chaque borne de paiement est connectée au serveur centralisé, qui est hébergé sur le cloud, et peut donc recevoir l'information concernant la catégorie du véhicule. Cette restitution d'information est rapide et se fait dans un délai inférieur à la seconde, et préférentiellement à un délai de 100ms.
  • Figure imgb0001
    Figure imgb0015
    Une étape de paiement au niveau de ladite borne au moyen par exemple d'espèces ou d'une carte de crédit.
  • Figure imgb0001
    Figure imgb0017
    Une étape de basculement de la barrière vers la position d'ouverture depuis sa position de fermeture, lorsque le montant a été acquitté.
A method according to the invention, making it possible to manage the passage of a vehicle 7 to a toll station 1, schematically comprises the following steps:
  • Figure imgb0001
    A step forward of the vehicle 7 to the automatic barrier 2 in the closed position.
  • Figure imgb0001
    Figure imgb0003
    A stage for detecting the presence of a vehicle just behind the barrier. This step can be carried out by means of a sensor.
  • Figure imgb0001
    Figure imgb0005
    A step of acquiring at least one image of the vehicle 7 presenting itself at the level of the automatic barrier 2, by means of a system image acquisition 4 placed on the side of the track 3 on which the vehicle 7 is moving. This image acquisition system is preferably a camera capable of producing images having a resolution greater than 244×244.
  • Figure imgb0001
    Figure imgb0007
    A step of measuring the total height of the vehicle 7. This step of measuring is carried out by means of two optical sensors 5, 6 placed on either side of the vehicle 7 upstream of the barrier 2. These two sensors 5, 6 are aligned along a transverse axis of the track 3, which is perpendicular to a longitudinal axis thereof.
  • Figure imgb0001
    Figure imgb0009
    A step of sending said at least one image and information representing the total height of the vehicle 7 measured, to at least one server hosted on the Internet network. In other words, the server is hosted in the cloud, and a multiplicity of toll stations 1 are connected to this server to identify the category of vehicle presenting itself at an automatic barrier, of these toll stations 1. This server is thus centralized for all toll stations 1, and it is then easy to intervene on a single server to carry out software corrections or updates thereof. The use of a single server instead of a multiplicity of local servers avoids the propagation of viruses in the system managing said local servers and reduces the risks of failures or malfunctions. All you have to do is connect to a dedicated application without having to touch the infrastructure.
  • Figure imgb0001
    Figure imgb0011
    A step of identifying the category of vehicle 7 by means of software located on said at least one server, and able to process said at least one image and said information relating to the total height of vehicle 7 measured. This software is based on a method consisting in detecting the characteristics of each image of each class of vehicle from a database of images processed a priori by people. Once this feature extraction step has been carried out precisely, the boundary that separates the different classes is then modelled. Therefore, for each input image, its features are extracted and then based on these, its class is returned.
  • Figure imgb0001
    Figure imgb0013
    A step of restoring information relating to the category of the vehicle, at the level of a payment terminal 8 located upstream of the barrier. This information will indicate the amount to be paid by the user, as well as possibly the category of his vehicle. It is understood that each payment terminal is connected to the centralized server, which is hosted on the cloud, and can therefore receive information concerning the category of the vehicle. This restitution of information is rapid and takes place within a period of less than a second, and preferably within a period of 100 ms.
  • Figure imgb0001
    Figure imgb0015
    A payment step at said terminal, for example by means of cash or a credit card.
  • Figure imgb0001
    Figure imgb0017
    A step of tilting the barrier to the open position from its closed position, when the amount has been paid.

Le principe d'un procédé de gestion selon l'invention, est qu'il s'appuie sur une image du véhicule et sur une mesure de sa hauteur, et non plus sur l'acquisition d'une image de la plaque d'immatriculation du véhicule, qui peut être une source d'erreur. En effet, si un motard se présente avec son véhicule 2 roues au niveau de la barrière 2, et si une automobile est placée juste derrière lui, les procédés actuellement mis en œuvre risquent de prendre en compte la plaque d'immatriculation de ce véhicule, et le motard va alors devoir s'acquitter d'une somme forfaitaire correspondant à un véhicule automobile.The principle of a management method according to the invention is that it is based on an image of the vehicle and on a measurement of its height, and no longer on the acquisition of an image of the license plate of the vehicle, which can be a source of error. Indeed, if a motorcyclist presents himself with his 2-wheeled vehicle at the level of the barrier 2, and if a car is placed just behind him, the methods currently implemented risk taking into account the license plate of this vehicle, and the biker will then have to pay a lump sum corresponding to a motor vehicle.

Deux possibilités s'offrent à lui :

  • Soit il refuse de payer cette somme erronée, et il fait alors appel à une personne habilitée de la station de péage pour régulariser la situation. Il va lors immobiliser le trafic pendant quelques minutes,
  • Soit il paie la somme erronée, et régularise la situation ultérieurement avec des personnes de l'entreprise chargée de gérer les paiements à la station de péage, en réclamant un remboursement de la partie de la somme indûment acquittée.
Two possibilities are available to him:
  • Either he refuses to pay this erroneous sum, and he then calls on an authorized person at the toll station to regularize the situation. It will then immobilize traffic for a few minutes,
  • Either he pays the incorrect amount, and regularizes the situation later with people from the company responsible for managing payments at the toll station, by claiming a refund of the part of the amount unduly paid.

Dans les deux cas, les situations sont consommatrices de temps, et sont coûteuses.In both cases, the situations are time-consuming, and costly.

En s'appuyant sur une image du véhicule et sur une mesure de sa hauteur, les risques d'erreur sur l'identification de la catégorie du véhicule sont quasiment nuls avec un procédé de gestion selon l'invention.By relying on an image of the vehicle and on a measurement of its height, the risks of error in identifying the category of the vehicle are practically nil with a management method according to the invention.

Claims (10)

  1. A method for managing the passage of a vehicle (7) through a toll station (1) of a road, said station (1) being passed through by at least one lane (3) and each of said lanes (3) having a barrier (2) able to go from a closed position preventing a vehicle from passing to an open position allowing said vehicle to pass, said method including the following steps:
    - A step for acquiring at least one image of the vehicle arriving in a lane (3) of the toll station (1) at the barrier (2), by means of an image acquisition system (4) placed near said lane (3),
    - A step for determining a parameter representative of the height of the vehicle,
    - A step for sending said at least one image and said parameter to at least one server hosted on the Internet,
    - A step for identifying the category of the vehicle using software located on said at least one server and able to process said at least one image and said parameter in order to retrieve information relative to the category of the vehicle, said software being based on a method consisting of:
    - Extracting the characteristics of each image from each category of vehicles of an image database processed a priori by people in order to model the border separating the different categories of vehicles,
    - For each input image, extracting its characteristics, then comparing them to those of the different categories extracted in the previous step before returning its category,
    - A step for retrieving information relative to the vehicle category, at a payment terminal (8) located upstream of the barrier (2),
    - A step for payment at said terminal (8),
    - A step for switching the barrier (2) to the open position from its closed position once the required amount has been paid.
  2. The management method according to claim 1, characterized in that the step for acquiring at least one image of the vehicle is carried out using a camera (4) placed near the barrier (2) and in front of the vehicle (7) presenting itself at the barrier (2).
  3. The management method according to claim 2, characterized in that the camera (4) is able to acquire an image having a resolution greater than 244x244.
  4. The management method according to any one of claims 1 to 3, characterized in that the step for acquiring the parameter is a step for direct measurement of the height of the vehicle (7), carried out using at least one optical sensor (5, 6).
  5. The management method according to claim 4, characterized in that the step for measuring the height of the vehicle is carried out using two optical sensors (5, 6) placed on either side of the vehicle (7) upstream of the barrier (2).
  6. The management method according to any one of claims 1 to 5, characterized in that it comprises a step for developing five different categories of vehicle, a first category corresponding to light vehicles, a second category corresponding to intermediate vehicles, a third category corresponding to heavy vehicles and other vehicles with two axles, a fourth category corresponding to heavy vehicles and other vehicles with three axles, a fifth category corresponding to motorcycles, side cars and trikes, and in that said management method retrieves information making it possible to classify each vehicle (7) in one of these five categories.
  7. The management method according to any one of claims 1 to 6, characterized in that the step for retrieving information relative to the category of the vehicle (7) takes place less than 100 ms after the step for sending said at least one image and said parameter.
  8. The management method according to claim 7, characterized in that the step for retrieving the information relative to the category of the vehicle (7) takes place 50 ms after the step for sending said at least one image and said parameter.
  9. A management device for carrying out a management method according to any one of claims 1 to 8, said device comprising an image acquisition system (4) intended to acquire at least one image of the vehicle (7), at least one optical sensor (5, 6) intended to measure the height of the vehicle, a payment terminal (8) and at least one server hosted on the Internet and comprising software able to process the image of the vehicle and the information relative to the height of the vehicle (7), then to send said terminal (8) information relative to the category of the vehicle (7), said software basing itself on a method consisting in:
    - Extracting the characteristics of each image from each category of vehicles of an image database processed a priori by people in order to model the border separating the different categories of vehicles,
    - For each input image, extracting its characteristics, then comparing them to those of the different categories extracted in the previous step before returning its category.
  10. The management device according to claim 9, characterized in that it comprises transmission means able to convey the various information between the assembly constituted by the image acquisition system (4) and said at least one sensor (5, 6), and the server, and transmission means between said server and the payment terminal (8).
EP19159523.0A 2018-02-26 2019-02-26 Method for managing the passage of a vehicle through a toll station of a road Active EP3531392B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
FR1851647A FR3078429B1 (en) 2018-02-26 2018-02-26 PROCESS FOR MANAGING THE PASSAGE OF A VEHICLE TO A ROAD TOLL STATION

Publications (2)

Publication Number Publication Date
EP3531392A1 EP3531392A1 (en) 2019-08-28
EP3531392B1 true EP3531392B1 (en) 2022-01-19

Family

ID=62222928

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19159523.0A Active EP3531392B1 (en) 2018-02-26 2019-02-26 Method for managing the passage of a vehicle through a toll station of a road

Country Status (4)

Country Link
EP (1) EP3531392B1 (en)
ES (1) ES2908738T3 (en)
FR (1) FR3078429B1 (en)
PT (1) PT3531392T (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI772700B (en) * 2019-10-29 2022-08-01 財團法人資訊工業策進會 Image recognition system and updating method thereof

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3140650B2 (en) * 1995-02-22 2001-03-05 三菱重工業株式会社 Vehicle type identification device
KR100243317B1 (en) * 1997-04-18 2000-03-02 윤종용 Car classification equipment
JP2001236531A (en) * 2000-02-21 2001-08-31 Toshiba Corp Device and method for issuing pass and recording medium
FR2903519B1 (en) * 2006-07-07 2008-10-17 Cs Systemes D Information Sa AUTOMOTIVE VEHICLE CLASSIFICATION SYSTEM
JP2017182404A (en) * 2016-03-30 2017-10-05 三菱重工メカトロシステムズ株式会社 Control device, control method, and program
JP6750967B2 (en) * 2016-06-09 2020-09-02 株式会社東芝 Vehicle type identification device and vehicle type identification method

Also Published As

Publication number Publication date
FR3078429B1 (en) 2021-02-12
EP3531392A1 (en) 2019-08-28
PT3531392T (en) 2022-03-31
ES2908738T3 (en) 2022-05-03
FR3078429A1 (en) 2019-08-30

Similar Documents

Publication Publication Date Title
US11770681B2 (en) Communications hub for crash event detection, response, and reporting system
US10296794B2 (en) On-demand artificial intelligence and roadway stewardship system
CN109800633B (en) Non-motor vehicle traffic violation judgment method and device and electronic equipment
AU2019235551B2 (en) On-demand artificial intelligence and roadway stewardship system
JP4567943B2 (en) Control method for use in toll determination system
KR101428011B1 (en) Method for Recognizing Vehicle Information of Vehicle Black Box and System thereof
KR101819568B1 (en) The method for operating a parking management system according to recognition of electric vehicle and Hi-pass
EP3531392B1 (en) Method for managing the passage of a vehicle through a toll station of a road
US20240161266A1 (en) Remote verification of image collection equipment for crash event detection, response, and reporting systems
JP6515726B2 (en) Vehicle identification device and vehicle identification system provided with the same
JP6524846B2 (en) Vehicle identification device and vehicle identification system provided with the same
KR102041188B1 (en) Accident Vehicle Tow Position Notification System
JP7219771B2 (en) Violator Identification Device, Violator Identification System, Violator Identification Method, and Program
FR2903519A1 (en) Motor vehicle classification system for tariffication and collection of toll fee, has video camera for discriminating vehicles from images captured upstream of passage channel and transmitting output data of vehicles to computer
CN117831307A (en) Road vehicle identification system and method
FR2951676A1 (en) DEVICE FOR PROTECTING A MOTOR VEHICLE
FR3056325A1 (en) METHOD FOR DETERMINING AN ASSEMBLY DIMENSION OF A VEHICLE EQUIPPED WITH AN EXTERNAL LOAD
FR3096016A1 (en) Method of avoiding collision of a vehicle with an obstacle traveling in the opposite direction
FR3083195A1 (en) DISPLAY DEVICE FOR DRIVING AID
CN109637120A (en) The overweight method persuaded to return of toll station lorry based on Internet technology
KR20230008484A (en) Apparatus and method for evaluating the management status of pedestrian paths according to obstacles using image deep learning algorithm
JP2024126199A (en) Information processing device, server and program
EP4214655A2 (en) System for delivering an order at a collection point
BE1023888B1 (en) BORDER INSPECTION WITH AERIAL CAMERAS
JPH0142031B2 (en)

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20191219

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: CYCLOPE.AI

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20210511

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20210920

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602019010953

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1464244

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220215

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: FRENCH

REG Reference to a national code

Ref country code: PT

Ref legal event code: SC4A

Ref document number: 3531392

Country of ref document: PT

Date of ref document: 20220331

Kind code of ref document: T

Free format text: AVAILABILITY OF NATIONAL TRANSLATION

Effective date: 20220324

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2908738

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20220503

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20220119

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1464244

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220419

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220226

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220419

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220420

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602019010953

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220519

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20220228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220226

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

26N No opposition filed

Effective date: 20221020

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220228

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220226

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220226

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220901

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220228

PGRI Patent reinstated in contracting state [announced from national office to epo]

Ref country code: IT

Effective date: 20220228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220228

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20230226

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230226

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230226

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PT

Payment date: 20240220

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20190226

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20240228

Year of fee payment: 6

Ref country code: FR

Payment date: 20240222

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20240328

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119