[go: up one dir, main page]

EP1391681A1 - Method and device for real time ground reconnaissance - Google Patents

Method and device for real time ground reconnaissance Download PDF

Info

Publication number
EP1391681A1
EP1391681A1 EP03018450A EP03018450A EP1391681A1 EP 1391681 A1 EP1391681 A1 EP 1391681A1 EP 03018450 A EP03018450 A EP 03018450A EP 03018450 A EP03018450 A EP 03018450A EP 1391681 A1 EP1391681 A1 EP 1391681A1
Authority
EP
European Patent Office
Prior art keywords
measurement data
image
reconnaissance
terrain
receiver
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP03018450A
Other languages
German (de)
French (fr)
Other versions
EP1391681B1 (en
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Diehl Defence GmbH and Co KG
Original Assignee
Diehl Munitionssysteme GmbH and Co KG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Diehl Munitionssysteme GmbH and Co KG filed Critical Diehl Munitionssysteme GmbH and Co KG
Publication of EP1391681A1 publication Critical patent/EP1391681A1/en
Application granted granted Critical
Publication of EP1391681B1 publication Critical patent/EP1391681B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F41WEAPONS
    • F41GWEAPON SIGHTS; AIMING
    • F41G3/00Aiming or laying means
    • F41G3/02Aiming or laying means using an independent line of sight

Definitions

  • the invention relates to a method for real-time terrain reconnaissance according to the Preamble of claim 1 and an apparatus for performing this Method according to the preamble of claim 7.
  • a method for real-time terrain surveillance using a sensor and a The device for performing this method is in DE 33 13 648 C2 described.
  • DE 41 04 800 C2 discloses a device for real-time terrain reconnaissance by means of at least one sensor, which is a load body from a carrier projectile according to Art a submunition is transferable and its information to a relay remote receiving station are transferable.
  • the at least one sensor and that Relays are load bodies of an artillery carrier projectile equipped with descent braking means designed to fire after a target area to be verified can be released from the carrier projectile.
  • the relay is with a brake fluid for equipped with a significantly lower sinking speed than the rotating one and that Target area spirally constricting scanning sensor.
  • a reconnaissance device with a sensor unit that is used to detect and Localization of targets is known from EP 0 800 052 A2.
  • This known reconnaissance facility is provided in an artillery storey.
  • the Reconciliation device is connected to a buoyancy device that between one in the artillery storey to save space and one active state released from the artillery storey can be changed.
  • the Buoyancy device serves to provide the reconnaissance device during a relative long period of magnitude to ten minutes over a target or Target area, for the detection and localization of the same, at an appropriate height to keep.
  • the reconnaissance sensor system has an optronic sensor and a high frequency sensor, both of which are essentially vertical but vertical installed in the drone opposite at a small angle and around the Vertical at least by a certain arc length, preferably all around, are pivotable so that a potential recorded in the overflown terrain Target object in different spectral ranges and directions - preferably briefly successively from opposite directions - grasped and in this way Weather-independent, sharp-contoured sensor information is obtained and transmitted via radio a ground control station can be supplied.
  • the invention has for its object a method and an apparatus to create the type mentioned, wherein to transmit the image signals and the Measurement signals only a comparatively small wall is required.
  • digitized image and measurement data signals from the reconnaissance missile are used transmitted to the receiver of the ground station.
  • This has the advantage that further methods such as data compression and / or data encryption-im Contrary to the transmission of analog signals - are easy to implement.
  • a small percentage is used for the transmission of the digitized measurement data signals the pixel of the image to be transmitted is used.
  • the transfer of the digitized image signals are expediently carried out line by line.
  • Each will Image line preferably provided with a sub-synchronization word that it for example a digitized graphics card of a decoder of the receiver Ground station enables line synchronization to be carried out.
  • a main synchronization word be used by which the digital graphics card of the Receiver can recognize the image synchronization.
  • the data in the Measurement data interspersed with image data, the position of which is known, such as pixels treated and thus also shown. This is possible because the measurement data change almost continuously and therefore do not differ in the image display differ.
  • FIG. 1 schematically shows a reconnaissance missile 10 in a block diagram with a transmitting antenna 12, a relay station 14 with a receiving antenna 16 and with a transmitting antenna 18, and a ground station 20 with a receiving antenna 22.
  • the ground station 20 has a receiver 24 and a decoder 26 which n connection with Figure 2 are described below.
  • Figure 1 illustrates schematically the data connection between the reconnaissance missile 10 and the Ground station 20 via relay station 14.
  • the pixel signals Pik are input into an encoder 30.
  • the reconnaissance missile 10 (see FIG. 1) has one besides the camera 28 Sensor device 32 for acquiring measurement data Ai.
  • Figure 2 are exemplary Measurement data A1, A2, A14 and A14 clarified.
  • the measurement data of the sensor device 32 are entered into an encoder 34 which is connected to the encoder 30 of the camera 28 connected is.
  • the encoder 30 has an output 36 at which a signal matrix 38 is given, as is exemplified in Figure 2.
  • This signal matrix 38 i.e. the corresponding frame structure is entered into a transmitter 40 and by the corresponding transmission antenna 12 (via a relay station not shown in FIG. 2 14 - sh. Figure 1 -) wirelessly transmitted to the ground station 20.
  • the receiving antenna of the ground station 20 is also designated in FIG.
  • the Receiving antenna 22 is connected to receiver 24 as in connection above has been mentioned with Figure 1.
  • the receiver 24 is via a bit synchronizer 40 connected to the decoder 26 already mentioned in connection with FIG. 1.
  • the Decoder 26 has an image output 42, measurement data outputs 44 and an output 46, to which an interface 48 for measurement data selection is connected.
  • the interface 48 is connected to a device 50 for displaying the measurement data.
  • To the Measurement data outputs 44 of the decoder 26 are connected to a measurement data PC 52.
  • An image data interface 54 is connected to the image output 42 of the decoder 26, which is connected to a digital graphics card 56.
  • the arrow 58 between the Image data interface 54 and the digital graphics card 56 schematically illustrate the Horizontal synchronization and the arrow 60 the vertical synchronization.
  • the arrow Pl, 1 between the image data interface and the digital graphics card with DSP (digital signal processor) illustrates this further above in connection with the camera 28 specified pixel 1 of the first image line.
  • the digital graphics card 56 therefore shows in addition a corresponding picture of the area to be cleared the measurement data recorded simultaneously by the reconnaissance missile.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Arrangements For Transmission Of Measured Signals (AREA)
  • Vehicle Body Suspensions (AREA)
  • Radio Relay Systems (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The method involves an aircraft acquiring an image of a terrain using a camera, transmitting corresponding image signals wirelessly to a receiver in a ground station and simultaneously acquiring measurement data by sensor device and transmitting the data to the receiver. The image signals and measurement data are digitized, whereby a defined small percentage of the pixels of the terrain image is used to transmit the digitized measurement data. The method involves a reconnaissance aircraft acquiring an image of the subject terrain using a camera (28) and transmitting the corresponding image signals wirelessly to a receiver (24) in a ground station and simultaneously acquiring measurement data by sensor device (32) and simultaneously transmitting the data to the receiver. The image signals and measurement data are digitized, whereby a defined small percentage of the pixels of the terrain image is used to transmit the digitized measurement data. An independent claim is also included for a device for real-time terrain reconnaissance.

Description

Die Erfindung betrifft ein Verfahren zur Echtzeit-Geländeaufklärung gemäß dem Oberbegriff des Anspruches 1 und eine Vorrichtung zur Durchführung dieses Verfahrens gemäß dem Oberbegriff des Anspruches 7.The invention relates to a method for real-time terrain reconnaissance according to the Preamble of claim 1 and an apparatus for performing this Method according to the preamble of claim 7.

Üblicherweise wird zur Echtzeit-Geländeaufklärung und zum Erfassen von Meßdaten wie der Lufttemperatur, der Windrichtung usw. eine kombinierte Bild- und Tonübertragung mit analogen Signalen vorgenommen. Um Meßdaten wie die Lufttemperatur o.dgl. beispielsweise aus einem Geschoß oder einem Flugkörper zusätzlich zu den Bildsignalen des aufzuklärenden Geländes vom Aufklärungs-Flugkörper zu einem Empfänger einer Bodenstation zu übertragen, kann der Tonträger benutzt werden, indem die quasi skalaren Meßdaten diesem aufmoduliert werden. Das ist jedoch nur mit einer eingeschränkten Bandbreite von ca. 40 kBit/sec bei NRZ-Daten (non return to zero), d.h. bei gängigen bipolaren, binär kodierten Digitalsignalen möglich. Eine andere Möglichkeit besteht darin, für die Bildsignalübertragung und für die Meßdaten-Signalübertragung zwei voneinander verschiedene Trägerfrequenzen zu verwenden. Die Verwendung von zwei voneinander verschiedenen Trägerfrequenzen stellt jedoch eine Verschwendung der nur eingeschränkt zur Verfügung stehenden Frequenzbänder dar. Die Verwendung zweier getrennter Trägerfrequenzen bedingt außerdem einen erheblichen Aufwand, weil für diese voneinander verschiedenen Trägerfrequenzen beispielsweise geeignete Antennen erforderlich sind.Usually, real-time terrain surveillance and the acquisition of measurement data such as air temperature, wind direction, etc. a combined image and Sound transmission made with analog signals. To measure data like that Air temperature or the like for example from a floor or a missile in addition to the image signals from the reconnaissance missile The sound carrier can transmit to a receiver of a ground station be used by modulating the quasi-scalar measurement data on it. The is, however, only with a restricted bandwidth of approx. 40 kbit / sec for NRZ data (non return to zero), i.e. with common bipolar, binary coded digital signals possible. Another possibility is for the image signal transmission and for the measurement data signal transmission to two different carrier frequencies use. The use of two different carrier frequencies however, is a waste of the limited available Frequency bands represent the use of two separate carrier frequencies also a considerable effort because they differ from each other Carrier frequencies, for example, suitable antennas are required.

Ein Verfahren zur Echtzeit-Geländeaufklärung mittels eines Sensors sowie eine Einrichtung zur Durchführung dieses Verfahrens ist in der DE 33 13 648 C2 beschrieben.A method for real-time terrain surveillance using a sensor and a The device for performing this method is in DE 33 13 648 C2 described.

Eine endphasen-korrigierbare Suchzünder-Munition und ein Verfahren zum Bekämpfen gepanzerter Zielobjekte mit einer solchen Munition ist aus der DE 35 16 673 C2 bekannt.An end-phase correctable search fuse ammunition and a method for Combating armored target objects with such ammunition is known from DE 35 16 673 C2 known.

Die DE 41 04 800 C2 offenbart eine Einrichtung zur Echtzeit-Geländeaufklärung mittels wenigstens eines Sensors, der als Lastkörper von einem Trägerprojektil nach Art einer Submunition verbringbar ist und dessen Informationen über ein Relais an eine abgesetzte Empfangsstation übertragbar sind. Der mindestens eine Sensor und das Relais sind als mit Abstiegs-Bremsmitteln ausgestattete Lastkörper eines Artillerie-Trägerprojektiles ausgelegt, die nach Verschuß über ein zu verifizierendes Zielgebiet aus dem Trägerprojektil freigebbar sind. Das Relais ist mit einem Bremsmittel für wesentlich geringere Sinkgeschwindigkeit ausgestattet als der rotierend und dabei das Zielgebiet spiralförmig einengend abtastende Sensor.DE 41 04 800 C2 discloses a device for real-time terrain reconnaissance by means of at least one sensor, which is a load body from a carrier projectile according to Art a submunition is transferable and its information to a relay remote receiving station are transferable. The at least one sensor and that Relays are load bodies of an artillery carrier projectile equipped with descent braking means designed to fire after a target area to be verified can be released from the carrier projectile. The relay is with a brake fluid for equipped with a significantly lower sinking speed than the rotating one and that Target area spirally constricting scanning sensor.

Eine Aufklärungseinrichtung mit einer Sensoreinheit, die zum Detektieren und Lokalisieren von Zielen vorgesehen ist, ist aus der EP 0 800 052 A2 bekannt. Diese bekannte Aufklärungseinrichtung ist in einem Artilleriegeschoß vorgesehen. Die Aufklärungseinrichtung ist mit einer Auftriebseinrichtung verbunden, die zwischen einem im Artilleriegeschoß platzsparend zusammengelegten Ruhezustand und einem aus dem Artilleriegeschoß freigegebenen Aktivzustand veränderbar ist. Die Auftriebseinrichtung dient dazu, die Aufklärungseinrichtung während einer relativ langen Zeitspanne von größenordnungsmäßig bis zehn Minuten über einem Ziel bzw. Zielgebiet, zur Detektion und Lokalisierung desselben, auf einer entsprechenden Höhe zu halten.A reconnaissance device with a sensor unit that is used to detect and Localization of targets is known from EP 0 800 052 A2. This known reconnaissance facility is provided in an artillery storey. The Reconciliation device is connected to a buoyancy device that between one in the artillery storey to save space and one active state released from the artillery storey can be changed. The Buoyancy device serves to provide the reconnaissance device during a relative long period of magnitude to ten minutes over a target or Target area, for the detection and localization of the same, at an appropriate height to keep.

Eine preiswerte und kleinbauende, vor allem aber leistungsfähige und allwettertaugliche Aufklärungssensorik für eine kleine Aufklärungs-Drohne ist aus der DE 197 14 539 A1 bekannt. Die Aufklärungssensorik weist einen Optronik-Sensor und einen Hochfrequenz-Sensor auf, die beide im wesentlichen vertikal aber der Vertikalen gegenüber um einen kleinen Winkel angestellt in die Drohne eingebaut und um die Vertikale wenigstens um eine gewisse Bogenlänge, vorzugsweise rundum, verschwenkbar sind, so daß ein im überflogenen Gelände erfaßtes potentielles Zielobjekt in unterschiedlichen Spektralbereichen und Richtungen - vorzugsweise kurz nacheinander aus einander entgegengesetzten Richtungen - erfaßt und auf diese Weise wetterunabhängig konturenscharfe Sensorinformationen gewonnen und über Funk an eine Bodenkontrollstation geliefert werden können.An inexpensive and small, but above all powerful and all-weather reconnaissance sensors for a small reconnaissance drone is out of the DE 197 14 539 A1 known. The reconnaissance sensor system has an optronic sensor and a high frequency sensor, both of which are essentially vertical but vertical installed in the drone opposite at a small angle and around the Vertical at least by a certain arc length, preferably all around, are pivotable so that a potential recorded in the overflown terrain Target object in different spectral ranges and directions - preferably briefly successively from opposite directions - grasped and in this way Weather-independent, sharp-contoured sensor information is obtained and transmitted via radio a ground control station can be supplied.

Der Erfindung liegt die Aufgabe zugrunde, ein Verfahren und eine Vorrichtung der eingangs genannten Art zu schaffen, wobei zur Übertragung der Bildsignale und der Meßsignale nur ein vergleichsweise kleiner Aurwand erforderlich ist.The invention has for its object a method and an apparatus to create the type mentioned, wherein to transmit the image signals and the Measurement signals only a comparatively small wall is required.

Diese Aufgabe wird verfahrensgemäß durch die Merkmale des Anspruches 1 und vorrichtungsgemäß durch die Merkmale des Anspruches 7 gelöst. Bevorzugte Aus- bzw. Weiterbildungen des erfindungsgemäßen Verfahrens sind in den Ansprüchen 2 bis 6 und bevorzugte Aus- bzw. Weiterbildungen der erfindungsgemäßen Vorrichtung sind in den Ansprüchen 8 bis 11 gekennzeichnet. This object is achieved according to the method by the features of claims 1 and solved according to the device by the features of claim 7. Preferred training or further developments of the method according to the invention are in claims 2 to 6 and preferred embodiments of the device according to the invention characterized in claims 8 to 11.

Erfindungsgemäß werden digitalisierte Bild- und Meßdaten-Signale vom Aufklärungs-Flugkörper zum Empfänger der Bodenstation übertragen. Das hat den Vorteil, daß weitere Verfahren wie eine Datenkompression und/oder eine Datenverschlüsselung-im Gegensatz zur Übertragung analoger Signale - leicht implementierbar sind.According to the invention, digitized image and measurement data signals from the reconnaissance missile are used transmitted to the receiver of the ground station. This has the advantage that further methods such as data compression and / or data encryption-im Contrary to the transmission of analog signals - are easy to implement.

Für die Übertragung der digitalisierten Meßdaten-Signale wird ein geringer Prozentsatz der Pixel des jeweils zu übertragenden Bildes verwendet. Die Übertragung der digitalisierten Bildsignale erfolgt zweckmäßigerweise zeilenweise. Dabei wird jede Bildzeile vorzugsweise mit einem Unter-Synchronisationswort versehen, das es beispielsweise einer digitalisierten Grafikkarte eines Decoders des Empfängers der Bodenstation ermöglicht, eine Zeilensynchronisation durchzuführen. Außerdem kann in einer bestimmten Bildzeile, vorzugsweise in der letzten Bildzeile, ein Haupt-Synchronisationswort verwendet werden, durch das die digitale Grafikkarte des Empfängers die Bildsynchronisation erkennen kann. Desweiteren ist es möglich, einen Zeilenzähler zum Empfänger der Bodenstation mit zu übertragen.A small percentage is used for the transmission of the digitized measurement data signals the pixel of the image to be transmitted is used. The transfer of the digitized image signals are expediently carried out line by line. Each will Image line preferably provided with a sub-synchronization word that it for example a digitized graphics card of a decoder of the receiver Ground station enables line synchronization to be carried out. Besides, can in a certain picture line, preferably in the last picture line, a main synchronization word be used by which the digital graphics card of the Receiver can recognize the image synchronization. Furthermore it is possible to get one Line counter to be transmitted to the receiver of the ground station.

Bei der Auswertung der Signale und der Darstellung der Bilddaten werden die in die Bilddaten eingestreuten Meßdaten, deren Position jeweils bekannt ist, wie Pixel behandelt und somit ebenfalls dargestellt. Das ist möglich, weil sich die Meßdaten quasi fortlaufend ändern und sich dadurch in der Bilddarstellung von dieser nicht unterscheiden.When evaluating the signals and displaying the image data, the data in the Measurement data interspersed with image data, the position of which is known, such as pixels treated and thus also shown. This is possible because the measurement data change almost continuously and therefore do not differ in the image display differ.

Aufgrund der bekannten Position der Meßdaten im jeweiligen Bild, d.h. innerhalb der Bilddaten, ist eine Extraktion der Meßdaten aus dem gesamten Datenstrom in vorteilhafter Weise einfach möglich.Due to the known position of the measurement data in the respective image, i.e. within the Image data is an extraction of the measurement data from the entire data stream in easily possible advantageously.

Ein Ausführungsbeispiel der erfindungsgemäßen Vorrichtung zur Echtzeit-Geländeaufklärung sowie ein Blockdiagramm des Rahmenaufbaus und der Bild- und Meßdaten-Extraktion sind in der Zeichnung dargestellt und werden nachfolgend beschrieben.An embodiment of the device according to the invention for real-time terrain surveillance and a block diagram of the frame structure and the picture and Measurement data extraction are shown in the drawing and are shown below described.

Es zeigen:

Figur 1
eine schematische Blockdarstellung der Vorrichtung zur Echtzeit-Geländeaufklärung,und
Figur 2
eine Blockdiagrammdarstellung des Rahmenaufbaus der Bild- und Meßdaten-Extraktion der Vorrichtung gemäß Figur 1.
Show it:
Figure 1
is a schematic block diagram of the device for real-time terrain surveillance, and
Figure 2
2 shows a block diagram representation of the frame structure of the image and measurement data extraction of the device according to FIG. 1.

Figur 1 zeigt schematisch in einer Blockdarstellung einen Aufklärungs-Flugkörper 10 mit einer Sendeantenne 12, eine Relaisstation 14 mit einer Empfangsantenne 16 und mit einer Sendeantenne 18, sowie eine Bodenstation 20 mit einer Empfangsantenne 22. Die Bodenstation 20 weist einen Empfänger 24 und einen Decoder 26 auf, die nachfolgend n Verbindung mit Figur 2 beschrieben werden. Die Figur 1 verdeutlicht schematisch die Datenverbindung zwischen dem Aufklärungs-Flugkörper 10 und der Bodenstation 20 über die Relaisstation 14.FIG. 1 schematically shows a reconnaissance missile 10 in a block diagram with a transmitting antenna 12, a relay station 14 with a receiving antenna 16 and with a transmitting antenna 18, and a ground station 20 with a receiving antenna 22. The ground station 20 has a receiver 24 and a decoder 26 which n connection with Figure 2 are described below. Figure 1 illustrates schematically the data connection between the reconnaissance missile 10 and the Ground station 20 via relay station 14.

Figur 2 verdeutlicht in einer Blockdarstellung den Rahmenaufbau und die Bild- und Meßdaten-Extraktion der erfindungsgemäßen Vorrichtung zur Echtzeit-Geländeaufklärung mit einer Kamera 28 eines Aufklärungs-Flugkörpers 10 gemäß Figur 1. Die Kamera 28 generiert Pixel Pik mit

Pl,l =
Pixel 1 der ersten Bildzeile
Pl,n =
Pixel n der ersten Zeile,
Pm,l =
Pixel 1 der m-ten Zeile, und
Pm,n =
n-tes Pixel der m-ten Zeile.
FIG. 2 illustrates in a block diagram the frame structure and the image and measurement data extraction of the device according to the invention for real-time terrain reconnaissance with a camera 28 of a reconnaissance missile 10 according to FIG. 1. The camera 28 also generates pixel spades
Pl, l =
Pixel 1 of the first image line
Pl, n =
Pixel n of the first line,
Pm, l =
Pixel 1 of the mth line, and
Pm, n =
nth pixel of the mth line.

Die Pixelsignale Pik werden in einen Encoder 30 eingegeben.The pixel signals Pik are input into an encoder 30.

Der Aufklärungs-Flugkörper 10 (sh. Figur 1) weist außer der Kamera 28 eine Sensoreinrichtung 32 zum Erfassen von Meßdaten Ai auf. In Figur 2 sind beispielhaft Meßdaten A1, A2, A14 und A14 verdeutlicht. Die Meßdaten der Sensoreinrichtung 32 werden in einen Encoder 34 eingegeben, der mit dem Encoder 30 der Kamera 28 verbunden ist. Der Encoder 30 weist einen Ausgang 36 auf, an dem eine Signal-Matrix 38 gegeben ist, wie sie in Figur 2 beispielhaft verdeutlicht ist. Diese Signal-Matrix 38, d.h. der entsprechende Rahmenaufbau, wird in einen Sender 40 eingegeben und durch die entsprechende Sendeantenne 12 (über eine in Figur 2 nicht dargestellte Relaisstation 14 - sh. Figur 1 - ) an die Bodenstation 20 drahtlos übertragen. Mit der Bezugsziffer 22 ist auch in Figur 2 die Empfangsantenne der Bodenstation 20 bezeichnet. Die Empfangsantenne 22 ist mit dem Empfänger 24 verbunden, wie er oben in Verbindung mit Figur 1 erwähnt worden ist. Der Empfänger 24 ist über einen Bitsynchronizer 40 mit dem bereits in Verbindung mit Figur 1 erwähnten Decoder 26 verbunden. Der Decoder 26 weist einen Bildausgang 42, Meßdaten-Ausgänge 44 sowie einen Ausgang 46 auf, an den ein Interface 48 zur Meßdaten-Selektion angeschlossen ist. Das Interface 48 ist mit einer Einrichtung 50 zur Darstellung der Meßdaten verbunden. An die Meßdaten-Ausgänge 44 des Decoders 26 ist ein Meßdaten-PC 52 angeschlossen.The reconnaissance missile 10 (see FIG. 1) has one besides the camera 28 Sensor device 32 for acquiring measurement data Ai. In Figure 2 are exemplary Measurement data A1, A2, A14 and A14 clarified. The measurement data of the sensor device 32 are entered into an encoder 34 which is connected to the encoder 30 of the camera 28 connected is. The encoder 30 has an output 36 at which a signal matrix 38 is given, as is exemplified in Figure 2. This signal matrix 38, i.e. the corresponding frame structure is entered into a transmitter 40 and by the corresponding transmission antenna 12 (via a relay station not shown in FIG. 2 14 - sh. Figure 1 -) wirelessly transmitted to the ground station 20. With the reference number 22 the receiving antenna of the ground station 20 is also designated in FIG. The Receiving antenna 22 is connected to receiver 24 as in connection above has been mentioned with Figure 1. The receiver 24 is via a bit synchronizer 40 connected to the decoder 26 already mentioned in connection with FIG. 1. The Decoder 26 has an image output 42, measurement data outputs 44 and an output 46, to which an interface 48 for measurement data selection is connected. The interface 48 is connected to a device 50 for displaying the measurement data. To the Measurement data outputs 44 of the decoder 26 are connected to a measurement data PC 52.

An den Bildausgang 42 des Decoders 26 ist ein Bilddaten-Interface 54 angeschlossen, das mit einer digitalen Grafikkarte 56 verbunden ist. Der Pfeil 58 zwischen dem Bilddaten-Interface 54 und der digitalen Grafikkarte 56 verdeutlicht schematisch die Horizontal-Synchronisation und der Pfeil 60 die Vertikal-Synchronisation. Der Pfeil Pl,1 zwischen dem Bilddaten-Interface und der digitalen Grafikkarte mit DSP (digital signal processor) verdeutlicht das weiter oben in Verbindung mit der Kamera 28 angegebene Pixel 1 der ersten Bildzeile. Die digitale Grafikkarte 56 zeigt also neben dem entsprechenden Bild des aufzuklärenden Geländes auch ein entsprechendes Bild der vom Aufklärungs-Flugkörper gleichzeitig aufgenommenen Meßdaten. An image data interface 54 is connected to the image output 42 of the decoder 26, which is connected to a digital graphics card 56. The arrow 58 between the Image data interface 54 and the digital graphics card 56 schematically illustrate the Horizontal synchronization and the arrow 60 the vertical synchronization. The arrow Pl, 1 between the image data interface and the digital graphics card with DSP (digital signal processor) illustrates this further above in connection with the camera 28 specified pixel 1 of the first image line. The digital graphics card 56 therefore shows in addition a corresponding picture of the area to be cleared the measurement data recorded simultaneously by the reconnaissance missile.

Bezugsziffernliste:List of reference numerals:

1010
Aufklärungs-FlugkörperReconnaissance missiles
1212
Sendeantenne (von 10)Transmitting antenna (out of 10)
1414
Relaisstationrelay station
1616
Empfangsantenne (von 14)Receiving antenna (of 14)
1818
Sendeantenne (von 14)Transmitting antenna (from 14)
2020
Bodenstationground station
2222
Empfangsantenne (von 20)Receiving antenna (of 20)
2424
Empfänger (von 20)Recipients (of 20)
2626
Decoder (von 20)Decoder (of 20)
2828
Kamera (von 10)Camera (of 10)
3030
Encoder (für 28)Encoder (for 28)
3232
Sensoreinrichtung (von 10)Sensor device (out of 10)
3434
Encoder (von 32)Encoder (out of 32)
3636
Ausgang (von 30)Output (from 30)
3838
Signal-Matrix (an 36)Signal matrix (at 36)
4040
Bitsynchronizer (an 36)Bit synchronizer (to 36)
4242
Bildausgang (von 26)Image output (from 26)
4444
Meßdaten-Ausgänge (von 26)Measurement data outputs (from 26)
4646
Ausgang (von 26 für 48)Output (from 26 for 48)
4848
Interface (für 50)Interface (for 50)
5050
Einrichtung zur Meßdaten-DarstellungDevice for displaying measured data
5252
Meßdaten-PC (an 44)Measurement data PC (on 44)
5454
Bilddaten-Interface (für 56)Image data interface (for 56)
5656
digitale Grafikkartedigital graphics card
5858
Pfeil / Horizontalsynchronisation (zwischen 54 und 56)Arrow / horizontal synchronization (between 54 and 56)
6060
Pfeil / Vertikalsynchronisation (zwischen 54 und 56)Arrow / vertical synchronization (between 54 and 56)

Claims (10)

Verfahren zur Echtzeit-Geländeaufklärung, wobei mittels einer Kamera (28) eines Aufklärungs-Flugkörpers (10) ein Bild des aufzuklärenden Geländes aufgenommen wird und die entsprechenden Bildsignale drahtlos zu einem Empfänger (24) einer Bodenstation (20) übertragen werden, und wobei mittels einer Sensoreinrichtung (32) des Aufklärungs-Flugkörpers (10) gleichzeitig Meßdaten erfaßt und die entsprechenden Meßdatensignale simultan zum Empfänger (24) übertragen werden,
dadurch gekennzeichnet , daß die Bildsignale und die Meßdaten digitalisiert werden, wobei ein bestimmter kleiner Prozentsatz der Pixel des jeweiligen Gelände-Bildes für die Übertragung der digitalisierten Meßdatensignale verwendet werden.
Method for real-time terrain reconnaissance, wherein a camera (28) of a reconnaissance missile (10) records an image of the terrain to be reconnaissance and the corresponding image signals are transmitted wirelessly to a receiver (24) of a ground station (20), and wherein using a Sensor device (32) of the reconnaissance missile (10) simultaneously records measurement data and the corresponding measurement data signals are simultaneously transmitted to the receiver (24),
characterized in that the image signals and the measurement data are digitized, a certain small percentage of the pixels of the respective terrain image being used for the transmission of the digitized measurement data signals.
Verfahren nach Anspruch 1,
dadurch gekennzeichnet, daß die Übertragung der Bildsignale zeilenweise erfolgt.
Method according to claim 1,
characterized in that the transmission of the image signals takes place line by line.
Verfahren nach Anspruch 2,
dadurch gekennzeichnet, daß jede Bildzeile mit einem Unter-Synchronisationswort versehen wird.
Method according to claim 2,
characterized in that each picture line is provided with a sub-synchronization word.
Verfahren nach Anspruch 2 oder 3,
dadurch gekennzeichnet, daß in einer bestimmten Bildzeile, vorzugsweise in der letzten Bildzeile, ein Haupt-Synchronisationswort verwendet wird.
Method according to claim 2 or 3,
characterized in that a main synchronization word is used in a certain picture line, preferably in the last picture line.
Verfahren nach einem der Ansprüche 2 bis 4,
dadurch gekennzeichnet, daß zum Empfänger (24) ein Zeilenzähler mit übertragen wird.
Method according to one of claims 2 to 4,
characterized in that a line counter is also transmitted to the receiver (24).
Verfahren nach einem der Ansprüche 1 bis 5,
dadurch gekennzeichnet, daß die digitalisierten Bild- und Meßdatensignale über eine Relaisstation (14) zum Empfänger (24) der Bodenstation (20) übertragen werden.
Method according to one of claims 1 to 5,
characterized in that the digitized image and measurement data signals are transmitted via a relay station (14) to the receiver (24) of the ground station (20).
Vorrichtung zur Echtzeit-Geländeaufklärung, mit einer Kamera (28) eines Aufklärungs-Flugkörpers (10) zur Aufnahme des aufzuklärenden Geländes, und mit einer Sensoreinrichtung (32) des Aufklärungsflugkörpers (10) zum gleichzeitigen Erfassen von Meßdaten, wobei die dem Gelände entsprechenden Bildsignale und die den Meßdaten entsprechenden Meßdatensignale simultan drahtlos zu einem Empfänger (24) einer Bodenstation (20) übertragen werden,
dadurch gekennzeichnet, daß die Sensoreinrichtung (32) mit einem ersten Encoder (34) und daß die Kamera (28) mit einem zweiten Encoder (30) verbunden ist, wobei der erste Encoder (34) mit dem zweiten Encoder (30) derart zusammengeschaltet ist, daß ein bestimmter kleiner Prozentsatz der Pixel des jeweiligen Gelände-Bildes für die digitalisierten Meßdatensignale verwendet wird und daß der Empfänger (24) einen Decoder (26) mit einem Bildausgang (42) und Meßdaten-Ausgänge (44) aufweist.
Device for real-time terrain reconnaissance, with a camera (28) of a reconnaissance missile (10) for recording the terrain to be reconnaissance, and with a sensor device (32) of the reconnaissance missile (10) for simultaneous acquisition of measurement data, the image signals and corresponding to the terrain the measurement data signals corresponding to the measurement data are simultaneously transmitted wirelessly to a receiver (24) of a ground station (20),
characterized in that the sensor device (32) is connected to a first encoder (34) and that the camera (28) is connected to a second encoder (30), the first encoder (34) being connected to the second encoder (30) in this way that a certain small percentage of the pixels of the respective terrain image is used for the digitized measurement data signals and that the receiver (24) has a decoder (26) with an image output (42) and measurement data outputs (44).
Vorrichtung nach Anspruch 7,
dadurch gekennzeichnet, daß der Bildausgang (42) des Decoders (26) mit einer digitalen Grafikkarte (56) verbunden ist.
Device according to claim 7,
characterized in that the picture output (42) of the decoder (26) is connected to a digital graphics card (56).
Vorrichtung nach Anspruch 8,
dadurch gekennzeichnet, daß die digitale Grafikkarte (56) mit dem Bildausgang (42) des Decoders (26) mittels eines Bilddaten-Interfaces (54) zusammengeschaltet ist.
Device according to claim 8,
characterized in that the digital graphics card (56) is connected to the image output (42) of the decoder (26) by means of an image data interface (54).
Vorrichtung nach Anspruch 7,
dadurch gekennzeichnet, daß an die Meßdaten-Ausgänge (44) des Decoders (26) ein Meßdaten-PC (52) angeschlossen ist.
Device according to claim 7,
characterized in that a measurement data PC (52) is connected to the measurement data outputs (44) of the decoder (26).
EP03018450A 2002-08-20 2003-08-14 Method and device for real time ground reconnaissance Expired - Lifetime EP1391681B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE10238019A DE10238019A1 (en) 2002-08-20 2002-08-20 Method and device for real-time terrain surveillance
DE10238019 2002-08-20

Publications (2)

Publication Number Publication Date
EP1391681A1 true EP1391681A1 (en) 2004-02-25
EP1391681B1 EP1391681B1 (en) 2006-10-11

Family

ID=30775442

Family Applications (1)

Application Number Title Priority Date Filing Date
EP03018450A Expired - Lifetime EP1391681B1 (en) 2002-08-20 2003-08-14 Method and device for real time ground reconnaissance

Country Status (3)

Country Link
EP (1) EP1391681B1 (en)
AT (1) ATE342484T1 (en)
DE (2) DE10238019A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1637827A1 (en) * 2004-09-21 2006-03-22 Zona Deltaspace S.r.l. Ballistically launched, remote reconnaissance device
RU2578494C1 (en) * 2014-12-11 2016-03-27 федеральное государственное автономное образовательное учреждение высшего образования "Нижегородский государственный университет им. Н.И. Лобачевского" System for horizon targeting and video surveillance

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3313648A1 (en) * 1983-04-15 1984-10-18 Diehl GmbH & Co, 8500 Nürnberg Process for real-time terrain reconnaissance by means of a sensor and device for carrying out the process
DE3516673A1 (en) * 1985-05-09 1986-11-13 Diehl GmbH & Co, 8500 Nürnberg END-PHASE CORRECTABLE SEARCHED AMMUNITION AND METHOD FOR FIGHTING ARMORED TARGETS
US4860968A (en) * 1988-04-15 1989-08-29 The Boeing Company Communication link between moving bodies
EP0447080A1 (en) * 1990-03-10 1991-09-18 United Kingdom Atomic Energy Authority Reconnaissance device
DE4104800A1 (en) * 1991-02-16 1992-08-20 Diehl Gmbh & Co Real=time target field scanning system - uses sensor and relay released from carrier projectile fired over target field
EP0800052A2 (en) * 1996-04-04 1997-10-08 DIEHL GMBH & CO. Reconnaissance system
DE19714539A1 (en) * 1997-04-09 1998-10-15 Diehl Stiftung & Co Unmanned, air-borne reconnaissance drone
EP0915314A1 (en) * 1997-10-10 1999-05-12 AEROSPATIALE Société Nationale Industrielle Apparatus for guiding a flying device, especially a missile

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE510622C2 (en) * 1996-06-17 1999-06-07 Asea Brown Boveri filter Equipment
DE19737835C2 (en) * 1997-08-29 1999-07-15 Siemens Ag Method for compressing image information
FR2777729B1 (en) * 1998-04-15 2000-06-02 Sgs Thomson Microelectronics METHOD FOR ACQUIRING DATA ON A VIDEO SIGNAL
DE19818426C2 (en) * 1998-04-24 2000-06-21 Daimler Chrysler Ag Remote reconnaissance and targeting procedures
DE10119331A1 (en) * 2001-01-08 2002-08-01 Oerlikon Contraves Gmbh Procedures for inherent target clarification

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3313648A1 (en) * 1983-04-15 1984-10-18 Diehl GmbH & Co, 8500 Nürnberg Process for real-time terrain reconnaissance by means of a sensor and device for carrying out the process
DE3516673A1 (en) * 1985-05-09 1986-11-13 Diehl GmbH & Co, 8500 Nürnberg END-PHASE CORRECTABLE SEARCHED AMMUNITION AND METHOD FOR FIGHTING ARMORED TARGETS
US4860968A (en) * 1988-04-15 1989-08-29 The Boeing Company Communication link between moving bodies
EP0447080A1 (en) * 1990-03-10 1991-09-18 United Kingdom Atomic Energy Authority Reconnaissance device
DE4104800A1 (en) * 1991-02-16 1992-08-20 Diehl Gmbh & Co Real=time target field scanning system - uses sensor and relay released from carrier projectile fired over target field
EP0800052A2 (en) * 1996-04-04 1997-10-08 DIEHL GMBH & CO. Reconnaissance system
DE19714539A1 (en) * 1997-04-09 1998-10-15 Diehl Stiftung & Co Unmanned, air-borne reconnaissance drone
EP0915314A1 (en) * 1997-10-10 1999-05-12 AEROSPATIALE Société Nationale Industrielle Apparatus for guiding a flying device, especially a missile

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1637827A1 (en) * 2004-09-21 2006-03-22 Zona Deltaspace S.r.l. Ballistically launched, remote reconnaissance device
RU2578494C1 (en) * 2014-12-11 2016-03-27 федеральное государственное автономное образовательное учреждение высшего образования "Нижегородский государственный университет им. Н.И. Лобачевского" System for horizon targeting and video surveillance

Also Published As

Publication number Publication date
ATE342484T1 (en) 2006-11-15
DE10238019A1 (en) 2004-03-11
DE50305328D1 (en) 2006-11-23
EP1391681B1 (en) 2006-10-11

Similar Documents

Publication Publication Date Title
DE69631750T2 (en) OBJECT DETECTION DEVICE
DE4216828C2 (en) Earth observation procedures
DE69529941T2 (en) Missile simulator apparatus
DE2364084C2 (en) Device for addressing a specific area within a control field
DE69514560T2 (en) Method for evaluating the image quality of a radar with a synthetic aperture
DE19704080A1 (en) Mine detector
WO2017072048A1 (en) Method and device for tracking objects, in particular moving objects, in the three-dimensional space of imaging radar sensors
DE69703706T2 (en) REAL-TIME SIMULATION DEVICE
DE3305499A1 (en) COLLISION PREVENTION SYSTEM
EP1817613B1 (en) Method and satellite for recognising hot targets on the earth
EP1391681B1 (en) Method and device for real time ground reconnaissance
EP0742420B1 (en) Method for determining the roll position of a rotating flying object
DE2438837C3 (en) Device for suppressing echo signals
DE102019201374A1 (en) Method for operating several FMCW radar sensors in a radar network or multistatic radar, and a radar sensor designed for this
DE19818426C2 (en) Remote reconnaissance and targeting procedures
DE4031089A1 (en) Mine system
DE102007008853A1 (en) Illusion field detecting method for e.g. global positioning system receiver, involves providing reference periodic information, and comparing reference periodic information with periodic information contained in navigation signals
EP0888559A1 (en) Method and device for determining the position of moving objects
EP0222110A2 (en) Complementary device for simulators for shooting practice and manoeuvring
DE102019101127A1 (en) Process for processing data obtained by ultrasound
DE102007008856A1 (en) Satellite navigation receiver deceiving method for e.g. missile, involves transmitting received navigation signal as deception field signal at deception frequency by deception field end device
EP1526353A1 (en) Reconnaissance system for detecting targets and target movements
DE19829340A1 (en) Pilot training system
DE1957303C3 (en) Secondary radar interrogation-response system with additional antenna to suppress sidelobe interrogation
DE1541066C1 (en) Process for processing a sequence of electrical signals to be filtered

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

17P Request for examination filed

Effective date: 20040701

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: DIEHL BGT DEFENCE GMBH & CO.KG

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED.

Effective date: 20061011

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20061011

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20061011

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20061011

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20061011

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20061011

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20061011

Ref country code: IE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20061011

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REF Corresponds to:

Ref document number: 50305328

Country of ref document: DE

Date of ref document: 20061123

Kind code of ref document: P

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20070111

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20070111

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20070111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20070122

GBT Gb: translation of ep patent filed (gb section 77(6)(a)/1977)

Effective date: 20070117

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20070319

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
ET Fr: translation filed
REG Reference to a national code

Ref country code: IE

Ref legal event code: FD4D

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20070712

BERE Be: lapsed

Owner name: DIEHL BGT DEFENCE G.M.B.H. & CO.KG

Effective date: 20070831

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070831

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070831

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20061011

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070814

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20061011

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070814

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20061011

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20070412

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070831

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20150819

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20150820

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20151021

Year of fee payment: 13

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 50305328

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20160814

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20170428

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170301

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160831

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160814