RU2578194C1 - Method for panoramic television-computer monitoring (versions) - Google Patents

Abstract

FIELD: information technology.

SUBSTANCE: invention relates to television monitoring, which is computer system according to panoramic television scanning by made using the technology of charge coupled devices (CCD) single-line circular photodetector monochrome (black-and-white) or color image sensor, having several “circular” photosensitive lines. Result is achieved by using photodetector single-line circular monochromatic sensor or “low-line” circular colour sensor by mechanical scanning in perpendicular direction relative to fixed plane of panoramic image of lens.

EFFECT: technical result is maintaining (keeping unchanged) of elevation angle parameters and elimination of passive pixels.

2 cl, 7 dwg

Description

The group of inventions relates to television monitoring, which is performed by a computer system using the method of panoramic television scanning using technology made with charge coupled devices (CCD) of a single-line ring photodetector of a monochrome (black and white) image or a color sensor having several “ring” photosensitive lines.

The closest in technical essence to the claimed invention should be considered a method of panoramic television-computer monitoring [1], which consists in the fact that a television camera implemented on the basis of a two-dimensional matrix CCD photodetector is installed in a fixed position, image is captured in the television camera with a panoramic lens with an angular field of 360 degrees in azimuth, form an analog image signal of the observed space in a television camera, convert the analog video signal into a digital video signal, transmit the video signal of the panoramic panoramic image of the observed space via the interface to the server, record the digital video signal in the server’s RAM, selectively monitor the panoramic image stored in the server’s memory on the screens of two or more personal computers connected to the server by converting the panoramic television into the server images into a regular image, and one current “ring” frame is read from the server’s memory using there are n “rectangular” frames, the number of which satisfies the ratio:

where γ _g is the horizontal angle of the field of view in degrees observed by the operator of the image.

The disadvantage of the prototype of the monitoring method is the occurrence of circular viewing losses in the elevation parameter when a rectangular target of the photodetector is entered into the annular image of a panoramic lens.

If, to exclude losses in elevation, this ring image is inscribed in the target rectangle, then a CCD matrix with an increased number of elements (pixels) is required. Moreover, a significant part of the pixels is passive (useless), because It does not carry information about the observed plot, but is used forcibly when generating a video signal in a television camera.

The objective of the invention is the preservation (maintenance of unchanged) of the parameter, the elevation angle and the exclusion of passive pixels by using as a photodetector a single-line ring monochrome sensor or "low-line" ring color sensor by mechanical scanning in the perpendicular direction relative to the stationary image plane of the panoramic lens.

The problem is solved in that in the inventive method of panoramic television-computer monitoring according to embodiment 1, the television camera is installed in a fixed position, the image is captured in the television camera with a panoramic lens with an angular field of 360 degrees in azimuth, an analog image signal of the observed space is formed in the television camera, convert the analog video signal into a digital video signal, transmit the video signal of the panoramic panoramic image of the observed space interface to the server, record the digital video signal into the server’s RAM, selectively monitor the panoramic image stored in the server’s memory on the screens of two or more personal computers connected to the server by converting the panoramic television image into a regular image in the server, with one current “ring” frame read from the server’s memory using n "rectangular" frames, the number of which satisfies the relation (1), according to the alleged invention In order to provide monochrome (black-and-white) images to computer operators, the analog video signal is generated in a television camera using a charge-coupled device (CCD) technology, which has a ring shape and contains a “ring” single-line photo-receiving region, “ring” on a common crystal output register and charge-voltage converter ”, while the sensor itself is mechanically scanned in a frame in the perpendicular direction relative to the fixed plane of the image eniya panoramic lens within its angular field at the place and at a pitch equal to the width of photodetector rows, the outer diameter of the sensor photodetector area equals the diameter of the panoramic image output lens.

The task in the inventive method of panoramic television-computer monitoring according to option 2 set the television camera in a fixed position, perform image capture in the television camera with a panoramic lens with an angular field of 360 degrees in azimuth, form an analog image signal of the observed space in the television camera, convert the analog video signal into digital video signal, transmit the video signal of the circular panoramic image of the observed space via the interface in gray Ver, they record the digital video signal in the server’s RAM, selectively monitor the panoramic image stored in the server’s memory on the screens of two or more personal computers connected to the server by converting the panoramic television image into a regular image in the server, and one current “ring” frame is read from server memory using n "rectangular" frames, the number of which satisfies the relation (1), according to the invention for providing to color image computer operators, the analog video signal is generated in a television camera using a CCD photodetector having a ring shape and containing a “ring” four-line photodetector on a common crystal, covered with a ring shape and sequentially arranged with an infrared (IR) cut-off filter and mosaic a color filter that separates light into cyan, yellow, magenta and green components, as well as containing front "output register and charge-voltage converter", while the sensor itself is mechanically scanned in a frame perpendicular to the fixed plane of the image of the panoramic lens, within its angular field in place and with a step equal to the width of the four-line photo-receiving region, the outer diameter of this the photodetector area of the sensor is equal to the diameter of the image at the output of the panoramic lens.

Comparative analysis with the prototype shows that the inventive method is distinguished by the presence of new features, namely the presence of the following action - mechanical scanning of the photodetector in a frame in the perpendicular direction relative to the output window of the panoramic lens within its elevation angle; the condition for carrying out this action, which consists in choosing the magnitude of the scanning step; and also used with this material means - a photodetector on a CCD having not a rectangular, but a circular form of implementation.

The combination of known and new features is not known from the prior art, therefore, the claimed method meets the requirement of novelty.

In the claimed solution, scanning by frame is carried out on an imaginary cylindrical surface, due to which a large area of the optical space is recorded, and therefore, new (additional) video information is also formed.

Therefore, the proposed solution meets the criterion of the presence of an inventive step.

In FIG. 1 shows a structural diagram of a device that implements the inventive method; in FIG. 2 - circuit design organization of a monochrome photodetector of a television camera; in FIG. 3 - circuit design organization of a color photodetector of a television camera; in FIG. 4 is a fragment of a color photodetector illustrating details of its construction; in FIG. 5, according to [2], a photograph of an image obtained using a domestic panoramic mirror-lens lens is presented; in FIG. 6 is an illustration of geometric relationships for a photodetector target having a “rectangular” and “ring” shape; in FIG. 7 - a panoramic image proposed to the operator in the form of a sequence of 6 “rectangular” frames.

A device for a television-computer monitoring system in which the inventive method is implemented, see FIG. 1, comprises a television camera 1 and a server 2 connected in series to a local area network, to which two or more personal computers are connected at position 3, the television camera 1 comprising a series-aligned and optically connected panoramic lens 1-1 and a photodetector 1- 2 of a monochrome or color image manufactured using CCD technology, moreover, on a crystal of a monochrome sensor, see FIG. 2, there is a “ring” single-line photodetector region 1-2-1, a “ring” register 1-2-2 and a charge-voltage converter (BPS) 1-2-3, and on a color sensor chip, see FIG. 3 is the same, with the exception of the photodetector region 1-2-1, which becomes four-line, and also has a “two-layer” optical coating in the form of a combination of an IR filter 1-7 and a mosaic color filter, see its fragment in FIG. four; in the composition of the television camera 1, the mechanical scanning unit 1-3 of the sensor is kinematically connected with the photodetector 1-2 and carries out its mechanical scanning in the frame, within the elevation angle of the panoramic lens 1-1 and in the perpendicular direction relative to the fixed plane of its output window, while controlling the inputs of the 1-2-1 area of the sensor are connected to the first output of the 1-4 block of the “ring” scan of the video signal, the second output of which is connected to the control inputs of the “ring” register 1-2-2 of the sensor, the third output of the block 1-4 "count front ”sweep - to the synchronization input of the signal processor 1-5, the fourth output of block 1-4“ ring ”sweep - to the clock input of an analog-to-digital converter (ADC) 1-6, the fifth output of block 1-4“ ring ”sweep - to the synchronization input of block 1-3 of the mechanical scanning of the sensor, and the control input of block 1-4 of the "circular" scan to the output of the exposure control of the signal processor 1-5; the output of the ADC 1-6 is the output of the television camera 1; a video card is installed in the expansion slot on the server 2 motherboard, matched via the I / O channels, control and power supply with the server bus, containing a block for converting a “ring” frame into “rectangular” frames (BPKP), the input of which is connected to the output of the RAM block per frame, and the output - to the output of the "network".

Depending on the variant of the proposed method of television-computer monitoring, a monochrome photodetector implements a single-line “ring” scan, and a color photodetector implements a four-line “ring” scan of a charge image on a photodetector region 1-2-1 with subsequent element-wise reading of charges in a “ring” register 1- 2-2 in order to form the voltage of the video signal in analog form at the output of the BPSN 1-2-3.

In this case, during one interval, the process of accumulation of charge packets occurs in proportion to the illumination of the panoramic plot in the photosensitive pixels of the photodetector region 1-2-1. During a short period of the subsequent interval, a photo shutter opens, and the charges of all the “ring” lines involved in the accumulation are transferred (in one rotation step) to the screened from light pixels located in the same region 1-2-1.

Then the photo shutter closes and, in a new cycle, another charge “picture” is accumulated on the target, and the charge packets accumulated in the previous cycle are transferred in radial directions to the periphery of the photodetector crystal, loading the “ring” register 1-2-2 in intermediate intervals with new charges.

The photodetector is the only color image video sensor in which, thanks to the use of a color ring filter, CCD pixels become sensitive to cyan (Cy), yellow (Ye), magenta (Mg) and green (G) color components. The design of this photodetector is shown in FIG. four.

We add that on the lens side in front of the mosaic filter there is a cut-off IR filter (see position 1-7 in Fig. 1), which changes the spectral characteristic of the sensor, ensuring its matching with the spectral sensitivity of the human eye.

It uses the well-known principle of color television, which states that for successful color recovery, in addition to the brightness signal (Y), just two additional signals are enough. This refers to the red color difference signal (R-Y) and the blue color difference signal (B-Y).

Note that it is this principle that is implemented in the design of a mosaic filter for a photodetector in widespread color single-matrix television cameras, see, for example, [3, p. 155].

Similar to the mode used in single-matrix color cameras, here, before reading in the “ring” register 1-2-2, the charge packets of neighboring (in the radial direction) photo-target pixels are combined in pairs, and differently for the first (odd) and second (even) sequentially read ) “Circular” lines of the generated image, as shown in FIG. four.

The first line contains pairwise samples: (M _g + C _y ), (G + Y _e ), (M _g + C _y ), (G + Y _e ) and so on.

Second line: pairwise samples: (C _y + G), (Y _e + M _g ), (C _y + G), (Y _e + M _g ) and so on.

To obtain a luminance signal for an odd line, an operation is performed similar to that in [3, p. 155] the algorithm, which consists in the fact that a time delay is performed on the decomposition element of the "circular" rotation and the summation of pairwise samples:

в формуле (2) возвращает «должок», приобретенный за счет суммирования зарядов в попарных отсчетах.Coefficient

in formula (2) returns “debt”, acquired by summing the charges in pairwise readings.

Obviously, expression (2) can be represented as follows:

Applying a similar algorithm for an even line, we obtain the following expression for the luminance signal:

Similarly, we represent the expression (3) in primary colors:

To obtain the color difference signal blue (B-Y), an operation is performed according to another algorithm, which consists in the fact that for an odd line, a time delay is performed on the decomposition element and subtraction of pairwise samples:

To obtain the color difference signal red (R-Y), the operation is performed according to an algorithm similar to the receipt of the color difference signal blue, but as applied to an even line:

These two color difference signals, together with the luminance signal, are mixed into the CVBS signal in the PAL system in the same way as in single-matrix color television cameras with a mosaic filter. Let us explain that CVBS is an abbreviation of English words: “composite video bar signal”, i.e. full video signal.

It is important to note that the length of the outer circumference of the “ring” photodetector, both monochrome and color, with an outer radius R (see Fig. 6) and the target inscribed in the vertical size of the CCD with the format: l / h = 4/3 , exceeds the horizontal size for the "rectangular" sensor by an amount equal to 3/4 × π.

This means that with the same pixel area, the gain in their number is an indicator that is at least 2.5 times.

The panoramic lens 1-1 of the television camera, as in the prototype, is designed to form an optical image of a circular view (ring image). As a technical solution for a panoramic lens 1-1, which coincides with a similar solution for the prototype, a panoramic mirror-lens lens can be proposed, the design of which is patented in Russia by Russian specialists from Moscow State University of Geodesy and Cartography [2].

A photograph of the annular image formed by the panoramic lens is shown in FIG. 5. The angular field for this lens is 360 degrees in azimuth and can reach (75-80) degrees in elevation.

The presence of a passive (non-informative) region in the center of the optical frame of the panoramic lens confirms the advisability of choosing a photodetector in favor of a circular ring.

Block 1-4 of the "circular" scan of the video signal, the signal processor 1-5 and the ADC 1-6, it is advisable to perform using a set of specialized microcircuits with a high level of integration, including and a programmable kit designed to service CCD color matrices.

Block 1-3 mechanical scanning of the sensor is designed to perform scanning on the frame of the photodetector 1-2. The step-by-step movement of the photodetector should correspond to the width of one “ring” line for a monochrome sensor and, accordingly, four “ring” lines for its color version. In physics of work, such a movement is electromechanical.

It is important to note that in order to exclude the occurrence of a vertical blur of the generated image, the time interval of the step-by-step movement of the photodetector should be sufficiently small relative to the interval of charge accumulation on the target.

The method of panoramic television-computer monitoring (options) is as follows.

The television camera 1 is placed on a tripod (in Fig. 1 it is not shown).

The panoramic lens 1-1 forms an “annular” optical of the controlled scene, projecting it onto the target 1-2-1 of the photodetector of the television camera. Photodetector 1-2 implements a “ring” single-line or four-line scan of the charge image in the photodetector region 1-2-1, followed by element-wise reading of the charge packets in the “ring” register 1-2-2 and generating a video signal voltage at the output of the BPSN 1-2-3 in analog form.

As a result of the subsequent analog-to-digital conversion of the video signal at the output of the television camera 1, a digital television signal of black and white or color image is generated for one “ring” line of the reconstructed raster. Via the interface (for example, USB 2.0), the digital video signal of this “ring” line of the photodetector 1-2 will be transmitted to the RAM of server 2 when the photodetector itself is moved stepwise to the width of four lines of its target.

As a result, video information about the “circular” frame obtained using the “scanner” recording of the “circular” lines constituting it will be recorded in the RAM of server 2.

Suppose that, as in the prototype, the horizontal angle of the field of view (γ _g ) of the presented panoramic image is 60 degrees.

Then it should be provided that one sixth of each "ring" line from the "ring" frame is recorded in server 2, respectively, in one of the six arrays of RAM per frame.

Suppose that the total number of “ring” lines in a “ring” frame is m. The need for time diversity of the process of accumulation of charges in the photodetector and the process of stepwise movement of the sensor determines the mode of formation of the "ring" frame as slow, i.e. small frame.

Therefore, the required recording time of all m lines in server 2 will amount to several seconds and, possibly, even a higher value, but this is completely justified by the achieved result - maintaining a constant indicator of the elevation angle of the circular view and optimizing the photodetector for such a review.

Further, as in the prototype, in server 2, using the BPC element that implements the functions assigned to it programmatically, the video signal is read, and as a result, the “ring” frame is converted into ordinary “rectangular” frames of broadcast television and the ability to provide this information at the output of the "network" server 2.

Therefore, the digital video recording signal for each "ring" image frame is converted into 6 "rectangular" frames, which can be offered in the form of a selected sequence (see Fig. 7) to computer operators 3.

Note that the operation of reading the "rectangular" frames includes the correction of geometric distortions of the corresponding section of the panoramic image in the same way as it is implemented in the prototype.

Currently, all elements of the structural diagram of a panoramic television-computer monitoring device are mastered or can be mastered by domestic industry.

Therefore, we should consider the present invention as a method of panoramic television-computer monitoring (options) corresponding to the requirement of industrial applicability.

INFORMATION SOURCES

1. RF patent No. 2371880, IPC H04N 7/00. The method of panoramic television surveillance and device for its implementation / V.M. Smelkov // B.I. - 2009. - No. 30.

2. RF patent No. 2185645, IPC G02B 13/06, G02B 17/08. Panoramic mirror-lens / A.V. Kurtov, V.A. Solomatin // B.I. - 2002. - No. 20.

3. Vlado Damianowski. CTV. Bible CCTV, Digital and Network Technology / Translated from English. M .: LLC "IS-ES Press", 2006.

Claims (2)

1. The method of panoramic television-computer monitoring (options) according to option 1, which consists in installing the television camera in a fixed position, capturing the image in the television camera with a panoramic lens with an angular field of 360 degrees in azimuth, generating an analog image signal in the television camera of the observed space, convert the analog video signal into a digital video signal, transmit the video signal of the panoramic panoramic image of the observed space via the interface in server, record the digital video signal in the server’s RAM, selectively monitor the panoramic image stored in the server’s memory on the screens of two or more personal computers connected to the server by converting the panoramic television image into a regular image in the server, and one current “ring” frame is read from server memory using n "rectangular" frames, the number of which satisfies the ratio:

where γ _g is the horizontal angle of the field of view in degrees of the image observed by the operator, characterized in that for providing the computer operators with a monochrome (black and white) image, the formation of the analog video signal in the television camera is performed using a charge-coupled device (CCD) made by the technology of the photodetector, having a ring shape and containing a “ring” single-line photodetector region, a “ring” output register and a charge-voltage converter on a common crystal, The sensor is mechanically scanned in a frame perpendicular to the fixed image plane of the panoramic lens, within its angular field in place and with a step equal to the width of the photodetector line, and the outer diameter of the photodetector region of the sensor is equal to the diameter of the image at the output of the panoramic lens. 2. The method of panoramic television-computer monitoring (options) according to option 2, which consists in installing the television camera in a fixed position, capturing the image in the television camera with a panoramic lens with an angular field of 360 degrees in azimuth, generating an analog image signal in the television camera of the observed space, convert the analog video signal into a digital video signal, transmit the video signal of the panoramic panoramic image of the observed space via the interface in server, record the digital video signal in the server’s RAM, selectively monitor the panoramic image stored in the server’s memory on the screens of two or more personal computers connected to the server by converting the panoramic television image into a regular image in the server, and one current “ring” frame is read from server memory using n "rectangular" frames, the number of which satisfies the relation (1), characterized in that to provide operators with color image computers, the analog video signal is formed in a television camera using a CCD photodetector having a ring shape and containing a “ring” four-line photodetector on a common crystal, covered with a ring shape and sequentially arranged with an infrared cut-off filter and a mosaic color filter separating light on cyan, yellow, magenta and green components, as well as containing a “ring” output on a common crystal the first register and the charge-voltage converter, while the sensor itself is mechanically scanned in a frame perpendicular to the fixed plane of the image of the panoramic lens, within its angular field in place and in increments equal to the width of the four-line photodetector region, the outer diameter of this photodetector The area of the sensor is equal to the diameter of the image at the output of the panoramic lens.

Images