[go: up one dir, main page]

GB2537221A - Method for representing a panoramic image and panoramic image representation apparatus - Google Patents

Method for representing a panoramic image and panoramic image representation apparatus Download PDF

Info

Publication number
GB2537221A
GB2537221A GB1603406.8A GB201603406A GB2537221A GB 2537221 A GB2537221 A GB 2537221A GB 201603406 A GB201603406 A GB 201603406A GB 2537221 A GB2537221 A GB 2537221A
Authority
GB
United Kingdom
Prior art keywords
image
panoramic image
panoramic
representation apparatus
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB1603406.8A
Other versions
GB201603406D0 (en
Inventor
Ruf Bernhard
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hensoldt Optronics GmbH
Original Assignee
Airbus DS Optronics GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Airbus DS Optronics GmbH filed Critical Airbus DS Optronics GmbH
Publication of GB201603406D0 publication Critical patent/GB201603406D0/en
Publication of GB2537221A publication Critical patent/GB2537221A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/32—Indexing scheme for image data processing or generation, in general involving image mosaicing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

Method for displaying a panoramic image, comprising: supplying input images from at least one image source (ie. camera); processing/combining the input images to form a panoramic output image; displaying the panoramic image; characterised in that: a computer graphic frame, whose size, shape and position can be varied, that encloses a region of the panoramic image that will be processed further, is inserted into the panoramic image in order to select the region. The further processing of the delimited area may be a graphical variation such as enlargement. The inserted border may be a rectangular box or window. Multiple frames may be inserted and different frames may be identified by different colours or types of lines (eg. solid, dashed, dotted). The panoramic image may show the environment or surroundings of an armoured vehicle or ship.

Description

Description:
Method for representing a panoramic image and panoramic image representation apparatus The invention relates to a method for representing an, in particular composite, panoramic image on an image reproduction device of a panoramic image representation apparatus. The invention likewise relates to a method for selecting at least one region to be processed further from a panoramic image, and to a panoramic image representation apparatus.
DE 10 2010 053 895 Al relates to a surroundings representation apparatus and to a vehicle comprising such a surroundings representation apparatus and a method for representing a panoramic image.
The present invention is based on the object of improving a method and a panoramic image representation apparatus of the type mentioned in the introduction, in particular of providing a simple and fast possibility for selecting specific regions of a displayed panoramic image.
This object is achieved according to the invention by means of the features mentioned in Claim 1.
By virtue of the fact that for selecting at least one region to be processed further from the panoramic image on the image reproduction device at least one frame in the form of a computer graphic is inserted, in particular for example directly into the panoramic image, said at least one frame being variable with regard to its size, shape and/or its position relative to the panoramic image in such a way that it surrounds or encloses the at least one region to be processed further of the panoramic image, a selection of an arbitrary region is possible simply and rapidly by means of such an input. In order to select one or a -2 -plurality of regions to be processed further or enlargement regions from an, in particular composite, panoramic image, one or a plurality of frames on a graphical interface are positioned at the desired location or the desired locations. The frames thus mark and/or enclose or surround the respective region to be selected, in particular in the form of one or a plurality of pixels. The selected regions can then be processed further or represented separately. In this case, the frames can be directly inserted into the panoramic image, that is to say as it were superimposed thereon, but other solutions are also suitable. The panoramic image can comprise e.g. an image of an environment or surroundings, in particular of an armoured vehicle or ship.
The further processing of the selected region of the panoramic image can comprise a graphical variation, in particular an enlargement, of the selected region of the panoramic image. In this case, the individual pixels of the region of the panoramic image can be represented in a correspondingly varied fashion.
A rectangular box or a window can be used as the frame. 25 Advantageously, different frames can be provided with different colours or types of lines (e.g. solid, dashed, dash-dotted, etc.).
The confirmation of the selection of the region to be processed further of the panoramic image can be carried out by means of at least one input device of the panoramic image representation apparatus. The variation of the size, shape and/or the position of the frame for determining the region to be processed further can be carried out by means of the at least one input device of the panoramic image representation apparatus. The at least one input device of the panoramic image representation apparatus can be a computer mouse, a joystick, a keyboard, a touchscreen or the like. The -3 -frames can thus be displaced and adapted by input devices.
Claim 6 relates to a method for selecting at least one 5 region to be processed further from a panoramic image.
A panoramic image representation apparatus is specified in Claim 7.
The image signal processing device can process the input image signals in such a way that on the image reproduction device the at least one frame which is variable with regard to its size, its shape and/or its position, in the form of a computer graphic, is inserted into the panoramic image.
According to the invention, it can furthermore be provided that the image signal processing device is designed to carry out the further processing of the 20 selected region of the panoramic image.
Advantageous configurations and developments of the invention are evident from the dependent claims. One exemplary embodiment of the invention is described in 25 principle below with reference to the drawing.
In the figures: Figure 1 shows a schematic illustration of the component parts of a panoramic image representation apparatus according to the invention; and Figure 2 shows a schematic illustration of a panoramic image that is displayed on the panoramic image representation apparatus according to the invention. -4 -
Figure 1 shows a panoramic image representation apparatus 1 according to the invention, which can be used for example in -not illustrated -an armoured vehicle or a ship as a surroundings representation apparatus. The panoramic image representation apparatus 1 can comprise as image sources four image sensors 2.12.4, in particular cameras that operate in visible light. However, alternatively or additionally, it is also possible to provide image sensors or image acquisition devices which operate in wavelength ranges outside visible light, for example in the infrared range. A first of the image sensors 2.1-2.4 can be directed forwards, another can be directed rearwards and the two remaining image sensors 2.1-2.4 can be arranged on the ship laterally in a manner directed respectively towards the left and towards the right side, thus resulting overall in a panoramic view of the surroundings of the ship.
The image sensors 2.1-2.4 generate electronic image data from the image obtained optically. These image data generated in the image sensors 2.1-2.4 are forwarded as image signals via corresponding data lines 2.1a-2.4a (e.g. cable connections or radio connections) from the respective image sensors 2.1-2.4 to an image signal processing device 3. In the image signal processing device 3, the incoming image signals are fused and overall image information is formed from the image information respectively contained in said image signals, in which overall image information the image information supplied by the individual image sources 2.1-2.4 is combined to form a panoramic image 4.1 as an overall image. Said overall image information is then subjected to image processing and forwarded as output image signal via a further image data line 3a from the image processing device 3 to an image reproduction device 4, which may be formed by a panoramic image screen, for example, which displays the panoramic image 4.1. -5 -
The panoramic image representation apparatus 1 comprises an input device 5, which is embodied as a keyboard in the present exemplary embodiment. The input 5 device 5 is communicatively connected via a data line 5a e.g. to the image processing device 3 or further component parts (not illustrated) of the panoramic image representation apparatus 1. In other exemplary embodiments, the input device 5 could also be embodied 10 as a computer mouse, a joystick, a touchscreen or the like.
Figure 2 shows a schematic illustration of a panoramic image 4.1, which is formed by a plurality of strips arranged one above another and which can be displayed on the panoramic image representation apparatus 1 according to the invention.
The panoramic image representation apparatus 1 is 20 designed according to the invention to carry out the method described below.
For selecting regions 4.11-4.14 to be processed further from the panoramic image 4.1 on the image reproduction 25 device 4 frames 6.1-6.4 that are variable with regard to size, shape and/or position, in the form of a computer graphic, are inserted, in particular directly, into the panoramic image 4.1, said frames being variable with regard to their size, shape and/or their 30 relative position with respect to the panoramic image in such a way that they enclose or surround or delimit the regions 4.11-4.14 to be processed further of the panoramic image 4.1.
The further processing of the selected region 4.11-4.14 of the panoramic image 4.1 can comprise a graphical variation, in particular an enlargement, of the selected region 4.11-4.14 of the panoramic image 4.1. The image signal processing device 3 can be designed to -6 -carry out the further processing of the selected region 4.11-4.14 of the panoramic image 4.1.
The confirmation of the selection of the region 4.115 4.14 to be processed further of the panoramic image 4.1 can be carried out by means of the input device 5 of the panoramic image representation apparatus 1.
The variation of the size and/or the position of the frame 6.1-6.4 for determining the selected, in particular confirmed, region to be processed further can likewise be carried out by means of the input device 5 of the panoramic image representation apparatus 1.
As is evident from Figure 2, rectangular boxes or windows can be used as frames 6.1-6.4. In the present exemplary embodiment, the frames 6.1-6.4 are identified by different types of lines. It goes without saying that they could also have different colours, for example.
The image signal processing device 3 can process the input image signals in such a way that on the image reproduction device 4 the frames 6.1-6.4 which are variable with regard to size and/or position, in the form of a computer graphic, are inserted into the panoramic image 4.1. -7 -
List of reference 1 signs Panoramic image representation apparatus according to the invention 2.1-2.4 Image sensors 2.1a-2.4a, 3a, 5a Data lines 3 Image signal processing device 4 Image reproduction device 4.1 Panoramic image 4.11-4.14 Regions to be processed further of the panoramic image Input device 6.1-6.4 Frames -8 -

Claims (10)

  1. Patent claims: 1. Method for representing an, in particular composite, panoramic image (4.1) on an image reproduction device ( 4) of a panoramic image representation apparatus (1), comprising the following steps: - providing input image signals that are supplied by at least one image source (2.1-2.4); processing and/or combining the input image signals to form output image signals for the panoramic image (4.1); - forwarding the output image signals to the image reproduction device (4); and displaying the panoramic image (4.1) on the image reproduction device (4); characterized in that for selecting at least one region (4.11-4.14) to be processed further from the panoramic image (4.1) on the image reproduction device (4) at least one frame (6.16.4) in the form of a computer graphic is inserted, in particular into the panoramic image (4.1), said at least one frame being variable with regard to its size, shape and/or its position relative to the panoramic image (4.1) in such a way that it encloses the at least one region (4.11-4.14) to be processed further of the panoramic image (4.1).
  2. 2. Method according to Claim 1, wherein the further processing of the selected region (4.11-4.14) of the panoramic image (4.1) comprises a graphical variation, in particular an enlargement, of the selected region (4.11-4.14) of the panoramic image (4.1).
  3. 3. Method according to Claim 1 or 2, wherein the confirmation of the selection of the region (4.11-4.14) to be processed further of the panoramic image (4.1) is carried out by means of at least one input device (5) of the panoramic image representation apparatus (1). -9 -
  4. 4. Method according to Claim 1, 2 or 3, wherein the variation of the size, shape and/or the position of the frame (6.1-6.4) for determining the region (4.11-4.14) to be processed further is carried out by means of at least one input device (5) of the panoramic image representation apparatus (1).
  5. 5. Method according to any of Claims 1 to 4, wherein a rectangular box or a window is used as the frame (6.1-6.4).
  6. 6. Method for selecting at least one region (4.114.14) to be processed further from a panoramic image (4.1) on an image reproduction device (4) of a panoramic image representation apparatus (1), wherein at least one frame (6.1-6.4) in the form of a computer graphic is inserted, in particular into the panoramic image (4.1), said at least one frame being variable with regard to its size, shape and/or its position relative to the panoramic image (4.1) in such a way that it encloses the at least one region (4.11-4.14) to be processed further of the panoramic image (4.1).
  7. 7. Panoramic image representation apparatus (1), comprising: - at least one image sensor (2.1-2.4) as image source; - an image signal processing device (3), wherein the input image signals acquired by the at least one image sensor (2.1-2.4) are fed to the image signal processing device (3), which processes the input image signals fed to it to form output image signals of a panoramic image (4.1); -at least one image reproduction device (4), wherein the output image signals from the image signal processing device (3) are forwarded to the image reproduction device (4) for displaying the panoramic image (4.1); and -10 -at least one input device (5), wherein the panoramic image representation apparatus (1) is designed to carry out a method according to any of Claims 1 to 6.
  8. 8. Panoramic image representation apparatus (1) according to Claim 7, wherein the image signal processing device (3) processes the input image signals in such a way that on the image reproduction device (4) the at least one frame (6.1-6.4) which is variable with regard to its size, its shape and/or its position, in the form of a computer graphic, is inserted into the panoramic image (4.1).
  9. 9. Panoramic image representation apparatus (1) according to Claim 7 or 8, wherein the image signal processing device (3) is designed to carry out the further processing of the selected region (4.11-4.14) of the panoramic image (4.1).
  10. 10. Panoramic image representation apparatus (1) according to Claim 7, 8 or 9, wherein the at least one input device (5) of the panoramic image representation apparatus (1) is a computer mouse, a joystick, a keyboard, a touchscreen or the like.
GB1603406.8A 2015-04-09 2016-02-26 Method for representing a panoramic image and panoramic image representation apparatus Withdrawn GB2537221A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102015105363.2A DE102015105363A1 (en) 2015-04-09 2015-04-09 Method of displaying a panoramic image and panoramic image display device

Publications (2)

Publication Number Publication Date
GB201603406D0 GB201603406D0 (en) 2016-04-13
GB2537221A true GB2537221A (en) 2016-10-12

Family

ID=55807005

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1603406.8A Withdrawn GB2537221A (en) 2015-04-09 2016-02-26 Method for representing a panoramic image and panoramic image representation apparatus

Country Status (2)

Country Link
DE (1) DE102015105363A1 (en)
GB (1) GB2537221A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2359686A (en) * 2000-01-20 2001-08-29 Canon Kk Image magnifying apparatus
US20040125148A1 (en) * 2002-12-30 2004-07-01 The Board Of Trustees Of The Leland Stanford Junior University Methods and apparatus for interactive point-of-view authoring of digital video content
WO2006085827A1 (en) * 2005-02-11 2006-08-17 Creative Technology Ltd Method and apparatus for forming a panoramic image
US20080056612A1 (en) * 2006-09-04 2008-03-06 Samsung Electronics Co., Ltd Method for taking panorama mosaic photograph with a portable terminal
EP2464097A1 (en) * 2010-12-13 2012-06-13 Research In Motion Limited Methods and apparatus for use in enabling an efficient review of photographic images which may contain irregularities
WO2013173670A2 (en) * 2012-05-18 2013-11-21 Thomson Licensing Processing panoramic pictures
EP2720191A1 (en) * 2012-10-10 2014-04-16 Samsung Electronics Co., Ltd Display device and method of photographing thereof

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102006003524A1 (en) * 2006-01-24 2007-07-26 Oerlikon Contraves Ag Panoramic view system especially in combat vehicles
DE102010053895A1 (en) 2010-12-09 2012-06-14 Eads Deutschland Gmbh Environment display device as well as a vehicle with such an environment-presentation device and method for displaying a panoramic image

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2359686A (en) * 2000-01-20 2001-08-29 Canon Kk Image magnifying apparatus
US20040125148A1 (en) * 2002-12-30 2004-07-01 The Board Of Trustees Of The Leland Stanford Junior University Methods and apparatus for interactive point-of-view authoring of digital video content
WO2006085827A1 (en) * 2005-02-11 2006-08-17 Creative Technology Ltd Method and apparatus for forming a panoramic image
US20080056612A1 (en) * 2006-09-04 2008-03-06 Samsung Electronics Co., Ltd Method for taking panorama mosaic photograph with a portable terminal
EP2464097A1 (en) * 2010-12-13 2012-06-13 Research In Motion Limited Methods and apparatus for use in enabling an efficient review of photographic images which may contain irregularities
WO2013173670A2 (en) * 2012-05-18 2013-11-21 Thomson Licensing Processing panoramic pictures
EP2720191A1 (en) * 2012-10-10 2014-04-16 Samsung Electronics Co., Ltd Display device and method of photographing thereof

Also Published As

Publication number Publication date
DE102015105363A1 (en) 2016-10-13
GB201603406D0 (en) 2016-04-13

Similar Documents

Publication Publication Date Title
KR101770110B1 (en) Semi transparent mark, a method for composing and detecting semi transparent mark,transparent mark and a method for composing and detecting transparent mark
US10070045B2 (en) Information processing apparatus, electronic apparatus, server, information processing program, and information processing method
EP3171588A1 (en) Image processing method and image processing apparatus executing that image processing method
US10178299B2 (en) Control device and control method
US20200358833A1 (en) Test cell presence system and methods of visualizing a test environment
EP3229468B1 (en) Image processing device, image processing method, program, and system
JP5003395B2 (en) Vehicle periphery image processing apparatus and vehicle periphery state presentation method
JP2013065280A5 (en)
JP5533766B2 (en) Vehicle display device
JP2017184217A5 (en)
KR101808393B1 (en) Two-dimensional image data processing device, two-dimensional color luminance meter, method for processing two-dimensional image data, and computer-readable recording medium
GB2537221A (en) Method for representing a panoramic image and panoramic image representation apparatus
US20120188457A1 (en) Image processing apparatus and image processing method
JP7156291B2 (en) Gas inspection report creation support device, gas inspection report creation support method, and gas inspection report creation support program
JP2011109507A (en) Apparatus and program for processing image
JP2016128893A (en) Image processing device and image processing method
KR102517104B1 (en) Method and apparatus for processing image in virtual reality system
Shin et al. Color correction using 3D multi-view geometry
EP1353211A3 (en) Three-dimensional transmission type microscope system, image display method and image processing apparatus
EP3822909A1 (en) A system and a method for generating output image data and a microscope
US20130155219A1 (en) Image processing apparatus
KR101316231B1 (en) Multi-image processing apparatus
EP4260553B1 (en) Method, system and computer program for enhancing depth perception of a non-visible spectrum image of a scene
CN113498518A (en) Image processing apparatus
KR20150092612A (en) Multispectral camera and control method of the camera for detecting 3d image

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)