[go: up one dir, main page]

WO2020003630A1 - Image processing device, image processing method, and drive recorder - Google Patents

Image processing device, image processing method, and drive recorder Download PDF

Info

Publication number
WO2020003630A1
WO2020003630A1 PCT/JP2019/009997 JP2019009997W WO2020003630A1 WO 2020003630 A1 WO2020003630 A1 WO 2020003630A1 JP 2019009997 W JP2019009997 W JP 2019009997W WO 2020003630 A1 WO2020003630 A1 WO 2020003630A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
image processing
vehicle
important part
processing apparatus
Prior art date
Application number
PCT/JP2019/009997
Other languages
French (fr)
Japanese (ja)
Inventor
勝 徳田
末永　俊之
Original Assignee
株式会社カーメイト
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社カーメイト filed Critical 株式会社カーメイト
Publication of WO2020003630A1 publication Critical patent/WO2020003630A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00—Registering or indicating the working of vehicles
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to an image processing device, an image processing method, and a drive recorder for recording a driving state or a parking state of a vehicle.
  • a drive recorder that records a driving state or a parking state of a vehicle is used for purposes such as accident analysis, technical confirmation of safe driving, and crime prevention.
  • drive recorders there is one that arranges an omnidirectional camera in a vehicle cabin and acquires an omnidirectional image centered on a vehicle.
  • the conventional spherical drive recorder reduces the amount of data by recording the entire image at a low resolution. For this reason, the image quality deteriorates, and disadvantages such as the inability to see the license plate of the vehicle ahead, which is about 10 meters from the host vehicle, occur.
  • the high-resolution image of the omnidirectional camera capable of shooting at a high resolution has an excessive data amount, generates a large amount of heat during operation, and places a load on the recorder body. Further, an expensive large-capacity memory is required to store high-resolution image data. Also, for example, manufacture a recorder that installs a spherical camera and a high-resolution camera on the recorder body, stores the spherical image and the high-resolution image separately, and combines the high-resolution image with the spherical image by post-processing. In this case, the recorder body becomes expensive because two different types of cameras, a spherical camera and a high-resolution camera, are combined.
  • Patent Document 1 There is also an imaging system of Patent Document 1 in which a spherical image is acquired with a plurality of optical lenses.
  • a coordinate conversion process is performed so that an image centered on a point of interest is arranged in a central portion of the omnidirectional image that is not easily distorted, and an image corresponding to the central portion is cut out and output as a display image.
  • the clipped image is an image that looks natural for the viewer, it simply functions to cut out part of the image and reduce the resolution.Therefore, there is a problem that the license plate of the vehicle ahead in about 10 meters cannot be seen. there were.
  • the problem to be solved by the present invention is to provide an image processing apparatus, an image processing method, and a drive recorder that can easily recognize an important part in an image and reduce a load during operation.
  • the present invention provides, as first means for solving the above-mentioned problems, a photographing means which is installed in a vehicle interior of a vehicle and photographs at least a periphery of the vehicle including a preceding vehicle, and An image processing apparatus comprising: an image quality changing unit that cuts out an important part and reduces the image quality of the captured image; and a storage unit that stores the cut out important part and the captured image whose quality is lowered.
  • An image processing apparatus comprising: an image quality changing unit that cuts out an important part and reduces the image quality of the captured image; and a storage unit that stores the cut out important part and the captured image whose quality is lowered.
  • the present invention as a second means for solving the above problems, a photographing means installed in a vehicle interior of the vehicle and photographing the periphery of the vehicle including at least a vehicle ahead at a high resolution, An image quality changing unit that cuts out an important part in the captured image of the imaging unit at a high resolution and reduces the captured image to a low resolution.
  • An image processing apparatus characterized by having: According to the second means, the important part in the reproduced image can be easily visually recognized, and the load such as heat generation during operation can be reduced.
  • the image capturing means includes a plurality of wide-angle lenses for capturing an image of the celestial sphere centered on the vehicle.
  • An object of the present invention is to provide an image processing apparatus characterized by the above. According to the third means, it is possible to capture an omnidirectional image centered on the own vehicle with one camera, and to reduce the overall cost of the apparatus without using a plurality of different cameras as in the related art. Can be achieved.
  • the present invention provides a method according to any one of the first to third means, wherein the important portion is a range including at least a license plate of the preceding vehicle.
  • An object of the present invention is to provide an image processing apparatus characterized by the following. According to the fourth means, at the time of reproduction, for example, a license plate of a preceding vehicle which is about 10 meters away from the own vehicle can be visually recognized.
  • the image processing apparatus wherein the important portion is a continuous portion in front, side, and rear of the vehicle.
  • An object of the present invention is to provide a processing device. According to the fifth means, at the time of reproduction, the entire periphery around the vehicle including the license plate of the preceding vehicle can be easily visually recognized from the surrounding (panoramic) image of the own vehicle.
  • the image processing apparatus according to any one of the first to fifth aspects, wherein the image quality changing unit determines a size of the important portion based on a position coordinate of an image.
  • Another object of the present invention is to provide an image processing apparatus characterized in that the position can be arbitrarily changed. According to the sixth means, it is possible to easily change the location of the important portion in the image that changes depending on the imaging target.
  • the image quality changing means sets the image quality of the captured image to be stored higher than that of the important part. It is an object of the present invention to provide an image processing apparatus characterized in that the setting can be arbitrarily changed within a range to be dropped. According to the seventh means, it is possible to easily select from a range in which the image quality is lowered according to the specifications (memory capacity and the like) of the apparatus.
  • the present invention provides the image processing apparatus according to any one of the first to seventh means, wherein the important portion is framed when the image processed by the image quality changing means is reproduced.
  • an important portion with good image quality is enlarged and displayed from the reproduced image, and, for example, a license plate of a vehicle ahead of the own vehicle about 10 meters away can be easily visually recognized.
  • a drive recorder including the image processing apparatus according to any one of the first to eighth aspects. According to the ninth means, it is possible to obtain a drive recorder capable of easily recognizing an important part in a reproduced image and reducing a load at the time of storage.
  • the present invention provides a step of recording the periphery of the vehicle including at least a forward vehicle with a photographing means installed in a vehicle cabin, Cutting out an important part in the photographed image of the photographing means, changing the image quality by lowering the image quality of the photographed image, and storing the cut-out important part and the photographed image having a reduced image quality.
  • An object of the present invention is to provide an image processing method characterized by the following. According to the tenth means, an important part in the reproduced image can be easily visually recognized, and the load during operation can be reduced.
  • the amount of data to be processed is reduced, and the heat generation of the recorder main body can be suppressed, so that the load during operation can be reduced. Further, the size of the apparatus main body can be reduced.
  • FIG. 2 is an explanatory diagram 1 of Example 1 of an important part of recorded data.
  • FIG. 3 is an explanatory diagram 2 of Example 1 of an important part of recorded data.
  • FIG. 4 is an explanatory diagram of an important part of the first embodiment.
  • FIG. 11 is an explanatory diagram of a second embodiment of an important part of recorded data of a modified example.
  • FIG. 13 is an explanatory diagram of a second embodiment of an important part of recorded data of a modified example.
  • FIG. 11 is an explanatory diagram 1 of Example 3 of an important part of recorded data in a modified example.
  • FIG. 11 is an explanatory diagram 2 of Example 3 of an important part of recorded data of a modified example.
  • FIG. 13 is an explanatory diagram of Example 3 of an important part of recorded data according to a modified example.
  • FIG. 1 is an explanatory diagram of a drive recorder serving as an image processing device of the present invention.
  • FIG. 2 is an explanatory diagram of an action camera serving as an image processing device of the present invention.
  • FIG. 4 is a flowchart of a recording process performed by the image processing apparatus of the present invention. It is a flowchart of the reproduction
  • FIG. 1 is a block diagram of an image processing apparatus according to the present invention.
  • FIG. 2 is an explanatory diagram 1 of Example 1 of an important part of recorded data.
  • FIG. 3 is an explanatory diagram 2 of the second embodiment of the important part of the recorded data.
  • FIG. 4 is an explanatory diagram of an important part of the first embodiment.
  • FIG. 5 is an explanatory diagram 1 of the second embodiment of the important part of the recorded data of the modified example.
  • FIG. 6 is an explanatory diagram of Example 2 of an important part of recorded data according to a modification.
  • FIG. 1 is a block diagram of an image processing apparatus according to the present invention.
  • FIG. 2 is an explanatory diagram 1 of Example 1 of an important part of recorded data.
  • FIG. 3 is an explanatory diagram 2 of the second embodiment of the important part of the recorded data.
  • FIG. 4 is an explanatory diagram of an important part of the first embodiment.
  • FIG. 5 is an explanatory diagram 1 of the second embodiment of the important part of the
  • FIG. 7 is an explanatory diagram 1 of the third embodiment of the important part of the recorded data of the modified example.
  • FIG. 8 is an explanatory diagram 2 of the third embodiment of the important part of the recorded data of the modified example.
  • FIG. 9 is an explanatory diagram of the third embodiment of the important part of the recorded data of the modified example.
  • FIG. 10 is an explanatory diagram of a drive recorder serving as an image processing device of the present invention.
  • FIG. 11 is an explanatory diagram of an action camera serving as the image processing device of the present invention.
  • FIG. 12 is a flowchart of a recording process performed by the image processing apparatus of the present invention.
  • FIG. 13 is a flowchart of a reproducing process by the reproducing means of the present invention.
  • the photographing means 20 is detachable inside the vehicle, and photographs around the vehicle including the vehicle ahead.
  • the photographing means has a plurality of wide-angle (including fish-eye lenses) lenses.
  • two wide-angle (fish-eye) lenses front and rear lenses
  • are image pickup devices front and rear image pickup devices that can acquire images in all directions by disposing the image pickup device.
  • CMOS Complementary Metal Oxide Semiconductor
  • Image quality changing means 30 For example, in the case where the number of pixels photographed by the photographing means 20 is a high resolution of about 7,808 ⁇ 3,904, which is about 30 million pixels, the data amount becomes enormous if recorded as a moving image as it is. On the other hand, when the number of pixels is set to a low resolution of about 4 million pixels of 2,880 (horizontal) ⁇ 1,440 (vertical), the amount of data to be recorded is suppressed, but the resolution is lowered, and the resolution is reduced, so that the number of pixels in a recorded image such as a license plate of a preceding vehicle is reduced. A problem arises in that important parts cannot be seen.
  • the image quality changing means 30 cuts out a central portion where the license plate of the preceding vehicle, which is an important portion in the recorded image, is reflected, and divides this number of pixels into about 1,920 ⁇ 1,080 ⁇ 2,080 pixels.
  • the resolution is high, and the number of pixels including important parts (cut-out parts), such as around the vehicle ahead, is a low resolution of about 4 million pixels of 2,880 horizontal ⁇ 1,440 vertical, which is lower than the image quality of the important parts. (See FIGS. 2, 3 and 4).
  • the total number of pixels is about 6 million pixels, which can be reduced to 1/5 of the number of pixels in the case where the entire image is of high image quality (about 30 million pixels).
  • the license plate of the preceding vehicle in the high-quality image of the important part is easy to see and can be clearly confirmed. Further, since the amount of data to be processed can be reduced, the amount of heat generated by the entire apparatus can be suppressed.
  • the image quality in the present embodiment is the quality of the image, and a clear image such as a license plate of a vehicle ahead of about 10 meters is seen as high image quality, and an image without a license plate is seen as low image quality.
  • the image quality may be defined numerically by the number of pixels and the frame rate. In the case of the number of pixels, the important part has a high resolution so that the license plate of the vehicle ahead, which is about 10 meters away from the vehicle, can be visually recognized. For this reason, the resolution is lower than that of the high resolution with a reduced number of pixels. Therefore, the photographing means 20 of the present invention uses a camera capable of acquiring high-quality recorded data.
  • a specific configuration of the image quality changing unit 30 of the present embodiment includes a front temporary storage unit that temporarily stores a captured image from a front image sensor, and a rear side that temporarily stores a captured image from a rear image sensor.
  • Such image quality changing means 30 is configured to be able to arbitrarily change the size or position of the important part based on the position coordinates of the image.
  • the important portion which is the range of the cutout may be set as a continuous portion in front of, on the side of, and behind the vehicle, in other words, as a panorama, as shown in FIGS.
  • the surroundings of the own vehicle side and rear vehicles, pedestrians on sidewalks, traffic lights, and the like
  • the extraction of the important part by the image quality changing means 30 may be automatically set by license plate recognition, face recognition, sign or signal recognition via an externally connected artificial intelligence.
  • a plurality of parts can be set (see FIG. 7-9). As shown in the figure, a license plate of a vehicle in front may be used on the front side, and a driver may be used as an important part on the back side.
  • the image quality changing means 30 can arbitrarily change the setting of the captured image to be saved according to the specifications (memory capacity and the like) of the apparatus within a range where the image quality is lower than that of the important part.
  • the storage means 40 stores the image data processed by the image quality changing means 30.
  • the storage unit 40 for example, a DRAM (Dynamic Random Access Memory) can be applied.
  • the storage unit 40 may have a configuration in which an external storage such as an SD memory that can be easily taken out when the recorded image is reproduced by an external terminal (such as a portable terminal) is attached.
  • an external storage such as an SD memory that can be easily taken out when the recorded image is reproduced by an external terminal (such as a portable terminal) is attached.
  • the specific configuration of the storage means 40 is such that an important part storage unit for storing a high-resolution important part from an important part cutout unit and an image quality from a front whole image quality changing unit are reduced (low resolution). 1) and a whole front and rear storage unit for recording the rear photographed image with a reduced image quality (low resolution) from the front photographed image and the rear whole image quality changing unit.
  • the reproduction means 50 is application software capable of reproducing the recorded image stored in the storage means 40.
  • the reproduction means 50 sets a frame surrounding an important part in the recorded image and displays it during reproduction (see FIGS. 3 and 6).
  • the file is switched to a file (image data) of an important portion, and this portion is enlarged and displayed (see FIG. 4).
  • the reproducing means 50 reproduces the entire recorded image by the photographing means 20 and the recorded data of the important part in synchronization. Therefore, when an important part is selected at an arbitrary time during reproduction, it is possible to switch to the important part at that time and reproduce the image.
  • the reproducing means 50 is installed in an external terminal or an apparatus main body connected to the apparatus main body via a cable or wirelessly.
  • a drive recorder 70 which is an example of an image processing apparatus, has a photographing unit 20 that is a spherical camera having a fish-eye (wide-angle) lens mounted on the front and back surfaces of the recorder main body.
  • the recorder body can be attached to and detached from the windshield of the vehicle, and can photograph the front and side of the vehicle with a front lens (not shown), and can photograph the rear and side of the vehicle with a rear lens.
  • By synthesizing the images of the front and back fisheye lenses 360-degree omnidirectional images can be taken.
  • FIG. 11A and 11B are explanatory diagrams of an action camera serving as an image processing device, wherein FIG. 11A shows one main surface (back surface), and FIG. 11B shows the other main surface (front surface).
  • an action camera 80 which is an example of the image processing apparatus has a photographing unit 20 which is a spherical camera having a fish-eye (wide-angle) lens on the front and back surfaces of the camera body.
  • the camera body can photograph the photographer himself with the wide-angle (rear) lens on the back, and can photograph around the photographer with the wide-angle (front) lens on the front.
  • 360-degree omnidirectional images can be taken.
  • the image processing apparatus employs a configuration in which a photographing unit 20, an image quality changing unit 30, and a storage unit 40 are arranged in the apparatus main body, and a reproducing unit 50 and a display unit 60 are arranged in an external terminal.
  • the overall size can be reduced.
  • a configuration in which a reproducing unit 50 and a display unit 60 are added to the apparatus main body may be adopted.
  • the captured image is stored as follows (see FIG. 12). [Cut out important parts]
  • the image quality changing unit 30 performs a process of cutting out an important portion (a central portion where a license plate of a preceding vehicle is reflected) from a captured image captured by the capturing unit 20 in advance.
  • the range to be cut out can be arbitrarily set and changed in size and position based on the position coordinates of the image data.
  • a plurality of important portions can be set, for example, at locations where the license plates of the front and rear vehicles can be seen.
  • settings are made to lower the image quality than the important portion (for example, lowering the resolution, lowering the number of frame rates, etc.).
  • Photographing is performed by the photographing means 20.
  • the captured image is temporarily stored in the front and rear temporary storage units.
  • the image data processed by the image quality changing means 30 is stored in the storage means 40.
  • the important portion cut out by the image quality changing means 30 is stored at a high resolution.
  • the license plate of the preceding vehicle in the high-quality image of the important part is easy to see and can be clearly confirmed.
  • the entire data is stored at a low resolution, the amount of data to be processed can be reduced, so that the heat generation of the entire apparatus can be suppressed.
  • the reproduction of the recorded image is performed as follows (see FIG. 13).
  • the image processing apparatus is connected to an external terminal in which the reproducing unit 50 is installed, and the recorded image of the celestial sphere is displayed (reproduced) on the display unit 60.
  • the recorded image of the celestial sphere with a lower image quality than the important part is reproduced, and the important part surrounded by a frame (such as a dotted line) is displayed on the reproduction screen.
  • the present invention can be widely applied, for example, as a vehicle-mounted drive recorder.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Time Recorders, Dirve Recorders, Access Control (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)

Abstract

[Problem] To provide an image processing device that can facilitate viewing of an important part of an image and reduce a load during an operation. [Solution] An image processing device 10 is characterized by having: a photographing means 20 that is installed in a cabin of a vehicle so as to record the surroundings of the vehicle including at least a vehicle ahead; an image quality changing means 30 for cutting out an important part of an image photographed by the photographing means 20, and reducing the image quality of the photographed image; and a storage means 40 for storing the cut-out important part and the quality-reduced photographed image.

Description

画像処理装置、画像処理方法、ドライブレコーダーImage processing device, image processing method, drive recorder
　本発明は車両の運転状況又は駐車状況を録画する画像処理装置、画像処理方法、ドライブレコーダーに関する。 The present invention relates to an image processing device, an image processing method, and a drive recorder for recording a driving state or a parking state of a vehicle.
　車両の運転状況又は駐車状況を録画するドライブレコーダーは、事故解析、安全運転の技術確認、防犯などの目的に利用されている。
　このようなドライブレコーダーには、車室内に全天球カメラを配置して車両を中心とする全天球画像を取得するものがある。
　しかしながら、従来の全天球型ドライブレコーダーは、画像全体を低解像度で録画することによりデータ量を低減している。このため画質が悪くなり、自車両から約十メートル先の前方車両のナンバープレートが見えない等の不都合が生じる。 2. Description of the Related Art A drive recorder that records a driving state or a parking state of a vehicle is used for purposes such as accident analysis, technical confirmation of safe driving, and crime prevention.
Among such drive recorders, there is one that arranges an omnidirectional camera in a vehicle cabin and acquires an omnidirectional image centered on a vehicle.
However, the conventional spherical drive recorder reduces the amount of data by recording the entire image at a low resolution. For this reason, the image quality deteriorates, and disadvantages such as the inability to see the license plate of the vehicle ahead, which is about 10 meters from the host vehicle, occur.
　一方、高解像度で撮影可能な全天球カメラの高解像度画像は、データ量が過大となり、稼働時に発熱量が多くなりレコーダー本体に負荷が掛かってしまう。また高解像度の画像データを保存するために高価な大容量のメモリが必要となる。
　また例えば、レコーダー本体に全天球カメラと高解像度カメラを設置して、全天球画像と高解像度画像を別々に保存して後処理で高解像度画像を全天球画像に合成するレコーダーを製造した場合には、全天球カメラと高解像度カメラの異なる２種類のカメラを組み合せているためレコーダー本体が高価となってしまう。 On the other hand, the high-resolution image of the omnidirectional camera capable of shooting at a high resolution has an excessive data amount, generates a large amount of heat during operation, and places a load on the recorder body. Further, an expensive large-capacity memory is required to store high-resolution image data.
Also, for example, manufacture a recorder that installs a spherical camera and a high-resolution camera on the recorder body, stores the spherical image and the high-resolution image separately, and combines the high-resolution image with the spherical image by post-processing. In this case, the recorder body becomes expensive because two different types of cameras, a spherical camera and a high-resolution camera, are combined.
　さらに複数の光学レンズで全天球画像を取得する特許文献１の撮像システムがある。この撮像システムは、全天球画像における歪みにくい中央部分に注目点を中心とした画像が配置されるよう座標変換処理が施され、中央部分に対応する画像が切り出されて表示画像として出力される。しかしながら切出画像は、閲覧者にとって自然に見える画像であり、単に画像の一部を切り出す機能、解像度を低下させる機能などであるため、約十メートル先の前方車両のナンバープレートが見えない課題があった。 There is also an imaging system of Patent Document 1 in which a spherical image is acquired with a plurality of optical lenses. In this imaging system, a coordinate conversion process is performed so that an image centered on a point of interest is arranged in a central portion of the omnidirectional image that is not easily distorted, and an image corresponding to the central portion is cut out and output as a display image. . However, since the clipped image is an image that looks natural for the viewer, it simply functions to cut out part of the image and reduce the resolution.Therefore, there is a problem that the license plate of the vehicle ahead in about 10 meters cannot be seen. there were.
特開２０１６－１７１５７７号公報JP 2016-171577 A
　本発明が解決しようとする課題は、画像中の重要部分を容易に視認できると共に、稼働時の負荷を低減できる画像処理装置、画像処理方法、ドライブレコーダーを提供することにある。 The problem to be solved by the present invention is to provide an image processing apparatus, an image processing method, and a drive recorder that can easily recognize an important part in an image and reduce a load during operation.
　本発明は、上記の課題を解決するための第１の手段として、車両の車室内に設置されて少なくとも前方車両を含む前記車両の周囲を撮影する撮影手段と、前記撮影手段の撮影画像中の重要部分を切り出すと共に、前記撮影画像の画質を落とす画質変更手段と、切り出した前記重要部分及び画質を落とした前記撮影画像を保存する記憶手段と、を有することを特徴とする画像処理装置を提供するものである。
　上記第１の手段によれば、再生画像中の重要部分を容易に視認できると共に、稼働時の発熱などの負荷を低減できる。 The present invention provides, as first means for solving the above-mentioned problems, a photographing means which is installed in a vehicle interior of a vehicle and photographs at least a periphery of the vehicle including a preceding vehicle, and An image processing apparatus comprising: an image quality changing unit that cuts out an important part and reduces the image quality of the captured image; and a storage unit that stores the cut out important part and the captured image whose quality is lowered. To do.
According to the first means, an important portion in the reproduced image can be easily visually recognized, and a load such as heat generation during operation can be reduced.
　本発明は上記課題を解決するための第２の手段として、車両の車室内に設置されて少なくとも前方車両を含む前記車両の周囲を高解像度で撮影する撮影手段と、
　前記撮影手段の撮影画像中の重要部分を高解像度で切り出すと共に、前記撮影画像を低解像度に落とす画質変更手段と、
　切り出した前記高解像度の重要部分及び前記低解像度の撮影画像を保存する記憶手段と、
　を有することを特徴とする画像処理装置を提供することにある。
　上記第２の手段によれば、再生画像中の重要部分を容易に視認できると共に、稼働時の発熱などの負荷を低減できる。 The present invention, as a second means for solving the above problems, a photographing means installed in a vehicle interior of the vehicle and photographing the periphery of the vehicle including at least a vehicle ahead at a high resolution,
An image quality changing unit that cuts out an important part in the captured image of the imaging unit at a high resolution and reduces the captured image to a low resolution.
Storage means for storing the cut out high-resolution important portion and the low-resolution captured image,
An image processing apparatus characterized by having:
According to the second means, the important part in the reproduced image can be easily visually recognized, and the load such as heat generation during operation can be reduced.
　本発明は、上記課題を解決するための第３の手段として、上記第１又は第２の手段において、前記撮影手段は、前記車両を中心とした全天球を撮影する複数の広角レンズを備えることを特徴とする画像処理装置を提供することにある。
　上記第３の手段によれば、１台のカメラで自車両を中心とする全天球画像を撮影することができ、従来のような複数の異なるカメラを用いることがなく装置全体コストの低廉化が図れる。 According to a third aspect of the present invention, in the first or second aspect, the image capturing means includes a plurality of wide-angle lenses for capturing an image of the celestial sphere centered on the vehicle. An object of the present invention is to provide an image processing apparatus characterized by the above.
According to the third means, it is possible to capture an omnidirectional image centered on the own vehicle with one camera, and to reduce the overall cost of the apparatus without using a plurality of different cameras as in the related art. Can be achieved.
　上記課題を解決するための第４の手段として、本発明は、上記第１ないし第３のいずれか１の手段において、前記重要部分は、少なくとも前記前方車両のナンバープレートを含む範囲であることを特徴とする画像処理装置を提供することにある。
　上記第４の手段によれば、再生時において、例えば自車両から約十メートル離れた前方車両のナンバープレートを視認できる。 As a fourth means for solving the above-mentioned problem, the present invention provides a method according to any one of the first to third means, wherein the important portion is a range including at least a license plate of the preceding vehicle. An object of the present invention is to provide an image processing apparatus characterized by the following.
According to the fourth means, at the time of reproduction, for example, a license plate of a preceding vehicle which is about 10 meters away from the own vehicle can be visually recognized.
　上記課題を解決するための第５の手段として、本発明は、上記第４の手段において、前記重要部分は、前記車両の前方及び側方及び後方の連続した箇所であることを特徴とする画像処理装置を提供することにある。
　上記第５の手段によれば、再生時において、自車両の周囲（パノラマ）画像から前方車両のナンバープレートを含む車両を中心とする全周囲を容易に視認できる。 According to a fifth aspect of the present invention, there is provided the image processing apparatus according to the fourth aspect, wherein the important portion is a continuous portion in front, side, and rear of the vehicle. An object of the present invention is to provide a processing device.
According to the fifth means, at the time of reproduction, the entire periphery around the vehicle including the license plate of the preceding vehicle can be easily visually recognized from the surrounding (panoramic) image of the own vehicle.
　上記課題を解決するための第６の手段として、本発明は、上記第１ないし第５のいずれか１の手段において、前記画質変更手段は、画像の位置座標に基づいて前記重要部分の大きさ又は位置を任意に変更可能なことを特徴とする画像処理装置を提供することにある。
　上記第６の手段によれば、撮影対象によって変化する画像中の重要部分の箇所を容易に変更することができる。 According to a sixth aspect of the present invention, there is provided the image processing apparatus according to any one of the first to fifth aspects, wherein the image quality changing unit determines a size of the important portion based on a position coordinate of an image. Another object of the present invention is to provide an image processing apparatus characterized in that the position can be arbitrarily changed.
According to the sixth means, it is possible to easily change the location of the important portion in the image that changes depending on the imaging target.
　上記課題を解決するための第７の手段として、本発明は、上記第１ないし第６のいずれか１の手段において、前記画質変更手段は、保存する前記撮影画像を前記重要部分よりも画質を落とす範囲内で任意に設定変更可能なことを特徴とする画像処理装置を提供することにある。
　上記第７の手段によれば、装置のスペック（メモリ容量など）に応じて容易に画質を落とす範囲から選択できる。 As a seventh means for solving the above-mentioned problems, according to the present invention, in any one of the first to sixth means, the image quality changing means sets the image quality of the captured image to be stored higher than that of the important part. It is an object of the present invention to provide an image processing apparatus characterized in that the setting can be arbitrarily changed within a range to be dropped.
According to the seventh means, it is possible to easily select from a range in which the image quality is lowered according to the specifications (memory capacity and the like) of the apparatus.
　上記課題を解決するための第８の手段として、本発明は、上記第１ないし第７のいずれか１の手段において、前記画質変更手段で画像処理した画像を再生する際に前記重要箇所を枠内で表示し、前記重要箇所を選択した場合に画面を前記重要箇所に切り替えて再生する再生手段を備えたことを特徴とする画像処理装置を提供することにある。
　上記第８の手段によれば、再生画像中から画質の良い重要部分を拡大表示して、例えば、自車両から約十メートル先の前方車両のナンバープレートを容易に視認できる。 As an eighth means for solving the above-mentioned problem, the present invention provides the image processing apparatus according to any one of the first to seventh means, wherein the important portion is framed when the image processed by the image quality changing means is reproduced. The image processing apparatus according to claim 1, further comprising a reproducing unit for displaying the image in the area and switching the screen to the important part when the important part is selected.
According to the eighth means, an important portion with good image quality is enlarged and displayed from the reproduced image, and, for example, a license plate of a vehicle ahead of the own vehicle about 10 meters away can be easily visually recognized.
　上記課題を解決するための第９の手段として、本発明は、上記第１ないし第８のいずれ
か１に記載された画像処理装置を備えることを特徴とするドライブレコーダーを提供することにある。
　上記第９の手段によれば、再生画像中の重要部分を容易に視認できると共に、保存時の負荷を低減できるドライブレコーダーが得られる。 According to a ninth aspect of the present invention, there is provided a drive recorder including the image processing apparatus according to any one of the first to eighth aspects.
According to the ninth means, it is possible to obtain a drive recorder capable of easily recognizing an important part in a reproduced image and reducing a load at the time of storage.
　上記課題を解決するための第１０の手段として、本発明は、車両の車室内に設置される撮影手段で少なくとも前方車両を含む前記車両の周囲を録画する工程と、
　前記撮影手段の撮影画像中の重要部分を切り出すと共に、前記撮影画像の画質を落として画質変更する工程と、切り出した前記重要部分及び画質を落とした前記撮影画像を保存する工程と、を有することを特徴とする画像処理方法を提供することにある。
　上記第１０の手段によれば、再生画像中の重要部分を容易に視認できると共に、稼働時の負荷を低減できる。 As a tenth means for solving the above-described problems, the present invention provides a step of recording the periphery of the vehicle including at least a forward vehicle with a photographing means installed in a vehicle cabin,
Cutting out an important part in the photographed image of the photographing means, changing the image quality by lowering the image quality of the photographed image, and storing the cut-out important part and the photographed image having a reduced image quality. An object of the present invention is to provide an image processing method characterized by the following.
According to the tenth means, an important part in the reproduced image can be easily visually recognized, and the load during operation can be reduced.
　上記構成による本発明によれば、処理するデータ量が少なくなると共に、レコーダー本体の発熱も抑えることができるため、稼働時の負荷を低減できる。また装置本体を小型化することができる。 According to the present invention having the above-described configuration, the amount of data to be processed is reduced, and the heat generation of the recorder main body can be suppressed, so that the load during operation can be reduced. Further, the size of the apparatus main body can be reduced.
本発明の画像処理装置のブロック図である。It is a block diagram of the image processing device of the present invention. 録画データの重要部分の実施例１の説明図１である。FIG. 2 is an explanatory diagram 1 of Example 1 of an important part of recorded data. 録画データの重要部分の実施例１の説明図２である。FIG. 3 is an explanatory diagram 2 of Example 1 of an important part of recorded data. 実施例１の重要部分の説明図である。FIG. 4 is an explanatory diagram of an important part of the first embodiment. 変形例の録画データの重要部分の実施例２の説明図１である。FIG. 11 is an explanatory diagram of a second embodiment of an important part of recorded data of a modified example. 変形例の録画データの重要部分の実施例２の説明図２である。FIG. 13 is an explanatory diagram of a second embodiment of an important part of recorded data of a modified example. 変形例の録画データの重要部分の実施例３の説明図１である。FIG. 11 is an explanatory diagram 1 of Example 3 of an important part of recorded data in a modified example. 変形例の録画データの重要部分の実施例３の説明図２である。FIG. 11 is an explanatory diagram 2 of Example 3 of an important part of recorded data of a modified example. 変形例の録画データの重要部分の実施例３の説明図３である。FIG. 13 is an explanatory diagram of Example 3 of an important part of recorded data according to a modified example. 本発明の画像処理装置となるドライブレコーダーの説明図である。FIG. 1 is an explanatory diagram of a drive recorder serving as an image processing device of the present invention. 本発明の画像処理装置となるアクションカメラの説明図である。FIG. 2 is an explanatory diagram of an action camera serving as an image processing device of the present invention. 本発明の画像処理装置による録画処理フロー図である。FIG. 4 is a flowchart of a recording process performed by the image processing apparatus of the present invention. 本発明の再生手段による再生処理のフロー図である。It is a flowchart of the reproduction | regeneration processing by the reproduction | regeneration means of this invention.
　本発明の画像処理装置、画像処理方法、ドライブレコーダーの実施形態について、添付の図面を参照しながら、以下詳細に説明する。
　図１は、本発明の画像処理装置のブロック図である。図２は録画データの重要部分の実施例１の説明図１である。図３は録画データの重要部分の実施例２の説明図２である。図４は実施例１の重要部分の説明図である。図５は変形例の録画データの重要部分の実施例２の説明図１である。図６は変形例の録画データの重要部分の実施例２の説明図２である。図７は変形例の録画データの重要部分の実施例３の説明図１である。図８は変形例の録画データの重要部分の実施例３の説明図２である。図９は変形例の録画データの重要部分の実施例３の説明図３である。図１０は本発明の画像処理装置となるドライブレコーダーの説明図である。図１１は本発明の画像処理装置となるアクションカメラの説明図である。図１２は本発明の画像処理装置による録画処理フロー図である。図１３は本発明の再生手段による再生処理のフロー図である。 Embodiments of an image processing apparatus, an image processing method, and a drive recorder according to the present invention will be described below in detail with reference to the accompanying drawings.
FIG. 1 is a block diagram of an image processing apparatus according to the present invention. FIG. 2 is an explanatory diagram 1 of Example 1 of an important part of recorded data. FIG. 3 is an explanatory diagram 2 of the second embodiment of the important part of the recorded data. FIG. 4 is an explanatory diagram of an important part of the first embodiment. FIG. 5 is an explanatory diagram 1 of the second embodiment of the important part of the recorded data of the modified example. FIG. 6 is an explanatory diagram of Example 2 of an important part of recorded data according to a modification. FIG. 7 is an explanatory diagram 1 of the third embodiment of the important part of the recorded data of the modified example. FIG. 8 is an explanatory diagram 2 of the third embodiment of the important part of the recorded data of the modified example. FIG. 9 is an explanatory diagram of the third embodiment of the important part of the recorded data of the modified example. FIG. 10 is an explanatory diagram of a drive recorder serving as an image processing device of the present invention. FIG. 11 is an explanatory diagram of an action camera serving as the image processing device of the present invention. FIG. 12 is a flowchart of a recording process performed by the image processing apparatus of the present invention. FIG. 13 is a flowchart of a reproducing process by the reproducing means of the present invention.
［撮影手段２０］
　撮影手段２０は、車両の内部に着脱可能とし、前方車両を含む車両の周囲を撮影している。撮影手段は複数の広角（魚眼レンズを含む）レンズを有し、本実施形態では一例とし
て、装置本体の正面（前方）及び背面（後方）に２つの広角（魚眼）レンズ（前方及び後方レンズ）を配置して全方位の画像を取得できる撮像素子（前方及び後方撮像素子）である。このような撮影手段は例えばＣＭＯＳ（Ｃｏｍｐｌｅｍｅｎｔａｒｙ　Ｍｅｔａｌ　Ｏｘｉｄｅ　Ｓｅｍｉｃｏｎｄｕｃｔｏｒ）イメージセンサを適用することができる。 [Photographing means 20]
The photographing means 20 is detachable inside the vehicle, and photographs around the vehicle including the vehicle ahead. The photographing means has a plurality of wide-angle (including fish-eye lenses) lenses. In the present embodiment, as an example, two wide-angle (fish-eye) lenses (front and rear lenses) are provided on the front (front) and back (rear) of the apparatus main body. Are image pickup devices (front and rear image pickup devices) that can acquire images in all directions by disposing the image pickup device. For example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor can be applied to such an imaging unit.
［画質変更手段３０］
　例えば、前記撮影手段２０で撮影する画素数を横７，８０８×縦３，９０４の約３，０００万画素の高解像度とする場合、そのまま動画として記録するとデータ量が膨大となってしまう。
　一方、画素数を横２，８８０×縦１，４４０の約４００万画素の低解像度とする場合、記録するデータ量は抑えられるものの解像度の低下によって前方車両のナンバープレート等など録画した画像中の重要部分が見えなくなるという問題が生じる。 [Image quality changing means 30]
For example, in the case where the number of pixels photographed by the photographing means 20 is a high resolution of about 7,808 × 3,904, which is about 30 million pixels, the data amount becomes enormous if recorded as a moving image as it is.
On the other hand, when the number of pixels is set to a low resolution of about 4 million pixels of 2,880 (horizontal) × 1,440 (vertical), the amount of data to be recorded is suppressed, but the resolution is lowered, and the resolution is reduced, so that the number of pixels in a recorded image such as a license plate of a preceding vehicle is reduced. A problem arises in that important parts cannot be seen.
　そこで画質変更手段３０は、録画した画像中での重要部分となる前方車両のナンバープレートなどが映る中央部分を切り出して、この画素数を横１，９２０×縦１，０８０の約２００万画素の高解像度とし、前方車両の周囲などの重要部分（切り出した部分）を含む箇所の画素数を横２，８８０×縦１，４４０の約４００万画素の低解像度とし、重要部分の画質よりも落している（図２，３，４参照）。
　この結果合計画素数は約６００万画素となり、前述の画像全体を高画質とした場合（約３，０００万画素）と比べて１／５の画素数に押えることができる。そして重要部分の高画質の画像中の前方車両のナンバープレートは見易くなりはっきりと確認できる。また処理するデータ量も低減できるために装置全体の発熱量も抑えることができる。 Therefore, the image quality changing means 30 cuts out a central portion where the license plate of the preceding vehicle, which is an important portion in the recorded image, is reflected, and divides this number of pixels into about 1,920 × 1,080 × 2,080 pixels. The resolution is high, and the number of pixels including important parts (cut-out parts), such as around the vehicle ahead, is a low resolution of about 4 million pixels of 2,880 horizontal × 1,440 vertical, which is lower than the image quality of the important parts. (See FIGS. 2, 3 and 4).
As a result, the total number of pixels is about 6 million pixels, which can be reduced to 1/5 of the number of pixels in the case where the entire image is of high image quality (about 30 million pixels). The license plate of the preceding vehicle in the high-quality image of the important part is easy to see and can be clearly confirmed. Further, since the amount of data to be processed can be reduced, the amount of heat generated by the entire apparatus can be suppressed.
　なお本実施形態の画質とは、映像の質であり、約十メートル離れた前方車両のナンバープレートが見えるなど鮮明な画像を高画質といい、ナンバープレートが見えない画像を低画質という。また、画質は、画素数、フレームレートで数値的に規定しても良い。
　画素数の場合、重要部分は車両から約十メートル離れた前方車両のナンバープレートが視認できる高解像度であり、重要部分以外は、画像全体の様子が分かれば良く、重要部分ほどの解像度は必要ないため、前記高解像度よりも画素数を落とした低解像度である。
　従って、本発明の前記撮影手段２０は、高画質の録画データを取得可能なカメラを用いている。 Note that the image quality in the present embodiment is the quality of the image, and a clear image such as a license plate of a vehicle ahead of about 10 meters is seen as high image quality, and an image without a license plate is seen as low image quality. The image quality may be defined numerically by the number of pixels and the frame rate.
In the case of the number of pixels, the important part has a high resolution so that the license plate of the vehicle ahead, which is about 10 meters away from the vehicle, can be visually recognized. For this reason, the resolution is lower than that of the high resolution with a reduced number of pixels.
Therefore, the photographing means 20 of the present invention uses a camera capable of acquiring high-quality recorded data.
　図１に示すように具体的な本実施形態の画質変更手段３０の構成は、前方撮像素子からの撮影画像を一時保存する前方一時保存部と、後方撮像素子からの撮影画像を一時保存する後方一時保存部と、前方一時保存部で一時保存した録画画像中の重要部分の切り出し部と、前方の録画画像の画質を変更する前方全体画質変更部と、後方の録画画像の画質を変更する後方全体画質変更部を有している。
　このような画質変更手段３０は、画像の位置座標に基づいて重要部分の大きさ又は位置を任意に変更可能に構成している。この切り出しの範囲となる重要部分は、この他、図５、６に示すように、車両の前方及び側方及び後方の連続した箇所、換言するとパノラマに設定しても良い。このような範囲では、前方車両のナンバープレートに加えて、自車両の周囲の様子（側方及び後方車両、歩道の歩行者、信号機など）も確認できる。
　なお画質変更手段３０による重要部分の切り出しは、外部に接続した人工知能を介したナンバープレート認識、顔認識、標識又は信号認識などにより自動設定するように構成しても良い
　また録画画像中の重要部分は、複数設定することもできる（図７－９参照）。図示のように正面側で前方車両のナンバープレートと、背面側でドライバーを重要部分としても良い。
　また画質変更手段３０は、保存する前記撮影画像を前記重要部分よりも画質を落とす範囲内で装置のスペック（メモリ容量など）に応じて任意に設定変更することができる。 As shown in FIG. 1, a specific configuration of the image quality changing unit 30 of the present embodiment includes a front temporary storage unit that temporarily stores a captured image from a front image sensor, and a rear side that temporarily stores a captured image from a rear image sensor. A temporary storage section, a cutout section of an important portion in the recorded image temporarily stored in the front temporary storage section, a front overall image quality changing section for changing the image quality of the front recorded image, and a rear section for changing the image quality of the rear recorded image. It has an overall image quality changing unit.
Such image quality changing means 30 is configured to be able to arbitrarily change the size or position of the important part based on the position coordinates of the image. The important portion which is the range of the cutout may be set as a continuous portion in front of, on the side of, and behind the vehicle, in other words, as a panorama, as shown in FIGS. In such a range, in addition to the license plate of the preceding vehicle, the surroundings of the own vehicle (side and rear vehicles, pedestrians on sidewalks, traffic lights, and the like) can be checked.
The extraction of the important part by the image quality changing means 30 may be automatically set by license plate recognition, face recognition, sign or signal recognition via an externally connected artificial intelligence. A plurality of parts can be set (see FIG. 7-9). As shown in the figure, a license plate of a vehicle in front may be used on the front side, and a driver may be used as an important part on the back side.
Further, the image quality changing means 30 can arbitrarily change the setting of the captured image to be saved according to the specifications (memory capacity and the like) of the apparatus within a range where the image quality is lower than that of the important part.
［記憶手段４０］
　記憶手段４０は、画質変更手段３０によって画像処理された画像データを保存している。この記憶手段４０は、例えば、ＤＲＡＭ（Ｄｙｎａｍｉｃ　Ｒａｎｄｏｍ　Ａｃｃｅｓｓ　Ｍｅｍｏｒｙ）を適用することができる。なお記憶手段４０は、外部端末（携帯端末など）で録画画像を再生する際に容易に持ち出せるＳＤメモリ等の外部ストレージを付帯させた構成を採用してもよい。
　図１に示すように具体的な記憶手段４０の構成は、重要部分切り出し部からの高解像度の重要部分を記憶する重要部分記憶部と、前方全体画質変更部からの画質を落とした（低解像度の）前方撮影画像及び後方全体画質変更部からの画質を落とした（低解像度の）後方撮影画像を記録する前後全体記憶部を有している。 [Storage means 40]
The storage means 40 stores the image data processed by the image quality changing means 30. As the storage unit 40, for example, a DRAM (Dynamic Random Access Memory) can be applied. Note that the storage unit 40 may have a configuration in which an external storage such as an SD memory that can be easily taken out when the recorded image is reproduced by an external terminal (such as a portable terminal) is attached.
As shown in FIG. 1, the specific configuration of the storage means 40 is such that an important part storage unit for storing a high-resolution important part from an important part cutout unit and an image quality from a front whole image quality changing unit are reduced (low resolution). 1) and a whole front and rear storage unit for recording the rear photographed image with a reduced image quality (low resolution) from the front photographed image and the rear whole image quality changing unit.
［再生手段５０］
　再生手段５０は、記憶手段４０に保存された録画画像を再生可能なアプリケーションソフトである。再生手段５０は、録画画像中の重要部分を囲む枠を設定して再生中に表示させている（図３，６参照）。再生中、この枠を選択すると、重要部分のファイル（画像データ）に切り替えて、この部分を拡大表示するように構成している（図４参照）。ここで再生手段５０は、撮影手段２０による全体の録画画像と、重要部分の録画データを同期させて再生している。このため、再生中の任意の時間で重要部分を選択すると、その時間における重要部分に切り替えて再生することができる。
　なお再生手段５０は装置本体と有線又は無線を介して接続する外部端末又は装置本体にインストールしている。また、録画画像を再生する際には、ケーブル接続（有線）の他にも、通信回線（３Ｇ／ＬＴＥ／５Ｇ）を使用して装置本体からデータ転送を行うと良い。
　またあらかじめ重要部分を複数設定した場合には、再生時において、ユーザが任意に選択し、選択した重要部分を拡大表示で再生しても良い。 [Reproduction means 50]
The reproduction means 50 is application software capable of reproducing the recorded image stored in the storage means 40. The reproduction means 50 sets a frame surrounding an important part in the recorded image and displays it during reproduction (see FIGS. 3 and 6). When this frame is selected during reproduction, the file is switched to a file (image data) of an important portion, and this portion is enlarged and displayed (see FIG. 4). Here, the reproducing means 50 reproduces the entire recorded image by the photographing means 20 and the recorded data of the important part in synchronization. Therefore, when an important part is selected at an arbitrary time during reproduction, it is possible to switch to the important part at that time and reproduce the image.
The reproducing means 50 is installed in an external terminal or an apparatus main body connected to the apparatus main body via a cable or wirelessly. When reproducing the recorded image, it is preferable to transfer data from the apparatus body using a communication line (3G / LTE / 5G) in addition to the cable connection (wired).
When a plurality of important parts are set in advance, the user may arbitrarily select the important parts during reproduction and reproduce the selected important parts in an enlarged display.
［ドライブレコーダー７０］
　図１０に示すように画像処理装置の一例となるドライブレコーダー７０は、レコーダー本体の表裏面に魚眼（広角）レンズを備えた全天球カメラとなる撮影手段２０を搭載している。レコーダー本体は、車両内のフロントガラス面に着脱可能とし、前方レンズ（不図示）で車両前方及び側方を撮影し、後方レンズで車両後及び側方を撮影できる。そして表裏面の魚眼レンズの映像を合成することで、３６０度の全方位を撮影できる。 [Drive recorder 70]
As shown in FIG. 10, a drive recorder 70, which is an example of an image processing apparatus, has a photographing unit 20 that is a spherical camera having a fish-eye (wide-angle) lens mounted on the front and back surfaces of the recorder main body. The recorder body can be attached to and detached from the windshield of the vehicle, and can photograph the front and side of the vehicle with a front lens (not shown), and can photograph the rear and side of the vehicle with a rear lens. By synthesizing the images of the front and back fisheye lenses, 360-degree omnidirectional images can be taken.
［アクションカメラ８０］
　図１１は画像処理装置となるアクションカメラの説明図であり、（Ａ）は一方の主面（背面）、（Ｂ）は他方の主面（正面）を示している。図示のように画像処理装置の一例となるアクションカメラ８０は、カメラ本体の表裏面に魚眼（広角）レンズを備えた全天球カメラとなる撮影手段２０を搭載している。カメラ本体は、背面の広角（後方）レンズで撮影者本人を撮影し、正面の広角（前方）レンズで撮影者の周囲を撮影できる。そして表裏面の魚眼レンズの映像を合成することで、３６０度の全方位を撮影できる。 [Action camera 80]
11A and 11B are explanatory diagrams of an action camera serving as an image processing device, wherein FIG. 11A shows one main surface (back surface), and FIG. 11B shows the other main surface (front surface). As shown in the figure, an action camera 80 which is an example of the image processing apparatus has a photographing unit 20 which is a spherical camera having a fish-eye (wide-angle) lens on the front and back surfaces of the camera body. The camera body can photograph the photographer himself with the wide-angle (rear) lens on the back, and can photograph around the photographer with the wide-angle (front) lens on the front. By synthesizing the images of the front and back fisheye lenses, 360-degree omnidirectional images can be taken.
　なお、本発明の画像処理装置は、装置本体に撮影手段２０、画質変更手段３０、記憶手段４０を配置し、外部端末に再生手段５０、表示部６０を配置した構成を採用することにより、装置全体の小型化を図ることができる。この他、前記装置本体に再生手段５０、表示部６０を追加した構成を採用することもできる。 The image processing apparatus according to the present invention employs a configuration in which a photographing unit 20, an image quality changing unit 30, and a storage unit 40 are arranged in the apparatus main body, and a reproducing unit 50 and a display unit 60 are arranged in an external terminal. The overall size can be reduced. In addition, a configuration in which a reproducing unit 50 and a display unit 60 are added to the apparatus main body may be adopted.
　上記構成による画像処理装置を用いた画像処理方法について以下説明する。
　撮影画像の保存は以下のように行う（図１２参照）。
［重要部分の切り出し］
　画質変更手段３０によってあらかじめ撮影手段２０で撮影した撮影画像の内で重要部分
（前方車両のナンバープレートが映る中央部分など）を切り出す処理を行う。切り出す範囲は、画像データの位置座標に基づいて、大きさ、位置を任意に設定変更することができ、この他、少なくとも前方車両のナンバープレートを含む車両の前方及び側方及び後方の連続したパノラマ画像に設定することもできる。また重要部分は複数、例えば、前方及び後方車両のナンバープレートが見える箇所などに設定することもできる。
　また、重要部分を含む撮影画像は、重要部分よりも画質を落とす設定（例えば、解像度を落とす、フレームレート数を落とすなど）を行う。 An image processing method using the image processing apparatus having the above configuration will be described below.
The captured image is stored as follows (see FIG. 12).
[Cut out important parts]
The image quality changing unit 30 performs a process of cutting out an important portion (a central portion where a license plate of a preceding vehicle is reflected) from a captured image captured by the capturing unit 20 in advance. The range to be cut out can be arbitrarily set and changed in size and position based on the position coordinates of the image data. In addition, a continuous panorama in front, side, and rear of the vehicle including at least the license plate of the vehicle in front. It can also be set to an image. In addition, a plurality of important portions can be set, for example, at locations where the license plates of the front and rear vehicles can be seen.
In addition, for a captured image including an important portion, settings are made to lower the image quality than the important portion (for example, lowering the resolution, lowering the number of frame rates, etc.).
［撮影］
　撮影手段２０で撮影する。撮影画像は前方及び後方一時保存部で一時保存される。
［保存（切り出し部分は高解像度／撮影画像は低解像度）］
　画質変更手段３０によって画像処理された画像データを記憶手段４０に保存する。例えば、画質変更手段３０で切り出した重要部分は高解像度で保存する。
　これにより、重要部分の高画質の画像中の前方車両のナンバープレートは見易くなりはっきりと確認できる。また全体を低解像度で保存することで処理するデータ量も低減できるために装置全体の発熱量も抑えることができる。 [photograph]
Photographing is performed by the photographing means 20. The captured image is temporarily stored in the front and rear temporary storage units.
[Save (cut out part is high resolution / captured image is low resolution)]
The image data processed by the image quality changing means 30 is stored in the storage means 40. For example, the important portion cut out by the image quality changing means 30 is stored at a high resolution.
Thereby, the license plate of the preceding vehicle in the high-quality image of the important part is easy to see and can be clearly confirmed. In addition, since the entire data is stored at a low resolution, the amount of data to be processed can be reduced, so that the heat generation of the entire apparatus can be suppressed.
　録画画像の再生は以下のように行う（図１３参照）。
［再生］
　例えば、再生手段５０を導入した外部端末に画像処理装置を接続して、表示部６０に全天球の録画画像を表示（再生）する。このとき、重要部分よりも画質を落とした全天球の録画画像が再生され、また再生画面中には、枠（点線など）で囲われた重要部分が表示されている。 The reproduction of the recorded image is performed as follows (see FIG. 13).
[Playback]
For example, the image processing apparatus is connected to an external terminal in which the reproducing unit 50 is installed, and the recorded image of the celestial sphere is displayed (reproduced) on the display unit 60. At this time, the recorded image of the celestial sphere with a lower image quality than the important part is reproduced, and the important part surrounded by a frame (such as a dotted line) is displayed on the reproduction screen.
［重要部分を選択］
　全天球の録画画像を再生中に任意の箇所で重要部分を示す枠を選択する。
［切替えファイルの再生］
　再生している全天球の録画画像と同期した重要部分の録画画像に切替えたファイルが再生される。この切替えファイルは全天球の録画画像よりも画質が良く自車両から約十メートル離れた前方車両のナンバープレートを容易に視認できる。
　このような本発明の画像処理方法によれば、再生画像中の重要部分を容易に視認できると共に、稼働時の負荷を低減できる。 [Select important parts]
During playback of the recorded image of the celestial sphere, a frame indicating an important portion is selected at an arbitrary position.
[Play switching file]
The file switched to the important part recorded image synchronized with the recorded image of the celestial sphere being reproduced is reproduced. This switching file has better image quality than the recorded image of the celestial sphere, and makes it easy to visually recognize the license plate of the vehicle ahead, which is about 10 meters away from the own vehicle.
According to such an image processing method of the present invention, an important portion in a reproduced image can be easily visually recognized, and a load during operation can be reduced.
　以上、本発明の好ましい実施形態について説明した。しかしながら、本発明は、上記実施形態に何ら制限されることなく、本発明の主旨を逸脱しない範囲において、種々の変更が可能である。
　また、本発明は、実施形態において示された組み合わせに限定されることなく、種々の組み合わせによって実施可能である。 The preferred embodiment of the present invention has been described above. However, the present invention is not limited to the above embodiment, and various modifications can be made without departing from the gist of the present invention.
In addition, the present invention can be implemented by various combinations without being limited to the combinations shown in the embodiments.
　本発明は、例えば、車載型ドライブレコーダーとして、広く適用することができる。 The present invention can be widely applied, for example, as a vehicle-mounted drive recorder.
１０　画像処理装置
２０　撮影手段
３０　画質変更手段
４０　記憶手段
５０　再生手段
６０　表示部
７０　ドライブレコーダー
８０　アクションカメラ REFERENCE SIGNS LIST 10 image processing device 20 photographing means 30 image quality changing means 40 storage means 50 reproducing means 60 display unit 70 drive recorder 80 action camera

Claims (10)

  1. 　車両の車室内に設置されて少なくとも前方車両を含む前記車両の周囲を撮影する撮影手段と、
    　前記撮影手段の撮影画像中の重要部分を切り出すと共に、前記撮影画像の画質を落とす画質変更手段と、
    　切り出した前記重要部分及び画質を落とした前記撮影画像を保存する記憶手段と、
    　を有することを特徴とする画像処理装置。     Photographing means for photographing the periphery of the vehicle, including at least the vehicle ahead, which is installed in the cabin of the vehicle,
    An image quality changing unit that cuts out an important part in the captured image of the imaging unit and reduces the image quality of the captured image,
    Storage means for storing the cut out of the important portion and the captured image of reduced image quality,
    An image processing apparatus comprising:
  2. 　車両の車室内に設置されて少なくとも前方車両を含む前記車両の周囲を高解像度で撮影する撮影手段と、
    　前記撮影手段の撮影画像中の重要部分を高解像度で切り出すと共に、前記撮影画像を低解像度に落とす画質変更手段と、
    　切り出した前記高解像度の重要部分及び前記低解像度の撮影画像を保存する記憶手段と、
    　を有することを特徴とする画像処理装置。     Photographing means for photographing the surroundings of the vehicle including at least the vehicle ahead at a high resolution, which is installed in the cabin of the vehicle,
    An image quality changing unit that cuts out an important part in the captured image of the imaging unit at a high resolution, and reduces the captured image to a low resolution.
    Storage means for storing the cut out of the high-resolution important portion and the low-resolution captured image,
    An image processing apparatus comprising:
  3. 　請求項１又は２に記載された画像処理装置において、前記撮影手段は、前記車両を中心とした全天球を撮影する複数の広角レンズを備えることを特徴とする画像処理装置。 The image processing apparatus according to claim 1 or 2, wherein the photographing unit includes a plurality of wide-angle lenses that photograph the celestial sphere centering on the vehicle.
  4. 　請求項１ないし３のいずれか１に記載された画像処理装置において、前記重要部分は、少なくとも前記前方車両のナンバープレートを含む範囲であることを特徴とする画像処理装置。 The image processing apparatus according to any one of claims 1 to 3, wherein the important part is a range including at least a license plate of the preceding vehicle.
  5. 　請求項４に記載された画像処理装置において、前記重要部分は、前記車両の前方及び側方及び後方の連続した箇所であることを特徴とする画像処理装置。 The image processing apparatus according to claim 4, wherein the important portion is a continuous portion in front, side, and rear of the vehicle.
  6. 　請求項１ないし５のいずれか１に記載された画像処理装置において、前記画質変更手段は、画像の位置座標に基づいて前記重要部分の大きさ又は位置を任意に変更可能なことを特徴とする画像処理装置。 6. The image processing apparatus according to claim 1, wherein the image quality changing unit can arbitrarily change a size or a position of the important part based on position coordinates of an image. Image processing device.
  7. 　請求項１ないし６のいずれか１に記載された画像処理装置において、前記画質変更手段は、保存する前記撮影画像を前記重要部分よりも画質を落とす範囲内で任意に設定変更可能なことを特徴とする画像処理装置。 7. The image processing apparatus according to claim 1, wherein the image quality changing unit can arbitrarily change the setting of the stored captured image within a range where the image quality is lower than that of the important part. Image processing apparatus.
  8. 　請求項１ないし７のいずれか１に記載された画像処理装置において、前記画質変更手段で画像処理した画像を再生する際に前記重要箇所を枠内で表示し、前記重要箇所を選択した場合に画面を前記重要箇所に切り替えて再生する再生手段を備えたことを特徴とする画像処理装置。 The image processing apparatus according to claim 1, wherein when the image processed by the image quality changing unit is reproduced, the important part is displayed in a frame, and the important part is selected. An image processing apparatus, comprising: a reproducing unit that switches a screen to the important part and reproduces the screen.
  9. 　請求項１ないし８のいずれか１に記載された画像処理装置を備えることを特徴とするドライブレコーダー。 A drive recorder comprising the image processing device according to any one of claims 1 to 8.
  10. 　車両の車室内に設置される撮影手段で少なくとも前方車両を含む前記車両の周囲を録画する工程と、
    　前記撮影手段の撮影画像中の重要部分を切り出すと共に、前記撮影画像の画質を落として画質変更する工程と、
    　切り出した前記重要部分及び画質を落とした前記撮影画像を保存する工程と、
    を有することを特徴とする画像処理方法。     A step of recording the periphery of the vehicle including at least the vehicle ahead by photographing means installed in the cabin of the vehicle,
    Cutting out an important part in the photographed image of the photographing means, and changing the image quality by reducing the image quality of the photographed image;
    A step of saving the cut out important part and the captured image with reduced image quality,
    An image processing method comprising:
PCT/JP2019/009997 2018-06-28 2019-03-12 Image processing device, image processing method, and drive recorder WO2020003630A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018123704A JP7198599B2 (en) 2018-06-28 2018-06-28 Image processing device, image processing method, drive recorder
JP2018-123704 2018-06-28

Publications (1)

Publication Number Publication Date
WO2020003630A1 true WO2020003630A1 (en) 2020-01-02

Family

ID=68986926

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/009997 WO2020003630A1 (en) 2018-06-28 2019-03-12 Image processing device, image processing method, and drive recorder

Country Status (2)

Country Link
JP (1) JP7198599B2 (en)
WO (1) WO2020003630A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115841711A (en) * 2022-11-22 2023-03-24 深圳市京华信息技术有限公司 Control method and device of automobile data recorder, automobile data recorder and medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7705091B2 (en) * 2022-05-31 2025-07-09 トヨタ自動車株式会社 Vehicle image storage device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009175848A (en) * 2008-01-22 2009-08-06 Nec Corp Drive recorder device, drive recording method, program, and recording medium
WO2009141951A1 (en) * 2008-05-19 2009-11-26 パナソニック株式会社 Image photographing device and image encoding device
JP2010279022A (en) * 2009-04-30 2010-12-09 Sanyo Electric Co Ltd Imaging device
JP2016110639A (en) * 2014-12-05 2016-06-20 株式会社リコー Service system, information processor, and service providing method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004070742A (en) * 2002-08-07 2004-03-04 Canon I-Tech Inc Image data generation device, image output system, image data generation method, program and storage medium
JP5774425B2 (en) * 2011-09-16 2015-09-09 Kddi株式会社 Image analysis apparatus and image evaluation apparatus
JP6014037B2 (en) * 2012-02-09 2016-10-25 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Image recognition apparatus, image recognition method, program, and integrated circuit
TWI592883B (en) * 2016-04-22 2017-07-21 財團法人車輛研究測試中心 Image recognition system and its adaptive learning method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009175848A (en) * 2008-01-22 2009-08-06 Nec Corp Drive recorder device, drive recording method, program, and recording medium
WO2009141951A1 (en) * 2008-05-19 2009-11-26 パナソニック株式会社 Image photographing device and image encoding device
JP2010279022A (en) * 2009-04-30 2010-12-09 Sanyo Electric Co Ltd Imaging device
JP2016110639A (en) * 2014-12-05 2016-06-20 株式会社リコー Service system, information processor, and service providing method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115841711A (en) * 2022-11-22 2023-03-24 深圳市京华信息技术有限公司 Control method and device of automobile data recorder, automobile data recorder and medium
CN115841711B (en) * 2022-11-22 2024-06-04 深圳市京华信息技术有限公司 Control method and device of automobile data recorder, automobile data recorder and medium

Also Published As

Publication number Publication date
JP2020005148A (en) 2020-01-09
JP7198599B2 (en) 2023-01-04

Similar Documents

Publication Publication Date Title
JP7282798B2 (en) Imaging device, image processing method, and program
US8736680B1 (en) Method and system for split-screen video display
US20090213218A1 (en) System and method for multi-resolution storage of images
US20150288886A1 (en) Imaging device, imaging system, and imaging method
JP4844979B2 (en) Image processing method and imaging apparatus using the image processing method
US20140176700A1 (en) Driving assistant system and method
US20140176699A1 (en) Driving assistant system and method
US20140184737A1 (en) Driving assistant system and method
JPWO2020090512A1 (en) Imaging device, control method, and program
US8373773B2 (en) Imaging apparatus for generating a wide-angle image
JP2023046953A (en) Image processing system, mobile device, image processing method, and computer program
JP2011124879A (en) Imaging system for vehicle and in-vehicle imaging apparatus
WO2020003630A1 (en) Image processing device, image processing method, and drive recorder
JP3352096B2 (en) Vehicle exterior monitoring device
JP2003179798A (en) Digital camera
WO2020204016A1 (en) Drive recorder installation method, drive recorder, and automobile
JP4606322B2 (en) Vehicle driving support device
JP2003116029A (en) Imaging device and image recorder using the same
JP2004235965A (en) Recording system for image data at vehicle driving
JP2023046965A (en) Image processing system, moving device, image processing method, and computer program
CN107872616B (en) Driving recording method and device
CN116843595A (en) Fusion photographing method and device, electronic equipment and vehicle
JP6844055B1 (en) Surveillance camera
TWM541406U (en) Vehicular image integration system
JP2006121320A (en) Omnidirectional monitor camera device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19825148

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19825148

Country of ref document: EP

Kind code of ref document: A1