CN105959566A - Image pickup mode switching method and device, and automobile data recorder - Google Patents

Abstract

The invention discloses a method and device for switching camera modes and a driving recorder, which includes dividing each frame of sampled images obtained by sampling the video signal according to the sampling frequency into a grid array of M rows and N columns, and acquiring The brightness value of each pre-selected grid; then generate the first brightness value according to the brightness values of the first Q grids with the highest brightness value, and generate the second brightness value according to the brightness values of the first Q grids with the lowest brightness value Brightness value; calculate the brightness ratio of the first brightness value and the second brightness value, and compare the brightness ratio with a preset threshold value; if there is a brightness ratio of Y frames in the continuous X frame sampling image are greater than the preset threshold value, then switch to the HDR mode. The invention obtains the brightness ratio value from the sampled images of continuous frames collected according to the collection frequency and compares it with the preset threshold value to realize the intelligent control of switching the HDR mode, which is convenient for users to use.

Description

A camera mode switching method, device and driving recorder

technical field

The present invention relates to the technical field of telecommunication, and more specifically, to a method and device for switching camera modes, and a driving recorder.

Background technique

With the development of software and hardware of digital optics, digital camera technology is constantly being updated, and new technologies and concepts are constantly being proposed and realized. Taking people’s daily use of driving recorders as an example, in order to solve the problem that the photos taken in LDR (Low-Dynamic Range, LDR, low dynamic range image) mode appear to be too bright in bright places or too dark in dark places, people began to use HDR (High-Dynamic Range, high dynamic range) mode shooting, because the bright part is too bright or the dark part is too dark in the LDR mode is mostly caused by the large difference between light and dark in the current scene and the loss of details in the bright or dark place of. HDR is to synthesize the final HDR image according to the LDR images of different exposure times and the LDR images corresponding to the best details of each exposure time, so that the obtained HDR images can better reflect the visual effects in the real environment and solve the problem of LDR. In the mode, the bright part is too bright or the dark part is too dark. The continuous emergence of driving recorders with HDR mode on the market also illustrates this trend.

At the same time, there are many other similar situations in people's lives, such as mobile phone photography and virtual reality technology, but people find that these camera devices with HDR mode often require users to manually set the camera mode, and most ordinary users Without professional photography knowledge and skills, these ordinary users don’t know which scenes should use HDR mode to get good shooting effects. In addition, there are more modes in high-end cameras, so manual switching of HDR mode is not smart enough and inconvenient for ordinary people. user use.

Contents of the invention

In view of the above problems, the present invention proposes a camera mode switching method, device and driving recorder.

To achieve this goal, the present invention adopts following technical scheme:

Option One:

A method for switching camera modes is provided, including:

Shooting and generating a video signal according to the shooting frequency, sampling the video signal according to the sampling frequency to obtain a sampled image;

Dividing each frame of the sampled image into a grid array of M rows and N columns, and obtaining the brightness value of each pre-selected grid, where M and N are both positive integers greater than 1;

Obtain the first Q grids with the highest brightness values and the first Q grids with the lowest brightness values, and generate a first brightness value according to the brightness values of the first Q grids with the highest brightness values, and generate the first brightness value according to the brightness values of the first Q grids with the lowest brightness values. The brightness values of the first Q grids generate a second brightness value, where Q is a positive integer greater than 1;

calculating a brightness ratio between the first brightness value and the second brightness value, and comparing the brightness ratio with a preset threshold value, and judging whether the brightness ratio is greater than the preset threshold value;

If the brightness ratios of Y frames in consecutive X frames of sampled images are greater than the preset threshold value, then switch to the HDR mode, where X and Y are both positive integers greater than 1, and X is greater than or equal to Y.

In the present invention, after the switching to the HDR mode, further steps are included:

If the luminance ratios of Z frames in consecutive X frames of sampled images are all smaller than the preset threshold value, the HDR mode is terminated, wherein Z is a positive integer and X is greater than or equal to Z.

In the present invention, before the video signal is generated according to the shooting frequency, it also includes the steps:

Obtain the speed information of the camera equipment;

The magnitude of the shooting frequency is determined based on the magnitude of the speed information.

In the present invention, before the video signal is generated according to the shooting frequency, it also includes the steps:

Obtain the speed information of the camera equipment;

The magnitude of the sampling frequency is determined based on the magnitude of the velocity information.

In the present invention, the pre-selected grid is: K rows of grids located on the upper part of the grid array, wherein K is a positive integer and M is greater than K.

In the present invention, the brightness value is an ambient light intensity value, and the acquired brightness value of each preselected grid is an ambient light intensity value of each preselected grid.

In the present invention, said obtaining the ambient light intensity value of each pre-selected grid includes the following steps:

converting each of the preselected grids into grayscale images;

The ambient light intensity values of the preselected grids are acquired according to the grayscale image.

In the present invention, the brightness value is the Y value of the YUV color space, and the brightness value of each pre-selected grid is obtained by obtaining the Y value of each pre-selected grid.

In the present invention, the first brightness value is the sum of brightness values of the first Q grids with the highest brightness values, and generating the first brightness value according to the brightness values of the first Q grids with the highest brightness values includes:

Calculate the sum of brightness values of the first Q grids with the highest brightness values.

In the present invention, the first brightness value is the average value of the brightness values of the first Q grids with the highest brightness values, and generating the first brightness value according to the brightness values of the first Q grids with the highest brightness values includes :

calculating the sum of the brightness values of the first Q grids with the highest brightness values;

The average value of the brightness values of the first Q grids with the highest brightness values is calculated according to the sum of the brightness values.

In the present invention, the second brightness value is the sum of brightness values of the first Q grids with the lowest brightness value, and generating the second brightness value according to the brightness values of the first Q grids with the lowest brightness value includes:

Calculate the sum of brightness values of the first Q grids with the lowest brightness values.

In the present invention, the second brightness value is the average value of the brightness values of the first Q grids with the lowest brightness values, and generating the second brightness value according to the brightness values of the first Q grids with the lowest brightness values includes :

calculating the sum of the brightness values of the first Q grids with the lowest brightness values;

Calculate the average value of the brightness values of the first Q grids with the lowest brightness values according to the sum of the brightness values.

Option II:

A camera mode switching device is provided, including:

A sampling module, configured to capture and generate a video signal according to the shooting frequency, and obtain a sampled image from the video signal according to the sampling frequency;

The grid module is used to equally divide each frame of sampling image into a grid array of M rows and N columns, and obtain the brightness value of each pre-selected grid, wherein M and N are both positive integers greater than 1;

A screening generation module, configured to obtain the first Q grids with the highest brightness values and the first Q grids with the lowest brightness values, and generate a first brightness value according to the brightness values of the first Q grids with the highest brightness values, and generating a second brightness value according to the brightness values of the first Q grids with the lowest brightness values, where Q is a positive integer greater than 1;

A ratio module, configured to calculate a brightness ratio between the first brightness value and the second brightness value, compare the brightness ratio with a preset threshold value, and determine whether the brightness ratio is greater than the preset threshold limit value;

The first judging module is used to switch to the HDR mode if the brightness ratio of the Y frame in the continuous X frame sampling image is greater than the preset threshold value, wherein X and Y are both positive integers greater than 1, And X is greater than or equal to Y.

In the present invention, the device also includes:

The second judging module is used to end the HDR mode after switching to the HDR mode, if the brightness ratios of the Z frames in the continuous X frame sampled images are all less than the preset threshold value, where Z is a positive integer and X is greater than or equal to Z.

In the present invention, the device includes:

The first speed module is used to obtain the speed information of the camera device before shooting and generating video signals according to the shooting frequency;

The first setting module is used to determine the magnitude of the shooting frequency based on the magnitude of the speed information.

In the present invention, the device includes:

The second speed module is used to obtain the speed information of the camera device before shooting and generating the video signal according to the shooting frequency;

The second setting module is used to determine the magnitude of the sampling frequency based on the magnitude of the speed information.

In the present invention, the pre-selected grid is: K rows of grids located on the upper part of the grid array, wherein K is a positive integer and M is greater than K.

In the present invention, the brightness value is an ambient light intensity value, and the acquired brightness value of each preselected grid is the ambient light intensity value of each preselected grid.

In the present invention, the grid module includes:

A conversion unit, configured to convert each pre-selected grid into a grayscale image;

The light intensity unit is configured to acquire the ambient light intensity value of each preselected grid according to the grayscale image.

In the present invention, the brightness value is the Y value of the YUV color space, and the brightness value of each pre-selected grid is obtained by obtaining the Y value of each pre-selected grid.

In the present invention, the first brightness value is the sum of the brightness values of the first Q grids with the highest brightness value, and the screening generation module includes:

The first adding unit is configured to calculate the sum of brightness values of the first Q grids with the highest brightness values.

In the present invention, the first brightness value is the average value of the brightness values of the first Q grids with the highest brightness values, and the screening generation module includes:

The second adding unit is used to calculate the sum of the brightness values of the first Q grids with the highest brightness values;

The first average unit is configured to calculate the average value of the brightness values of the first Q cells with the highest brightness values according to the sum of the brightness values.

In the present invention, the second brightness value is the sum of the brightness values of the first Q grids with the lowest brightness value, and the screening generation module includes:

The third adding unit is configured to calculate the sum of the brightness values of the first Q cells with the lowest brightness values.

In the present invention, the second brightness value is the average value of the brightness values of the first Q grids with the lowest brightness value, and the screening generation module includes:

A fourth adding unit, configured to calculate the sum of the brightness values of the first Q grids with the lowest brightness values;

The second mean unit is configured to calculate the average value of the brightness values of the first Q cells with the lowest brightness values according to the sum of the brightness values.

third solution:

A driving recorder is provided, comprising:

one or more processors;

memory;

camera;

one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, the one or more program programs are configured to:

Shooting and generating a video signal according to the shooting frequency, sampling the video signal according to the sampling frequency to obtain a sampled image;

Dividing each frame of the sampled image into a grid array of M rows and N columns, and obtaining the brightness value of each pre-selected grid, where M and N are both positive integers greater than 1;

Obtain the first Q grids with the highest brightness values and the first Q grids with the lowest brightness values, and generate a first brightness value according to the brightness values of the first Q grids with the highest brightness values, and generate the first brightness value according to the brightness values of the first Q grids with the lowest brightness values. The brightness values of the first Q grids generate a second brightness value, where Q is a positive integer greater than 1;

calculating a brightness ratio between the first brightness value and the second brightness value, and comparing the brightness ratio with a preset threshold value, and judging whether the brightness ratio is greater than the preset threshold value;

If the brightness ratios of Y frames in consecutive X frames of sampled images are greater than the preset threshold value, then switch to the HDR mode, where X and Y are both positive integers greater than 1, and X is greater than or equal to Y.

In the present invention, after the switching to the HDR mode, further steps are included:

If the luminance ratios of Z frames in consecutive X frames of sampled images are all smaller than the preset threshold value, the HDR mode is terminated, wherein Z is a positive integer and X is greater than or equal to Z.

In the present invention, before the video signal is generated according to the shooting frequency, it also includes the steps:

Obtain the speed information of the camera equipment;

The magnitude of the shooting frequency is determined based on the magnitude of the speed information.

In the present invention, before the video signal is generated according to the shooting frequency, it also includes the steps:

Obtain the speed information of the camera equipment;

The magnitude of the sampling frequency is determined based on the magnitude of the speed information.

In the present invention, the pre-selected grid is: K rows of grids located on the upper part of the grid array, wherein K is a positive integer and M is greater than K.

In the present invention, the brightness value is an ambient light intensity value, and the acquired brightness value of each preselected grid is an ambient light intensity value of each preselected grid.

In the present invention, said obtaining the ambient light intensity value of each pre-selected grid includes the following steps:

converting each of the preselected grids into grayscale images;

The ambient light intensity values of the preselected grids are acquired according to the grayscale image.

In the present invention, the brightness value is the Y value of the YUV color space, and the brightness value of each pre-selected grid is obtained by obtaining the Y value of each pre-selected grid.

In the present invention, the first brightness value is the sum of brightness values of the first Q grids with the highest brightness values, and generating the first brightness value according to the brightness values of the first Q grids with the highest brightness values includes:

Calculate the sum of brightness values of the first Q grids with the highest brightness values.

In the present invention, the first brightness value is the average value of the brightness values of the first Q grids with the highest brightness values, and generating the first brightness value according to the brightness values of the first Q grids with the highest brightness values includes :

calculating the sum of the brightness values of the first Q grids with the highest brightness values;

The average value of the brightness values of the first Q grids with the highest brightness values is calculated according to the sum of the brightness values.

In the present invention, the second brightness value is the sum of brightness values of the first Q grids with the lowest brightness value, and generating the second brightness value according to the brightness values of the first Q grids with the lowest brightness value includes:

Calculate the sum of brightness values of the first Q grids with the lowest brightness values.

In the present invention, the second brightness value is the average value of the brightness values of the first Q grids with the lowest brightness values, and generating the second brightness value according to the brightness values of the first Q grids with the lowest brightness values includes :

calculating the sum of the brightness values of the first Q grids with the lowest brightness values;

Calculate the average value of the brightness values of the first Q grids with the lowest brightness values according to the sum of the brightness values.

Compared with the prior art, the invention has the following beneficial effects of a camera mode switching method, device and driving recorder:

The method and device for switching camera modes and the driving recorder acquire the first brightness value and the second brightness value from the sampled images of continuous frames according to the collection frequency and compare them with the preset threshold value to realize the switching The intelligent control of the HDR mode avoids the problem that ordinary users do not know which scenes should use the HDR mode to obtain a good shooting effect. At the same time, it also simplifies the multi-mode selection of high-end cameras to a certain extent, which is convenient for users.

The method and device for switching the camera mode and the driving recorder reduce the processing time of the sampled image by first gridding the sampled image and using the gridded grid as the processing object to obtain its brightness value. The amount of calculated data reduces the power consumption of hardware circuits, conforms to the market trend of low power consumption, and is more energy-saving and environmentally friendly. At the same time, it also reduces the thermal potential of real-time and long-term camera equipment to a certain extent.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 shows a schematic flow diagram of a method for switching camera modes in one embodiment of the present invention;

Fig. 2 shows a schematic flow chart of generating a video signal according to the shooting frequency in the method for switching the camera mode in one embodiment of the present invention;

Fig. 3 shows a schematic diagram of a preselected grid example of a method for switching camera modes in an embodiment of the present invention;

Fig. 4 shows a block diagram of a camera mode switching device in an embodiment of the present invention.

detailed description

In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention.

In some processes described in the specification and claims of the present invention and the above-mentioned drawings, a plurality of operations appearing in a specific order are contained, but it should be clearly understood that these operations may not be performed in the order in which they appear herein Execution or parallel execution, the serial numbers of the operations, such as 101, 102, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. Additionally, these processes can include more or fewer operations, and these operations can be performed sequentially or in parallel. It should be noted that the descriptions of "first" and "second" in this article are used to distinguish different messages, devices, modules, etc. are different types.

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts fall within the protection scope of the present invention.

Please refer to Fig. 1. In some embodiments, a method for switching camera modes is provided, which is applied to shooting scenes of camera equipment, wherein the camera equipment includes cameras, mobile phones, driving recorders, and other cameras with camera or camera functions. device of. For the convenience of description, this embodiment is described by taking the method applied to the video recording mode of the driving recorder as an example.

In some embodiments, the method for switching camera modes includes the following steps:

Step 100: Shoot and generate a video signal according to the shooting frequency, and obtain a sampling image from the video signal according to the sampling frequency.

Please refer to FIG. 2. In some embodiments, such as in an embedded system, the generation of a video signal according to shooting frequency includes the following steps 202-208:

Step 202: Open the video device file, and initialize the parameters of the video capture.

Specifically, in an embedded system, all peripherals are regarded as a special file, which becomes a device file, which can be read and written like an ordinary file. For example, for the camera device file /dev/v4l/video0 driven by V4L2, you can directly call the open function to open the device file.

In some embodiments, the parameter initialization of the video capture includes setting the capture window parameters of the video, setting the video dot matrix format and dot matrix size, and setting the video shooting frequency.

In some embodiments, the shooting frequency can be set according to the speed information of the camera device. Specifically, before generating a video signal according to the shooting frequency, the steps include:

Obtain the speed information of the camera equipment;

The magnitude of the shooting frequency is determined based on the magnitude of the speed information described above.

In some embodiments, considering that the driving recorder is fixed on the vehicle, the speed of the above-mentioned camera equipment may also be the vehicle speed. For example, when the vehicle speed is 10KM/H, the sampling frequency is 30 frames/S; when the vehicle speed is 30KM/H, the sampling frequency is 60 frames/S.

Step 204: Apply for multiple frame buffers for video capture.

Specifically, in the embedded system, the driver applies for several frame buffers in the memory to store video data. The application program applies for several frame buffers of video data through VIDIOC_REQBUFS. The number of applied frame buffers is generally not less than 3. Each frame buffer stores a frame of video data, and these frame buffers are in the kernel space. Then query the length and offset address of the frame buffer in the kernel space through VIDIOC_QUERYBUF. Finally, the address of the applied kernel space frame buffer is mapped to the user space address through MMAP(), so that the data of the frame buffer can be directly processed. Among them, VIDIOC_REQBUFS is an identifier for memory allocation; VIDIOC_QUERYBUF is also an identifier for converting the data cache allocated in VIDIOC_REQBUFS into a physical address; MMAP() is a shared memory creation mechanism, which is passed on the disk Create a file on the above, and open up a space for mapping in each process memory.

In some embodiments, the above-mentioned frame buffer for applying for multiple video captures is a frame buffer for applying for five video captures.

Step 206: queue the requested frame buffer in the video capture input queue, and start video capture.

Specifically, in the embedded system, the driver first defines two queues in the process of video processing: the video capture input queue and the video capture output queue, wherein the video capture input queue is a queue waiting for the driver to store video data; The output queue is the queue into which the driver has put video data. The video capture is not started until the application program queues the above frame buffer in the video capture input queue.

Step 208: The driver starts to collect video data, and the application program takes out the frame buffer from the video capture output queue, and puts the frame buffer back into the video capture input queue after processing, and collects continuous video data repeatedly.

Specifically, after video capture is started, the driver starts to capture a frame of data, and puts the collected data into the first frame buffer of the video capture input queue. After one frame of data capture is completed, that is, the first frame buffer is full. After a frame of data, the driver moves the frame buffer to the video capture output queue, waiting for the application to take it out from the output queue. The driver next collects the next frame of data and puts it into the second frame buffer. After the same frame buffer is full of the next frame of data, it is put into the video capture output queue.

The application program takes out the frame buffer containing video data from the video capture output queue, and processes the video data in the frame buffer, such as encoding or compressing. Finally, the application program puts the frame buffer that has processed the data back into the video capture input queue, so that the capture can be performed cyclically.

In some embodiments, the format of the video data in the frame buffer is YUV, wherein YUV is a color coding method adopted by the European television system. Among them, Y represents the brightness, that is, the grayscale value; U and V represent the chroma.

It is worth mentioning that YUV, which is often proposed in practice, is also called YCbCr. This YCbCr is part of the ITU-R BT1601 proposal during the development of the video standard of the World Digital Organization. It is essentially YUV scaled and offset. Reprint. Among them, Y has the same meaning as Y in YUV, and Cb and Cr also refer to color.

The video data in the above-mentioned processing frame buffer realizes H.264 encoding through the underlying encoding library, such as NVIDIA's NVCUVENC library, which can implement H.264 graphics processor encoding, which receives the original YUV data and then encodes it to generate NAL unit. Among them, H.264 is a highly compressed digital video codec standard proposed by the Joint Video Group jointly composed of the ITU-T Video Coding Expert Group and the ISO/IEC Dynamic Image Expert Group. This standard is usually called H.264/AVC or AVC/H.264 or H.264/MPEG-4AVC or MPEG-4/H.264AVC; NAL unit is a variable-length byte string of certain syntax elements , including one byte of header information used to indicate the data type and several integer bytes of payload data, the H.264 coded video sequence includes a series of NAL units.

In some embodiments, the sampled image obtained by sampling the video signal according to the sampling frequency is obtained by sampling the sampled image according to the sampling frequency from the frame buffer containing video data in the video capture output queue.

Similarly, the sampling frequency can be set according to the speed information of the camera device. Specifically, before the video signal is generated according to the shooting frequency, it includes:

Obtain the speed information of the camera equipment;

The magnitude of the sampling frequency is determined based on the magnitude of the speed information described above.

In some embodiments, considering that the driving recorder is fixed on the vehicle, the speed of the above-mentioned camera equipment may also be the vehicle speed. For example, when the vehicle speed is 10KM/H, the sampling frequency is 1 frame/S; when the vehicle speed is 30KM/H, the sampling frequency is 2 frames/S.

Step 102: Divide each frame of the sampled image into a grid array of M rows and N columns, and acquire brightness values of each pre-selected grid, where M and N are both positive integers greater than 1.

Specifically, each frame of sampled image is divided into M×N grids in the two-dimensional direction, and each grid uses a brightness value to represent the brightness of the area, so that each frame of sampled image is discretized into M×N brightness values.

In some embodiments, in the embedded system, the OPENCV library is used to crop each frame of the sampled image to obtain a grid array equally divided into M rows and N columns. Among them, OPENCV is a cross-platform computer vision library licensed by Berkeley Software Distribution, which can run on Linux, Windows and Mac OS operating systems. It consists of a series of C functions and a small number of C++ classes. It also provides interfaces for languages such as Python, Ruby, and MATLAB, and implements many general-purpose algorithms in image processing and computer vision.

The above-mentioned pre-selected grid refers to the grid after removing the noise in the grid array of M rows and N columns. These parts often interfere with subsequent data processing, so they need to be cropped.

In some embodiments, the pre-selected grid is K rows of grids located on the upper part of the grid array, where K is a positive integer and M is greater than K.

Please refer to Fig. 3, Fig. 3 shows when M=5, N=5, the example schematic diagram of the pre-selected grid of K=4, in Fig. 3, this sampling image is divided into 5 * 5 in the two-dimensional direction Grid where the bottom 1 row of the sampled image is cropped. The acquisition of the luminance values of each pre-selected grid is to acquire the luminance values of K×N grids.

In some embodiments, the brightness value is an ambient light intensity value, and the brightness value of each pre-selected grid is obtained by obtaining the ambient light intensity value of each pre-selected grid.

In the embedded system, considering that the video data format in the frame buffer is YUV, therefore, the brightness value is the Y value of the YUV color space, and the above-mentioned acquisition of the brightness value of each pre-selected grid is the Y value of each pre-selected grid value.

In some embodiments, in order to facilitate the processing of image data, video signals in multiple signal modes are converted into a unified RGB data mode by a video processing chip. Then, the acquisition of the ambient light intensity value of each pre-selected grid includes the following steps:

converting each of the preselected grids into grayscale images;

The ambient light intensity values of the preselected grids are acquired according to the above gray scale image.

Among them, the above-mentioned RGB data mode is a color standard in the industry, and various colors are obtained by changing the three color channels of red, green, and blue and superimposing them with each other. RGB represents The color of the three channels of red, green, and blue, this standard includes almost all the colors that human vision can perceive, and is one of the most widely used color systems at present.

In some embodiments, the aforementioned conversion of each preselected grid into a grayscale image can be realized by the famous psychological formula Gray=R×0.299+G×0.587+B×0.114.

Step 104: Obtain the first Q grids with the highest brightness values and the first Q grids with the lowest brightness values, and generate a first brightness value according to the brightness values of the first Q grids with the highest brightness values, and according to the The brightness values of the first Q grids with the lowest brightness values generate a second brightness value, where Q is a positive integer greater than 1.

Preferably, the aforementioned Q number is two.

In some embodiments, obtaining the first Q grids with the highest brightness values and the first Q grids with the lowest brightness values includes the following steps:

Sort the brightness values of the K×N grids from high to low through a sorting algorithm;

From the above sorting, the first Q grids with the highest brightness values and the first Q grids with the lowest brightness values are obtained.

Specifically, the sorting algorithm includes one or more of direct insertion sorting, Hill sorting, simple selection sorting, heap sorting, bubble sorting, quick sorting, merge sorting, and radix sorting. in,

Direct insertion sorting inserts a record to be sorted into an appropriate position in the previously sorted sequence according to the size of its key until all records are inserted;

Hill sorting is to first divide the entire record sequence to be sorted into several subsequences for direct insertion sorting, and when the records in the entire sequence are basically in order, then perform direct insertion sorting on all records in turn;

Simple selection sorting is to select the smallest (or largest) number and exchange it with the number in the first position in a set of numbers to be sorted; then find the smallest (or largest) and second number among the remaining numbers The number of positions is exchanged, and so on, until the n-1th element (the penultimate number) is compared with the nth element (the last number);

Heap sorting refers to a sorting algorithm designed using the data structure of the stacked tree. It is a kind of selection sorting, which can quickly locate the elements of the specified index by using the characteristics of the array; the heap is divided into a large root heap and a small root heap. Complete binary tree, where the requirement of the large root heap is that the value of each node is not greater than the value of its parent node;

Bubble sorting is to compare and adjust two adjacent numbers from top to bottom for all the numbers in the range that are not yet sorted in the set of numbers to be sorted, so that the larger number goes to the next row. Sink, smaller ones rise;

Quick sorting is to divide the data to be sorted into two independent parts by one-pass sorting, and all the data in one part is smaller than all the data in the other part, and then quickly sort the two parts of the data in this way, the whole The sorting process can be performed recursively so that the entire data becomes an ordered sequence;

Merge sort is to merge two (or more than two) ordered lists into a new ordered list, that is, divide the sequence to be sorted into several subsequences, each subsequence is ordered, and then divide the ordered subsequences Merge into an overall ordered sequence;

Radix sorting divides the array into a finite number of buckets. Each bucket is sorted individually.

In some embodiments, sorting the brightness values of the K×N grids from high to low by a sorting algorithm is sorting the brightness values of the K×N grids from high to low by bubble sorting.

In some embodiments, the first brightness value is the sum of the brightness values of the first Q grids with the highest brightness values, and generating the first brightness value according to the brightness values of the first Q grids with the highest brightness values includes:

Calculate the sum of the brightness values of the first Q grids with the highest brightness values.

In some embodiments, the first brightness value is an average value of the brightness values of the first Q grids with the highest brightness values, and generating the first brightness value based on the brightness values of the first Q grids with the highest brightness values includes:

Calculate the sum of the brightness values of the first Q grids with the highest brightness values;

The average value of the brightness values of the first Q grids with the highest brightness values is calculated according to the sum of the brightness values above.

In some embodiments, the second brightness value is the sum of the brightness values of the first Q grids with the lowest brightness values, and generating the second brightness value according to the brightness values of the first Q grids with the lowest brightness values includes:

Calculate the sum of the brightness values of the first Q grids with the lowest brightness values.

In some embodiments, the second brightness value is an average value of the brightness values of the first Q grids with the lowest brightness values, and the generating of the second brightness value based on the brightness values of the first Q grids with the lowest brightness values includes:

Calculate the sum of the brightness values of the first Q grids with the lowest brightness values;

The average value of the brightness values of the first Q grids with the lowest brightness values is calculated according to the sum of the brightness values above.

Step 106: Calculate the brightness ratio between the first brightness value and the second brightness value, compare the brightness ratio with a preset threshold value, and determine whether the brightness ratio is greater than the preset threshold value .

Specifically, the preset threshold value is also called critical value, which refers to the lowest value or the highest value that an effect can produce.

In some embodiments, after judging whether the brightness ratio is greater than a preset threshold value, the following steps are included:

If the brightness ratio is greater than the preset threshold value, switch the HDR mode counter to increase by one unit;

If the brightness ratio is less than or equal to the preset threshold value, the end HDR mode counter is incremented by one unit.

Step 108: If the luminance ratios of Y frames in consecutive X frames of sampled images are greater than the preset threshold value, then switch to the HDR mode, where X and Y are both positive integers greater than 1, and X is greater than or is equal to Y.

Specifically, the continuous X frames of sampled images are consecutive X frames of sampled images obtained by sampling from a video signal according to the sampling frequency.

In some embodiments, if the brightness ratios of Y frames in consecutive X frames of sampled images are all greater than the preset threshold value, then switching to the HDR mode includes the following steps:

Calculate the luminance ratio of the first luminance value and the second luminance value of each frame of sampled images of continuous X frames of sampled images, and compare the luminance ratio with a preset threshold value to determine whether the luminance ratio is greater than the preset threshold value;

If the brightness ratio of the above sampled image is greater than the preset threshold value, then switch to the HDR mode counter and increase one unit; if the brightness ratio of Y frames in the continuous X frame sampled image is greater than the preset threshold value, then switch to HDR mode .

In some embodiments, if the above-mentioned brightness ratios of Y frames in the continuous X frames of sampled images are all greater than the preset threshold value, switching to the HDR mode includes the following steps:

Calculate the luminance ratio of the first luminance value and the second luminance value of each frame of sampled images of continuous X frames of sampled images, and compare the luminance ratio with a preset threshold value to determine whether the luminance ratio is greater than the preset threshold value;

If the brightness ratio of the above-mentioned sampled image is less than the preset threshold value, the end of the HDR mode counter increases by one unit; if the brightness ratio of Z frames in the continuous X frame sampled image is less than the above-mentioned preset threshold value, the HDR mode is ended ; Among them, Z is a positive integer and X is greater than or equal to Z.

Please refer to Fig. 4, based on the same inventive concept, in an embodiment, a camera mode switching device is also provided, including: a sampling module 4001, a grid module 4003, a screening generation module 4005, a ratio module 4007 and a first judgment Module 4009, where,

The sampling module 4001 is configured to capture and generate a video signal according to the shooting frequency, and obtain a sampled image from the video signal according to the sampling frequency;

The grid module 4003 is used to equally divide each frame of the sampled image into a grid array of M rows and N columns, and obtain the brightness value of each pre-selected grid, wherein the M and N are both positive integers greater than 1;

A screening generation module 4005, configured to obtain the first Q grids with the highest brightness values and the first Q grids with the lowest brightness values, and generate a first brightness value according to the brightness values of the first Q grids with the highest brightness values, and generating a second brightness value according to the brightness values of the first Q grids with the lowest brightness values, where Q is a positive integer greater than 1;

Ratio module 4007, configured to calculate a brightness ratio between the first brightness value and the second brightness value, compare the brightness ratio with a preset threshold value, and determine whether the brightness ratio is greater than the preset Threshold value;

The first judging module 4009 is used to switch to the HDR mode if the brightness ratios of Y frames in the continuous X frames of sampled images are greater than the preset threshold value, wherein X and Y are both positive integers greater than 1, And X is greater than or equal to Y.

The above-mentioned device also includes:

The second judging module is used to end the HDR mode after switching to the HDR mode, if the brightness ratios of the Z frames in the continuous X frame sampling images are all less than the above-mentioned preset threshold value, wherein Z is a positive integer and X Greater than or equal to Z.

The above-mentioned device also includes:

The first speed module is used to obtain the speed information of the camera device before shooting and generating video signals according to the shooting frequency;

The first setting module is configured to determine the magnitude of the shooting frequency based on the magnitude of the above speed information.

The above-mentioned device also includes:

The second speed module is used to obtain the speed information of the camera device before shooting and generating the video signal according to the shooting frequency;

The second setting module is configured to determine the magnitude of the sampling frequency based on the magnitude of the above speed information.

In some embodiments, the pre-selected grid is: K rows of grids located on the upper part of the grid array, where K is a positive integer and M is greater than K.

In some embodiments, the brightness value is an ambient light intensity value, and the brightness value of each preselected grid is acquired to acquire the ambient light intensity value of each preselected grid.

In some embodiments, grid module 4003 includes:

A conversion unit, which is used to convert each pre-selected grid into a grayscale image;

The light intensity unit is configured to obtain the ambient light intensity value of each pre-selected grid according to the above grayscale image.

In some embodiments, the brightness value is a Y value of a YUV color space, and the brightness value of each preselected grid is acquired as a Y value of each preselected grid.

In some embodiments, the first brightness value is the sum of the brightness values of the first Q grids with the highest brightness values, and the screening generation module 4005 includes:

The first adding unit is used to calculate the sum of the brightness values of the first Q grids with the highest brightness values.

In some embodiments, the first brightness value is the average value of the brightness values of the first Q grids with the highest brightness values, and the screening generation module 4005 includes:

The second adding unit is used to calculate the sum of the brightness values of the first Q grids with the highest brightness value;

The first mean value unit is configured to calculate the average value of the brightness values of the first Q grids with the highest brightness values according to the sum of the brightness values.

In some embodiments, the second brightness value is the sum of the brightness values of the first Q grids with the lowest brightness values, and the screening generation module 4005 includes:

The third adding unit is used to calculate the sum of the brightness values of the first Q grids with the lowest brightness values.

In some embodiments, the second brightness value is the average value of the brightness values of the first Q grids with the lowest brightness values, and the screening generation module 4005 includes:

The fourth adding unit is used to calculate the sum of the brightness values of the first Q grids with the lowest brightness values;

The second mean unit is configured to calculate the average value of the brightness values of the first Q grids with the lowest brightness values according to the sum of the brightness values.

Based on the same inventive concept, a driving recorder is also provided, including one or more processors, memory, cameras, and one or more application programs, wherein,

The memory can be used to store software programs and modules, and the processor executes various functional applications and data processing of the driving recorder by running the software programs and modules stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); The data created by the use of the recorder (such as audio data, phone book, etc.) and the like. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices;

The display may be used to display information input by or provided to the user and various menus of the drive recorder. The display may include a display panel. Optionally, the display panel may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like. Further, the touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it will be sent to the processor to determine the type of the touch event, and then the processor will display the touch event on the display panel according to the type of the touch event. Provide corresponding visual output.

The one or more application programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs are configured to:

Shooting and generating a video signal according to the shooting frequency, sampling the video signal according to the sampling frequency to obtain a sampled image;

Dividing each frame of the sampled image into a grid array of M rows and N columns, and obtaining the brightness value of each pre-selected grid, where M and N are both positive integers greater than 1;

Obtain the first Q grids with the highest brightness values and the first Q grids with the lowest brightness values, and generate a first brightness value according to the brightness values of the first Q grids with the highest brightness values, and generate the first brightness value according to the brightness values of the first Q grids with the lowest brightness values. The brightness values of the first Q grids generate a second brightness value, where Q is a positive integer greater than 1;

calculating a brightness ratio between the first brightness value and the second brightness value, and comparing the brightness ratio with a preset threshold value, and judging whether the brightness ratio is greater than the preset threshold value;

If the brightness ratios of Y frames in consecutive X frames of sampled images are greater than the preset threshold value, then switch to the HDR mode, where X and Y are both positive integers greater than 1, and X is greater than or equal to Y.

In some embodiments, after switching to the HDR mode, the steps further include:

If the luminance ratios of Z frames in consecutive X frames of sampled images are all smaller than the preset threshold value, the HDR mode is terminated, wherein Z is a positive integer and X is greater than or equal to Z.

In some embodiments, before the video signal is generated according to the shooting frequency, the step further includes:

Obtain the speed information of the camera equipment;

The magnitude of the shooting frequency is determined based on the magnitude of the speed information described above.

In some embodiments, before the video signal is generated according to the shooting frequency, the step further includes:

Obtain the speed information of the camera equipment;

The magnitude of the sampling frequency is determined based on the magnitude of the velocity information.

In some embodiments, the pre-selected grid is: K rows of grids located on the upper part of the grid array, where K is a positive integer and M is greater than K.

In some embodiments, the brightness value is an ambient light intensity value, and the brightness value of each pre-selected grid is obtained by obtaining the ambient light intensity value of each pre-selected grid.

In some embodiments, the acquisition of the ambient light intensity values of the pre-selected grids includes the following steps:

Convert each pre-selected grid to a grayscale image;

The ambient light intensity values of the preselected grids are acquired according to the above gray scale image.

In some embodiments, the brightness value is a Y value of a YUV color space, and the brightness value of each preselected grid is acquired as a Y value of each preselected grid.

In some embodiments, the first brightness value is the sum of the brightness values of the first Q grids with the highest brightness values, and generating the first brightness value according to the brightness values of the first Q grids with the highest brightness values includes:

Calculate the sum of the brightness values of the first Q grids with the highest brightness values.

In some embodiments, the first brightness value is an average value of the brightness values of the first Q grids with the highest brightness values, and generating the first brightness value based on the brightness values of the first Q grids with the highest brightness values includes:

Calculate the sum of the brightness values of the first Q grids with the highest brightness values;

The average value of the brightness values of the first Q grids with the highest brightness values is calculated according to the sum of the brightness values above.

In some embodiments, the second brightness value is the sum of the brightness values of the first Q grids with the lowest brightness values, and generating the second brightness value according to the brightness values of the first Q grids with the lowest brightness values includes:

Calculate the sum of the brightness values of the first Q grids with the lowest brightness values.

In some embodiments, the second brightness value is an average value of the brightness values of the first Q grids with the lowest brightness values, and the generating of the second brightness value based on the brightness values of the first Q grids with the lowest brightness values includes:

Calculate the sum of the brightness values of the first Q grids with the lowest brightness values;

The average value of the brightness values of the first Q grids with the lowest brightness values is calculated according to the sum of the brightness values above.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium can include: Read Only Memory (ROM, Read Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk, etc.

Compared with the prior art, the invention has the following beneficial effects of a camera mode switching method, device and driving recorder:

The method and device for switching camera modes and the driving recorder acquire the first brightness value and the second brightness value from the sampled images of continuous frames according to the collection frequency and compare them with the preset threshold value to realize the switching The intelligent control of HDR mode avoids the problem that ordinary users do not know which scenes should use HDR mode to obtain a good shooting effect, and also simplifies the selection of multi-modes of high-end cameras to a certain extent, which is convenient for users.

The method and device for switching the camera mode, and the driving recorder reduce the processing time of the sampled image by gridding the sampled image and using the gridded grid as the processing object to obtain its brightness value. The amount of calculated data reduces the power consumption of hardware circuits, conforms to the market trend of low power consumption, and is more energy-saving and environmentally friendly. At the same time, it also reduces the thermal potential of real-time and long-term camera equipment to a certain extent.

A method, device, and equipment for sending information provided by the present invention have been introduced in detail above. For those of ordinary skill in the art, according to the idea of the embodiment of the present invention, there will be changes in the specific implementation and application scope. In summary, the contents of this specification should not be construed as limiting the present invention.

Claims (10)

1. A method for camera mode switching, comprising: Shooting and generating a video signal according to the shooting frequency, sampling the video signal according to the sampling frequency to obtain a sampled image; Dividing each frame of the sampled image into a grid array of M rows and N columns, and obtaining the brightness value of each pre-selected grid, where M and N are both positive integers greater than 1; Obtain the first Q grids with the highest brightness values and the first Q grids with the lowest brightness values, and generate a first brightness value according to the brightness values of the first Q grids with the highest brightness values, and generate the first brightness value according to the brightness values of the first Q grids with the lowest brightness values. The brightness values of the first Q grids generate a second brightness value, where Q is a positive integer greater than 1; calculating a brightness ratio between the first brightness value and the second brightness value, and comparing the brightness ratio with a preset threshold value, and judging whether the brightness ratio is greater than the preset threshold value; If the brightness ratios of Y frames in consecutive X frames of sampled images are greater than the preset threshold value, then switch to the HDR mode, where X and Y are both positive integers greater than 1, and X is greater than or equal to Y. 2. The method for switching camera mode according to claim 1, characterized in that, after said switching to HDR mode, further comprising the steps of: If the luminance ratios of Z frames in consecutive X frames of sampled images are all smaller than the preset threshold value, the HDR mode is terminated, wherein Z is a positive integer and X is greater than or equal to Z. 3. The method for switching between camera modes according to claim 1, wherein, before the video signal is generated according to the shooting frequency, the method further comprises the steps of: Obtain the speed information of the camera equipment; The magnitude of the shooting frequency is determined based on the magnitude of the speed information. 4. The method for switching between camera modes according to claim 1, wherein, before the video signal is generated according to the shooting frequency, the method further comprises the steps of: Obtain the speed information of the camera equipment; The magnitude of the sampling frequency is determined based on the magnitude of the velocity information. 5. A camera mode switching device, characterized in that it comprises: A sampling module, configured to capture and generate a video signal according to the shooting frequency, and obtain a sampled image from the video signal according to the sampling frequency; The grid module is used to equally divide each frame of sampling image into a grid array of M rows and N columns, and obtain the brightness value of each pre-selected grid, wherein M and N are both positive integers greater than 1; A screening generation module, configured to obtain the first Q grids with the highest brightness values and the first Q grids with the lowest brightness values, and generate a first brightness value according to the brightness values of the first Q grids with the highest brightness values, and generating a second brightness value according to the brightness values of the first Q grids with the lowest brightness values, where Q is a positive integer greater than 1; A ratio module, configured to calculate a brightness ratio between the first brightness value and the second brightness value, compare the brightness ratio with a preset threshold value, and determine whether the brightness ratio is greater than the preset threshold limit value; The first judging module is used to switch to the HDR mode if the brightness ratio of the Y frame in the continuous X frame sampling image is greater than the preset threshold value, wherein X and Y are both positive integers greater than 1, And X is greater than or equal to Y. 6. The device for switching camera modes according to claim 5, wherein the device further comprises: The second judging module is used to end the HDR mode if, after switching to the HDR mode, the brightness ratios of Z frames in the continuous X frame sampling images are all less than the preset threshold value, where Z is a positive integer and X is greater than or equal to Z. 7. The camera mode switching device according to claim 5, characterized in that the device comprises: The first speed module is used to obtain the speed information of the camera device before shooting and generating video signals according to the shooting frequency; The first setting module is used to determine the magnitude of the shooting frequency based on the magnitude of the speed information. 8. The camera mode switching device according to claim 5, characterized in that the device comprises: The second speed module is used to obtain the speed information of the camera device before shooting and generating the video signal according to the shooting frequency; The second setting module is used to determine the magnitude of the sampling frequency based on the magnitude of the speed information. 9. A driving recorder, characterized in that it comprises: one or more processors; memory; camera; one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, the one or more program programs are configured to: Shooting and generating a video signal according to the shooting frequency, sampling the video signal according to the sampling frequency to obtain a sampled image; Dividing each frame of the sampled image into a grid array of M rows and N columns, and obtaining the brightness value of each pre-selected grid, where M and N are both positive integers greater than 1; Obtain the first Q grids with the highest brightness values and the first Q grids with the lowest brightness values, and generate a first brightness value according to the brightness values of the first Q grids with the highest brightness values, and generate the first brightness value according to the brightness values of the first Q grids with the lowest brightness values. The brightness values of the first Q grids generate a second brightness value, where Q is a positive integer greater than 1; calculating a brightness ratio between the first brightness value and the second brightness value, and comparing the brightness ratio with a preset threshold value, and judging whether the brightness ratio is greater than the preset threshold value; If the brightness ratios of Y frames in consecutive X frames of sampled images are greater than the preset threshold value, then switch to the HDR mode, where X and Y are both positive integers greater than 1, and X is greater than or equal to Y. 10. The driving recorder according to claim 9, characterized in that, after switching to the HDR mode, further comprising the steps of: If the luminance ratios of Z frames in consecutive X frames of sampled images are all smaller than the preset threshold value, the HDR mode is terminated, wherein Z is a positive integer and X is greater than or equal to Z.