[go: up one dir, main page]

CN114625526A - Electronic equipment and video recording control method, device and storage medium thereof - Google Patents

Electronic equipment and video recording control method, device and storage medium thereof Download PDF

Info

Publication number
CN114625526A
CN114625526A CN202011475970.9A CN202011475970A CN114625526A CN 114625526 A CN114625526 A CN 114625526A CN 202011475970 A CN202011475970 A CN 202011475970A CN 114625526 A CN114625526 A CN 114625526A
Authority
CN
China
Prior art keywords
processing chip
processor
frequency
image signal
video recording
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011475970.9A
Other languages
Chinese (zh)
Inventor
韩世广
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202011475970.9A priority Critical patent/CN114625526A/en
Priority to PCT/CN2021/132361 priority patent/WO2022127530A1/en
Publication of CN114625526A publication Critical patent/CN114625526A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/505Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/20Processor architectures; Processor configuration, e.g. pipelining
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/5012Processor sets

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Studio Devices (AREA)

Abstract

本申请涉及一种电子设备及其录像控制方法、装置及存储介质。所述方法包括:基于当前的录像场景,设置应用处理芯片和图像信号处理芯片中的各个处理器的频率;以及采用第一调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的频率进行调节。从而既能保证相机效果又能降低整机功耗。

Figure 202011475970

The present application relates to an electronic device and a video recording control method, device and storage medium thereof. The method includes: setting the frequency of each processor in the application processing chip and the image signal processing chip based on the current video recording scene; frequency is adjusted. Thus, the camera effect can be ensured and the power consumption of the whole machine can be reduced.

Figure 202011475970

Description

电子设备及其录像控制方法、装置及存储介质Electronic equipment and video recording control method, device and storage medium thereof

技术领域technical field

本申请涉及图像处理技术领域,特别是涉及一种电子设备及其录像控制方法、装置及存储介质。The present application relates to the technical field of image processing, and in particular, to an electronic device and a video recording control method, device and storage medium thereof.

背景技术Background technique

目前,移动终端包括具有图像信号处理的主芯片以及位于主芯片之前的图像前处理芯片,通过主芯片和图像前处理芯片对图像信号进行相应的处理,但是由于图像前处理芯片包括中央处理器、网络处理器等处理器且各处理器的功耗较大,尤其是网络处理器的功耗非常大,导致整机功耗非常大。At present, the mobile terminal includes a main chip with image signal processing and an image pre-processing chip located before the main chip, and the image signal is processed correspondingly through the main chip and the image pre-processing chip. Processors such as network processors and the power consumption of each processor are relatively large, especially the power consumption of the network processor is very large, resulting in very large power consumption of the whole machine.

相关技术中,通过使用小模型的网络处理器来降低功耗;或者,通过降低相机传感器的分辨率与帧率来降低图像前处理芯片中各处理器的计算量以达到降低功耗的目的,但是这些方式均会影响到相机效果。In the related art, the power consumption is reduced by using a network processor of a small model; or, the calculation amount of each processor in the image preprocessing chip is reduced by reducing the resolution and frame rate of the camera sensor to achieve the purpose of reducing power consumption, But these methods will affect the camera effect.

发明内容SUMMARY OF THE INVENTION

基于此,有必要针对上述技术问题,提供一种既能保证相机效果又能降低整机功耗的电子设备及其录像控制方法、装置及存储介质。Based on this, it is necessary to provide an electronic device, a video recording control method, a device and a storage medium thereof, which can not only ensure the effect of the camera but also reduce the power consumption of the whole machine, aiming at the above technical problems.

一种电子设备的录像控制方法,电子设备包括应用处理芯片和图像信号处理芯片,方法包括:A video recording control method for electronic equipment, the electronic equipment includes an application processing chip and an image signal processing chip, and the method includes:

基于当前的录像场景,设置应用处理芯片和图像信号处理芯片中的各个处理器的频率;以及Based on the current recording scene, set the frequency of each processor in the application processing chip and the image signal processing chip; and

采用第一调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的频率进行调节。The frequency of at least one processor in the application processing chip and the image signal processing chip is adjusted using the first scheduling policy.

一种计算机可读存储介质,其上存储有电子设备的录像控制程序,该电子设备的录像控制程序被处理器执行时实现上述的电子设备的录像控制方法。A computer-readable storage medium stores a video recording control program of an electronic device thereon, and when the video recording control program of the electronic device is executed by a processor, realizes the above-mentioned video recording control method of the electronic device.

一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的电子设备的录像控制程序,处理器执行录像控制程序时,实现上述的电子设备的录像控制方法。An electronic device includes a memory, a processor, and a video recording control program of the electronic device stored on the memory and running on the processor. When the processor executes the video recording control program, the above-mentioned video recording control method of the electronic device is realized.

一种电子设备的录像控制装置,包括:A video recording control device for electronic equipment, comprising:

设置模块,用于基于当前的录像场景,设置应用处理芯片和图像信号处理芯片中的各个处理器的频率;以及a setting module for setting the frequency of each processor in the application processing chip and the image signal processing chip based on the current recording scene; and

调节模块,用于采用第一调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的频率进行调节。The adjustment module is configured to adjust the frequency of at least one processor in the application processing chip and the image signal processing chip by adopting the first scheduling strategy.

上述电子设备及其录像控制方法、装置及存储介质,通过基于当前的录像场景,设置应用处理芯片和图像信号处理芯片中的各个处理器的频率,并采用第一调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的频率进行调节,从而既能保证录像效果又能降低整机功耗。The above-mentioned electronic equipment and its video recording control method, device and storage medium, by setting the frequency of each processor in the application processing chip and the image signal processing chip based on the current video recording scene, and adopting the first scheduling strategy for the application processing chip and the image signal processing chip. The frequency of at least one processor in the signal processing chip is adjusted, so as to ensure the video recording effect and reduce the power consumption of the whole machine.

附图说明Description of drawings

图1为一个实施例中电子设备的录像控制方法的应用环境图;1 is an application environment diagram of a video recording control method of an electronic device in one embodiment;

图2为一个实施例中电子设备的录像控制方法的流程示意图;2 is a schematic flowchart of a video recording control method of an electronic device in one embodiment;

图3为另一个实施例中电子设备的录像控制方法的流程示意图;3 is a schematic flowchart of a video recording control method of an electronic device in another embodiment;

图4为又一个实施例中电子设备的录像控制方法的流程示意图;4 is a schematic flowchart of a video recording control method of an electronic device in another embodiment;

图5为一个实施例中电子设备的录像控制方法的软件架构示意图;5 is a schematic diagram of a software architecture of a video recording control method of an electronic device in one embodiment;

图6为另一个实施例中电子设备的录像控制方法的软件架构示意图;6 is a schematic diagram of a software architecture of a video recording control method of an electronic device in another embodiment;

图7为一个实施例中中央处理器的能耗与能力关系图;7 is a graph showing the relationship between power consumption and capability of a central processing unit in one embodiment;

图8为一个实施例中优化前中央处理器的能力曲线图;FIG. 8 is a capability graph of the central processing unit before optimization in one embodiment;

图9为一个实施例中优化前中央处理器的能力曲线图;FIG. 9 is a capability graph of the central processing unit before optimization in one embodiment;

图10为一个实施例中电子设备的录像控制装置的结构框图。FIG. 10 is a structural block diagram of a video recording control apparatus of an electronic device in one embodiment.

具体实施方式Detailed ways

为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

本申请提供的电子设备的录像控制方法,可以应用于如图1所示的电子设备中。电子设备包括图像信号处理芯片和应用处理芯片。其中,应用处理芯片主要用于处理传统图像处理算法,如坏点校正、时域降噪、3D降噪、白平衡、自动曝光等,具体可包括图像信号处理(Image Signal Processing,ISP)模块、中央处理器(Central Processing Unit,CPU)、图形处理器(Graphics Processing Unit,GPU)、数字信号处理器(Digital SignalProcessing,DSP)以及双倍速率同步动态随机存储器(Double Data Rate,DDR)等,图像信号处理模块可包括图像前端处理器(Image Front End,IFE)、图像处理器(ImageProcessing Engine,IPE)以及拜尔处理器(Bayer Processing Segment,BPS)等。The video recording control method of an electronic device provided by the present application can be applied to the electronic device as shown in FIG. 1 . Electronic equipment includes image signal processing chips and application processing chips. Among them, the application processing chip is mainly used to process traditional image processing algorithms, such as dead pixel correction, temporal noise reduction, 3D noise reduction, white balance, automatic exposure, etc. Central Processing Unit (CPU), Graphics Processing Unit (GPU), Digital Signal Processing (DSP), and Double Data Rate (DDR), etc., image The signal processing module may include an Image Front End (IFE), an Image Processing Engine (IPE), a Bayer Processing Segment (BPS), and the like.

图像信号处理芯片主要用来做差异化算法,如RAW(未经加工图像)域的逆光拍照、高动态范围图像(High Dynamic Range,HDR)拍照、预览以及视频效果加强等,具体可包括前期图像信号处理(Pre Image Signal Processing,PreISP)模块、中央处理器、双倍速率同步动态随机存储器以及移动行业处理器接口(Mobile Industry Processor Interface,MIPI)等,前期图像信号处理模块可包括前端处理器(Front End,FE)、网络处理器(Neural-network Processing Unit,NPU)以及后端处理器(Back End,BE)等。电子设备可以为手机、平板电脑以及智能相机等具有拍照或摄像功能的设备。The image signal processing chip is mainly used for differential algorithms, such as backlight photography in RAW (unprocessed image) domain, high dynamic range image (High Dynamic Range, HDR) photography, preview and video effect enhancement, etc., which may include pre-images. Signal processing (Pre Image Signal Processing, PreISP) module, central processing unit, double-rate synchronous dynamic random access memory and mobile industry processor interface (Mobile Industry Processor Interface, MIPI), etc. The early image signal processing module may include a front-end processor ( Front End, FE), network processor (Neural-network Processing Unit, NPU) and back-end processor (Back End, BE) and so on. The electronic device may be a mobile phone, a tablet computer, a smart camera, and other devices having a photographing or video recording function.

在一个实施例中,如图2所示,提供了一种电子设备的录像控制方法,以该方法应用于图1所示的电子设备为例进行说明,包括以下步骤:In one embodiment, as shown in FIG. 2, a video recording control method of an electronic device is provided, and the method is applied to the electronic device shown in FIG. 1 as an example for description, including the following steps:

步骤202,基于当前的录像场景,设置应用处理芯片和图像信号处理芯片中的各个处理器的频率。Step 202 , based on the current video recording scene, set the frequency of each processor in the application processing chip and the image signal processing chip.

举例而言,通常电子设备(如手机)中设置有相机应用程序,当用户通过电子设备拍照或录像时,打开相机应用程序,通过相机应用程序的应用设置界面进行相关设置,如对录像场景、是否延时摄影、是否添加滤镜等进行设置,其中录像场景包括但不限于是超级夜景模式、极夜模式、人像拍照模式和通用模式。在用户通过相机应用程序设置完成后,相机中间件获得录像场景。For example, a camera application is usually set in an electronic device (such as a mobile phone). When a user takes a photo or video through an electronic device, the camera application is opened, and relevant settings are made through the application setting interface of the camera application, such as setting the recording scene, Whether to set time-lapse photography, whether to add filters, etc., the video scenes include but are not limited to super night scene mode, extreme night mode, portrait photo mode and general mode. After the user has set up through the camera application, the camera middleware gets the recording scene.

在本申请中,不同的录像场景,应用处理芯片和图像信号处理芯片中的各个处理器对应不同的频率,且这些频率是相机性能(效果)和功耗达到平衡时对应的频率,这样既能满足相机性能需求又能满足功耗需求。在实际应用中,可预先通过计算及测试获得不同录像模式下相机性能和功耗达到最好平衡点时应用处理芯片和图像信号处理芯片中的各个处理器的频率,而后将各个录像场景以及对应的应用处理芯片和图像信号处理芯片中的各个处理器的频率对应存储至相机中间件中。In this application, for different video recording scenarios, each processor in the application processing chip and the image signal processing chip corresponds to different frequencies, and these frequencies are the corresponding frequencies when the camera performance (effect) and power consumption reach a balance. Meet the camera performance requirements and meet the power consumption requirements. In practical applications, the frequency of each processor in the application processing chip and the image signal processing chip can be obtained through calculation and testing in advance when the camera performance and power consumption in different recording modes reach the best balance point, and then each recording scene and corresponding The frequency of each processor in the application processing chip and the image signal processing chip is correspondingly stored in the camera middleware.

在一个实施例中,上述的电子设备的录像控制方法还包括:根据录像场景的负载,预先确定应用处理芯片和图像信号处理芯片中的至少一个处理器的频率;以及根据当前的录像场景查询相应的应用处理芯片和图像信号处理芯片中的各个处理器的频率。In one embodiment, the above-mentioned video recording control method of the electronic device further includes: predetermining the frequency of at least one processor in the application processing chip and the image signal processing chip according to the load of the video recording scene; The frequency of each processor in the application processing chip and the image signal processing chip.

本申请中,录像场景的负载是指相机传感器输出的分辨率和帧率,不同的录像场景对应不同的分辨率和帧率。在实际应用中,可先获取不同录像场景对应的相机传感器输出的分辨率和帧率,并根据相机传感器输出的分辨率和帧率,通过计算及测试获得不同录像场景下相机性能和功耗达到最好平衡点时应用处理芯片和图像信号处理芯片中各个处理器的频率,而后将各个录像场景以及对应的应用处理芯片和图像信号处理芯片中的各个处理器的频率对应存储至相机中间件中。In this application, the load of the video recording scene refers to the resolution and frame rate output by the camera sensor, and different video recording scenes correspond to different resolutions and frame rates. In practical applications, the resolution and frame rate of the camera sensor output corresponding to different video scenes can be obtained first, and according to the resolution and frame rate output by the camera sensor, the camera performance and power consumption in different video scenes can be obtained through calculation and testing. It is best to balance the frequency of each processor in the application processing chip and the image signal processing chip, and then store the frequencies of each video recording scene and the corresponding processor in the application processing chip and the image signal processing chip into the camera middleware. .

在相机中间件获得当前的录像场景后,可根据当前的录像场景查找获得与之对应的应用处理芯片和图像信号处理芯片中的各个处理器的频率,并根据查找获得的频率对应用处理芯片和图像信号处理芯片中的各个处理器的频率进行设置。例如,根据查找获得的频率,通过内核提供的节点对图像信号处理芯片中相关处理器如中央处理器、网络处理器和双倍速率同步动态随机存储器等的频率、以及应用处理芯片中相关处理器如中央处理器、图形处理器和数字信号处理器等的频率进行设置,从而使得图像信号处理芯片和应用处理芯片中各个处理器的频率与当前录像场景相匹配,使得既能满足相机性能需求又能满足功耗需求。After the camera middleware obtains the current recording scene, the frequency of each processor in the corresponding application processing chip and image signal processing chip can be obtained by searching according to the current recording scene, and the application processing chip and the image signal processing chip can be searched according to the obtained frequencies. The frequency of each processor in the image signal processing chip is set. For example, according to the frequency obtained by the search, the frequency of the relevant processors in the image signal processing chip such as the central processing unit, the network processor and the double-rate synchronous dynamic random access memory, etc., as well as the relevant processors in the application processing chip, are determined by the nodes provided by the kernel. Such as the frequency of the central processing unit, graphics processing unit and digital signal processor, etc., so that the frequency of each processor in the image signal processing chip and the application processing chip matches the current recording scene, so that it can not only meet the performance requirements of the camera, but also can meet the power consumption requirements.

步骤204,采用第一调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的频率进行调节。Step 204, using the first scheduling strategy to adjust the frequency of at least one processor in the application processing chip and the image signal processing chip.

本申请中,第一调度策略也称惰性调度策略,具体是指对应用处理芯片和图像信号处理芯片中各个处理器的频率的调节敏感度,反应到调节参数上为频率的调节步长,该第一调度策略对应的调节步长为较小值。In this application, the first scheduling strategy is also called lazy scheduling strategy, which specifically refers to the adjustment sensitivity to the frequency of each processor in the application processing chip and the image signal processing chip, which is reflected in the adjustment parameter as the adjustment step size of the frequency. The adjustment step corresponding to the first scheduling policy is a smaller value.

在相机中间件基于当前的录像场景对应用处理芯片和图像信号处理芯片中的各个处理器的频率设置完成后,还采用第一调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的频率进行调节。例如,各个录像场景采用相同的第一调度策略,即采用相同的调节步长;或者,不同录像场景采用不同的第一调度策略,即采用不同的调节步长,其中录像场景的负载越高,调节步长越大,录像场景的负载越低,调节步长越小。After the camera middleware completes setting the frequency of each processor in the application processing chip and the image signal processing chip based on the current video recording scene, the first scheduling strategy is also used for at least one processor in the application processing chip and the image signal processing chip frequency is adjusted. For example, each recording scene adopts the same first scheduling strategy, that is, the same adjustment step size is adopted; or, different recording scenes adopt different first scheduling strategies, that is, different adjustment step size is adopted. The larger the adjustment step, the lower the load of the recording scene, and the smaller the adjustment step.

在一个实施例中,至少一个处理器的频率调节区间为[Freq*(1-10%),Freq*(1+10%)],其中,Freq为处理器频率,也即基于当前的录像场景获得的。可以理解的是,由于录像场景对相机性能的需求较为稳定,因此可以设置上述各个处理器的最小频率为Freq*(1-10%),最大频率为Freq*(1+10%)。In one embodiment, the frequency adjustment interval of at least one processor is [Freq*(1-10%), Freq*(1+10%)], where Freq is the frequency of the processor, that is, based on the current recording scene acquired. It can be understood that since the video recording scene has relatively stable requirements for camera performance, the minimum frequency of each of the above processors can be set to Freq*(1-10%), and the maximum frequency is Freq*(1+10%).

上述实施例中,通过基于当前的录像场景,设置应用处理芯片和图像信号处理芯片中的各个处理器的频率,并采用第一调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的频率进行调节,从而既能满足相机性能需求又能满足功耗需求,有效解决了通过使用小模型的图像处理器来降低功耗,或者通过降低相机传感器的分辨率与帧率来降低图像信号处理芯片中各处理器的计算量以达到降低功耗的目的导致的相机性能受到影响的问题,同时,针对不同的录像场景设置不同的频率且采用第一调度策略进行调节,能够有效避免所有录像场景均采用同一频率导致的功耗高或者相机性能受到影响的问题。In the above-mentioned embodiment, the frequency of each processor in the application processing chip and the image signal processing chip is set based on the current video recording scene, and the first scheduling strategy is used for at least one processor in the application processing chip and the image signal processing chip. The frequency of the camera can be adjusted to meet both the performance requirements of the camera and the power consumption requirements, effectively solving the problem of reducing power consumption by using a small model image processor, or reducing the resolution and frame rate of the camera sensor to reduce the image signal. The camera performance is affected by processing the calculation amount of each processor in the chip to achieve the purpose of reducing power consumption. At the same time, setting different frequencies for different recording scenarios and using the first scheduling strategy for adjustment can effectively avoid all recordings. High power consumption or camera performance is affected due to the use of the same frequency in the scenes.

在一个实施例中,参考图3所示,电子设备的录像控制方法还包括:In one embodiment, as shown in FIG. 3 , the video recording control method of the electronic device further includes:

步骤S302,判断当前的录像场景是否叠加动态效果。Step S302, determining whether the current video recording scene is superimposed with dynamic effects.

用户在通过相机应用程序选择录像场景后,还可通过相机应用程序对录像场景添加相应的动态效果,其中动态效果包括但不限于是HDR效果、美颜处理效果、背景虚化处理效果、炫彩效果、防抖效果和超画质效果。在用户通过相机应用程序对录像场景以及相应的动态效果添加完成后,相机中间件将获得录像场景以及需要叠加的动态效果。After the user selects the recording scene through the camera application, the user can also add corresponding dynamic effects to the recording scene through the camera application, wherein the dynamic effects include but are not limited to HDR effects, beauty processing effects, background blur processing effects, and dazzling colors. effects, anti-shake effects, and ultra-quality effects. After the user completes adding the video scene and the corresponding dynamic effects through the camera application, the camera middleware will obtain the video scene and the dynamic effects that need to be superimposed.

步骤S304,如果确定叠加动态效果,则根据动态效果获取叠加频率,并将叠加频率增加至应用处理芯片和图像信号处理芯片中的各个处理器的已设置的频率,以及采用第二调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的叠加后的频率进行调节。Step S304, if it is determined to superimpose the dynamic effect, the superposition frequency is obtained according to the dynamic effect, and the superimposed frequency is increased to the set frequency of each processor in the application processing chip and the image signal processing chip, and the second scheduling strategy is adopted for the application. The superimposed frequency of at least one processor in the processing chip and the image signal processing chip is adjusted.

本申请中,第二调度策略也称敏感调度策略,具体是指对应用处理芯片和图像信号处理芯片中各个处理器的频率的调节敏感度,反应到调节参数上为频率的调节步长,该第二调度策略对应的调节步长为较大值。其中,第一调度策略对处理器频率的调节敏感度小于第二调度策略对处理器频率的调节敏感度。In this application, the second scheduling strategy is also called the sensitive scheduling strategy, which specifically refers to the adjustment sensitivity to the frequency of each processor in the application processing chip and the image signal processing chip, which is reflected in the adjustment parameter as the adjustment step size of the frequency. The adjustment step corresponding to the second scheduling policy is a larger value. The adjustment sensitivity of the first scheduling strategy to the processor frequency is smaller than the adjustment sensitivity of the second scheduling strategy to the processor frequency.

不同的录像场景对应不同的动态效果,且不同的动态效果对应不同的叠加频率,具体可通过计算及测试获得。例如,可预先通过计算及测试获得超级夜景模式下HDR效果、防抖效果以及超画质效果等对应的叠加频率,通过计算及测试获得极夜模式下防抖效果以及超画质效果等对应的叠加频率,依次类推,直至完成对所有录像场景下每个动态效果对应的叠加频率的获取。而后,将录像场景、每个录像场景对应的动态效果、以及每个动态效果对应的叠加频率对应存储至相机中间件。Different video scenes correspond to different dynamic effects, and different dynamic effects correspond to different superimposition frequencies, which can be obtained through calculation and testing. For example, the corresponding superposition frequencies of the HDR effect, anti-shake effect and super image quality effect in the super night scene mode can be obtained through calculation and testing in advance, and the corresponding superimposed frequency of the anti-shake effect and super image quality effect in the extreme night mode can be obtained through calculation and testing. The superposition frequency, and so on, until the acquisition of the superposition frequency corresponding to each dynamic effect in all video scenes is completed. Then, the video recording scene, the dynamic effect corresponding to each video recording scene, and the superposition frequency corresponding to each dynamic effect are correspondingly stored in the camera middleware.

在相机中间件获得当前的录像场景以及需要叠加的动态效果后,可先根据录像场景对应的频率对应用处理芯片和图像信号处理芯片中相关处理器的频率进行设置,并利用第一调度策略对应用处理芯片和图像信号处理芯片中相关处理器的频率进行调节,而后根据需要叠加的动态效果获取对应的叠加频率,并将该叠加频率分别叠加至应用处理芯片和图像信号处理芯片中相关处理器的频率上,以及采用第二调度策略对应用处理芯片和图像信号处理芯片中相关处理器的频率进行调节。After the camera middleware obtains the current recording scene and the dynamic effects that need to be superimposed, it can first set the frequency of the relevant processors in the application processing chip and the image signal processing chip according to the frequency corresponding to the recording scene, and use the first scheduling strategy to The frequency of the relevant processors in the application processing chip and the image signal processing chip is adjusted, and then the corresponding superimposed frequency is obtained according to the dynamic effect that needs to be superimposed, and the superimposed frequency is superimposed to the relevant processors in the application processing chip and the image signal processing chip respectively. and the frequency of the relevant processors in the application processing chip and the image signal processing chip is adjusted by using the second scheduling strategy.

作为一个具体示例,录像场景、动态效果以及相应调度策略可参考表1所示:As a specific example, the recording scenes, dynamic effects and corresponding scheduling strategies can be referred to as shown in Table 1:

表1Table 1

Figure BDA0002835325100000041
Figure BDA0002835325100000041

Figure BDA0002835325100000051
Figure BDA0002835325100000051

需要说明的是,对于预览场景,由于其频率是浮动的,所以在相关预览场景下,各个处理器的频率和调度策略均与通用模式一致。It should be noted that, for the preview scene, since the frequency is floating, in the relevant preview scene, the frequency and scheduling policy of each processor are consistent with the general mode.

上述实施例中,通过基于当前的录像场景设置应用处理芯片和图像信号处理芯片中的各个处理器的频率,并采用第一调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的频率进行调节,同时根据需要叠加的动态效果获取叠加频率,并将该叠加频率叠加至应用处理芯片和图像信号处理芯片中的各个处理器的已设置的频率,以及采用第二调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的叠加后的频率进行调节,从而能够满足录像场景以及需要叠加的动态效果的不同需求,有效解决因动态效果有多项、且有些动态效果又具备可变等级,难以以静态场景评估每个场景所需要预设的场景频率的问题,且频率的设置既能满足相机性能需求又能满足功耗需求。In the above embodiment, the frequency of each processor in the application processing chip and the image signal processing chip is set based on the current video recording scene, and the first scheduling strategy is used to control the frequency of at least one processor in the application processing chip and the image signal processing chip. The frequency is adjusted, and the superimposed frequency is obtained according to the dynamic effect that needs to be superimposed, and the superimposed frequency is superimposed to the set frequency of each processor in the application processing chip and the image signal processing chip, and the second scheduling strategy is used to process the application. The frequency after the superposition of at least one processor in the chip and the image signal processing chip is adjusted, so as to meet the different needs of the video recording scene and the dynamic effects that need to be superimposed, and effectively solve the problem that there are many dynamic effects, and some dynamic effects are also available. Variable level, it is difficult to evaluate the preset scene frequency of each scene in a static scene, and the frequency setting can meet both the camera performance requirements and the power consumption requirements.

作为一个具体示例,参考图4所示,电子设备的录像控制方法包括:As a specific example, referring to FIG. 4 , the video recording control method of the electronic device includes:

步骤S402,确定录像场景。Step S402, determining a video recording scene.

在用户通过相机应用程序设置完录像场景和动态效果后,相机应用程序发起录像场景和动态效果的切换操作。After the user sets the recording scene and the dynamic effect through the camera application, the camera application initiates a switching operation between the recording scene and the dynamic effect.

步骤S404,设置应用处理芯片和图像信号处理芯片中相关处理器的频率为A,且利用第一调度策略对相关处理器的频率A进行调节。Step S404 , set the frequency of the relevant processors in the application processing chip and the image signal processing chip to A, and adjust the frequency A of the relevant processors by using the first scheduling strategy.

相机中间件存储有录像场景对应的频率、动态效果对应的叠加频率以及调度策略信息。相机中间件在获得录像场景时,可根据录像场景查找获得频率,并根据该频率通过内核提供的节点设置应用处理芯片和图像信号处理芯片中相关处理器的频率,假设频率为A,并利用第一调度策略通过内核提供的节点对相关处理器的频率A进行调节。The camera middleware stores the frequency corresponding to the recording scene, the superposition frequency corresponding to the dynamic effect, and the scheduling policy information. When the camera middleware obtains the video scene, it can search and obtain the frequency according to the video scene, and set the frequency of the relevant processors in the application processing chip and the image signal processing chip through the node provided by the kernel according to the frequency. A scheduling strategy adjusts the frequency A of the relevant processor through the nodes provided by the kernel.

步骤S406,判断是否设置了动态效果。如果是,则执行步骤S410;否则,执行步骤S408。Step S406, it is determined whether a dynamic effect is set. If yes, go to step S410; otherwise, go to step S408.

在用户设置了动态效果后,相机中间件将确定需要叠加动态效果,此时执行步骤S410;在用户未设置动态效果时,相机中间件将确定不需要叠加动态效果,此时执行步骤S408。After the user sets the dynamic effect, the camera middleware will determine that the dynamic effect needs to be superimposed, and then step S410 is performed; when the user has not set the dynamic effect, the camera middleware will determine that the dynamic effect does not need to be superimposed, and then step S408 is performed.

步骤S408,录像场景使用。Step S408, the video recording scene is used.

步骤S410,设置应用处理芯片和图像信号处理芯片中相关处理器的频率为A_dynamic,且利用第二调度策略对相关处理器的频率A_dynamic进行调节。Step S410 , setting the frequency of the relevant processors in the application processing chip and the image signal processing chip as A_dynamic, and adjusting the frequency A_dynamic of the relevant processors by using the second scheduling strategy.

在相机中间件确定需要叠加动态效果后,依据动态效果查找获得叠加频率,并通过内核提供的节点将该叠加频率叠加至相关的处理器频率上,最终处理器频率为A_dynamic。而后,设置与动态效果相关的处理器为第二调度策略,即利用第二调度策略通过内核提供的节点对相关处理器频率A_dynamic进行调节。After the camera middleware determines that the dynamic effect needs to be superimposed, the superimposed frequency is obtained according to the dynamic effect search, and the superimposed frequency is superimposed on the relevant processor frequency through the node provided by the kernel, and the final processor frequency is A_dynamic. Then, the processor related to the dynamic effect is set as the second scheduling strategy, that is, the frequency A_dynamic of the relevant processor is adjusted through the node provided by the kernel by using the second scheduling strategy.

步骤S412,判断是否关闭了所有动态效果。如果是,返回步骤S404;否则,返回步骤S410。Step S412, it is judged whether all dynamic effects are closed. If yes, go back to step S404; otherwise, go back to step S410.

简言之,参考图5所示,电子设备的录像控制方法可包括:相机应用程序在接收到用户设置的录像场景和动态效果后,发起录像场景和动态效果的切换操作。相机中间件存储有录像场景和动态效果对应的频率信息,以及调度策略信息,相机中间件根据录像场景和动态效果查找相应的频率,并通过内核提供的节点设置对应频率和调节策略,其中内核提供设置对应频率与调度策略的节点,例如内核提供应用处理芯片中中央处理器的频率与调度策略的节点、应用处理芯片中图形处理器的频率与调度策略的节点等。In short, as shown in FIG. 5 , the video recording control method of the electronic device may include: after receiving the video recording scene and dynamic effect set by the user, the camera application initiates a switching operation between the video recording scene and the dynamic effect. The camera middleware stores the frequency information corresponding to the recording scene and dynamic effect, as well as the scheduling strategy information. The camera middleware searches for the corresponding frequency according to the recording scene and dynamic effect, and sets the corresponding frequency and adjustment strategy through the nodes provided by the kernel. Set the node corresponding to the frequency and scheduling policy, such as the node where the kernel provides the frequency and scheduling policy of the central processing unit in the application processing chip, and the node where the frequency and scheduling policy of the graphics processor in the application processing chip are applied.

具体地,参考图6所示,电子设备的录像控制方法可包括:相机应用程序在接收到用户设置的录像场景和动态效果后,发起录像场景和动态效果的切换操作。软件层中的相机服务器在接收到录像场景和动态效果的切换操作后,将其传递给相机硬件抽象层中图像信号处理芯片的硬件抽象层的功耗管理层,功耗管理层存储有录像场景和动态效果对应的频率以及调度策略信息,同时内核驱动中的温度传感器提供图像信号处理芯片和整机的温度信息给功耗管理层。Specifically, referring to FIG. 6 , the video recording control method of the electronic device may include: after receiving the video recording scene and dynamic effect set by the user, the camera application initiates a switching operation between the video recording scene and the dynamic effect. After the camera server in the software layer receives the switching operation of the recording scene and the dynamic effect, it passes it to the power consumption management layer of the hardware abstraction layer of the image signal processing chip in the camera hardware abstraction layer, and the power consumption management layer stores the recording scene. The frequency and scheduling policy information corresponding to the dynamic effect, and the temperature sensor in the kernel driver provides the temperature information of the image signal processing chip and the whole machine to the power consumption management layer.

图像信号处理芯片的硬件抽象层根据录像场景和动态效果查找相应的频率,包括录像场景对应的频率和动态效果对应的叠加频率,并将与图像信号处理芯片相关的频率传递给图像信号处理芯片的驱动,图像信号处理芯片的驱动根据接收的频率对相关处理器进行设置,如对图像信号处理芯片的双倍速率同步动态随机存储器和图像信号处理芯片的中央处理器进行设置,同时,将与应用处理芯片相关的频率传递给图像信号处理芯片的服务器,图像信号处理芯片的服务器将相关频率传递给功耗管理服务器,由功耗管理服务器通知给功耗硬件抽象层,通过功耗硬件抽象层对应用处理芯片的中央处理器和图形处理器进行设置。The hardware abstraction layer of the image signal processing chip finds the corresponding frequency according to the video scene and dynamic effect, including the frequency corresponding to the video scene and the superimposed frequency corresponding to the dynamic effect, and transmits the frequency related to the image signal processing chip to the image signal processing chip. The driver of the image signal processing chip sets the relevant processors according to the received frequency, such as setting the double-rate synchronous dynamic random access memory of the image signal processing chip and the central processing unit of the image signal processing chip. The frequency related to the processing chip is passed to the server of the image signal processing chip, and the server of the image signal processing chip passes the relevant frequency to the power consumption management server, and the power consumption management server notifies the power consumption hardware abstraction layer. Apply the processing chip's central processing unit and graphics processing unit to make settings.

在上述实施例中,基于录像场景和动态效果的性能需求,设置应用处理芯片和图像信号处理芯片中相关处理器的频率,且该频率是相机性能和功耗之间最好平衡点,并且针对录像场景和动态效果对相机性能需求稳定性不一致的情况,分别设置了第一和第二调度策略,从而能够在保证各个录像场景的性能需求下降低功耗。In the above embodiment, based on the performance requirements of the video recording scene and dynamic effects, the frequency of the relevant processors in the application processing chip and the image signal processing chip is set, and the frequency is the best balance point between camera performance and power consumption, and for In the case where the camera performance requirements and stability of the video recording scenes and dynamic effects are inconsistent, the first and second scheduling policies are set respectively, so that the power consumption can be reduced while ensuring the performance requirements of each video recording scene.

为了验证本申请的有效性,下面参考图7-图9进行说明。该示例中,参考图7所示,中央处理器采用由小核、大核和超大核构成的三簇架构,包括四个小核、三个大核和一个超大核。其中,直线1表示功耗相同下,大核可以提供比超大核更多的性能,直线2表示功耗相同下,小核可以提供比大核更多的性能,这也是在录像模式下设置第一调度策略的原因。因为如果由于一些任务的冲突导致小核切换到大核,一是会导致中央处理器的任务迁移消耗,二是会导致任务在能效比更差的大核上运行,如图8所示。而在采用了本申请提供的方案后,即使出现一些任务冲突也不会发生任务迁移,虽然小核的任务会加重,但是整体功耗会减少,使得能效达到最优,从而既能保证相机效果又能降低整机功耗。In order to verify the validity of the present application, the following description is made with reference to FIGS. 7-9 . In this example, as shown in FIG. 7 , the central processing unit adopts a three-cluster architecture composed of small cores, large cores and super large cores, including four small cores, three large cores and one super large core. Among them, line 1 indicates that the large core can provide more performance than the large core under the same power consumption, and line 2 indicates that the small core can provide more performance than the large core under the same power consumption. A reason for the scheduling policy. Because if the small core switches to the large core due to the conflict of some tasks, it will cause task migration consumption of the central processor, and second, it will cause the task to run on the large core with a worse energy efficiency ratio, as shown in Figure 8. After adopting the solution provided by this application, even if some task conflicts occur, task migration will not occur. Although the tasks of the small core will increase, the overall power consumption will be reduced, so that the energy efficiency can be optimized, and the camera effect can be guaranteed. It can also reduce the power consumption of the whole machine.

应该理解的是,虽然图2-6的流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,这些步骤可以以其它的顺序执行。而且,图2-6中的至少一部分步骤可以包括多个子步骤或者多个阶段,这些子步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些子步骤或者阶段的执行顺序也不必然是依次进行,而是可以与其它步骤或者其它步骤的子步骤或者阶段的至少一部分轮流或者交替地执行。It should be understood that although the steps in the flowcharts of FIGS. 2-6 are shown in sequence according to the arrows, these steps are not necessarily executed in the sequence shown by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order, and these steps may be performed in other orders. Moreover, at least a part of the steps in FIGS. 2-6 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed and completed at the same time, but may be executed at different times. These sub-steps or stages are not necessarily completed at the same time. The order of execution of the steps is not necessarily sequential, but may be performed alternately or alternately with other steps or at least a part of sub-steps or stages of other steps.

在一个实施例中,提供一种计算机可读存储介质,其上存储有电子设备的录像控制程序,该电子设备的录像控制程序被处理器执行时实现上述的电子设备的录像控制方法。In one embodiment, a computer-readable storage medium is provided, on which a video recording control program of an electronic device is stored, and when the video recording control program of the electronic device is executed by a processor, the above-mentioned video recording control method of an electronic device is implemented.

在一个实施例中,提供一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的电子设备的录像控制程序,处理器执行录像控制程序时,实现上述的电子设备的录像控制方法。In one embodiment, an electronic device is provided, comprising a memory, a processor, and a video recording control program of the electronic device that is stored in the memory and can run on the processor. When the processor executes the video recording control program, the above-mentioned electronic device is implemented. recording control method.

在一个实施例中,参考图10所示,提供一种电子设备的录像控制装置,包括:设置模块10和调节模块20。In one embodiment, referring to FIG. 10 , a video recording control apparatus of an electronic device is provided, including: a setting module 10 and an adjustment module 20 .

其中,设置模块10用于基于当前的录像场景,设置应用处理芯片和图像信号处理芯片中的各个处理器的频率;调节模块20用于采用第一调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的频率进行调节。Wherein, the setting module 10 is used for setting the frequency of each processor in the application processing chip and the image signal processing chip based on the current video recording scene; the adjusting module 20 is used for adopting the first scheduling The frequency of at least one processor is adjusted.

在一个实施例中,设置模块10还用于:根据录像场景的负载,预先确定应用处理芯片和图像信号处理芯片中的至少一个处理器的频率;以及根据当前的录像场景查询相应的应用处理芯片和图像信号处理芯片中的各个处理器的频率。In one embodiment, the setting module 10 is further configured to: predetermine the frequency of at least one processor in the application processing chip and the image signal processing chip according to the load of the video recording scene; and query the corresponding application processing chip according to the current video recording scene and the frequency of each processor in the image signal processing chip.

在一个实施例中,调节模块20还用于:判断当前的录像场景是否叠加动态效果;如果确定叠加动态效果,则根据动态效果获取叠加频率,并将叠加频率增加至应用处理芯片和图像信号处理芯片中的各个处理器的已设置的频率,以及采用第二调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的叠加后的频率进行调节。In one embodiment, the adjustment module 20 is further configured to: determine whether a dynamic effect is superimposed on the current video recording scene; if it is determined to superimpose a dynamic effect, obtain the superimposition frequency according to the dynamic effect, and add the superimposition frequency to the application processing chip and the image signal processing The set frequency of each processor in the chip, and the superimposed frequency of at least one processor in the application processing chip and the image signal processing chip is adjusted using the second scheduling policy.

在一个实施例中,图像信号处理芯片中的处理器包括:中央处理器CPU、网络处理器NPU和双倍速率同步动态随机存储器DDR。In one embodiment, the processor in the image signal processing chip includes: a central processing unit (CPU), a network processor (NPU), and a double-rate synchronous dynamic random access memory (DDR).

在一个实施例中,应用处理芯片中的处理器包括:中央处理器CPU、图形处理器GPU和数字信号处理器DSP。In one embodiment, the processors in the application processing chip include: a central processing unit (CPU), a graphics processing unit (GPU), and a digital signal processor (DSP).

在一个实施例中,录像场景包括超级夜景模式、极夜模式、人像拍照模式和通用模式。In one embodiment, the video recording scene includes a super night scene mode, an extreme night mode, a portrait photography mode, and a general mode.

在一个实施例中,动态效果包括HDR效果、美颜处理效果、背景虚化处理效果、炫彩效果、防抖效果和超画质效果。In one embodiment, the dynamic effects include HDR effects, beauty processing effects, background blur processing effects, colorful effects, anti-shake effects, and ultra-image quality effects.

在一个实施例中,第一调度策略对处理器频率的调节敏感度小于第二调度策略对处理器频率的调节敏感度。In one embodiment, the adjustment sensitivity of the first scheduling policy to the processor frequency is less than the adjustment sensitivity of the second scheduling policy to the processor frequency.

在一个实施例中,至少一个处理器的频率的调节区间为[Freq*(1-10%),Freq*(1+10%)],其中,Freq为至少一个处理器的频率。In one embodiment, the adjustment interval of the frequency of the at least one processor is [Freq*(1-10%), Freq*(1+10%)], where Freq is the frequency of the at least one processor.

关于电子设备的录像控制装置的具体限定可以参见上文中对于电子设备的录像控制方法的限定,在此不再赘述。上述电子设备的录像控制装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中,也可以以软件形式存储于计算机设备中的存储器中,以便于处理器调用执行以上各个模块对应的操作。For the specific limitation of the video recording control device of the electronic device, reference may be made to the above limitation on the video recording control method of the electronic device, which will not be repeated here. All or part of the modules in the video recording control device of the electronic device can be implemented by software, hardware and combinations thereof. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

上述电子设备及其录像控制方法、装置及存储介质,通过基于当前的录像场景,设置应用处理芯片和图像信号处理芯片中的各个处理器的频率,并采用第一调度策略对应用处理芯片和图像信号处理芯片中的至少一个处理器的频率进行调节,从而既能保证录像效果又能降低整机功耗。The above-mentioned electronic equipment and its video recording control method, device and storage medium, by setting the frequency of each processor in the application processing chip and the image signal processing chip based on the current video recording scene, and adopting the first scheduling strategy for the application processing chip and the image signal processing chip. The frequency of at least one processor in the signal processing chip is adjusted, so as to ensure the video recording effect and reduce the power consumption of the whole machine.

本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一非易失性计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限,RAM以多种形式可得,诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage In the medium, when the computer program is executed, it may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database or other medium used in the various embodiments provided in this application may include non-volatile and/or volatile memory. Nonvolatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Road (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

以上实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above embodiments can be combined arbitrarily. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features It is considered to be the range described in this specification.

以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。The above-mentioned embodiments only represent several embodiments of the present application, and the descriptions thereof are specific and detailed, but should not be construed as a limitation on the scope of the invention patent. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims (12)

1. A video recording control method of an electronic device, wherein the electronic device comprises an application processing chip and an image signal processing chip, and the method comprises the following steps:
setting the frequency of each processor in the application processing chip and the image signal processing chip based on the current video scene; and
and adjusting the frequency of at least one processor in the application processing chip and the image signal processing chip by adopting a first scheduling strategy.
2. The method of claim 1, further comprising:
according to the load of a video scene, the frequency of at least one processor in the application processing chip and the image signal processing chip is predetermined; and
and inquiring the frequency of each processor in the corresponding application processing chip and the image signal processing chip according to the current video scene.
3. The method of claim 1, further comprising:
judging whether the current video scene is superposed with a dynamic effect; and
and if the dynamic effect is determined to be superposed, acquiring superposed frequency according to the dynamic effect, adding the superposed frequency to the set frequency of each processor in the application processing chip and the image signal processing chip, and adjusting the superposed frequency of at least one processor in the application processing chip and the image signal processing chip by adopting a second scheduling strategy.
4. The method of claim 1 or 2, wherein the processor in the image signal processing chip comprises: a central processing unit CPU, a network processor NPU and a double-rate synchronous dynamic random access memory DDR.
5. The method of claim 1 or 2, wherein the processor in the application processing chip comprises: a central processing unit CPU, a graphic processing unit GPU and a digital signal processor DSP.
6. The method of claim 1 or 2, wherein the video recording scene comprises a super night scene mode, an extreme night mode, a portrait photographing mode, and a general mode.
7. The method of claim 3, wherein the dynamic effects comprise HDR effects, beautification effects, background blurring effects, glare effects, anti-shake effects, and super-picture quality effects.
8. The method of claim 3, wherein the first scheduling policy is less sensitive to adjustment of processor frequency than the second scheduling policy.
9. The method of claim 1, wherein the frequency of the at least one processor is adjusted over an interval of [ Freq (1-10%), Freq (1+ 10%) ], wherein Freq is the frequency of the at least one processor.
10. A computer-readable storage medium, having stored thereon a video recording control program of an electronic device, which when executed by a processor, implements a video recording control method of the electronic device according to any one of claims 1 to 9.
11. An electronic device, comprising a memory, a processor, and a video recording control program of the electronic device stored in the memory and operable on the processor, wherein the processor executes the video recording control program to implement the video recording control method of the electronic device according to any one of claims 1 to 9.
12. An apparatus for controlling video recording of an electronic device, comprising:
the setting module is used for setting the frequency of each processor in the application processing chip and the image signal processing chip based on the current video scene; and
and the adjusting module is used for adjusting the frequency of at least one processor in the application processing chip and the image signal processing chip by adopting a first scheduling strategy.
CN202011475970.9A 2020-12-14 2020-12-14 Electronic equipment and video recording control method, device and storage medium thereof Pending CN114625526A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202011475970.9A CN114625526A (en) 2020-12-14 2020-12-14 Electronic equipment and video recording control method, device and storage medium thereof
PCT/CN2021/132361 WO2022127530A1 (en) 2020-12-14 2021-11-23 Electronic device and video recording control method and apparatus therefor, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011475970.9A CN114625526A (en) 2020-12-14 2020-12-14 Electronic equipment and video recording control method, device and storage medium thereof

Publications (1)

Publication Number Publication Date
CN114625526A true CN114625526A (en) 2022-06-14

Family

ID=81897123

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011475970.9A Pending CN114625526A (en) 2020-12-14 2020-12-14 Electronic equipment and video recording control method, device and storage medium thereof

Country Status (2)

Country Link
CN (1) CN114625526A (en)
WO (1) WO2022127530A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103324270A (en) * 2013-06-25 2013-09-25 东莞宇龙通信科技有限公司 Mobile terminal and method for adjusting CPU (Central Processing Unit) frequency thereof
CN104346226A (en) * 2013-08-09 2015-02-11 联想(北京)有限公司 Processor frequency control method and electronic equipment
CN105955827A (en) * 2016-05-31 2016-09-21 广东欧珀移动通信有限公司 Method and device for allocating computational resource of processor
CN109151966A (en) * 2018-10-15 2019-01-04 Oppo广东移动通信有限公司 Terminal control method, terminal control device, terminal equipment and storage medium
CN111429333A (en) * 2020-03-25 2020-07-17 京东方科技集团股份有限公司 GPU dynamic frequency modulation method, device and system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103955264B (en) * 2014-05-15 2016-10-12 乐视致新电子科技(天津)有限公司 Dynamically regulate the method and system of processor working frequency
CN107678855B (en) * 2017-09-19 2020-06-12 中国电子产品可靠性与环境试验研究所 Processor dynamic adjustment method, device and processor chip
US10739838B2 (en) * 2017-12-28 2020-08-11 Omnivision Technologies, Inc. Quality-driven dynamic frequency scaling for energy optimization of smart camera systems
CN110209501B (en) * 2019-06-03 2022-02-08 Oppo广东移动通信有限公司 Frequency adjusting method and device of graphic processor, terminal and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103324270A (en) * 2013-06-25 2013-09-25 东莞宇龙通信科技有限公司 Mobile terminal and method for adjusting CPU (Central Processing Unit) frequency thereof
CN104346226A (en) * 2013-08-09 2015-02-11 联想(北京)有限公司 Processor frequency control method and electronic equipment
CN105955827A (en) * 2016-05-31 2016-09-21 广东欧珀移动通信有限公司 Method and device for allocating computational resource of processor
CN109151966A (en) * 2018-10-15 2019-01-04 Oppo广东移动通信有限公司 Terminal control method, terminal control device, terminal equipment and storage medium
CN111429333A (en) * 2020-03-25 2020-07-17 京东方科技集团股份有限公司 GPU dynamic frequency modulation method, device and system

Also Published As

Publication number Publication date
WO2022127530A1 (en) 2022-06-23

Similar Documents

Publication Publication Date Title
US10467496B2 (en) Temporal filtering of independent color channels in image data
US9413951B2 (en) Dynamic motion estimation and compensation for temporal filtering
CN109978774B (en) Denoising fusion method and device for multi-frame continuous equal exposure images
CN111294575B (en) Image processing method, device, electronic device and storage medium
CN110706162B (en) Image processing method, device and computer storage medium
US11825094B2 (en) System-on-chip having a merged frame rate converter and video codec and frame rate converting method thereof
CN113992850B (en) ISP-based image processing method and device, storage medium and image pickup apparatus
US20220044357A1 (en) Methods And Apparatus For Optimized Stitching Of Overcapture Content
US9299128B2 (en) Delta interpolation for upsampling imaging solution
JP2023509744A (en) Super night view image generation method, device, electronic device and storage medium
CN111462021B (en) Image processing method, apparatus, electronic device, and computer-readable storage medium
WO2022127530A1 (en) Electronic device and video recording control method and apparatus therefor, and storage medium
CN114862735A (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
US20140055639A1 (en) Raw data processing apparatus, raw data processing method and imaging device
JP6946966B2 (en) Image generator and method
CN116029951B (en) Image processing method and electronic device
CN115767287B (en) Image processing method and electronic equipment
CN115604576A (en) Shooting equipment scene switching method, device, shooting equipment and storage medium
CN114902237B (en) Image processing method, device and electronic device
CN114727082B (en) Image processing apparatus, image signal processor, image processing method, and medium
CN116645274A (en) Image processing method, device, electronic device, and computer-readable storage medium
JP2022019533A (en) Edge-based sharpness strength control circuit, image sensing device, and operation method thereof
WO2022233251A1 (en) Image processing method and apparatus, and electronic device and storage medium
KR102787522B1 (en) Method and apparatus for noise reduction of rgbir image
CN117714895B (en) Image processing method and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination