WO2019023915A1 - 一种视频处理方法、设备、飞行器及系统 - Google Patents
一种视频处理方法、设备、飞行器及系统 Download PDFInfo
- Publication number
- WO2019023915A1 WO2019023915A1 PCT/CN2017/095341 CN2017095341W WO2019023915A1 WO 2019023915 A1 WO2019023915 A1 WO 2019023915A1 CN 2017095341 W CN2017095341 W CN 2017095341W WO 2019023915 A1 WO2019023915 A1 WO 2019023915A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- target object
- frame
- edited
- video frame
- Prior art date
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 24
- 238000012545 processing Methods 0.000 claims abstract description 343
- 238000000034 method Methods 0.000 claims abstract description 141
- RZVHIXYEVGDQDX-UHFFFAOYSA-N 9,10-anthraquinone Chemical compound C1=CC=C2C(=O)C3=CC=CC=C3C(=O)C2=C1 RZVHIXYEVGDQDX-UHFFFAOYSA-N 0.000 claims description 99
- 230000008569 process Effects 0.000 claims description 95
- 230000015654 memory Effects 0.000 claims description 25
- 238000003384 imaging method Methods 0.000 claims description 11
- 230000004044 response Effects 0.000 claims description 10
- 230000008859 change Effects 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 35
- 230000003993 interaction Effects 0.000 description 9
- 230000003321 amplification Effects 0.000 description 5
- 238000003199 nucleic acid amplification method Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000006641 stabilisation Effects 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/10—Simultaneous control of position or course in three dimensions
- G05D1/101—Simultaneous control of position or course in three dimensions specially adapted for aircraft
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/20—Linear translation of whole images or parts thereof, e.g. panning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/28—Mobile studios
Definitions
- the present invention relates to the field of control technologies, and in particular, to a video processing method, device, aircraft, and system.
- the traditional video processing is generally: the user obtains the captured video to be edited, and loads the video to be edited into an application such as Photoshop; then, the user uses the tool provided by the application software to edit the edited video, and the user wants to The video of the effect. How to better edit video is a hot topic.
- Embodiments of the present invention provide a video processing method, device, aircraft, and system, which can automatically perform video editing processing.
- an embodiment of the present invention provides a video processing method, including:
- the video to be edited is a video including a target object captured by an imaging device mounted on the aircraft when the aircraft is in a specific flight mode, wherein the target object in the video is in the image The position remains unchanged and the size of the target object in the image changes;
- the image location area of the target object in the second video frame after the adjustment is the same as the image location area of the display area in the first video frame.
- an embodiment of the present invention further provides a video processing method, including:
- the flight control command is used to indicate an airplane flight mode, and
- the flight control instruction includes a target object
- an embodiment of the present invention further provides a video processing method, including:
- the video processing device sends a flight control command to the aircraft, the flight control command being used to indicate a flight mode of the aircraft;
- the aircraft is responsive to the flight control command, flying in the flight mode and controlling an image pickup device mounted on the aircraft to photograph the target object, wherein in the flight mode, the camera device
- the posture keeps the position of the target object in the captured picture unchanged, and the flight trajectory of the aircraft causes the size of the target object to change in the captured picture;
- a video to be edited to the video processing device, where the video to be edited is a video captured by the camera device in the flight mode;
- the video processing device determines a first video frame from the to-be-edited video, and determines a display area of the target object in the first video frame;
- the video processing device performs an adjustment process on the image position of the target object in the second video frame of the video to be edited according to the display area, to obtain a target video;
- the image location area of the target object in the second video frame after the adjustment is the same as the image location area of the display area in the first video frame.
- an embodiment of the present invention provides a video processing device, including a memory and a processor;
- the memory is configured to store program instructions
- the processor is configured to receive a video to be edited, where the video to be edited is a video including a target object captured by an image capturing device mounted on an aircraft when the aircraft is in a specific flight mode, where the video is included in the video.
- the position of the target object in the image remains unchanged, and the size of the target object in the image changes; determining a first video frame from the to-be-edited video, and determining that the target object is in the first video frame a display area in the image; adjusting, according to the display area, an image position of the target object in the second video frame of the video to be edited, to obtain a target video;
- the image location area of the target object in the second video frame is the same as the image location area of the display area in the first video frame.
- an embodiment of the present invention provides an aircraft, including:
- a power system disposed on the fuselage for providing flight power
- a processor for receiving a flight control command, the flight control command is for indicating an airplane flight mode, and the flight control command includes a target object; in response to the flight control instruction, flying and controlling the aircraft in the flight mode
- the camera mounted on the aircraft photographs the target object, wherein in the flight mode, the attitude of the camera causes the position of the target object in the captured image to remain unchanged, and the aircraft
- the flight trajectory changes the size of the target object in the captured picture; returns the video captured by the camera device in the flight mode.
- an embodiment of the present invention provides a video processing system, including: a video processing device and an aircraft;
- the video processing device is configured to send a flight control command to the aircraft, where the flight control command is used to indicate a flight mode of the aircraft;
- the aircraft is configured to, in response to the flight control instruction, fly in the flight mode and control an imaging device mounted on the aircraft to photograph the target object, wherein in the flight mode, the aircraft
- the posture of the camera device is such that the position of the target object in the photographing screen remains unchanged, and the flight trajectory of the aircraft causes the size of the target object to change in the photographing screen;
- the video to be edited is returned to the video processing device
- the video to be edited is a video captured by the camera device in the flight mode;
- the video processing device is further configured to receive the to-be-edited video; determine a first video frame from the to-be-edited video, and determine a display area of the target object in the first video frame; a display area, the image position of the target object in the second video frame of the video to be edited is adjusted to obtain a target video; wherein, the image position area of the target object in the processed second video frame is adjusted, The same as the image position area of the display area in the first video frame.
- an embodiment of the present invention provides a computer readable storage medium, where the computer readable storage medium stores a computer program, and when the computer program is executed by the processor, implements the first aspect, the second aspect, or the third The video processing method described in the aspect.
- a preview image is obtained by capturing an image capturing device mounted on the aircraft. Obtaining a target object from the preview image, and determining a display area of the target object in the preview image, and acquiring a to-be-edited video captured by the camera device during the moving of the aircraft, The specified video frame in the video is edited to obtain the target video, thereby automatically performing video editing processing.
- FIG. 1 is a schematic structural diagram of an unmanned aerial vehicle system according to an embodiment of the present invention.
- FIG. 2 is a schematic diagram of an interface for acquiring a target object from a preview image according to an embodiment of the present invention
- FIG. 3 is a schematic diagram of an interface for executing a flight control instruction according to an embodiment of the present invention.
- FIG. 4 is a schematic diagram of an interface of a shooting process according to an embodiment of the present invention.
- FIG. 5 is a schematic flowchart of a video processing method according to an embodiment of the present disclosure.
- FIG. 6 is a schematic diagram of an interface for specifying a video frame according to an embodiment of the present invention.
- FIG. 7 is a schematic diagram of another interface for specifying a video frame according to an embodiment of the present invention.
- FIG. 8 is a schematic diagram of another interface for specifying a video frame according to an embodiment of the present invention.
- FIG. 9 is a schematic diagram of an interface of an enlarged video frame according to an embodiment of the present invention.
- FIG. 10 is a schematic diagram of an interface for zooming in a target object according to an embodiment of the present invention.
- FIG. 11 is a schematic flowchart diagram of another video processing method according to an embodiment of the present disclosure.
- FIG. 12 is a schematic flowchart diagram of still another video processing method according to an embodiment of the present disclosure.
- FIG. 14 is a schematic structural diagram of a video processing device according to an embodiment of the present invention.
- the video processing method provided by the embodiment of the present invention may be performed by a video processing device, or in other embodiments, the video processing method may also be applied to an aircraft such as a drone, and the following corresponds to an aircraft.
- the video processing method is illustrated by way of example.
- the solution adopts the method of controlling the whole process from the remote control and without manual post-processing, and enters the moving zoom shooting mode through the APP application on the video processing device after the aircraft takes off to capture the target video.
- the aircraft can adjust the pan/tilt to follow the target object by moving the zoom shooting mode, so that the camera device always follows the target object, and determines the display area of the target object.
- the target object is always kept at the position of the display area. This allows you to shoot a video that can be edited.
- a flight control instruction may be generated, and The flight control command is sent to the aircraft, and the flight control command generated after the click operation is used to control the aircraft to move in a direction away from the target object for shooting, or to move in a direction close to the target object for shooting.
- the aircraft transmits the to-be-edited video captured by the camera device to the terminal in real time, so that the terminal can receive the to-be-edited video.
- the aircraft may also send the complete video as a to-be-edited video to the terminal.
- the video captured by the camera device itself may also be transmitted to the terminal.
- the terminal may determine a first video frame from the to-be-edited video, and determine a display area of the target object in the first video frame, where the terminal may perform a second to the to-be-edited video according to the display area. Adjusting an image position of the target object in the video frame to obtain a target video; wherein, adjusting an image position area of the target object in the processed second video frame, and the display area in the first video frame The image location area is the same.
- the video to be edited that needs to be edited by the terminal may not be a video captured by a combination of the aircraft and the camera, and the acquisition scene of the video to be edited may include multiple. In one embodiment, it may be a video captured by a camera mounted on a mobile robot, and in another embodiment, a user may also shoot through a camera-equipped device such as a smart phone. A video of a user or object (such as a tree, statue, etc.).
- FIG. 1 is a schematic structural diagram of a UAV system according to an embodiment of the present invention.
- the system includes a video processing device 11 and a drone 12.
- the video processing device 11 may be a control terminal of the drone, and may specifically be one of a remote controller, a smart phone, a tablet computer, a laptop computer, a ground station, a wearable device (watch, a wristband) or
- the drone 12 may be a rotary wing type unmanned aerial vehicle, such as a quadrotor drone, a six-rotor drone, an eight-rotor drone, or a fixed-wing drone.
- the drone includes a power system 121 for providing flight power to the drone, wherein the power system 121 includes one or more of a propeller, a motor, and an electric switch, and the drone may further include a pan/tilt 122
- the imaging device 123 is mounted on the main body of the drone by the pan/tilt 122.
- the camera device is used for image or video shooting during the flight of the drone, including but not limited to multi-spectral imager, hyperspectral imager, visible light camera and infrared camera, etc.
- the pan/tilt is a multi-axis transmission and stabilization system.
- the pan/tilt motor compensates the shooting angle of the imaging device by adjusting the rotation angle of the rotating shaft, and prevents or reduces the jitter of the imaging device by setting an appropriate buffer mechanism.
- the video processing device 11 may configure an interaction device that interacts with the user, and the interaction device may be one or more of a touch display screen, a keyboard, a button, a joystick, and a pulsator.
- An APP and a user interface may be provided, the APP is displayed on the user interface, and an electronic map is displayed on the APP, and the user may perform a click operation on the electronic map displayed on the APP of the user interface of the video processing device 11, the click operation Click once to confirm a point.
- the video processing device 11 After receiving the at least 2 points clicked by the click operation, connects the at least 2 points to form a connection formed by the at least 2 points.
- the trajectory is photographed, thereby controlling the drone 12 to fly in accordance with the photographing trajectory, so that the photographing device 123 performs photographing according to the photographing trajectory.
- the click operation on the user interface is only one method for confirming the shooting trajectory, and the manner for confirming the shooting trajectory is not limited in the embodiment of the present invention.
- the drone before the video processing device receives the video to be edited, the drone needs to capture a preview image by the camera device, and the video processing device determines the target object from the acquired preview image, and determines the The display area of the target object in the preview image.
- the video processing device sends a flight control command to the drone to cause the drone to perform flight shooting in response to the flight control command, so that the camera device captures a video to be edited; wherein the to-be-edited The target object is included in the video, and the position of the target object in the video to be edited remains unchanged.
- FIG. 2 is a preview from the embodiment of the present invention.
- FIG. 2 is a preview from the embodiment of the present invention.
- FIG. 3 is a schematic diagram of an interface for executing a flight control instruction according to an embodiment of the present invention.
- the preview image is captured by the image capturing device.
- the user selects an area indicated by 201 in the image by a frame selection operation on the target object, and takes an image object in the image of the area as a target object, and determines The display area of the target object, in one embodiment, the selected area of the frame selection operation may serve as the display area of the target object.
- the location information about the click operation of the target object in the preview image may be acquired, as shown in FIG. 3, where 301 is an execution button. It is used to control the drone to execute the flight control command, and 302 is a cancel button for canceling the display area of the currently selected target object.
- the video processing device will control the drone to execute the flight control command and control the camera on the drone to shoot the target object.
- the position information of the click operation an area as shown by 201 in FIG. 2 is automatically selected, and an image object in the image of the area is used as a target object, and the display area of the target object is determined.
- the selected area of the click operation can be used as the display area of the target object.
- FIG. 4 is a schematic diagram of an interface of a photographing process according to an embodiment of the present invention.
- 401 indicates the shooting progress
- 401 is the exit button.
- the shooting process of the image capturing apparatus has been completed 40%, and when the shooting end is detected, the video processing device can obtain the video to be edited.
- the video processing device 11 may acquire the size of the target object in each video frame in the to-be-edited video, and determine the video frame with the largest size of the target object as the first video frame.
- the video processing device 11 may also determine the first frame video frame in the to-be-edited video as the first video frame, or determine the last frame of the video to be edited as the first video frame.
- the video processing device 11 may determine the size of the target object in the display area of the first video frame, determine the size as a standard size, and target the target in the second video frame according to the standard size.
- the object performs a scaling process, and performs an adjustment process on the image position of the target object in the second video frame after the scaling process according to the position of the display area.
- the video processing device 11 may adjust the images in reverse order according to the shooting time sequence.
- Each specified video frame in the target video is adjusted, and the video obtained after adjusting the time sequence is determined as the target video.
- FIG. 5 is a schematic flowchart of a video processing method according to an embodiment of the present invention.
- the method may be performed by a video processing device, where a specific explanation of the video processing device is as described above.
- the method of the embodiment of the present invention includes the following steps.
- the video processing device may receive a video to be edited, where the video to be edited is a video including a target object captured by an imaging device mounted on the aircraft when the aircraft is in a specific flight mode, where The position of the target object in the image remains unchanged in the video, and the size of the target object in the image changes.
- the video processing device may capture a preview image by capturing the image capturing device on the aircraft before receiving the video to be edited, and acquire the target object from the acquired preview image.
- the video processing device may acquire a frame selection operation on the target object in the preview image, the preview image is captured by an image capturing device mounted on the aircraft, and determined according to the frame selection operation.
- the target frame selection area wherein the target object is in the target frame selection area in the to-be-edited video captured during the flight of the aircraft.
- the video processing device can perform shooting by controlling the camera mounted on the aircraft, and control the pan/tilt to face the target object, so that the camera captures the preview image and is based on the user's user interface on the video processing device.
- FIG. 2 is an example, as shown in FIG. 2, which is a preview image captured by the video processing device by controlling the camera device, and based on the user's preview image on the user interface of the video processing device, regarding the target object.
- the image area 201 determined by the frame selection operation is used as the target frame selection area of the target object.
- the frame selection operation is one type of operation of the user on the target object in the preview image on the user interface of the video processing device, and the user views the preview on the user interface of the video processing device.
- the operation of the target object in the image may also be other operations.
- the embodiment of the present invention does not limit the operation of the target object in the preview image on the user interface of the video processing device.
- the video processing device can acquire a video to be edited that is captured by the camera during the movement of the aircraft.
- the video processing device can control the movement of the aircraft on which the camera device is mounted by acquiring a shooting execution instruction, and capture the video to be edited during the moving process.
- FIG. 3 is used as an example. As shown in FIG. 3, after the user interface of the video processing device acquires the target object, an execution button “GO” as shown in FIG. 301 and 302 in the figure are displayed.
- the cancel button is shown, when the video processing device receives a click event of the execution button "GO" by the user, the video processing device can acquire a shooting execution instruction, thereby controlling the movement of the aircraft on which the camera device is mounted, and The video to be edited is captured during the move.
- the video processing device can control an aircraft mounted with an imaging device to control the movement of the aircraft according to a preset movement rule, so that the camera device captures a video, so that the video processing device can acquire the camera.
- the device captures the video to be edited during the movement of the aircraft.
- the preset movement rule may control the movement of the aircraft by determining one or both of a shooting start position and a shooting end point position.
- the current position of the aircraft is determined as the shooting end point position.
- the camera device is performing a shooting instruction during the movement, and if the video processing device receives a click operation of the user, the video processing device will position the current aircraft.
- the position of the shooting end point is determined, and the camera mounted on the aircraft is controlled to stop shooting.
- the operation of the user may be a click operation, a sliding operation, and the like, which are not limited in the embodiment of the present invention.
- S502 Determine a first video frame from the to-be-edited video, and determine a display area of the target object in the first video frame.
- the video processing device may determine a first video frame from the to-be-edited video, and determine a display area of the target object in the first video frame. Specifically, the video processing device may determine, to obtain, from the acquired preview image, location information of a display area of the target object in the preview image, where the location information includes a size, an area, coordinate information, and a target object of the area where the target object is located. One or more pieces of information in a ratio to the preview image, the preview image being obtained by the video processing device by controlling an image pickup device mounted on the aircraft, the target object being the video processing device based on the user in the video The operation on the user interface of the processing device is obtained from the obtained preview image. Specifically, FIG. 2 is used as an example. For example, the video processing device can determine that the length of the area indicated by 201 is 10 cm and the width is 15 cm according to the obtained area indicated by 201 as the target object.
- the video processing device may determine the video frame with the largest size of the target object as the first video frame by acquiring the size of the target object in each video frame in the to-be-edited video. For example, if the size of the target object in each video frame in the video to be edited is 25 cm 2 , 30 cm 2 , 40 cm 2 , and 50 cm 2 , the video processing device determines that the 50 cm 2 video frame with the largest size of the target object is the first. A video frame.
- the video processing device may determine the first frame of the video frame to be edited as the first video frame, or determine the last frame of the video to be edited as the first video frame.
- the display area of the target object in the first video frame is determined according to the location of the target frame selection area.
- S503 Perform an adjustment process on the image position of the target object in the second video frame of the video to be edited according to the display area, to obtain a target video.
- the video processing device may first determine a size of the target object in the display area of the first video frame, determine the size as a standard size, and target the second video frame according to the standard size.
- the object is scaled.
- the video processing device may perform an adjustment process on the image position of the target object in the second video frame after the scaling process according to the position of the display area.
- the video processing device may further perform scaling processing on the entire image region of the second video frame according to the standard size.
- the video processing device may adjust the time sequence of each specified video frame in the to-be-edited video according to a preset adjustment rule after performing adjustment processing on the image location of the target object in each second video frame. ; The video obtained after adjusting the chronological order is determined as the target video.
- the video processing device can transmit a flight control command to the aircraft for controlling the aircraft to fly.
- the flight control command includes instructions for controlling movement of the aircraft in a direction away from the target object; or the flight control instructions include An instruction to control the movement of the aircraft in a direction approaching the target object.
- the video processing device may perform an adjustment process on the specified video frame in the acquired video to be edited to obtain a target video.
- the specified video frame refers to a part of the video frame to be edited or all the video frames to be edited.
- the video processing device may select a part of the video frame to be edited as the specified video frame from the to-be-edited video, where the selection mode is not limited, and all the video frames to be edited may be used as the specified video. a frame, so that the video processing device performs adjustment processing on the obtained specified video frame to obtain a target video.
- FIG. 6 is a schematic diagram of an interface for specifying a video frame according to an embodiment of the present invention
- FIG. 7 is another interface for specifying a video frame according to an embodiment of the present invention
- FIG. 8 is a schematic diagram of another interface for specifying a video frame according to an embodiment of the present invention.
- the interface diagram shown in FIG. 6 is the first video frame acquired by the video processing device, where 601 is the display area of the acquired target object in the preview image;
- the schematic diagram is the second video frame acquired by the video processing device.
- the interface diagram shown in FIG. 8 is the third video frame acquired by the video processing device, where the video frame image of FIG. 6 to FIG. 8 is
- the video processing device transmits a flight control command to the aircraft to cause the camera to capture the resulting video frame during flight.
- the flight control command includes instructions for controlling movement of the aircraft in a direction away from the target object, or the flight control command includes instructions for controlling movement of the aircraft in a direction toward the target object.
- the video processing device adjusts
- the video processing device may determine the target object in a specified video frame in the to-be-edited video, and perform the specified video frame on the specified video frame.
- FIG. 7 and FIG. 6 can be used as an example.
- the video processing device acquires a specified video frame image as shown in FIG. 7 from the video to be edited, and the video processing device can be specified as shown in FIG. 7.
- the target object 701 is determined in the video frame image, and the display position of the target object in the preview image shown in 601 in FIG.
- FIG. 9 is a schematic diagram of an interface of an enlarged video frame according to an embodiment of the present invention.
- the video processing device obtains the specified video frame from the video to be edited. Afterwards, the target object may be determined in a specified video frame in the to-be-edited video, and the target object is enlarged, and the enlarged target object is located in the target image in the specified video frame. region.
- FIG. 6 and FIG. 8 can be used as an example.
- the video processing device acquires a specified video frame image as shown in FIG. 8 from the video to be edited, and the video processing device can be specified in FIG.
- the target object 801 is determined in the video frame image, and the display position of the target object in the preview image shown in 601 of FIG. 6 is the target image area, and the target object 801 is enlarged to perform the amplification process.
- the target object is located in the target image area as shown in 601 of FIG. 6, and a video frame image as shown in FIG. 10 is obtained.
- FIG. 10 is a schematic diagram of an interface of the zoom target object according to an embodiment of the present invention.
- the video processing device may adjust an order of each specified video frame in the target video according to a preset adjustment rule, and obtain a target video according to the specified video frame after the adjustment sequence.
- the video processing device may adjust each specified video frame in the target video in a reverse order according to the shooting time sequence, and combine the specified video frames after the adjustment sequence to obtain a target video.
- FIG. 6, FIG. 9, and FIG. 10 are used as an example.
- the edited video frame acquired by the video processing device is a video frame image as shown in FIG. 6, FIG. 9, and FIG. 10, and the video processing is performed.
- the device may adjust the specified video frame as shown in FIG. 6, FIG. 9, and FIG. 10 in the target video in reverse order according to the shooting time sequence, and output from the video frame image described in FIG. 10, and then output.
- the video frame image described in FIG. 9 finally outputs the video frame image described in FIG.
- the video processing device may acquire a target object from the acquired preview image, and determine a display position of the target object in the preview image, by acquiring a process in which the camera device moves in the aircraft.
- the first video frame is obtained from the video to be edited, and the image position of the target object in the second video frame of the first video frame is adjusted according to the first video frame to obtain a target video, thereby obtaining a target video. Realize video editing processing automatically, improving video processing efficiency.
- FIG. 11 is a schematic flowchart diagram of another video processing method according to an embodiment of the present invention.
- the method may be performed by a video processing device, where a specific explanation of the video processing device is as described above.
- the method of the embodiment of the invention comprises the following steps.
- the video processing device can receive the video to be edited, and the video to be edited is a video comprising a target object captured by the camera mounted on the aircraft while the aircraft is in a particular flight mode, wherein the position of the target object in the image remains unchanged in the video, and the target object is The size in the image changes.
- the video processing device may capture a preview image by capturing the image capturing device on the aircraft before receiving the video to be edited, and acquire the target object from the acquired preview image.
- the video processing device may acquire a frame selection operation on the target object in the preview image, the preview image being captured by a camera mounted on the aircraft, according to The frame selection operation determines a target frame selection area, wherein the target object is in the target frame selection area in the to-be-edited video captured during the flight of the aircraft.
- the video processing device can perform shooting by controlling the camera mounted on the aircraft, and control the pan/tilt to face the target object, so that the camera captures the preview image and is based on the user's user interface on the video processing device.
- FIG. 2 is an example, as shown in FIG. 2, which is a preview image captured by the video processing device by controlling the camera device, and based on the user's preview image on the user interface of the video processing device, regarding the target object.
- the image area 201 determined by the frame selection operation is used as the target frame selection area of the target object.
- the frame selection operation is one type of operation of the user on the target object in the preview image on the user interface of the video processing device, and the user views the preview on the user interface of the video processing device.
- the operation of the target object in the image may also be other operations.
- the embodiment of the present invention does not limit the operation of the target object in the preview image on the user interface of the video processing device.
- the video processing device may further acquire location information about a click operation of the target object in the preview image, the preview image being captured by a camera mounted on the aircraft, according to the click operation.
- the location information determines a target frame selection area, wherein the target object is in the target frame selection area in the to-be-edited video captured during the flight of the aircraft.
- FIG. 2 is an example, as shown in FIG. 2, which is a preview image captured by the video processing device by controlling the camera device, and based on the user's preview image on the user interface of the video processing device, regarding the target object.
- the location information of the operation is determined, and the target frame selection area 201 is determined as the target frame selection area of the target object.
- the camera device is in the to-be-edited video captured during the flight of the aircraft, the target object is in the target frame selection area.
- the video processing device can acquire a video to be edited that is captured by the camera during the movement of the aircraft.
- the video processing device can control the movement of the aircraft on which the camera device is mounted by acquiring a shooting execution instruction, and capture the video to be edited during the moving process.
- FIG. 3 is used as an example. As shown in FIG. 3, after the user interface of the video processing device acquires the target object, an execution button “GO” as shown in FIG. 301 and 302 in the figure are displayed.
- the cancel button is shown, when the video processing device receives a click event of the execution button "GO" by the user, the video processing device can acquire a shooting execution instruction, thereby controlling the movement of the aircraft on which the camera device is mounted, and The video to be edited is captured during the move.
- the video processing device can control an aircraft mounted with an imaging device to control the movement of the aircraft according to a preset movement rule, so that the camera device captures a video, so that the video processing device can acquire the camera.
- the device captures the video to be edited during the movement of the aircraft.
- the preset movement rule may control the movement of the aircraft by determining one or both of a shooting start position and a shooting end point position.
- the video processing device may control the aircraft to move from the current position to the shooting end point position by determining a shooting end point position. Specifically, the video processing device can control the aircraft to move from the current position to the shooting end point position by determining the shooting end point position. Wherein the shooting end point is in a direction away from the target object.
- the video processing device may control the aircraft to move from the shooting start position to the shooting end position by determining a shooting start position and a shooting end position.
- the video processing device may determine the shooting start position according to the first position selection operation by receiving the first position selection operation, and determine the second position selection operation according to the second position selection operation.
- Shooting end point position It should be noted that the first location selection operation or the second location selection operation may be a location selection operation similar to a click operation, which is not limited in the embodiment of the present invention.
- the video processing device receives a user operation
- the current position of the aircraft is determined as the shooting end point position.
- the camera device is performing a shooting finger during the moving process.
- the video processing device receives the click operation of the user
- the video processing device determines the current position of the aircraft as the shooting end point position, and controls the camera mounted on the aircraft to stop shooting.
- the operation of the user may be a click operation, a sliding operation, and the like, which are not limited in the embodiment of the present invention.
- S1102 Acquire a size of a target object in each video frame in the to-be-edited video.
- the video processing device may acquire the size of the target object in each video frame in the to-be-edited video.
- the size of the target object in each video frame in the video to be edited by the video processing device is 25 cm 2 , 30 cm 2 , 40 cm 2 , and 50 cm 2 , respectively .
- S1103 Determine a video frame with the largest size of the target object as the first video frame.
- the video processing device may determine the size of the target object in each video frame in the video to be edited, and determine the video frame with the largest size of the target object as the first video frame. For example, if the size of the target object in each video frame in the video to be edited is 25 cm 2 , 30 cm 2 , 40 cm 2 , and 50 cm 2 , the video processing device determines that the 50 cm 2 video frame with the largest size of the target object is the first. A video frame.
- the video processing device may determine the first frame of the video frame to be edited as the first video frame, or determine the last frame of the video to be edited as the first video frame.
- the display area of the target object in the first video frame is determined according to the location of the target frame selection area.
- S1104 Determine a size of the target object in the display area of the first video frame, and determine the size as a standard size.
- the video processing device may determine the size of the target object in the display area of the first video frame, and determine the size as a standard size. For example, the video processing device may determine that the size of the target object in the display area of the first video frame is 50 cm 2 , and the video processing device takes the size as a standard size.
- S1105 Perform scaling processing on the target object in the second video frame according to a standard size.
- the video processing device may first determine the size of the target object in the display area of the first video frame, determine the size as a standard size, and target the second video frame according to the standard size.
- the object is scaled.
- the video processing device may first determine a size of the target object in the display area of the first video frame, determine the size as a standard size, and enlarge the target object in the second video frame according to the standard size. Process or reduce processing so that after processing The size of the target object in the second video frame is the same as the standard size.
- the video processing device may further perform scaling processing on the entire image region of the second video frame according to the standard size.
- the video processing device may perform an enlargement process on the entire image region of the second video frame according to the standard size, and perform an interception process on the image of the second video frame after the enlargement process, so that after the interception process
- the size of the display area of the second video frame is the same as the size of the display area of the first video frame.
- S1106 Perform an adjustment process on the image position of the target object in the second video frame after the scaling process according to the position of the display area.
- the video processing device may perform an adjustment process on the image position of the target object in the second video frame after the scaling process according to the position of the display area.
- the video processing device may perform an adjustment process on the specified video frame in the acquired video to be edited to obtain a target video.
- the specified video frame refers to a part of the video frame to be edited or all the video frames to be edited.
- the video processing device may select a part of the video frame to be edited as the specified video frame from the to-be-edited video, where the selection mode is not limited, and all the video frames to be edited may be used as the specified video. a frame, so that the video processing device performs adjustment processing on the obtained specified video frame to obtain a target video.
- FIG. 6, FIG. 7, and FIG. 8 are used as an example.
- the interface diagram shown in FIG. 6 is the first video frame acquired by the video processing device, where 601 indicates that the acquired target object is located.
- the interface diagram shown in FIG. 7 is the second video frame acquired by the video processing device, and
- the interface diagram shown in FIG. 8 is the third video acquired by the video processing device. frame.
- the video frame image of FIG. 6 to FIG. 8 is a video frame that the video processing device sends a flight control instruction to the aircraft to cause the camera to capture the image during flight.
- the flight control command includes instructions for controlling movement of the aircraft in a direction away from the target object, or the flight control command includes instructions for controlling movement of the aircraft in a direction toward the target object.
- each specified video in the to-be-edited video is sequentially adjusted in the order of shooting time.
- the frame is adjusted.
- the video processing device obtains the specified video frame from the video to be edited. Thereafter, the target object may be determined in a specified video frame in the to-be-edited video, and the specified video frame is subjected to enlargement processing, wherein the target object is located in the specified video frame after the enlargement processing Target image area.
- FIG. 7 and FIG. 6 can be used as an example.
- the video processing device acquires a specified video frame image as shown in FIG. 7 from the video to be edited, and the video processing device can be specified as shown in FIG. 7.
- the target object 701 is determined in the video frame image, and the display position of the target object in the preview image shown in 601 in FIG.
- FIG. 9 is a schematic diagram of an interface of an enlarged video frame according to an embodiment of the present invention.
- the video processing device may further perform an enlargement process on the target object. Specifically, after acquiring the specified video frame from the video to be edited, the video processing device may determine the target object in a specified video frame in the to-be-edited video, and perform amplification processing on the target object, The enlarged target object is located in the target image area in the specified video frame.
- FIG. 6 and FIG. 8 can be described as an example.
- the video processing device acquires the specified video frame image as shown in FIG. 8 from the video to be edited, and the video processing device can determine the target object 801 in the specified video frame image as shown in FIG.
- the display position of the target object shown in 601 in the preview image is the target image area, and the target object 801 is enlarged, so that the target object after the enlargement processing is located as shown by 601 in FIG.
- the target image area results in a video frame image as shown in FIG.
- S1107 After performing adjustment processing on the image position of the target object in each second video frame, adjusting a time sequence of each specified video frame in the to-be-edited video according to a preset adjustment rule.
- the video processing device adjusts the time sequence of each specified video frame in the to-be-edited video according to the preset adjustment rule.
- the video processing device may adjust each of the specified video frames in the target video in a reverse order according to the shooting time sequence.
- FIG. 6, FIG. 9, and FIG. 10 are used as an example.
- the edited video frame acquired by the video processing device is a video frame image as shown in FIG. 6, FIG. 9, and FIG. 10, and the video processing is performed.
- the device may adjust the specified video frames in the target video as shown in FIG. 6, FIG. 9, and FIG. 10 in reverse order according to the shooting time sequence, and the adjusted output sequence is the video frame described in FIG. Image starts output, second output image 9 the video frame image, and finally the video frame image described in FIG. 6 is output.
- S1108 Determine the video obtained by adjusting the time sequence as the target video.
- the video processing device may determine the video obtained after adjusting the time sequence as the target video. Specifically, the video processing device may adjust each specified video frame in the target video in a reverse order according to the shooting time sequence, and combine the specified video frames after the adjustment sequence to obtain a target video.
- FIG. 6, FIG. 9, and FIG. 10 are used as an example.
- the edited video frame acquired by the video processing device is a video frame image as shown in FIG. 6, FIG. 9, and FIG. 10, and the video processing is performed.
- the device may adjust the specified video frames in the target video as shown in FIG. 6, FIG. 9, and FIG. 10 in reverse order according to the shooting time sequence.
- the video processing device is as shown in FIG. 10 and FIG. 9 to FIG.
- the sequence of the video frame images is described, and the video frame images are combined and edited to generate a target video.
- the video processing device may acquire a target object from the acquired preview image, and determine a display area of the target object in the preview image, by acquiring the process of the camera device flying in the aircraft.
- Obtaining a video to be edited by the camera device acquiring a first video frame from the to-be-edited video, and performing an adjustment process according to the image position of the target object in the second video frame of the first video frame to be edited, according to the shooting time
- the specified video frames in the target video are adjusted in a reverse-adjusted manner, so that the target video can be obtained according to the specified video frame after the adjustment sequence, thereby improving the efficiency of video processing.
- FIG. 12 is a schematic flowchart of still another video processing method according to an embodiment of the present invention.
- the method may be performed by an aircraft.
- the method in the embodiment of the present invention includes the following steps.
- the aircraft may receive a flight control command for indicating an airplane flight mode, and the flight control command includes a target object.
- the flight control command includes an instruction to control movement of the aircraft in a direction away from the target object; or the flight control command includes an instruction to control movement of the aircraft in a direction approaching the target object.
- the aircraft may acquire a video to be edited collected by the camera device during flight; determine a first video frame from the to-be-edited video, and determine that the target object is in the first video frame
- the display area is adjusted according to the display area, and the image position of the target object in the second video frame of the video to be edited is adjusted to obtain a target video; wherein, after the adjustment process
- the image position area in which the target object is located in the two video frames is the same as the image position area in the first video frame of the display area.
- the aircraft may determine the video frame having the largest size of the target object as the first video frame by acquiring the size of the target object in each video frame in the to-be-edited video.
- the aircraft may also determine the first frame of the video frame to be edited as the first video frame, or determine the last frame of the video to be edited as the first video frame.
- the aircraft may determine the size of the target object in the display area of the first video frame, determine the size as a standard size, and perform the target object in the second video frame according to the standard size. And scaling processing, and performing an adjustment process on the image position of the target object in the second video frame after the scaling process according to the position of the display area. Or performing scaling processing on the entire image area of the second video frame according to the standard size. Then, according to the shooting time sequence, each specified video frame in the target video is adjusted in a reverse order adjustment manner, and the video obtained after adjusting the time sequence is determined as the target video.
- S1202 In response to the flight control instruction, flying in the flight mode and controlling an image capturing device mounted on the aircraft to photograph the target object.
- the aircraft may fly in the flight mode and control an image capturing device mounted on the aircraft to photograph the target object in response to the flight control command, wherein, in the flight mode, The posture of the image pickup device causes the position of the target object in the photographing screen to remain unchanged, and the flight trajectory of the aircraft causes the size of the target object to change in the photographing screen.
- the position of the target object in the shooting picture remains unchanged, and the position of one point (for example, the center point) on the target object may remain unchanged, or the target frame of the target object may be framed.
- One of the points in the area (for example, the center point) remains unchanged in the shooting picture.
- the flight trajectory of the aircraft changes the size of the target object in the shooting picture, and may be a change of the distance of the aircraft from the target object during the flight, so that the size of the target object in the shooting picture changes.
- the aircraft may return the video captured by the camera device in the flight mode to the video processing device, so that the video processing device performs adjustment processing on the received video.
- the aircraft may receive a flight control command and respond to the flight control finger Having, in the flight mode, controlling and controlling an image pickup device mounted on the aircraft to photograph the target object, and in real time, shooting the camera device in the flight mode during the flight in the specific flight mode
- the video to be edited is sent to the video processing device, thereby implementing automatic video editing processing, which improves the video processing efficiency.
- FIG. 13 is a schematic flowchart diagram of still another video processing method according to an embodiment of the present invention, where the method may be performed by a video processing device and an aircraft.
- the method includes an interaction between a video processing device and a aircraft, the video processing device transmitting a flight control command to the aircraft, the flight control command to indicate an airplane flight mode, the aircraft responding to the flight control command, Flying in the flight mode and controlling the camera mounted on the aircraft to capture the target object, wherein in the flight mode, the attitude of the camera causes the target object to remain in the captured position Not changing, and the flight trajectory of the aircraft changes the size of the target object in the captured picture; the aircraft returns the video to be edited to the video processing device, the video to be edited is in the flight mode a video captured by the camera device; the video processing device receives the video to be edited; the video processing device determines a first video frame from the to-be-edited video, and determines that the target object is in the first video a display area in the frame; the video processing device according
- the video processing device acquires a frame selection operation on the target object in the preview image.
- the video processing device may acquire a frame selection operation on the target object in the preview image.
- the video processing device may acquire a frame selection operation on the target object in the preview image, the preview image is captured by an image capturing device mounted on the aircraft, and the imaging device is in the flight process of the aircraft.
- the target object is in the target frame selection area.
- the video processing device determines the target frame selection area according to the frame selection operation.
- the video processing device may determine the target frame selection area according to the frame selection operation.
- the video processing device may acquire a frame selection operation on the target object in the preview image, where The preview image is captured by a camera mounted on the aircraft, and according to the frame selection operation, the target frame selection area is determined, and the camera device shoots during the flight of the aircraft.
- the target object is in the target frame selection area.
- the video processing device can perform shooting by controlling the camera mounted on the aircraft, and control the pan/tilt to face the target object, so that the camera captures the preview image and is based on the user's user interface on the video processing device.
- FIG. 2 is an example, as shown in FIG. 2, which is a preview image captured by the video processing device by controlling the camera device, and based on the user's preview image on the user interface of the video processing device, regarding the target object.
- the image area 201 determined by the frame selection operation is used as the target frame selection area of the target object.
- the frame selection operation is one type of operation of the user on the target object in the preview image on the user interface of the video processing device, and the user views the preview on the user interface of the video processing device.
- the operation of the target object in the image may also be other operations.
- the embodiment of the present invention does not limit the operation of the target object in the preview image on the user interface of the video processing device.
- the video processing device acquires location information about a click operation of the target object in the preview image.
- the video processing device may acquire location information about a click operation of the target object in the preview image, where the preview image is captured by an image capturing device mounted on the aircraft, according to the click operation.
- the location information determines a target frame selection area, wherein the target object is in the target frame selection area in the to-be-edited video captured during the flight of the aircraft.
- the video processing device determines the target frame selection area according to the location information of the click operation.
- the video processing device may determine the target frame selection area according to the location information of the click operation.
- the video processing device may acquire location information about a click operation of the target object in the preview image, the preview image being captured by a camera mounted on the aircraft, according to the click operation.
- the location information determines a target frame selection area, wherein the target object is in the target frame selection area in the to-be-edited video captured during the flight of the aircraft.
- FIG. 2 is used as an example.
- the preview image captured by the video processing device by controlling the camera device is based on the user's user interface on the video processing device.
- the click operation on the target object in the preview image is acquired, and the location information of the click operation is obtained, and the target frame selection area 201 is determined as the target frame selection area of the target object according to the location information of the click operation.
- the camera device is in the to-be-edited video captured during the flight of the aircraft, the target object is in the target frame selection area.
- the video processing device sends a flight control command to the aircraft.
- the video processing device may send a flight control command to the aircraft, the flight control command being used to indicate the flight mode of the aircraft.
- the flight mode can be an auto zoom mode.
- S1306 The aircraft responds to the flight control command, and flies in the flight mode and controls an image capturing device mounted on the aircraft to shoot the target object.
- the aircraft may fly in the flight mode and control the camera mounted on the aircraft to photograph the target object in response to the flight control command, wherein in the flight mode, the aircraft
- the posture of the image pickup device keeps the position of the target object in the photographing screen unchanged, and the flight trajectory of the aircraft causes the size of the target object to change in the photographing screen.
- the aircraft may return the video to be edited to the video processing device, and the video to be edited is a video captured by the camera device in the flight mode.
- the video processing device receives the video to be edited.
- the video processing device can receive the video to be edited.
- the video processing device may determine a first video frame from the to-be-edited video, and determine a display area of the target object in the first video frame. Specifically, the video processing device may determine, to obtain, from the acquired preview image, location information of a display area of the target object in the preview image, where the location information includes a size, an area, coordinate information, and a target object of the area where the target object is located. One or more pieces of information in a ratio to the preview image, the preview image being obtained by the video processing device by controlling an image pickup device mounted on the aircraft, the target object being the video processing device based on the user in the video The operation on the user interface of the processing device is obtained from the obtained preview image. Specifically, FIG. 2 is used as an example. For example, the video processing device may determine that the length of the area indicated by 201 is 10 cm according to the obtained area indicated by 201 as the target object. The width is 15cm.
- the video processing device determines a size of the target object in the display area of the first video frame, and determines the size as a standard size.
- the video processing device may determine the size of the target object in the display area of the first video frame, and determine the size as a standard size.
- the video processing device may determine the video frame with the largest size of the target object as the first video frame by acquiring the size of the target object in each video frame in the to-be-edited video. For example, if the size of the target object in each video frame in the video to be edited is 25 cm 2 , 30 cm 2 , 40 cm 2 , and 50 cm 2 , the video processing device determines that the 50 cm 2 video frame with the largest size of the target object is the first. A video frame.
- the video processing device may determine the first frame of the video frame to be edited as the first video frame, or determine the last frame of the video to be edited as the first video frame.
- the display area of the target object in the first video frame is determined according to the location of the target frame selection area.
- the video processing device may perform scaling processing on the target object in the second video frame according to a standard size.
- the video processing device may first determine a size of the target object in the display area of the first video frame, determine the size as a standard size, and target the second video frame according to the standard size. The object is scaled.
- the video processing device performs an interception process on the image of the second video frame after the amplification process.
- the video processing device may perform an interception process on the image of the second video frame after the amplification process. Specifically, if it is detected that the video processing device performs the enlargement process on the target object in the second video frame according to the standard size, the video processing device may perform an interception process on the image of the second video frame after the enlargement process, so that after the interception process
- the size of the display area of the second video frame is the same as the size of the display area of the first video frame.
- the video processing device performs an adjustment process on the image position of the target object in the second video frame after the scaling process according to the position of the display area.
- the video processing device may perform an adjustment process on the image position of the target object in the second video frame after the scaling process according to the position of the display area.
- the video processing device may perform an adjustment process on the specified video frame in the acquired video to be edited to obtain a target video.
- the specified video frame refers to a part of the video frame to be edited or all the video frames to be edited.
- the video processing device may select a part of the video frame to be edited as the specified video frame from the to-be-edited video, where the selection mode is not limited, and all the video frames to be edited may be used as the specified video. a frame, so that the video processing device performs adjustment processing on the obtained specified video frame to obtain a target video.
- FIG. 6, FIG. 7, and FIG. 8 are used as an example.
- the interface diagram shown in FIG. 6 is the first video frame acquired by the video processing device, where 601 indicates that the acquired target object is located.
- the interface diagram shown in FIG. 7 is the second video frame acquired by the video processing device, and
- the interface diagram shown in FIG. 8 is the third video acquired by the video processing device. frame.
- the video frame image of FIG. 6 to FIG. 8 is a video frame that the video processing device sends a flight control instruction to the aircraft to cause the camera to capture the image during flight.
- the flight control command includes instructions for controlling movement of the aircraft in a direction away from the target object, or the flight control command includes instructions for controlling movement of the aircraft in a direction toward the target object.
- the video processing device may determine the target object in a specified video frame in the to-be-edited video, and perform the specified video frame on the specified video frame.
- FIG. 7 and FIG. 6 can be used as an example.
- the video processing device acquires a specified video frame image as shown in FIG. 7 from the video to be edited, and the video processing device can be specified as shown in FIG. 7.
- the target object 701 is determined in the video frame image, and the display position of the target object in the preview image shown in 601 in FIG.
- FIG. 9 is a schematic diagram of an interface of an enlarged video frame according to an embodiment of the present invention.
- the video processing device may further perform an enlargement process on the target object. Specifically, after acquiring the specified video frame from the video to be edited, the video processing device may determine the target object in a specified video frame in the to-be-edited video, and perform amplification processing on the target object, The enlarged target object is located in the target image area in the specified video frame.
- FIG. 6 and FIG. 8 can be described as an example.
- the video processing device is in the video to be edited Obtaining the specified video frame image as shown in FIG. 8, the video processing apparatus can determine the target object 801 in the specified video frame image as shown in FIG. 8, and in the preview with the target object shown by 601 in FIG. The display position in the image is the target image area, and the target object 801 is enlarged, so that the target object after the enlargement processing is located in the target image area as shown by 601 in FIG. 6, which is obtained as shown in FIG. Video frame image.
- the video processing device After adjusting the image position of the target object in each second video frame, the video processing device adjusts the time sequence of each specified video frame in the to-be-edited video according to a preset adjustment rule.
- the video processing device adjusts the time sequence of each specified video frame in the to-be-edited video according to the preset adjustment rule.
- each specified video frame in the to-be-edited video is adjusted in reverse order according to the shooting time sequence.
- the video processing device may adjust each of the specified video frames in the target video in a reverse order according to the shooting time sequence.
- FIG. 6, FIG. 9, and FIG. 10 are used as an example.
- the edited video frame acquired by the video processing device is a video frame image as shown in FIG. 6, FIG. 9, and FIG. 10, and the video processing is performed.
- the device may adjust the specified video frames in the target video as shown in FIG. 6, FIG. 9, and FIG. 10 in reverse order according to the shooting time sequence, and the adjusted output sequence is the video frame described in FIG.
- the image begins to be output, the video frame image described in FIG. 9 is output next, and the video frame image described in FIG. 6 is finally output.
- the video processing device determines the video obtained by adjusting the time sequence as the target video.
- the video processing device may determine the video obtained after adjusting the time sequence as the target video. Specifically, the video processing device may adjust each specified video frame in the target video in a reverse order according to the shooting time sequence, and combine the specified video frames after the adjustment sequence to obtain a target video.
- FIG. 6, FIG. 9, and FIG. 10 are used as an example.
- the edited video frame acquired by the video processing device is once as shown in FIG. 6, FIG. 9, and FIG.
- the video processing device can adjust the specified video frame as shown in FIG. 6, FIG. 9, and FIG. 10 in the target video in reverse order according to the shooting time sequence, the video processing device.
- the video frame images are combined and edited to generate a target video in the order of the video frame images described in FIG. 10 and FIG. 9 to FIG.
- the video processing device sends a flight control command to the aircraft, and the aircraft responds to the flight control command, flies in the flight mode, and returns the video to be edited captured by the camera device to the video processing device.
- the video processing device receives the video to be edited, determines a first video frame from the to-be-edited video, and determines a display area of the target object in the first video frame, according to the display area, The image position of the target object in the second video frame of the to-be-edited video is adjusted to obtain a target video, thereby implementing automatic video editing processing and improving video processing efficiency.
- FIG. 14 is a schematic structural diagram of a video processing device according to an embodiment of the present invention.
- the video processing device includes: an interaction device 1401, a processor 1402, and a memory 1403; the video processing device can be configured with an interaction device 1401 that interacts with a user, and the interaction device can be a touch display screen, a keyboard, a button, and a joystick.
- One or more of the pulsators, a user interface can be provided on the interaction device.
- the interaction device 1401 is configured to process interaction data generated for a user, including touching a display screen and the like.
- the memory 1403 may include a volatile memory; the memory 1403 may also include a non-volatile memory; the memory 1403 may also include a combination of the above types of memories.
- the processor 1402 can be a central processing unit (CPU).
- the processor 1402 may further include a hardware chip.
- the hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof.
- the PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), or any combination thereof.
- the memory 1403 is configured to store program instructions.
- the processor 1402 can call the program instructions stored in the memory 1403 for performing the following steps:
- the video to be edited is a video including a target object captured by an image capturing device mounted on the aircraft when the aircraft is in a specific flight mode, wherein the video is included in the video
- the position of the target object in the image remains unchanged, and the size of the target object in the image changes
- the image location area of the target object in the second video frame after the adjustment is the same as the image location area of the display area in the first video frame.
- the processor 1402 calls a program instruction stored in the memory 1403 to perform the following steps:
- the video frame having the largest size of the target object is determined as the first video frame.
- the processor 1402 calls the program instructions stored in the memory 1403 to perform the following steps:
- the last frame of the video frame to be edited is determined as the first video frame.
- the processor 1402 calls the program instructions stored in the memory 1403, and is further configured to perform the following steps:
- the camera device is in the to-be-edited video captured by the aircraft during flight, and the target object is in the target frame selection area.
- the processor 1402 calls the program instructions stored in the memory 1403, and is further configured to perform the following steps:
- the camera device is in the to-be-edited video captured by the aircraft during flight, and the target object is in the target frame selection area.
- the display area of the target object in the first video frame is according to the target frame The location of the selected area is determined.
- the processor 1402 calls the program instructions stored in the memory 1403 to perform the following steps:
- the processor 1402 calls the program instructions stored in the memory 1403 to perform the following steps:
- the entire image area of the second video frame is scaled according to the standard size.
- the processor 1402 calls the program instructions stored in the memory 1403 to perform the following steps:
- the processor 1402 calls the program instructions stored in the memory 1403 to perform the following steps:
- the video obtained after adjusting the chronological order is determined as the target video.
- the processor 1402 calls the program instructions stored in the memory 1403 to perform the following steps:
- the specified video frames in the target video are adjusted in reverse order according to the shooting time sequence.
- the processor 1402 calls the program instructions stored in the memory 1403 to perform the following steps:
- each specified video frame in the to-be-edited video is adjusted in reverse order according to the shooting time sequence.
- the processor 1402 calls the program instructions stored in the memory 1403 to perform the following steps:
- a flight control command is sent to the aircraft, the flight control command being used to control the aircraft flight.
- the flight control instruction includes instructions for controlling movement of the aircraft in a direction away from the target object;
- the flight control instructions include instructions for controlling movement of the aircraft in a direction proximate to the target object.
- processor 1402 for a specific implementation of the processor 1402 in the embodiment of the present invention, reference may be made to the description of related content in the foregoing embodiments, and details are not described herein.
- the video processing device may acquire a target object from the acquired preview image, and determine a display area of the target object in the preview image, by acquiring a process in which the camera device moves in the aircraft.
- the first video frame is obtained from the to-be-edited video, and the image position of the target object in the second video frame of the first video frame is adjusted according to the first video frame, so that the adjustment may be performed according to the adjustment sequence.
- the specified video frame is followed by the target video to improve the efficiency of video processing.
- An embodiment of the present invention further provides an aircraft, including: a fuselage; a power system disposed on the airframe to provide flight power; a processor, configured to receive a flight control command, the flight control command to indicate the aircraft Flight mode, and the flight control command includes a target object; in response to the flight control command, flying in the flight mode and controlling an image pickup device mounted on the aircraft to photograph the target object, wherein In the flight mode, the attitude of the camera device is such that the position of the target object in the captured image remains unchanged, and the flight trajectory of the aircraft changes the size of the target object in the captured image; The video captured by the camera in flight mode.
- processor is further configured to perform the following steps:
- the flight control command includes instructions for controlling movement of the aircraft in a direction away from the target object;
- the flight control instructions include instructions for controlling movement of the aircraft in a direction proximate to the target object.
- the processor is specifically configured to perform the following steps:
- the image location area of the target object in the second video frame after the adjustment is the same as the image location area of the display area in the first video frame.
- the aircraft may be a four-rotor UAV, a six-rotor UAV, a multi-rotor UAV, and the like.
- the power system may include a motor, an ESC, a propeller, etc., wherein the motor is responsible for driving the aircraft propeller, and the ESC is responsible for controlling the speed of the motor of the aircraft.
- An embodiment of the present invention further provides a video processing system, including: a video processing device and an aircraft;
- the video processing device is configured to send a flight control command to the aircraft, where the flight control command is used to indicate a flight mode of the aircraft;
- the video processing device is configured to receive the to-be-edited video; determine a first video frame from the to-be-edited video, and determine a display area of the target object in the first video frame; according to the display a region, the image position of the target object in the second video frame of the to-be-edited video is adjusted to obtain a target video; wherein, the image location area of the target object in the processed second video frame is adjusted, and The display area is the same in the image position area in the first video frame.
- the video processing device is further configured to acquire a size of a target object in each video frame in the to-be-edited video; and determine a video frame with a largest size of the target object as the first video frame.
- the video processing device is further configured to determine the first frame video frame in the to-be-edited video as the first video frame, or determine the last frame video frame in the to-be-edited video as the first video frame.
- the video processing device is further configured to acquire a frame selection operation on the target object in a preview image, where the preview image is captured by an image capturing device mounted on an aircraft; Operation, determining a target frame selection area; wherein the target object is in the target frame selection area in the to-be-edited video captured during the flight of the aircraft.
- the video processing device is further configured to acquire location information about a click operation of the target object in a preview image, where the preview image is captured by an image capturing device mounted on an aircraft; Clicking the location information of the operation to determine a target frame selection area; wherein the target device is in the target frame selection area in the to-be-edited video captured during the flight of the aircraft.
- the display area of the target object in the first video frame is determined according to a location of the target frame selection area.
- the video processing device is further configured to determine a size of the target object in the display area of the first video frame, determine the size as a standard size, and compare the standard size to the second video frame.
- the target object performs a scaling process; and performs an adjustment process on the image position of the target object in the second video frame after the scaling process according to the position of the display area.
- the video processing device is further configured to perform an enlargement process on the entire image region of the second video frame according to the standard size, and perform interception processing on the image of the second video frame after the enlargement process, so as to intercept
- the size of the display area of the processed second video frame is the same as the size of the display area of the first video frame.
- the video processing device is further configured to: after adjusting an image location of the target object in each second video frame, and then adjusting each specified video frame in the to-be-edited video according to a preset adjustment rule.
- the chronological order; the video obtained after adjusting the chronological order is determined as the target video.
- the video processing device is further configured to adjust each specified video frame in the target video in a reverse order according to a shooting time sequence.
- the video processing device is further configured to: when the to-be-edited video is captured by the aircraft in a direction away from the target object, in a reverse order according to a shooting time sequence, Each specified video frame in the video to be edited is adjusted.
- the flight control instruction includes a method for controlling the aircraft to be away from the target object.
- An instruction to move; or the flight control command includes instructions for controlling movement of the aircraft in a direction toward the target object.
- FIG. 13 Also provided in an embodiment of the present invention is a computer readable storage medium storing a computer program, which when executed by a processor, implements the present invention, FIG. 5, FIG. 11, FIG.
- the video processing device of the embodiment of the present invention shown in FIG. 13 can also be implemented in the video processing method in the embodiment corresponding to FIG. 13 , and details are not described herein again.
- the computer readable storage medium may be an internal storage unit of the device described in any of the preceding embodiments, such as a hard disk or a memory of the device.
- the computer readable storage medium may also be an external storage device of the device, such as a plug-in hard disk equipped on the device, a smart memory card (SMC), and a secure digital (SD) card. , Flash Card, etc.
- the computer readable storage medium may also include both an internal storage unit of the device and an external storage device.
- the computer readable storage medium is for storing the computer program and other programs and data required by the terminal.
- the computer readable storage medium can also be used to temporarily store data that has been output or is about to be output.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Automation & Control Theory (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
一种视频处理方法,其中,该方法包括:接收待编辑视频,所述待编辑视频是挂载在飞行器上的摄像装置(123)在飞行器处于特定飞行模式中时拍摄得到的包括目标对象的视频,其中,所述视频中所述目标对象在图像中的位置保持不变,且所述目标对象在图像中的大小改变;从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同,从而可以根据调整顺序后的指定视频帧得到目标视频,实现自动地视频编辑处理,提高视频处理的效率。此外还包括对应的视频处理设备、飞行器及视频处理系统。
Description
本发明涉及控制技术领域,尤其涉及一种视频处理方法、设备、飞行器及系统。
随着电子技术和图像处理技术的发展,人们可以通过较多的电子设备来拍摄视频,并通过诸如Photoshop应用(一种图像处理软件)等应用来将视频编辑为具有一定效果的视频。
传统的视频处理一般是:用户获取拍摄到的待编辑视频,并将待编辑视频加载到Photoshop等应用中;然后,用户再通过应用软件提供的工具来对待编辑视频进行编辑,得出用户想要效果的视频。如何更好地对视频进行编辑成为研究的热点。
发明内容
本发明实施例提供了一种视频处理方法、设备、飞行器及系统,可以自动地进行视频编辑处理。
第一方面,本发明实施例提供了一种视频处理方法,包括:
接收待编辑视频,所述待编辑视频是挂载在飞行器上的摄像装置在飞行器处于特定飞行模式中时拍摄得到的包括目标对象的视频,其中,所述视频中所述目标对象在图像中的位置保持不变,且所述目标对象在图像中的大小改变;
从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;
根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;
其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
第二方面,本发明实施例还提供了一种视频处理方法,包括:
接收飞行控制指令,所述飞行控制指令用于指示飞行器的飞行模式,且所
述飞行控制指令包括目标对象;
响应所述飞行控制指令,在所述飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变;
返回所述飞行模式下所述摄像装置拍摄到的视频。
第三方面,本发明实施例还提供了一种视频处理方法,包括:
视频处理设备发送飞行控制指令给飞行器,所述飞行控制指令用于指示飞行器的飞行模式;
所述飞行器响应所述飞行控制指令,在所述飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变;
所述飞行器将待编辑视频返回给所述视频处理设备,所述待编辑视频是所述飞行模式中所述摄像装置拍摄到的视频;
所述视频处理设备接收所述待编辑视频;
所述视频处理设备从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;
所述视频处理设备根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;
其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
第四方面,本发明实施例提供了一种视频处理设备,包括存储器和处理器;
所述存储器,用于存储程序指令;
所述处理器,用于接收待编辑视频,所述待编辑视频是挂载在飞行器上的摄像装置在飞行器处于特定飞行模式中时拍摄得到的包括目标对象的视频,其中,所述视频中所述目标对象在图像中的位置保持不变,且所述目标对象在图像中的大小改变;从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处
理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
第五方面,本发明实施例提供了一种飞行器,包括:
机身;
设置在机身上的动力系统,用于提供飞行动力;
处理器,用于接收飞行控制指令,所述飞行控制指令用于指示飞行器的飞行模式,且所述飞行控制指令包括目标对象;响应所述飞行控制指令,在所述飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变;返回所述飞行模式下所述摄像装置拍摄到的视频。
第六方面,发明实施例提供了一种视频处理系统,包括:视频处理设备和飞行器;
所述视频处理设备,用于发送飞行控制指令给飞行器,所述飞行控制指令用于指示飞行器的飞行模式;
所述飞行器,用于响应所述飞行控制指令,在所述飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变;将待编辑视频返回给所述视频处理设备,所述待编辑视频是所述飞行模式中所述摄像装置拍摄到的视频;
所述视频处理设备,还用于接收所述待编辑视频;从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
第七方面,本发明实施例提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,该计算机程序被处理器执行时实现如上述第一方面、第二方面或第三方面所述的视频处理方法。
本发明实施例中,通过挂载在飞行器上的摄像装置拍摄获取到预览图像,
从该预览图像中获取目标对象,以及确定所述目标对象在所述预览图像中的显示区域,并获取所述摄像装置在所述飞行器移动的过程中拍摄得到的待编辑视频,对所述待编辑视频中的指定视频帧进行调整处理,得到目标视频,从而实现自动地进行视频编辑处理。
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本发明实施例提供的一种无人机系统的结构示意图;
图2是本发明实施例提供的一种从预览图像中获取目标对象的界面示意图;
图3是本发明实施例提供的一种执行飞行控制指令的界面示意图;
图4是本发明实施例提供的一种拍摄过程的界面示意图;
图5是本发明实施例提供的一种视频处理方法的流程示意图;
图6是本发明实施例提供的一种指定视频帧的界面示意图;
图7是本发明实施例提供的另一种指定视频帧的界面示意图;
图8是本发明实施例提供的又一种种指定视频帧的界面示意图;
图9是本发明实施例提供的一种放大视频帧的界面示意图;
图10是本发明实施例提供的一种放大目标对象的界面示意图;
图11是本发明实施例提供的另一种视频处理方法的流程示意图;
图12是本发明实施例提供的又一种视频处理方法的流程示意图;
图13是本发明实施例提供的再一种视频处理方法的流程示意图;
图14是本发明实施例提供的一种视频处理设备的结构示意图。
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动
前提下所获得的所有其他实施例,都属于本发明保护的范围。
下面结合附图,对本发明的一些实施方式作详细说明。在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。
在本发明实施例提供的视频处理方法可以由一种视频处理设备执行,或,在其他实施例中,该视频处理方法也可以应用于像无人机这样的飞行器上,下面对应用于飞行器的视频处理方法进行举例说明。
本方案采取脱离遥控器控制全程构图以及无需手动进行后期处理的办法,在飞行器起飞之后通过视频处理设备上的APP应用进入移动变焦拍摄模式,以拍摄目标视频。在一个实施例中,飞行器在飞行的过程中,可以通过移动变焦拍摄模式调整云台对目标对象进行跟随,使摄像装置始终跟随目标对象拍摄,并确定所述目标对象的显示区域,以使所述目标对象始终保持在所述显示区域的位置不变。由此拍摄得到可供编辑的视频。
在一个实施例中,可以在确认摄像装置跟随所述目标对象拍摄并且所述目标对象存在于所述显示区域后,当接收到APP上动作执行按钮的点击操作时,生成飞行控制指令,并将所述飞行控制指令发送给飞行器,在该点击操作后生成的飞行控制指令用于控制所述飞行器向远离所述目标对象的方向移动进行拍摄,或者向靠近所述目标对象的方向移动进行拍摄。所述飞行器实时地将摄像装置所拍摄到的待编辑视频发送给终端,以使终端可以接收到所述待编辑视频。在一个实施例中,所述飞行器也可以在拍摄得到完整的视频后,再将其作为待编辑视频发送给终端。在一个实施例中,也可以由所述摄像装置自身将其拍摄到的视频发送给终端。
终端可以从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域,终端可以根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
在一个实施例中,需要终端进行编辑的待编辑视频也可以不是由飞行器和摄像装置的组合拍摄得到的视频,所述待编辑视频的获取场景可以包括多个。在一个实施例中,可以是在可移动机器人上挂载的摄像装置拍摄到的视频,再一个实施例中,还可以是一个用户通过智能手机等带摄像功能的设备拍摄的另
外一个用户或者对象(例如树、雕像等)的视频。
请参见图1,图1是本发明实施例提供的一种无人机系统的结构示意图。所述系统包括:视频处理设备11和无人机12。所述视频处理设备11可以为无人机的控制终端,具体地可以为遥控器、智能手机、平板电脑、膝上型电脑、地面站、穿戴式设备(手表、手环)中的一种或多种,所述无人机12可以是旋翼型无人机,例如四旋翼无人机、六旋翼无人机、八旋翼无人机,也可以是固定翼无人机。无人机包括动力系统121,动力系统用于为无人机提供飞行动力,其中,动力系统121包括螺旋桨、电机、电调中的一种或多种,无人机还可以包括云台122以及摄像装置123,摄像装置123通过云台122搭载于无人机的主体上。摄像装置用于在无人机的飞行过程中进行图像或视频拍摄,包括但不限于多光谱成像仪、高光谱成像仪、可见光相机及红外相机等,云台为多轴传动及增稳系统,云台电机通过调整转动轴的转动角度来对成像设备的拍摄角度进行补偿,并通过设置适当的缓冲机构来防止或减小成像设备的抖动。
在一个实施例中,该视频处理设备11可以配置与用户交互的交互装置,该交互装置可以是触摸显示屏、键盘、按键、摇杆、波轮中的一种或多种,该交互装置上可以提供APP以及用户界面,该用户界面上显示有该APP,该APP上显示有电子地图,用户可以在该视频处理设备11的用户界面的APP上显示的电子地图上执行点击操作,该点击操作点击一次即可确认一个点,该视频处理设备11在接收到该点击操作所点击的至少2个点之后,视频处理设备11连接该至少2个点,形成由这至少2个点连接而成的拍摄轨迹,从而控制无人机12按该拍摄轨迹飞行,以使摄像装置123按该拍摄轨迹进行拍摄。需要说明的是,该用户界面上的点击操作,只是确认拍摄轨迹的一种方法,对于拍摄轨迹的确认方式,本发明实施例不做限定。
在一个实施例中,在视频处理设备接收待编辑视频之前,无人机需要通过摄像装置拍摄预览图像,视频处理设备从获取到的预览图像中确定目标对象,并通过接收用户操作,确定所述目标对象在所述预览图像中的显示区域。所述视频处理设备发送飞行控制指令给所述无人机,以使所述无人机响应所述飞行控制指令,进行飞行拍摄,以使摄像装置拍摄得到待编辑视频;其中,所述待编辑视频中包括所述目标对象,所述目标对象在待编辑视频中的位置保持不变。具体以图2和图3为例进行说明,图2是本发明实施例提供的一种从预览
图像中获取目标对象的界面示意图,图3是本发明实施例提供的一种执行飞行控制指令的界面示意图。如图2所示是通过摄像装置拍摄得到的预览图像,用户通过对目标对象的框选操作选中图中201所示的区域,将该区域的图像中的某个图像对象作为目标对象,并确定该目标对象的显示区域,在一个实施例中,该框选操作所选中的区域可以作为该目标对象的显示区域。
在一个实施例中,在视频处理设备接收待编辑视频之前,可以获取在预览图像中关于所述目标对象的点击操作的位置信息,如图3所示的界面示意图,其中,301是执行按钮,用于控制无人机执行飞行控制指令,302是取消按钮,用于取消当前选取的目标对象的显示区域。当检测到用户点击图3中301所示的“GO”按钮时,该视频处理设备将控制无人机执行飞行控制指令,并控制无人机上的摄像装置对目标对象进行拍摄。根据该点击操作的位置信息,自动地框选出如图2中201所示的区域,将该区域的图像中的某个图像对象作为目标对象,并确定该目标对象的显示区域,在一个实施例中,该点击操作所选中的区域可以作为该目标对象的显示区域。
其中,拍摄过程如图4所示,图4是本发明实施例提供的一种拍摄过程的界面示意图。如图4所示,401表示拍摄进度,401是退出按钮,如图4所示,摄像装置的拍摄过程已完成了40%,当检测到拍摄结束时,视频处理设备便可以得到待编辑视频。
在一个实施例中,该视频处理设备11可以获取所述待编辑视频中各个视频帧中目标对象的尺寸,将所述目标对象的尺寸最大的视频帧确定为第一视频帧。
在一个实施例中,该视频处理设备11还可以将待编辑视频中的第一帧视频帧确定为第一视频帧,或者将待编辑视频中的最后一帧视频帧确定为第一视频帧。
在一个实施例中,该视频处理设备11可以确定出所述第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸,根据标准尺寸对所述第二视频帧中的目标对象进行缩放处理,根据所述显示区域的位置,对缩放处理后的所述目标对象在所述第二视频帧中的图像位置进行调整处理。
在一个实施例中,该视频处理设备11在对各个第二视频帧中的目标对象的图像位置进行调整处理后,可以按照拍摄时间顺序,以倒序调整的方式对所
述目标视频中各个指定视频帧进行调整,将调整时间顺序后得到的视频确定为目标视频。
具体再请参见图5,图5是本发明实施例提供的一种视频处理方法的流程示意图,所述方法可以由视频处理设备执行,其中,视频处理设备的具体解释如前所述。具体的,本发明实施例的所述方法包括如下步骤。
S501:接收待编辑视频。
本发明实施例中,视频处理设备可以接收待编辑视频,所述待编辑视频是挂载在飞行器上的摄像装置在飞行器处于特定飞行模式中时拍摄得到的包括目标对象的视频,其中,所述视频中所述目标对象在图像中的位置保持不变,且所述目标对象在图像中的大小改变。视频处理设备可以在接收待编辑视频之前,通过挂载在飞行器上的摄像装置拍摄得到预览图像,从获取的预览图像中获取目标对象。
在一个实施例中,视频处理设备可以获取在预览图像中关于所述目标对象的框选操作,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的,根据所述框选操作,确定目标框选区域,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。具体的,视频处理设备可以通过控制挂载在飞行器上的摄像装置进行拍摄,控制云台正对目标对象,从而使得摄像装置拍摄获取到预览图像,并基于用户在该视频处理设备的用户界面上的预览图像中关于所述目标对象的框选操作,从获取的预览图像中确定目标对象的目标框选区域,其中,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。具体可以图2为例进行说明,如图2所示为视频处理设备通过控制摄像装置拍摄到的预览图像,并基于用户在该视频处理设备的用户界面上的预览图像中关于所述目标对象的框选操作,将该框选操作确定的图像区域201作为目标对象的目标框选区域。
需要说明的是,该框选操作是用户在该视频处理设备的用户界面上的对所述预览图像中目标对象的操作的一种,用户在该视频处理设备的用户界面上的对所述预览图像中目标对象的操作也可以是其它操作,本发明实施例对用户在在该视频处理设备的用户界面上的对所述预览图像中目标对象的操作不做限定。
在一个实施例中,视频处理设备可以获取在预览图像中关于所述目标对象的点击操作的位置信息,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的,根据所述点击操作的位置信息,确定目标框选区域,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。具体可以图2为例进行说明,如图2所示为视频处理设备通过控制摄像装置拍摄到的预览图像,并基于用户在该视频处理设备的用户界面上的预览图像中关于所述目标对象的点击操作,获取该点击操作的位置信息,根据所述点击操作的位置信息,确定目标框选区域201为该目标对象的目标框选区域。其中,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
在一个实施例中,该视频处理设备可以获取该摄像装置在该飞行器移动的过程中拍摄得到的待编辑视频。具体的,该视频处理设备可以通过获取拍摄执行指令,控制挂载有摄像装置的飞行器移动,并在移动过程中拍摄得到待编辑视频。具体可以图3为例进行说明,如图3所示,该视频处理设备的用户界面在获取到目标对象之后,便会出现一个如图中301所示的执行按钮“GO”以及如图中302所示的取消按钮,当该视频处理设备接收到用户对该执行按钮“GO”的点击事件时,该视频处理设备可以获取到拍摄执行指令,从而控制挂载有摄像装置的飞行器移动,并在移动过程中拍摄得到待编辑视频。
在一个实施例中,该视频处理设备可以控制挂载有摄像装置的飞行器按照预置的移动规则控制所述飞行器移动,以便于所述摄像装置拍摄视频,从而使该视频处理设备可以获取该摄像装置在该飞行器移动的过程中拍摄得到的待编辑视频。其中,所述预置的移动规则可以通过确定拍摄起点位置、拍摄结束点位置中的一个或两个来控制该飞行器移动。
在一个实施例中,该视频处理设备可以是通过确定拍摄结束点位置,控制所述飞行器从当前位置向拍摄结束点位置移动。具体的,该视频处理设备可以通过确定拍摄结束点位置,控制所述飞行器从当前位置向拍摄结束点位置移动。其中,所述拍摄结束点在远离所述目标对象的方向。
在一个实施例中,该视频处理设备可以是通过确定拍摄起点位置以及拍摄结束点位置,控制所述飞行器从所述拍摄起点位置向拍摄结束点位置移动。其中,该视频处理设备可以通过接收第一位置选择操作,并根据所述第一位置选
择操作确定出拍摄起点位置,以及通过接收第二位置选择操作,并根据所述第二位置选择操作确定出拍摄结束点位置。需要说明的是,所述第一位置选择操作或第二位置选择操作可以是类似点击操作这样的位置选择操作,本发明实施例不做限定。
在一个实施例中,在所述飞行器的移动过程中,如果该视频处理设备接收到用户操作,则将当前所述飞行器的位置确定为拍摄结束点位置。具体可举例说明,在所述飞行器的移动过程中,该摄像装置在移动过程中正在执行拍摄指令,如果该视频处理设备接收到用户的点击操作,则该视频处理设备将当前所述飞行器的位置确定为拍摄结束点位置,控制挂载在该飞行器上的摄像装置停止拍摄。其中,该用户操作可以是点击操作、滑动操作等操作,本发明实施例不做限定。
S502:从该待编辑视频中确定第一视频帧,并确定该目标对象在第一视频帧中的显示区域。
本发明实施例中,视频处理设备可以从该待编辑视频中确定第一视频帧,并确定该目标对象在第一视频帧中的显示区域。具体的,该视频处理设备可以确定从获取的预览图像中获取目标对象在该预览图像中的显示区域的位置信息,其中,该位置信息包括目标对象所在区域的大小、面积、坐标信息、目标对象与预览图像的比例等中的一项或多项信息,该预览图像是视频处理设备通过控制挂载在飞行器上的摄像装置进行拍摄得到的,该目标对象是该视频处理设备基于用户在该视频处理设备的用户界面上的操作,从获取的预览图像中获取得到的。具体可以图2为例进行说明,例如,该视频处理设备可以根据获取到的作为目标对象的201所示区域,确定出该201所示区域的长度为10cm与宽度为15cm。
在一个实施例中,视频处理设备可以通过获取所述待编辑视频中各个视频帧中目标对象的尺寸,将所述目标对象的尺寸最大的视频帧确定为第一视频帧。例如,视频处理设备获取到待编辑视频中各个视频帧中目标对象的尺寸分别为25cm2、30cm2、40cm2、50cm2,则将所述目标对象的尺寸最大的50cm2视频帧确定为第一视频帧。
在一个实施例中,视频处理设备可以将待编辑视频中的第一帧视频帧确定为第一视频帧,或者将待编辑视频中的最后一帧视频帧确定为第一视频帧。
需要说明的是,所述目标对象在所述第一视频帧中的显示区域是根据所述目标框选区域的位置确定的。
S503:根据该显示区域,对该待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频。
本发明实施例中,视频处理设备可以根据该显示区域,对该待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频。
在一个实施例中,视频处理设备可以先确定出所述第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸,根据该标准尺寸对所述第二视频帧中的目标对象进行缩放处理。视频处理设备可以根据所述显示区域的位置,对缩放处理后的所述目标对象在所述第二视频帧中的图像位置进行调整处理。
在一个实施例中,视频处理设备还可以根据所述标准尺寸对所述第二视频帧的整个图像区域进行缩放处理。
在一个具体的实施例中,待编辑视频中目标对象的尺寸最大的视频帧确定为第一视频帧,该目标对象的尺寸为标准尺寸;其余视频帧均确定为第二视频帧。视频处理设备根据该标准尺寸对待编辑视频中的每一个第二视频帧的整个图像区域进行放大,并将放大后的第二视频帧的边缘区域截取掉,使得截取后的第二视频帧的大小和第一视频帧的大小一致,且截取后的第二视频帧中的目标对象在该截取后的第二视频帧中所在的位置和所占的面积,和第一视频帧中的目标对象在该第一视频帧中的位置和所占的面积相同。需要注意的是,本文中所指定相同,是允许一定范围内的误差存在的。
在一个实施例中,视频处理设备可以在对各个第二视频帧中的目标对象的图像位置进行调整处理后,再根据预置的调整规则调整所述待编辑视频中各个指定视频帧的时间顺序;将调整时间顺序后得到的视频确定为目标视频。
在一个实施例中,当所述待编辑视频是所述飞行器向远离所述目标对象的方向飞行时拍摄的,则按照拍摄时间顺序,以倒序调整的方式对所述待编辑视频中各个指定视频帧进行调整。
在一个实施例中,视频处理设备可以向所述飞行器发送飞行控制指令,所述飞行控制指令用于控制所述飞行器飞行。所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令;或者所述飞行控制指令包括用于
控制飞行器向靠近所述目标对象的方向移动的指令。
在一个实施例中,该视频处理设备可以对获取到的待编辑视频中的指定视频帧进行调整处理,得到目标视频。其中,该指定视频帧是指部分待编辑视频帧或全部待编辑视频帧。具体的,该视频处理设备在获取到待编辑视频之后,可以从待编辑视频中选取部分待编辑视频帧作为指定视频帧,其中选取方式不做限定,也可以将全部待编辑视频帧作为指定视频帧,以使该视频处理设备对获取的指定视频帧进行调整处理,得到目标视频。
具体可以图6、图7、图8为例进行说明,图6是本发明实施例提供的一种指定视频帧的界面示意图,图7是本发明实施例提供的另一种指定视频帧的界面示意图,图8是本发明实施例提供的又一种指定视频帧的界面示意图。如图6所示的界面示意图是该视频处理设备获取到的第一张视频帧,其中,601所示为获取到的目标对象在所述预览图像中的显示区域;如图7所示的界面示意图是该视频处理设备获取到的第二张视频帧,如图8所示的界面示意图是该视频处理设备获取到的第三张视频帧,其中,图6至图8的视频帧图像是该视频处理设备向所述飞行器发送飞行控制指令,以使该飞行器在飞行过程中摄像装置拍摄得到的视频帧。其中,所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令,或者所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。该视频处理设备通过对这三张视频帧进行调整处理,从而得到目标视频。
在一个实施例中,该视频处理设备在从待编辑视频中获取到指定视频帧之后,可以在所述待编辑视频中的指定视频帧中确定所述目标对象,并对所述指定视频帧进行放大处理,其中,所述目标对象位于放大处理后的指定视频帧中的所述目标图像区域。具体可以图7和图6为例进行说明,例如,该视频处理设备在从待编辑视频中获取到如图7所示的指定视频帧图像,该视频处理设备可以在如图7所示的指定视频帧图像中确定目标对象701,并以图6中601所示的目标对象在所述预览图像中的显示位置为目标图像区域,对该视频帧进行放大处理,以使所述目标对象701位于放大处理后的指定视频帧中的所述目标图像区域,得到如图9所示的视频帧图像,其中,图9是本发明实施例提供的一种放大视频帧的界面示意图。
在一个实施例中,该视频处理设备在从待编辑视频中获取到指定视频帧之
后,可以在所述待编辑视频中的指定视频帧中确定所述目标对象,对所述目标对象进行放大处理,所述放大处理后的目标对象位于所述指定视频帧中的所述目标图像区域。具体可以图6和图8为例进行说明,例如,该视频处理设备在从待编辑视频中获取到如图8所示的指定视频帧图像,该视频处理设备可以在如图8所示的指定视频帧图像中确定目标对象801,并以图6中601所示的目标对象在所述预览图像中的显示位置为目标图像区域,对该目标对象801进行放大处理,以使所述放大处理后的目标对象位于如图6中601所示的所述目标图像区域,得到如图10所示的视频帧图像,其中,图10是本发明实施例提供的一种放大目标对象的界面示意图。
在一个实施例中,该视频处理设备可以根据预置的调整规则调整所述目标视频中各个指定视频帧的顺序,根据调整顺序后的指定视频帧得到目标视频。具体的,该视频处理设备可以按照拍摄时间顺序,以倒序调整的方式对所述目标视频中各个指定视频帧进行调整,将调整顺序后的指定视频帧进行组合处理,从而得到目标视频。具体可以图6、图9、图10为例进行说明,例如,该视频处理设备获取到的编辑后的视频帧一次为如图6、图9、图10所示的视频帧图像,该视频处理设备可以按照拍摄时间顺序,以倒序调整的方式对所述目标视频中如图6、图9、图10所述的指定视频帧进行调整,从图10所述的视频帧图像开始输出,其次输出图9所述的视频帧图像,最后输出图6所述的视频帧图像。
本发明实施例中,该视频处理设备可以从获取的预览图像中获取目标对象,并确定所述目标对象在所述预览图像中的显示位置,通过获取所述摄像装置在所述飞行器移动的过程中拍摄得到的待编辑视频,从所述待编辑视频中获取第一视频帧,根据该第一视频帧对待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频,从而实现自动进行视频编辑处理,提高了视频处理效率。
请参见图11,图11是本发明实施例提供的另一种视频处理方法的流程示意图,所述方法可以由视频处理设备执行,其中视频处理设备的具体解释如前所述。本发明实施例的所述方法包括如下步骤。
S1101:接收待编辑视频。
本发明实施例中,视频处理设备可以接收待编辑视频,所述待编辑视频是
挂载在飞行器上的摄像装置在飞行器处于特定飞行模式中时拍摄得到的包括目标对象的视频,其中,所述视频中所述目标对象在图像中的位置保持不变,且所述目标对象在图像中的大小改变。视频处理设备可以在接收待编辑视频之前,通过挂载在飞行器上的摄像装置拍摄得到预览图像,从获取的预览图像中获取目标对象。
在一个实施例中,视频处理设备在接收待编辑视频之前,可以获取在预览图像中关于所述目标对象的框选操作,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的,根据所述框选操作,确定目标框选区域,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。具体的,视频处理设备可以通过控制挂载在飞行器上的摄像装置进行拍摄,控制云台正对目标对象,从而使得摄像装置拍摄获取到预览图像,并基于用户在该视频处理设备的用户界面上的预览图像中关于所述目标对象的框选操作,从获取的预览图像中确定目标对象的目标框选区域,其中,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。具体可以图2为例进行说明,如图2所示为视频处理设备通过控制摄像装置拍摄到的预览图像,并基于用户在该视频处理设备的用户界面上的预览图像中关于所述目标对象的框选操作,将该框选操作确定的图像区域201作为目标对象的目标框选区域。
需要说明的是,该框选操作是用户在该视频处理设备的用户界面上的对所述预览图像中目标对象的操作的一种,用户在该视频处理设备的用户界面上的对所述预览图像中目标对象的操作也可以是其它操作,本发明实施例对用户在在该视频处理设备的用户界面上的对所述预览图像中目标对象的操作不做限定。
在一个实施例中,视频处理设备还可以获取在预览图像中关于所述目标对象的点击操作的位置信息,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的,根据所述点击操作的位置信息,确定目标框选区域,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。具体可以图2为例进行说明,如图2所示为视频处理设备通过控制摄像装置拍摄到的预览图像,并基于用户在该视频处理设备的用户界面上的预览图像中关于所述目标对象的点击操作,获取该点击操作的位置信息,根据所述点
击操作的位置信息,确定目标框选区域201为该目标对象的目标框选区域。其中,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
在一个实施例中,该视频处理设备可以获取该摄像装置在该飞行器移动的过程中拍摄得到的待编辑视频。具体的,该视频处理设备可以通过获取拍摄执行指令,控制挂载有摄像装置的飞行器移动,并在移动过程中拍摄得到待编辑视频。具体可以图3为例进行说明,如图3所示,该视频处理设备的用户界面在获取到目标对象之后,便会出现一个如图中301所示的执行按钮“GO”以及如图中302所示的取消按钮,当该视频处理设备接收到用户对该执行按钮“GO”的点击事件时,该视频处理设备可以获取到拍摄执行指令,从而控制挂载有摄像装置的飞行器移动,并在移动过程中拍摄得到待编辑视频。
在一个实施例中,该视频处理设备可以控制挂载有摄像装置的飞行器按照预置的移动规则控制所述飞行器移动,以便于所述摄像装置拍摄视频,从而使该视频处理设备可以获取该摄像装置在该飞行器移动的过程中拍摄得到的待编辑视频。其中,所述预置的移动规则可以通过确定拍摄起点位置、拍摄结束点位置中的一个或两个来控制该飞行器移动。
在一个实施例中,该视频处理设备可以是通过确定拍摄结束点位置,控制所述飞行器从当前位置向拍摄结束点位置移动。具体的,该视频处理设备可以通过确定拍摄结束点位置,控制所述飞行器从当前位置向拍摄结束点位置移动。其中,所述拍摄结束点在远离所述目标对象的方向。
在一个实施例中,该视频处理设备可以是通过确定拍摄起点位置以及拍摄结束点位置,控制所述飞行器从所述拍摄起点位置向拍摄结束点位置移动。其中,该视频处理设备可以通过接收第一位置选择操作,并根据所述第一位置选择操作确定出拍摄起点位置,以及通过接收第二位置选择操作,并根据所述第二位置选择操作确定出拍摄结束点位置。需要说明的是,所述第一位置选择操作或第二位置选择操作可以是类似点击操作这样的位置选择操作,本发明实施例不做限定。
在一个实施例中,在所述飞行器的移动过程中,如果该视频处理设备接收到用户操作,则将当前所述飞行器的位置确定为拍摄结束点位置。具体可举例说明,在所述飞行器的移动过程中,该摄像装置在移动过程中正在执行拍摄指
令,如果该视频处理设备接收到用户的点击操作,则该视频处理设备将当前所述飞行器的位置确定为拍摄结束点位置,控制挂载在该飞行器上的摄像装置停止拍摄。其中,该用户操作可以是点击操作、滑动操作等操作,本发明实施例不做限定。
S1102:获取该待编辑视频中各个视频帧中目标对象的尺寸。
本发明实施例中,视频处理设备可以获取所述待编辑视频中各个视频帧中目标对象的尺寸。例如,视频处理设备获取到待编辑视频中各个视频帧中目标对象的尺寸分别为25cm2、30cm2、40cm2、50cm2。
S1103:将该目标对象的尺寸最大的视频帧确定为第一视频帧。
本发明实施例中,视频处理设备可以通过获取所述待编辑视频中各个视频帧中目标对象的尺寸,将所述目标对象的尺寸最大的视频帧确定为第一视频帧。例如,视频处理设备获取到待编辑视频中各个视频帧中目标对象的尺寸分别为25cm2、30cm2、40cm2、50cm2,则将所述目标对象的尺寸最大的50cm2视频帧确定为第一视频帧。
在一个实施例中,视频处理设备可以将待编辑视频中的第一帧视频帧确定为第一视频帧,或者将待编辑视频中的最后一帧视频帧确定为第一视频帧。
需要说明的是,所述目标对象在所述第一视频帧中的显示区域是根据所述目标框选区域的位置确定的。
S1104:确定出该第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸。
本发明实施例中,视频处理设备可以确定出所述第一视频帧的显示区域中目标对象的尺寸,并将该尺寸确定为标准尺寸。例如,视频处理设备可以确定出所述第一视频帧的显示区域中目标对象的尺寸为50cm2,则视频处理设备将该尺寸作为标准尺寸。
S1105:根据标准尺寸对该第二视频帧中的目标对象进行缩放处理。
本发明实施例中,视频处理设备可以先确定出所述第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸,根据该标准尺寸对所述第二视频帧中的目标对象进行缩放处理。具体的,视频处理设备可以先确定出所述第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸,根据该标准尺寸对所述第二视频帧中的目标对象进行放大处理或缩小处理,以使处理后
的所述第二视频帧中的目标对象的尺寸与所述标准尺寸相同。其中,视频处理设备还可以根据所述标准尺寸对所述第二视频帧的整个图像区域进行缩放处理。
在一个实施例中,视频处理设备可以根据所述标准尺寸对所述第二视频帧的整个图像区域进行放大处理,并对放大处理后的第二视频帧的图像进行截取处理,使得截取处理后的第二视频帧的显示区域的尺寸与所述第一视频帧的显示区域的尺寸相同。
S1106:根据该显示区域的位置,对缩放处理后的该目标对象在该第二视频帧中的图像位置进行调整处理。
本发明实施例中,视频处理设备可以根据所述显示区域的位置,对缩放处理后的所述目标对象在所述第二视频帧中的图像位置进行调整处理。
在一个实施例中,该视频处理设备可以对获取到的待编辑视频中的指定视频帧进行调整处理,得到目标视频。其中,该指定视频帧是指部分待编辑视频帧或全部待编辑视频帧。具体的,该视频处理设备在获取到待编辑视频之后,可以从待编辑视频中选取部分待编辑视频帧作为指定视频帧,其中选取方式不做限定,也可以将全部待编辑视频帧作为指定视频帧,以使该视频处理设备对获取的指定视频帧进行调整处理,得到目标视频。
具体可以图6、图7、图8为例进行说明,如图6所示的界面示意图是该视频处理设备获取到的第一张视频帧,其中,601所示为获取到的目标对象在所述预览图像中的显示区域;如图7所示的界面示意图是该视频处理设备获取到的第二张视频帧,如图8所示的界面示意图是该视频处理设备获取到的第三张视频帧。其中,图6至图8的视频帧图像是该视频处理设备向所述飞行器发送飞行控制指令,以使该飞行器在飞行过程中摄像装置拍摄得到的视频帧。其中,所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令,或者所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。
在一个实施例中,当所述待编辑视频是所述飞行器向远离所述目标对象的方向飞行时拍摄的,则按照拍摄时间顺序,以倒序调整的方式对所述待编辑视频中各个指定视频帧进行调整。
在一个实施例中,该视频处理设备在从待编辑视频中获取到指定视频帧之
后,可以在所述待编辑视频中的指定视频帧中确定所述目标对象,并对所述指定视频帧进行放大处理,其中,所述目标对象位于放大处理后的指定视频帧中的所述目标图像区域。具体可以图7和图6为例进行说明,例如,该视频处理设备在从待编辑视频中获取到如图7所示的指定视频帧图像,该视频处理设备可以在如图7所示的指定视频帧图像中确定目标对象701,并以图6中601所示的目标对象在所述预览图像中的显示位置为目标图像区域,对该视频帧进行放大处理,以使所述目标对象701位于放大处理后的指定视频帧中的所述目标图像区域,得到如图9所示的视频帧图像,其中,图9是本发明实施例提供的一种放大视频帧的界面示意图。
在一个实施例中,该视频处理设备还可以对该目标对象进行放大处理。具体的,该视频处理设备在从待编辑视频中获取到指定视频帧之后,可以在所述待编辑视频中的指定视频帧中确定所述目标对象,对所述目标对象进行放大处理,所述放大处理后的目标对象位于所述指定视频帧中的所述目标图像区域。具体可以图6和图8为例进行说明。例如,该视频处理设备在从待编辑视频中获取到如图8所示的指定视频帧图像,该视频处理设备可以在如图8所示的指定视频帧图像中确定目标对象801,并以图6中601所示的目标对象在所述预览图像中的显示位置为目标图像区域,对该目标对象801进行放大处理,以使所述放大处理后的目标对象位于如图6中601所示的所述目标图像区域,得到如图10所示的视频帧图像。
S1107:在对各个第二视频帧中的目标对象的图像位置进行调整处理后,再根据预置的调整规则调整该待编辑视频中各个指定视频帧的时间顺序。
本发明实施例中,该视频处理设备可以在对各个第二视频帧中的目标对象的图像位置进行调整处理后,再根据预置的调整规则调整该待编辑视频中各个指定视频帧的时间顺序。
在一个实施例中,该视频处理设备可以按照拍摄时间顺序,以倒序调整的方式对所述目标视频中各个指定视频帧进行调整。具体可以图6、图9、图10为例进行说明,例如,该视频处理设备获取到的编辑后的视频帧一次为如图6、图9、图10所示的视频帧图像,该视频处理设备可以按照拍摄时间顺序,以倒序调整的方式对所述目标视频中如图6、图9、图10所述的指定视频帧进行调整,调整后的输出顺序为从图10所述的视频帧图像开始输出,其次输出图
9所述的视频帧图像,最后输出图6所述的视频帧图像。
S1108:将调整时间顺序后得到的视频确定为目标视频。
本发明实施例中,该视频处理设备可以将调整时间顺序后得到的视频确定为目标视频。具体的,该视频处理设备可以按照拍摄时间顺序,以倒序调整的方式对所述目标视频中各个指定视频帧进行调整,将调整顺序后的指定视频帧进行组合处理,从而得到目标视频。具体可以图6、图9、图10为例进行说明,例如,该视频处理设备获取到的编辑后的视频帧一次为如图6、图9、图10所示的视频帧图像,该视频处理设备可以按照拍摄时间顺序,以倒序调整的方式对所述目标视频中如图6、图9、图10所述的指定视频帧进行调整,该视频处理设备以图10、图9至图6所述的视频帧图像的顺序,将该视频帧图像组合编辑生成目标视频。
本发明实施例中,该视频处理设备可以从获取的预览图像中获取目标对象,并确定所述目标对象在所述预览图像中的显示区域,通过获取所述摄像装置在所述飞行器飞行的过程中摄像装置拍摄得到的待编辑视频,从所述待编辑视频中获取第一视频帧,根据该第一视频帧对待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,按照拍摄时间顺序,以倒序调整的方式对所述目标视频中各个指定视频帧进行调整,从而可以根据调整顺序后的指定视频帧得到目标视频,提高视频处理的效率。
请参见图12,图12是本发明实施例提供的又一种视频处理方法的流程示意图,所述方法可以由飞行器执行,具体的,本发明实施例的所述方法包括如下步骤。
S1201:接收飞行控制指令。
本发明实施例中,飞行器可以接收飞行控制指令,该飞行控制指令用于指示飞行器的飞行模式,且所述飞行控制指令包括目标对象。其中,所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令;或者所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。
在一个实施例中,飞行器可以获取飞行过程中所述摄像装置采集到的待编辑视频;从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处理后的第
二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
在一个实施例中,飞行器可以通过获取所述待编辑视频中各个视频帧中目标对象的尺寸,将所述目标对象的尺寸最大的视频帧确定为第一视频帧。
在一个实施例中,该飞行器还可以将待编辑视频中的第一帧视频帧确定为第一视频帧,或者将待编辑视频中的最后一帧视频帧确定为第一视频帧。
在一个实施例中,该飞行器可以通过确定出所述第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸,根据标准尺寸对所述第二视频帧中的目标对象进行缩放处理,并根据所述显示区域的位置,对缩放处理后的所述目标对象在所述第二视频帧中的图像位置进行调整处理。或者根据所述标准尺寸对所述第二视频帧的整个图像区域进行缩放处理。再按照拍摄时间顺序,以倒序调整的方式对所述目标视频中各个指定视频帧进行调整,将调整时间顺序后得到的视频确定为目标视频。
S1202:响应该飞行控制指令,在该飞行模式下飞行并控制该飞行器上挂载的摄像装置对该目标对象进行拍摄。
本发明实施例中,飞行器可以响应所述飞行控制指令,在所述飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变。
其中,目标对象在拍摄画面中的位置保持不变,可以是指的目标对象上的其中一点(例如中心点)在拍摄画面中的位置保持不变,或者是框住该目标对象的目标框选区域内的其中一点(例如中心点)在拍摄画面中的位置保持不变。
其中,飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变,可以是飞行器在飞行的过程中与目标对象的距离发生变化,以使得目标对象在拍摄画面中的大小改变。
S1203:返回该飞行模式下该摄像装置拍摄到的视频。
本发明实施例中,飞行器可以返回该飞行模式下该摄像装置拍摄到的视频给视频处理设备,以使该视频处理设备对接收到的视频进行调整处理。
本发明实施例中,飞行器可以接收飞行控制指令,并响应所述飞行控制指
令,在所述飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,并实时地将在特定飞行模式下该摄像装置在所述飞行器在飞行过程中拍摄的待编辑视频发送给视频处理设备,从而实现自动进行视频编辑处理,提高了视频处理效率。
请参见图13,图13是本发明实施例提供的再一种视频处理方法的流程示意图,所述方法可以由视频处理设备和飞行器执行。该方法包括了视频处理设备和飞行器之间的交互,视频处理设备发送飞行控制指令给飞行器,所述飞行控制指令用于指示飞行器的飞行模式;所述飞行器响应所述飞行控制指令,在所述飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变;所述飞行器将待编辑视频返回给所述视频处理设备,所述待编辑视频是所述飞行模式中所述摄像装置拍摄到的视频;所述视频处理设备接收所述待编辑视频;所述视频处理设备从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;所述视频处理设备根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。具体的,本发明实施例的所述方法包括如下步骤。
S1301:视频处理设备获取在预览图像中关于所述目标对象的框选操作。
本发明实施例中,视频处理设备可以获取在预览图像中关于所述目标对象的框选操作。具体的,视频处理设备可以获取在预览图像中关于所述目标对象的框选操作,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
S1302:视频处理设备根据该框选操作,确定目标框选区域。
本发明实施例中,视频处理设备可以根据所述框选操作,确定目标框选区域,在一个实施例中,视频处理设备可以获取在预览图像中关于所述目标对象的框选操作,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的,根据所述框选操作,确定目标框选区域,所述摄像装置在所述飞行器的飞行过程中拍
摄的待编辑视频中,所述目标对象在所述目标框选区域内。具体的,视频处理设备可以通过控制挂载在飞行器上的摄像装置进行拍摄,控制云台正对目标对象,从而使得摄像装置拍摄获取到预览图像,并基于用户在该视频处理设备的用户界面上的预览图像中关于所述目标对象的框选操作,从获取的预览图像中确定目标对象的目标框选区域,其中,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。具体可以图2为例进行说明,如图2所示为视频处理设备通过控制摄像装置拍摄到的预览图像,并基于用户在该视频处理设备的用户界面上的预览图像中关于所述目标对象的框选操作,将该框选操作确定的图像区域201作为目标对象的目标框选区域。
需要说明的是,该框选操作是用户在该视频处理设备的用户界面上的对所述预览图像中目标对象的操作的一种,用户在该视频处理设备的用户界面上的对所述预览图像中目标对象的操作也可以是其它操作,本发明实施例对用户在在该视频处理设备的用户界面上的对所述预览图像中目标对象的操作不做限定。
S1303:视频处理设备获取在预览图像中关于该目标对象的点击操作的位置信息。
本发明实施例中,视频处理设备可以获取在预览图像中关于所述目标对象的点击操作的位置信息,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的,根据所述点击操作的位置信息,确定目标框选区域,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
S1304:视频处理设备根据该点击操作的位置信息,确定目标框选区域。
本发明实施例中,视频处理设备可以根据该点击操作的位置信息,确定目标框选区域。在一个实施例中,视频处理设备可以获取在预览图像中关于所述目标对象的点击操作的位置信息,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的,根据所述点击操作的位置信息,确定目标框选区域,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。具体可以图2为例进行说明,如图2所示为视频处理设备通过控制摄像装置拍摄到的预览图像,并基于用户在该视频处理设备的用户界面上的
预览图像中关于所述目标对象的点击操作,获取该点击操作的位置信息,根据所述点击操作的位置信息,确定目标框选区域201为该目标对象的目标框选区域。其中,所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
S1305:视频处理设备发送飞行控制指令给飞行器。
本发明实施例中,视频处理设备可以发送飞行控制指令给飞行器,所述飞行控制指令用于指示飞行器的飞行模式。例如,该飞行模式可以是自动变焦模式。
S1306:飞行器响应该飞行控制指令,在该飞行模式下飞行并控制该飞行器上挂载的摄像装置对该目标对象进行拍摄。
本发明实施例中,飞行器可以响应该飞行控制指令,在该飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变。
S1307:飞行器将将待编辑视频返回给该视频处理设备。
本发明实施例中,飞行器可以将待编辑视频返回给所述视频处理设备,所述待编辑视频是所述飞行模式中所述摄像装置拍摄到的视频。
S1308:视频处理设备接收该待编辑视频。
本发明实施例中,视频处理设备可以接收待编辑视频。
S1309:视频处理设备从该待编辑视频中确定第一视频帧,并确定目标对象在该第一视频帧中的显示区域。
本发明实施例中,视频处理设备可以从该待编辑视频中确定第一视频帧,并确定该目标对象在第一视频帧中的显示区域。具体的,该视频处理设备可以确定从获取的预览图像中获取目标对象在该预览图像中的显示区域的位置信息,其中,该位置信息包括目标对象所在区域的大小、面积、坐标信息、目标对象与预览图像的比例等中的一项或多项信息,该预览图像是视频处理设备通过控制挂载在飞行器上的摄像装置进行拍摄得到的,该目标对象是该视频处理设备基于用户在该视频处理设备的用户界面上的操作,从获取的预览图像中获取得到的。具体可以图2为例进行说明,例如,该视频处理设备可以根据获取到的作为目标对象的201所示区域,确定出该201所示区域的长度为10cm与
宽度为15cm。
S1310:视频处理设备确定出该第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸。
本发明实施例中,视频处理设备可以确定出该第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸。
在一个实施例中,视频处理设备可以通过获取所述待编辑视频中各个视频帧中目标对象的尺寸,将所述目标对象的尺寸最大的视频帧确定为第一视频帧。例如,视频处理设备获取到待编辑视频中各个视频帧中目标对象的尺寸分别为25cm2、30cm2、40cm2、50cm2,则将所述目标对象的尺寸最大的50cm2视频帧确定为第一视频帧。
在一个实施例中,视频处理设备可以将待编辑视频中的第一帧视频帧确定为第一视频帧,或者将待编辑视频中的最后一帧视频帧确定为第一视频帧。
需要说明的是,所述目标对象在所述第一视频帧中的显示区域是根据所述目标框选区域的位置确定的。
S1311:视频处理设备根据标准尺寸对该第二视频帧中的目标对象进行缩放处理。
本发明实施例中,视频处理设备可以根据标准尺寸对该第二视频帧中的目标对象进行缩放处理。在一个实施例中,视频处理设备可以先确定出所述第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸,根据该标准尺寸对所述第二视频帧中的目标对象进行缩放处理。
S1312:视频处理设备对放大处理后的第二视频帧的图像进行截取处理。
本发明实施例中,视频处理设备可以对放大处理后的第二视频帧的图像进行截取处理。具体的,如果检测到视频处理设备根据标准尺寸对该第二视频帧中的目标对象进行放大处理,则视频处理设备可以对放大处理后的第二视频帧的图像进行截取处理,使得截取处理后的第二视频帧的显示区域的尺寸与所述第一视频帧的显示区域的尺寸相同。
S1313:视频处理设备根据该显示区域的位置,对缩放处理后的该目标对象在该第二视频帧中的图像位置进行调整处理。
本发明实施例中,视频处理设备可以根据该显示区域的位置,对缩放处理后的该目标对象在该第二视频帧中的图像位置进行调整处理。
在一个实施例中,该视频处理设备可以对获取到的待编辑视频中的指定视频帧进行调整处理,得到目标视频。其中,该指定视频帧是指部分待编辑视频帧或全部待编辑视频帧。具体的,该视频处理设备在获取到待编辑视频之后,可以从待编辑视频中选取部分待编辑视频帧作为指定视频帧,其中选取方式不做限定,也可以将全部待编辑视频帧作为指定视频帧,以使该视频处理设备对获取的指定视频帧进行调整处理,得到目标视频。
具体可以图6、图7、图8为例进行说明,如图6所示的界面示意图是该视频处理设备获取到的第一张视频帧,其中,601所示为获取到的目标对象在所述预览图像中的显示区域;如图7所示的界面示意图是该视频处理设备获取到的第二张视频帧,如图8所示的界面示意图是该视频处理设备获取到的第三张视频帧。其中,图6至图8的视频帧图像是该视频处理设备向所述飞行器发送飞行控制指令,以使该飞行器在飞行过程中摄像装置拍摄得到的视频帧。其中,所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令,或者所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。
在一个实施例中,该视频处理设备在从待编辑视频中获取到指定视频帧之后,可以在所述待编辑视频中的指定视频帧中确定所述目标对象,并对所述指定视频帧进行放大处理,其中,所述目标对象位于放大处理后的指定视频帧中的所述目标图像区域。具体可以图7和图6为例进行说明,例如,该视频处理设备在从待编辑视频中获取到如图7所示的指定视频帧图像,该视频处理设备可以在如图7所示的指定视频帧图像中确定目标对象701,并以图6中601所示的目标对象在所述预览图像中的显示位置为目标图像区域,对该视频帧进行放大处理,以使所述目标对象701位于放大处理后的指定视频帧中的所述目标图像区域,得到如图9所示的视频帧图像,其中,图9是本发明实施例提供的一种放大视频帧的界面示意图。
在一个实施例中,该视频处理设备还可以对该目标对象进行放大处理。具体的,该视频处理设备在从待编辑视频中获取到指定视频帧之后,可以在所述待编辑视频中的指定视频帧中确定所述目标对象,对所述目标对象进行放大处理,所述放大处理后的目标对象位于所述指定视频帧中的所述目标图像区域。具体可以图6和图8为例进行说明。例如,该视频处理设备在从待编辑视频中
获取到如图8所示的指定视频帧图像,该视频处理设备可以在如图8所示的指定视频帧图像中确定目标对象801,并以图6中601所示的目标对象在所述预览图像中的显示位置为目标图像区域,对该目标对象801进行放大处理,以使所述放大处理后的目标对象位于如图6中601所示的所述目标图像区域,得到如图10所示的视频帧图像。
S1314:视频处理设备在对各个第二视频帧中的目标对象的图像位置进行调整处理后,再根据预置的调整规则调整该待编辑视频中各个指定视频帧的时间顺序。
本发明实施例中,该视频处理设备可以在对各个第二视频帧中的目标对象的图像位置进行调整处理后,再根据预置的调整规则调整该待编辑视频中各个指定视频帧的时间顺序。
S1315:当该待编辑视频是该飞行器向远离该目标对象的方向飞行时拍摄的,则按照拍摄时间顺序,以倒序调整的方式对该待编辑视频中各个指定视频帧进行调整。
本发明实施例中,当该待编辑视频是该飞行器向远离该目标对象的方向飞行时拍摄的,则按照拍摄时间顺序,以倒序调整的方式对该待编辑视频中各个指定视频帧进行调整。
在一个实施例中,该视频处理设备可以按照拍摄时间顺序,以倒序调整的方式对所述目标视频中各个指定视频帧进行调整。具体可以图6、图9、图10为例进行说明,例如,该视频处理设备获取到的编辑后的视频帧一次为如图6、图9、图10所示的视频帧图像,该视频处理设备可以按照拍摄时间顺序,以倒序调整的方式对所述目标视频中如图6、图9、图10所述的指定视频帧进行调整,调整后的输出顺序为从图10所述的视频帧图像开始输出,其次输出图9所述的视频帧图像,最后输出图6所述的视频帧图像。
S1316:视频处理设备将调整时间顺序后得到的视频确定为目标视频。
本发明实施例中,该视频处理设备可以将调整时间顺序后得到的视频确定为目标视频。具体的,该视频处理设备可以按照拍摄时间顺序,以倒序调整的方式对所述目标视频中各个指定视频帧进行调整,将调整顺序后的指定视频帧进行组合处理,从而得到目标视频。具体可以图6、图9、图10为例进行说明,例如,该视频处理设备获取到的编辑后的视频帧一次为如图6、图9、图10
所示的视频帧图像,该视频处理设备可以按照拍摄时间顺序,以倒序调整的方式对所述目标视频中如图6、图9、图10所述的指定视频帧进行调整,该视频处理设备以图10、图9至图6所述的视频帧图像的顺序,将该视频帧图像组合编辑生成目标视频。
本发明实施例中,视频处理设备通过发送飞行控制指令给飞行器,飞行器响应所述飞行控制指令,在所述飞行模式下飞行,并将摄像装置拍摄到的待编辑视频返回给所述视频处理设备,所述视频处理设备接收到待编辑视频,从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域,根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频,从而实现自动进行视频编辑处理,提高了视频处理效率。
再请参见图14,图14是本发明实施例提供的一种视频处理设备的结构示意图。具体的,所述视频处理设备包括:交互装置1401、处理器1402以及存储器1403;该视频处理设备可以配置与用户交互的交互装置1401,该交互装置可以是触摸显示屏、键盘、按键、摇杆、波轮中的一种或多种,该交互装置上可以提供用户界面。
所述交互装置1401,用于对针对用户产生的交互数据进行处理,包括触摸显示屏等部件。
所述存储器1403可以包括易失性存储器(volatile memory);存储器1403也可以包括非易失性存储器(non-volatile memory);存储器1403还可以包括上述种类的存储器的组合。所述处理器1402可以是中央处理器(central processing unit,CPU)。所述处理器1402还可以进一步包括硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated circuit,ASIC),可编程逻辑器件(programmable logic device,PLD)或其组合。上述PLD可以是复杂可编程逻辑器件(complex programmable logic device,CPLD),现场可编程逻辑门阵列(field-programmable gate array,FPGA)或其任意组合。
可选地,所述存储器1403用于存储程序指令。所述处理器1402可以调用存储器1403中存储的程序指令,用于执行如下步骤:
接收待编辑视频,所述待编辑视频是挂载在飞行器上的摄像装置在飞行器处于特定飞行模式中时拍摄得到的包括目标对象的视频,其中,所述视频中所
述目标对象在图像中的位置保持不变,且所述目标对象在图像中的大小改变;
从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;
根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;
其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
可选地,所述处理器1402调用存储器1403中存储的程序指令,用于执行如下步骤:
获取所述待编辑视频中各个视频帧中目标对象的尺寸;
将所述目标对象的尺寸最大的视频帧确定为第一视频帧。
可选地,所述处理器1402调用存储器1403中存储的程序指令还用于执行如下步骤:
将待编辑视频中的第一帧视频帧确定为第一视频帧;或者
将待编辑视频中的最后一帧视频帧确定为第一视频帧。
可选地,所述处理器1402调用存储器1403中存储的程序指令,还用于执行如下步骤:
获取在预览图像中关于所述目标对象的框选操作,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的;
根据所述框选操作,确定目标框选区域;
所述摄像装置在所述飞行器在飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
可选地,所述处理器1402调用存储器1403中存储的程序指令,还用于执行如下步骤:
获取在预览图像中关于所述目标对象的点击操作的位置信息,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的;
根据所述点击操作的位置信息,确定目标框选区域;
所述摄像装置在所述飞行器在飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
可选地,所述目标对象在所述第一视频帧中的显示区域是根据所述目标框
选区域的位置确定的。
可选地,所述处理器1402调用存储器1403中存储的程序指令还用于执行如下步骤:
确定出所述第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸;
根据标准尺寸对所述第二视频帧中的目标对象进行缩放处理;
根据所述显示区域的位置,对缩放处理后的所述目标对象在所述第二视频帧中的图像位置进行调整处理。
可选地,所述处理器1402调用存储器1403中存储的程序指令还用于执行如下步骤:
根据所述标准尺寸对所述第二视频帧的整个图像区域进行缩放处理。
可选地,所述处理器1402调用存储器1403中存储的程序指令还用于执行如下步骤:
根据所述标准尺寸对所述第二视频帧的整个图像区域进行放大处理;
对放大处理后的第二视频帧的图像进行截取处理,使得截取处理后的第二视频帧的显示区域的尺寸与所述第一视频帧的显示区域的尺寸相同。
可选地,所述处理器1402调用存储器1403中存储的程序指令还用于执行如下步骤:
在对各个第二视频帧中的目标对象的图像位置进行调整处理后,再根据预置的调整规则调整所述待编辑视频中各个指定视频帧的时间顺序;
将调整时间顺序后得到的视频确定为目标视频。
可选地,所述处理器1402调用存储器1403中存储的程序指令还用于执行如下步骤:
按照拍摄时间顺序,以倒序调整的方式对所述目标视频中各个指定视频帧进行调整。
可选地,所述处理器1402调用存储器1403中存储的程序指令还用于执行如下步骤:
当所述待编辑视频是所述飞行器向远离所述目标对象的方向飞行时拍摄的,则按照拍摄时间顺序,以倒序调整的方式对所述待编辑视频中各个指定视频帧进行调整。
可选地,所述处理器1402调用存储器1403中存储的程序指令还用于执行如下步骤:
向所述飞行器发送飞行控制指令,所述飞行控制指令用于控制所述飞行器飞行。
可选地,所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令;或者
所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。
本发明实施例的所述处理器1402的具体实现可参考上述各个实施例中相关内容的描述,在此不赘述。
本发明实施例中,该视频处理设备可以从获取的预览图像中获取目标对象,并确定所述目标对象在所述预览图像中的显示区域,通过获取所述摄像装置在所述飞行器移动的过程中拍摄得到的待编辑视频,从所述待编辑视频中获取第一视频帧,根据该第一视频帧对待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,从而可以根据调整顺序后的指定视频帧得到目标视频,提高视频处理的效率。
本发明实施例还提供了一种飞行器,包括:机身;设置在机身上的动力系统,用于提供飞行动力;处理器,用于接收飞行控制指令,所述飞行控制指令用于指示飞行器的飞行模式,且所述飞行控制指令包括目标对象;响应所述飞行控制指令,在所述飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变;返回所述飞行模式下所述摄像装置拍摄到的视频。
进一步,所述处理器还用于执行如下步骤:
所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令;或者
所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。
可选的,所述处理器具体用于执行如下步骤:
获取待编辑视频,所述待编辑视频是所述飞行模式下所述摄像装置拍摄到的视频;
从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;
根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;
其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
所述飞行器中处理器的具体实现可参考上述图12所对应实施例的视频处理方法,在此不再赘述。其中,飞行器可以是四旋翼无人机、六旋翼无人机、多旋翼无人机等类型的飞行器。所述动力系统可以包括电机、电调、螺旋桨等结构,其中,电机负责带动飞行器螺旋桨,电调负责控制飞行器的电机的转速。
本发明实施例还提供了一种视频处理系统,包括:视频处理设备和飞行器;
所述视频处理设备,用于发送飞行控制指令给飞行器,所述飞行控制指令用于指示飞行器的飞行模式;
所述飞行器,用于响应所述飞行控制指令,在所述飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变;将待编辑视频返回给所述视频处理设备,所述待编辑视频是所述飞行模式中所述摄像装置拍摄到的视频;
所述视频处理设备,用于接收所述待编辑视频;从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
可选的,所述视频处理设备,还用于获取所述待编辑视频中各个视频帧中目标对象的尺寸;将所述目标对象的尺寸最大的视频帧确定为第一视频帧。
可选的,所述视频处理设备,还用于将待编辑视频中的第一帧视频帧确定为第一视频帧,或者将待编辑视频中的最后一帧视频帧确定为第一视频帧。
可选的,所述视频处理设备,还用于获取在预览图像中关于所述目标对象的框选操作,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的;根据所述框选操作,确定目标框选区域;所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
可选的,所述视频处理设备,还用于获取在预览图像中关于所述目标对象的点击操作的位置信息,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的;根据所述点击操作的位置信息,确定目标框选区域;所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
可选的,所述目标对象在所述第一视频帧中的显示区域是根据所述目标框选区域的位置确定的。
可选的,所述视频处理设备,还用于确定出所述第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸;根据标准尺寸对所述第二视频帧中的目标对象进行缩放处理;根据所述显示区域的位置,对缩放处理后的所述目标对象在所述第二视频帧中的图像位置进行调整处理。
可选的,所述视频处理设备,还用于根据所述标准尺寸对所述第二视频帧的整个图像区域进行缩放处理。
可选的,所述视频处理设备,还用于根据所述标准尺寸对所述第二视频帧的整个图像区域进行放大处理;对放大处理后的第二视频帧的图像进行截取处理,使得截取处理后的第二视频帧的显示区域的尺寸与所述第一视频帧的显示区域的尺寸相同。
可选的,所述视频处理设备,还用于在对各个第二视频帧中的目标对象的图像位置进行调整处理后,再根据预置的调整规则调整所述待编辑视频中各个指定视频帧的时间顺序;将调整时间顺序后得到的视频确定为目标视频。
可选的,所述视频处理设备,还用于按照拍摄时间顺序,以倒序调整的方式对所述目标视频中各个指定视频帧进行调整。
可选的,所述视频处理设备,还用于当所述待编辑视频是所述飞行器向远离所述目标对象的方向飞行时拍摄的,则按照拍摄时间顺序,以倒序调整的方式对所述待编辑视频中各个指定视频帧进行调整。
可选的,所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方
向移动的指令;或者所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。
在本发明的实施例中还提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现本发明图5、图11、图12或图13所对应实施例中描述的视频处理方法方式,也可实现图13所述本发明所对应实施例的视频处理设备,在此不再赘述。
所述计算机可读存储介质可以是前述任一实施例所述的设备的内部存储单元,例如设备的硬盘或内存。所述计算机可读存储介质也可以是所述设备的外部存储设备,例如所述设备上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。进一步地,所述计算机可读存储介质还可以既包括所述设备的内部存储单元也包括外部存储设备。所述计算机可读存储介质用于存储所述计算机程序以及所述终端所需的其他程序和数据。所述计算机可读存储介质还可以用于暂时地存储已经输出或者将要输出的数据。
以上所揭露的仅为本发明部分实施例而已,当然不能以此来限定本发明之权利范围,因此依本发明权利要求所作的等同变化,仍属本发明所涵盖的范围。
Claims (61)
- 一种视频处理方法,其特征在于,包括:接收待编辑视频,所述待编辑视频是挂载在飞行器上的摄像装置在飞行器处于特定飞行模式中时拍摄得到的包括目标对象的视频,其中,所述视频中所述目标对象在图像中的位置保持不变,且所述目标对象在图像中的大小改变;从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
- 根据权利要求1所述的方法,其特征在于,所述从所述待编辑视频中确定第一视频帧,包括:获取所述待编辑视频中各个视频帧中目标对象的尺寸;将所述目标对象的尺寸最大的视频帧确定为第一视频帧。
- 根据权利要求1所述的方法,其特征在于,所述从所述待编辑视频中确定第一视频帧,还包括:将待编辑视频中的第一帧视频帧确定为第一视频帧,或者将待编辑视频中的最后一帧视频帧确定为第一视频帧。
- 根据权利要求1所述的方法,其特征在于,所述接收待编辑视频之前,包括:获取在预览图像中关于所述目标对象的框选操作,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的;根据所述框选操作,确定目标框选区域;所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
- 根据权利要求1所述的方法,其特征在于,所述接收待编辑视频之前,还包括:获取在预览图像中关于所述目标对象的点击操作的位置信息,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的;根据所述点击操作的位置信息,确定目标框选区域;所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
- 根据权利要求4或5所述的方法,其特征在于,所述目标对象在所述第一视频帧中的显示区域是根据所述目标框选区域的位置确定的。
- 根据权利要求1-6任一项所述的方法,其特征在于,所述根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,包括:确定出所述第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸;根据标准尺寸对所述第二视频帧中的目标对象进行缩放处理;根据所述显示区域的位置,对缩放处理后的所述目标对象在所述第二视频帧中的图像位置进行调整处理。
- 根据权利要求6或7所述的方法,其特征在于,所述根据标准尺寸对第二视频帧中的目标对象进行缩放处理,包括:根据所述标准尺寸对所述第二视频帧的整个图像区域进行缩放处理。
- 根据权利要求8所述的方法,其特征在于,所述根据所述标准尺寸对所述第二视频帧的整个图像区域进行缩放处理,包括:根据所述标准尺寸对所述第二视频帧的整个图像区域进行放大处理;对放大处理后的第二视频帧的图像进行截取处理,使得截取处理后的第二视频帧的显示区域的尺寸与所述第一视频帧的显示区域的尺寸相同。
- 根据权利要求1-9任一项所述的方法,其特征在于,所述得到目标视频,包括:在对各个第二视频帧中的目标对象的图像位置进行调整处理后,再根据预置的调整规则调整所述待编辑视频中各个指定视频帧的时间顺序;将调整时间顺序后得到的视频确定为目标视频。
- 根据权利要求10所述的方法,其特征在于,所述根据预置的调整规则调整所述待编辑视频中各个指定视频帧,包括:按照拍摄时间顺序,以倒序调整的方式对所述待编辑视频中各个指定视频帧进行调整。
- 根据权利要求11所述的方法,其特征在于,所述以倒序调整的方式对所述待编辑视频中各个指定视频帧进行调整,包括:当所述待编辑视频是所述飞行器向远离所述目标对象的方向飞行时拍摄的,则按照拍摄时间顺序,以倒序调整的方式对所述待编辑视频中各个指定视频帧进行调整。
- 根据权利要求1所述的方法,其特征在于,还包括:向所述飞行器发送飞行控制指令,所述飞行控制指令用于控制所述飞行器飞行。
- 根据权利要求13所述的方法,其特征在于,所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令;或者所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。
- 一种视频处理方法,其特征在于,包括:接收飞行控制指令,所述飞行控制指令用于指示飞行器的飞行模式,且所 述飞行控制指令包括目标对象;响应所述飞行控制指令,在所述飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变;返回所述飞行模式下所述摄像装置拍摄到的视频。
- 根据权利要求15所述的方法,其特征在于,所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令;或者所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。
- 根据权利要求15所述的方法,其特征在于,还包括:获取待编辑视频,所述待编辑视频是所述飞行模式下所述摄像装置拍摄到的视频;从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
- 一种视频处理方法,其特征在于,包括:视频处理设备发送飞行控制指令给飞行器,所述飞行控制指令用于指示飞行器的飞行模式;所述飞行器响应所述飞行控制指令,在所述飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变;所述飞行器将待编辑视频返回给所述视频处理设备,所述待编辑视频是所述飞行模式中所述摄像装置拍摄到的视频;所述视频处理设备接收所述待编辑视频;所述视频处理设备从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;所述视频处理设备根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
- 根据权利要求18所述的方法,其特征在于,所述视频处理设备从所述待编辑视频中确定第一视频帧,包括:获取所述待编辑视频中各个视频帧中目标对象的尺寸;将所述目标对象的尺寸最大的视频帧确定为第一视频帧。
- 根据权利要求18所述的方法,其特征在于,所述从视频处理设备所述待编辑视频中确定第一视频帧,还包括:将待编辑视频中的第一帧视频帧确定为第一视频帧,或者将待编辑视频中的最后一帧视频帧确定为第一视频帧。
- 根据权利要求18所述的方法,其特征在于,所述视频处理设备接收待编辑视频之前,包括:获取在预览图像中关于所述目标对象的框选操作,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的;根据所述框选操作,确定目标框选区域;所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
- 根据权利要求18所述的方法,其特征在于,所述视频处理设备接收待编辑视频之前,还包括:获取在预览图像中关于所述目标对象的点击操作的位置信息,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的;根据所述点击操作的位置信息,确定目标框选区域;所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
- 根据权利要求21或22所述的方法,其特征在于,所述目标对象在所述第一视频帧中的显示区域是根据所述目标框选区域的位置确定的。
- 根据权利要求18-23任一项所述的方法,其特征在于,所述视频处理设备根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,包括:确定出所述第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸;根据标准尺寸对所述第二视频帧中的目标对象进行缩放处理;根据所述显示区域的位置,对缩放处理后的所述目标对象在所述第二视频帧中的图像位置进行调整处理。
- 根据权利要求23或24所述的方法,其特征在于,所述视频处理设备根据标准尺寸对第二视频帧中的目标对象进行缩放处理,包括:根据所述标准尺寸对所述第二视频帧的整个图像区域进行缩放处理。
- 根据权利要求25所述的方法,其特征在于,所述根据所述标准尺寸对所述第二视频帧的整个图像区域进行缩放处理,包括:根据所述标准尺寸对所述第二视频帧的整个图像区域进行放大处理;对放大处理后的第二视频帧的图像进行截取处理,使得截取处理后的第二视频帧的显示区域的尺寸与所述第一视频帧的显示区域的尺寸相同。
- 根据权利要求18-26任一项所述的方法,其特征在于,所述得到目标视频,包括:在对各个第二视频帧中的目标对象的图像位置进行调整处理后,再根据预置的调整规则调整所述待编辑视频中各个指定视频帧的时间顺序;将调整时间顺序后得到的视频确定为目标视频。
- 根据权利要求27所述的方法,其特征在于,所述根据预置的调整规则调整所述目标视频中各个指定视频帧,包括:按照拍摄时间顺序,以倒序调整的方式对所述目标视频中各个指定视频帧进行调整。
- 根据权利要求28所述的方法,其特征在于,所述以倒序调整的方式对所述目标视频中各个指定视频帧进行调整,包括:当所述待编辑视频是所述飞行器向远离所述目标对象的方向飞行时拍摄的,则按照拍摄时间顺序,以倒序调整的方式对所述待编辑视频中各个指定视频帧进行调整。
- 根据权利要求18所述的方法,其特征在于,所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令;或者所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。
- 一种视频处理设备,其特征在于,包括存储器和处理器;所述存储器,用于存储程序指令;所述处理器,用于接收待编辑视频,所述待编辑视频是挂载在飞行器上的摄像装置在飞行器处于特定飞行模式中时拍摄得到的包括目标对象的视频,其中,所述视频中所述目标对象在图像中的位置保持不变,且所述目标对象在图像中的大小改变;从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在 第一视频帧中的图像位置区域相同。
- 根据权利要求31所述的设备,其特征在于,所述处理器,还用于获取所述待编辑视频中各个视频帧中目标对象的尺寸;将所述目标对象的尺寸最大的视频帧确定为第一视频帧。
- 根据权利要求31所述的设备,其特征在于,所述处理器,还用于将待编辑视频中的第一帧视频帧确定为第一视频帧,或者将待编辑视频中的最后一帧视频帧确定为第一视频帧。
- 根据权利要求31所述的设备,其特征在于,所述处理器,还用于获取在预览图像中关于所述目标对象的框选操作,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的;根据所述框选操作,确定目标框选区域;所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
- 根据权利要求31所述的设备,其特征在于,所述处理器,还用于获取在预览图像中关于所述目标对象的点击操作的位置信息,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的;根据所述点击操作的位置信息,确定目标框选区域;所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
- 根据权利要求34或35所述的设备,其特征在于,所述目标对象在所述第一视频帧中的显示区域是根据所述目标框选区域的位置确定的。
- 根据权利要求31-36任一项所述的设备,其特征在于,所述处理器,还用于确定出所述第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸;根据标准尺寸对所述第二视频帧中的目标对象进行缩放处理;根据所述显示区域的位置,对缩放处理后的所述目标对象在所述第二视频帧中的图像位置进行调整处理。
- 根据权利要求36或37所述的设备,其特征在于,所述处理器,还用于根据所述标准尺寸对所述第二视频帧的整个图像区域进行缩放处理。
- 根据权利要求38所述的设备,其特征在于,所述处理器,还用于根据所述标准尺寸对所述第二视频帧的整个图像区域进行放大处理;对放大处理后的第二视频帧的图像进行截取处理,使得截取处理后的第二视频帧的显示区域的尺寸与所述第一视频帧的显示区域的尺寸相同。
- 根据权利要求31-39任一项所述的设备,其特征在于,所述处理器,还用于在对各个第二视频帧中的目标对象的图像位置进行调整处理后,再根据预置的调整规则调整所述待编辑视频中各个指定视频帧的时间顺序;将调整时间顺序后得到的视频确定为目标视频。
- 根据权利要求40所述的设备,其特征在于,所述处理器,还用于按照拍摄时间顺序,以倒序调整的方式对所述待编辑视频中各个指定视频帧进行调整。
- 根据权利要求41所述的设备,其特征在于,所述处理器,还用于当所述待编辑视频是所述飞行器向远离所述目标对象的方向飞行时拍摄的,则按照拍摄时间顺序,以倒序调整的方式对所述待编辑视频中各个指定视频帧进行调整。
- 根据权利要求31所述的设备,其特征在于,所述处理器,还用于向所述飞行器发送飞行控制指令,所述飞行控制指令用于控制所述飞行器飞行。
- 根据权利要求43所述的设备,其特征在于,所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令;或者所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。
- 一种飞行器,其特征在于,包括:机身;设置在机身上的动力系统,用于提供飞行动力;处理器,用于接收飞行控制指令,所述飞行控制指令用于指示飞行器的飞行模式,且所述飞行控制指令包括目标对象;响应所述飞行控制指令,在所述飞行模式下飞行并控制所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变;返回所述飞行模式下所述摄像装置拍摄到的视频。
- 根据权利要求45所述的飞行器,其特征在于,所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令;或者所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。
- 根据权利要求45所述的飞行器,其特征在于,所述处理器,还用于获取待编辑视频,所述待编辑视频是所述飞行模式下所述摄像装置拍摄到的视频;从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
- 一种视频处理系统,其特征在于,包括:视频处理设备和飞行器;所述视频处理设备,用于发送飞行控制指令给飞行器,所述飞行控制指令用于指示飞行器的飞行模式;所述飞行器,用于响应所述飞行控制指令,在所述飞行模式下飞行并控制 所述飞行器上挂载的摄像装置对所述目标对象进行拍摄,其中,在所述飞行模式中,所述摄像装置的姿态使得所述目标对象在拍摄画面中的位置保持不变,且所述飞行器的飞行轨迹使得所述目标对象在拍摄画面中的大小改变;将待编辑视频返回给所述视频处理设备,所述待编辑视频是所述飞行模式中所述摄像装置拍摄到的视频;所述视频处理设备,还用于接收所述待编辑视频;从所述待编辑视频中确定第一视频帧,并确定所述目标对象在所述第一视频帧中的显示区域;根据所述显示区域,对所述待编辑视频的第二视频帧中目标对象的图像位置进行调整处理,得到目标视频;其中,调整处理后的第二视频帧中的所述目标对象所在的图像位置区域,与所述显示区域在第一视频帧中的图像位置区域相同。
- 根据权利要求48所述的系统,其特征在于,所述视频处理设备,还用于获取所述待编辑视频中各个视频帧中目标对象的尺寸;将所述目标对象的尺寸最大的视频帧确定为第一视频帧。
- 根据权利要求48所述的系统,其特征在于,所述视频处理设备,还用于将待编辑视频中的第一帧视频帧确定为第一视频帧,或者将待编辑视频中的最后一帧视频帧确定为第一视频帧。
- 根据权利要求48所述的系统,其特征在于,所述视频处理设备,还用于获取在预览图像中关于所述目标对象的框选操作,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的;根据所述框选操作,确定目标框选区域;所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
- 根据权利要求48所述的系统,其特征在于,所述视频处理设备,还用于获取在预览图像中关于所述目标对象的点击操作的位置信息,所述预览图像是挂载在飞行器上的摄像装置拍摄得到的;根据所述点击操作的位置信息,确定目标框选区域;所述摄像装置在所述飞行器的飞行过程中拍摄的待编辑视频中,所述目标对象在所述目标框选区域内。
- 根据权利要求51或52所述的系统,其特征在于,所述目标对象在所述第一视频帧中的显示区域是根据所述目标框选区域的位置确定的。
- 根据权利要求48-53任一项所述的系统,其特征在于,所述视频处理设备,还用于确定出所述第一视频帧的显示区域中目标对象的尺寸,将该尺寸确定为标准尺寸;根据标准尺寸对所述第二视频帧中的目标对象进行缩放处理;根据所述显示区域的位置,对缩放处理后的所述目标对象在所述第二视频帧中的图像位置进行调整处理。
- 根据权利要求53或54所述的系统,其特征在于,所述视频处理设备,还用于根据所述标准尺寸对所述第二视频帧的整个图像区域进行缩放处理。
- 根据权利要求55所述的系统,其特征在于,所述视频处理设备,还用于根据所述标准尺寸对所述第二视频帧的整个图像区域进行放大处理;对放大处理后的第二视频帧的图像进行截取处理,使得截取处理后的第二视频帧的显示区域的尺寸与所述第一视频帧的显示区域的尺寸相同。
- 根据权利要求48-56任一项所述的系统,其特征在于,所述视频处理设备,还用于在对各个第二视频帧中的目标对象的图像位置进行调整处理后,再根据预置的调整规则调整所述待编辑视频中各个指定视频帧的时间顺序;将调整时间顺序后得到的视频确定为目标视频。
- 根据权利要求57所述的系统,其特征在于,所述视频处理设备,还用于按照拍摄时间顺序,以倒序调整的方式对所述目标视频中各个指定视频帧进行调整。
- 根据权利要求58所述的系统,其特征在于,所述视频处理设备,还用于当所述待编辑视频是所述飞行器向远离所述目标对象的方向飞行时拍摄的,则按照拍摄时间顺序,以倒序调整的方式对所述待编辑视频中各个指定视频帧进行调整。
- 根据权利要求48所述的系统,其特征在于,所述飞行控制指令包括用于控制飞行器向远离所述目标对象的方向移动的指令;或者所述飞行控制指令包括用于控制飞行器向靠近所述目标对象的方向移动的指令。
- 一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求1至30任一项所述方法。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2017/095341 WO2019023915A1 (zh) | 2017-07-31 | 2017-07-31 | 一种视频处理方法、设备、飞行器及系统 |
CN201780004734.9A CN108476289B (zh) | 2017-07-31 | 2017-07-31 | 一种视频处理方法、设备、飞行器及系统 |
US16/747,970 US11385658B2 (en) | 2017-07-31 | 2020-01-21 | Video processing method, device, aircraft, and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2017/095341 WO2019023915A1 (zh) | 2017-07-31 | 2017-07-31 | 一种视频处理方法、设备、飞行器及系统 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/747,970 Continuation US11385658B2 (en) | 2017-07-31 | 2020-01-21 | Video processing method, device, aircraft, and system |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019023915A1 true WO2019023915A1 (zh) | 2019-02-07 |
Family
ID=63266561
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2017/095341 WO2019023915A1 (zh) | 2017-07-31 | 2017-07-31 | 一种视频处理方法、设备、飞行器及系统 |
Country Status (3)
Country | Link |
---|---|
US (1) | US11385658B2 (zh) |
CN (1) | CN108476289B (zh) |
WO (1) | WO2019023915A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
IL301734B1 (en) * | 2019-07-31 | 2024-07-01 | Corephotonics Ltd | System and method for creating background blur in camera panning or motion |
Families Citing this family (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109194849B (zh) | 2013-06-13 | 2021-01-15 | 核心光电有限公司 | 双孔径变焦数字摄影机 |
JP2016523389A (ja) | 2013-07-04 | 2016-08-08 | コアフォトニクス リミテッド | 小型望遠レンズアセンブリ |
CN105917641B (zh) | 2013-08-01 | 2018-10-19 | 核心光电有限公司 | 具有自动聚焦的纤薄多孔径成像系统及其使用方法 |
US9392188B2 (en) | 2014-08-10 | 2016-07-12 | Corephotonics Ltd. | Zoom dual-aperture camera with folded lens |
WO2016108093A1 (en) | 2015-01-03 | 2016-07-07 | Corephotonics Ltd. | Miniature telephoto lens module and a camera utilizing such a lens module |
EP3696587B1 (en) | 2015-04-16 | 2023-09-20 | Corephotonics Ltd. | Auto focus and optical image stabilization in a compact folded camera |
EP3335415B1 (en) | 2015-08-13 | 2019-11-20 | Corephotonics Ltd. | Dual aperture zoom camera with video support and switching / non-switching dynamic control |
WO2018007981A1 (en) | 2016-07-07 | 2018-01-11 | Corephotonics Ltd. | Linear ball guided voice coil motor for folded optic |
US11531209B2 (en) | 2016-12-28 | 2022-12-20 | Corephotonics Ltd. | Folded camera structure with an extended light-folding-element scanning range |
EP4525469A3 (en) | 2017-01-12 | 2025-05-21 | Corephotonics Ltd. | Compact folded camera |
KR102424791B1 (ko) | 2017-11-23 | 2022-07-22 | 코어포토닉스 리미티드 | 컴팩트 폴디드 카메라 구조 |
CN112367448B (zh) | 2018-04-23 | 2022-04-19 | 核心光电有限公司 | 感测机构 |
CN109831687A (zh) * | 2018-12-12 | 2019-05-31 | 深圳慧源创新科技有限公司 | 无人机图传视频编辑方法和技术 |
CN109743511B (zh) * | 2019-01-03 | 2021-04-20 | 苏州佳世达光电有限公司 | 自动调整播放画面显示方向的方法及系统 |
CN110035234A (zh) * | 2019-04-16 | 2019-07-19 | 深圳市道通智能航空技术有限公司 | 一种飞行器的拍摄控制方法、飞行器及飞行系统 |
WO2020258258A1 (zh) * | 2019-06-28 | 2020-12-30 | 深圳市大疆创新科技有限公司 | 目标跟随的方法、系统、可读存储介质和可移动平台 |
CN111050066A (zh) | 2019-11-01 | 2020-04-21 | 深圳市道通智能航空技术有限公司 | 变焦方法、装置、飞行器、飞行系统及存储介质 |
US11949976B2 (en) | 2019-12-09 | 2024-04-02 | Corephotonics Ltd. | Systems and methods for obtaining a smart panoramic image |
CN113474741A (zh) * | 2019-12-26 | 2021-10-01 | 深圳市大疆创新科技有限公司 | 数据处理方法、装置、无人飞行器与飞行控制系统 |
CN114128247A (zh) * | 2020-03-17 | 2022-03-01 | 深圳市大疆创新科技有限公司 | 图像处理方法、装置及存储介质 |
CN111405140B (zh) * | 2020-03-18 | 2022-04-29 | 浙江工业大学 | 一种基于目标跟踪的视频防抖方法 |
WO2021245488A1 (en) | 2020-05-30 | 2021-12-09 | Corephotonics Ltd. | Systems and methods for obtaining a super macro image |
CN113810751B (zh) * | 2020-06-12 | 2022-10-28 | 阿里巴巴集团控股有限公司 | 视频处理方法及设备、电子设备及服务器 |
US11637977B2 (en) | 2020-07-15 | 2023-04-25 | Corephotonics Ltd. | Image sensors and sensing methods to obtain time-of-flight and phase detection information |
CN114071001B (zh) * | 2020-07-31 | 2023-12-22 | 北京小米移动软件有限公司 | 控制方法、装置、电子设备及存储介质 |
KR20250037574A (ko) | 2020-07-31 | 2025-03-17 | 코어포토닉스 리미티드 | 큰 스트로크 선형 위치 감지를 위한 홀 센서-자석 구조 |
KR102480820B1 (ko) | 2020-08-12 | 2022-12-22 | 코어포토닉스 리미티드 | 스캐닝 폴디드 카메라의 광학 이미지 안정화 |
CN114697517A (zh) * | 2020-12-28 | 2022-07-01 | 北京小米移动软件有限公司 | 视频处理方法、装置、终端设备及存储介质 |
CN114697525B (zh) * | 2020-12-29 | 2023-06-06 | 华为技术有限公司 | 一种确定跟踪目标的方法及电子设备 |
CN113709560B (zh) * | 2021-03-31 | 2024-01-02 | 腾讯科技(深圳)有限公司 | 视频剪辑方法、装置、设备及存储介质 |
CN113613067B (zh) | 2021-08-03 | 2023-08-22 | 北京字跳网络技术有限公司 | 视频处理方法、装置、设备及存储介质 |
KR102770497B1 (ko) | 2022-03-24 | 2025-02-18 | 코어포토닉스 리미티드 | 슬림 컴팩트 렌즈 광학 이미지 안정화 |
CN117336597B (zh) * | 2023-01-04 | 2024-11-12 | 荣耀终端有限公司 | 视频拍摄方法及相关设备 |
CN116866719B (zh) * | 2023-07-12 | 2024-02-02 | 山东恒辉软件有限公司 | 一种基于图像识别的高清视频内容智能分析处理方法 |
CN119450191A (zh) * | 2023-07-31 | 2025-02-14 | 北京字跳网络技术有限公司 | 视频处理方法、装置及电子设备 |
CN117615173A (zh) * | 2023-09-28 | 2024-02-27 | 书行科技(北京)有限公司 | 视频效果处理方法、装置、计算机设备和存储介质 |
CN117768720A (zh) * | 2023-12-22 | 2024-03-26 | 北京字跳网络技术有限公司 | 视频处理方法、装置、设备、计算机可读存储介质及产品 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030066932A1 (en) * | 2001-09-27 | 2003-04-10 | Carroll Ernest A. | Miniature, unmanned aircraft with interchangeable data module |
CN105141895A (zh) * | 2015-08-06 | 2015-12-09 | 广州飞米电子科技有限公司 | 视频处理方法及装置、系统、四轴飞行器 |
CN105554480A (zh) * | 2016-03-01 | 2016-05-04 | 深圳市大疆创新科技有限公司 | 无人机拍摄图像的控制方法、装置、用户设备及无人机 |
CN105830009A (zh) * | 2013-12-20 | 2016-08-03 | 高通股份有限公司 | 用于视频帧的显示分割和集群的对象的选择和跟踪 |
CN105938369A (zh) * | 2013-06-25 | 2016-09-14 | 深圳市大疆创新科技有限公司 | 飞行器的控制系统及控制方法 |
CN106708092A (zh) * | 2016-12-30 | 2017-05-24 | 歌尔科技有限公司 | 一种无人机控制方法、装置和系统 |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004288100A (ja) * | 2003-03-25 | 2004-10-14 | Minolta Co Ltd | 撮像装置及び移動体カメラ |
KR101431535B1 (ko) * | 2007-08-30 | 2014-08-19 | 삼성전자주식회사 | 얼굴인식 기능을 이용한 영상 촬영 장치 및 방법 |
KR101838033B1 (ko) * | 2011-11-25 | 2018-03-15 | 삼성전자 주식회사 | 사용자 디바이스의 영상 촬영 방법 및 장치 |
JP2015195569A (ja) * | 2014-03-25 | 2015-11-05 | パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America | 移動体用撮影装置 |
CN104796611A (zh) * | 2015-04-20 | 2015-07-22 | 零度智控(北京)智能科技有限公司 | 移动终端遥控无人机实现智能飞行拍摄的方法及系统 |
CN106899796A (zh) * | 2015-12-18 | 2017-06-27 | 富泰华工业(深圳)有限公司 | 拍照系统及方法 |
JP6735583B2 (ja) * | 2016-03-17 | 2020-08-05 | キヤノン株式会社 | ズーム制御装置、撮像装置及びそれらの制御方法、プログラム並びに記憶媒体 |
JP6500849B2 (ja) * | 2016-06-23 | 2019-04-17 | カシオ計算機株式会社 | 撮像装置、撮像方法及びプログラム |
US10642271B1 (en) * | 2016-08-26 | 2020-05-05 | Amazon Technologies, Inc. | Vehicle guidance camera with zoom lens |
CN111325201A (zh) * | 2016-08-31 | 2020-06-23 | 深圳市大疆灵眸科技有限公司 | 影像处理方法、装置与可移动设备、无人机遥控器及系统 |
-
2017
- 2017-07-31 CN CN201780004734.9A patent/CN108476289B/zh active Active
- 2017-07-31 WO PCT/CN2017/095341 patent/WO2019023915A1/zh active Application Filing
-
2020
- 2020-01-21 US US16/747,970 patent/US11385658B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030066932A1 (en) * | 2001-09-27 | 2003-04-10 | Carroll Ernest A. | Miniature, unmanned aircraft with interchangeable data module |
CN105938369A (zh) * | 2013-06-25 | 2016-09-14 | 深圳市大疆创新科技有限公司 | 飞行器的控制系统及控制方法 |
CN105830009A (zh) * | 2013-12-20 | 2016-08-03 | 高通股份有限公司 | 用于视频帧的显示分割和集群的对象的选择和跟踪 |
CN105141895A (zh) * | 2015-08-06 | 2015-12-09 | 广州飞米电子科技有限公司 | 视频处理方法及装置、系统、四轴飞行器 |
CN105554480A (zh) * | 2016-03-01 | 2016-05-04 | 深圳市大疆创新科技有限公司 | 无人机拍摄图像的控制方法、装置、用户设备及无人机 |
CN106708092A (zh) * | 2016-12-30 | 2017-05-24 | 歌尔科技有限公司 | 一种无人机控制方法、装置和系统 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
IL301734B1 (en) * | 2019-07-31 | 2024-07-01 | Corephotonics Ltd | System and method for creating background blur in camera panning or motion |
IL301734B2 (en) * | 2019-07-31 | 2024-11-01 | Corephotonics Ltd | System and method for creating background blur in camera panning or motion |
Also Published As
Publication number | Publication date |
---|---|
US11385658B2 (en) | 2022-07-12 |
CN108476289A (zh) | 2018-08-31 |
US20200162682A1 (en) | 2020-05-21 |
CN108476289B (zh) | 2021-02-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019023915A1 (zh) | 一种视频处理方法、设备、飞行器及系统 | |
US11649052B2 (en) | System and method for providing autonomous photography and videography | |
US20210173396A1 (en) | System and method for providing easy-to-use release and auto-positioning for drone applications | |
CN108702444B (zh) | 一种图像处理方法、无人机及系统 | |
US20200366840A1 (en) | Video processing method and device, unmanned aerial vehicle and system | |
US20220224865A1 (en) | Unmanned aerial vehicle imaging control method, unmanned aerial vehicle imaging method, control terminal, unmanned aerial vehicle control device, and unmanned aerial vehicle | |
CN109076161B (zh) | 一种图像处理方法、移动平台、控制设备及系统 | |
EP2770723A2 (en) | Apparatus and method for photographing image | |
WO2019227441A1 (zh) | 可移动平台的拍摄控制方法和设备 | |
WO2018036285A1 (zh) | 基于飞行器实现自拍的方法及装置 | |
WO2020083114A1 (zh) | 航拍相机的图像处理方法、图像处理系统及无人机 | |
CN114205536B (zh) | 一种视频获取方法、控制终端、飞行器及系统 | |
WO2020019106A1 (zh) | 云台和无人机控制方法、云台及无人机 | |
CN108351650A (zh) | 一种对飞行器的飞行控制方法、装置及飞行器 | |
US20200348663A1 (en) | Flight control method, device, aircraft, system, and storage medium | |
WO2023036198A1 (zh) | 控制飞行器拍摄旋转延时视频的方法、装置、设备及介质 | |
WO2017166714A1 (zh) | 全景图像的拍摄方法、装置及系统 | |
WO2020014953A1 (zh) | 一种图像处理方法及设备 | |
WO2021168804A1 (zh) | 图像处理方法、图像处理装置和图像处理系统 | |
US20210004005A1 (en) | Image capture method and device, and machine-readable storage medium | |
WO2021237619A1 (zh) | 视频文件编辑方法、设备、系统及计算机可读存储介质 | |
CN109479086A (zh) | 相对于物体变焦的方法和设备 | |
WO2019105222A1 (zh) | 生成装置、生成系统、摄像系统、移动体以及生成方法 | |
WO2022141122A1 (zh) | 无人机的控制方法、无人机及存储介质 | |
WO2022041013A1 (zh) | 控制方法、手持云台、系统及计算机可读存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17920283 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17920283 Country of ref document: EP Kind code of ref document: A1 |