[go: up one dir, main page]

CN106157363A - A camera method, device and mobile terminal based on augmented reality - Google Patents

A camera method, device and mobile terminal based on augmented reality Download PDF

Info

Publication number
CN106157363A
CN106157363A CN201610507188.8A CN201610507188A CN106157363A CN 106157363 A CN106157363 A CN 106157363A CN 201610507188 A CN201610507188 A CN 201610507188A CN 106157363 A CN106157363 A CN 106157363A
Authority
CN
China
Prior art keywords
target
augmented reality
augmented
reality content
acquiring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610507188.8A
Other languages
Chinese (zh)
Inventor
曾元清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201610507188.8A priority Critical patent/CN106157363A/en
Publication of CN106157363A publication Critical patent/CN106157363A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention discloses a photographing method and device based on augmented reality and a mobile terminal. The method comprises the following steps: acquiring a current shot image through a camera of a mobile terminal, and acquiring a target enhancement object from the current shot image; acquiring matched augmented reality content according to the characteristic information of the target augmented object; and generating a target enhanced image according to the augmented reality content and the current shooting image, and displaying the target enhanced image. The technical scheme provided by the embodiment of the invention optimizes the existing augmented reality photographing technology, enriches the photographing modes based on augmented reality, improves the photographing interest of augmented reality, and meets the increasing personalized and convenient augmented reality photographing requirements of people.

Description

一种基于增强现实的拍照方法、装置和移动终端A camera method, device and mobile terminal based on augmented reality

技术领域technical field

本发明实施例涉及增强现实技术领域,尤其涉及一种基于增强现实的拍照方法、装置和移动终端。The embodiments of the present invention relate to the field of augmented reality technology, and in particular, to a method, device and mobile terminal for taking photos based on augmented reality.

背景技术Background technique

增强现实(Augmented Reality,AR)技术是通过计算机系统提供的信息增加用户对现实世界感知的技术,将虚拟的信息应用到真实世界,并将计算机生成的虚拟物体、场景或系统提示信息叠加到真实场景中,从而实现对现实的增强。Augmented reality (Augmented Reality, AR) technology is a technology that increases users' perception of the real world through the information provided by the computer system, applies virtual information to the real world, and superimposes computer-generated virtual objects, scenes or system prompts on the real world. In the scene, so as to realize the enhancement of reality.

目前,增强现实技术已被应用于移动终端中,通过增强现实技术可将虚拟内容作为增强现实内容与摄像头获取的图像进行叠加,实现了将真实世界信息与虚拟世界信息的“无缝”融合。例如,通过摄像头对准任意一个哈根达斯商标,这时瓶盖上就会出现一个虚拟的音乐家演奏小提琴曲,又例如,将摄像头对准自己的手掌,这时移动终端就会自动调出虚拟角色在用户手上翩翩起舞。然而,现有技术中一般都是从通过摄像头拍摄的现实图像中识别到目标增强对象,根据目标增强对象获取该目标增强对象匹配的增强现实内容,把增强现实内容和现实图像进行合成,从而得到增强现实的图像,现有技术中的增强现实的拍照形式比较单一,已不能满足人们日益增长的个性化、便捷化的增强现实的拍照需求。At present, augmented reality technology has been applied to mobile terminals. Through augmented reality technology, virtual content can be superimposed as augmented reality content and images acquired by cameras, realizing the "seamless" fusion of real world information and virtual world information. For example, point the camera at any Haagen-Dazs trademark, and a virtual musician will appear on the bottle cap to play violin music. For example, point the camera at your palm, and the mobile terminal will automatically adjust the A virtual character dances on the user's hand. However, in the prior art, the target augmented object is generally identified from the real image captured by the camera, and the augmented reality content matching the target augmented object is obtained according to the target augmented object, and the augmented reality content and the real image are synthesized to obtain For augmented reality images, the photographing form of augmented reality in the prior art is relatively single, which can no longer meet people's growing demand for personalized and convenient augmented reality photographing.

发明内容Contents of the invention

本发明实施例提供一种基于增强现实的拍照方法、装置和移动终端,以优化现有的增强现实的拍照技术,满足人们日益增长的个性化、便捷化的增强现实的拍照需求。Embodiments of the present invention provide an augmented reality-based photographing method, device, and mobile terminal to optimize the existing augmented reality photographing technology and meet people's growing demand for personalized and convenient augmented reality photographing.

在第一方面,本发明实施例提供了一种基于增强现实的拍照方法,包括:In a first aspect, an embodiment of the present invention provides a method for taking photos based on augmented reality, including:

通过移动终端的摄像头获取当前拍摄图像,并从所述当前拍摄图像中获取目标增强对象;Acquiring the current photographed image through the camera of the mobile terminal, and obtaining the target enhancement object from the current photographed image;

根据所述目标增强对象的特征信息获取匹配的增强现实内容;Acquiring matched augmented reality content according to the feature information of the target augmented object;

根据所述增强现实内容与所述当前拍摄图像生成目标增强图像,并显示所述目标增强图像。Generate an augmented target image according to the augmented reality content and the currently captured image, and display the augmented target image.

在第二方面,本发明实施例提供了一种基于增强现实的拍照装置,包括:In a second aspect, an embodiment of the present invention provides a camera device based on augmented reality, including:

目标增强对象获取模块,用于通过移动终端的摄像头获取当前拍摄图像,并从所述当前拍摄图像中获取目标增强对象;A target enhancement object acquisition module, configured to acquire a current captured image through the camera of the mobile terminal, and acquire a target enhanced object from the current captured image;

增强现实内容获取模块,用于根据所述目标增强对象的特征信息获取匹配的增强现实内容;An augmented reality content acquiring module, configured to acquire matched augmented reality content according to the feature information of the target augmented object;

目标增强图像生成模块,用于根据所述增强现实内容与所述当前拍摄图像生成目标增强图像,并显示所述目标增强图像。A target enhanced image generation module, configured to generate a target enhanced image according to the augmented reality content and the currently captured image, and display the target enhanced image.

在第三方面,本发明实施例提供了一种移动终端,所述移动终端集成了如第二方面所提供的装置。In a third aspect, an embodiment of the present invention provides a mobile terminal, where the mobile terminal integrates the apparatus provided in the second aspect.

本发明实施例通过根据目标增强对象的特征信息来获取匹配的增强现实内容,根据所述增强现实内容与所述当前拍摄图像生成目标增强图像并显示,优化了现有的增强现实的拍照技术,丰富了基于增强现实的拍照方式,满足了人们日益增长的个性化、便捷化的增强现实的拍照需求。The embodiment of the present invention obtains the matched augmented reality content according to the feature information of the target augmented object, and generates and displays the augmented reality image of the target according to the augmented reality content and the currently captured image, thereby optimizing the existing augmented reality photographing technology, It enriches the way of taking pictures based on augmented reality, and satisfies people's growing demand for personalized and convenient augmented reality photography.

附图说明Description of drawings

图1是本发明实施例一提供的基于增强现实的拍照方法的流程图;FIG. 1 is a flow chart of an augmented reality-based photographing method provided in Embodiment 1 of the present invention;

图2是本发明实施例二提供的基于增强现实的拍照方法的流程图;FIG. 2 is a flow chart of an augmented reality-based photographing method provided in Embodiment 2 of the present invention;

图3a是本发明实施例二提供的第一人机交互界面示意图;Fig. 3a is a schematic diagram of the first human-computer interaction interface provided by Embodiment 2 of the present invention;

图3b是本发明实施例二提供的第二人机交互界面示意图;Fig. 3b is a schematic diagram of a second human-computer interaction interface provided by Embodiment 2 of the present invention;

图4是本发明实施例三提供的基于增强现实的拍照方法的流程图;FIG. 4 is a flow chart of an augmented reality-based photographing method provided by Embodiment 3 of the present invention;

图5a是本发明实施例三提供的第一人机交互界面示意图;Fig. 5a is a schematic diagram of the first human-computer interaction interface provided by Embodiment 3 of the present invention;

图5b是本发明实施例三提供的第二人机交互界面示意图;Fig. 5b is a schematic diagram of a second human-computer interaction interface provided by Embodiment 3 of the present invention;

图6是本发明实施例四提供的基于增强现实的拍照方法的流程图;FIG. 6 is a flowchart of an augmented reality-based photographing method provided in Embodiment 4 of the present invention;

图7是本发明实施例五提供的基于增强现实的拍照方法的流程图;Fig. 7 is a flow chart of the augmented reality-based photographing method provided by Embodiment 5 of the present invention;

图8是本发明实施例六提供的基于增强现实的拍照方法的流程图;FIG. 8 is a flow chart of an augmented reality-based photographing method provided in Embodiment 6 of the present invention;

图9是本发明实施例七提供的基于增强现实的拍照装置的结构示意图。FIG. 9 is a schematic structural diagram of an augmented reality-based photographing device provided by Embodiment 7 of the present invention.

具体实施方式detailed description

为了使本发明的目的、技术方案和优点更加清楚,下面结合附图对本发明具体实施例作进一步的详细描述。可以理解的是,此处所描述的具体实施例仅仅用于解释本发明,而非对本发明的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本发明相关的部分而非全部内容。在更加详细地讨论示例性实施例之前应当提到的是,一些示例性实施例被描述成作为流程图描绘的处理或方法。虽然流程图将各项操作(或步骤)描述成顺序的处理,但是其中的许多操作可以被并行地、并发地或者同时实施。此外,各项操作的顺序可以被重新安排。当其操作完成时所述处理可以被终止,但是还可以具有未包括在附图中的附加步骤。所述处理可以关联于方法、函数、规程、子例程、子程序等等。In order to make the object, technical solution and advantages of the present invention clearer, specific embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, only parts related to the present invention are shown in the drawings but not all content. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe various operations (or steps) as sequential processing, many of the operations may be performed in parallel, concurrently, or simultaneously. In addition, the order of operations can be rearranged. The process may be terminated when its operations are complete, but may also have additional steps not included in the figure. The processing may be associated with a method, function, procedure, subroutine, subroutine, or the like.

实施例一Embodiment one

图1给出了本发明实施例一提供的基于增强现实的拍照方法的流程图,本实施例的方法可以由基于增强现实的拍照装置来执行,该装置可通过硬件和/或软件的方式实现,所述装置可作为移动终端的一部分设置在所述移动终端内部。Figure 1 shows the flow chart of the augmented reality-based photographing method provided by Embodiment 1 of the present invention. The method of this embodiment can be executed by an augmented reality-based photographing device, which can be implemented by means of hardware and/or software. , the device can be set inside the mobile terminal as a part of the mobile terminal.

如图1所示,本实施例提供的基于增强现实的拍照方法具体包括以下步骤:As shown in Figure 1, the augmented reality-based photographing method provided in this embodiment specifically includes the following steps:

步骤101、通过移动终端的摄像头获取当前拍摄图像,并从所述当前拍摄图像中获取目标增强对象。Step 101. Obtain a currently captured image through a camera of a mobile terminal, and acquire a target enhancement object from the currently captured image.

本发明实施例中所述的移动终端包括但不限定于手机、平板电脑、数码相机等配置有摄像头的设备,优选为智能手机。The mobile terminals described in the embodiments of the present invention include but are not limited to mobile phones, tablet computers, digital cameras and other devices equipped with cameras, preferably smart phones.

其中,所述目标增强对象为需要根据与其对应的增强现实内容对其进行增强,以达到在该对象的基础上实现增强现实效果的对象。所述目标增强对象可以为一个或多个,本实施例对此并不进行限制。所述目标增强对象具体可以为被拍摄的人物、物品或者特定图像。Wherein, the target augmented object is an object that needs to be augmented according to its corresponding augmented reality content, so as to achieve an augmented reality effect on the basis of the object. There may be one or more target augmentation objects, which is not limited in this embodiment. The target augmentation object may specifically be a photographed person, item, or specific image.

示例性的,增强现实内容可包括实物图像(如树木、太阳、建筑物、海滩及吉祥物等实物的图像)、特效(如烟雾效果、蒸汽效果及运动轨迹效果等)和场景效果(如白天、黑夜、雨、雪等)等虚拟内容。Exemplarily, the augmented reality content may include physical images (such as images of real objects such as trees, the sun, buildings, beaches, and mascots), special effects (such as smoke effects, steam effects, and motion track effects, etc.) , night, rain, snow, etc.) and other virtual content.

步骤102、根据所述目标增强对象的特征信息获取匹配的增强现实内容。Step 102: Obtain matching augmented reality content according to the characteristic information of the target augmented object.

其中,所述特征信息可以为人的手势信息、表情信息、语音信息或运动轨迹信息等,也可以为物品的形状或长宽高信息等,也可以为特定图像的标识信息。Wherein, the feature information may be human gesture information, facial expression information, voice information, or motion trajectory information, etc., or may be the shape or length, width, and height information of an item, or may be identification information of a specific image.

该步骤具体可以为:根据所述目标增强对象的特征信息获取所述目标增强对象匹配的增强现实内容;或者,根据所述目标增强对象的特征信息获取所述当前拍摄图像匹配的背景增强现实内容;或者,根据所述目标增强对象的特征信息获取所述当前拍摄图像匹配的亮度增强现实内容;或者,根据所述目标增强对象的特征信息获取所述当前拍摄图像匹配的滤镜效果增强现实内容。This step may specifically be: acquiring the augmented reality content matched with the target augmented object according to the feature information of the target augmented object; or acquiring the background augmented reality content matched with the currently captured image according to the feature information of the target augmented object or, according to the feature information of the target augmented object, obtain the brightness augmented reality content matched with the current shot image; or, according to the feature information of the target augmented object, obtain the filter effect augmented reality content matched with the current shot image .

步骤103、根据所述增强现实内容与所述当前拍摄图像生成目标增强图像,并显示所述目标增强图像。Step 103: Generate an augmented target image according to the augmented reality content and the currently captured image, and display the augmented target image.

具体的,可以通过拍摄预览界面显示所述目标增强图像,此时,增强现实内容与拍摄预览界面中包含的摄像头实时获取的当前拍摄图像可以相叠加,使用户预览增强效果。Specifically, the target enhanced image can be displayed through the shooting preview interface. At this time, the augmented reality content and the current captured image captured by the camera included in the shooting preview interface can be superimposed in real time, so that the user can preview the enhanced effect.

本实施例提供的基于增强现实的拍照方法,通过根据目标增强对象的特征信息来获取匹配的增强现实内容,根据所述增强现实内容与所述当前拍摄图像生成目标增强图像并显示,优化了现有的增强现实的拍照技术,丰富了基于增强现实的拍照方式,提升了增强现实的拍照趣味性,满足了人们日益增长的个性化、便捷化的增强现实的拍照需求。The augmented reality-based photographing method provided in this embodiment optimizes the present situation by obtaining matched augmented reality content according to the feature information of the target augmented object, generating and displaying a target augmented image according to the augmented reality content and the currently captured image. Some augmented reality photography technologies have enriched augmented reality-based photography methods, improved the fun of augmented reality photography, and met people's growing demand for personalized and convenient augmented reality photography.

在上述实施例的基础上,所述根据所述目标增强对象的特征信息获取匹配的增强现实内容具体可以为:根据所述目标增强对象的特征信息从服务器或者移动终端本地或者互联网中获取匹配的增强现实内容,优选为从服务器中获取匹配的增强现实内容。当然,也可以由移动终端对所述目标增强对象进行实时分析,自行根据目标增强对象的特征信息生成匹配的增强现实内容。On the basis of the above-mentioned embodiments, the acquisition of the matched augmented reality content according to the feature information of the target augmented object may specifically be: acquiring the matched augmented reality content from a server or mobile terminal locally or from the Internet according to the feature information of the target augmented object. The augmented reality content is preferably obtained from a server to match the augmented reality content. Certainly, the mobile terminal may also perform real-time analysis on the target augmented object, and generate matching augmented reality content by itself according to the feature information of the target augmented object.

在上述实施例的基础上,还可以包括以下步骤:在接收到拍照指令时,根据所述目标增强图像生成增强现实照片。On the basis of the above-mentioned embodiments, the following step may be further included: when a photographing instruction is received, an augmented reality photo is generated according to the target augmented image.

实施例二Embodiment two

图2给出了本发明实施例二提供的基于增强现实的拍照方法的流程图。本实施例以上述实施例一为基础进行优化。在本实施例中,将“目标增强对象”优化为人物,进一步,将“根据所述目标增强对象的特征信息获取匹配的增强现实内容”,优化为“根据所述目标增强对象的手势信息获取匹配的增强现实内容”。FIG. 2 shows a flow chart of an augmented reality-based photographing method provided by Embodiment 2 of the present invention. This embodiment is optimized on the basis of the first embodiment above. In this embodiment, the "target augmented object" is optimized as a character, and further, "obtain matching augmented reality content according to the feature information of the target augmented object" is optimized as "acquire Matching augmented reality content".

相应的,如图2所示,本实施例提供的方法包括以下步骤:Correspondingly, as shown in Figure 2, the method provided in this embodiment includes the following steps:

步骤201、通过移动终端的摄像头获取当前拍摄图像,并从所述当前拍摄图像中获取目标增强对象。Step 201. Obtain a currently captured image through a camera of a mobile terminal, and acquire a target enhancement object from the currently captured image.

步骤202、根据所述目标增强对象的手势信息获取匹配的增强现实内容。Step 202. Acquire matching augmented reality content according to the gesture information of the target augmented object.

具体的,该步骤可以包括:根据所述目标增强对象的手势信息获取所述目标增强对象匹配的增强现实内容。示例性的,若目标增强对象的手势信息为张开双臂,则获取与目标增强对象匹配的历史张开双臂的增强现实内容,例如在其他时间或场景下拍摄的该目标增强对象张开双臂的图像。Specifically, this step may include: acquiring the augmented reality content matched by the target augmented object according to the gesture information of the target augmented object. Exemplarily, if the gesture information of the target augmented object is to open arms, the historical augmented reality content of arms opened that matches the target augmented object is obtained, for example, images of the target augmented object with arms opened at other times or scenes.

具体的,该步骤可以包括:根据所述目标增强对象的手势信息获取当前拍摄图像匹配的背景增强现实内容。示例性的,若目标增强对象的手势信息为张开双臂,则获取泰坦尼克号中男女主人公张开双臂的经典造型图像作为与当前拍摄图像匹配的背景图像。Specifically, this step may include: acquiring the background augmented reality content matched with the currently captured image according to the gesture information of the target augmented object. Exemplarily, if the gesture information of the target augmented object is to open arms, a classic image of the hero and heroine in the Titanic with open arms is acquired as a background image matching the currently captured image.

具体的,该步骤可以包括:根据所述目标增强对象的手势信息获取所述当前拍摄图像匹配的亮度增强现实内容。示例性,若目标增强对象的手势信息为手掌五指伸展,则获取高于当前亮度的亮度增强现实内容,以提高当前拍摄图像的亮度;若目标增强对象的手势信息为握拳,则获取低于当前亮度的亮度增强现实内容,以降低当前拍摄图像的亮度。Specifically, this step may include: acquiring brightness augmented reality content matching the currently captured image according to the gesture information of the target augmented object. Exemplarily, if the gesture information of the target augmented object is the stretching of the palm and five fingers, obtain the augmented reality content with a brightness higher than the current brightness to increase the brightness of the currently captured image; Brightness for brightness augmented reality content to reduce the brightness of the currently captured image.

具体的,该步骤可以包括:根据所述目标增强对象的手势信息获取所述当前拍摄图像匹配的滤镜效果增强现实内容。示例性的,用户的手势为双手遮脸,则对增强现实对象的脸部进行打马赛克的滤镜效果增强现实操作。Specifically, this step may include: acquiring the filter effect augmented reality content matched with the currently captured image according to the gesture information of the target augmented object. Exemplarily, if the gesture of the user is to cover the face with both hands, an augmented reality operation of a mosaic filter effect is performed on the face of the augmented reality object.

步骤203、根据所述增强现实内容与所述当前拍摄图像生成目标增强图像,并显示所述目标增强图像。Step 203: Generate an augmented target image according to the augmented reality content and the currently captured image, and display the augmented target image.

具体的,将上述示例中根据目标增强对象的手势信息获取的与所述目标增强对象匹配的增强现实内容,或者与所述当前拍摄图像匹配的背景增强现实内容,或者与所述当前拍摄图像匹配的亮度增强现实内容,或者与所述当前拍摄图像匹配的滤镜效果增强现实内容与当前拍摄图像生成目标增强图像,并显示所述目标增强图像。Specifically, the augmented reality content matched with the target augmented object acquired according to the gesture information of the target augmented object in the above example, or the background augmented reality content matched with the current captured image, or matched with the current captured image The augmented reality content of brightness, or the augmented reality content of the filter effect matched with the current photographed image generates a target augmented image with the current photographed image, and displays the target augmented image.

图3a给出了本发明实施例二提供的第一人机交互界面示意图,如图3a所示,目标增强对象A1做出了心形的手势。图3b给出了本发明实施例二提供的第二人机交互界面示意图,如图3b所示,根据手势信息获取匹配的增强现实内容为心形的内容B1,根据心形增强现实内容B1与当前图像生成目标增强图像,并显示所述目标增强图像。目标增强图像向用户展示了心形增强现实效果。FIG. 3a shows a schematic diagram of the first human-computer interaction interface provided by Embodiment 2 of the present invention. As shown in FIG. 3a , the target augmented object A1 makes a heart-shaped gesture. Figure 3b shows a schematic diagram of the second human-computer interaction interface provided by Embodiment 2 of the present invention. As shown in Figure 3b, the matched augmented reality content obtained according to the gesture information is heart-shaped content B1, and according to the heart-shaped augmented reality content B1 and The current image generates an object-enhanced image and displays the object-enhanced image. The target augmented image shows the user a heart-shaped augmented reality effect.

本实施例提供的方法,通过根据目标增强对象的手势信息来获取匹配的增强现实内容,根据所述增强现实内容与所述当前拍摄图像生成目标增强图像并显示,优化了现有的增强现实的拍照技术,丰富了基于增强现实的拍照方式,提升了增强现实的拍照趣味性,满足了人们日益增长的个性化、便捷化的增强现实的拍照需求。The method provided in this embodiment optimizes the existing augmented reality by obtaining the matched augmented reality content according to the gesture information of the target augmented object, and generating and displaying the augmented reality image of the target according to the augmented reality content and the currently captured image. The camera technology enriches the way of taking photos based on augmented reality, enhances the fun of taking pictures in augmented reality, and meets people's growing demand for personalized and convenient photos in augmented reality.

实施例三Embodiment three

图4给出了本发明实施例三提供的基于增强现实的拍照方法的流程图。本实施例以上述实施例一为基础进行优化。在本实施例中,将“目标增强对象”优化为人物,进一步,将“根据所述目标增强对象的特征信息获取匹配的增强现实内容”,优化为“根据所述目标增强对象的表情信息获取匹配的增强现实内容”。FIG. 4 shows a flow chart of an augmented reality-based photographing method provided by Embodiment 3 of the present invention. This embodiment is optimized on the basis of the first embodiment above. In this embodiment, the "target augmented object" is optimized as a character, and further, "obtain matching augmented reality content according to the feature information of the target augmented object" is optimized as "acquire Matching augmented reality content".

相应的,如图4所示,本实施例提供的方法包括以下步骤:Correspondingly, as shown in Figure 4, the method provided in this embodiment includes the following steps:

步骤301、通过移动终端的摄像头获取当前拍摄图像,并从所述当前拍摄图像中获取目标增强对象。Step 301. Acquire a currently captured image through a camera of a mobile terminal, and acquire a target enhancement object from the currently captured image.

步骤302、根据所述目标增强对象的表情信息获取匹配的增强现实内容。Step 302. Acquire matching augmented reality content according to the expression information of the target augmented object.

具体的,该步骤可以包括:根据所述目标增强对象的表情信息获取所述目标增强对象匹配的增强现实内容。示例性的,若目标增强对象的表情为微笑,则获取与目标增强对象匹配的在其他时间或场景下拍摄的该目标增强对象微笑的图像,或者获取其他人或动物微笑的图像,或者其他微笑的吉祥物。Specifically, this step may include: acquiring the augmented reality content matched by the target augmented object according to the expression information of the target augmented object. Exemplarily, if the expression of the target augmented object is a smile, obtain images of the target augmented object smiling that are matched with the targeted augmented object at other times or scenes, or obtain images of other people or animals smiling, or other smiling images mascot.

具体的,该步骤可以包括:根据所述目标增强对象的表情信息获取所述当前拍摄图像匹配的背景增强现实内容。示例性的,若目标增强对象的表情为微笑,则获取阳光明媚的图像作为与当前拍摄图像匹配的背景图像;若目标增强对象的表情为愤怒,则获取狂风暴雨的图像作为当前拍摄图像匹配的背景图像。Specifically, this step may include: acquiring the background augmented reality content matched with the currently captured image according to the expression information of the target augmented object. Exemplarily, if the expression of the object to be enhanced is smiling, then obtain a sunny image as the background image matching the current captured image; if the expression of the target enhanced object is angry, obtain a stormy image as the background image matched background image.

具体的,该步骤可以包括:根据所述目标增强对象的表情信息获取所述当前拍摄图像匹配的亮度增强现实内容。示例性的,若目标增强对象的表情为微笑,则获取高于当前亮度的亮度增强现实内容,以提高当前拍摄图像的亮度;若目标增强对象的表情为愤怒,则获取低于当前亮度的亮度增强现实内容,以降低当前拍摄图像的亮度。Specifically, this step may include: acquiring brightness augmented reality content matching the currently captured image according to the expression information of the target augmented object. Exemplarily, if the expression of the target enhanced object is smiling, obtain the augmented reality content with a brightness higher than the current brightness to increase the brightness of the currently captured image; if the expression of the target enhanced object is angry, obtain the brightness lower than the current brightness Augmented reality content to reduce the brightness of the currently captured image.

具体的,该步骤可以包括:根据所述目标增强对象的表情信息获取所述当前拍摄图像匹配的滤镜效果增强现实内容。示例性的,可以根据表情为微笑或愤怒时获取不同的滤镜效果增强现实内容。Specifically, this step may include: acquiring the filter effect augmented reality content matched with the currently captured image according to the expression information of the target augmented object. Exemplarily, the augmented reality content with different filter effects may be obtained according to the expression of smiling or angry.

步骤303、根据所述增强现实内容与所述当前拍摄图像生成目标增强图像,并显示所述目标增强图像。Step 303: Generate an augmented target image according to the augmented reality content and the currently captured image, and display the augmented target image.

具体的,将上述示例中根据目标增强对象的表情信息获取的与所述目标增强对象匹配的增强现实内容,或者与所述当前拍摄图像匹配的背景增强现实内容,或者与所述当前拍摄图像匹配的亮度增强现实内容,或者与所述当前拍摄图像匹配的滤镜效果增强现实内容与当前拍摄图像生成目标增强图像,并显示所述目标增强图像。Specifically, the augmented reality content matched with the target augmented object acquired according to the expression information of the target augmented object in the above example, or the background augmented reality content matched with the current captured image, or matched with the current captured image The augmented reality content of brightness, or the augmented reality content of the filter effect matched with the current photographed image generates a target augmented image with the current photographed image, and displays the target augmented image.

图5a给出了本发明实施例三提供的第一人机交互界面示意图,如图5a所示,目标增强对象A2的表情为微笑。图5b给出了本发明实施例三提供的第二人机交互界面示意图,如图5b所示,获取阳光明媚的图像B2作为与当前拍摄图像匹配的背景图像,根据所述阳光明媚的背景图像B2与当前拍摄图像生成目标增强图像,并显示所述目标增强图像。目标增强图像向用户展示了目标增强对象的表情为微笑时,阳光明媚背景的增强现实效果。Fig. 5a shows a schematic diagram of the first human-computer interaction interface provided by Embodiment 3 of the present invention. As shown in Fig. 5a, the expression of the target enhancement object A2 is a smile. Fig. 5b shows a schematic diagram of the second human-computer interaction interface provided by Embodiment 3 of the present invention. As shown in Fig. 5b, the sunny image B2 is acquired as the background image matching the currently captured image, and according to the sunny background image B2 generates a target enhanced image with the currently captured image, and displays the target enhanced image. The target augmented image shows the user the augmented reality effect of a sunny background when the target augmented subject's expression is smiling.

本实施例提供的方法,通过根据目标增强对象的表情信息来获取匹配的增强现实内容,根据所述增强现实内容与所述当前拍摄图像生成目标增强图像并显示,优化了现有的增强现实的拍照技术,丰富了基于增强现实的拍照方式,提升了增强现实的拍照趣味性,满足了人们日益增长的个性化、便捷化的增强现实的拍照需求。The method provided in this embodiment optimizes the existing augmented reality by obtaining matched augmented reality content according to the expression information of the target augmented object, and generating and displaying a target augmented image according to the augmented reality content and the currently captured image. The camera technology enriches the way of taking photos based on augmented reality, enhances the fun of taking pictures in augmented reality, and meets people's growing demand for personalized and convenient photos in augmented reality.

实施例四Embodiment Four

图6给出了本发明实施例四提供的基于增强现实的拍照方法的流程图。本实施例以上述实施例一为基础进行优化。在本实施例中,将“目标增强对象”优化为人物,进一步,将“根据所述目标增强对象的特征信息获取匹配的增强现实内容”,优化为“根据所述目标增强对象的运动轨迹信息获取匹配的增强现实内容”。FIG. 6 shows a flow chart of an augmented reality-based photographing method provided by Embodiment 4 of the present invention. This embodiment is optimized on the basis of the first embodiment above. In this embodiment, the "target augmented object" is optimized as a character, and further, "obtain matching augmented reality content according to the feature information of the target augmented object" is optimized as "according to the target augmented object's motion track information Get matching augmented reality content".

相应的,如图6所示,本实施例提供的方法包括以下步骤:Correspondingly, as shown in FIG. 6, the method provided in this embodiment includes the following steps:

步骤401、通过移动终端的摄像头获取当前拍摄图像,并从所述当前拍摄图像中获取目标增强对象。Step 401: Acquire a currently captured image through a camera of a mobile terminal, and acquire a target augmentation object from the currently captured image.

步骤402、根据所述目标增强对象的运动轨迹信息获取匹配的增强现实内容。Step 402. Acquire matched augmented reality content according to the motion track information of the target augmented object.

与实施例二不同的是,实施例二中目标增强对象的手势信息为静态手势信息,本实中目标增强对象的运动轨迹信息为动态运动轨迹信息,所述运动轨迹信息具体可以为目标增强对象这一整体的运动轨迹信息,也可以为目标增强对象的动态手势信息。The difference from Embodiment 2 is that the gesture information of the target augmented object in Embodiment 2 is static gesture information. In this example, the motion trajectory information of the target augmented object is dynamic motion trajectory information, and the motion trajectory information may specifically be the target augmented object This overall motion trajectory information can also be used to enhance the object's dynamic gesture information for the target.

具体的,该步骤可以包括:根据所述目标增强对象的运动轨迹信息获取所述目标增强对象匹配的增强现实内容。示例性的,若目标增强对象的运动轨迹为跳跃,则获取与目标对象匹配的历史跳跃动作的增强现实内容,例如该目标增强对象打篮球的图像。Specifically, this step may include: acquiring the augmented reality content matched with the target augmented object according to the motion track information of the target augmented object. Exemplarily, if the movement track of the target augmented object is jumping, the augmented reality content of the historical jumping action matching the target object is obtained, for example, an image of the target augmented object playing basketball.

具体的,该步骤可以包括:根据所述目标增强对象的运动轨迹信息获取当前拍摄图像匹配的背景增强现实内容。示例性,若目标增强对象的运动轨迹为跳跃,则获取篮球架图像作为当前拍摄图像匹配的背景图像。Specifically, this step may include: acquiring the background augmented reality content matched with the currently captured image according to the motion track information of the target augmented object. For example, if the movement track of the object for target enhancement is jumping, the image of the basketball hoop is acquired as the background image matched with the currently captured image.

具体的,该步骤可以包括:根据所述目标增强对象的运动轨迹信息获取所述当前拍摄图像匹配的亮度增强现实内容。示例性的,若目标增强对象的运动轨迹信息为从左向右挥动手臂,则获取高于当前亮度的亮度增强现实内容,以提高当前拍摄图像的亮度;若目标增强对象的运动轨迹信息为从右向左挥动手臂,则获取低于当前亮度的亮度增强现实内容,以降低当前拍摄图像的亮度。Specifically, this step may include: acquiring brightness augmented reality content matched with the currently captured image according to the motion track information of the target augmented object. Exemplarily, if the motion track information of the target augmented object is waving an arm from left to right, acquire the augmented reality content with a brightness higher than the current brightness to increase the brightness of the currently captured image; if the motion track information of the target augmented object is from Waving the arm from right to left obtains augmented reality content with a brightness lower than the current brightness, so as to reduce the brightness of the currently captured image.

具体的,该步骤可以包括:根据所述目标增强对象的运动轨迹信息获取所述当前拍摄图像匹配的滤镜效果增强现实内容。示例性的,若目标增强对象的运动轨迹信息为画了一个圆,则获取当前拍摄图像中所画圆包含的区域匹配的滤镜效果增强现实内容,例如,紫外线滤光镜效果增强现实内容,以将所画圆包含的区域有效过滤掉紫外线提高该区域图像的清晰度,使该区域图像的清晰度高于当前拍摄图像中的其他区域。Specifically, this step may include: acquiring the filter effect augmented reality content matched with the currently captured image according to the motion trajectory information of the target augmented object. Exemplarily, if the motion trajectory information of the target augmented object is that a circle is drawn, the filter effect augmented reality content matching the region contained in the circle drawn in the currently captured image is obtained, for example, the ultraviolet filter effect augmented reality content, To effectively filter out the ultraviolet rays in the area contained by the circle to improve the clarity of the image in this area, so that the image clarity of this area is higher than other areas in the currently captured image.

步骤403、根据所述增强现实内容与所述当前拍摄图像生成目标增强图像,并显示所述目标增强图像。Step 403: Generate an augmented target image according to the augmented reality content and the currently captured image, and display the augmented target image.

具体的,将上述示例中根据目标增强对象的运动轨迹信息获取的与所述目标增强对象匹配的增强现实内容,或者与所述当前拍摄图像匹配的背景增强现实内容,或者与所述当前拍摄图像匹配的亮度增强现实内容,或者与所述当前拍摄图像匹配的滤镜效果增强现实内容与当前拍摄图像生成目标增强图像,并显示所述目标增强图像。Specifically, the augmented reality content matched with the target augmented object, or the background augmented reality content matched with the currently captured image, or The matched brightness augmented reality content, or the filter effect augmented reality content matched with the current photographed image and the current photographed image generate a target augmented image, and display the target augmented image.

本实施例提供的方法,通过根据目标增强对象的运动轨迹信息来获取匹配的增强现实内容,根据所述增强现实内容与当前拍摄图像生成目标增强图像并显示,优化了现有的增强现实的拍照技术,丰富了基于增强现实的拍照方式,提升了增强现实的拍照趣味性,满足了人们日益增长的个性化、便捷化的增强现实的拍照需求。The method provided in this embodiment optimizes the existing augmented reality photography by obtaining the matched augmented reality content according to the motion track information of the target augmented object, generating and displaying the augmented reality image of the target according to the augmented reality content and the current captured image The technology has enriched the way of taking photos based on augmented reality, enhanced the fun of taking photos in augmented reality, and met people's growing demand for personalized and convenient augmented reality photos.

实施例五Embodiment five

图7给出了本发明实施例五提供的基于增强现实的拍照方法的流程图。本实施例以上述实施例一为基础进行优化。在本实施例中,将“目标增强对象”优化为人物,进一步,将“根据所述目标增强对象的特征信息获取匹配的增强现实内容”,优化为“根据所述目标增强对象的语音信息获取匹配的增强现实内容”。FIG. 7 shows a flow chart of an augmented reality-based photographing method provided by Embodiment 5 of the present invention. This embodiment is optimized on the basis of the first embodiment above. In this embodiment, the "target augmented object" is optimized as a person, and further, "obtain matching augmented reality content according to the feature information of the target augmented object" is optimized as "acquire the voice information of the targeted augmented object Matching augmented reality content".

相应的,如图7所示,本实施例提供的方法包括以下步骤:Correspondingly, as shown in FIG. 7, the method provided in this embodiment includes the following steps:

步骤501、通过移动终端的摄像头获取当前拍摄图像,并从所述当前拍摄图像中获取目标增强对象。Step 501. Acquire a currently captured image through a camera of a mobile terminal, and acquire a target enhancement object from the currently captured image.

步骤502、根据所述目标增强对象的语音信息获取匹配的增强现实内容。Step 502: Obtain matching augmented reality content according to the voice information of the target augmented object.

具体的,该步骤可以包括:根据所述目标增强对象的语音信息获取所述目标增强对象匹配的增强现实内容。Specifically, this step may include: acquiring the augmented reality content matched by the target augmented object according to the voice information of the target augmented object.

具体的,该步骤可以包括:根据所述目标增强对象的语音信息获取所述当前拍摄图像匹配的背景增强现实内容。Specifically, this step may include: acquiring background augmented reality content matched with the currently captured image according to the voice information of the target augmented object.

具体的,该步骤可以包括:根据所述目标增强对象的语音信息获取所述当前拍摄图像匹配的亮度增强现实内容。Specifically, this step may include: acquiring brightness augmented reality content matched with the currently captured image according to the voice information of the target augmented object.

具体的,该步骤可以包括:根据所述目标增强对象的语音信息获取所述当前拍摄图像匹配的滤镜效果增强现实内容。Specifically, this step may include: acquiring the filter effect augmented reality content matched with the currently captured image according to the voice information of the target augmented object.

示例性的,用户的语音信息为奥运吉祥物,则获取奥运吉祥物增强现实内容;示例性的,用户的语音信息为阳光明媚背景,则获取阳光明媚增强现实内容以作为当前拍摄图像的背景;示例性的,用户的语音信息为增强当前亮度,则获取高于当前亮度的亮度增强现实内容,以提高当前拍摄图像的亮度;示例性的,用户的语音信息为紫外线滤光镜效果,则对当前拍摄图像预设区域内的图像进行紫外线滤光镜效果的增强现实操作。Exemplarily, if the user's voice information is the Olympic mascot, then obtain the augmented reality content of the Olympic mascot; exemplary, if the user's voice information is the sunny background, then obtain the sunny augmented reality content as the background of the currently captured image; Exemplarily, if the user's voice information is to enhance the current brightness, the augmented reality content with a brightness higher than the current brightness is acquired to increase the brightness of the currently captured image; exemplary, the user's voice information is the effect of an ultraviolet filter, then the The image in the preset area of the currently captured image performs the augmented reality operation of the ultraviolet filter effect.

步骤503、根据所述增强现实内容与所述当前拍摄图像生成目标增强图像,并显示所述目标增强图像。Step 503: Generate an augmented target image according to the augmented reality content and the currently captured image, and display the augmented target image.

具体的,将上述示例中根据目标增强对象的语音信息获取的与所述目标增强对象匹配的增强现实内容,或者与所述当前拍摄图像匹配的背景增强现实内容,或者与所述当前拍摄图像匹配的亮度增强现实内容,或者与所述当前拍摄图像匹配的滤镜效果增强现实内容与当前拍摄图像生成目标增强图像,并显示所述目标增强图像。Specifically, the augmented reality content matched with the target augmented object acquired according to the voice information of the target augmented object in the above example, or the background augmented reality content matched with the currently captured image, or matched with the currently captured image The augmented reality content of brightness, or the augmented reality content of the filter effect matched with the current photographed image generates a target augmented image with the current photographed image, and displays the target augmented image.

本实施例提供的方法,通过根据目标增强对象的语音信息来获取匹配的增强现实内容,根据所述增强现实内容与当前拍摄图像生成目标增强图像并显示,优化了现有的增强现实的拍照技术,丰富了基于增强现实的拍照方式,提升了增强现实的拍照趣味性,满足了人们日益增长的个性化、便捷化的增强现实的拍照需求。The method provided in this embodiment optimizes the existing augmented reality photographing technology by obtaining the matched augmented reality content according to the voice information of the target augmented object, generating and displaying the augmented reality image of the target according to the augmented reality content and the currently captured image , which enriches the way of taking photos based on augmented reality, enhances the fun of taking photos of augmented reality, and meets people's growing demand for personalized and convenient augmented reality photos.

实施例六Embodiment six

图8给出了本发明实施例六提供的基于增强现实的拍照方法的流程图。本实施例以上述实施例一为基础进行优化。在本实施例中,将“目标增强对象”优化为特定图像,进一步,将“根据所述目标增强对象的特征信息获取匹配的增强现实内容”,优化为“根据所述目标增强对象的语音信息获取与所述目标增强对象匹配的增强现实内容”。FIG. 8 shows a flow chart of an augmented reality-based photographing method provided by Embodiment 6 of the present invention. This embodiment is optimized on the basis of the first embodiment above. In this embodiment, the "target augmented object" is optimized as a specific image, and further, "obtain matched augmented reality content according to the feature information of the targeted augmented object" is optimized as "according to the voice information of the targeted augmented object Acquiring augmented reality content matching the target augmented object".

相应的,如图8所示,本实施例提供的方法包括以下步骤:Correspondingly, as shown in FIG. 8, the method provided in this embodiment includes the following steps:

步骤601、通过移动终端的摄像头获取当前拍摄图像,并从所述当前拍摄图像中获取目标增强对象,所述目标增强对象为特定图像。Step 601: Obtain a currently captured image through the camera of the mobile terminal, and acquire a target augmented object from the currently captured image, where the target augmented object is a specific image.

其中,所述特定图像包括二维码、品牌标志或交通标志中的至少一项。Wherein, the specific image includes at least one of a two-dimensional code, a brand logo or a traffic sign.

步骤602、根据所述目标增强对象的特征信息获取与所述目标对象匹配的增强现实内容。Step 602: Obtain augmented reality content matching the target object according to the characteristic information of the target augmented object.

示例性的,所述特定图像为二维码,则根据拍摄到的该二维码图像获取该二维码对应的商品信息。Exemplarily, the specific image is a two-dimensional code, and the commodity information corresponding to the two-dimensional code is obtained according to the captured image of the two-dimensional code.

示例性的,所述特定图像为品牌标志,则根据该品牌标志获取该品牌今年的新款商品和搭配信息。Exemplarily, the specific image is a brand logo, and the new product and collocation information of the brand this year are acquired according to the brand logo.

示例性的,所述特定图像为交通标志,则根据该交通标志获取该交通标志对应的文字解说信息。Exemplarily, the specific image is a traffic sign, and the text explanatory information corresponding to the traffic sign is obtained according to the traffic sign.

步骤603、根据所述增强现实内容与所述当前拍摄图像生成目标增强图像,并显示所述目标增强图像。Step 603: Generate an augmented target image according to the augmented reality content and the currently captured image, and display the augmented target image.

示例性的,将上述示例中获取的商品信息、或者新款商品和搭配信息,或者文字解说信息与当前拍摄图像生成目标增强图像,并显示所述目标增强图像。Exemplarily, the product information obtained in the above examples, or new product and collocation information, or text commentary information and the currently captured image are used to generate a target enhanced image, and the target enhanced image is displayed.

本实施例提供的方法,通过根据特定图像的特征信息来获取匹配的增强现实内容,根据所述增强现实内容与当前拍摄图像生成目标增强图像并显示,优化了现有的增强现实的拍照技术,丰富了基于增强现实的拍照方式,提升了增强现实的拍照趣味性,满足了人们日益增长的个性化、便捷化的增强现实的拍照需求。The method provided in this embodiment optimizes the existing augmented reality photographing technology by obtaining matched augmented reality content according to the feature information of a specific image, generating and displaying a target augmented image according to the augmented reality content and the current captured image, It enriches the way of taking photos based on augmented reality, enhances the fun of taking photos in augmented reality, and meets people's growing demand for personalized and convenient augmented reality photos.

实施例七Embodiment seven

图9给出了本发明实施例七提供的基于增强现实的拍照装置的结构示意图,该装置可由软件和/或硬件实现,一般集成在移动终端中。如图9所示,本实施例提供的基于增强现实的拍照装置包括目标增强对象获取模块71、增强现实内容获取模块72和目标增强图像生成模块73。FIG. 9 shows a schematic structural diagram of an augmented reality-based photographing device provided by Embodiment 7 of the present invention. The device can be implemented by software and/or hardware, and is generally integrated in a mobile terminal. As shown in FIG. 9 , the augmented reality-based photographing device provided in this embodiment includes a target augmented object acquisition module 71 , an augmented reality content acquisition module 72 and a target augmented image generation module 73 .

所述目标增强对象获取模块71,用于通过移动终端的摄像头获取当前拍摄图像,并从所述当前拍摄图像中获取目标增强对象;The target augmented object acquiring module 71 is configured to acquire a current photographed image through a camera of the mobile terminal, and acquire a target augmented object from the currently photographed image;

所述增强现实内容获取模块72,用于根据所述目标增强对象的特征信息获取匹配的增强现实内容;The augmented reality content acquisition module 72 is configured to acquire matched augmented reality content according to the characteristic information of the target augmented object;

所述目标增强图像生成模块73,用于根据所述增强现实内容与所述当前拍摄图像生成目标增强图像,并显示所述目标增强图像。The target enhanced image generation module 73 is configured to generate a target enhanced image according to the augmented reality content and the currently captured image, and display the target enhanced image.

本实施例提供的技术方案,通过根据目标增强对象的特征信息来获取匹配的增强现实内容,根据所述增强现实内容与当前拍摄图像生成目标增强图像并显示,优化了现有的增强现实的拍照技术,丰富了基于增强现实的拍照方式,提升了增强现实的拍照趣味性,满足了人们日益增长的个性化、便捷化的增强现实的拍照需求。The technical solution provided by this embodiment optimizes the existing augmented reality photographing by obtaining the matched augmented reality content according to the feature information of the target augmented object, generating and displaying the augmented reality image of the target according to the augmented reality content and the current captured image The technology has enriched the way of taking photos based on augmented reality, enhanced the fun of taking photos in augmented reality, and met people's growing demand for personalized and convenient augmented reality photos.

在上述各实施例的基础上,所述目标增强对象为人物,所述增强现实内容获取模块具体用于:On the basis of the above-mentioned embodiments, the target augmented object is a character, and the augmented reality content acquisition module is specifically used for:

根据所述目标增强对象的手势信息获取匹配的增强现实内容;或者,Acquiring matched augmented reality content according to the gesture information of the target augmented object; or,

根据所述目标增强对象的表情信息获取匹配的增强现实内容;或者,Acquire matching augmented reality content according to the expression information of the target augmented object; or,

根据所述目标增强对象的运动轨迹信息获取匹配的增强现实内容;或者,Acquiring matched augmented reality content according to the motion track information of the target augmented object; or,

根据所述目标增强对象的语音信息获取匹配的增强现实内容。Acquire matched augmented reality content according to the voice information of the target augmented object.

在上述各实施例的基础上,所述目标增强对象为特定图像,所述特定图像包括二维码、品牌标志或交通标志中的至少一项。On the basis of the above embodiments, the target enhancement object is a specific image, and the specific image includes at least one of a two-dimensional code, a brand logo or a traffic sign.

在上述各实施例的基础上,所述增强现实内容获取模块具体用于:On the basis of the above-mentioned embodiments, the augmented reality content acquisition module is specifically used for:

根据所述目标增强对象的特征信息获取所述目标增强对象匹配的增强现实内容;或者,Acquiring augmented reality content matched with the target augmented object according to the feature information of the target augmented object; or,

根据所述目标增强对象的特征信息获取所述当前拍摄图像匹配的背景增强现实内容;或者,Acquiring the background augmented reality content matched with the currently captured image according to the feature information of the target augmented object; or,

根据所述目标增强对象的特征信息获取所述当前拍摄图像匹配的亮度增强现实内容;或者,Acquiring the brightness augmented reality content matched with the currently captured image according to the feature information of the target augmented object; or,

根据所述目标增强对象的特征信息获取所述当前拍摄图像匹配的滤镜效果增强现实内容。The filter effect augmented reality content matched with the currently captured image is obtained according to the feature information of the target augmented object.

在上述各实施例的基础上,所述增强现实内容获取模块具体用于:On the basis of the above-mentioned embodiments, the augmented reality content acquisition module is specifically used for:

根据所述目标增强对象的特征信息从服务器中获取匹配的增强现实内容。The matched augmented reality content is obtained from the server according to the feature information of the target augmented object.

在上述各实施例的基础上,还包括:On the basis of above-mentioned each embodiment, also include:

增强现实照片生成模块,用于在接收到拍照指令时,根据所述目标增强图像生成增强现实照片。The augmented reality photo generating module is configured to generate an augmented reality photo according to the target augmented image when receiving a photographing instruction.

本发明实施例提供的基于增强现实的拍照装置可执行本发明任意实施例提供的基于增强现实的拍照方法,具备执行方法相应的功能模块和有益效果。The augmented reality-based photographing device provided in the embodiments of the present invention can execute the augmented reality-based photographing method provided in any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method.

实施例八Embodiment eight

本实施例八提供了一种移动终端,该移动终端包括本发明实施例中所述的基于增强现实的拍照装置,可通过执行基于增强现实的拍照方法来进行增强现实内容的拍照。The eighth embodiment provides a mobile terminal, the mobile terminal includes the augmented reality-based photographing device described in the embodiments of the present invention, and can perform augmented reality content photographing by executing the augmented reality-based photographing method.

示例性的,本实施例中的移动终端具体可为手机、平板电脑以及数码照相机等配置有摄像头的终端,优选为智能手机。Exemplarily, the mobile terminal in this embodiment may specifically be a terminal equipped with a camera, such as a mobile phone, a tablet computer, and a digital camera, and is preferably a smart phone.

当用户使用本实施例中的移动终端时,移动终端可在应用程序调用摄像头进行拍照时,通过根据目标增强对象的特征信息来获取匹配的增强现实内容,根据所述增强现实内容与当前拍摄图像生成目标增强图像并显示,优化了现有的增强现实的拍照技术,丰富了基于增强现实的拍照方式,提升了增强现实的拍照趣味性,满足了人们日益增长的个性化、便捷化的增强现实的拍照需求。When the user uses the mobile terminal in this embodiment, the mobile terminal can obtain the matched augmented reality content according to the characteristic information of the target augmented object when the application program calls the camera to take pictures, and according to the augmented reality content and the currently captured image Generate target enhanced images and display them, optimize the existing augmented reality photography technology, enrich the augmented reality-based photography methods, enhance the fun of augmented reality photography, and meet people's growing personalized and convenient augmented reality photo needs.

上述实施例中提供的基于增强现实的拍照装置及移动终端可执行本发明任意实施例所提供的基于增强现实的拍照方法,具备执行该方法相应的功能模块和有益效果。未在上述实施例中详尽描述的技术细节,可参见本发明任意实施例所提供的基于增强现实的拍照方法。The augmented reality-based photographing device and mobile terminal provided in the above embodiments can execute the augmented reality-based photographing method provided in any embodiment of the present invention, and have corresponding functional modules and beneficial effects for executing the method. For technical details not exhaustively described in the foregoing embodiments, reference may be made to the augmented reality-based photographing method provided in any embodiment of the present invention.

上述仅为本发明的较佳实施例及所运用的技术原理。本发明不限于这里所述的特定实施例,对本领域技术人员来说能够进行的各种明显变化、重新调整及替代均不会脱离本发明的保护范围。因此,虽然通过以上实施例对本发明进行了较为详细的说明,但是本发明不仅仅限于以上实施例,在不脱离本发明构思的情况下,还可以包括更多其他等效实施例,而本发明的范围由权利要求的范围决定。The foregoing are only preferred embodiments of the present invention and the applied technical principles. The present invention is not limited to the specific embodiments described here, and various obvious changes, readjustments and substitutions that can be made by those skilled in the art will not depart from the protection scope of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present invention, and the present invention The scope is determined by the scope of the claims.

Claims (11)

1. An augmented reality-based photographing method, comprising:
acquiring a current shot image through a camera of a mobile terminal, and acquiring a target enhancement object from the current shot image;
acquiring matched augmented reality content according to the characteristic information of the target augmented object;
and generating a target enhanced image according to the augmented reality content and the current shooting image, and displaying the target enhanced image.
2. The method of claim 1, wherein the target augmented object is a human figure, and the obtaining the matching augmented reality content according to the feature information of the target augmented object comprises:
acquiring matched augmented reality content according to the gesture information of the target augmented object; or,
acquiring matched augmented reality content according to the expression information of the target augmented object; or,
acquiring matched augmented reality content according to the motion trail information of the target augmented object; or,
and acquiring the matched augmented reality content according to the voice information of the target augmented object.
3. The method of claim 1, wherein:
the target enhancement object is a specific image, and the specific image comprises at least one of a two-dimensional code, a brand mark or a traffic mark.
4. The method according to claim 1, wherein the obtaining the matching augmented reality content according to the feature information of the target augmented object comprises:
acquiring augmented reality content matched with the target augmented object according to the characteristic information of the target augmented object; or,
acquiring background augmented reality content matched with the current shot image according to the characteristic information of the target augmented object; or,
acquiring brightness augmented reality content matched with the current shot image according to the characteristic information of the target augmented object; or,
and acquiring the filter effect augmented reality content matched with the current shot image according to the characteristic information of the target augmented object.
5. The method according to claim 1, wherein the obtaining the matching augmented reality content according to the feature information of the target augmented object comprises:
and acquiring the matched augmented reality content from the server according to the characteristic information of the target augmented object.
6. An augmented reality-based photographing device, comprising:
the target enhanced object acquisition module is used for acquiring a current shot image through a camera of the mobile terminal and acquiring a target enhanced object from the current shot image;
the augmented reality content acquisition module is used for acquiring matched augmented reality content according to the characteristic information of the target augmented object;
and the target enhanced image generation module is used for generating a target enhanced image according to the augmented reality content and the current shooting image and displaying the target enhanced image.
7. The apparatus of claim 6, wherein the target augmented object is a person, and the augmented reality content obtaining module is specifically configured to:
acquiring matched augmented reality content according to the gesture information of the target augmented object; or,
acquiring matched augmented reality content according to the expression information of the target augmented object; or,
acquiring matched augmented reality content according to the motion trail information of the target augmented object; or,
and acquiring the matched augmented reality content according to the voice information of the target augmented object.
8. The apparatus of claim 6, wherein:
the target enhancement object is a specific image, and the specific image comprises at least one of a two-dimensional code, a brand mark or a traffic mark.
9. The apparatus of claim 6, wherein the augmented reality content obtaining module is specifically configured to:
acquiring augmented reality content matched with the target augmented object according to the characteristic information of the target augmented object; or,
acquiring background augmented reality content matched with the current shot image according to the characteristic information of the target augmented object; or,
acquiring brightness augmented reality content matched with the current shot image according to the characteristic information of the target augmented object; or,
and acquiring the filter effect augmented reality content matched with the current shot image according to the characteristic information of the target augmented object.
10. The apparatus of claim 6, wherein the augmented reality content obtaining module is specifically configured to:
and acquiring the matched augmented reality content from the server according to the characteristic information of the target augmented object.
11. A mobile terminal characterized in that it integrates the apparatus according to any of claims 6-10.
CN201610507188.8A 2016-06-28 2016-06-28 A camera method, device and mobile terminal based on augmented reality Pending CN106157363A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610507188.8A CN106157363A (en) 2016-06-28 2016-06-28 A camera method, device and mobile terminal based on augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610507188.8A CN106157363A (en) 2016-06-28 2016-06-28 A camera method, device and mobile terminal based on augmented reality

Publications (1)

Publication Number Publication Date
CN106157363A true CN106157363A (en) 2016-11-23

Family

ID=57350806

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610507188.8A Pending CN106157363A (en) 2016-06-28 2016-06-28 A camera method, device and mobile terminal based on augmented reality

Country Status (1)

Country Link
CN (1) CN106157363A (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106601217A (en) * 2016-12-06 2017-04-26 北京邮电大学 Interactive-type musical instrument performing method and device
CN107730461A (en) * 2017-09-29 2018-02-23 北京金山安全软件有限公司 Image processing method, apparatus, device and medium
CN107895161A (en) * 2017-12-22 2018-04-10 北京奇虎科技有限公司 Real-time attitude recognition methods and device, computing device based on video data
CN107944376A (en) * 2017-11-20 2018-04-20 北京奇虎科技有限公司 The recognition methods of video data real-time attitude and device, computing device
CN108021896A (en) * 2017-12-08 2018-05-11 北京百度网讯科技有限公司 Image pickup method, device, equipment and computer-readable medium based on augmented reality
CN108109161A (en) * 2017-12-19 2018-06-01 北京奇虎科技有限公司 Video data real-time processing method and device based on adaptive threshold fuzziness
CN108525305A (en) * 2018-03-26 2018-09-14 广东欧珀移动通信有限公司 Image processing method, device, storage medium and electronic equipment
CN108829479A (en) * 2018-06-01 2018-11-16 北京市商汤科技开发有限公司 Information processing method and device, storage medium
CN109447958A (en) * 2018-10-17 2019-03-08 腾讯科技(深圳)有限公司 Image processing method, device, storage medium and computer equipment
CN109660714A (en) * 2018-10-31 2019-04-19 百度在线网络技术(北京)有限公司 Image processing method, device, equipment and storage medium based on AR
CN110321009A (en) * 2019-07-04 2019-10-11 北京百度网讯科技有限公司 AR expression processing method, device, equipment and storage medium
CN110855875A (en) * 2018-08-20 2020-02-28 珠海格力电器股份有限公司 Method and device for acquiring background information of image
WO2020215789A1 (en) * 2019-04-26 2020-10-29 北京字节跳动网络技术有限公司 Virtual paintbrush implementing method and apparatus, and computer readable storage medium
CN111915744A (en) * 2020-08-31 2020-11-10 深圳传音控股股份有限公司 Interaction method, terminal and storage medium for augmented reality image
CN112422945A (en) * 2020-09-01 2021-02-26 华为技术有限公司 Image processing method, mobile terminal and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1794265A (en) * 2005-12-31 2006-06-28 北京中星微电子有限公司 Method and device for distinguishing face expression based on video frequency
CN101247482A (en) * 2007-05-16 2008-08-20 北京思比科微电子技术有限公司 Method and device for implementing dynamic image processing
CN101370195A (en) * 2007-08-16 2009-02-18 英华达(上海)电子有限公司 Method and device for implementing emotion regulation in mobile terminal
CN101893935A (en) * 2010-07-14 2010-11-24 北京航空航天大学 Construction method of collaborative augmented reality table tennis system based on real racket
WO2013027893A1 (en) * 2011-08-22 2013-02-28 Kang Jun-Kyu Apparatus and method for emotional content services on telecommunication devices, apparatus and method for emotion recognition therefor, and apparatus and method for generating and matching the emotional content using same
CN103533244A (en) * 2013-10-21 2014-01-22 深圳市中兴移动通信有限公司 Shooting device and automatic visual effect processing shooting method thereof
CN103858073A (en) * 2011-09-19 2014-06-11 视力移动技术有限公司 Touch free interface for augmented reality systems
CN104117203A (en) * 2014-07-02 2014-10-29 乔冰 Infrared projection billiard entertainment system and implementation method thereof
CN104780338A (en) * 2015-04-16 2015-07-15 美国掌赢信息科技有限公司 Method and electronic equipment for loading expression effect animation in instant video

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1794265A (en) * 2005-12-31 2006-06-28 北京中星微电子有限公司 Method and device for distinguishing face expression based on video frequency
CN101247482A (en) * 2007-05-16 2008-08-20 北京思比科微电子技术有限公司 Method and device for implementing dynamic image processing
CN101370195A (en) * 2007-08-16 2009-02-18 英华达(上海)电子有限公司 Method and device for implementing emotion regulation in mobile terminal
CN101893935A (en) * 2010-07-14 2010-11-24 北京航空航天大学 Construction method of collaborative augmented reality table tennis system based on real racket
WO2013027893A1 (en) * 2011-08-22 2013-02-28 Kang Jun-Kyu Apparatus and method for emotional content services on telecommunication devices, apparatus and method for emotion recognition therefor, and apparatus and method for generating and matching the emotional content using same
CN103858073A (en) * 2011-09-19 2014-06-11 视力移动技术有限公司 Touch free interface for augmented reality systems
CN103533244A (en) * 2013-10-21 2014-01-22 深圳市中兴移动通信有限公司 Shooting device and automatic visual effect processing shooting method thereof
CN104117203A (en) * 2014-07-02 2014-10-29 乔冰 Infrared projection billiard entertainment system and implementation method thereof
CN104780338A (en) * 2015-04-16 2015-07-15 美国掌赢信息科技有限公司 Method and electronic equipment for loading expression effect animation in instant video

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106601217A (en) * 2016-12-06 2017-04-26 北京邮电大学 Interactive-type musical instrument performing method and device
CN106601217B (en) * 2016-12-06 2021-03-02 北京邮电大学 A kind of interactive musical instrument performance method and device
CN107730461A (en) * 2017-09-29 2018-02-23 北京金山安全软件有限公司 Image processing method, apparatus, device and medium
CN107944376A (en) * 2017-11-20 2018-04-20 北京奇虎科技有限公司 The recognition methods of video data real-time attitude and device, computing device
CN108021896B (en) * 2017-12-08 2019-05-10 北京百度网讯科技有限公司 Augmented reality-based shooting method, apparatus, device, and computer-readable medium
CN108021896A (en) * 2017-12-08 2018-05-11 北京百度网讯科技有限公司 Image pickup method, device, equipment and computer-readable medium based on augmented reality
CN108109161A (en) * 2017-12-19 2018-06-01 北京奇虎科技有限公司 Video data real-time processing method and device based on adaptive threshold fuzziness
CN108109161B (en) * 2017-12-19 2021-05-11 北京奇虎科技有限公司 Method and device for real-time processing of video data based on adaptive threshold segmentation
CN107895161A (en) * 2017-12-22 2018-04-10 北京奇虎科技有限公司 Real-time attitude recognition methods and device, computing device based on video data
CN107895161B (en) * 2017-12-22 2020-12-11 北京奇虎科技有限公司 Real-time gesture recognition method, device and computing device based on video data
CN108525305A (en) * 2018-03-26 2018-09-14 广东欧珀移动通信有限公司 Image processing method, device, storage medium and electronic equipment
CN108525305B (en) * 2018-03-26 2020-08-14 Oppo广东移动通信有限公司 Image processing method, device, storage medium and electronic device
CN108829479A (en) * 2018-06-01 2018-11-16 北京市商汤科技开发有限公司 Information processing method and device, storage medium
CN110855875A (en) * 2018-08-20 2020-02-28 珠海格力电器股份有限公司 Method and device for acquiring background information of image
CN109447958A (en) * 2018-10-17 2019-03-08 腾讯科技(深圳)有限公司 Image processing method, device, storage medium and computer equipment
CN109447958B (en) * 2018-10-17 2023-04-14 腾讯科技(深圳)有限公司 Image processing method, image processing device, storage medium and computer equipment
CN109660714A (en) * 2018-10-31 2019-04-19 百度在线网络技术(北京)有限公司 Image processing method, device, equipment and storage medium based on AR
US11561651B2 (en) 2019-04-26 2023-01-24 Beijing Bytedance Network Technology Co., Ltd. Virtual paintbrush implementing method and apparatus, and computer readable storage medium
WO2020215789A1 (en) * 2019-04-26 2020-10-29 北京字节跳动网络技术有限公司 Virtual paintbrush implementing method and apparatus, and computer readable storage medium
CN110321009A (en) * 2019-07-04 2019-10-11 北京百度网讯科技有限公司 AR expression processing method, device, equipment and storage medium
CN110321009B (en) * 2019-07-04 2023-04-07 北京百度网讯科技有限公司 AR expression processing method, device, equipment and storage medium
CN111915744A (en) * 2020-08-31 2020-11-10 深圳传音控股股份有限公司 Interaction method, terminal and storage medium for augmented reality image
CN111915744B (en) * 2020-08-31 2024-09-27 深圳传音控股股份有限公司 Interaction method, terminal and storage medium for augmented reality image
CN112422945A (en) * 2020-09-01 2021-02-26 华为技术有限公司 Image processing method, mobile terminal and storage medium

Similar Documents

Publication Publication Date Title
CN106157363A (en) A camera method, device and mobile terminal based on augmented reality
WO2022001593A1 (en) Video generation method and apparatus, storage medium and computer device
CN108305317B (en) Image processing method, device and storage medium
US11736756B2 (en) Producing realistic body movement using body images
KR101306221B1 (en) Method and apparatus for providing moving picture using 3d user avatar
US20130101164A1 (en) Method of real-time cropping of a real entity recorded in a video sequence
TWI255141B (en) Method and system for real-time interactive video
CN113287118A (en) System and method for face reproduction
CN112199016B (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
CN112348937A (en) Face image processing method and electronic equipment
CN106203286B (en) Augmented reality content acquisition method and device and mobile terminal
JP7421010B2 (en) Information display method, device and storage medium
WO2022116604A1 (en) Image captured image processing method and electronic device
CN106155315A (en) Method, device and mobile terminal for adding augmented reality effect in shooting
CN108668050B (en) Video shooting method and device based on virtual reality
CN114612643B (en) Method, device, electronic device and storage medium for adjusting image of virtual object
KR20120120858A (en) Service and method for video call, server and terminal thereof
US20240282016A1 (en) Machine learning diffusion model with image encoder trained for synthetic image generation
CN106200917A (en) An augmented reality content display method, device and mobile terminal
CN113453027B (en) Live video and virtual make-up image processing method and device and electronic equipment
CN106203289A (en) A method, device and mobile terminal for acquiring target augmented reality content
CN106203288A (en) A camera method, device and mobile terminal based on augmented reality
KR101189043B1 (en) Service and method for video call, server and terminal thereof
CN118250523A (en) Digital human video generation method and device, storage medium and electronic equipment
CN114779948B (en) Method, device and equipment for controlling instant interaction of animation characters based on facial recognition

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20161123