CN103489002B - A kind of augmented reality method and system - Google Patents

Abstract

The present application provides an augmented reality method and system, wherein an augmented reality method includes: acquiring a real scene image captured by a mobile terminal and the geographic location of the mobile terminal; matching the real scene image with images in a preset image library ; If the real scene image is successfully matched with the image in the preset image library, the multimedia information of the real scene image is obtained according to the geographic location; the multimedia information is sent to the mobile terminal, and the mobile terminal displays the multimedia information and the real scene image in combination. That is to say, the augmented reality method provided by this application can combine image recognition and geographic location to obtain final multimedia information, and enhance the matching accuracy of reality. And the real scene image captured by the mobile terminal is often the image that the user is looking for, which realizes instant shooting, and the mobile terminal can also display the multimedia information corresponding to the real scene image while displaying the real scene image, thereby enhancing the display effect.

Description

A method and system for augmented reality

technical field

The present application relates to the technical field of image recognition, in particular to an augmented reality method and system.

Background technique

As computer technology is more and more widely used in people's lives, how to shorten the distance between people and the Internet, realize a more natural and intimate interaction between people and the Internet, and integrate real life scenes with the Internet, augmented reality is the most suitable method. The current augmented reality method uses simple geographical information matching, and the process may include: obtaining the image of the real scene taken by the first terminal; obtaining the location information of the location of the first terminal and the geographic location of the second terminal. The location information includes geographic coordinates and The orientation of the first terminal; matching the location information with the geographic location; displaying the information of the second terminal whose geographic location is within a certain range of geographic coordinates on the image of the real scene captured by the first terminal.

The user using the first terminal can select the second terminal to communicate with according to the second terminal displayed on the image of the real scene, so as to communicate with the user using the second terminal, and can also obtain The user's specific geographic location and orientation.

From the description of the above prior art, it can be seen that the existing augmented reality method is only suitable for social applications to realize the function of finding nearby friends, and it only matches the geographical location and the orientation of the terminal. Therefore, the matching accuracy of augmented reality is reduced, which in turn affects the effect of augmented display.

Contents of the invention

The technical problem to be solved in this application is to provide an augmented reality method and system for obtaining multimedia information of real scene images captured by mobile terminals, so that the mobile terminal can also display multimedia information while displaying real scene images, enhancing the display effect . The technical solution is as follows:

An embodiment of the present application provides an augmented reality method, including:

Obtain the real scene image taken by the mobile terminal and the geographic location of the mobile terminal;

matching the real scene image with images in a preset image library;

If the real scene image is successfully matched with the image in the preset image library, then acquire the multimedia information of the real scene image according to the geographic location;

The multimedia information is sent to the mobile terminal, and the mobile terminal displays the multimedia information and the real scene image in combination.

Preferably, before matching the real scene image with the images in the preset image library, it also includes:

Filtering the images in the preset image library according to the geographic location to obtain an image to be matched, wherein the image to be matched is that the geographic location of the scene recorded in the image and the geographic location of the mobile terminal are within a preset range Image;

Matching the real scene image with images in a preset image library includes: matching the real scene image with the image to be matched.

Preferably, if the real scene image fails to match the images in the preset image library, the multimedia information of the real scene image recorded by the mobile terminal is acquired.

Preferably, matching the real scene image with the images in the preset image library includes: matching the first feature data of the real scene image with the second feature data of the images in the preset image library, if the If the first feature data is consistent with the second feature data, it is determined that the real scene image is successfully matched with the image in the preset image library; if the first feature data is inconsistent with the second feature data, it is determined that The real scene image failed to match with the images in the preset image library.

Preferably, said acquiring the real scene image taken by the mobile terminal includes:

When the real scene images taken by the mobile terminal two times before and after exceed the preset threshold, the real scene image taken by the mobile terminal last time is acquired.

Preferably, the mobile terminal displays the multimedia information and the real scene image in combination, including:

If the multimedia information is text information, embedding the text information in the real scene image for display;

If the multimedia information is video or picture information, the video or picture information is fused into the real scene image in a picture-in-picture form for display.

An embodiment of the present application also provides an augmented reality system, including: a mobile terminal and an information processing system, wherein the mobile terminal includes an image acquisition module, a position acquisition module, a first network transmission module, and a fusion module;

The image acquisition module is used to acquire real scene images;

The location acquisition module is configured to acquire the geographic location of the mobile terminal;

The first network transmission module is configured to send the real scene image and the geographic location of the mobile terminal to the information processing system;

The fusion module is used to obtain the multimedia information of the real scene image through the first network transmission module, and display the multimedia information and the real scene image in combination;

The information processing system includes: a second network transmission module, an image matching module and an information matching module;

The second network transmission module is configured to receive the real scene image and the geographic location of the mobile terminal sent by the first network transmission module;

The image recognition module is used to match the real scene image with images in a preset image library;

The information matching module is configured to acquire the multimedia information of the real scene image according to the geographic location when the real scene image is successfully matched with the images in the preset image library, and the multimedia information is passed through the The second network transmission module sends.

Preferably, the information matching module is further configured to filter the images in the preset image library according to the geographic location to obtain the image to be matched, wherein the image to be matched is the geographic location of the scene recorded in the image and the location An image in which the geographic location of the mobile terminal is within a preset range;

The image recognition module is specifically configured to match the real scene image with the image to be matched.

Preferably, the mobile terminal further includes: an information collection module, configured to obtain multimedia information of the real scene image recorded by the mobile terminal;

The first network transmission module is further configured to send the multimedia information of the real scene image recorded by the mobile terminal;

The second network transmission module is further configured to receive the multimedia information of the real scene image recorded by the mobile terminal.

Preferably, matching the real scene image with the images in the preset image library includes: matching the first feature data of the real scene image with the second feature data of the images in the preset image library, if the If the first feature data is consistent with the second feature data, it is determined that the real scene image is successfully matched with the image in the preset image library; if the first feature data is inconsistent with the second feature data, it is determined that The real scene image failed to match with the images in the preset image library.

Preferably, the image acquisition module is specifically configured to acquire the real scene image captured the next time when the real scene images captured by the mobile terminal twice before and after exceed the preset threshold, and transmit the image through the first network module sent.

Preferably, the fusion module is specifically used for:

If the multimedia information is text information, embedding the text information in the real scene image for display;

If the multimedia information is video or picture information, the video or picture information is fused into the real scene image in a picture-in-picture form for display.

Compared with the prior art, the present application includes the following advantages:

In this application, the real scene image is first matched with the images in the preset image library, and if the matching is successful, the multimedia information of the real scene image is obtained according to the geographical location. That is to say, the augmented reality method provided by the present application can combine image recognition and geographic location to obtain the final multimedia information. Compared with the existing matching based solely on geographic location, the matching accuracy of augmented reality is higher.

And the real scene image captured by the mobile terminal is often the image that the user is looking for, which realizes instant shooting, and the mobile terminal can also display the multimedia information corresponding to the real scene image while displaying the real scene image, thereby enhancing the display effect.

Of course, implementing any product of the present application does not necessarily need to achieve all the above-mentioned advantages at the same time.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 is a flow chart of an augmented reality method provided by the present application;

FIG. 2 is another flowchart of an augmented reality method provided by the present application;

FIG. 3 is a schematic structural diagram of an augmented reality system provided by the present application;

Fig. 4 is another schematic structural diagram of an augmented reality system provided by the present application;

Fig. 5 is another structural schematic diagram of an augmented reality system provided by the present application.

detailed description

Firstly, an augmented reality method provided in the embodiment of the present application is briefly described. The augmented reality method provided in the present application can be developed into an APP (Application, application software), and the APP can be applied to various mobile terminals. For example: mobile phones, tablets and wearable devices. The augmented reality method may include:

Obtain the real scene image taken by the mobile terminal and the geographic location of the mobile terminal;

matching the real scene image with images in a preset image library;

If the real scene image is successfully matched with the image in the preset image library, then acquire the multimedia information of the real scene image according to the geographic location;

The multimedia information is sent to the mobile terminal, and the mobile terminal displays the multimedia information and the real scene image in combination.

Applying the above technical solution, the real scene image is first matched with the images in the preset image library, and if the matching is successful, then the multimedia information of the real scene image is obtained according to the geographical location. That is to say, the augmented reality method provided by the present application can combine image recognition and geographic location to obtain the final multimedia information. Compared with the existing matching based solely on geographic location, the matching accuracy of augmented reality is higher.

And the real scene image captured by the mobile terminal is often the image that the user is looking for, which realizes instant shooting, and the mobile terminal can also display the multimedia information corresponding to the real scene image while displaying the real scene image, thereby enhancing the display effect.

The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

Please refer to FIG. 1, which shows a flow chart of an augmented reality method provided by an embodiment of the present application, which may include the following steps:

Step 101: Obtain the real scene image captured by the mobile terminal and the geographic location of the mobile terminal.

At present, a mobile terminal is provided with a camera, and the mobile terminal can control the camera to capture a real scene image by detecting a user's operation, wherein the real scene image is an image of the user's environment. When the user operates the mobile terminal, he often fixes the focus of the camera on a certain point he cares about. At this time, the image captured by the mobile terminal is the real scene image that the user cares about, so that you can get what you want when you shoot.

The geographic location of the mobile terminal may be obtained through a GPS (Global Positioning System, Global Positioning System) in the mobile terminal. After the mobile terminal obtains the real scene image and the geographic location, it sends the real scene image and the geographic location to the information processing system through the network transmission module in the mobile terminal. The network transmission module may be a wireless module or a wired module, which is not limited in this application.

Step 102: Match the real scene image with the images in the preset image library.

It can be understood that the matching between the real scene image and the images in the preset image library can be performed using image recognition technology, for example, by matching the first feature data of the real scene image with the second image in the preset image library. feature data for matching, wherein the first feature data and the second feature data may include image profile data, color data, and the like.

Step 103: If the real scene image is successfully matched with the images in the preset image library, then acquire the multimedia information of the real scene image according to the geographic location.

In the embodiment of the present application, the successful matching between the real scene image and the images in the preset image library means that most of the image areas of the two images are the same, and the same image areas can be represented by feature data. That is, the first feature data and the second feature data in the image area are consistent, and it is determined that the image area is the same, and then it is determined that the real scene image matches the image in the preset image library successfully, and the first feature data and the second feature data in the image area Inconsistent, it is determined that the image areas are different, and then it can be determined that the matching between the real scene image and the image in the preset image library fails.

Of course, it can also be the matching of all image areas when performing image matching. When all image areas are the same, it is determined that the real scene image matches the image in the preset image library successfully, otherwise it is determined that the real scene image and the image in the preset image library Match failed.

When the matching is successful, the multimedia information of the real scene image is obtained according to the geographic location of the mobile terminal, wherein the multimedia information can include at least one of text information, picture information and video information, and the multimedia information can be stored in the information database.

Step 104: Send the multimedia information to the mobile terminal, and the mobile terminal will combine and display the multimedia information and the real scene image.

If the multimedia information is text information, the text information is embedded in the real scene image for display. If the multimedia information is video or picture information, the video or picture information is fused into the real scene image in the form of picture-in-picture for display. Of course, if the multimedia information includes both text information and video or picture information, then the text information is embedded in the real scene image for display, and the video or picture information is fused into the real scene image in the form of picture-in-picture for display.

For example, the real scene image is an image of a certain scenic spot. According to the geographical location of the mobile terminal, the name of the scenic spot where the user is located can be determined, and then the multimedia information of the scenic spot is obtained from the information database, and the multimedia information and the real scene image are simultaneously displayed in the mobile terminal. display, so that users can learn about the information of the scenic spot through multimedia information.

Applying the above technical solution, the real scene image is first matched with the images in the preset image library, and if the matching is successful, then the multimedia information of the real scene image is obtained according to the geographical location. That is to say, the augmented reality method provided by the present application can combine image recognition and geographic location to obtain the final multimedia information. Compared with the existing matching based solely on geographic location, the matching accuracy of augmented reality is higher.

And the real scene image captured by the mobile terminal is often the image that the user is looking for, which realizes instant shooting, and the mobile terminal can also display the multimedia information corresponding to the real scene image while displaying the real scene image, thereby enhancing the display effect.

Although the augmented reality method shown in Figure 1 can improve the matching accuracy and display effect, and realize instant shooting, the number of images in the preset image library is large, and the real scene images are directly matched with the images in the preset image library. The matching efficiency will be reduced due to the large number of images. In order to solve this problem, the embodiment of the present application provides another augmented reality method, the flow chart of which is shown in Figure 2, which may include:

Step 201: Obtain the real scene image captured by the mobile terminal and the geographic location of the mobile terminal.

At present, a mobile terminal is provided with a camera, and the mobile terminal can control the camera to capture a real scene image by detecting a user's operation, wherein the real scene image is an image of the user's environment. When the user operates the mobile terminal, he often fixes the focus of the camera on a certain point he cares about. At this time, the image captured by the mobile terminal is the real scene image that the user cares about, so that you can get what you want when you shoot.

Each time the mobile terminal captures a real scene image, it can be compared with the real scene image captured last time. When the real scene images captured by the mobile terminal twice before and after exceed the preset threshold, the mobile terminal sends the real scene image captured the last time . The preset threshold can be set to different values according to different scenes. When the real scene images captured by the mobile terminal twice before and after exceed the preset threshold, it means that the same image area in the real scene images captured twice is small or the real scene images captured twice The completion is different. At this time, the information processing system needs to re-identify the real scene image taken in the last time to achieve continuous matching.

The geographic location of the mobile terminal may be obtained through a GPS (Global Positioning System, Global Positioning System) in the mobile terminal. After the mobile terminal obtains the real scene image and the geographic location, it sends the real scene image and the geographic location to the information processing system through the network transmission module in the mobile terminal. The network transmission module may be a wireless module or a wired module, which is not limited in this application.

Step 202: Filter the images in the preset image database according to the geographic location to obtain the image to be matched, wherein the image to be matched is an image in which the geographic location of the scene recorded in the image and the geographic location of the mobile terminal are within a preset range.

It can be understood that filtering the images in the preset image library according to the geographic location can reduce the number of matched images in subsequent image matching, thereby improving the matching efficiency. For example, it can be determined that the user is in a certain scenic spot according to the geographic location information, and then the image of the scenic spot is acquired from the preset image library as the image to be matched.

Step 203: Match the real scene image with the image to be matched.

The matching process may be: matching the first feature data of the real scene image with the second feature data of the image to be matched, and if the first feature data and the second feature data are consistent, it is determined that the match between the real scene image and the image to be matched is successful; If the first feature data is inconsistent with the second feature data, it is determined that the matching between the real scene image and the image to be matched fails. The first feature data and the second feature data may include image profile data, color data, and the like.

Step 204: If the real scene image is successfully matched with the images in the preset image library, the multimedia information of the real scene image is acquired according to the geographic location.

Step 205: Send the multimedia information to the mobile terminal, and the mobile terminal will combine and display the multimedia information and the real scene image.

Step 204 and step 205 in the embodiment of the present application are the same as step 103 and step 104 in the embodiment shown in FIG. 1 , which will not be described in this embodiment of the present application.

In addition, if the matching between the real scene image and the images in the preset image library fails, the multimedia information of the real scene image recorded by the mobile terminal is acquired. The multimedia information of the real scene image recorded by the mobile terminal may include at least one of images and videos captured by the mobile terminal, and of course may also include a text description summarized by the user for the real scene image. The multimedia information can be saved in the information database for use in subsequent image matching.

Further saving the multimedia information of the real scene images recorded by the mobile terminal into the information library can make the preset image library and information library more and more rich as time goes by, so as to realize the enhanced display of almost all real scenes. Effect.

For the aforementioned method embodiments, for the sake of simple description, they are expressed as a series of action combinations, but those skilled in the art should know that the application is not limited by the described action sequence, because according to the application, Certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions and modules involved are not necessarily required by this application.

Corresponding to the above-mentioned method embodiment, the embodiment of the present application also provides an augmented reality system, whose structural diagram is shown in FIG. 3 , which may include: a mobile terminal 1 and an information processing system 2, wherein the mobile terminal 1 includes an image acquisition module 11 , a location collection module 12, a first network transmission module 13 and a fusion module 14.

The image acquisition module 11 is used to acquire real scene images. Currently, the mobile terminal is equipped with a camera, and the image acquisition module 11 can acquire a real scene image captured by the camera, wherein the real scene image is an image of the environment where the user is located. When the user operates the mobile terminal, he often fixes the focus of the camera on a certain point he cares about. At this time, the image captured by the mobile terminal is the real scene image that the user cares about, so that you can get what you want when you shoot.

In addition, in order to achieve continuous matching, the image acquisition module 11 can also be specifically used to acquire the real scene image captured at the next time when the real scene images taken by the mobile terminal twice before and after exceed the preset threshold, and transmit it through the first network Module 13 sends.

The location acquisition module 12 is used to acquire the geographic location of the mobile terminal. The geographic location of the mobile terminal may be obtained through a GPS (Global Positioning System, Global Positioning System) in the mobile terminal. After the mobile terminal obtains the real scene image and the geographic location, it sends the real scene image and the geographic location to the information processing system through the network transmission module in the mobile terminal.

The first network transmission module 13 is configured to send the real scene image and the geographic location of the mobile terminal to the information processing system. The network transmission module may be a wireless module or a wired module, which is not limited in this application.

The fusion module 14 is configured to acquire the multimedia information of the real scene image through the first network transmission module 13, and combine the multimedia information and the real scene image for display.

The multimedia information is obtained from the information processing system and sent to the first network transmission module 13 through the second network transmission module 21 of the information processing system. The first network transmission module 13 then sends it to the fusion module 14 .

The multimedia information may include at least one of text information, picture information and video information. If the multimedia information is text information, the fusion module 14 embeds the text information in the real scene image for display. If the multimedia information is video or picture information, the fusion module 14 fuses the video or picture information into the real scene image in the form of picture-in-picture for display. Of course, if the multimedia information includes both text information and video or picture information, then the fusion module 14 embeds the text information in the real scene image for display, and integrates the video or picture information into the real scene image for display in the form of picture-in-picture .

The information processing system 2 includes: a second network transmission module 21 , an image matching module 22 and an information matching module 23 .

The second network transmission module 21 is configured to receive the real scene image and the geographic location of the mobile terminal sent by the first network transmission module 13 . At this time, the information processing system 2 acquires the real scene image captured by the mobile terminal and the geographic location of the mobile terminal.

The image recognition module 22 is configured to match the real scene image with the images in the preset image library. It is to be understood that: the matching of the real scene image with the images in the preset image library can be performed using image recognition technology, for example, by matching the first feature data of the real scene image with the second feature data of the images in the preset image library. feature data for matching, wherein the first feature data and the second feature data may include image profile data, color data, and the like.

The information matching module 23 is used for acquiring the multimedia information of the real scene image according to the geographic location when the real scene image is successfully matched with the images in the preset image database, and the multimedia information is sent through the second network transmission module 21 .

In the embodiment of the present application, the successful matching between the real scene image and the images in the preset image library means that most of the image areas of the two images are the same, and the same image areas can be represented by feature data. That is, the first feature data and the second feature data in the image area are consistent, and it is determined that the image area is the same, and then it is determined that the real scene image matches the image in the preset image library successfully, and the first feature data and the second feature data in the image area Inconsistent, it is determined that the image areas are different, and then it can be determined that the matching between the real scene image and the image in the preset image library fails.

Of course, it can also be the matching of all image areas when performing image matching. When all image areas are the same, it is determined that the real scene image matches the image in the preset image library successfully, otherwise it is determined that the real scene image and the image in the preset image library Match failed.

When the matching is successful, the multimedia information of the real scene image is obtained according to the geographic location of the mobile terminal, wherein the multimedia information can include at least one of text information, picture information and video information, and the multimedia information can be stored in the information database.

The multimedia information is sent through the second network transmission module 21 , and the first network transmission module 13 sends the multimedia information to the fusion module 14 after receiving the multimedia information. For example, the real scene image is an image of a scenic spot, and the information matching module 23 can determine the name of the scenic spot where the user is located according to the geographical location of the mobile terminal, and then obtain the multimedia information of the scenic spot from the information database, and pass the multimedia information through the second network in turn. The transmission module 21 and the first network transmission module 13 send to the fusion module 14 . The fusion module 14 simultaneously displays the multimedia information together with the real scene image in the mobile terminal, so that the user can understand the information of the scenic spot through the multimedia information.

The above-mentioned image recognition module 22 directly matches the real scene image with the images in the preset image library, which will reduce the matching efficiency due to the large number of images. To solve this problem, the embodiment of the present application also provides an augmented reality system as shown in FIG. 4 , in which the communication between the information matching module 23 and the image recognition module 22 is two-way communication. On the basis of the embodiment shown in Figure 3, the information matching module 23 is also used to filter the images in the preset image library according to the geographic location to obtain images to be matched, so as to reduce the number of matched images in subsequent image matching, thereby improving matching efficiency . The image to be matched is an image in which the geographic location of the scene recorded in the image and the geographic location of the mobile terminal are within a preset range. At this time, the image recognition module 22 is specifically used to match the real scene image with the image to be matched. That is to say, the one-way communication between the information matching module 23 and the image recognition module 22 is transformed into the two-way communication shown in FIG. 4 .

Please refer to FIG. 5, which shows another schematic structural diagram of an augmented reality system provided by an embodiment of the present application. On the basis of FIG. Multimedia information of real scene images.

The multimedia information of the real scene image recorded by the mobile terminal is sent to the second network transmission module 21 through the first network transmission module 13 . The multimedia information of the real scene image recorded by the mobile terminal may include at least one of images and videos captured by the mobile terminal, and of course may also include a text description summarized by the user for the real scene image. The multimedia information can be saved in the information database for use in subsequent image matching.

Further saving the multimedia information of the real scene images recorded by the mobile terminal into the information library can make the preset image library and information library more and more rich as time goes by, so as to realize the enhanced display of almost all real scenes. Effect.

It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. For the same and similar parts in each embodiment, refer to each other, that is, Can. As for the system embodiment, because it is basically similar to the method embodiment, the description is relatively simple, and for the related parts, please refer to the part of the description of the method embodiment.

Finally, it should also be noted that in this text, relational terms such as first and second etc. are only used to distinguish one entity or operation from another, and do not necessarily require or imply that these entities or operations, any such actual relationship or order exists. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

For the convenience of description, when describing the above devices, functions are divided into various units and described separately. Of course, when implementing the present application, the functions of each unit can be implemented in one or more pieces of software and/or hardware.

It can be known from the above description of the implementation manners that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general-purpose hardware platform. Based on this understanding, the essence of the technical solution of this application or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products can be stored in storage media, such as ROM/RAM, disk , CD, etc., including several instructions to make a computer device (which may be a personal computer, server, or network device, etc.) execute the methods described in various embodiments or some parts of the embodiments of the present application.

The above is a detailed introduction to an augmented reality method and system provided by this application. In this paper, specific examples are used to illustrate the principle and implementation of this application. The description of the above embodiment is only used to help understand the method of this application. and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of this application, there will be changes in the specific implementation and application scope. limits.

Claims (9)

1. a kind of augmented reality method, it is characterised in that include：

Obtain the geographical position of the real scene image and the mobile terminal of mobile terminal shooting；

The image in pre-set image storehouse is filtered according to the geographical position, obtain image to be matched, treated wherein described Figure seems image of the geographical position of geographical position and the mobile terminal of the recorded scene of image in preset range；

The real scene image is matched with the image in pre-set image storehouse, including：By the real scene image with The image to be matched is matched；

By the real scene image and the image in pre-set image storehouse carry out matching including：By the of the real scene image One characteristic is matched with the second feature data of the image in pre-set image storehouse, if the fisrt feature data and institute State second feature data unanimously, then judge the real scene image and the images match success in pre-set image storehouse；If institute State fisrt feature data and the second feature data are inconsistent, then in judging the real scene image and pre-set image storehouse Images match fails；The fisrt feature data and the second feature data include image profile data, color data；

The real scene image is matched with the image in pre-set image storehouse；

If the real scene image and the images match success in pre-set image storehouse, obtain institute according to the geographical position State the multimedia messages of real scene image；

The multimedia messages are sent to the mobile terminal, by the mobile terminal by multimedia messages and described true Scene image is combined and is shown.

2. method according to claim 1, it is characterised in that if in the real scene image and pre-set image storehouse Images match fails, then obtain the multimedia messages of the real scene image of the mobile terminal records.

3. method according to claim 2, it is characterised in that the real scene image that the acquisition mobile terminal shoots, Including：

In the case that the real scene image for being shot before and after the mobile terminal twice exceedes predetermined threshold value, the movement is obtained The real scene image once shot after terminal.

4. method according to claim 3, it is characterised in that the mobile terminal is by multimedia messages and described true Real scene image is combined and is shown, including：

If the multimedia messages are Word messages, the Word message are embedded in the real scene image and are shown Show；

If the multimedia messages are video or pictorial information, the video or pictorial information are merged with picture-in-picture form Show in the real scene image.

5. a kind of augmented reality system, it is characterised in that include：Mobile terminal and information processing system, wherein described mobile whole End includes image capture module, station acquisition module, first network transport module and Fusion Module；

Described image acquisition module, for obtaining real scene image；

The station acquisition module, for obtaining the geographical position of the mobile terminal；

The first network transport module, for the geographical position of the real scene image and the mobile terminal is sent to Described information processing system；

The Fusion Module, for the multimedia letter of the real scene image is obtained by the first network transport module Breath, the multimedia messages and the real scene image is combined and is shown；

Described information processing system includes：Second network transmission module, images match module and information matches module；

Second network transmission module, for receiving real scene image that the first network transport module sends and described The geographical position of mobile terminal；

Described image identification module, for the real scene image is matched with the image in pre-set image storehouse；By institute State real scene image and the image in pre-set image storehouse carry out matching including：By the fisrt feature number of the real scene image According to being matched with the second feature data of the image in pre-set image storehouse, if fisrt feature data and described second special Levy data unanimously, then judge the real scene image and the images match success in pre-set image storehouse；If described first is special Levy data and the second feature data are inconsistent, then judge the real scene image and the images match in pre-set image storehouse Failure；The fisrt feature data and the second feature data include image profile data, color data；

Described information matching module, for the successful situation of images match in the real scene image with pre-set image storehouse Under, the multimedia messages of the real scene image are obtained according to the geographical position, the multimedia messages are by described the Two network transmission modules send；Described information matching module is additionally operable to according to the geographical position in the pre-set image storehouse Image is filtered, and obtains image to be matched, wherein the image to be matched is the geographical position of the recorded scene of image and institute State image of the geographical position of mobile terminal in preset range；

Described image identification module, specifically for the real scene image is matched with the image to be matched.

6. system according to claim 5, it is characterised in that the mobile terminal also includes：Information acquisition module, is used for Obtain the multimedia messages of the real scene image of the mobile terminal records；

The first network transport module, the multimedia of the real scene image for being additionally operable to send the mobile terminal records Information；

Second network transmission module, the multimedia of the real scene image for being additionally operable to receive the mobile terminal records Information.

7. system according to claim 6, it is characterised in that by the figure in the real scene image and pre-set image storehouse Include as carrying out matching：By the second feature of the image in the fisrt feature data of the real scene image and pre-set image storehouse Data are matched, if the fisrt feature data are consistent with the second feature data, judge the real scene figure As with pre-set image storehouse in images match success；If the fisrt feature data and the second feature data are inconsistent, Then judge that the real scene image is failed with the images match in pre-set image storehouse.

8. system according to claim 7, it is characterised in that described image acquisition module, specifically in the movement In the case that the real scene image for being shot before and after terminal twice exceedes predetermined threshold value, the real scene figure once shot after acquisition Picture, and sent by the first network transport module.

9. system according to claim 8, it is characterised in that the Fusion Module specifically for：

If the multimedia messages are Word messages, the Word message are embedded in the real scene image and are shown Show；

If the multimedia messages are video or pictorial information, the video or pictorial information are merged with picture-in-picture form Show in the real scene image.