KR101568741B1 - Information System based on mobile augmented reality - Google Patents

Abstract

A mobile augmented reality based information providing system that provides contents accessible at the center of a user location and provides contents at a place away from the current location without direct movement of the user through virtual movement, An information providing server for providing contents around the current position in response to an information request according to a current position; And an information providing terminal for requesting content information while providing location information to the information providing server, and for distributing the provided content by using the road data based on the digital map to center the road, The present invention has an advantage in that information can be provided to a user more efficiently by arranging contents that can be accessed through the center of the road by displaying the contents in a center of the road, .

Description

[0001] The present invention relates to a mobile augmented reality based information providing system,

The present invention relates to a mobile augmented reality-based information providing system, and more particularly, it relates to a mobile augmented reality-based information providing system in which content accessible at the center of a user's location is provided centered on a road, The present invention relates to a mobile Augmented Reality-based information providing system capable of providing content of a place.

Recently, with the spread of smart phones and the development of wireless communication technology, the mobile industry is shifting from voice communication to data communication. As a result, mobile users can access the Internet anytime and anywhere, search for desired contents through specific keywords, and acquire various types of contents such as text, images, and moving images. However, it is difficult for a user in an unfamiliar place to acquire information about a place and a building around him through the above search. It is difficult to search for desired information if there is no knowledge required to search for information such as keywords or nearby building names that can represent their own locations. For users in this situation, location-based services are used which provide contents around the user's own location.

Based on the location information obtained through the mobile communication network or GPS, the location-based service provides the user with living information such as location of people and vehicles, weather at a specific place, traffic information around the user, department store, restaurant, (See Non-Patent Document 5). This information has been provided to the user through a map or text information providing method. Recently, augmented reality technology, which provides information intuitively using various sensors attached to mobile devices, has been utilized in some location-based services .

Augmented reality technology refers to a technology that adds virtual objects to the real world illuminated by a camera. These technologies enable users to simulate 3D objects through difficult or expensive operations that are physically difficult to implement, and simultaneously provide contents related to the images of the real world inputted by the camera, thereby enabling users to use more realistic services . It is utilized in various fields such as medical care, architecture, education, marketing, etc., and it fully utilizes various sensors of high performance devices for precisely combining virtual information with real world and expressing more realistic information, And the like. However, in order to provide user-centric information in the location-based service, the focus is on providing the location information of the content, not the representation of the processed 3D object. By using the sensor attached to the mobile device, And searches and displays the contents present in the surroundings in real time.

However, due to the rapid increase in the number of contents in recent years, some problems have arisen that are inefficient in acquiring user information. For example, when the contents are concentrated in a specific area, overlapping phenomenon occurs in which a plurality of contents are arranged in a specific part of the terminal screen and overlap each other. In this case, the user has difficulty in discriminating the desired information. Also, there is a case in which the content is displayed on an obstacle such as a wall that the user can not move, and the user is somewhat lacking in information in order to determine the actual movement route to the content. In other words, information related to actual user mobility is not considered in the service.

This problem mainly occurs because the contents present within a certain range around the user are represented using only the location and sensor information in order to provide information. In the system, distance and direction between user and contents are calculated using only two pieces of information, and contents are arranged on the mobile screen accordingly. Therefore, if there are a large number of contents in a dense region, an overlap occurs in a specific portion of the mobile screen, and there is a lack of information about the user's surroundings, thereby providing information considering an object that restricts the movement of an actual user This is difficult.

On the other hand, the augmented reality is a technology that shows virtual objects overlapping one another in the real world coming in as a camera image, and has started as a field of virtual reality. These augmented reality technologies have been used with the initial HMD and hardware with various sensors attached. However, mobile augmented reality has emerged as an augmented reality system with mobility as the technology of mobile devices has recently been developed.

In contrast to the conventional mobile augmented reality technology, which focuses on the representation of 3D virtual objects in the past and the synthesis of real-time video, recent mobile augmented reality systems use a variety of sensor information such as location information and angle Has evolved into a form of an augmented information service that focuses on combining with Internet services and providing them in the form of enhanced interfaces (see Non-Patent Document 1).

In addition, the augmented reality tracking technology refers to a technology for finding an object to which a virtual image or tag information is to be attached in a real world image coming from a camera (see Non-Patent Document 4). These kinds of tracking technology are divided into sensor based, vision based, and hybrid based. Sensor-based tracking technology is a technology that precisely tracks the position, motion, speed, and direction of objects such as GPS, digital compass, and acceleration sensor. Vision-based tracking technology uses markers, non-marker recognition, , Image matching based method. Hybrid tracking technology is a combination of sensor-based and vision-based tracking technologies.

Most of the recently used smart augmented mobile augmented reality services such as Layar and ScanSearch utilize sensor based tracking technology and have been expanded to utilize non - marker based vision based tracking technology as terminal performance improves.

In a location - based service, mobile augmented reality technology is useful for users to intuitively recognize information. The surrounding contents are provided according to the location of the user using the camera and the internal position and direction sensors of the mobile device. Typical examples of services include ScanSearch and OVJET. These services, also called augmented reality-based mobile search applications, provide content such as shops, weather, music, movies, and so on at the user's location.

As shown in FIG. 1, ScanSearch is a mobile augmented reality-based location information providing service capable of searching various information about an object by shining or photographing (refer to non-patent document 2). ScanSearch allows the user to select a topic of interest directly to provide the desired content around the user.

As shown in FIG. 2, OVJET is a location-based augmented reality application (see Non-Patent Document 1). The GPS sensor of the smartphone is used to identify the current location of the user and the location of the real world objects displayed by the smartphone camera, and provides additional information about the object. In particular, it is characterized by enabling online exchange among users who use OVJET in combination with the Social Network Services (SNS) function (see Non-Patent Document 3).

Jeon Jongheung; Lee Seungyun, 2011, "Standardization Trends of Mobile Augmented Reality Technology", Electronics and Telecommunications Trends, Vol. 26, No. 4, pp. 33-45 ScanSearch, http://scan.sc OVJET, http://ovjet.com Zhou, F., H. B.-L. Duh, and M. Billinghurst, 2008, "Trends in augmented reality tracking, teraction and display: A review of ten years of ISMAR", IEEE / ACM Int. Symposiumon Mixed and Augmented Reality, pp.193-202. Ronald T. Azuma, 1997, "A Survey of Augmented Reality", Teleoperators and Virtual Environments 6, 4, pp. 355-385

However, the above conventional techniques have the following problems.

For example, in a mobile AR system, contents around a user are provided to a user in accordance with a real-world image input by a camera. In order to provide such information, the mobile device calculates sensor information obtained from the mounted GPS and geomagnetic sensor with location information of the content, and acquires the relative direction and distance information of the content from the user. This information determines the content location of the mobile screen, and the position of the content changes according to the change of the sensor information according to the user's movement. Through this process, users can acquire intuitive and realistic information. However, this information providing method may cause confusion when acquiring user information. In the location based mobile augmented reality service, it is necessary to transmit accurate information at an early time due to characteristics of a mobile device having portability, mobility, and promptness. However, it is difficult for the user to recognize the correct information by only having two pieces of information, that is, the location and the direction, which determine the retrieval and display of the contents. Here is an example of this problem:

First, an overlap phenomenon occurs between contents as shown in FIG. Due to the limited size of the mobile device, there is a limit to displaying a large number of contents on the screen. Each content in the terminal screen occupies a certain rate of space, and if there is a large number of contents in a specific area even if the icon size is changed according to the distance, the user has difficulty in finding or selecting a desired one of the overlapped contents .

Second, as shown in FIG. 4, there is a disadvantage that the mobility of the user is not considered. Here, mobility refers to whether the user can move to the place where the actual content is located. Although the content exists on the terminal screen, the real world displayed to the user may be a dead end that the user can not actually walk on, or may move in another direction that is not related to the content when moving. This is because the environment around the user is not reflected in providing information. Therefore, the user uses the map to determine the surrounding environment and the location of the user, and determines the travel route.

Third, a large number of contents are provided, and it is easy to be confused with a user searching for desired contents. The user shines the camera in various directions to search for the content located in the vicinity of the user. At this time, many contents may exist on the terminal screen. Since the terminal displays an icon on the screen only with the GPS coordinates of the user and the contents, when there are a plurality of contents, the user is disturbed from the contents that do not meet his / her needs.

The reason for these problems is that the sensor-based service only determines the display method of the contents by calculating the position information of the user and the GPS of the contents to be provided. The calculation of GPS information alone can only obtain the relative distance between two objects and the orientation information of another object in a specific object. Therefore, contents existing in a similar direction from the user can have the same direction information and different distance information. When the contents existing in the same direction are displayed using the distance, the height of the contents image of the terminal screen is used, but in this case also, an overlap phenomenon occurs between contents when the number of contents is large.

Therefore, in order to solve such a problem in some services, the user may directly select a category to limit the content to be provided, or select representative content among the contents displayed on the screen and provide the selected content to the user. However, in such a system, when the purpose of the user is not clear, the efficiency of providing information in category selection becomes low, and in the case where the information desired by the user is not included in the representative set, .

An object of the present invention is to solve all the problems of the related art as described above, and it is an object of the present invention to provide a mobile augmented reality-based And to provide an information providing system.

Another object of the present invention is to provide an information providing system based on a mobile augmented reality, which can provide contents at a place away from a current location without a user's direct movement through virtual movement.

It is still another object of the present invention to provide a mobile Augmented Reality-based information providing system that ensures the mobility of an actual user and provides information in consideration of the surrounding environment by utilizing road data extracted from a digital map.

According to an aspect of the present invention, there is provided an information providing system based on a mobile augmented reality, the information providing server providing surrounding contents in response to an information request according to a current location; And an information providing terminal for requesting contents information while providing location information to the information providing server and classifying the provided contents by using the road data based on the digital map and arranging the contents based on the road.

The information providing terminal includes a road selection unit for selecting a road through matching between a road in a real space and a virtual road in the center of the screen based on an azimuth angle.

In the above road selection, the position of the user is confirmed, the intersection coordinates nearest to the user are searched, the coordinates of the middle point of the roads connected to the intersection are selected, and the azimuth sensor and the selected coordinates Is determined using the following equation.

The information providing terminal includes a content classifying unit for acquiring position information through a GPS module and extracting only the contents within a predetermined range of the road data based on the obtained position information.

Wherein the content classification unit classifies the extracted content within the predetermined range according to the adjacent roads.

The content classification unit determines the closest coordinates by calculating the coordinates of the edges of the road connecting the intersections of the real space with the coordinates of the respective contents. Then, the content classification unit determines the closest coordinates by using the location information of the acquired contents and the road data, The shortest distance to move to the content is calculated to classify the content.

The information providing terminal includes a virtual movement position recognizing unit that recognizes the position as a virtual movement position when a user drags on the screen.

The contents arrangement unit arranges the contents according to the distance on the basis of the virtual road displayed on the screen and displays the contents of the virtual movement position when the virtual movement position is recognized by the virtual movement position recognition unit, And the content is provided.

In this case, the content arrangement unit extracts only the content for the road from the location-based content provided by the information providing server, and then extracts the extracted content using the road data based on the digital map, And displays it.

According to the present invention, there is an advantage that information that can be accessed at the center of a user's location is displayed centered on a road, thereby providing more efficient information to a user.

In addition, according to the present invention, it is possible to provide contents at a place away from the current position without moving the user directly through the virtual movement.

In addition, according to the present invention, there is an advantage in that overlapping of contents can be solved by arranging accessible contents using road data indicating the possibility of movement of a user, around the road.

FIG. 1 is an exemplary screen for providing contents through a ScanSearch function,
FIG. 2 is an exemplary screen for providing contents through the conventional OVJET function,
FIG. 3 illustrates an example of a problem screen in which contents are overlapped on a screen when providing information according to the related art,
4 is an exemplary screen for explaining that the mobility of the conventional user is limited;
FIG. 5 is a schematic configuration diagram of a mobile AR system based information providing system according to a preferred embodiment of the present invention;
FIG. 6 is a block diagram of an embodiment of the information providing terminal of FIG. 5;
FIG. 7 is a block diagram of an embodiment of the control unit of FIG.
FIG. 8 is a view showing an example of a content classification screen using road information in the present invention,
FIG. 9 is an exemplary content classification example of the present invention,
FIG. 10 is a diagram showing an example of road selection and contents display on a selected road in the present invention,
11 is an exemplary view of content displayed on a terminal screen in the present invention.

Hereinafter, a mobile Augmented Reality-based information providing system according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 5 is a block diagram of a mobile Augmented Reality-based information providing system according to a preferred embodiment of the present invention.

5, the mobile augmented reality-based information providing system according to the present invention includes an information providing terminal 100, a database 200, and an information providing server 300.

The database 200 stores content to be provided to the user. Here, the content is information displayed on the screen around the road when the user requests it, and means information such as a shop, a cafe, a clothing store, and the like.

The information providing server 200 is connected to the information providing terminal 100 through a network and searches the database 200 based on the location information transmitted from the information providing terminal 100, And provides it to the information providing terminal 100. It is preferable that the information providing server 200 is implemented by a normal server class computer.

The information providing terminal 100 requests content information while providing location information to the information providing server 200, and distributes the received content using the road data based on the digital map to center the road . The information providing terminal 100 refers to a terminal such as a smart phone, a personal information terminal, and the like carried by a user.

6, the information providing terminal 100 includes a camera 110 for photographing, an image processing unit 120 for processing an image photographed by the camera 110, A GPS module 130 for receiving GPS information, an azimuth sensor 140 for obtaining direction information (view information), content information requesting the location information transmission to the information providing server 200, Extracts the road data based on the current position of the user, selects a road to be moved based on the current position of the user, and extracts the content corresponding to the road and arranges the extracted road based on the road. The information providing terminal 100 includes an operation unit 160 for inputting content display information to the control unit 150 in response to a user's operation and dragging the content providing screen to input virtual movement position information, A display unit 170 for displaying contents within a certain range around the road selected by the user under the control of the control unit 150, a storage unit 180 for storing information such as contents information and digital map provided from the information providing server 200 ) For communicating with the information providing server 200 through the network under control of the controller 150 to transmit the positional information and transmitting the content transmitted from the information providing server 200 to the controller 150 Module 190, as shown in FIG.

7, the control unit 150 includes an image receiving unit 151 for receiving the image processed by the image processing unit 120, and a control unit 150 for controlling the control unit 150 based on the azimuth angle transmitted from the azimuth sensor 140 A position information detector 152 for detecting position information from the GPS information transmitted through the GPS module 130, a position information detector 152 for detecting position information of the user through the manipulator 160, And a virtual movement position recognizing unit 154 for recognizing the information as a virtual movement position. Here, the field of view information is a direction in which the camera of the terminal looks, and refers to a direction in which an actual user looks.

In addition, the controller 150 checks the position of the user, searches the intersection coordinates closest to the user, selects the coordinates of the midpoint between the roads connected to the intersection, and determines which road the user is looking at, And a road selection unit 155 that determines the road using the selected coordinates.

The control unit 150 further includes a road data extraction unit 156 that extracts road data for the selected road from the digital map.

In addition, the controller 150 acquires positional information through the GPS module and extracts only a content within a certain range based on the road data extracted by the road data extractor 156, (157).

The content classification unit 157 determines edge coordinates of the road connecting the intersection of the real space with the coordinates of the contents to determine the closest coordinates, The shortest distance from the location to the actual content is calculated.

The control unit 150 extracts only the content for the road from the location-based content provided from the information providing server 200, and transmits the road data based on the digital map, And a content arrangement unit 158 for arranging and displaying the extracted content.

The content arrangement unit 158 arranges contents based on the distance on the basis of the virtual road displayed on the screen, and when the virtual movement position is recognized by the virtual movement position recognition unit 154, To provide content for virtual movement.

The operation of the mobile augmented reality-based information providing system according to the present invention will be described in detail as follows.

First, a user carrying the information providing terminal 100 selects an information providing function through the operation unit 160 and illuminates a part where information is required through the camera 110, in order to check information of a surrounding area at an arbitrary position. For example, a user in an unfamiliar location and location may say, "What's going on here?", "What are the restaurants around?" And the like. In this case, when the user uses the mobile device to illuminate the surrounding road, the mobile provides information related to the road to the user. The provided information is displayed on the screen based on virtual roads displayed on the terminal, and the user acquires the information of the contents through the touch operation and moves his / her position to an arbitrary point on the road to acquire additional information.

Generally, a variety of tracking techniques are used to search for content in augmented reality services, but sensor based tracking technology is used in mobile augmented reality services. By using the sensor attached to the mobile device, the user is able to grasp the position information of the user and the azimuth information from the user to the content located in the surrounding area, thereby searching for the direction in which the content is located. Thus, if the content exists in the direction in which the user is looking, it is displayed corresponding to a given position of the camera image. In this case, there arises a problem that the content is displayed in a superimposed manner or the content is displayed in a position where the actual user can not go.

In order to solve such a problem, the present invention uses road data around a user as an element of a content search process. In reality, roads in real space are movable objects. This road is used as a reference for classifying contents in the present invention. It is possible to distinguish contents having high relevance to the road by using the location information of the contents and the road data. This content is determined by the distance calculation of the GPS coordinates, and the details thereof will be described later. Then, the user 's location information is further utilized to apply to the shortest path algorithm, so that the user can know the route to the content. Through such a process, it is possible to provide information that discriminates only the contents existing on the moving path of the actual user. By using the road as an element of the augmented reality tracking technology, it is possible to provide more efficient information in terms of the mobility of the road and the use of objects existing in the real space.

We have mentioned that there is a limit to finding the necessary information with only the relative location information of users and contents. The contents existing in the direction that the user is looking at are all displayed on the terminal screen without any specific constraints and the information about the actual movement of the user is not considered. However, further utilization of roads is a more specific search condition when searching for information. The act of the user illuminating the surrounding roads with the camera is an information request for one of the few candidates that are actually movable. The information obtained by this operation helps determine the direction of the action after obtaining the user's information.

The image photographed by the camera 110 is processed by the image processor 120 and then transmitted to the controller 150. At this time, GPS information through the GPS module 130 and azimuth angle information by the azimuth sensor 140 are also input to the controller 150.

The image receiving unit 151 of the control unit 150 receives the photographed image processed by the image processing unit 120 and the position information detecting unit 152 detects the current position information from the inputted GPS information.

In addition, the control unit 150 transmits neighboring content request information including current location information to the information providing server 300 through the communication module 190.

The information providing server 300 searches the database 200 according to the peripheral content information request, searches for a user's peripheral content within a certain range based on the user location, and transmits the retrieved user peripheral content information to the information providing terminal 100 ).

The view information acquiring unit 153 of the controller 150 of the information providing terminal 150 uses the azimuth angle and the road center line coordinates calculated based on the photographed image and the location information so that the photographing direction of the camera coincides with the direction of the virtual road .

In the present invention, the azimuth angle is recognized as 0 ° when looking north from the user's location, and increasing to 360 ° when rotating to the right, Coordinates.

Through this process, the direction of the camera, that is, the direction of the user's view, is determined.

When the direction of the user's field of view is determined, the road selection unit 155 confirms the location of the user, searches for the closest road coordinate to the user, selects the coordinates of the midpoint between the roads connected to the road, Is determined by using the azimuth sensor and the selected coordinates.

The road data extracting unit 156 extracts road data for the road selected by the road selecting unit 155 from the digital map.

Here, the road data refers to coordinates of the road center line to which the user can move, and is made up of GPS coordinates. Numerical maps contain various information such as topographical features and earthquakes in the real world. In this digital map, there are also information on the roads between the intersections and the intersections existing in the real world. Therefore, in the present invention, such location information is processed according to the system.

The composition of the road data consists of the detailed coordinates of the vertices representing the intersection roads and the end of the roads and the edges joining them. The distance between the two vertices and the connection information through the edge are also included so that the user can determine the road and the intersection according to the location of the user and utilize it in the classification process of the contents.

The road data is coordinate information of a road extracted from a digital map. These road data are extracted from coordinates on the digital map, and the end points of roads or roads connecting a plurality of roads are designated as vertexes for use in the present invention, and the edges between the vertices are divided into 3m intervals Specify detailed coordinates to use. This data is used to identify the nearest road of the contents. It is also used to select the closest path to the user and to obtain information on the connected roads.

Next, when the road data is extracted, the content classification unit 157 classifies the contents using the road information.

The content classifying unit 157 classifies the contents located around the user in accordance with the adjacent roads. To do this, as shown in FIG. 8, after confirming the user's position, contents and road data within a certain range are acquired around the position.

Thereafter, each content is classified according to the adjacent roads. This process is determined by the content and GPS of the road. The edge coordinates of the road connecting the intersections of the real space are respectively calculated with the coordinates of the contents to determine the closest coordinates. The shortest distance from the user's location to the actual content is calculated using the location information of the acquired contents and the road data. In this process, Dijkstra's algorithm is applied to calculate the shortest distance. By applying an algorithm to contents within a certain range around the user, a movement path for each content can be obtained. Here, a certain range may be set by the user, or may be set in advance such as 50M, 100M, 200M, and 300M. Through this, it is possible to distinguish the contents that can be acquired when the user selects one road. That is, it classifies the content that passes through the road selected by the user in each algorithm result. FIG. 9 illustrates contents classified on the road selected by the user.

In this way, it is possible to provide the user with the content information that is guaranteed to be mobility to the actual user by utilizing the road data to the existing service using only the GPS coordinates and the azimuth sensor. In the existing service, various contents are displayed on the screen of the mobile device. However, in order to move the actual user, it is necessary to check the road that the user should actually use by using the map. However, by utilizing the road data, the user has an advantage that, when the desired content is displayed on the screen, the user can move along the road.

Next, the content arrangement unit 158 arranges the content classified by the content classification unit 157 on the selected road, and displays it on the screen.

Here, in the road selection process, the roads in the real space are matched with the virtual roads located at the center of the screen of the information providing terminal 100. The matching process is calculated by the azimuth sensor value in the information providing terminal 100. A virtual road that does not move is displayed on the screen of the information providing terminal 100 and the road is selected by matching the virtual road with the road in the actual space. When the road is selected, contents classified according to the road in the previous step are arranged on the screen and provided.

In order to accomplish this, after confirming the location of the user, the roads around the user are determined. After confirming the location of the user, the coordinates of the nearest neighboring road are searched. Then, the coordinates of the middle point of the roads connected to the intersection are selected, and the user determines which road is viewed by using the azimuth sensor and the selected coordinates.

FIG. 10 shows virtual roads on the screen for more intuitive road selection to the actual user. The user selects the road by matching the virtual road shown on the screen with the road existing in the real world.

For example, in the present mobile augmented reality service, the surrounding contents are searched and displayed in response to the user's minute movement by using the image and the sensor value obtained in real time. In such an operation, since there is no restriction on the user's behavior in the content search, there is a somewhat unnecessary search result. Specifically, the user can obtain search results for various directions from 0 ° to 360 ° based on the north, and in such a case, the content placed on the mobile screen is mostly displayed on the obstacle that the actual user is unable to move .

However, in the present invention, a virtual road is created at the center of the mobile screen, and the desired information is obtained by matching the road with the road of the camera image taken by the user. By arranging the contents obtained by such a search based on virtual roads, more detailed information such as 'There is a ○○ beside a road' and 'You can go to ○○ if you follow this road' can be obtained. Furthermore, by arranging the contents in the order of contents from the bottom to the bottom of the virtual road, the contents existing in the same direction from the user can be displayed without overlap. Furthermore, since the above method is constructed based on road data, the user can select an arbitrary point on the road selected by himself / herself by manipulating the terminal screen, and by utilizing the same, There is an advantage of movement.

This will be described in more detail as follows.

In the process of outputting the contents to the screen, the icon arrangement based on the road is used. According to the present invention, contents are arranged according to distances on the basis of virtual roads of a mobile device screen, and contents at distant locations can be confirmed through a user's operation. This can give the user a virtual moving effect, and the same effect as an actual moving along the path.

In a typical mobile augmented reality service, the virtual objects displayed on the screen use the image processing of the camera screen or determine the location of the information to be provided using the sensor. Thus, as the user rotates or moves the mobile device, the position of the object displayed on the screen changes in real time. In the case of services for displaying peripheral contents on a terminal using image processing, it is most common to set an arbitrary specific marker and display the contents at that position. In this case, the user only has to obtain additional information about a specific object actually visible at his location. On the other hand, in a service based on a sensor, if there are a plurality of contents in one direction at a user location, an overlap phenomenon occurs between the contents.

In the present invention, an image displayed on a terminal screen is determined according to a road related to a user. When various contents are located in the same direction from the user, the contents are arranged according to the distance based on the virtual road displayed on the screen. By using such a display method, it is possible to prevent an overlap phenomenon between contents.

Then, the user can acquire additional information by moving the user's position to an arbitrary point on the road through a simple operation.

For example, when the user touches a specific location on the screen or selects a specific location by dragging the screen, the virtual location recognizing unit 154 recognizes the location and transmits the recognized location to the road data extracting unit 156 do.

The road data extraction unit 156 extracts the road data at the corresponding position, and the content classification unit 157 classifies the contents corresponding to the extracted road. By arranging the contents classified on the road extracted by the content arrangement unit 158 according to the distance, the user does not move the actual distance but moves to the corresponding position and performs virtual movement such as viewing the contents of the corresponding position, .

Although the present invention has been described in detail with reference to the above embodiments, it is needless to say that the present invention is not limited to the above-described embodiments, and various modifications may be made without departing from the spirit of the present invention.

100: Information providing terminal
130: GPS module
140: azimuth sensor
150:
152: Position information detector
153: vision information acquiring unit
155: Road selection unit
156: road data extracting unit
157:
158: Content arrangement unit
200: Information providing server
300: Database

Claims (12)

In a mobile Augmented Reality-based information providing system,
An information providing server for providing contents around the current position in response to an information request according to a current position;
A content classification unit for requesting contents information while providing location information obtained through the GPS module to the information providing server and extracting only contents within a certain range on the basis of the road data based on the digital map on the basis of the acquired location information And an information providing terminal for classifying the contents provided through the unit and arranging the contents using a contents arrangement unit for arranging contents according to distances on the basis of virtual roads displayed on the screen,
The information providing terminal includes a road selecting unit for selecting a road through matching between a road in a real space and a virtual road located at the center of the screen based on an azimuth angle and a road data extracting unit for extracting road data from a digital map,
Wherein the content arrangement unit arranges the contents in the order of contents from the bottom to the bottom of the virtual road, displays the contents existing in the same direction from the user without overlap,
The selection of the road is performed by checking the position of the user, searching the intersection coordinates closest to the user, selecting the coordinates of the midpoint between the roads connected to the intersection, , ≪ / RTI >
Wherein the road data includes detailed coordinates of a vertex indicating an end of a road and a road and edges joining the vertices, and includes distance between two vertices and connection information through an edge.
delete delete delete delete delete 2. The system as claimed in claim 1, wherein the content classification unit classifies the extracted content in a predetermined range according to an adjacent road.
The content classification unit of claim 7, wherein the content classification unit calculates edge coordinates of the road connecting the intersection of the real space with each of the coordinates of the contents to determine the closest coordinates, Wherein the shortest distance to the actual content is calculated to extract only the content within a certain range.
The information providing system of claim 1, wherein the information providing terminal includes a virtual moving location recognizing unit that recognizes the location as a virtual moving location when a user drags on the screen.
The information providing terminal according to claim 9, wherein when the virtual moving position is recognized by the virtual moving position recognizing unit, the information providing terminal displays content for the virtual moving position and provides content for virtual moving Information providing system.
[Claim 10] The system of claim 10, wherein the content arrangement unit extracts only the content for the road from the location-based content provided by the information providing server, And displaying the contents by displaying the contents of the mobile Augmented Reality.


delete

Images