KR20260012040A - System Providing Tour and Related Service Based on Mixed Reality - Google Patents

Abstract

A mixed reality tour service providing system according to one aspect of the present invention is a mixed reality tour service providing system (10) that provides a tour service using mixed reality to a user terminal that is connected online and used by a user, comprising: an image loading unit (12) that loads one real-world image from a series of real-world images to correspond to a user spot where a user is virtually located; and an overlay unit (14) that displays a guide avatar, which is an avatar of a guide, on the real-world image loaded by the image loading unit (12) to generate a composite image, and displays the guide avatar on the guide spot where the guide is virtually located; characterized in that the composite image is provided to the user terminal (20).

Description

System Providing Tour and Related Service Based on Mixed Reality

The present invention relates to a system for providing a tour service based on mixed reality and a system for restoring lost national heritage through augmented reality, providing a notification service for national heritage existing around the user, and providing religious events.

Several technologies are known to provide travel guides based on the metaverse.

The technology of Patent Document 1 relates to a metaverse platform system for local tourism, and includes a metaverse server that implements a target region as a three-dimensional virtual space and provides a local tourism metaverse world that a user's avatar can enter and use, wherein the local tourism metaverse world includes virtual tourist destinations, virtual shops, and virtual cultural properties that implement tourist destinations of the target region, shops within the tourist destination streets, and cultural properties in three-dimensional virtual reality, respectively.

The technology of Patent Document 2 is a method for providing a travel service performed by a processor of a server, comprising: a step of storing information on a plurality of travel locations and a metaverse environment; a step of providing a metaverse environment for the travel locations to a user; a step of setting a travel area within the metaverse environment based on one or more travel destination preference information received from a user terminal; a step of assigning a mission to the user within the metaverse environment; and a step of maintaining or changing the travel area within the metaverse environment based on the mission result when it is detected that the user has performed the mission.

The technology of Patent Document 3 relates to a metaverse-based travel guide service providing device that provides a personalized, real-time, one-on-one travel guide service based on a metaverse environment to actual travelers, thereby providing sufficient information on travel itineraries and destinations, and enabling assistance in unexpected situations. The traveler's terminal collects sounds, voices, and environmental images of the surroundings (or travel destination) through a camera, speaker, etc., and outputs a screen implemented in the metaverse environment based on the collected information. The device communicates with a server.

However, in technologies such as patent documents 1 and 2, travel locations are implemented using graphic images, and since they are virtual spaces that are far removed from actual travel destinations, there is a problem that user interest is low and the sense of reality is low.

In addition, the technology of patent document 3 has the problem that it is not suitable for purposes such as experiencing a travel destination remotely, as it is a service that can only be received by the user when visiting the actual travel destination.

1. Korean Patent Publication No. 10-2024-0088396 2. Korean Patent Publication No. 10-2652780 3. Korean Patent Publication No. 10-2024-0043413

The purpose of the present invention is to provide a system capable of providing a highly realistic virtual tour service even in a remote location.

The purpose of the present invention is not limited to the above, and other purposes of the present invention will be added and made clear through the description of specific contents for carrying out the present invention.

A mixed reality tour service providing system according to one aspect of the present invention is a mixed reality tour service providing system that provides a tour service using mixed reality to a user terminal that is connected online and used by a user, the mixed reality tour service providing system including: an image loading unit that loads one real-world image from a series of real-world images to correspond to a user spot where a user is virtually located; and an overlay unit that displays a guide avatar, which is an avatar of a guide, on the real-world image loaded by the image loading unit to generate a composite image, and displays the guide avatar on a guide spot where a guide is virtually located; and is characterized in that the composite image is provided to the user terminal.

In the above-described mixed reality tour service providing system, a guide audio providing unit may further be included that receives real-time voice including the guide's explanation from a guide terminal, which is a terminal used by the guide, and provides the same to the user terminal.

In the above-described mixed reality tour service providing system, the overlay unit can further display a path image indicating a path that the user can proceed on top of the real-life image blown by the image loading unit.

In the above-described mixed reality tour service providing system, the overlay unit displays a user avatar, which is a user avatar, on a real-life image blown by the image loading unit, and can display the user's shadow centered on a user spot where the user is virtually located.

In the above-described mixed reality tour service providing system, a user tracking unit may further be included that receives a movement command for moving the user spot from a guide terminal used by a guide or the user terminal, or a rotation command for changing the angle viewed from the user spot, and provides the command to the image loading unit to determine an image to be loaded.

In the above-described mixed reality tour service providing system, when the user tracking unit receives a movement command to move the user spot from the guide terminal, it can move the user spots of all users participating in the tour together. In the above-described mixed reality tour service providing system,

The above overlay unit can display a restored image of a lost cultural asset by overlaying it on the actual image blown by the image loading unit according to a selection command from the user terminal.

In the above-described mixed reality tour service providing system, the overlay unit further displays a content icon on the real-life image blown by the image loading unit, and when the user terminal clicks on the content icon, an image, video or data stored matching the content icon can be provided to the user terminal.

In the above-described mixed reality tour service providing system, the location of the user terminal is received from the user terminal, the existence of a national heritage around the location of the user terminal is notified, and map information displaying the national heritage around the location of the user terminal on a map can be provided.

In the above-described mixed reality tour service providing system, the location of the user terminal is received from the user terminal, and when the user is at a specific location of a national heritage site, a menu or icon that can confirm a visit is activated, and map information displaying the national heritage site that the user has confirmed to have visited can be provided on a map.

In the above-described mixed reality tour service providing system, a religious metaverse unit is further included that generates a three-dimensional graphic image simulating at least an altar of a temple, church or cathedral and provides the image to the user terminal; wherein the religious metaverse unit can provide an image simulating a situation of placing a virtual candle, lantern, flower, roof tile or offering on the three-dimensional graphic image in response to a command from the user terminal.

According to the mixed reality tour service providing system of the present invention, not only are real images of national heritage provided to the user, but the user can also view the real images from a desired angle while moving along the route, so the user has the advantage of being able to enjoy a highly realistic tour even from a remote location.

The mixed reality tour service system of the present invention offers the advantage of enabling a highly realistic tour, as visitors can view real-time images of national heritage sites while navigating the route, while also receiving immersive, real-time explanations from a live guide. The mixed reality tour service system of the present invention offers the advantage of doubling the sense of realism and presence by combining a series of real-time images with real-time explanations from a human guide.

According to the mixed reality tour service providing system of the present invention, it provides realistic information on national heritage through a national heritage tour using a guide, restores lost national heritage through augmented reality to enable confirmation, and provides a notification service for national heritage existing around the user, thereby expanding opportunities to experience national heritage and enriching content related to national heritage.

According to the mixed reality tour service provision system of the present invention, there is an advantage in that, in cases where a person is physically uncomfortable or cannot visit a national heritage site in person due to time constraints, he or she can have an experience similar to seeing it with his or her own eyes without having to visit the site, thereby increasing accessibility to the national heritage site and providing an experience similar to actually visiting the site.

According to the mixed reality tour service provision system of the present invention, it is easy to acquire quality information about national heritage by utilizing a professional guide, it increases satisfaction with the tour, and it has the advantage of easily overcoming language barriers through real-time machine translation.

According to the mixed reality tour service providing system of the present invention, a space is provided in which offerings, memorial services, and enshrinement of ancestral tablets can be made in temples/churches/cathedrals, etc., and prayers can be made within mixed reality and the metaverse, so there is an advantage in that offerings and prayers can be made anytime and anywhere through virtual space, and the on-site situation can be confirmed.

Figure 1 illustrates the overall configuration for providing the mixed reality tour service of the present invention.
Figure 2 illustrates the detailed configuration of a mixed reality tour service provision system (server).
FIG. 3 illustrates a scene of a virtual tour service provided by a server to a user terminal in a mixed reality tour service providing system according to one embodiment of the present invention.

The present invention utilizes virtual worlds, photos, videos, and information from different periods based on mixed reality so that users interested in national heritage and religious facilities (temples, churches, cathedrals, etc.) can feel as if they are visiting them in person, provides realistic information on national heritage through a national heritage tour using a guide, restores lost national heritage through augmented reality so that it can be confirmed, provides a notification service for national heritage existing around the user, and enables religious events such as candlelight prayers at temples.

For those who are unable to visit national heritage sites in person due to physical limitations or time constraints, accessibility is improved by providing information on national heritage sites across the country or around the world using mixed reality, so that they can experience seeing them with their own eyes without having to visit the site. In addition, real-life objects can be realized through photos and videos, allowing for an experience similar to seeing them in person.

Recently, the number of users who utilize professional guides to acquire quality information rather than simply viewing national heritage sites has been increasing. Satisfaction with guided tours has been so high that professional guides catering to Koreans are now available not only in Korea but also at famous historical sites abroad.

However, if time is limited or it is difficult to visit in person, you can experience it indirectly through media such as TV or YouTube. However, this has the disadvantage of facing the problem of one-way information transmission and the limitation of lacking a sense of reality.

To address this issue, mixed reality and other tools were utilized, allowing the guide to group users and proactively move them from the starting point to the transit point and destination, allowing them to confirm the route. Furthermore, the guide enhanced the sense of realism by providing materials (photos, videos, VR, etc.) to illustrate the destination or journey. Users with questions could post questions in a group chatroom created at the start of the guide, and the guide would respond in real time, using their own voice, thereby fostering two-way communication.

Figure 1 illustrates the overall configuration for providing the mixed reality tour service of the present invention. Figure 2 illustrates the detailed configuration of the server (mixed reality tour service provision system).

A user terminal (20) is a terminal used by a user, such as a smartphone, tablet, or computer. The user terminal (20) is connected to a mixed reality tour service provision system (10) (hereinafter also simply referred to as a "server") via a network and can transmit and receive various commands and information with the tour service provision system (10).

The guide terminal (30) is a terminal used by the guide, such as a smartphone, tablet, or computer. The guide terminal (30) is connected to the mixed reality tour service provision system (10) via a network and can transmit and receive various commands and information with the tour service provision system (10).

A dedicated application for receiving the tour service of the present invention may be installed on the user terminal (20) and guide terminal (30).

The tour service provision system (server) (10) is a computer server connected to a network and equipped with a storage device and a processor, and is a core element for providing the tour service of the present invention. The server (10) is configured to include a database (19), a membership registration section (11), an image loading section (12), a guide tracking section (13), an overlay section (14), a user tracking section (15), a transmission/reception section (16), an audio provision section (17), a content provision section (18), a user interaction section (1), an augmented reality section (2), a notification service section (3), a visit confirmation section (4), and a religious metaverse section (5).

The database (19), membership registration section (11), image loading section (12), guide tracking section (13), overlay section (14), user tracking section (15), transmission/reception section (16), audio provision section (17), content provision section (18), user interaction section (1), augmented reality section (2), notification service section (3), visit confirmation section (4), and religious metaverse section (5) may be physically divided hardware, but are preferably implemented as each functional block of software running on the server, and a detailed description of each functional block will become clear from the description below explaining the operation of the server (10).

join the membership

Users and guides can access the server (10) using a user terminal (20) and a guide terminal (30), and then register as members through the member registration form (11). Upon registering as a member, users can set their own avatars. Guides can register guides for desired themes, regions, or national heritage sites. Guides can use personal data (photos, videos), and tour types are provided to users through live or pre-recorded data.

The server (10) provides users with categories such as national heritage name, type and era classification, regional exploration, guided tour, history study, direct visit, and religious facility experience, and after the user selects a desired theme, provides exploration using mixed reality, metaverse, or virtual reality.

Search for national heritage by name, type, era, and regional exploration.

When a user accesses the server (10) via a user terminal (20) and searches for a national heritage site they wish to visit, a virtual tour service begins at the national heritage site entrance or in front of the site, depending on the user's selection. The user can move around using the character as if they were actually moving. Upon selecting a national heritage site of interest, the user can view and listen to related information, and optionally view photos and videos of the national heritage site. Questions can be posted in the Q&A section for the relevant national heritage site.

When a user accesses the server (10) via a user terminal (20) and searches for a national heritage type (e.g., a stone pagoda), the user can view the names of domestic and international national heritage sites by nationality, era, or name. Upon selecting a national heritage site of interest, a virtual tour service begins at the national heritage site entrance or in front of the site, similar to the name search. Furthermore, the distribution area of the national heritage site can be confirmed on a map, and upon selecting a starting point, the virtual tour service begins at that location.

When a user accesses the server (10) via a user terminal (20) and searches for a period of interest (e.g., the Joseon Dynasty), the user can search for national heritage sites believed to have been created during that period by period or name. Upon selecting a national heritage site of interest, a virtual tour service begins at the national heritage site entrance or in front of the site, similar to the name search step. Furthermore, the distribution area of the national heritage site can be checked on a map, and upon selecting a starting point, the virtual tour service begins at that location.

When a user accesses the server (10) via a user terminal (20), the user can search for a desired region (e.g., Gyeongju) and view national heritage sites within the region by era or name. Upon selecting a national heritage site of interest, a virtual tour service begins at the national heritage site entrance or in front of the site, similar to the name search step. Furthermore, the distribution of national heritage sites can be confirmed on a map, and upon selecting a starting point, the virtual tour service begins at that location.

Virtual Tour Service

The server (10) is connected online and provides a virtual tour service using mixed reality to the user terminal used by the user. The database (19) stores a series of real-life images (actual images) taken of national heritage sites while moving along a certain route. This series of real-life images may be 360-degree images taken in all directions at certain intervals along the route. The real-life images may be taken individually for each national heritage site, season or month, or time of day (or divided into morning, afternoon, and evening). Therefore, even if the national heritage site being toured by the user is the same, the real-life images provided may differ depending on the season, month, or time of day. The set of real-life images may differ depending on the national heritage site, season or month, and time of day.

When the virtual tour service starts, the image loading unit (12) selects one of the real image sets from the database (19) for the national heritage desired by the user, according to the current season or month and time zone, or according to the season or month and time zone desired by the user.

And the image loading unit (12) loads one real image from a series of real images from the database (19) to correspond to the user spot where the user is virtually located. Then, an image area suitable for the direction the user is facing is selected from the user spot, and based on the selected real image (which may be limited to the selected area) (hereinafter also referred to as the 'base image'), an image to be provided to the user terminal (30) is configured in real time.

FIG. 3 illustrates a scene of a virtual tour service provided to a user terminal (20) by a mixed reality tour service providing system (server (10)) according to one embodiment of the present invention.

The overlay unit (14) executes various overlays on the basic image selected and loaded by the image loading unit (12). The overlay unit (14) overlays path images, guide avatars, user avatars, and various icons on the basic image.

The path image (a1) is an image that is overlaid to indicate a path that the user can proceed, and the overlay unit (14) further displays the path that the user can proceed on top of the real-life image blown in by the image loading unit (12). The path that the user can proceed is similar to, parallel to, or equivalent to a set of points where a series of images were taken of a national heritage site, connected by lines. Such a path image is displayed as a line, and may include points where multiple lines branch off or merge into a single line, as if there is a fork in the road, and in an area of high user interest, the shooting points may form a spider web shape and be displayed as spider web-like lines.

The user avatar (a3), which is the user's avatar, is an image representing the user, and the overlay unit (14) displays the user avatar, which is the user avatar, on the real-life image loaded by the image loading unit (12). The user avatar (a3) may display the user's shadow centered on the user spot where the user is virtually located. The user spot may be located at a point on the path that the user can proceed.

The user tracking unit (15) receives a movement command for moving the user spot or a rotation command for changing the angle viewed from the user spot from the user terminal (20), and provides the command to the image loading unit (12) to determine the image to be loaded. For example, the user can generate a movement command using the direction keys on the user terminal and then provide the command to the user tracking unit (15) of the server (10), and can generate a rotation command using the drag of the mouse and then provide the command to the user tracking unit (15) of the server (10). Since the movement command is valid on the path displayed as the path image, movement outside the path is impossible.

The overlay unit (14) creates a composite image by overlaying a path image, a guide avatar, a user avatar, and various icons on the basic image and provides this to the transceiver unit (16), and the transceiver unit (16) provides the composite image to the user terminal (20).

The overlay unit (14) can display a content icon on the real-life image to inform the user that there is content on the corresponding point of the national heritage when there is content related to the national heritage. The content may be an image, video, or data related to the national heritage. The overlay unit (14) further displays the content icon on the real-life image loaded by the image loading unit (12), and when the user terminal (20) clicks on the content icon, the content providing unit (18) provides the image, video, or data stored in the database (19) that matches the content icon to the user terminal (20) through the transmission/reception unit (16).

The virtual guided tour service of the present invention provides information to enable historical study by era based on national heritage. The content provider (18) provides information by era, categorizes it so that it can be selected by time zone, and provides it in both voice and text. In addition, the user interaction unit (1) allows users to post questions about a specific national heritage through the Q&A section displayed on the user terminal (20), and the questions are answered by an administrator. If there is a question about a national heritage, the question can be registered through the Q&A section for the relevant cultural festival, and the administrator responds to the question. Frequently asked questions are displayed at the top in order of priority, so that users can check which questions are frequently asked about the national heritage.

According to the present invention, not only is a real-life image of a national heritage provided to a user, but the user can also view the real-life image from a desired angle while moving along a route, so the user has the advantage of being able to enjoy a highly realistic tour even from a remote location.

Guided tour service

By implementing a guided tour program, users can select a guide based on national heritage, region, or theme. Guides can only be registered upon registration, and users can register for their preferred national heritage, region, or theme. Users can choose to receive a virtual tour service without a guide, or they can participate in a guided tour in real time.

In the case of a real-time guided tour, the guide can group users together and proactively move them from the starting point to the waypoint and destination. When the guide groups users, a group chat room is created among the users to enable mutual communication. The guide's spoken voice (audio) is transmitted to the user terminal (20) via the server (10) and played back as audio in real time on the user terminal (20), or the server (10) automatically creates subtitles using voice recognition technology, and then transmits them to the user terminal (20) in text format and then displays them on the guide window (w1). The guide's guiding voice automatically creates subtitles in a separate window from the group chat room using voice recognition technology, so that people with hearing impairments can also participate.

The overlay unit (14) displays the guide avatar (a2), which is the guide's avatar, on the real image blown in by the image loading unit (12) to create a composite image, and displays the guide avatar (a2) on the guide spot where the guide is virtually located. The server (10) can receive the guide's voice speaking using the microphone of the guide terminal (30) and provide it to the user terminal (20). The audio providing unit (17) receives real-time voice including the guide's explanation from the guide terminal and provides it to the user terminal (20), thereby allowing the guide's real-time voice to be played.

When the guide's real-time voice is provided to the user terminal (20), the overlay part (14) can increase the user's attention by making the guide avatar's lips move and make gestures.

The guide can provide the user with photos, videos, 3D graphics, and materials that he or she has worked on, and when the user posts a question in writing, the guide responds in real time, enabling two-way communication. The server stores the photos, videos, 3D graphics, and materials provided by the guide in a database (19) according to the guide's command, or after receiving photos, videos, 3D graphics, and materials provided in real time from the guide terminal, transmits the corresponding content to the user terminal (20) so that it can be played or displayed on the user terminal (20).

Guided virtual tour services can be provided for a single user, or as a group tour for multiple users. User avatars are positioned at various points along a designated route, but each user's user spot and facing direction may differ. The avatars of connected users can be visible to others, and users can choose to hide avatars other than their own (visible only to themselves) to ensure visibility without interference.

Each user's individual avatar can be transmitted to all user terminals, giving users the feeling of being part of a group tour. Users can communicate with each other through a group chat room, as shown in the chat window (w2).

The present invention allows users to view real-time images of national heritage sites while moving along a route, while also receiving immersive, real-time commentary from a live guide. This allows for a more realistic tour experience, even from a remote location. The present invention combines a series of real-time images with real-time commentary from a human guide, thereby enhancing the sense of realism and presence.

Guides can control the guide spots they position on the real-world image. These virtual guide spots can be positioned independently of the route, so they are not restricted by the route like user spots. However, appropriate locations can be automatically or manually selected based on the distance from the user and the direction of the specific national heritage site being described.

And the user tracking unit (15) receives a movement command to move the user spot or a rotation command to change the angle (direction) viewed from the user spot from the guide terminal (30) used by the guide, and provides it to the image loading unit (12) so that the image to be loaded is determined for each user terminal. In the real world, each user must follow the guide by moving his or her own body, but in the mixed reality tour service according to one embodiment of the present invention, the guide can move the users all at once and change the viewing direction.

When the user tracking unit (15) receives a movement command to move a user spot from the guide terminal (30), it moves the user spots of all users participating in the tour together. At this time, it is preferred to move the user spots together while leaving a small distance between them.

In addition, when the user tracking unit (15) receives a change command from the guide terminal (30) to change the direction in which the user is looking, it can change the direction in which all users participating in the tour are looking so that they all look in the same direction. For example, when a guide wants to explain about a specific national heritage site located in a specific direction, the guide can use this change command to make all users look in the direction of the specific national heritage site before explaining it.

According to the present invention, this function can be used even when it is necessary to deviate from a predetermined path or return to answer a user's question.

According to the present invention, the user spot can be moved and the direction of view can be changed together according to the guide-led movement command and change command, so that the guide activity becomes more convenient and the user has the advantage of feeling that he or she is actually being guided.

Meanwhile, separately from the guide terminal (30), each user terminal (20) can adjust the user spot on the path it is located on. For example, when there is an obstructing object in front and you want to move slightly and then look at the object of interest or change the direction, the user tracking unit (15) determines the movement and angle (direction) change of the user spot for each user according to the command from the user terminal and provides it to the image loading unit (12) so that each user terminal determines the image to be loaded.

Augmented reality restores lost national heritage

Augmented reality technology using location tracking technology is provided to show a 3D virtual representation of a national heritage site overlaid on the real world when a camera is pointed at the site of a historic site that was destroyed by war, such as Hwangryongsa Temple, and only the ruins remain.

Work is underway to implement representative national heritage sites in augmented reality (AR) by local governments. However, these methods require the use of tablet PCs provided on-site, and users cannot view AR experiences using their own smart devices. The present invention utilizes two methods to activate AR.

First, when exploring a national heritage site in the real world, a GPS device that transmits and receives information such as latitude/longitude will sound an alarm when passing by a site restored in augmented reality to inform the user that there is a national heritage site restored in augmented reality around the user's current location, and will provide information such as the name, address, and content. When the user activates the camera function at that location, the site recognized on the screen will be analyzed to identify the national heritage site, and the lost national heritage site will be restored in augmented reality so that the user can confirm it through the display.

Second, when a user uses a tour service within a virtual space, if there is a place where augmented reality can be implemented around the user spot where the user is located, a notification is sent to the user, and when the user clicks the activated augmented reality button, the augmented reality that restores the lost national heritage is activated, and when the activation button is not clicked, the user can explore the national heritage expressing the current situation.

When a user terminal such as a smartphone is used to access the server (10), location information (latitude/longitude, etc.) obtained from a GPS module and an on-site image (video) recognized on the camera screen are transmitted to the server (10), and the augmented reality unit (2) of the server (10) analyzes the location information to identify the national heritage, provides a graphic image that graphically expresses the lost national heritage stored in the database (19), and allows the user terminal (20) to overlay the corresponding part or provides the received on-site image to the user terminal (20) for display. Since the national heritage is expressed in three dimensions at a 1:1 actual size, the screen that can be viewed changes depending on the angle.

In addition, the augmented reality function is made available even when visiting using a virtual tour service rather than the real world. For example, when passing a place where augmented reality can be implemented, such as the Hwangryongsa Temple site during a virtual tour service, the augmented reality button on the screen is activated, and when the user clicks the activated augmented reality button, the augmented reality that restores the lost national heritage is activated. In response to a selection command from the user terminal (e.g., clicking the augmented reality button), the overlay unit (2) fetches the corresponding graphic image from the database (19) and provides it to the overlay unit (14), and the overlay unit (14) overlays and displays the restored image of the lost cultural asset on the real image that the image loading unit fetches.

This solves the problem of using only specific devices and allows the use of augmented reality without time or place restrictions by utilizing individual smart devices, and augmented reality can be used in both the real world and the virtual world.

National Heritage Notification Service Near Me

When the application is launched, the GPS module, which can obtain information such as latitude/longitude, identifies national heritage sites around the user and provides notifications with information such as their names, locations, and content. Depending on the settings, the GPS function can be enabled permanently or only when the app is running. Additionally, when passing by a national heritage site that supports augmented reality (whether through a virtual tour or in the real world), notifications can be sent with the name, location, and other information.

Before visiting a historic site, people often research local national heritage sites online or in books, but they can easily miss them. Furthermore, even on frequently traveled routes, lesser-known national heritage sites can be overlooked. To address this issue, a notification service is provided to help users become aware of the national heritage sites nearby. Users will be notified of the names, locations, and details of national heritage sites within a few kilometers. An alert will also sound when passing by restored sites using augmented reality, alerting users.

The notification service unit (3) receives the location of the user terminal from the user terminal, notifies the existence of national heritages around the location of the user terminal, and provides map information displaying national heritages around the location of the user terminal on a map.

National Heritage Visit Records and Recommendations

Upon accessing the application, a virtual confirmation stamp is provided at each historic site, allowing users to stamp with the date. The application records the national heritage sites, categorizes them by era, and maps or lists national heritage sites created during that era, allowing users to track their visits. Furthermore, once a user's visit history identifies a specific era (e.g., Unified Silla), the application maps national heritage sites from that era across all regions and recommends national heritage sites near the user.

To address the issue of paper stamps being lost over time, the application allows users to stamp a dated stamp on each national heritage site they visit. This stamp is then recorded and categorized by era and location, and the locations visited are then mapped or listed to store the user's visits. Once the data is analyzed and the era of interest (e.g., Unified Silla) is identified, the application maps national heritage sites from that era across all regions and recommends national heritage sites near the user, stimulating their interest in history.

The visit confirmation unit (4) receives the location of the user terminal (20) from the user terminal (20), and when the user terminal (20) is at a specific location within a national heritage site, activates a menu or icon for receiving visit confirmation, and when the user terminal (20) requests a stamp of the confirmation stamp as if receiving a confirmation stamp, the visit confirmation unit (4) enables a display including an image of the confirmation stamp to be displayed on the user terminal, and records the date and time of the visit, identification information of the visited location, etc. in the database (10). In addition, the visit confirmation unit (4) can provide map information indicating the national heritage site visited by the user on a map to the user terminal (20).

Visits to religious facilities and events

The virtual tour service of the present invention utilizes mixed reality and the religious metaverse section (5) to enable virtual visits to temples/churches/cathedrals, etc., and provides a space for offering prayers, etc. Candles, lanterns, and roof tile offerings can be purchased by size, and desired phrases can be written. Prayers can be offered at a desired time by setting a time slot. On-site purchases via bank transfer are also possible by entering the religious facility's contact information and account number. Memorial services, ancestral tablet enshrinement, etc. are also possible, and memorial services can be held on a desired date and time. In the case of memorial tablet enshrinement, a period can be set for the memorial service to be held within that period. If a memorial service, memorial tablet enshrinement, or memorial service is to be shared with family/relatives, the relevant information can be confirmed by entering the desired ID. A group chat room can be created among shared members to enable mutual conversation during the memorial service, memorial tablet enshrinement, or memorial service. The " virtual tour service " and " guided tour service " described in detail above can be applied identically or similarly.

The religious metaverse section (5) generates a three-dimensional graphic image simulating an altar of a temple, church or cathedral and provides it to a user terminal (20), and the religious metaverse section (5) adds a simulation of a situation in which a virtual candle, lantern, flower, roof tile or offering is placed on the three-dimensional graphic image according to a command from the user terminal and provides it.

Religious facilities are closely linked to national heritage. Temples, churches, and cathedrals offer spaces for offerings, ancestral rites, and enshrinement of ancestral tablets, and prayers can be held within mixed reality and the metaverse. While the rise of single-person households, surpassing extended and nuclear families, does not necessarily require complete digitalization, the culture of ancestral rites and enshrinement facilities, while adhering to tradition, offers the advantage of being accessible anytime, anywhere through mixed reality and the metaverse. Group chat rooms allow people to leave messages to their ancestors in the form of guestbooks.

10: Mixed Reality Tour Service Provision System (Server)
20: User terminal
30: Guide terminal

Claims (11)

A mixed reality tour service provision system that provides a tour service using mixed reality to a user terminal that is connected online and used by the user.
An image loading unit that loads one of a series of real-world images to correspond to a user spot where the user is virtually located; and
The image loading section generates a composite image by displaying a guide avatar, which is an avatar of a guide, on a real image blown in by the above image loading section, and includes an overlay section that displays the guide avatar on a guide spot where the guide is virtually located;
Characterized in that the above-mentioned composite image is provided to the user terminal,
A mixed reality tour service provision system. In claim 1,
A guide audio providing unit further comprising: a guide terminal used by a guide; receiving real-time voice including the guide's explanation from the guide terminal and providing the same to the user terminal;
A mixed reality tour service provision system. In claim 1,
The above overlay part,
The image loading section above displays a path image that indicates the path the user can proceed on top of the blown-up real-time image.
A mixed reality tour service provision system. In claim 1,
The above overlay part,
The image loading section displays the user avatar, which is the user's avatar, on the real-life image blown in, and displays the user's shadow centered on the user spot where the user is virtually located.
A mixed reality tour service provision system. In claim 1,
A user tracking unit further comprising: a user terminal used by a guide or a user terminal; a movement command for moving the user spot or a rotation command for changing the angle viewed from the user spot; and a user tracking unit that provides the movement command to the image loading unit to determine an image to be loaded.
A mixed reality tour service provision system. In claim 5,
The above user tracking unit,
When a movement command to move the user spot is received from the guide terminal, the user spots of all users participating in the tour are moved together.
A mixed reality tour service provision system. In claim 1,
The above overlay part,
In response to a selection command from the user terminal, the image loading unit displays a restored image of a lost cultural asset by overlaying it on the actual image.
A mixed reality tour service provision system. In claim 1,
The above overlay part displays a content icon on top of the real image blown by the image loading part,
When the user terminal clicks on the content icon, an image, video or data stored matching the content icon is provided to the user terminal.
A mixed reality tour service provision system. In claim 1,
By receiving the location of the user terminal from the user terminal, notifying the existence of a national heritage around the location of the user terminal, and providing map information displaying the national heritage around the location of the user terminal on a map.
A mixed reality tour service provision system. In claim 1,
By receiving the location of the user terminal from the user terminal, if the user is at a specific location of the national heritage, a menu or icon that can confirm the visit is activated.
Provides map information that displays national heritage sites visited by the user on the map.
A mixed reality tour service provision system. In claim 1,
Further including a religious metaverse section that generates a three-dimensional graphic image replicating at least an altar of a temple, church or cathedral and provides it to the user terminal;
The above religious metaverse department,
Providing a simulation of placing virtual candles, lanterns, flowers, roof tiles or offerings on the 3D graphic image according to a command from the user terminal.
A mixed reality tour service provision system.