[go: up one dir, main page]

CN112734937B - Tourism system based on panoramic technology - Google Patents

Tourism system based on panoramic technology Download PDF

Info

Publication number
CN112734937B
CN112734937B CN202011626596.8A CN202011626596A CN112734937B CN 112734937 B CN112734937 B CN 112734937B CN 202011626596 A CN202011626596 A CN 202011626596A CN 112734937 B CN112734937 B CN 112734937B
Authority
CN
China
Prior art keywords
panoramic
scenic spot
scenic
unit
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011626596.8A
Other languages
Chinese (zh)
Other versions
CN112734937A (en
Inventor
黄业鹏
张晓露
许根
葛建飞
肖江剑
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ningbo Institute of Material Technology and Engineering of CAS
Original Assignee
Ningbo Institute of Material Technology and Engineering of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ningbo Institute of Material Technology and Engineering of CAS filed Critical Ningbo Institute of Material Technology and Engineering of CAS
Priority to CN202011626596.8A priority Critical patent/CN112734937B/en
Publication of CN112734937A publication Critical patent/CN112734937A/en
Application granted granted Critical
Publication of CN112734937B publication Critical patent/CN112734937B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/74Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/14Travel agencies
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Human Resources & Organizations (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Economics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The invention discloses a tour system based on panoramic technology, which comprises a panoramic image acquisition module, an online panoramic preview module, a scenic spot card punching module and a panoramic image fusion module, wherein the panoramic image acquisition module is used for acquiring scenic spot panoramic image data in real time; the online panoramic preview module is used for acquiring panoramic image data of scenic spots, providing panoramic scenes of each scenic spot for online previewing of the user and providing scenic spot interaction experience; the scenic spot card punching module is used for recording the card punching from the user to the scenic spot and providing panoramic pictures of the card punching scenic spot; and the panoramic image fusion module is used for fusing the tourist photos uploaded by the user with the panoramic pictures of the scenic spots to form the tourist panoramic album. The invention provides the functions of online real-time panoramic preview, panoramic image fusion and panoramic video production of tourist attractions, and solves the problem of poor user tourist experience in the traditional method in a mode of combining virtual tourist with real tourist.

Description

一种基于全景技术的旅游系统A tourism system based on panoramic technology

技术领域Technical Field

本发明属于全景技术领域,具体涉及一种基于全景技术的旅游系统。The invention belongs to the field of panoramic technology, and in particular relates to a tourism system based on panoramic technology.

背景技术Background technique

如今,人们的生活节奏加快,生活条件越来越好。旅游成了人们排解压力放松心情的一种重要方式。由于空间、时间等客观因素的影响,旅游业的发展受到一定限制。而现今全景技术的发展与成熟,全景虚拟旅游已经渐渐成为旅游景区宣传的重要手段。Nowadays, people's pace of life is accelerating and living conditions are getting better and better. Traveling has become an important way for people to relieve stress and relax. Due to the influence of objective factors such as space and time, the development of tourism is subject to certain restrictions. With the development and maturity of panoramic technology, panoramic virtual tourism has gradually become an important means of promoting tourist attractions.

目前大多数全景虚拟旅游平台中拍摄的旅游景点的VR视频比较杂乱、碎片化,用户只能观看到旅游景点的局部影像,用户旅游途中所拍摄的数字照片和视频的存储也是一个较大的问题。Currently, the VR videos of tourist attractions shot on most panoramic virtual tourism platforms are rather messy and fragmented, and users can only view partial images of the tourist attractions. The storage of digital photos and videos taken by users during their travels is also a major problem.

如何提供一种旅游景点在线实时全景预览,旅游全景影像融合和旅游短视频制作功能的智慧旅游系统,是一个急需解决的问题。How to provide a smart tourism system with online real-time panoramic preview of tourist attractions, tourism panoramic image fusion and tourism short video production functions is an issue that needs to be addressed urgently.

发明内容Summary of the invention

本发明的主要目的在于提供一种基于全景技术的旅游系统,从而克服现有技术的不足。The main purpose of the present invention is to provide a tourism system based on panoramic technology, thereby overcoming the shortcomings of the prior art.

为实现前述发明目的,本发明采用的技术方案包括:一种基于全景技术的旅游系统,包括:To achieve the above-mentioned invention object, the technical solution adopted by the present invention includes: a tourism system based on panoramic technology, including:

全景图像采集模块,用于实时获取景点全景图像数据;Panoramic image acquisition module, used to obtain panoramic image data of scenic spots in real time;

在线全景预览模块,用于获取所述景点全景图像数据,提供用户在线预览每个景点的全景场景及提供景点互动体验;An online panoramic preview module is used to obtain the panoramic image data of the scenic spot, provide users with online preview of the panoramic scene of each scenic spot and provide interactive experience of the scenic spot;

景点打卡模块,用于记录用户到访景点的打卡,并提供打卡景点的全景图片;The scenic spot check-in module is used to record the user's check-in at the scenic spot and provide panoramic pictures of the check-in scenic spot;

全景影像融合模块,用于将用户上传的旅游照片与景点的所述全景图片相融合,形成旅游全景相册。The panoramic image fusion module is used to merge the tourist photos uploaded by users with the panoramic pictures of the scenic spots to form a tourist panoramic album.

在一优选实施例中,所述全景图像采集模块包括:In a preferred embodiment, the panoramic image acquisition module includes:

全景图像采集单元,用于所述实时获取景点全景图像数据;A panoramic image acquisition unit, used for acquiring panoramic image data of scenic spots in real time;

全景数据存储单元,用于对所述景点全景图像数据进行存储,存储形式包括图片和视频的形式。The panoramic data storage unit is used to store the panoramic image data of the scenic spot, and the storage form includes the form of pictures and videos.

在一优选实施例中,所述在线全景预览模块包括:In a preferred embodiment, the online panoramic preview module includes:

预览单元,用于提供用户在线预览每个景点的全景场景;A preview unit, used to provide users with an online preview of the panoramic scene of each scenic spot;

互动体验单元,用于提供用户景点互动体验;Interactive experience unit, used to provide users with interactive experience of scenic spots;

智能语音讲解单元,用于对景点进行语音介绍。Intelligent voice explanation unit, used for voice introduction of scenic spots.

在一优选实施例中,所述景点互动体验包括供用户点赞和收藏景点,在线进行互动留言,及一键分享景点。In a preferred embodiment, the scenic spot interactive experience includes allowing users to like and collect scenic spots, leave interactive messages online, and share scenic spots with one click.

在一优选实施例中,所述景点打卡模块包括:In a preferred embodiment, the scenic spot check-in module includes:

景点打卡单元,用于记录用户到访景点的打卡,并提供打卡景点的全景图片和视频体验;The scenic spot check-in unit is used to record the user's check-in at the scenic spot and provide panoramic pictures and video experience of the check-in scenic spot;

地图交互单元,用于在用户打卡之前,提供智能路线规划及旅游足迹生成。The map interaction unit is used to provide intelligent route planning and travel footprint generation before users check in.

在一优选实施例中,所述全景影像融合模块包括;In a preferred embodiment, the panoramic image fusion module includes:

全景融合单元,用于将用户上传的旅游照片与景点的所述全景图片、视频相融合,形成所述旅游全景相册;A panoramic fusion unit, used to fuse the tourist photos uploaded by the user with the panoramic pictures and videos of the scenic spots to form the tourist panoramic album;

全景视频制作单元,用于供用户制作旅游全景视频。The panoramic video production unit is used for users to produce panoramic travel videos.

在一优选实施例中,所述全景视频制作单元包括:In a preferred embodiment, the panoramic video production unit includes:

视频编辑单元,用于全景视频的编辑、制作;Video editing unit, used for editing and producing panoramic videos;

特效处理单元,用于提供所述全景视频的特效处理;A special effect processing unit, used for providing special effect processing of the panoramic video;

社交互动单元,用于提供用户对景点的互动,所述互动包括点赞、分享、评论。The social interaction unit is used to provide users with interaction with scenic spots, including liking, sharing, and commenting.

在一优选实施例中,所述图像采集模块以全景相机的形式,架设在景区相应地点,实时获取景点的全景图像数据。In a preferred embodiment, the image acquisition module is in the form of a panoramic camera, which is set up at a corresponding location in the scenic area to obtain panoramic image data of the scenic spot in real time.

在一优选实施例中,所述全景影像融合模块采用图像融合算法将旅游照片中的人物提取,融合到所获得的的全景图片上的相应位置。In a preferred embodiment, the panoramic image fusion module uses an image fusion algorithm to extract people from tourist photos and fuse them to corresponding positions on the obtained panoramic picture.

在一优选实施例中,所述图像融合算法包括:In a preferred embodiment, the image fusion algorithm includes:

S1,将全景柱面图与用户上传的旅游照片采用SIFT进行特征点提取;S1, extract feature points from the panoramic cylindrical image and the travel photos uploaded by the user using SIFT;

S2,检测所述特征点以进行图像配准,建立用户上传的旅游照片和全景图片特征之间的相关性,建立图像之间的几何对应关系,重新投影用户上传的照片并将其放在全景图片画布上;S2, detecting the feature points to perform image registration, establishing correlation between features of the travel photos uploaded by the user and the panoramic picture, establishing a geometric correspondence between the images, re-projecting the photos uploaded by the user and placing them on the panoramic picture canvas;

S3,在重叠区域中使用加权平均颜色值来融合重叠像素。S3, uses weighted average color value to blend overlapping pixels in the overlapping area.

与现有技术相比较,本发明的有益效果至少在于:Compared with the prior art, the beneficial effects of the present invention are at least:

1、本发明提供旅游景点全景图像采集、在线实时全景预览、景点打卡、全景图像融合和全景视频制作功能等,以虚拟旅游结合现实旅游的方式,解决传统方法中用户旅游体验感差的问题。1. The present invention provides panoramic image acquisition of tourist attractions, online real-time panoramic preview, scenic spot check-in, panoramic image fusion and panoramic video production functions, etc., which solves the problem of poor user travel experience in traditional methods by combining virtual tourism with real tourism.

2、本发明可以提供景区的实时全景预览,对每个景点以全景的方式进行展示,使得用户可以在线预览每个景区的实景,足不出户就能游览景区。2. The present invention can provide a real-time panoramic preview of the scenic spot, and display each scenic spot in a panoramic manner, so that users can preview the real scene of each scenic spot online and visit the scenic spot without leaving home.

3、本发明可以记录用户到访景点的打卡,且与地图交互生成旅游足迹,还可以获取打卡时间下的景点全景图片、视频,做到景点全景拍照留念,区别于平面图文,以俯瞰角度,基于全景图像的真实场景体验不一样的景点风光。并且提供全景影像与用户旅游照片融合的功能,由用户自定义编辑,上传旅游途中拍摄的照片,融合到所打卡获得的全景图片、视频上,也可添加文字、饰品和表情贴图等装饰组件,增强用户旅游过程的体验感。3. The present invention can record the check-in of the user's visit to the scenic spot, and interact with the map to generate the travel footprint. It can also obtain the panoramic pictures and videos of the scenic spot at the time of the check-in, so as to take panoramic photos of the scenic spot as a souvenir. Different from the flat pictures and texts, it can experience different scenic spots from a bird's-eye view and based on the real scene of the panoramic image. It also provides the function of integrating the panoramic image with the user's travel photos, which can be customized and edited by the user, and the photos taken during the travel can be uploaded and integrated into the panoramic pictures and videos obtained by the check-in. Decorative components such as text, accessories and emoticons can also be added to enhance the user's experience during the travel process.

4、本发明可以制作全景短视频,动态展示用户的旅游足迹,且提供丰富的滤镜、视频特效处理、背景音乐等处理,增强视频相册的视觉效果。4. The present invention can produce panoramic short videos, dynamically display the user's travel footprints, and provide rich filters, video special effects processing, background music and other processing to enhance the visual effect of the video album.

5、本发明可以将制作好的全景短视频发布到广场中,也查看到他人制作好的旅游全景短视频,提供社交互动功能;另外也可提供景点的互动体验,用户可以点赞和收藏喜欢的景点,随时在线进行互动留言,留下所见所闻所想,还可以一键分享美景。5. The present invention can publish the prepared panoramic short videos to the square, and also view the travel panoramic short videos prepared by others, providing a social interaction function; in addition, it can also provide an interactive experience of scenic spots. Users can like and collect their favorite scenic spots, leave interactive messages online at any time, leave what they see, hear and think, and share the beautiful scenery with one click.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明中记载的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

图1是本发明系统的结构框图;Fig. 1 is a block diagram of the system of the present invention;

图2是本发明景点全景预览模块的流程示意图;FIG2 is a schematic diagram of a flow chart of a panoramic view preview module of a scenic spot according to the present invention;

图3是本发明全景图像融合模块的流程示意图;FIG3 is a schematic diagram of a flow chart of a panoramic image fusion module of the present invention;

图4是本发明图像融合算法的流程示意图;FIG4 is a schematic diagram of the flow chart of the image fusion algorithm of the present invention;

图5是本发明全景视频制作单元的流程示意图。FIG. 5 is a schematic diagram of a flow chart of a panoramic video production unit according to the present invention.

具体实施方式Detailed ways

通过应连同所附图式一起阅读的以下具体实施方式将更完整地理解本发明。本文中揭示本发明的详细实施例;然而,应理解,所揭示的实施例仅具本发明的示范性,本发明可以各种形式来体现。因此,本文中所揭示的特定功能细节不应解释为具有限制性,而是仅解释为权利要求书的基础且解释为用于教示所属领域的技术人员在事实上任何适当详细实施例中以不同方式采用本发明的代表性基础。The present invention will be more fully understood through the following detailed description, which should be read in conjunction with the accompanying drawings. Detailed embodiments of the present invention are disclosed herein; however, it should be understood that the disclosed embodiments are only exemplary of the present invention, which can be embodied in various forms. Therefore, the specific functional details disclosed herein should not be interpreted as limiting, but only as the basis of the claims and as a representative basis for teaching those skilled in the art to adopt the present invention in different ways in virtually any appropriate detailed embodiment.

本发明所揭示的一种基于全景技术的旅游系统,可以提供旅游景点在线实时全景预览、全景图像融合和全景视频制作功能,以虚拟旅游结合现实旅游的方式,解决传统方法中用户旅游体验感差的问题。The present invention discloses a tourism system based on panoramic technology, which can provide online real-time panoramic preview of tourist attractions, panoramic image fusion and panoramic video production functions, and solve the problem of poor user travel experience in traditional methods by combining virtual tourism with real tourism.

如图1所示,本发明所揭示的一种基于全景技术的旅游系统,包括:全景图像采集模块、在线全景预览模块、景点打卡模块和全景影像融合模块。As shown in FIG1 , a tourism system based on panoramic technology disclosed in the present invention includes: a panoramic image acquisition module, an online panoramic preview module, a scenic spot check-in module and a panoramic image fusion module.

其中,全景图像采集模块,具体以全景相机的形式,架设在旅游景区标志性地点,实时获取景点全景图像数据,全景图像数据包括全景图片和全景视频。本实施例中,全景图像采集模块具体包括:The panoramic image acquisition module is specifically in the form of a panoramic camera, which is set up at a landmark location in a tourist attraction to obtain panoramic image data of the scenic spot in real time. The panoramic image data includes panoramic pictures and panoramic videos. In this embodiment, the panoramic image acquisition module specifically includes:

全景图像采集单元,用于实时获取景点全景图像数据;A panoramic image acquisition unit, used to obtain panoramic image data of scenic spots in real time;

全景数据存储单元,用于对景点全景图像数据进行存储,存储形式包括图片和视频的形式,图像数据在实时录像存储的同时,规律性地每隔一定时间存储景点的全景图片,从而便于根据用户的不同需要,提供图片或者视频数据。The panoramic data storage unit is used to store panoramic image data of scenic spots. The storage forms include pictures and videos. While the image data is stored in real-time video, panoramic pictures of scenic spots are stored regularly at regular intervals, so as to provide pictures or video data according to different needs of users.

结合图2所示,在线全景预览模块,用于针对移动端设备,通过服务器连接上景点的全景相机,获取景点全景图像数据,展示在移动端设备上,提供用户在线预览每个景区的720度实景,足不出户就能游览景区、俯瞰城市,以多个角度发现世界之美。本实施例中,在线全景预览模块具体包括:As shown in FIG2 , the online panoramic preview module is used for connecting the panoramic camera of the scenic spot through the server for the mobile terminal device, obtaining the panoramic image data of the scenic spot, and displaying it on the mobile terminal device, so as to provide the user with an online preview of the 720-degree real scene of each scenic spot, so that the user can visit the scenic spot and overlook the city without leaving home, and discover the beauty of the world from multiple angles. In this embodiment, the online panoramic preview module specifically includes:

预览单元,用于提供用户在线预览每个景点的全景场景;优选地,预览单元包括VR双屏模式切换和陀螺仪感应,用户可将移动端设备直接放置在VR头盔中,沉浸式远程体验景点实时风景。The preview unit is used to provide users with online preview of the panoramic scene of each scenic spot; preferably, the preview unit includes VR dual-screen mode switching and gyroscope sensing, and users can place the mobile device directly in the VR helmet to immersively experience the real-time scenery of the scenic spot remotely.

互动体验单元,用于提供用户景点互动体验,其中,互动体验包括供用户点赞和收藏喜欢的景点,随时在线进行互动留言,留下所见所闻所想,还可以一键分享美景。The interactive experience unit is used to provide users with interactive experience of scenic spots, including allowing users to like and collect their favorite scenic spots, leave interactive messages online at any time, record what they see, hear and think, and share the beautiful scenery with one click.

智能语音讲解单元,用于对景点进行语音介绍。Intelligent voice explanation unit, used for voice introduction of scenic spots.

景点打卡模块,用于记录用户到访景点的打卡,提供打卡景点的全景图片。具体地,用户在游览景区景点的时候,可以进行扫码打卡操作,在景点处留下自己的足迹。还可以获取打卡时间下的景点全景图片、视频,真正做到景点全景拍照留影,区别于平面图文,以俯瞰角度,基于全景图像的真实场景体验不一样的景点风光。本实施例中,景点打卡模块具体包括:The scenic spot check-in module is used to record the check-ins of users visiting scenic spots and provide panoramic pictures of the check-in scenic spots. Specifically, when visiting scenic spots, users can scan the code to check in and leave their footprints at the scenic spots. You can also obtain panoramic pictures and videos of the scenic spots at the time of the check-in, so that you can truly take panoramic photos of the scenic spots. Different from flat pictures and texts, you can experience different scenic spots from a bird's-eye view and based on the real scene of the panoramic image. In this embodiment, the scenic spot check-in module specifically includes:

景点打卡单元,用于记录用户到访景点的打卡,并提供打卡景点的全景图片和视频体验。The scenic spot check-in unit is used to record the user's check-in at the scenic spots and provide panoramic pictures and video experience of the check-in scenic spots.

地图交互单元,用于提供智能路线规划及旅游足迹生成。其中,智能路线规划主要对于用户想去的景点,提供智能路线规划功能,方便用户在不熟悉当地路线的情况下,前往景点打卡。旅游足迹生成主要对于用户打卡过的景点,按照打卡时间的先后顺序,生成用户专属的旅游足迹。The map interaction unit is used to provide intelligent route planning and travel footprint generation. Among them, intelligent route planning mainly provides intelligent route planning functions for the attractions that users want to visit, so that users can check in at the attractions when they are not familiar with the local routes. Travel footprint generation mainly generates user-exclusive travel footprints for the attractions that users have checked in, according to the order of check-in time.

结合图3所示,全景影像融合模块,提供全景影像与用户旅游照片融合的功能。具体用于由用户定义编辑,上传旅游途中拍摄的照片,由用户自行框选照片中的人物,采用图像融合算法,将照片中的人物提取,融合到所打卡获得的全景图片、视频上相应位置。本实施例中,全景图像融合模块主页展示的是用户当前位置地区下的所有景区景点列表,以供用户自行选择前往景点扫码打卡。本实施例中,全景影像融合模块具体包括:As shown in FIG3 , the panoramic image fusion module provides the function of fusing panoramic images with user travel photos. Specifically, it is used for users to define and edit, upload photos taken during travel, and select the characters in the photos by themselves. The image fusion algorithm is used to extract the characters in the photos and fuse them to the corresponding positions on the panoramic pictures and videos obtained by punching in. In this embodiment, the homepage of the panoramic image fusion module displays a list of all scenic spots in the user's current location area, so that users can choose to scan the code to punch in at the scenic spot. In this embodiment, the panoramic image fusion module specifically includes:

全景融合单元,用于供用户自行框选照片中的人物,采用图像融合算法,将照片中的人物提取,融合到所打卡获得的全景图片、视频上相应位置,并且也可添加装饰组件,增强用户旅游过程的体验感。装饰组件包括文字、饰品和表情贴图等。The panoramic fusion unit allows users to select people in the photo by themselves, and uses image fusion algorithms to extract people from the photo and fuse them into the corresponding positions on the panoramic pictures and videos obtained by checking in. It can also add decorative components to enhance the user's travel experience. Decorative components include text, accessories, and emoticon stickers.

其中,如图4所示,图像融合算法具体包括以下步骤:As shown in FIG4 , the image fusion algorithm specifically includes the following steps:

S1,将全景柱面图与用户上传的旅游照片采用SIFT((尺度不变特征转换,ScaleInvariant Feature Transform))进行特征点提取;S1, extract feature points from the panoramic cylindrical image and the tourist photos uploaded by the user using SIFT (Scale Invariant Feature Transform);

S2,检测所述特征点以进行图像配准,建立用户上传的旅游照片和全景图片特征之间的相关性,建立图像之间的几何对应关系,重新投影用户上传的照片并将其放在全景图片画布上;S2, detecting the feature points to perform image registration, establishing correlation between features of the travel photos uploaded by the user and the panoramic picture, establishing a geometric correspondence between the images, re-projecting the photos uploaded by the user and placing them on the panoramic picture canvas;

S3,在重叠区域中使用加权平均颜色值来融合重叠像素,混合像素颜色以避免接缝。S3, uses weighted average color values in overlapping areas to blend overlapping pixels and mix pixel colors to avoid seams.

如图5所示,全景视频制作单元,用于以全景视频的形式记录用户的旅游足迹和旅游见闻。本实施例中,全景视频制作单元具体包括视频编辑单元、特效处理单元、社交互动单元和音乐编辑单元,其中,视频编辑单元,用于对全景视频的编辑、制作,具体是由用户自行上传不同角度拍摄的视频,最终拼接成全景视频,或者是通过打卡获得全景图片、全景视频融合用户上传的旅游照片做成全景短视频,动态展示用户的旅游足迹。特效处理单元用于提供全景视频丰富的滤镜、视频特效处理,增强视频相册的视觉效果;音乐编辑单元用于支持用户搜索网络音乐也支持添加本地音乐,提供音乐剪辑功能,用作旅游全景短视频的背景音乐。社交互动单元用于提供用户全景视频的分享和查阅功能,具体地,社交互动单元用于供用户将制作好的全景短视频分享到视频软件中,也可在视频软件中查看他人发布的全景短视频,为用户的旅游规划提供良好的参照和决策依据。As shown in FIG5 , the panoramic video production unit is used to record the user's travel footprints and travel experiences in the form of panoramic videos. In this embodiment, the panoramic video production unit specifically includes a video editing unit, a special effect processing unit, a social interaction unit and a music editing unit, wherein the video editing unit is used to edit and produce panoramic videos, specifically, videos shot from different angles are uploaded by the user, and finally spliced into a panoramic video, or a panoramic picture is obtained by punching in, and the panoramic video is integrated with the travel photos uploaded by the user to make a panoramic short video, which dynamically displays the user's travel footprint. The special effect processing unit is used to provide rich filters and video special effects processing for panoramic videos to enhance the visual effects of video albums; the music editing unit is used to support users to search for online music and also supports adding local music, providing music editing functions, which are used as background music for travel panoramic short videos. The social interaction unit is used to provide users with sharing and viewing functions for panoramic videos. Specifically, the social interaction unit is used for users to share the prepared panoramic short videos to the video software, and can also view the panoramic short videos posted by others in the video software, providing a good reference and decision-making basis for users' travel planning.

用户在进入本发明的系统后,视频软件的主页推送热门的全景短视频作品,提供抖音版景点的远程体验全景预览,在WiFi情况下自动播放,数据浏览下提示是否继续浏览,且用户上滑和下滑可切换全景短视频。且,用户一打开视频软件就直接进入全景短视频播放界面,整体界面为竖向全屏播放,内容随机推送,这就减少了用户选择的负担,增强用户的沉浸式体验。另外也提供用户自行搜索感兴趣的话题观看,吸引用户前往景区实地打卡景点。After the user enters the system of the present invention, the homepage of the video software pushes popular panoramic short video works, provides a remote experience panoramic preview of the Douyin version of the scenic spot, automatically plays in the WiFi condition, prompts whether to continue browsing under data browsing, and the user can switch the panoramic short video by sliding up and down. Moreover, as soon as the user opens the video software, he directly enters the panoramic short video playback interface. The overall interface is vertical full-screen playback, and the content is randomly pushed, which reduces the burden of user selection and enhances the user's immersive experience. In addition, it also provides users with the ability to search for topics of interest and watch them, attracting users to visit scenic spots and check in on the spot.

本发明将虚拟旅游与现实旅游相结合,提供一个综合的智慧旅游平台,增强用户旅游体验的同时,还能为旅游景区景点吸引游客。The present invention combines virtual tourism with real tourism to provide a comprehensive smart tourism platform, which can enhance the user's travel experience while also attracting tourists to tourist attractions.

本发明的各方面、实施例、特征及实例应视为在所有方面为说明性的且不打算限制本发明,本发明的范围仅由权利要求书界定。在不背离所主张的本发明的精神及范围的情况下,所属领域的技术人员将明了其它实施例、修改及使用。The various aspects, embodiments, features and examples of the present invention should be considered as illustrative in all aspects and are not intended to limit the present invention, the scope of the present invention is defined only by the claims. Other embodiments, modifications and uses will be apparent to those skilled in the art without departing from the spirit and scope of the claimed invention.

在本发明案中标题及章节的使用不意味着限制本发明;每一章节可应用于本发明的任何方面、实施例或特征。The use of headings and sections in this disclosure is not meant to limit the disclosure; each section may apply to any aspect, embodiment, or feature of the disclosure.

除非另外具体陈述,否则术语“包含(include、includes、including)”、“具有(have、has或having)”的使用通常应理解为开放式的且不具限制性。Unless specifically stated otherwise, use of the terms "include," "includes," "including," "have," "has," or "having" should generally be construed as open ended and non-limiting.

尽管已参考说明性实施例描述了本发明,但所属领域的技术人员将理解,在不背离本发明的精神及范围的情况下可做出各种其它改变、省略及/或添加且可用实质等效物替代所述实施例的元件。另外,可在不背离本发明的范围的情况下做出许多修改以使特定情形或材料适应本发明的教示。因此,本文并不打算将本发明限制于用于执行本发明的所揭示特定实施例,而是打算使本发明将包含归属于所附权利要求书的范围内的所有实施例。此外,除非具体陈述,否则术语第一、第二等的任何使用不表示任何次序或重要性,而是使用术语第一、第二等来区分一个元素与另一元素。Although the present invention has been described with reference to illustrative embodiments, it will be appreciated by those skilled in the art that various other changes, omissions and/or additions may be made without departing from the spirit and scope of the present invention and that the elements of the embodiments may be replaced by substantial equivalents. In addition, many modifications may be made without departing from the scope of the present invention to adapt specific circumstances or materials to the teachings of the present invention. Therefore, it is not intended herein to limit the present invention to the disclosed specific embodiments for performing the present invention, but it is intended that the present invention will include all embodiments within the scope of the appended claims. In addition, unless specifically stated, any use of the terms first, second, etc. does not indicate any order or importance, but rather uses the terms first, second, etc. to distinguish one element from another.

Claims (8)

1.一种基于全景技术的旅游系统,其特征在于,所述系统包括:1. A tourism system based on panoramic technology, characterized in that the system comprises: 全景图像采集模块,用于实时获取景点全景图像数据;Panoramic image acquisition module, used to obtain panoramic image data of scenic spots in real time; 在线全景预览模块,用于获取所述景点全景图像数据,提供用户在线预览每个景点的全景场景及提供景点互动体验;An online panoramic preview module is used to obtain the panoramic image data of the scenic spot, provide users with online preview of the panoramic scene of each scenic spot and provide interactive experience of the scenic spot; 景点打卡模块,用于记录用户到访景点的打卡,并提供打卡景点的全景图片;The scenic spot check-in module is used to record the user's check-in at the scenic spot and provide panoramic pictures of the check-in scenic spot; 全景影像融合模块,用于将用户上传的旅游照片与景点的所述全景图片相融合,形成旅游全景相册;A panoramic image fusion module is used to fuse the tourist photos uploaded by users with the panoramic pictures of the scenic spots to form a tourist panoramic album; 其中,所述全景影像融合模块是采用图像融合算法将旅游照片中的人物提取,融合到所获得的的全景图片上的相应位置,所述图像融合算法包括:The panoramic image fusion module uses an image fusion algorithm to extract the characters in the tourist photos and fuse them to the corresponding positions on the obtained panoramic picture. The image fusion algorithm includes: S1,将全景柱面图与用户上传的旅游照片采用SIFT进行特征点提取;S1, extract feature points from the panoramic cylindrical image and the travel photos uploaded by the user using SIFT; S2,检测所述特征点以进行图像配准,建立用户上传的旅游照片和全景图片特征之间的相关性,建立图像之间的几何对应关系,重新投影用户上传的照片并将其放在全景图片画布上;S2, detecting the feature points to perform image registration, establishing correlation between features of the travel photos uploaded by the user and the panoramic picture, establishing a geometric correspondence between the images, re-projecting the photos uploaded by the user and placing them on the panoramic picture canvas; S3,在重叠区域中使用加权平均颜色值来融合重叠像素。S3, uses weighted average color value to blend overlapping pixels in the overlapping area. 2.根据权利要求1所述的一种基于全景技术的旅游系统,其特征在于,所述全景图像采集模块包括:2. A tourism system based on panoramic technology according to claim 1, characterized in that the panoramic image acquisition module comprises: 全景图像采集单元,用于所述实时获取景点全景图像数据;A panoramic image acquisition unit, used for acquiring panoramic image data of scenic spots in real time; 全景数据存储单元,用于对所述景点全景图像数据进行存储,存储形式包括图片和视频的形式。The panoramic data storage unit is used to store the panoramic image data of the scenic spot, and the storage form includes the form of pictures and videos. 3.根据权利要求1所述的一种基于全景技术的旅游系统,其特征在于,所述在线全景预览模块包括:3. A tourism system based on panoramic technology according to claim 1, characterized in that the online panoramic preview module comprises: 预览单元,用于提供用户在线预览每个景点的全景场景;A preview unit, used to provide users with an online preview of the panoramic scene of each scenic spot; 互动体验单元,用于提供用户景点互动体验;Interactive experience unit, used to provide users with interactive experience of scenic spots; 智能语音讲解单元,用于对景点进行语音介绍。Intelligent voice explanation unit, used for voice introduction of scenic spots. 4.根据权利要求3所述的一种基于全景技术的旅游系统,其特征在于,所述景点互动体验包括供用户点赞和收藏景点,在线进行互动留言,及一键分享景点。4. A tourism system based on panoramic technology according to claim 3, characterized in that the interactive experience of scenic spots includes allowing users to like and collect scenic spots, leave interactive messages online, and share scenic spots with one click. 5.根据权利要求1所述的一种基于全景技术的旅游系统,其特征在于,所述景点打卡模块包括:5. A tourism system based on panoramic technology according to claim 1, characterized in that the scenic spot check-in module comprises: 景点打卡单元,用于记录用户到访景点的打卡,并提供打卡景点的全景图片和视频体验;The scenic spot check-in unit is used to record the user's check-in at the scenic spot and provide panoramic pictures and video experience of the check-in scenic spot; 地图交互单元,用于在用户打卡之前,提供智能路线规划及旅游足迹生成。The map interaction unit is used to provide intelligent route planning and travel footprint generation before users check in. 6.根据权利要求1所述的一种基于全景技术的旅游系统,其特征在于,所述全景影像融合模块包括;6. A tourism system based on panoramic technology according to claim 1, characterized in that the panoramic image fusion module comprises: 全景融合单元,用于将用户上传的旅游照片与景点的所述全景图片、视频相融合,形成所述旅游全景相册;A panoramic fusion unit, used to fuse the tourist photos uploaded by the user with the panoramic pictures and videos of the scenic spots to form the tourist panoramic album; 全景视频制作单元,用于供用户制作旅游全景视频。The panoramic video production unit is used for users to produce panoramic travel videos. 7.根据权利要求6所述的一种基于全景技术的旅游系统,其特征在于,所述全景视频制作单元包括:7. A tourism system based on panoramic technology according to claim 6, characterized in that the panoramic video production unit comprises: 视频编辑单元,用于全景视频的编辑、制作;Video editing unit, used for editing and producing panoramic videos; 特效处理单元,用于提供所述全景视频的特效处理;A special effects processing unit, used to provide special effects processing for the panoramic video; 社交互动单元,用于提供用户对景点的互动,所述互动包括点赞、分享、评论。The social interaction unit is used to provide users with interaction with scenic spots, including liking, sharing, and commenting. 8.根据权利要求1所述的一种基于全景技术的旅游系统,其特征在于,所述图像采集模块以全景相机的形式,架设在景区相应地点,实时获取景点的全景图像数据。8. A tourism system based on panoramic technology according to claim 1, characterized in that the image acquisition module is in the form of a panoramic camera, set up at a corresponding location in the scenic area, and obtains panoramic image data of the scenic spot in real time.
CN202011626596.8A 2020-12-31 2020-12-31 Tourism system based on panoramic technology Active CN112734937B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011626596.8A CN112734937B (en) 2020-12-31 2020-12-31 Tourism system based on panoramic technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011626596.8A CN112734937B (en) 2020-12-31 2020-12-31 Tourism system based on panoramic technology

Publications (2)

Publication Number Publication Date
CN112734937A CN112734937A (en) 2021-04-30
CN112734937B true CN112734937B (en) 2024-06-28

Family

ID=75607954

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011626596.8A Active CN112734937B (en) 2020-12-31 2020-12-31 Tourism system based on panoramic technology

Country Status (1)

Country Link
CN (1) CN112734937B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7425491B2 (en) * 2021-09-16 2024-01-31 ナーブ株式会社 Online event systems, equipment, and programs
CN114143281B (en) * 2021-11-10 2023-03-14 聚好看科技股份有限公司 Document generation method, server and display device
CN118628608A (en) * 2024-04-30 2024-09-10 安徽财经大学 Panoramic image multi-source information fusion system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101937535A (en) * 2010-09-21 2011-01-05 上海杰图度假网络科技有限公司 Panoramic electronic map-based virtual tourism platform system
CN107203646A (en) * 2017-07-12 2017-09-26 三星电子(中国)研发中心 A kind of intelligent social sharing method and device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106558087B (en) * 2015-09-30 2020-10-23 捷荣科技集团有限公司 A virtual tourism method and system based on human body model
CN107590754A (en) * 2017-11-01 2018-01-16 首都师范大学 A kind of system and method based on augmented reality lifting national park Tourist Experience
CN111026261A (en) * 2018-10-09 2020-04-17 上海奈飒翱网络科技有限公司 Method for AR interactive display of tourist attractions
CN109614558B (en) * 2018-12-10 2021-01-12 湘潭大学 A method and system for automatically generating multi-location travel logs
CN110930517A (en) * 2019-08-19 2020-03-27 泉州师范学院 A panoramic video interactive system and method
CN110673734B (en) * 2019-09-30 2023-12-01 京东方科技集团股份有限公司 Virtual travel method, client, server, system and image acquisition equipment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101937535A (en) * 2010-09-21 2011-01-05 上海杰图度假网络科技有限公司 Panoramic electronic map-based virtual tourism platform system
CN107203646A (en) * 2017-07-12 2017-09-26 三星电子(中国)研发中心 A kind of intelligent social sharing method and device

Also Published As

Publication number Publication date
CN112734937A (en) 2021-04-30

Similar Documents

Publication Publication Date Title
US20170257414A1 (en) Method of creating a media composition and apparatus therefore
CN112734937B (en) Tourism system based on panoramic technology
US20150058709A1 (en) Method of creating a media composition and apparatus therefore
US8405740B2 (en) Guidance for image capture at different locations
US9282250B2 (en) Photography apparatus, control method, program, and information processing device
CN107172476B (en) System for recording video resume by interactive script and implementation method
CN106170101B (en) Contents providing system, information processing equipment and content reproducing method
US20120327265A1 (en) Imaging device providing capture location guidance
US20190205086A1 (en) Image tagging with audio files in a wide area network
US20120327257A1 (en) Photo product using images from different locations
JP2003158655A (en) Image pickup device
Lee Digital cameras, personal photography and the reconfiguration of spatial experiences
CN102867280A (en) Virtual tourism platform construction device and application thereof
CN110930517A (en) A panoramic video interactive system and method
JP6095618B2 (en) Information processing apparatus, information processing method, and information processing program
WO2013116163A1 (en) Method of creating a media composition and apparatus therefore
JP5800319B2 (en) Video distribution system for souvenirs
CN110248207B (en) Image reality display server, image reality display method, recording medium and image reality display system
JP2010045436A (en) Camera and photographing system
KR20200101583A (en) Method, device and program for producing VR video contents
JP2016224658A (en) Electronic album creation device
JP2005196615A (en) Information processing system and information processing method
CN202771484U (en) Construction device of virtual travel platform
WO2021075279A1 (en) Information processing device and method, and program
KR102248676B1 (en) Creative Literature Book Generation System and Its Service Method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant