JP2017138719A - Information processing system, information processing method, and information processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily retrieve the latest entire celestial sphere panoramic image which satisfies a user desired retrieval condition from a plurality of entire celestial sphere panoramic images.SOLUTION: An information processing system 10 includes a server device 12, and an information processing terminal 18. The server device 12 includes an acquisition part 12Q, a retrieval part 12R, and a transmission part 12G. The server device 12 acquires retrieval information including a retrieval condition of an entire celestial sphere panoramic image obtained by photographing an omnidirectional range from the information processing device 18. The retrieval part 12R retrieves the latest entire celestial sphere panoramic image corresponding to a retrieval condition included in the acquired retrieval information from a storage part 12B storing a plurality of entire celestial sphere panoramic images. The transmission part 12G transmits the retrieved entire celestial sphere panoramic image to the information processing terminal 18.SELECTED DRAWING: Figure 11

Description

  The present invention relates to an information processing system, an information processing method, and an information processing program.

  A technique for handling an omnidirectional panoramic image obtained by shooting in an omnidirectional range is disclosed. For example, Patent Document 1 discloses a technique for displaying an omnidirectional panoramic image and a thumbnail of the omnidirectional panoramic image. Patent Document 1 discloses that when a user selects a displayed thumbnail, an omnidirectional panoramic image corresponding to the selected thumbnail is displayed.

  However, with the conventional technology, it has been difficult to easily search the latest omnidirectional panoramic image satisfying the user's desired search condition from among a plurality of omnidirectional panoramic images.

  The present invention has been made in view of the above, and an object thereof is to easily search the latest omnidirectional panoramic image satisfying a user-desired search condition from a plurality of omnidirectional panoramic images.

  In order to solve the above-described problems and achieve the object, the present invention is an information processing system including a server device and an information processing terminal capable of communicating with the server device, and the server device is omnidirectional. The search information including the search conditions for the omnidirectional panoramic image obtained by shooting in the range of is acquired from the acquisition unit that acquires from the information processing terminal and the storage unit that stores the plurality of omnidirectional panoramic images A search unit that searches for the latest panoramic image corresponding to the search condition included in the search information, and a transmission unit that transmits the searched panoramic image to the information processing terminal. Information processing system.

  According to the present invention, it is possible to easily search the latest omnidirectional panoramic image satisfying a user-desired search condition from a plurality of omnidirectional panoramic images.

FIG. 1 is a schematic diagram of an information processing system according to the present embodiment. FIG. 2 is a schematic external view of the photographing apparatus. FIG. 3 is a diagram illustrating an example of a usage state of the imaging apparatus. FIG. 4 is an explanatory diagram of an example of creating an omnidirectional panoramic image. FIG. 5 is an explanatory diagram of an example of creating an omnidirectional panoramic image. FIG. 6 is an explanatory diagram of the positional relationship of the predetermined areas. FIG. 7 is an explanatory diagram of the positional relationship of the predetermined areas. FIG. 8 is a schematic diagram illustrating a hardware configuration of the photographing apparatus. FIG. 9 is a hardware configuration diagram of the server device and the information processing terminal. FIG. 10 is an explanatory diagram showing an example of an outline of the flow of information processing. FIG. 11 is a schematic diagram illustrating a functional configuration of the information processing system. FIG. 12 is a schematic diagram illustrating an example of the data configuration of each of the image management DB, the drawing management DB, and the authority management DB. FIG. 13 is a schematic diagram illustrating an example of a display image. FIG. 14 is a schematic diagram illustrating an example of a display screen. FIG. 15 is a schematic diagram illustrating an example of a display screen. FIG. 16 is a schematic diagram illustrating an example of an operation screen. FIG. 17 is a sequence diagram illustrating an example of the flow of data registration processing. FIG. 18 is a sequence diagram illustrating an example of the flow of search processing. FIG. 19 is a flowchart illustrating an example of a procedure of storage / retrieval processing. FIG. 20 is a flowchart illustrating an example of a display processing procedure.

  Embodiments of the present invention will be described below.

  FIG. 1 is a schematic diagram of an information processing system 10 according to the present embodiment.

  The information processing system 10 includes a server device 12, a photographing device 14, and an information processing terminal 18. The server device 12, the imaging device 14, and the information processing terminal 18 are connected to be communicable with each other via a communication unit such as the network 20.

  For the communication unit, for example, a short-range wireless technology, a wireless communication network using a mobile communication system, and the Internet are used. Examples of the short-range wireless technology include Wi-Fi (Wireless Fidelity). Examples of wireless communication networks based on mobile communication systems include LTE (Long Term Evolution), NFC (Near Field Communication), WiMAX (World Wide Interoperability for Microwave Access) and the like.

  The imaging device 14 captures an omnidirectional range to obtain an omnidirectional panoramic image. The server device 12 manages the omnidirectional panoramic image. The information processing terminal 18 displays the omnidirectional panoramic image desired by the user among the omnidirectional panoramic images managed by the server device 12.

  In the present embodiment, as an example, it is assumed that each of the imaging device 14 and the information processing terminal 18 is installed in a specific installation area B. The installation area B is, for example, a specific store, a specific building, a specific floor (floor) in the building, a specific room in the building, or the like.

  In the present embodiment, it is assumed that the imaging device 14, the information processing terminal 18, and the server device 12 are installed in different installation areas B. Specifically, a case will be described in which the imaging device 14 is installed in the installation area B1, the information processing terminal 18 is installed in the installation area B2, and the server apparatus 12 is installed in the installation area B3.

  The imaging device 14 is installed in advance by a user who manages the installation area B1 in, for example, an installation area B1 such as a store. In the installation area B1, for example, one or a plurality of shelves D are installed, and an entrance / exit E is provided. In the present embodiment, a case where a plurality of (five) photographing devices 14 are installed in the installation area B1 will be described as an example. Note that the number of the imaging devices 14 included in the information processing system 10 is not limited. The imaging device 14 can also be used as a monitoring camera for monitoring the installation area B1, for example.

  The installation area B2 where the information processing terminal 18 is installed is, for example, a room where the user operates the information processing terminal 18. The installation area B3 where the server device 12 is installed is, for example, a management company of the information processing system 10.

  Note that at least one of the plurality of photographing devices 14 may be installed in different installation areas B. Further, at least one of the plurality of photographing devices 14 and the information processing terminal 18 may be installed in the same installation area B. In addition, at least one of the imaging device 14 and the information processing terminal 18 may be configured to be portable, and may be moved by being carried by a user or the like.

  In FIG. 1, three installation areas B are shown to simplify the description. However, the information processing system 10 has a configuration in which one or more of the imaging device 14, the information processing terminal 18, and the server device 12 are arranged in each of two or less or four or more installation areas B. May be.

  FIG. 1 illustrates a case where the number of each of the server device 12 and the information processing terminal 18 included in the information processing system 10 is one. However, the number of server apparatuses 12 and information processing terminals 18 may be plural.

  First, the imaging device 14 will be described.

  The photographing device 14 is a photographing device that obtains an omnidirectional panoramic image by photographing. The omnidirectional panoramic image is a panoramic image obtained by photographing the entire celestial sphere (360 °).

  FIG. 2 is an example of a schematic external view of the photographing apparatus 14. FIG. 2A is a side view of the photographing apparatus 14. FIG. 2B is a side view of the imaging device 14 on the side opposite to FIG. FIG. 2C is a plan view of the imaging device 14.

  As shown in FIG. 2A, the photographing device 14 has a size that a human can hold with one hand, for example. Note that the size of the imaging device 14 is not limited to such a size.

  As shown in FIG. 2, a lens 14 </ b> A is provided on the front side (one surface side) and a lens 14 </ b> B is provided on the back side (the other surface side). The lens 14A and the lens 14B are wide-angle lenses each having an angle of view of 180 ° or more. In the present embodiment, the lens 14A and the lens 14B will be described as fish-eye lenses that are one of wide-angle lenses. In the imaging device 14, an image is guided through each of the lens 14 </ b> A and the lens 14 </ b> B, and an image is formed on an imaging element corresponding to each of the images. Examples of the image sensor include a CCD and a CMOS. 2B, an operation unit 14C such as a shutter button may be provided on the front side of the photographing apparatus 14.

  Next, an example of the usage status of the imaging device 14 will be described. FIG. 3 is a diagram illustrating an example of a usage state of the imaging device 14. As shown in FIG. 3, when the user takes a picture with the photographing apparatus 14 in his / her hand, the omnidirectional (360 °) around the user is photographed. In this case, the images guided from the lens 14A and the lens 14B are detected by the respective image sensors, so that the subject around the user is imaged and two hemispherical images are obtained. An omnidirectional panoramic image is created from these two hemispherical images.

  Next, an outline of the processing from the creation of a panoramic image from a hemispheric image photographed by the photographing device 14 will be described. 4 and 5 are explanatory diagrams of an example of creation of an omnidirectional panoramic image. 4A is a hemispheric image (front side) photographed by the photographing apparatus 14, FIG. 4B is a hemispheric image photographed by the photographing apparatus 14 (rear side), and FIG. 4C is represented by Mercator projection. FIG. 6 is a schematic diagram illustrating an example of an image (hereinafter referred to as “Mercatl image”). FIG. 5 is a diagram illustrating an example of the omnidirectional panoramic image 60.

  As shown in FIG. 4A, since the lens 14A is a fisheye lens, the image obtained by the lens 14A is a curved hemispherical image (front side). Further, as shown in FIG. 4B, since the lens 14B is a fisheye lens, the image obtained by the lens 14B is a curved hemispherical image (rear side). Then, the hemispherical image (front side) and the hemispherical image (rear side) are combined by the photographing device 14 to create a Mercator image (see FIG. 4C).

  In the imaging device 14, the Mercator image is pasted so as to cover the spherical surface by using OpenGL ES (Open Graphics Library for Embedded Systems). Thereby, the imaging device 14 creates an omnidirectional panoramic image 60 as shown in FIG. Thus, the omnidirectional panoramic image 60 is represented as an image in which the Mercator image faces the center of the sphere. Note that OpenGL ES is a graphics library used to visualize 2D (2-Dimensions) and 3D (3-Dimensions) data.

  Returning to FIG. 1, the imaging device 14 transmits the omnidirectional panoramic image 60 to the server device 12. In the present embodiment, description will be made assuming that the imaging device 14 generates the omnidirectional panoramic image 60 by synthesizing the hemispherical images. However, the server device 12 may create the omnidirectional panoramic image 60 by synthesizing the hemispherical images received from the imaging device 14.

  Here, the omnidirectional panoramic image 60 is an image pasted so as to cover the spherical surface as described above. For this reason, when a human visually recognizes, there may be a sense of incongruity. Therefore, it is preferable to display a predetermined region of the omnidirectional panoramic image 60 as a flat image with little curvature. Thereby, it is possible to perform a display that does not give a sense of incongruity to humans.

  6 and 7 are explanatory diagrams of the positional relationship between the omnidirectional panoramic image 60 assumed to be a three-dimensional solid sphere and the predetermined region S. FIG.

  It is assumed that the omnidirectional panoramic image 60 is a three-dimensional solid sphere (solid sphere CS) as shown in FIGS. In this case, the virtual photographing device P is positioned at the center of the solid sphere CS. The virtual photographing device P corresponds to the viewpoint position of the user who visually recognizes the omnidirectional panoramic image 60 displayed as the three-dimensional solid sphere CS.

  Then, a coordinate system with this center as the origin is constructed. The predetermined area S has a shooting angle of view when the virtual shooting device P installed at the center of the three-dimensional sphere CS shoots the three-dimensional spherical panoramic image 60 with a narrower angle of view than the omnidirectional panoramic image 60. The corresponding area.

  The predetermined area S is specified by the predetermined area information. In the present embodiment, the predetermined area information includes coordinates (x, y) and a shooting angle of view α.

  The coordinates (x, y) included in the predetermined area information indicate the center position CP of the predetermined area S in the solid sphere CS when the position of the center of the solid sphere CS (virtual imaging device P) is the origin. The shooting angle of view α is specified by the shooting magnification (zoom) of the virtual shooting device P. The predetermined area information may further include shooting posture information indicating the posture of the virtual shooting device P. The shooting posture information of the virtual shooting device P is specified by the rotation angles (yaw, pitch, roll) of each of the three axes constituting the coordinate system with the center of the solid sphere CS as the origin.

  In the information processing system 10 of the present embodiment, the predetermined area S in the omnidirectional panoramic image 60 is used as the display image 71 displayed on the information processing terminal 18 or the like. For this reason, the information processing system 10 has a configuration capable of displaying without giving a sense of incongruity to humans.

  In the present embodiment, the imaging device 14 transmits predetermined area information set in advance in the imaging device 14 to the server device 12. That is, the predetermined area information transmitted from the photographing apparatus 14 to the server apparatus 12 is initial area information set as an initial setting. The predetermined area information can be changed by an operation instruction by a user operating the information processing terminal 18.

  Next, the hardware configuration of the imaging device 14 will be described.

  FIG. 8 is a schematic diagram illustrating a hardware configuration of the imaging device 14. The imaging device 14 includes an imaging unit 101, an image processing unit 104, an imaging control unit 105, a microphone 108, a sound processing unit 109, a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, an SRAM (Static Random Access Memory). 113, a DRAM (Dynamic Random Access Memory) 114, an operation unit 115, a network I / F 116, a communication unit 117, an antenna 117 a, and an electronic compass 118.

  The imaging unit 101 includes a lens 14A, a lens 14B, an imaging element 13A, and an imaging element 13B. The image sensor 13A is provided corresponding to the lens 14A. The image sensor 13B is provided corresponding to the lens 14B. The image sensor 13A and the image sensor 13B convert an optical image obtained by each of the lens 14A and the lens 14B into image data of an electric signal and output it.

  Each of the image sensor 13A and the image sensor 13B is connected to the image processing unit 104 by a parallel I / F bus. In addition, the image pickup device 13A and the image pickup device 13B are connected to the image pickup control unit 105 through a serial I / F bus (I2C bus or the like). The image processing unit 104 and the imaging control unit 105 are connected to the CPU 111 via the bus 110. Furthermore, ROM 112, SRAM 113, DRAM 114, operation unit 115, network I / F 116, and the like are also connected to the bus 110.

  The image processing unit 104 takes in the image data of the hemispherical image output from the image sensor 13A and the image sensor 13B through the parallel I / F bus. Then, the image processing unit 104 synthesizes the image data of these hemispherical images to create an omnidirectional panoramic image 60.

  The imaging control unit 105 sets commands and the like in the register groups of the imaging element 13A and the imaging element 13B using the I2C bus with the imaging control unit 105 as a master device and the imaging element 13A and the imaging element 13B as slave devices. Necessary commands and the like are received from the CPU 111. Further, the imaging control unit 105 uses the I2C bus to capture status data and the like of the register groups of the imaging device 13A and the imaging device 13B and send them to the CPU 111.

  The imaging control unit 105 also functions as a synchronization control unit that synchronizes the output timing of the image data of the hemispherical images of the imaging element 13A and the imaging element 13B in cooperation with the CPU 111. In the present embodiment, the imaging device 14 is not provided with a display unit, but a display unit may be provided.

  The microphone 108 converts sound into sound (signal) data. The sound processing unit 109 takes in the sound data output from the microphone 108 through the I / F bus and performs predetermined processing on the sound data.

  The CPU 111 controls the overall operation of the photographing apparatus 14 and executes necessary processes. The ROM 112 stores various programs for the CPU 111. The SRAM 113 and the DRAM 114 are work memories, and store programs executed by the CPU 111 and data being processed. The DRAM 114 stores image data being processed by the image processing unit 104 and the processed panoramic image 60.

  The network I / F 116 is a general term for an interface circuit (USB I / F or the like) with an external medium such as an SD card or a personal computer. The network I / F 116 may be a network interface regardless of wireless or wired. The spherical panoramic image 60 stored in the DRAM 114 is recorded on an external medium via the network I / F 116 or transmitted to an external device such as the communication terminal 15 via the network I / F 116.

  The communication unit 117 communicates with an external device such as the communication terminal 15 by using a short-range wireless technology such as Wi-Fi or NFC via an antenna 117 a provided in the photographing device 14. The communication unit 117 may transmit the omnidirectional panoramic image 60 to an external device of the communication terminal 15.

  The electronic compass 118 detects photographing posture information indicating the posture (rotation angle (yaw, pitch, roll)) of the photographing device 14 from the earth's magnetism.

  Next, the hardware configuration of the server device 12 and the information processing terminal 18 will be described. FIG. 9 is an example of a hardware configuration diagram of the server device 12 and the information processing terminal 18.

  The server device 12 and the information processing terminal 18 include a CPU 501, a ROM 502, a RAM 503, an HDD (Hard Disk Drive) 505, a media drive 507, a display 508, a network I / F 509, a keyboard 511, a mouse 512, and a CD-ROM drive 514. The configuration is connected via a bus 510. The media drive 507 reads or writes (stores) data on a recording medium 506 such as a flash memory. The CD-ROM drive 514 reads or writes various data with respect to a CD-ROM (Compact Disc Read Only Memory) 513 as an example of a removable recording medium. Note that the server device 12 and the information processing terminal 18 may have a configuration including a touch panel in which a display 508, a keyboard 511, and a mouse 512 are integrally configured.

  Next, an outline of the flow of information processing performed by the information processing system 10 according to the present embodiment will be described. FIG. 10 is an explanatory diagram showing an example of an overview of the flow of information processing performed by the information processing system 10.

  In the present embodiment, the imaging device 14 transmits the omnidirectional panoramic image 60 obtained by imaging and the related information 61 corresponding to the omnidirectional panoramic image 60 via the communication terminal 15 and the wireless router 16. And transmitted to the server device 12 (step S1, step S2).

  In the present embodiment, the imaging device 14 is described as being fixed at a predetermined position in the installation area B1. Further, the description will be made assuming that the imaging device 14 performs continuous imaging and sequentially transmits each of the omnidirectional panoramic images 60 obtained by the continuous imaging to the server device 12.

  That is, in the present embodiment, the imaging device 14 is described as transmitting a moving image that is a plurality of (multiple frames) omnidirectional panoramic images 60 that are continuous in time series to the server device 12.

  In addition, the imaging device 14 transmits related information 61 corresponding to the omnidirectional panoramic image 60 to the server device 12 together with the omnidirectional panoramic image 60. That is, the imaging device 14 transmits the related information 61 corresponding to each omnidirectional panoramic image 60 of each frame together with the omnidirectional panoramic image 60 to the server device 12.

  The related information 61 includes shooting date / time information indicating the shooting date / time of the corresponding omnidirectional panoramic image 60, shooting device identification information (hereinafter referred to as shooting device ID), and predetermined area information.

  The imaging device ID included in the related information 61 is identification information for identifying the imaging device 14 that has captured the panoramic image 60 corresponding to the related information 61. The predetermined area information included in the related information 61 is predetermined area information (coordinates (x, y), shooting angle of view α) as an initial setting.

  When the server device 12 receives the omnidirectional panoramic image 60 and the related information 61 from the imaging device 14, the server device 12 performs a storage process for storing the omnidirectional panoramic image 60 and the related information 61 (step S3).

  The information processing terminal 18 transmits the search information including the search conditions for the omnidirectional panoramic image 60 to the server device 12 by receiving the user's operation instruction (step S4). The search condition is specified by the user (details will be described later).

  The server device 12 executes a search process for searching for the latest panoramic image 60 corresponding to the search condition included in the search information received from the information processing terminal 18 (step S5). And the server apparatus 12 produces | generates the display screen data which shows the display screen of the searched omnidirectional panoramic image 60, and transmits to the information processing terminal 18 (step S6). Therefore, the information processing terminal 18 can display the latest omnidirectional panoramic image 60 according to the transmitted search condition.

  Next, the function of each device constituting the information processing system 10 of the present embodiment will be described in detail.

  FIG. 11 is a schematic diagram illustrating functional configurations of the server device 12, the imaging device 14, the communication terminal 15, and the information processing terminal 18 in the information processing system 10.

  The imaging device 14 includes an imaging unit 14E, a storage unit 14F, a connection unit 14G, and a storage / readout unit 14I. The imaging unit 14E acquires image data of a hemispheric image by imaging and stores it in the storage unit 14F. The imaging unit 14E reads out image data of a pair of hemispheric images at the same imaging timing from the storage unit 14F, and generates an omnidirectional panoramic image 60. Further, the storage / reading unit 14I reads out the shooting date / time information of the generated omnidirectional panoramic image 60, the shooting device ID of the shooting device 14, and the predetermined area information from the storage unit 14F as related information 61. Then, the connecting unit 14G transmits the omnidirectional panoramic image 60 generated by the storage / reading unit 14I and the related information 61 to the communication terminal 15.

  The communication terminal 15 includes a connection unit 15A and a transmission / reception unit 15B. The connection unit 15A is connected to the connection unit 14G of the imaging device 14. The connection unit 15 </ b> A receives the omnidirectional panoramic image 60 and the related information 61 from the imaging device 14. The transmission / reception unit 15B communicates with the imaging device 14 via the connection unit 15A. The transmission / reception unit 15 </ b> B communicates with the server device 12 via the network 20. In the present embodiment, the transmission / reception unit 15B transmits the omnidirectional panoramic image 60 and the related information 61 acquired from the imaging device 14 via the connection unit 15A to the server device 12 via the network 20.

  The server device 12 includes a control unit 12A and a storage unit 12B. The control unit 12A and the storage unit 12B are connected so as to be able to exchange data and signals.

  The storage unit 12B stores various data. The storage unit 12B stores, for example, an image management DB (database) 12C, a drawing management DB 12D, and an authority management DB 12E. The image management DB 12C stores an omnidirectional panoramic image 60 and thumbnail images. The drawing management DB 12D stores drawing images (details will be described later).

  FIG. 12 is a schematic diagram illustrating an example of the data configuration of each of the image management DB 12C, the drawing management DB 12D, and the authority management DB 12E. Various types of information are registered in the image management DB 12C and the drawing management DB 12D by the processing of the control unit 12A (details will be described later).

  FIG. 12A is a schematic diagram illustrating an example of a data configuration of the image management DB 12C. The image management DB 12C is a database for managing the omnidirectional panoramic image 60 acquired from the imaging device 14. The data configuration of the image management DB 12C is not limited to a database, and may be a table or the like.

  The image management DB 12C associates a photographing device ID, an image ID, photographing date / time information, a panoramic image 60, predetermined area information, a thumbnail ID, a thumbnail image, and a search condition. is there.

  The image ID is identification information for identifying the corresponding omnidirectional panoramic image 60. The shooting date / time information is information indicating the shooting date / time of the corresponding panoramic image 60. The thumbnail image is a thumbnail of the corresponding omnidirectional panoramic image 60. The thumbnail image is, for example, an image obtained by reducing the omnidirectional panoramic image 60 or an image obtained by reducing the predetermined area S of the omnidirectional panoramic image 60.

  The search condition indicates a condition for searching the omnidirectional panoramic image 60 managed by the server device 12. In the present embodiment, the search condition includes person information, posture information, and drawn image identification information (hereinafter referred to as a drawn image ID).

  The person information is information indicating that a person is included in the omnidirectional panoramic image 60. In the present embodiment, the server device 12 registers information indicating the presence or absence of a person in the image management DB 12C as person information. For example, the number of persons included in the corresponding omnidirectional panoramic image 60 is registered as person information in the image management DB 12C. The person information “0” indicates that no person is included in the corresponding omnidirectional panoramic image 60. Further, when the person information is an integer of “1” or more, it indicates that the corresponding omnidirectional panoramic image 60 includes one or more persons. If the person information is an integer equal to or greater than “1”, it indicates that the number of persons indicated by the person information is included in the corresponding omnidirectional panoramic image 60.

  The posture information is information indicating the posture of a person included in the omnidirectional panoramic image 60. The posture of the person can be, for example, a state where the person is sitting, a state where the person is squatting, a state where the hand is raised, a state where the hand is extended, a state where the leg is raised, a forward-facing state, a state where the person is looking up, etc. Can be mentioned. Note that the posture of the person is not limited to these.

  In the present embodiment, the server device 12 defines posture identification information (a, b, c, d,...) Indicating each of a plurality of predetermined postures. An example in which posture identification information is registered as posture information in the image management DB 12C will be described.

  The drawing image ID is drawing image information indicating a drawing image drawn on the omnidirectional panoramic image 60. In the present embodiment, a case will be described in which identification information for identifying a drawing image is used as the drawing image ID. The drawn image is an image drawn on the omnidirectional panoramic image 60 by an operation by the user of the information processing terminal 18 described later. The drawing image is an image such as a character or a line input by handwriting by a user, or an image such as a character or a line created in advance. The drawn image may be referred to as a sketch.

  Note that, as the drawing image information indicating the drawing image, information indicating the feature of the drawing image may be used instead of the drawing image ID. For example, information indicating features that can be extracted by known image processing from the color, shape, and the like of the drawn image may be used as the drawn image information.

  Each information is registered in the image management DB 12C by the processing of the control unit 12A.

  Next, the drawing management DB 12D will be described. FIG. 12B is a schematic diagram illustrating an example of a data configuration of the drawing management DB 12D. The drawing management DB 12D is a database for managing drawing images. The data configuration of the drawing management DB 12D is not limited to the database, and may be a table or the like.

  The drawing management DB 12D associates a photographing apparatus ID, an image ID, a drawing image ID, drawing date information, and a drawing image. The drawing date / time information is information indicating the date / time when the corresponding drawing image was created (drawn).

  Next, the authority management DB 12E will be described. FIG. 12C is a schematic diagram illustrating an example of a data configuration of the authority management DB 12E. The authority management DB 12E is a database for managing the viewing authority of the omnidirectional panoramic image 60. The data configuration of the authority management DB 12E is not limited to a database, and may be a table or the like.

  The authority management DB 12E associates a user ID with browsing authority information. The user ID is identification information of a user who operates the information processing terminal 18. The browsing authority information is information indicating the browsing authority previously given to the user identified by the corresponding user ID. In the present embodiment, a case where a photographing apparatus ID is registered as browsing authority information will be described.

  Therefore, the user can browse the omnidirectional panoramic image 60 captured by the imaging device 14 identified by the imaging device ID registered in the viewing authority information corresponding to the user ID of the user. It is.

  The browsing authority information may be information indicating the browsing authority for the omnidirectional panoramic image 60. For example, as the viewing authority information, the shooting date range (period) of the omnidirectional panoramic image 60, the image ID of the omnidirectional panoramic image 60, and the like may be registered in the authority management DB 12E.

  The authority management DB 12E is set in advance and registered in the storage unit 12B in advance. Each information registered in the authority management DB 12E may be changed as appropriate according to an operation instruction by the user.

  Next, the control unit 12A of the server device 12 will be described. The control unit 12A controls the server device 12. The control unit 12A is realized by the CPU 501, the ROM 502, the RAM 503, and the like (see FIG. 9). Note that the control unit 12A may be realized by a circuit or the like.

  A program for executing various processes executed by the server device 12 of the present embodiment is provided by being incorporated in advance in the ROM 503 or the like.

  A program for executing various processes executed by the server device 12 of the present embodiment is a file in a format that can be installed in the server device 12 or an executable format, such as a CD-ROM, a flexible disk (FD), You may comprise so that it may record and provide on computer-readable recording media, such as CD-R and DVD (Digital Versatile Disk).

  Further, the program executed by the server device 12 of the present embodiment may be configured to be stored by being stored on a computer connected to a network such as the Internet and downloaded via the network. In addition, a program for executing each process in the server device 12 of the present embodiment may be configured to be provided or distributed via a network such as the Internet.

  The control unit 12A includes a transmission / reception unit 12F, a detection unit 12I, a thumbnail creation unit 12M, a processing unit 12N, a storage control unit 12P, an acquisition unit 12Q, a search unit 12R, a change unit 12T, and a screen creation unit. 12S. The transmission / reception unit 12F includes a transmission unit 12G and a reception unit 12H. The detection unit 12I includes a person detection unit 12J, a posture detection unit 12K, and a drawing detection unit 12L.

  Transmission / reception unit 12F, transmission unit 12G, reception unit 12H, detection unit 12I, person detection unit 12J, posture detection unit 12K, drawing detection unit 12L, thumbnail creation unit 12M, processing unit 12N, storage control unit 12P, acquisition unit 12Q, search Part or all of the unit 12R, the change unit 12T, and the screen creation unit 12S may be realized by causing a processing device such as the CPU 501 (see FIG. 9) to execute a program (that is, software). Further, it may be realized by hardware such as an IC (Integrated Circuit) or may be realized in combination.

  The transmission / reception unit 12 </ b> F transmits / receives data to / from each of the imaging device 14 and the information processing terminal 18 via the network 20.

  The transmission / reception unit 12F includes a transmission unit 12G and a reception unit 12H. The receiving unit 12H receives the omnidirectional panoramic image 60 and the related information 61 from the imaging device 14 via the communication terminal 15 and the network 20. The receiving unit 12H outputs the received panoramic image 60 and related information 61 to the storage control unit 12P and the thumbnail creation unit 12M. The receiving unit 12H outputs the received panoramic image 60 to the detecting unit 12I and the processing unit 12N.

  In addition, the receiving unit 12H receives from the information processing terminal 18 a drawing image drawn by a user's operation of the information processing terminal 18, an image ID of the omnidirectional panoramic image 60 on which the drawing image is drawn, drawing date and time information, , Receive. The receiving unit 12H outputs the received drawing image, image ID, and drawing date / time information to the detecting unit 12I.

  The storage control unit 12P stores various data in the storage unit 12B, reads various data from the storage unit 12B, and the like.

  Receiving omnidirectional panoramic image 60 and related information 61 from receiving unit 12H, storage control unit 12P stores omnidirectional panoramic image 60 and related information 61 in storage unit 12B. Specifically, the storage control unit 12P registers the received omnidirectional panoramic image 60 in the image management DB 12C (see FIG. 12), assigns an image ID to the omnidirectional panoramic image 60, and sends the image management DB 12C to the image management DB 12C. sign up. In addition, the storage control unit 12P registers the photographing apparatus ID, photographing date information, and predetermined area information included in the related information 61 in the image management DB 12C in association with the image ID.

  The detection unit 12I detects a search condition from the omnidirectional panoramic image 60 received from the imaging device 14 via the reception unit 12H. In the present embodiment, a case will be described in which the detection unit 12I detects person information, posture information, and a drawing image ID as search conditions. Note that the detection unit 12I only needs to detect features that can be detected by analyzing the omnidirectional panoramic image 60 as search conditions, and is not limited to these detection conditions.

  In the present embodiment, detection unit 12I includes a person detection unit 12J, a posture detection unit 12K, and a drawing detection unit 12L.

  The person detecting unit 12J analyzes the received omnidirectional panoramic image 60 to detect the presence / absence of persons included in the omnidirectional panoramic image 60 and person information indicating the number of persons. The person detection unit 12J may detect person information from the omnidirectional panoramic image 60 by a known person recognition technique. The person detection unit 12J outputs the person information to the storage control unit 12P as a search condition detection result.

  The storage control unit 12P registers the person information detected by the person detection unit 12J in the image management DB 12C in association with the image ID of the omnidirectional panoramic image 60 used for the detection of the person information.

  The posture detection unit 12 </ b> K detects the posture information indicating the posture of the person included in the omnidirectional panoramic image 60 by analyzing the received omnidirectional panoramic image 60. A known technique may be used to detect the posture information. In the present embodiment, posture detection unit 12K detects posture identification information corresponding to the detected posture type as posture information. Then, the posture detection unit 12K outputs the posture information to the storage control unit 12P as a search condition detection result.

  The storage control unit 12P registers the posture information detected by the posture detection unit 12K in the image management DB 12C in association with the image ID of the omnidirectional panoramic image 60 used for the detection of the posture information.

  The drawing detection unit 12L receives, from the reception unit 12H, a drawing image drawn by the user's operation of the information processing terminal 18, an image ID of the omnidirectional panoramic image 60 in which the drawing image is drawn, and drawing date / time information. . The drawing detection unit 12L detects the drawing image by receiving the drawing image. Then, the drawing detection unit 12L outputs the accepted drawing image, the image ID of the omnidirectional panorama image 60 on which the drawing image is drawn, and the drawing date / time information to the storage control unit 12P.

  The storage control unit 12P assigns a drawing image ID to the drawing image received from the drawing detection unit 12L, and the drawing image ID, the received drawing date / time information, the received drawing image, and the received image ID. Correspondingly, it is registered in the drawing management DB 12D (see FIG. 12B). Further, the storage control unit 12P reads the image capturing device ID corresponding to the image ID from the image management DB 12C. Then, the storage control unit 12P registers the read photographing apparatus ID in the drawing management DB 12D in association with the corresponding image ID. Further, the storage control unit 12P registers the drawing image ID corresponding to the image ID in the drawing management DB 12D in association with the image management DB 12C.

  In this way, every time the omnidirectional panoramic image 60 and related information 61 are received from the imaging device 14 or a drawing image is received from the information processing terminal 18, the control unit 12A updates the image management DB 12C and the drawing management DB 12D. To do.

  The thumbnail creation unit 12M creates a thumbnail image of the omnidirectional panoramic image 60 received from the reception unit 12H. A known method may be used to create the thumbnail image. For example, the thumbnail creation unit 12M reads predetermined area information corresponding to the omnidirectional panoramic image 60 for which a thumbnail image is to be created in the image management DB 12C. Then, the thumbnail creating unit 12M extracts the predetermined area S indicated by the read predetermined area information from the omnidirectional panoramic image 60 to be created, and creates a thumbnail of the predetermined area image of the predetermined area S, A thumbnail image may be created.

  The thumbnail creation unit 12M outputs the created thumbnail image to the storage control unit 12P. The storage control unit 12P gives a thumbnail ID to the thumbnail image received from the thumbnail creation unit 12M. Then, the storage control unit 12P associates the thumbnail ID and the thumbnail image with the image ID of the omnidirectional panoramic image 60 used to create the thumbnail image, and manages the image management DB 12C (FIG. 12A). ))).

  The processing unit 12N processes a part of the omnidirectional panoramic image 60 registered in the image management DB 12C by the storage control unit 12P. In the present embodiment, the processing unit 12N processes an image area in which the personal information that can be specified included in the omnidirectional panoramic image 60 is difficult to specify the personal information. For example, the processing unit 12N performs blurring processing by blurring an area indicating the personal name, address, company name, face, and the like included in the omnidirectional panoramic image 60. A known method may be used as the processing method.

  Then, the processing unit 12N registers the processed panoramic image 60 in the image management DB 12C. For this reason, the omnidirectional panoramic image 60 processed by the processing unit 12N is registered in the image management DB 12C.

  The processing unit 12N further adjusts the processed omnidirectional panoramic image 60 to a display size that can be displayed on the display unit 18G of the information processing terminal 18, and converts the adjusted omnidirectional panoramic image 60 into an image. You may register into management DB12C. For example, the processing unit 12N may adjust the display size of the panoramic image 60 for each of the information processing terminal 18 as a mobile terminal such as a smartphone and the information processing terminal 18 as a personal computer. .

  The receiving unit 12H further receives search information from the information processing terminal 18. The receiving unit 12H outputs the received search information to the acquiring unit 12Q.

  The acquisition unit 12Q acquires search information from the information processing terminal 18 via the reception unit 12H. The search information includes search conditions for the omnidirectional panoramic image 60. As described above, in the present embodiment, the search condition includes the person information indicating that a person is included, the attitude information indicating the attitude of the person, and the drawing indicating the drawing image drawn on the omnidirectional panoramic image 60. Image information.

  The search information preferably further includes the latest type information in addition to the search condition. The latest type information indicates the first latest information indicating that the shooting timing of the omnidirectional panoramic image 60 is the latest, or the second latest information indicating that the drawing timing of the drawn image is the latest.

  The user operates the information processing terminal 18 to input the first latest information or the second latest information as the latest type information. Thereby, the information processing terminal 18 transmits the search information including the latest type information indicating the first latest information or the second latest information to the server device 12 (details will be described later). Thereby, the acquisition unit 12Q acquires the search information including the latest type information and the search condition from the information processing terminal 18.

  The search information may further include the user ID of the user who operates the information processing terminal 18.

  The search unit 12R searches the storage unit 12B for the latest omnidirectional panoramic image 60 corresponding to the search condition included in the search information acquired by the acquisition unit 12Q.

  Specifically, the search unit 12R reads a search condition included in the search information. Then, the search unit 12R searches the image management DB 12C (see FIG. 12A) for the omnidirectional panoramic image 60 corresponding to the read search condition. The omnidirectional panoramic image 60 corresponding to the search condition is the omnidirectional panoramic image 60 corresponding to the search condition that matches the search condition included in the search information.

  For example, the search unit 12R searches the omnidirectional panoramic image 60 as follows. As described above, the search condition includes at least one of person information, posture information, and drawn image information.

  When the search condition included in the search information acquired by the acquisition unit 12Q includes personal information indicating the presence of a person, the search unit 12R obtains an integer of “person information” from the image management DB 12C of the storage unit 12B. The omnidirectional panoramic image 60 shown is searched. In addition, when the search condition included in the search information acquired by the acquisition unit 12Q includes personal information indicating the number of persons, the search unit 12R reads from the image management DB 12C of the storage unit 12B “person” that matches the number of persons. The omnidirectional panoramic image 60 corresponding to “information” is searched.

  Further, when the search condition included in the search information acquired by the acquisition unit 12Q includes the posture information, the search unit 12R receives the panoramic image 60 corresponding to the posture information from the image management DB 12C of the storage unit 12B. Search for.

  In addition, when the search information included in the search information acquired by the acquisition unit 12Q includes drawing image information, the search unit 12R corresponds to the drawing image ID of the drawing image information from the image management DB 12C of the storage unit 12B. The omnidirectional panoramic image 60 is searched.

  Note that the search unit 12R may search for the omnidirectional panoramic image 60 corresponding to the search condition whose similarity to the search condition included in the search information is greater than or equal to a threshold value. The threshold may be determined in advance.

  Then, the search unit 12R searches for the latest omnidirectional panoramic image 60 from one or more omnidirectional panoramic images 60 corresponding to the search condition. The latest panoramic image 60 indicates the latest shooting timing or the latest drawing timing.

  In the present embodiment, the search unit 12R includes the latest celestial sphere indicated by the latest type information included in the search information among the one or more omnidirectional panoramic images 60 corresponding to the search conditions included in the search information. The panoramic image 60 is searched.

  For example, it is assumed that the latest type information included in the search information is first latest information indicating that the shooting timing of the panoramic image 60 is the latest. In this case, the search unit 12R may search the image management DB 12C for the omnidirectional panoramic image 60 corresponding to the shooting date / time information indicating the latest shooting date / time from the omnidirectional panoramic image 60 corresponding to the search condition. .

  Further, for example, it is assumed that the latest type information included in the search information is second latest information indicating that the drawing timing of the drawn image drawn on the omnidirectional panoramic image 60 is the latest. In this case, the search unit 12R selects, from the drawing management DB 12D and the image management DB 12C, the omnidirectional panoramic image 60 corresponding to the drawing date / time information indicating the latest drawing date / time from the omnidirectional panoramic image 60 corresponding to the search condition. Just search.

  Furthermore, as described above, the search information acquired from the information processing terminal 18 may include a user ID.

  In this case, it is preferable that the search unit 12R searches the omnidirectional panoramic image 60 corresponding to the search condition from the omnidirectional panoramic image 60 for which the user identified by the user ID included in the search information has the viewing authority. .

  Specifically, the search unit 12R reads the browsing authority information corresponding to the user ID included in the search information from the authority management DB 12E (see FIG. 12C). Then, the search unit 12R includes the omnidirectional panorama corresponding to the acquired search condition from the omnidirectional panorama image 60 corresponding to the read browsing authority information (in this embodiment, the imaging device ID) in the authority management DB 12E. The image 60 may be searched.

  By searching the omnidirectional panoramic image 60 according to the search information by the search unit 12R, one latest (one frame) omnidirectional panoramic image 60 corresponding to the search condition acquired from the information processing terminal 18 is searched. .

  Further, when the search information includes a user ID, it corresponds to the search condition among the omnidirectional panoramic images 60 corresponding to the search condition acquired from the information processing terminal 18 and to which the user identified by the user ID has the viewing authority. The latest panoramic image 60 is searched for one frame (one frame).

  Note that the search information may be in a form further including a photographing device ID. In this case, the search unit 12R includes the latest omnidirectional panorama corresponding to the acquired search condition among the omnidirectional panoramic images 60 captured by the imaging device 14 identified by the imaging device ID included in the search information. The image 60 may be searched.

  When the search information includes a plurality of imaging device IDs, the search unit 12R corresponds to the search condition for each of the plurality of imaging devices 14 identified by the plurality of imaging device IDs included in the search information. The latest omnidirectional panoramic image 60 may be searched. For this reason, in this case, the search unit 12R searches for a plurality of (multiple frames) omnidirectional panoramic images 60.

  In the present embodiment, as an example, the server device 12 receives search information including the search condition, the latest type information, the user ID, and the imaging device ID from the information processing terminal 18 via the reception unit 12H. It is assumed that it is acquired.

  The transmission unit 12G transmits the omnidirectional panoramic image 60 searched by the search unit 12R to the information processing terminal 18.

  Here, in the present embodiment, the transmission unit 12G displays the image of the predetermined area S indicated by the predetermined area information corresponding to the omnidirectional panoramic image 60 in the omnidirectional panoramic image 60 searched by the search unit 12R. Then, it is transmitted to the information processing terminal 18 as a display image for display. For example, the transmission unit 12G reads predetermined area information corresponding to the omnidirectional panoramic image 60 searched by the search unit 12R from the image management DB 12C (see FIG. 12A).

  Then, the transmission unit 12G generates a display image by extracting an image in the predetermined area S indicated by the read predetermined area information in the omnidirectional panoramic image 60. Then, the transmitting unit 12G may transmit the display image data of the display image to the information processing terminal 18 as the searched omnidirectional panoramic image 60.

  In addition, the extraction of the image of the predetermined area S in the omnidirectional panoramic image 60 searched by the search unit 12R may be performed by the search unit 12R, or may be performed by the change unit 12T or the screen creation unit 12S described later. .

  FIG. 13 is a schematic diagram illustrating an example of the display image 71. In FIG. 13, a display image 71A and a display image 71B are shown as an example of the display image 71. The display image 71 is an image of the predetermined area S (see FIGS. 6 and 7) in the omnidirectional panoramic image 60.

  As shown in FIG. 13, the processing unit 12 </ b> N performs blurring processing on an image area B that can be specified for personal information such as a human face included in the display image 71.

  Returning to FIG. 11, the changing unit 12T changes the display form of the specific area according to the search condition acquired by the search unit 12R in the omnidirectional panoramic image 60 searched by the search unit 12R. The specific area is an area that matches the search condition acquired by the search unit 12R.

  In the present embodiment, the changing unit 12T extracts the predetermined area S indicated by the corresponding predetermined area information in the image management DB 12C from the omnidirectional panoramic image 60 searched by the search unit 12R, thereby displaying the display image 71 ( 13) is generated. Then, the changing unit 12T changes the display mode of the specific area in the display image 71 according to the search condition acquired by the search unit 12R.

  Changing the display form includes processing such as surrounding the specific area with a frame line, enlarging the specific area, and adjusting the specific area so that it is positioned at the center during display.

  The change of the display form will be described with reference to FIG. For example, it is assumed that the search condition is person information. Then, it is assumed that the search unit 12R searches for the omnidirectional panoramic image 60 shown in FIG. 13A, and the changing unit 12T has created the display image 71A of the predetermined region S in the omnidirectional panoramic image 60. .

  In this case, for example, the changing unit 12T surrounds the specific area M including the person included in the display image 71A with a frame line 62 that surrounds the specific area M. By this processing, the changing unit 12T changes the display form of the specific area M.

  Further, it is assumed that the search condition includes person information and drawing image information. Then, the search unit 12R searches the omnidirectional panoramic image 60 on which the drawing image K is drawn, as shown in FIG. 13B, and the changing unit 12T displays the predetermined area S in the omnidirectional panoramic image 60. Assume that image 71B has been created.

  In this case, for example, the changing unit 12T surrounds each of the specific areas M1 and M2 including the person included in the display image 71B with a frame line 62 that surrounds the specific areas M1 and M2. The changing unit 12T surrounds the specific area M3 including the drawing image K in the display image 71B with a frame line 62 that surrounds the specific area M3. By these processes, the changing unit 12T changes the display form of the specific area M (specific areas M1, M2, and M3).

  In addition, when adjusting so that the specific area M is positioned at the center during display, the changing unit 12T may change the predetermined area S so that the specific area M is positioned at the center of the display image 71. In this case, the changing unit 12T applies the omnidirectional panoramic image 60 whose display form is to be changed in the image management DB 12C (see FIG. 12A) so that the specific area M is located at the center of the display image 71. The corresponding predetermined area information may be changed. Then, the changing unit 12T extracts the predetermined area S indicated by the changed predetermined area information from the omnidirectional panoramic image 60, thereby creating the display image 71 in which the specific area M is located at the center. .

  The screen creation unit 12 </ b> S generates a display screen to be displayed on the information processing terminal 18. The screen creation unit 12S generates a display screen on which the omnidirectional panoramic image 60 searched by the search unit 12R is arranged.

  In the present embodiment, the screen creation unit 12S generates a display screen including the display image 71 that is the predetermined area S in the searched omnidirectional panoramic image 60.

  FIG. 14 is a schematic diagram illustrating an example of the display screen 70. 14A to 14C show an example of the display screen 70 when the omnidirectional panoramic image 60 searched by the search unit 12R is one (one frame).

  For example, it is assumed that the search unit 12R searches the omnidirectional panoramic image 60 shown in FIG. 13A and the change unit 12T creates the display image 71A. In this case, the screen creation unit 12S creates a display screen 70A in which button images 72 are arranged on the display image 71A, as shown in FIG. The button image 72 is an image to be operated when the user instructs to change the predetermined area S, enlarge, reduce, display a thumbnail image, or the like.

  Further, it is assumed that the search unit 12R searches the omnidirectional panoramic image 60 shown in FIG. 13B, and the change unit 12T creates the display image 71B. In this case, the screen creation unit 12S creates a display screen 70B in which the button image 72 is arranged on the display image 71B, as shown in FIG.

  In addition, when the omnidirectional panoramic image 60 that matches the search condition is not stored in the storage unit 12B, the search unit 12R updates the latest of the plurality of omnidirectional panoramic images 60 stored in the storage unit 12B. The omnidirectional panoramic image 60 may be searched. In this case, the screen creation unit 12S may create a display screen 70C in which the button image 72 is arranged on the display image 71C of the omnidirectional panoramic image 60 as shown in FIG. 14C, for example.

  Here, as described above, the search unit 12R may search for the latest omnidirectional panoramic image 60 corresponding to each of the plurality of imaging devices 14. In this case, the search unit 12R searches for a plurality of omnidirectional panoramic images 60.

  In this case, the screen creation unit 12S preferably creates a display screen 70 in which a plurality of omnidirectional panoramic images 60 searched by the search unit 12R are arranged on one screen.

  In the present embodiment, the screen creation unit 12S creates a display screen 70 in which the display images 71 that are the predetermined regions S in each of the plurality of omnidirectional panoramic images 60 searched by the search unit 12R are arranged on one screen. .

  FIG. 15 is a schematic diagram illustrating an example (display screen 70D) of the display screen 70 when the search unit 12R searches for a plurality of panoramic images 60.

  For example, the search unit 12R searches for a plurality of omnidirectional panoramic images 60 (omnidirectional panoramic images 60E to 60H), and the changing unit 12T displays the predetermined area S from each of these omnidirectional panoramic images 60. Assume that an image 71 (display images 71E to 71H) has been created. In this case, as shown in FIG. 15, the screen creation unit 12S arranges the button image 72 on each of the display images 71E to 71H, and then arranges these display images 71E to 71H on one screen. 70D may be created.

  Each of the plurality of display screens 70 (display screen 70E to display screen 70H) in display screen 70D accepts an operation instruction from the user in each display screen 70 when displayed on information processing terminal 18. Is possible.

  For example, the user who operates the information processing terminal 18 operates the display screen 70E on the display screen 70D displayed on the information processing terminal 18, thereby giving various operation instructions to the omnidirectional panoramic image 60E on the display screen 70E. Can be entered.

  Returning to FIG. The transmission unit 12G transmits the omnidirectional panoramic image 60 searched by the search unit 12R to the information processing terminal 18. In the present embodiment, the transmission unit 12G transmits the display screen data of the display screen 70 created by the screen creation unit 12S to the information processing terminal 18 based on the search result by the search unit 12R.

  Next, the functional configuration of the information processing terminal 18 will be described. The information processing terminal 18 includes a transmission / reception unit 18A, a reception unit 18C, a display control unit 18D, a storage / reading unit 18B, a storage unit 18E, an input unit 18F, and a display unit 18G.

  The transmitting / receiving unit 18A, the storage / reading unit 18B, the receiving unit 18C, the display control unit 18D, and the storage unit 18E are connected so as to be able to exchange data and signals.

  The receiving unit 18C is connected to the input unit 18F. 18 C of reception parts receive the operation instruction of the input part 18F by a user. The input unit 18F corresponds to the keyboard 511 and the mouse 512 (see FIG. 9). The display control unit 18D displays various images on the display unit 18G. The display unit 18G corresponds to the display 508 (see FIG. 9). The transmission / reception unit 18 </ b> A communicates with the server device 12 via the network 20. The storage unit 18E stores various data. For example, the storage unit 18E stores the user ID of the user who operates the information processing terminal 18. The storage / reading unit 18B stores various data in the storage unit 18E and reads out various data from the storage unit 18E.

  The user operates the input unit 18F to input search conditions for the omnidirectional panoramic image 60, the latest type information, and the imaging device ID.

  For example, the user inputs the search condition, the latest type information, and the imaging device ID while referring to the operation screen 50 displayed on the display unit 18G.

  FIG. 16 is a schematic diagram illustrating an example of the operation screen 50 displayed on the display unit 18G of the information processing terminal 18. For example, the operation screen 50 includes a photographing device selection area 52 and a window 54. In the photographing device selection area 52, a list of selectable photographing devices 14 is displayed. In the example shown in FIG. 16, the icon A indicating each of the imaging devices 14 installed in the installation area B1 (see FIG. 1) is displayed at a position corresponding to the actual installation position of each of the imaging devices 14 in the installation area B1. Has been.

  The user operates the input unit 18F to move the position of the pointer 56 and select a display area of the icon A indicating the desired imaging device 14 that has captured the omnidirectional panoramic image 60 to be searched. Thereby, the reception unit 18C receives the imaging device ID of the imaging device 14 indicated by the icon A of the selected display area.

  In the window 54, a list of search conditions and the latest type information is displayed so as to be selectable. In the example shown in FIG. 16, in the window 54, “person” corresponding to the search condition “person information”, “person (squatting)” corresponding to “posture information”, and “posture information” “ “Drawing image (shooting date and time)” corresponding to “person (stretching hand on shelf)”, “drawing image” and “first latest information indicating that shooting timing is latest”, and “drawing image "And" drawing image (creation date and time) "corresponding to" second latest information indicating that the drawing timing is the latest "are displayed.

  The user operates the input unit 18F to select a desired search condition and latest type information from the search condition and latest type information displayed in the window 54. Thereby, the reception unit 18C receives the search condition and the latest type information.

  Note that the operation screen 50 illustrated in FIG. 16 is an example, and is not limited to the form illustrated in FIG.

  Returning to FIG. 11, when receiving the search condition, the latest type information, and the imaging device ID from the input unit 18F, the receiving unit 18C outputs the search condition, the latest type information, and the imaging device ID to the transmitting / receiving unit 18A. In the present embodiment, the transmission / reception unit 18A receives the search information received by the reception unit 18C, including the search conditions, the latest type information, the imaging device ID, and the user ID stored in the storage unit 18E. It transmits to the server device 12.

  In addition, the transmission / reception unit 18 </ b> A receives the omnidirectional panoramic image 60 corresponding to the transmitted search condition from the server device 12. In the present embodiment, the transmission / reception unit 18A receives display image data of the display image 71 corresponding to the omnidirectional panoramic image 60 corresponding to the transmitted search condition from the server device 12.

  The display control unit 18D displays the display image 71 of the display image data received by the transmission / reception unit 18A on the display unit 18G. Therefore, the display screen 70 including the display image 71 of the omnidirectional panoramic image 60 corresponding to the transmitted search condition is displayed on the display unit 18G (see FIGS. 14 and 15).

  Next, an example of the flow of data registration processing in each of the image management DB 12C and the drawing management DB 12D of the server device 12 in the information processing system 10 of the present embodiment will be described.

  FIG. 17 is a sequence diagram illustrating an example of the flow of data registration processing executed by the information processing system 10.

  First, the imaging device 14 obtains an omnidirectional panoramic image 60 by imaging (SEQ100). Then, the imaging device 14 transmits the obtained omnidirectional panoramic image 60 and related information 61 corresponding to the omnidirectional panoramic image 60 to the server device 12 (SEQ102).

  The transmission / reception unit 12F of the server device 12 receives the omnidirectional panoramic image 60 and the related information 61 from the imaging device 14, and outputs them to the storage control unit 12P (SEQ104). When storage controller 12P receives omnidirectional panoramic image 60 and related information 61 from transmission / reception unit 12F, storage controller 12P registers omnidirectional panoramic image 60 and related information 61 in image management DB 12C of storage unit 12B (SEQ106).

  Next, the storage control unit 12P reads the omnidirectional panoramic image 60 registered in the image management DB 12C in SEQ106 (SEQ108) and outputs it to the detection unit 12I (SEQ110).

  Each of the person detection unit 12J and the posture detection unit 12K in the detection unit 12I detects a search condition from the omnidirectional panoramic image 60 received in SEQ110 (SEQ112). The detection unit 12I may receive the omnidirectional panoramic image 60 captured by the imaging device 14 from the transmission / reception unit 12F and use it for detection of the search condition.

  Then, the person detection unit 12J and the posture detection unit 12K of the detection unit 12I output the search condition detection results (person information and posture information) to the storage control unit 12P (SEQ114). The storage control unit 12P associates the detection results (person information and posture information) detected by the person detection unit 12J and the posture detection unit 12K with the image ID of the omnidirectional panoramic image 60 used for the detection, and performs image management. Registration in the DB 12C (SEQ116).

  Next, the storage control unit 12P reads the omnidirectional panoramic image 60 registered in the image management DB 12C in SEQ106 (SEQ118), and outputs it to the thumbnail creation unit 12M (SEQ120).

  The thumbnail creation unit 12M creates a thumbnail image of the received omnidirectional panoramic image 60 (SEQ122). The thumbnail creation unit 12M may receive the omnidirectional panoramic image 60 captured by the imaging device 14 from the transmission / reception unit 12F and use it to create a thumbnail image.

  Then, the thumbnail creation unit 12M outputs the created thumbnail image to the storage control unit 12P (SEQ124). The storage control unit 12P gives a thumbnail ID to the thumbnail image received from the thumbnail creation unit 12M. Then, the storage control unit 12P associates the thumbnail ID and the thumbnail image with the image ID of the omnidirectional panoramic image 60 used to create the thumbnail image, and manages the image management DB 12C (FIG. 12A). ))) (SEQ126).

  Next, the storage control unit 12P reads the omnidirectional panoramic image 60 registered in the image management DB 12C in SEQ106 (SEQ128), and outputs it to the processing unit 12N (SEQ130).

  The processing unit 12N processes the identifiable image area included in the received omnidirectional panoramic image 60 so that it is difficult to specify the personal information (SEQ132). Then, the processing unit 12N outputs the processed panoramic image 60 to the storage control unit 12P (SEQ134). The storage control unit 12P registers the omnidirectional panoramic image 60 processed by the processing unit 12N in the image management DB 12C (SEQ136). For this reason, the omnidirectional panoramic image 60 processed by the processing unit 12N is registered in the image management DB 12C.

  As described above, the server device 12 updates the image management DB 12C and the drawing management DB 12D every time the omnidirectional panoramic image 60 and the related information 61 are received from the imaging device 14.

  On the other hand, in the information processing terminal 18, the receiving unit 18C receives the input of the image ID of the omnidirectional panoramic image 60 from the input unit 18F (SEQ140). For example, the user of the information processing terminal 18 operates the input unit 18F to input the image ID of the omnidirectional panoramic image 60 to be drawn. Thereby, the receiving unit 18C receives the input of the image ID from the input unit 18F.

  The transmission / reception unit 18A of the information processing terminal 18 transmits the image ID received in SEQ 140 to the server device 12 (SEQ 142). When receiving the image ID from the imaging device 14, the transmission unit 12G of the server device 12 outputs the received image ID to the storage control unit 12P (SEQ144).

  The storage control unit 12P reads the omnidirectional panoramic image 60 corresponding to the received image ID from the image management DB 12C (SEQ146, SEQ148). Then, the storage control unit 12P outputs the read omnidirectional panoramic image 60 to the transmission / reception unit 12F (SEQ150). The storage control unit 12P outputs an instruction to create the display screen 70 of the read omnidirectional panoramic image 60 to the screen creation unit 12S, and the display screen data of the display screen 70 created by the screen creation unit 12S is transmitted and received. You may transmit to 12F. Here, the case where the storage control unit 12P transmits display screen data to the transmission / reception unit 12F will be described.

  The transmission / reception unit 12F transmits the display screen data received from the storage control unit 12P to the information processing terminal 18 that is the transmission source of the image ID of SEQ142 (SEQ152). Note that the display screen data includes an image ID for identifying the omnidirectional panoramic image 60 of the display image 71 of the display screen data.

  The transmission / reception unit 18 </ b> A of the information processing terminal 18 receives display screen data from the server device 12. Then, the display control unit 18D of the information processing terminal 18 displays the display image 71 of the display screen data on the display unit 18G (SEQ154). The user of the information processing terminal 18 draws the drawn image on the panoramic image 60 of the display image 71 by operating the input unit 18F while referring to the display image 71 displayed on the display unit 18G. Thereby, the accepting unit 18C accepts an input of a drawing image from the input unit 18F (SEQ156).

  The transmission / reception unit 18A of the information processing terminal 18 receives the drawing image drawn by the user's operation of the information processing terminal 18, the image ID of the omnidirectional panoramic image 60 on which the drawing image is drawn, and the drawing date and time information. 12 is transmitted (SEQ158).

  When receiving the drawing image, the image ID, and the drawing date / time information from the information processing terminal 18 (SEQ158), the transmission / reception unit 12F of the server device 12 outputs the drawing image to the drawing detection unit 12L (SEQ160).

  The drawing detection unit 12L receives the drawing image to detect the drawing image (SEQ162). Then, the drawing detection unit 12L outputs the received drawing image, the image ID of the omnidirectional panoramic image 60 on which the drawing image is drawn, and the drawing date / time information to the storage control unit 12P (SEQ164).

  The storage control unit 12P assigns a drawing image ID to the drawing image received from the drawing detection unit 12L, and the drawing image ID, the received drawing date / time information, the received drawing image, and the received image ID. Correspondingly, it is registered in the drawing management DB 12D (SEQ166). Further, the storage control unit 12P reads the image capturing device ID corresponding to the image ID from the image management DB 12C. Then, the storage control unit 12P registers the read photographing apparatus ID in the drawing management DB 12D in association with the corresponding image ID (SEQ166). Further, the storage control unit 12P registers the drawing image ID corresponding to the image ID in the drawing management DB 12D in association with the image management DB 12C (SEQ168).

  Through the processing of SEQ140 to SEQ168, the server device 12 updates the image management DB 12C and the drawing management DB 12D every time a drawing image is received from the information processing terminal 18.

  Next, an example of the flow of search processing for the omnidirectional panoramic image 60 in the information processing system 10 of the present embodiment will be described.

  FIG. 18 is a sequence diagram illustrating an example of the flow of search processing executed by the information processing system 10.

  First, the receiving unit 18C of the information processing terminal 18 receives a search condition from the input unit 18F (SEQ200). For example, the reception unit 18C receives search information including a search condition, a photographing apparatus ID, the latest type information, and a user ID. Then, the transmitting / receiving unit 18A of the information processing terminal 18 transmits the received search information to the server device 12 (SEQ202).

  When receiving the search information from the information processing terminal 18, the transmission / reception unit 12F of the server device 12 outputs the received search information to the acquisition unit 12Q (SEQ204).

  The acquisition unit 12Q outputs the acquired search information to the search unit 12R (SEQ206). The search unit 12R uses the image management DB 12C, the drawing management DB 12D, and the authority management DB 12E in the storage unit 12B, and the search information received in SEQ 206 to search for the omnidirectional panoramic image 60 corresponding to the search condition ( SEQ208-SEQ214).

  Then, the search unit 12R outputs the searched omnidirectional panoramic image 60 to the change unit 12T (SEQ215).

  The changing unit 12T changes the display form of the specific area in the omnidirectional panoramic image 60 searched by the searching unit 12R according to the search condition acquired by the searching unit 12R (SEQ216). Then, the changing unit 12T outputs the omnidirectional panoramic image 60 whose display form has been changed to the screen creating unit 12S (SEQ217).

  The screen creation unit 12S creates the display screen 70 from the omnidirectional panoramic image 60 received from the change unit 12T (SEQ218). As described above, the screen creation unit 12S creates, for example, the image of the predetermined area S indicated by the predetermined area information corresponding to the omnidirectional panoramic image 60 as the display image 71 for display. Then, the screen creation unit 12S creates the display screen 70 including the created display image 71 (SEQ218).

  The screen creation unit 12S outputs the created display screen data of the display screen 70 to the transmission / reception unit 12F (SEQ220). The transmission / reception unit 12F transmits the display screen data received from the screen creation unit 12S to the information processing terminal 18 that is the transmission source of the search information of SEQ202 (SEQ222).

  The transmission / reception unit 18A of the information processing terminal 18 displays the display screen 70 of the display screen data received from the server device 12 on the display unit 18G (SEQ224). For this reason, the information processing terminal 18 displays the display screen 70 of the omnidirectional panoramic image 60 corresponding to the search condition accepted in SEQ200 (see FIG. 14).

  Note that the button image 72 (see FIG. 14) may be operated by a user operation instruction on the input unit 18F, and a screen operation instructing rotation, movement, or the like may be input. In this case, the receiving unit 18C of the information processing terminal 18 receives the screen operation (SEQ226). Then, the display control unit 18D of the information processing terminal 18 displays the display screen 70 corresponding to the screen operation accepted in SEQ226 on the display unit 18G (SEQ228).

  For example, it is assumed that a rotation instruction including a rotation direction and a rotation amount is received in SEQ226. In this case, the display control unit 18D displays the display image 71 obtained by rotating the predetermined area S of the displayed display image 71 within the corresponding panoramic image 60 in the direction and the rotation amount according to the rotation instruction. Control may be performed as described above.

  Further, the button image 72 (see FIG. 14) may be operated by a user's operation instruction on the input unit 18F, and a thumbnail image display request may be received (SEQ230). In this case, the transmission / reception unit 18A of the information processing terminal 18 transmits the thumbnail display request received by the reception unit 18C to the server device 12 (SEQ232). The transmission / reception unit 12F outputs the received thumbnail display request to the acquisition unit 12Q (SEQ234). It is assumed that the thumbnail display request includes the image ID of the omnidirectional panoramic image 60 currently displayed on the display unit 18G of the information processing terminal 18.

  The acquisition unit 12Q outputs the thumbnail display request received in SEQ234 to the search unit 12R (SEQ236). The search unit 12R searches the image management DB 12C for a thumbnail image and a thumbnail ID corresponding to the image ID included in the received thumbnail display request (SEQ238). Further, the search unit 12R searches the image management DB 12C for other thumbnail images and thumbnail IDs that are consecutive in time series on the shooting date and time indicated by the shooting date and time information corresponding to the image ID (SEQ238).

  Then, the search unit 12R outputs a list of thumbnail images and thumbnail IDs searched in SEQ238 to the transmission / reception unit 12F (SEQ240). The transmission / reception unit 12F transmits the received thumbnail image and list of thumbnail IDs to the information processing terminal 18 that has transmitted the thumbnail display request of SEQ232 (SEQ242).

  The display control unit 18D of the information processing terminal 18 superimposes and displays the thumbnail image received in SEQ242 on the displayed display image 71 (that is, the omnidirectional panoramic image 60) (SEQ244).

  The user operates the input unit 18F to select a desired thumbnail image from the displayed thumbnail image list. Then, the accepting unit 18C accepts an instruction for the selected thumbnail image from the input unit 18F (SEQ246). The transmission / reception unit 18A of the information processing terminal 18 transmits the thumbnail ID corresponding to the thumbnail image received in SEQ246 to the server device 12 (SEQ248).

  When the transmission / reception unit 12F of the server device 12 receives the thumbnail ID from the information processing terminal 18, the transmission / reception unit 12F outputs the received thumbnail ID to the search unit 12R via the acquisition unit 12Q (SEQ250, SEQ252).

  The search unit 12R searches the image management DB 12C for the omnidirectional panoramic image 60 corresponding to the received thumbnail ID (SEQ254), and outputs it to the screen creation unit 12S (SEQ256).

  The screen creation unit 12S creates the display screen 70 of the omnidirectional panoramic image 60 received from the search unit 12R (SEQ258). Then, the screen creation unit 12S transmits the created display screen data of the display screen 70 to the information processing terminal 18 via the transmission / reception unit 12F (SEQ260, SEQ262).

  The transmission / reception unit 18A of the information processing terminal 18 displays the display screen 70 of the display screen data received from the server device 12 on the display unit 18G (SEQ264). For this reason, the information processing terminal 18 displays the display screen 70 of the omnidirectional panoramic image 60 corresponding to the thumbnail image received in SEQ246.

  Next, a procedure of storage / retrieval processing executed by the server device 12 will be described.

  FIG. 19 is a flowchart illustrating an example of a procedure of storage / retrieval processing executed by the server device 12.

  First, the receiving unit 12H of the server device 12 determines whether or not the omnidirectional panoramic image 60 and the related information 61 are received from the imaging device 14 (step S300). If an affirmative determination is made in step S300 (step S300: Yes), the process proceeds to step S302.

  In step S302, the storage controller 12P registers the omnidirectional panoramic image 60 and related information 61 received in step S300 in the image management DB 12C (step S302).

  Next, the detection unit 12I detects a search condition from the omnidirectional panoramic image 60 received in step S300 (step S304). Next, the storage control unit 12P registers the search condition detected in step S304 in the image management DB 12C (step S306).

  Next, the thumbnail creation unit 12M creates a thumbnail image of the omnidirectional panoramic image 60 received in step S300 (step S308). Next, the storage control unit 12P registers the thumbnail image created in step S308 in the image management DB 12C (step S310).

  Next, the processing unit 12N processes the identifiable image area included in the omnidirectional panoramic image 60 received in step S300 so that it is difficult to specify the personal information (step S312). The storage control unit 12P registers (overwrites) the omnidirectional panoramic image 60 processed in step S312 in the image management DB 12C in association with the corresponding image ID (step S314). Then, this routine ends.

  On the other hand, if a negative determination is made in step S300 (step S300: No), the process proceeds to step S316. In step S316, the receiving unit 12H determines whether or not the drawing image, the image ID, and the drawing date / time information are received from the information processing terminal 18 (step S316). If an affirmative determination is made in step S316 (step S316: Yes), the process proceeds to step S318.

  In step S318, the drawing detection unit 12L detects the drawing image, and associates the drawing image, the drawing image ID, the drawing date / time information, and the image ID via the storage control unit 12P to the drawing management DB 12D. Register (SEQ 318). Further, the storage control unit 12P reads the image capturing device ID corresponding to the image ID from the image management DB 12C. Then, the storage control unit 12P registers the read photographing apparatus ID in the drawing management DB 12D in association with the corresponding image ID. Then, the storage control unit 12P registers the drawing image ID corresponding to the image ID in the drawing management DB 12D in association with the image management DB 12C (SEQ320). Then, this routine ends.

  On the other hand, if a negative determination is made in step S316 (step S316: No), the process proceeds to step S322. In step S322, the receiving unit 12H determines whether the search information is received from the information processing terminal 18 (step S322).

  If a negative determination is made in step S322 (step S322: No), this routine ends. If an affirmative determination is made in step S322 (step S322: Yes), the acquisition unit 12Q acquires the search information, and the process proceeds to step S324.

  In step S324, the search unit 12R searches for the latest panoramic image 60 corresponding to the search condition included in the search information acquired in step 322 (step S324).

  Next, the changing unit 12T changes the display form of the specific area according to the search condition in the omnidirectional panoramic image 60 searched by the search unit 12R in step S324 (step S326). Next, the screen creation unit 12S creates the display screen 70 from the omnidirectional panoramic image 60 changed by the changing unit 12T (step S328).

  Next, the screen creation unit 12S transmits the created display screen data of the display screen 70 to the information processing terminal 18 via the transmission unit 12G (step S340). Then, this routine ends.

  Next, an example of a display processing procedure executed by the information processing terminal 18 will be described. FIG. 20 is a flowchart illustrating an example of a procedure of display processing executed by the information processing terminal 18.

  First, the receiving unit 18C of the information processing terminal 18 determines whether a search condition is received from the input unit 18F (step S400). If an affirmative determination is made in step S400 (step S400: Yes), the process proceeds to step S402. For example, the reception unit 18C receives search information including a search condition, an imaging device ID, the latest type information, and a user ID from the input unit 18F.

  In step S402, the transmission / reception unit 18A transmits search information including the search condition accepted in step S400 to the server device 12 (step S402).

  Next, the transmission / reception unit 18A receives display screen data from the server device 12 (step S404). Then, the display control unit 18D displays the display screen 70 of the display screen data received in step S404 on the display unit 18G (step S406). For this reason, the information processing terminal 18 displays the display screen 70 of the omnidirectional panoramic image 60 corresponding to the search condition accepted in S400 (see FIG. 14).

  Next, the receiving unit 18C determines whether a screen operation is received from the input unit 18F (step S408). If a negative determination is made in step S408 (step S408: No), this routine ends. On the other hand, if an affirmative determination is made in step S408 (step S408: Yes), the process proceeds to step S410.

  In step S410, the display control unit 18D displays the display screen 70 in accordance with the screen operation accepted in step S408 on the display unit 18G (step S410). Then, this routine ends.

  On the other hand, if a negative determination is made in step S400 (step S400: No), the process proceeds to step S412. In step S412, the receiving unit 18C determines whether an image ID is received from the input unit 18F (step S412). If a negative determination is made in step S412 (step S412: No), this routine is terminated. On the other hand, if an affirmative determination is made in step S412 (step S412: Yes), the process proceeds to step S414.

  In step S414, the transmission / reception unit 18A transmits the image ID received in S412 to the server device 12 (step S414). Next, the transmission / reception unit 18A receives display screen data of the display screen 70 of the omnidirectional panoramic image 60 corresponding to the image ID transmitted in step S414 from the server device 12 (step S416).

  Next, the display control unit 18D displays the display screen 70 of the display screen data received in step S416 on the display unit 18G (step S418). Next, the receiving unit 18C determines whether or not an input of a drawing image has been received from the input unit 18F (step S420). If a negative determination is made in step S420 (step S420: No), this routine ends. On the other hand, if an affirmative determination is made in step S420 (step S420: Yes), the process proceeds to step S422.

  In step S422, the transmission / reception unit 18A displays the drawing image drawn by the user's operation of the information processing terminal 18, the image ID of the omnidirectional panoramic image 60 in which the drawing image is drawn, and the drawing date / time information. (Step S422). Then, this routine ends.

  As described above, the information processing system 10 according to the present embodiment includes the server device 12 and the information processing terminal 18. The server device 12 includes an acquisition unit 12Q, a search unit 12R, and a transmission unit 12G. The server device 12 acquires from the information processing terminal 18 search information including search conditions for the omnidirectional panoramic image 60 obtained by photographing the omnidirectional range. The search unit 12R searches the latest omnidirectional panoramic image 60 corresponding to the search condition included in the acquired search information from the storage unit 12B storing the plurality of omnidirectional panoramic images 60. The transmission unit 12G transmits the searched omnidirectional panoramic image 60 to the information processing terminal 18.

  As described above, the server device 12 according to the present embodiment searches for the latest panoramic image 60 corresponding to the search condition included in the search information acquired from the information processing terminal 18 and transmits it to the information processing terminal 18. To do. Therefore, in the information processing system 10 according to the present embodiment, the latest omnidirectional panoramic image 60 that satisfies a user-desired search condition can be easily retrieved from a plurality of omnidirectional panoramic images 60.

  The search condition includes at least one of person information indicating that a person is included, attitude information indicating a person's attitude, and drawn image information indicating a drawn image drawn on the omnidirectional panoramic image. Is preferred.

  The search information includes first latest information indicating that the shooting timing of the omnidirectional panoramic image 60 is latest, or second latest information indicating that the drawing timing of the drawing image K is latest. It is preferable to include the latest type information shown. In this case, the search unit 12R may search for the latest omnidirectional panoramic image 60 indicated by the latest type information.

  The search information may include a user ID (user identification information) of a user who operates the information processing terminal 18. In this case, the search unit 12R may search the omnidirectional panoramic image 60 corresponding to the search condition from the omnidirectional panoramic image 60 for which the user identified by the user ID (user identification information) has the viewing authority.

  Moreover, the server apparatus 12 can be provided with the change part 12T. The changing unit 12T changes the display form of the specific region M according to the acquired search condition in the omnidirectional panoramic image 60 searched by the search unit 12R. In this case, the transmitting unit 12G may transmit the changed omnidirectional panoramic image 60 to the information processing terminal 18 as the searched omnidirectional panoramic image 60.

  For example, the changing unit 12T enlarges the specific area M according to the acquired search condition in the omnidirectional panoramic image 60 searched by the search unit 12R, gives a frame line 62 surrounding the specific area M, and the specific area M The display form can be changed by performing at least one of adjustment so that is centered at the time of display.

  In addition, the search information can include an imaging device ID (imaging identification information) that identifies the imaging device 14 that captured the omnidirectional panoramic image 60. In this case, the search unit 12R includes the latest panoramic image 60 captured by the imaging device 14 identified by the imaging device ID (imaging identification information) included in the search information, corresponding to the acquired search condition. The omnidirectional panoramic image 60 may be searched.

  Further, the search information may include a plurality of imaging device IDs (imaging identification information). In this case, the search unit 12 </ b> R has the omnidirectional panorama imaged by the imaging device 14 for each of the plurality of imaging devices 14 identified by each of the plurality of imaging device IDs (imaging identification information) included in the search information. Of the images 60, it is preferable to search for the latest panoramic image 60 corresponding to the acquired search condition.

  The server device 12 can include a screen creation unit 12S. The screen creation unit 12S creates a display screen 70 in which a plurality of searched omnidirectional panoramic images 60 are arranged on one screen.

  The information processing method according to the present embodiment includes a step of acquiring search information including a search condition for the omnidirectional panoramic image 60 obtained by shooting in an omnidirectional range from the information processing terminal 18; A step of searching the latest omnidirectional panoramic image 60 corresponding to the search condition included in the acquired search information from the storage unit 12B storing the celestial sphere panoramic image 60, and information processing the searched omnidirectional panoramic image 60 Transmitting to the terminal 18.

  In addition, the information processing program of the present embodiment includes a step of acquiring search information including a search condition for the omnidirectional panoramic image 60 obtained by shooting in the omnidirectional range from the information processing terminal 18, and a plurality of all A step of searching the latest omnidirectional panoramic image 60 corresponding to the search condition included in the acquired search information from the storage unit 12B storing the celestial sphere panoramic image 60, and information processing the searched omnidirectional panoramic image 60 An information processing program for causing a computer to execute the step of transmitting to the terminal 18.

  Note that a program for executing the above-described processing, which is executed in each of the server device 12, the imaging device 14, and the information processing terminal 18, is incorporated in advance in NV-RAM, ROM, or other nonvolatile storage medium. Provided. In addition, a program for executing the above-described processing, which is executed in each of the server device 12, the imaging device 14, and the information processing terminal 18, is a CD-ROM, a flexible disk in an installable format or an executable format file. (FD), CD-R, DVD (Digital Versatile Disk), etc. can be recorded and provided on a computer-readable recording medium.

  In addition, a program for executing the above-described processing, which is executed in each of the server device 12, the imaging device 14, and the information processing terminal 18, is stored on a computer connected to a network such as the Internet and downloaded via the network. May be provided or distributed.

  Moreover, you may comprise so that the program for performing the said process performed with each of the server apparatus 12, the imaging device 14, and the information processing terminal 18 may be previously incorporated in ROM etc. and provided.

  Moreover, the program for performing the said process performed with each of the server apparatus 12, the imaging device 14, and the information processing terminal 18 becomes a module structure containing each part mentioned above, As actual hardware, When the CPU (processor) reads the program from the storage medium and executes the program, the units are loaded onto the main storage device, and the units are generated on the main storage device.

  Various types of information stored in the storage unit 12B of the server device 12 may be stored in an external device. In this case, the external device and the server device 12 may be connected via a network or the like.

  In the present embodiment, the configuration in which the server device 12 transmits display screen data for displaying the omnidirectional panoramic image 60 to the information processing terminal 18 has been described. However, it is not limited to this form. For example, the information processing terminal 18 may receive the omnidirectional panoramic image 60 transmitted from the server device 12, and the display control unit 18D of the information processing terminal 18 may generate and display the display screen data.

  In addition, although this Embodiment was described above, the said embodiment is shown as an example and is not intending limiting the range of invention. The above-described novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. The above-described embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 10 Information processing system 12 Server apparatus 12B Storage part 12G Transmission part 12I Detection part 12Q Acquisition part 12R Search part 12S Screen creation part 12T Change part 14 Imaging device 18 Information processing terminal

JP 2014-006880 A

Claims (11)

An information processing system comprising a server device and an information processing terminal capable of communicating with the server device,
The server device
An acquisition unit for acquiring search information including search conditions for an omnidirectional panoramic image obtained by shooting in an omnidirectional range from the information processing terminal;
A search unit that searches the latest omnidirectional panoramic image corresponding to the search condition included in the acquired search information from a storage unit that stores a plurality of omnidirectional panoramic images;
A transmitting unit for transmitting the searched omnidirectional panoramic image to the information processing terminal;
An information processing system comprising:   The search condition includes at least one of person information indicating that a person is included, attitude information indicating a person's attitude, and drawn image information indicating a drawn image drawn on the omnidirectional panoramic image. The information processing system according to claim 1. The search information includes first latest information indicating that the shooting timing of the panoramic image is the latest, or second latest information indicating that the drawing timing of the drawing image is latest. Including type information,
The information processing system according to claim 1, wherein the search unit searches for the latest omnidirectional panoramic image indicated by the latest type information. The search information includes user identification information of a user who operates the information processing terminal,
The search unit
4. The omnidirectional panoramic image corresponding to the search condition is searched from the omnidirectional panoramic image to which the user identified by the user identification information has a viewing authority. 5. Information processing system described in 1. The server device
In the omnidirectional panoramic image searched by the search unit, provided with a change unit for changing the display form of the specific area according to the acquired search condition,
The transmitter is
The information processing system according to any one of claims 1 to 4, wherein the changed omnidirectional panoramic image is transmitted to the information processing terminal as the searched omnidirectional panoramic image. The changing unit is
In the omnidirectional panoramic image searched by the search unit, the specific area corresponding to the acquired search condition is enlarged, a frame surrounding the specific area is given, and the specific area is centered at the time of display. The information processing system according to claim 5, wherein the display form is changed by performing at least one of adjustment as described above. The search information includes shooting identification information for identifying a shooting device that shot the panoramic image.
The search unit includes the latest omnidirectional panorama corresponding to the acquired search condition among the omnidirectional panoramic images captured by the imaging device identified by the imaging identification information included in the search information. The information processing system according to claim 1, wherein an image is searched. The search information includes a plurality of the shooting identification information,
The search unit acquires, for each of the plurality of imaging devices identified by each of the plurality of imaging identification information included in the search information, among the omnidirectional panoramic images captured by the imaging device. The information processing system according to claim 7, wherein the latest panoramic image corresponding to the search condition is searched. The server device
The information processing system according to claim 8, further comprising a screen creation unit that creates a display screen in which the plurality of searched panoramic images are arranged on one screen. Obtaining search information including search conditions for an omnidirectional panoramic image obtained by shooting in an omnidirectional range from the information processing terminal;
Searching the latest omnidirectional panoramic image corresponding to the search condition included in the acquired search information from a storage unit storing a plurality of omnidirectional panoramic images;
Transmitting the searched panoramic image to the information processing terminal;
An information processing method including: Obtaining search information including search conditions for an omnidirectional panoramic image obtained by shooting in an omnidirectional range from the information processing terminal;
Searching the latest omnidirectional panoramic image corresponding to the search condition included in the acquired search information from a storage unit storing a plurality of omnidirectional panoramic images;
Transmitting the searched panoramic image to the information processing terminal;
Processing program for causing a computer to execute.

Images