JP2020030609A - Property information presentation device, property information presentation method and property information presentation program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a property information presenting device capable of presenting property information of a desired real estate property to a user even when there is no floor plan image. SOLUTION: A specific constituent image is specified based on a feature amount of a constituent image constituting a designated three-dimensional model image designated by a user, and between the specific constituent image and each of the registered images of the property information database 321. When the first similarity is equal to or greater than the threshold value, the relationship constituent image having a predetermined positional relationship with respect to the specific constituent image and the first similarity degree are equal to or greater than the first threshold value. The second similarity between the first registered image and the registered image having the positional relationship is calculated, and when the second similarity is equal to or higher than the default second threshold value, the first registered image and the first registered image are calculated. 2 An image of a real estate property having a second registered image whose similarity is equal to or higher than the second threshold is specified in the property information database 321, and property information including the specified similar image is presented to the user. [Selection diagram] Fig. 4

Description

  The present invention belongs to a technical field such as a property information presentation device that presents property information of a real estate property to a user.

  In general, when selecting a real estate property, it is generally necessary to select a real estate property while looking at a floor plan at a real estate agent's store and to preview the selected real estate property, thereby finally selecting a desired real estate property. Is At this time, it is convenient if it is possible to see the inside of the real estate on a homepage, for example, without going to the preview. And when you look at the inside of a real estate property on the homepage, if you can see it as a three-dimensional image, you can imagine the actual room more clearly and it will be easier to select a real estate property .

  As a prior art document that discloses such a conventional technology regarding the selection of a real estate property, for example, Patent Document 1 below is cited. The conventional technique disclosed in Patent Document 1 has a configuration including a floor plan identification unit that generates floor plan information based on a floor plan image, and a model generation unit that generates a three-dimensional model using the floor plan information. ing.

Patent No. 6116746

  However, the conventional technology disclosed in Patent Document 1 is based on the premise that a floor plan image is used. If the floor plan image cannot be acquired, a three-dimensional model of the real estate cannot be generated, and It is impossible to select a desired real estate property.

  Therefore, the present invention has been made in view of the above points and the like, and an example of the problem is that it is possible to present property information of a desired real estate property to a user even when there is no floor plan image. It is to provide a property information presentation device, a property information presentation method, and a property information presentation program.

  In order to solve the above-mentioned problem, the invention according to claim 1 is a property information providing apparatus that allows an image of a real estate property to access a database registered as a registration image for each of the plurality of real estate properties, An acquisition unit that acquires a search request including a designated three-dimensional model image that is a three-dimensional model image designated by a user; and a specific configuration based on a feature amount of each of the constituent images constituting the designated three-dimensional model image. First specifying means for specifying an image as a specific constituent image; first calculating means for calculating a first similarity between the specified specific constituent image and each of the registered images; When the first similarity is equal to or greater than a preset first threshold value, a relational constituent image having a predetermined positional relationship with respect to the specific constituent image among the constituent images; A second calculation for calculating a second similarity between the registered image having the positional relationship with the first registered image, which is the registered image whose first similarity obtained is equal to or greater than the first threshold value Means, wherein the first registered image and the calculated second similarity are equal to or greater than the second threshold when the calculated second similarity is equal to or greater than a preset second threshold. A second specifying unit that specifies, as a similar image, the image of the real estate article having the second registered image that is a registered image in the database; and the property information including the specified similar image corresponds to the search request. Presenting means for presenting the search result to the user.

  According to the present invention, even when there is no floor plan image, it is possible to present the property information of a desired real estate property to the user using the three-dimensional model image designated by the user.

  According to a second aspect of the present invention, in the property information presentation device according to the first aspect, the first specifying unit sets, as the specific configuration image, a configuration image having the largest feature amount among a plurality of the configuration images. Configured to identify.

  According to the present invention, property information of a real estate property closer to a desired real estate property can be presented to the user.

  According to a third aspect of the present invention, in the property information presenting apparatus according to the first or second aspect, the first specifying unit is configured to perform the determination based on a relative value of each of the feature amounts among a plurality of the constituent images. It is configured to specify the specific constituent image.

  According to the present invention, property information of a real estate property closer to a desired real estate property can be presented to the user.

  According to a fourth aspect of the present invention, in the property information presenting apparatus according to any one of the first to third aspects, the specific configuration image is a configuration wall image that configures the designated three-dimensional model image. The specific constituent wall image specified based on the feature amount, the registered image is each of the registered wall images forming the image of the real estate article, and the related constituent image is the constituent wall image among the constituent wall images. The first registered image is a constituent wall image adjacent to the specific constituent wall image, and the first registered image is the registered wall image whose calculated first similarity is equal to or greater than the first threshold, and the second registered image Is configured to be the registered wall image whose calculated second similarity is equal to or greater than the second threshold.

  According to the present invention, the property information of the real estate property closer to the desired real estate property can be accurately presented to the user by using the wall image from which the feature amount as the image can be easily obtained.

  According to a fifth aspect of the present invention, in the property information presentation device according to any one of the first to third aspects, the specific configuration image is a configuration wall image or a configuration that configures the designated three-dimensional model image. The specific configuration wall image or the specific configuration ceiling image specified based on the feature amount of each ceiling image, the registered image is a registered wall image or a registered ceiling image configuring the image of the real estate, respectively. The related constituent image is a constituent wall image or a constituent ceiling image adjacent to the specific constituent image in the constituent wall image or the constituent ceiling image, and the first registered image is the calculated first similarity. Is the registered wall image or the registered ceiling image that is equal to or greater than the first threshold, and the second registered image is the registered wall image in which the calculated second similarity is equal to or greater than the second threshold. Serial configured to be registered ceiling image.

  According to the present invention, it is possible to accurately present the property information of a real estate property closer to a desired real estate property to the user by using the wall image and the ceiling image from which the feature amount as an image is relatively easy to obtain.

  According to a sixth aspect of the present invention, in the property information presentation device according to any one of the first to fifth aspects, when the calculated second similarity is equal to or greater than the second threshold, Between a second related constituent image having a second positional relationship set in advance with respect to the specific constituent image among the constituent images, and the registered image having the second positional relationship with respect to the first registered image. A third calculating unit that calculates a third similarity of the first registered image, the second specifying unit, when the calculated second similarity is equal to or more than the second threshold, The image of the real estate having the second registered image and the third registered image, which is the registered image in which the calculated third similarity is equal to or greater than a predetermined third threshold, is specified as the similar image. It is configured as follows.

  According to the present invention, by using three registered images, property information of a real estate property closer to a desired real estate property can be accurately presented to the user.

  According to a seventh aspect of the present invention, in the property information providing device according to the sixth aspect, the specific configuration image is specified based on each of the characteristic amounts of the configuration wall images constituting the designated three-dimensional model image. The specific configuration wall image, wherein the registered image is each of the registered wall images configuring the image of the real estate property, and the relational configuration image is a configuration wall adjacent to the specific configuration image in the configuration wall image. The first registered image is the registered wall image whose calculated first similarity is greater than or equal to the first threshold, and the second registered image is the calculated second similarity Is the registered wall image that is greater than or equal to the second threshold value, and the second related constituent image is a constituent wall image that is in contact with the specific constituent image in the second positional relationship among the constituent wall images, The third registered image is The third degree of similarity issued configured such that the registration wall image was the third threshold value or more.

  According to the present invention, by using a wall image from which a feature amount as an image can be easily obtained, property information of a real estate property closer to a desired real estate property can be accurately presented to the user.

  The invention according to claim 8 is the property information presentation device according to claim 6, wherein the specific configuration image is based on the feature amount of each of the configuration wall image or the configuration ceiling image configuring the designated three-dimensional model image. The specific configuration wall image or the specific configuration ceiling image specified in the above, the registered image is a registered wall image or a registered ceiling image configuring the image of the real estate, respectively, and the related configuration image is the configuration wall. The constituent wall image or the constituent ceiling image adjacent to the specific constituent image in the image or the constituent ceiling image, and in the first registered image, the calculated first similarity is equal to or greater than the first threshold. The registered wall image or the registered ceiling image, wherein the second registered image is the registered wall image or the registered ceiling image in which the calculated second similarity is equal to or greater than the second threshold. The second related configuration image is a configuration wall image or a configuration ceiling image that is in contact with the specific configuration image in the second positional relationship among the configuration wall images or the configuration ceiling images, and the third registered image is the calculated It is configured to be the registered wall image or the registered ceiling image whose third similarity obtained is equal to or larger than the third threshold value.

  According to the present invention, by using the wall image and the ceiling image in which the feature amount as the image is relatively easy to obtain, it is possible to accurately present the property information of the real estate nearer to the desired real estate to the user. .

  According to a ninth aspect of the present invention, in the property information presentation apparatus according to any one of the first to eighth aspects, the database includes a three-dimensional model image of the real estate property in a three-dimensional model. A registered three-dimensional model image and a registered photographic image, which is a photographic image of the real estate, are registered as the registered images for each of the plurality of real estates, and the second specifying means is configured to register the registered three-dimensional model. At least one of a model image and the registered photographic image is specified as the similar image.

  According to the present invention, by using at least one of the registered three-dimensional model image and the photograph image, it is possible to accurately present the property information of the real estate near the desired real estate to the user.

  According to a tenth aspect of the present invention, the image of the real estate property is a designated three-dimensional model image designated by a user on a computer capable of accessing a database registered as a registered image for each of the plurality of real estate properties. Obtaining a search request including a model image; identifying the specific constituent image as a specific constituent image based on a feature amount of each of the constituent images constituting the specified three-dimensional model image; and Calculating a first similarity between the specific constituent image and each of the registered images; and, when the calculated first similarity is equal to or greater than a first threshold set in advance, the constituent image Among the related constituent images having a predetermined positional relationship with respect to the specific constituent image, and before the calculated first similarity is equal to or greater than the first threshold. Calculating a second similarity between the first registered image that is a registered image and the registered image that is in the positional relationship, and a second threshold value in which the calculated second similarity is set in advance In the case of the above, the image of the real estate article having the first registered image and the second registered image that is the registered image whose calculated second similarity is equal to or more than the second threshold value, A step of specifying the similar image in the database and a step of presenting the property information including the specified similar image to the user as a search result corresponding to the search request are executed.

  The invention according to claim 11 is a property information presenting method executed by a computer capable of accessing a database registered as a registered image for each of a plurality of real estate properties, wherein the image of the real estate property is specified by a user. Obtaining a search request including the designated three-dimensional model image, which is the designated three-dimensional model image, and, based on the feature amount of each of the constituent images constituting the designated three-dimensional model image, identifying the specific constituent image as a specific constituent image And calculating a first similarity between the specified specific constituent image and each of the registered images; and calculating the first similarity calculated in advance as a first similarity. If not less than a threshold value, a relational constituent image having a predetermined positional relationship with respect to the specific constituent image among the constituent images, Calculating a second similarity between the first registered image, which is the registered image whose first similarity is equal to or greater than the first threshold, and the registered image in the positional relationship with the first registered image; The first registered image and the second registered image having the calculated second similarity greater than or equal to the second threshold when the second similarity is greater than or equal to a second threshold set in advance. Specifying the image of the real estate article having the registered image in the database as a similar image, and presenting the property information including the specified similar image to the user as a search result corresponding to the search request. Step.

  According to the present invention, property information of a desired real estate property can be presented to the user using the three-dimensional model image specified by the user.

FIG. 1 is a diagram illustrating an example of a schematic configuration of an information providing system according to an embodiment. It is a figure showing an example of the information registered into the property information database of this embodiment. (A) is a figure which illustrates the two-dimensional floor plan of this embodiment. (B) is a diagram showing an example of data registered in the reference data database of the present embodiment. It is a figure showing an example of a functional block of a system control part of this embodiment. It is a figure which illustrates the indoor image of this embodiment. (A) is a figure which illustrates border line extraction of this embodiment. (B) is a conceptual diagram showing the distance calculation of the present embodiment. FIG. 2A is a diagram illustrating an image before distortion correction according to the embodiment. FIG. 2B is a diagram illustrating an image after distortion correction according to the embodiment. (C) is a figure which illustrates the six-view figure which comprises the three-dimensional model of embodiment. (A) is a conceptual diagram illustrating an indoor space image of the present embodiment. (B) is a conceptual diagram illustrating the connection of the indoor space image of the embodiment. It is a figure showing an example of a floor plan creation / display page used for generation of floor plan image data and display of a floor plan image of the embodiment. It is a figure showing an example of the article information publication page where article information of this embodiment was published. FIG. 2A is a diagram (I) illustrating a process of creating three-dimensional floor plan image data according to the present embodiment. (B) is a diagram (II) illustrating the creation process. (A) is a figure (III) which illustrates the creation processing of three-dimensional floor plan image data of the present embodiment. (B) is a diagram (IV) illustrating the creation processing. (A) is a diagram (I) illustrating a search process of the present embodiment. (B) is a diagram (II) illustrating the search processing. (A) is a sequence diagram showing the whole property information generation processing of the present embodiment. (B) is a flowchart showing details of the property information generation processing. FIG. 4 is a sequence diagram illustrating a process of generating a three-dimensional floor plan image according to the embodiment. FIG. 9 is a sequence diagram illustrating a search process according to the embodiment.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Note that the embodiment described below is a case where the present invention is applied to an information providing system that provides property information including floor plan image data for displaying a floor plan image of a real estate property to a terminal used by a user. It is an embodiment. The real estate of the present embodiment is, for example, real estate such as buildings and land.

[1. Configuration and Function of Information Providing System]
First, the configuration and functions of an information providing system according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 is a diagram illustrating an example of a schematic configuration of the information providing system according to the present embodiment.

  As shown in FIG. 1, the information providing system S of the present embodiment includes a general consumer terminal 1-1, a general consumer terminal 1-2,..., A general consumer terminal 1-n (n is a natural number), and For example, the omnidirectional camera C1, the omnidirectional camera C2,..., The omnidirectional camera Cm (m is a natural number) used by the real estate agent, and the information providing server 3 (an example of the “property information presenting device” in the present invention) ) And the like. In the following description, when common items are described for the general consumer terminal 1-1, the general consumer terminal 1-2,..., The general consumer terminal 1-n, these are collectively referred to as “general consumer terminal. 1 ". Further, in the following description, when a configuration and operation common to the omnidirectional camera C1, the omnidirectional camera C2,..., The omnidirectional camera Cm are described, these are collectively referred to simply as “omnidirectional camera C”. Called. The real estate agent is an agent that mediates, for example, when a general consumer (customer; an example of a “user” in the present invention) purchases or rents a real estate property. The real estate broker acquires property information indicating the contents of the real estate property from a management company that owns / manages the real estate property itself, and introduces the real estate property to general consumers based on the property information. This real estate agent is a real estate agent that is often found in towns. Each general consumer terminal 1 and each omnidirectional camera C can communicate with the information providing server 3 via the network NW. The network NW includes, for example, a telephone circuit switching network and a data communication packet switching network for connecting to the Internet.

[1-1. Configuration and function of spherical camera]
Next, the configuration and functions of the spherical camera C will be described. In the configuration shown in FIG. 1, the omnidirectional camera C is installed in one of the indoor spaces in the real estate, which is to be sold or rented, by a real estate agent or the like in which the omnidirectional camera C is used. At this time, the “indoor space” refers to any one of a room, a corridor, an entrance, and the like constituting the real estate. Then, the omnidirectional camera C generates indoor image data corresponding to a panoramic image (i.e., an omnidirectional image) obtained by omnidirectionally capturing the indoor space in which the omnidirectional camera C is installed, and the information providing server 3 via the network NW. Send to At this time, the transmitted indoor image data includes property identification data for identifying the real estate property from other real estate properties, and the installation position of the spherical camera C at the time of capturing the panoramic image (particularly, the room to be imaged). Installation position data indicating the height of a camera unit of the omnidirectional camera C from the floor of the space (described later) is added. Note that the generation and transmission of the indoor image data may be performed only for one indoor space in the real estate property, or may be performed for a plurality of indoor spaces in the real estate property by re-installing the spherical camera C. May be performed. Here, when the indoor image data is generated for each of a plurality of indoor spaces in one real estate, together with the above-mentioned object identification data, the indoor space reflected in the indoor image data is converted to other indoor spaces in the real estate. Room space identification data for identifying from the space is also added and transmitted. As a result, the information providing server 3 uses the transmitted indoor image data to generate an indoor space image representing a three-dimensional model of the indoor space reflected in the indoor image data for each real estate property and each indoor space. And memorize (accumulate).

  More specifically, each spherical camera C includes, for example, a camera unit 20 including a fisheye lens, a control unit 21 including a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. A storage unit 22, an operation display unit 23 including a shutter button, a power button, necessary indicators, and the like, a communication unit 24 connectable to a network NW, and the like are provided. These components are electrically connected via a bus 25. ing. In this configuration, when the power button of the operation display unit 23 is operated and the omnidirectional camera C is activated, the control unit 21 controls the camera unit 20 to control the room in which the omnidirectional camera C is installed. The imaging of the space as an omnidirectional panoramic image is started. Thereafter, the control unit 21 monitors whether the shutter button of the operation display unit 23 has been operated. When the shutter button is operated, the control unit 21 causes the storage unit 22 to store room image data corresponding to a panoramic image captured at the timing when the shutter button is operated, via the bus 25. The control unit 21 repeats the capturing of the panoramic image and the generation and storage of the indoor image data corresponding to the panoramic image in each indoor space in the real estate for each indoor space. Then, for example, when a transmission button or the like is operated on the operation display unit 23, the control unit 21 converts the room image data stored in the storage unit 22 into the object identification data and the installation position data based on the operation. The data is transmitted to the information providing server 3 via the communication unit 24 and the network NW together with the indoor space identification data.

[1-2. Configuration and function of general consumer terminal]
Next, the configuration and functions of the general consumer terminal 1 will be described. In the configuration shown in FIG. 1, the general consumer terminal 1 is a user terminal used by the general consumer who purchases or rents a real estate, for example. Each general consumer terminal 1 includes a communication unit 11, a storage unit 12, a system control unit 13, an operation display unit 14, and the like. These components are electrically connected via a bus 15. Each of the general consumer terminals 1 has a browser function controlled by the system control unit 13. Each general consumer terminal 1 displays a page (for example, a web page or a landing page) provided from the property information site in response to a request (request) by the browser on a screen (for example, a browser window). To be displayed. Such a page is composed of a structured document such as an HTML (Hyper Text Markup Language) document and an XHTML document, image data, and the like. Examples of the general consumer terminal 1 include a personal computer, a mobile phone, a smartphone, a tablet, and a portable game machine.

  The communication unit 11 communicates with the information providing server 3 via the network NW under the control of the system control unit 13. The storage unit 12 includes, for example, a hard disk drive or the like, and stores an OS, an application, and the like. The operation display unit 14 includes, for example, the above-described display formed of a liquid crystal display or the like, and an operation unit such as a touch panel which is installed on a surface of the display unit of the display. On the display of the operation display unit 14, a property information posting page for posting property information and a floor plan creation / display page for generating and displaying a floor plan image of a real estate property provided from the information providing server 3 are provided. Is displayed. A general consumer who uses the general consumer terminal 1 creates and displays a two-dimensional floor plan or a three-dimensional floor plan of a desired real estate property using the floor plan creation / display page. Note that, in the following description, when matters common to the two-dimensional floor plan and the three-dimensional floor plan are described, these are collectively referred to simply as “floor plan”. The creation of each floor plan is performed by a freehand input operation of a line or the like using the touch panel of the operation display unit 14. Therefore, trajectory data (for example, dot data constituting the trajectory) indicating the trajectory of the freehand input operation on the touch panel, the input start position and the input end position of the trajectory on the touch panel, the input start timing, and the A floor plan image data request including detailed data indicating the input end timing and terminal identification data for identifying the general consumer terminal 1 on which the floor plan creation / display page is displayed from other general consumer terminals 1 is provided. Is transmitted to the information providing server 3 via the network NW under the control of the system control unit 13. In the case where one component to be described later that constitutes one floor plan is configured (drawn) by a plurality of lines, the detailed data includes the stroke order data indicating the input order (ie, the stroke order) of the line. ing. Then, the floor plan image data generated in the information providing server 3 corresponding to the trajectory data and the detailed data is transmitted to the general consumer terminal 1 via the network NW. In the following description, when the trajectory data and the detailed data are collectively referred to, they are simply referred to as “trajectory data or the like”. Thereby, the system control unit 13 of the general consumer terminal 1 that has received the floor plan image data displays the floor plan image corresponding to the received floor plan image data on the display of the operation display unit 14 using the floor plan creation / display page. . After that, the user of the general consumer terminal 1 (a user who is a general consumer) who has viewed the floor plan image displayed on the display requests, for example, to search for a real estate property of the floor plan indicated by the displayed floor plan image ( Is input via the operation display unit 14 together with the search condition, the system control unit 13 transmits the input search request to the general consumer terminal 1 to which the search condition has been input by another general consumer terminal. The information is transmitted to the information providing server 3 via the network NW together with the terminal identification data for identifying from the user terminal 1. As a result, the information providing server 3 determines based on the search conditions included in the search request and the floor plan image displayed on the operation display unit 14 of the general consumer terminal 1 when the search request is transmitted. Then, a real estate property is searched in the property information database 321 to be described later. Then, the property providing page including the property information as the search result is transmitted from the information providing server 3 to the general consumer terminal 1 that transmitted the search request via the network NW. At this time, the terminal identification data transmitted together with the search request is used as a clue. Then, the system control unit 13 of the general consumer terminal 1 that has received the property information posting page displays the property information posting page on the display of the operation display unit 14. The creation and display of the floor plan using the floor plan creation / display page by the information providing server 3 will be described later in detail.

[1-3. Configuration and function of information providing server]
Next, the configuration and functions of the information providing server 3 will be described. In the configuration illustrated in FIG. 1, the information providing server 3 is a server that configures a property information site. The information providing server 3 includes a communication unit 31, a storage unit 32, a system control unit 33, and the like. These components are electrically connected via a bus 34. The information providing server 3 may be configured by one server computer, or may be configured by a plurality of server computers. Here, the communication unit 31 is an example of the “acquisition unit” in the present invention.

  The communication unit 31 communicates with each omnidirectional camera C and each general consumer terminal 1 via the network NW under the control of the system control unit 33. The storage unit 32 includes, for example, a hard disk drive and stores an OS, an application, and the like. In the storage unit 32, a property information database (DB) 321 and a reference data database (DB) 322 of the present embodiment are constructed. FIG. 2 is a diagram illustrating an example of information registered in the property information database 321, and FIG. 3 is a diagram illustrating an example of information registered in the reference data database 322. The property information database 321 and the reference data database 322 may be provided in other servers different from the information providing server 3, respectively.

  As illustrated in FIG. 2, the property information database 321 registers (stores) the property information relating to the real estate property, the broker ID of the real estate broker who provided the property information, and the property ID of the real estate property in association with each other. ). With such a property information database 321, many pieces of property information can be managed separately for each real estate agent. Here, the broker ID is identification information uniquely given to each real estate broker. The property ID is identification information uniquely assigned to each real estate agent and each real estate property. That is, the same real estate property may be handled by a plurality of different real estate agents, and even if the same real estate property is handled, the property ID is different if the real estate brokers handling the different real estate agents. The property information includes, for example, property type, property name, location, traffic, age, floor number, occupied area, exterior image, floor plan information, indoor space image, indoor photographic image, transaction information, and the like (see FIG. 10). ). The property type is classified into individual house (detached house), apartment house (apartment or apartment), and land. The floor plan information in the case where the property type is a multi-family housing includes a location floor, a room number, a floor plan, images of rooms and facilities, etc. for each house (each room). The appearance image is a photographic image or a two-dimensional image showing the appearance of the corresponding real estate property. The indoor space image is a three-dimensional model image of the indoor space generated based on indoor image data obtained by imaging the corresponding indoor space with the spherical camera C. The indoor photo image is an image of a photo (still photo) in which the corresponding indoor space is captured by a normal camera. The transaction information includes, for example, a transaction type and a transaction condition. The transaction type is a rental property, a newly built property, or a used property. Transaction conditions for a rental property include rent, security deposit, key money, and contract period. The transaction conditions for newly built and used properties include the sale price, management costs, and reserve for repairs. Designation of property information by a real estate agent is indispensable in principle.

  The reference data database 322 registers (stores) reference data used for creating a floor plan of the present embodiment. The reference data of the present embodiment constitutes a floor plan showing a two-dimensional floor plan of a real estate based on the trajectory of the line input by the freehand input operation on the operation display unit 14 of each general consumer terminal 1. This is data used when generating an image of a component to be processed. The two-dimensional floor plan in this case is, for example, a general two-dimensional floor plan FP indicating the floor plan of a real estate article, as exemplified in FIG. In addition, the above-described components configuring the floor plan FP include, for example, one room, one window, one door, one toilet, and the like that configure the floor plan. The reference data of the present embodiment is drawn in a case where each of a plurality of types of components (the rooms and the like) constituting the two-dimensional floor plan FP is drawn by the freehand input operation. , And data indicating the reference of the shape (that is, the drawing method including the stroke order, and a typical example of the shape). By comparing the trajectory of the line actually input by the freehand input operation on the operation display unit 14 with the reference data, a component indicated by the reference data of the drawing style and shape closest to the trajectory Is specified. Then, the trajectory of the line actually input by the freehand input operation is converted into a drawing of the specified component.

  Here, the reference data of the present embodiment will be specifically described with reference to FIG. 3B. In the “trajectory” column of FIG. 3B, “● (black circle)” indicates a start point in the freehand input operation, and a tip of the arrow indicates an end point in the input operation. Specifically, when a closed locus indicated by a solid line is input in a “trajectory” column as illustrated as “room 1” in FIG. The trajectory is converted into a rectangular drawing having the width and depth of the entire trajectory as a drawing of one room constituting the floor plan FP. Further, as exemplified in FIG. 3B as “room 2”, in a state where a wall as the above-described component indicated by a broken line is displayed in the “trajectory” column, a closed shape in contact with the broken line is displayed. When the trajectory is input as shown by a solid line, the trajectory is a drawing of one room in contact with the wall, and a rectangular drawing (shown by a broken line) as a room having the width and depth of the entire trajectory. (A rectangular drawing on the wall). Further, as illustrated as a “window” in FIG. 3B, in a state where the wall exemplified by the broken line is displayed in the “trajectory” column, a part of the wall is distinguished from other parts. When two trajectories are input as indicated by the solid lines, the part of the wall sandwiched and distinguished by the trajectories is defined as a sliding door type window made in the wall, and the specified part is It is converted into a drawing of a sliding door type window as a frontage. Also, as illustrated as a “door” in FIG. 3B, in a state where the wall indicated by a broken line is displayed in the “trajectory” column, a part of the wall is set as a starting point and substantially perpendicular to the wall. If a trajectory that once separates in the direction and then returns to the original wall after drawing a substantially circular shape is input as shown by a solid line, the trajectory has the wall between the start point and the end point of the trajectory as the frontage Converted to drawing of a single-opening door. In addition, as illustrated in FIG. 3B as “toilet”, in a state where the wall exemplified by the broken line is displayed in the “track” column, the wall protrudes from a part of the wall as a starting point. When a locus that draws a substantially elliptical shape and returns to the original wall is input as shown by a solid line, the locus is converted into a drawing of a toilet provided between the start point and the end point of the locus. . In addition, as illustrated in FIG. 3B as a “bathroom”, a substantially elliptical locus that touches the wall with the wall illustrated by a broken line displayed in the “trajectory” column Is input as shown by the solid line, the trajectory is converted to a drawing of a wash basin having the entire width of the trajectory. Also, as illustrated in FIG. 3B as “kitchen”, in a state where the wall exemplified by a broken line is displayed in the “trajectory” column, a substantially elliptical locus is in contact with the wall. , A substantially rectangular locus, and a linear locus that connects them, are input as indicated by solid lines, and these locus are converted into a kitchen drawing having the entire width of the locus. In addition, as illustrated as a “bathroom” in FIG. 3B, when a substantially elliptical trajectory is input so as to be double as indicated by a solid line in the “trajectory” column, those trajectories are , With the width and depth of the entire trajectory (outer trajectory). Finally, as illustrated in FIG. 3B as a “bay window”, in a state where the wall exemplified by the broken line is displayed in the “trajectory” column, the user goes out of a part of the wall, and Further, when one locus that returns to the other part of the wall is input as shown by a solid line, the locus is defined as a bay window whose frontage is the length of the part of the wall sandwiched and distinguished by the locus. Converted to drawing. Note that the floor plan FP of a house or condominium as a real estate property includes drawings of various components in addition to the components illustrated in FIG. 3 (B). Reference data that can be distinguished from other components by the locus represented is registered in the reference data database 322.

  FIG. 4 is a diagram illustrating an example of functional blocks of the system control unit 33 of the information providing server 3 according to the present embodiment. The system control unit 33 includes a CPU, a ROM, a RAM, and the like. The CPU (computer) executes various processes according to an application operating on an operating system. As illustrated in FIG. 4, the system control unit 33 functions as a page providing unit 331, a search unit 332, a floor plan image data generation unit 333, a display control unit 334, a property information acquisition unit 335, an indoor space image generation unit 336, and the like. I do. Here, the display control unit 334 is an example of the “presenting unit” in the present invention. The property information acquisition unit 335 is an example of the “first specifying unit”, the “second specifying unit”, the “first calculating unit”, the “second calculating unit”, and the “third calculating unit” in the present invention.

  The indoor space image generation unit 336 functions as an image processing unit 337, a boundary line extraction unit 338, an image extraction unit 339, an intersection extraction unit 340, a horizontal distance detection unit 341, a distance calculation unit 342, and the like. In this configuration, when the indoor image data is transmitted from any celestial sphere camera C, the indoor space image generation unit 336 receives this via the communication unit 31. Then, the image processing unit 337, the boundary line extracting unit 338, the image extracting unit 339, the intersection extracting unit 340, the horizontal distance detecting unit 341 and the distance calculating unit 342 use the received indoor image data to generate the indoor image data. The indoor space image representing the three-dimensional model of the reflected indoor space is generated for each real estate property and each indoor space. The generation of the indoor space image by the image processing unit 337, the boundary line extraction unit 338, the image extraction unit 339, the intersection extraction unit 340, the horizontal distance detection unit 341 and the distance calculation unit 342 will be described later with reference to FIGS. This will be described in detail. Thereafter, the indoor space image generation unit 336 registers the generated indoor space image in the property information database 321 in association with the property identification data and the room space identification data.

  Here, the indoor image transmitted from the omnidirectional camera C to the information providing server 3 as the indoor space data will be described more specifically with reference to FIG. As shown in FIG. 5, the indoor image D is a spherical image captured by the spherical camera C, and includes a ceiling image CL corresponding to a ceiling of the indoor space and four walls of the indoor space. It includes the corresponding wall images W1 to W4 and the floor image FL corresponding to the floor in the indoor space. At this time, as illustrated in FIG. 5, a part of the wall image W2 may include a window image WD corresponding to a window in the indoor space as illustrated in FIG. In addition, the ceiling image CL may include an illumination image L corresponding to the illumination of the indoor space as illustrated in FIG.

  Then, upon receiving the room identification data, the indoor space identification data, and the installation position data added from any one of the omnidirectional cameras C, the indoor space image generation unit 336 generates the image processing unit 337 and the like. Thus, the indoor space image representing the three-dimensional model of the indoor space reflected in the received indoor image data is generated, and other corresponding property information is added to generate the property information. The generation of the indoor space image and the property information by the image processing unit 337 and the like will be described later in detail. After that, the indoor space image generation unit 336 registers the generated property information in the property information database 321 in association with the corresponding property identification data and indoor space identification data.

  Next, the process of generating the property information by the indoor space image generation unit 336 will be described more specifically with reference to FIGS. FIG. 6 is a diagram illustrating an example of boundary line extraction according to the present embodiment, FIG. 7 is a diagram illustrating an image before distortion correction according to the embodiment, and FIG. 8 is a diagram illustrating an indoor space image according to the present embodiment. It is a conceptual diagram etc. which illustrate.

  That is, when performing the property information generation process on the indoor image data transmitted from any of the spherical cameras C, first, the indoor space image generation unit 336 generates the indoor space image reflected in the indoor image data. The indoor space image representing the three-dimensional model is generated. More specifically, first, the boundary line extraction unit 338 of the indoor space image generation unit 336 extracts a ceiling image corresponding to the ceiling of the corresponding indoor space and a wall corresponding to each wall from the indoor image corresponding to the indoor image data. A boundary line with the image, a boundary line between the wall images corresponding to the respective walls, and a boundary line between the floor image corresponding to the floor in the indoor space and the wall image corresponding to each wall are extracted. More specifically, the boundary line extraction unit 338 extracts boundary lines BCW1 to BCW4 between the ceiling image CL and each of the wall images W1 to W4, for example, from the indoor image D illustrated in FIG. Further, the boundary line extraction unit 338 extracts, from the indoor image D, a boundary line BW12, a boundary line BW23, a boundary line BW34, and a boundary line BW14 between the wall images W1 to W4. Furthermore, the boundary line extraction unit 338 extracts, from the indoor image D, boundary lines BFW1 to BFW4 between the floor image FL and the wall images W1 to W4. At this time, the extraction of each boundary line BCW1 or the like itself can use the same method of extracting a boundary line between surfaces in an image as in the related art.

  After the boundary lines BCW1 and the like are extracted from the indoor image D, the image extracting unit 339 then generates a surface (see FIG. 6A) surrounded by the boundary lines BCW1 and the like based on the boundary lines BCW1 and the like. , The ceiling image CL, the wall images W1 to W4, and the floor image FL. At this time, the extraction of the ceiling image CL or the like can use the same image extraction method as that of the related art. After the ceiling image CL or the like is extracted, the intersection extracting unit 340 then determines, based on each of the boundary lines BCW1 and the like, an intersection where each of the boundary lines BCW1 and the like intersects with the room angle CN of the indoor space (see FIG. 6A). Are shown as examples). At this time, the extraction of the room angle CN itself can use the same acute angle intersection extraction method as the conventional method.

  After the room angle CN is extracted, the horizontal distance detection unit 341 then detects the horizontal distance from the spherical camera C to each room angle CN extracted by the intersection extraction unit 340 based on the indoor image D. I do. That is, the horizontal distance detection unit 341 detects the vertical line standing from the floor through the position P (see FIG. 6B) of the spherical camera C and the room angles CN extracted by the intersection extraction unit 340 (see FIG. A) and FIG. 6B) are detected in the direction parallel to the floor. At this time, the detection of each horizontal distance itself can use the same method of detecting the horizontal distance using the spherical camera C as in the related art.

  When the horizontal distance from the spherical camera C to each room angle CN is detected, the distance calculation unit 342 then transmits the camera of the spherical camera C to each room angle CN extracted by the intersection extracting unit 340. The distance L from the unit 20 is calculated. That is, as shown in FIG. 6B, the distance calculation unit 342 includes a camera unit indicated by each horizontal distance PL detected by the horizontal distance detection unit 341 and the installation position data added to the indoor image data. The distance L is calculated for each room angle CN based on the height H from the floor 20 of the room. At this time, the position of the camera unit 20 and the imaging direction correspond to the position of the viewpoint and the direction of the line of sight of the user in the indoor space, respectively.

  After the distance L from the camera unit 20 to each room angle CN is calculated by the distance calculation unit 342, the image processing unit 337 then calculates the ceiling image CL and the like extracted by the image extraction unit 339. The expansion and contraction processing and the expansion processing using the calculated distance L are performed to correct distortion in each ceiling image CL and the like. More specifically, the image processing unit 337 determines, for example, the wall image W1 (see FIG. 6A) surrounded by the boundary lines BCW1, BW14, BFW1, and BW12 from the position of the camera unit 20. Correction processing including expansion / contraction processing using the distance L to each room angle CN (that is, from the position of one point in the indoor space) is performed, and the wall image W1 including the distortion illustrated in FIG. The distortion-free (square) corrected wall image MW1 illustrated in FIG. 7B is generated. Further, the image processing unit 337 performs the same distortion correction processing on the ceiling image CL, the wall images W2 to W4, and the floor image FL, respectively, and corrects the corrected ceiling image MCL, the corrected wall images MW2 to MW4, and A corrected floor image MFL is generated.

  After that, the image processing unit 337 combines the generated corrected wall images MW1 and the like into a hexahedral view corresponding to the indoor space as illustrated in FIG. Further, the indoor space image R representing the three-dimensional model of the indoor space reflected in the indoor image data is generated. By using the indoor space image R, for example, by changing the viewpoint and line of sight of a viewer (for example, a user of the general consumer terminal 1) based on the installation position data added to the original indoor image data, While moving in the indoor space where the three-dimensional model is represented by the spatial image R, the indoor space can be observed from the viewpoint of the viewer.

  When a plurality of indoor image data to which the same property identification data is added are received, a plurality of indoor image data are transmitted for one real estate property, that is, a plurality of indoor space There will be. In this case, the image processing unit 337 connects the indoor space image R corresponding to each indoor image data, and generates an indoor space image representing a three-dimensional model of the entire real estate including the plurality of indoor spaces. More specifically, when there are two indoor spaces connected via a door, for example, as shown in FIG. 8B, the image processing unit 337 generates indoor image data of each of the indoor spaces. , A portion common to the indoor space image R1 and the indoor space image R2 respectively corresponding to the indoor image data (the door image DR in the case illustrated in FIG. 8B) is detected, and the detection is performed. The indoor space image R1 and the indoor space image R2 are connected so that the result is shared. More specifically, the connection method used in this case is, for example, i) a method of connecting indoor space images using feature amounts described below, and ii) connecting an indoor space image using arrangement. Method.

i) Method of Connecting Indoor Space Images Using Feature Amount In the case of using a method of connecting indoor space images using feature amounts, the image processing unit 337 uses the method of connecting the indoor space images reflected in the original indoor image data. A characteristic amount of an image of a characteristic portion in the space (for example, a window or a door for moving between the indoor spaces) is detected for each indoor space image. More specifically, the image processing unit 337 determines the characteristic amount of the door image DR illustrated in FIG. 8B when viewed from the indoor space image R1 side and the characteristic amount when viewed from the indoor space image R2 side. And the feature amount are detected. The “feature value” at this time is, for example, in the case of a door, a parameter quantitatively indicating a feature such as a shape of the entire door, a position of a door knob, a pattern or a color of a door surface, and the like. In addition, for example, the feature quantity in the case of a window common to two indoor spaces includes features such as the overall shape of the window, its structural features (eg, left and right sliding door type), and colors (including whether or not it is transparent). These are quantified parameters. Then, the image processing unit 337 compares the feature amounts detected for the indoor space image R1 and the indoor space image R2, respectively, and when it is determined that they correspond to the same door or window, the image processing unit 337 intervenes therebetween. , The indoor space image R1 and the indoor space image R2 are connected. When detecting the characteristic amount, the characteristic amount may be detected not for a part of the wall or the like like the door or the like but for the entire wall or floor.

ii) Method of connecting indoor space images using arrangement When using a method of connecting indoor space images using arrangement, the image processing unit 337 performs the processing in the indoor space reflected in the original indoor image data. The arrangement of the image of the characteristic portion in the portion of the indoor space image including the image (for example, the wall image including the image) is detected for each indoor space image. More specifically, the image processing unit 337 arranges the door image DR illustrated in FIG. 8B on the entire wall when viewed from the indoor space image R1 side and when viewed from the indoor space image R2 side. And its arrangement over the entire wall of the. The “arrangement” at this time means, for example, in the case of a door, the dimensions of the entire door, or its position on the wall containing the door (for example, the distance from the end of the wall or the ratio to the width of the entire wall). . The same applies hereinafter.) For example, in the case of a window common to two indoor spaces, the parameter is a parameter indicating the size of the entire window or its position on a wall including the window. Then, the image processing unit 337 compares the above-described arrangements detected for the indoor space image R1 and the indoor space image R2, and if it is determined that they correspond to the same door or window, the image processing unit 337 interposes them. The indoor space image R1 and the indoor space image R2 are connected.

  Next, the indoor space image generation unit 336 adds other necessary property information as the real estate property to the generated indoor space image R and the like, generates property information to be registered in the property information database 321, The property information is registered in the property information database 321.

  Returning to FIG. 4, the page providing unit 331 generalizes the floor plan creation / display page of the present embodiment via the network NW in response to a request from any of the general consumer terminals 1 accessing the property information site. Provide (send) to the consumer terminal 1. In addition, the page providing unit 331 displays the property information posting page (including an indoor space image described later) in response to a search request for the real estate property from any of the general consumer terminals 1 accessing the property information site. , Via the network NW to the general consumer terminal 1 that transmitted the search request.

  FIG. 9 is a diagram illustrating an example of a floor plan creation / display page according to the present embodiment. FIG. 9 shows an example in which the trajectory input region R10 for inputting the trajectory is displayed on the screen of the display of the operation display unit 14 of the general consumer terminal 1. As shown in FIG. 9, the floor plan creation / display page of this embodiment is provided with a locus input area R10, an image display area R20, and the like. In the trajectory input area R10, an input area 100, an input button 111, and a transmission button 112 are provided. The input button 111 is operated when the user of the general consumer terminal 1 starts creating a floor plan of a real estate property. By operating the input button 111, the system control unit 13 of the general consumer terminal 1 on which the floor plan creation / display page is displayed initializes, for example, trajectory data and the like that have been input so far. The input area 100 is an area in which a line indicating a component that constitutes a real estate property for which a floor plan is desired to be created is input by a free hand using the touch panel of the operation display unit 14 for each component. . The general consumer terminal 1 on which the trajectory data and the like corresponding to the trajectory of the line input using the input area 100 (see FIG. 3B) and the floor plan creation / display page are displayed by other general consumers A floor plan image data request including terminal identification data for identifying from the terminal 1 is transmitted from the general consumer terminal 1 via the network NW every time the trajectory data indicating one component and the terminal identification data are input. The information is transmitted to the information providing server 3. In transmitting the trajectory data and the like and the terminal identification data, the system control unit 13 performs the transmission at a timing when the transmission button 112 is operated.

  The image display area R20 is displayed on the screen by scrolling the layout creation / display page by a general consumer scroll operation using the operation display unit 14. The image display area R20 includes a display area 200, a correction button 201, a three-dimensionalization button 202, and a property search button 203. The display area 200 displays a floor plan image corresponding to the floor plan image data transmitted from the information providing server 3 for each component. As the floor plan image, first, a two-dimensional floor plan image corresponding to the trajectory of the line input using the input area 100 is displayed. The correction button 201 is operated when a line or a point for correcting the floor plan image displayed in the display area 200 is input, for example, for each component. When the operation of the correction button 201 is detected, the system control unit 13 enables input of a new (for correction) freehand line using the display area 200. The trajectory of the line input for correction is transmitted to the network NW for each component as the trajectory data for correction or the like, and the corresponding floor plan image data is corrected in the information providing server 3. The modified floor plan image data is transmitted to the general consumer terminal 1 again via the network NW based on the terminal identification data, and the corresponding corrected floor plan image is displayed again in the display area 200.

  The three-dimensionalization button 202 displays a three-dimensional floor plan image corresponding to a three-dimensional model obtained by three-dimensionalizing the two-dimensional floor plan image in the display area 200 in a state where the two-dimensional floor plan image is displayed in the display area 200. It is operated when. When the three-dimensionalization button 202 is operated, the system control unit 13 sends a three-dimensionalization request corresponding to the operation to the general consumer terminal 1 on which the three-dimensionalization button 202 is operated and the other general consumer terminals 1. The information is transmitted to the information providing server 3 via the network NW together with the terminal identification data for identifying from the server. When three-dimensional floor plan image data corresponding to the three-dimensional processing is transmitted from the information providing server 3 based on the terminal identification data, the system control unit 13 corresponds to the three-dimensional floor plan image data. The three-dimensional floor plan image is displayed in the display area 200.

  The property search button 203 is operated when searching for a real estate property having a floor plan corresponding to the floor plan image displayed in the display area 200. After the property search button 203 has been operated, the system control unit 13 sets a search condition (not shown) for inputting the search condition when there is a search condition other than the floor plan corresponding to the displayed floor plan image. An input screen is displayed on the display of the operation display unit 14, and the search condition is input. The search condition input using the search condition input screen corresponds to, for example, a search condition displayed in a search condition designation area R1 in a property information posting page described later with reference to FIG. Then, the system control unit 13 sends the search request including the search condition together with terminal identification data for identifying the general consumer terminal 1 including the system control unit 13 from other general consumer terminals 1. , To the information providing server 3 via the network NW. Thereafter, when a property information posting page corresponding to the search request is transmitted from the information providing server 3, the system control unit 13 displays the same on the display of the operation display unit 14.

  FIG. 10 is a diagram illustrating an example of a property information posting page on which property information of the present embodiment is posted. FIG. 10 shows an example in which a list of rental properties searched according to the search conditions included in the search request is displayed. As shown in FIG. 10, the property information posting page of the present embodiment is provided with a search condition designation area R1, a property list display area R2, an advertisement display area R3, and the like. The search condition specification area R1 is an area for specifying search conditions for real estate properties. In the search condition specification region R1, an area specification column and a floor plan selection column illustrated in FIG. 10, and an appearance photograph or an indoor space photograph that is displayed so as to be selectable when designating the search condition and referred to are displayed. At this time, the exterior photograph or the interior space photograph is an exterior photograph or an interior space photograph of a real estate property registered in the property information database 321 (see FIG. 2). In addition, as the appearance photograph or the indoor space photograph displayed in the search condition specification region R1, for example, the display may be narrowed down to the appearance photograph or the indoor space photograph of the real estate property of the floor plan selected in the floor plan selection column. The property list display area R2 is an area for displaying a list of real estate properties searched according to specified search conditions. In the property list display area R2, a property display area R2a, a property display area R2b, a property display area R2c, and the like, which are separated for each searched real estate property, are provided in a predetermined display order. When the general consumer terminal 1 receives the property information posting page, the property display area R2a, property display area R2b, and property display area R2c, in which the display order is set higher, are displayed on the screen as shown in FIG. Is done. Then, by scrolling the property information posting page by a general consumer's scroll operation, the property order display area R2d whose display order is set lower than the property display area R2c is displayed on the screen. In each property display area, part of the property information in the property information (for example, property name, property type, rent, location, traffic, occupied area, floor plan, etc.), and link letters and buttons to detailed pages Is displayed (in some cases, an inquiry button is displayed). For example, the property name 101 and the “see details” 102 displayed in the property display area R2a are link characters to a detail page, and when the link is clicked or tapped, the detail page is provided by the page providing unit 331. Will be done. On the detail page, almost all of the property information in the property information, broker information, and an inquiry button are displayed (a material request button may be displayed). Further, on the detail page, a panoramic image (including the indoor space image of the present embodiment) as an advertisement for the real estate, a staff comment, and the like are displayed. The advertisement display area R3 is an area for displaying an advertisement of a real estate property (for example, a banner advertisement in which a link to a detailed page is set) according to the selection. Such an advertisement display region R3 may be provided on a page (for example, a blog page) provided from a specific site (not limited to the property information site), in addition to the property information posting page.

  Next, the search unit 332 of the system control unit 33 uses the above-described floor plan creation / display page (see FIG. 9) to transmit the above-described trajectory data and the like included in the floor plan image data request transmitted from the general consumer terminal 1. , The reference data database 322 is searched to identify the reference data (see FIG. 3B) of the component corresponding to the trajectory data and the like. More specifically, for example, when trajectory data or the like indicating a trajectory indicated as “room 1” in FIG. 3B is transmitted, the search unit 332 searches the reference data database based on the trajectory data or the like. 322 is searched, and the reference data of the “room 1” is specified. Thereby, the floor plan image data generation unit 333 reads the specified reference data from the reference data database 322 based on the specification information of the reference data from the search unit 332, and corresponds to a floor plan corresponding to the reference data. Generate floor plan image data. For example, when the reference data indicated as “room 1” in FIG. 3B is read, the floor plan image data generation unit 333 determines the corresponding one of the rooms as a drawing of the trajectory indicated by the trajectory data and the like. It generates floor plan image data corresponding to a rectangular drawing having the entire width and depth. When the general trajectory data or the like for correction corresponding to the operation of the correction button 201 is newly transmitted from the general consumer terminal 1, the search unit 332 searches the newly transmitted trajectory data or the like. The reference data database 322 is searched based on the reference data, and the corresponding reference data is specified. Further, the floor plan image data generation unit 333 reads the specified reference data from the reference data database 322 and corresponds to the corresponding floor plan. To generate (ie, correct) the floor plan image data.

  Here, based on a request corresponding to the operation of the three-dimensionalization button 202 from the general consumer terminal 1, the floor plan image data generation unit 333 corresponds to the two-dimensional floor plan image data corresponding to the reference data (ie, Three-dimensional floor plan image data representing a three-dimensional model (three-dimensionalized from the two-dimensional floor plan image) is generated. The generation of the three-dimensional floor plan image data will be described later in detail with reference to FIGS. After that, the display control unit 334 transmits the floor plan image data generated by the floor plan image data generation unit 333 to the general consumer terminal 1 that has transmitted the floor plan image data request based on the terminal identification data. Thereby, in the general consumer terminal 1 to which the floor plan image data has been transmitted, the floor plan image (that is, the two-dimensional floor plan image or the three-dimensional floor plan image) corresponding to the floor plan image data is displayed on the floor plan creation / display page. The image is displayed using the image display area R20. When a search request corresponding to the operation of the property search button 203 is transmitted from the general consumer terminal 1 on which the floor plan image is displayed, the property information acquisition unit 335 determines the search condition included in the search request. The property information database 321 is used to search the property information database 321, and property information corresponding to the search result is output to the page providing unit 331. Accordingly, the page providing unit 331 transmits the property information providing page (see FIG. 10) including the output property information to the general consumer terminal 1 that has transmitted the search request based on the terminal identification data. I do. Then, the general consumer terminal 1 to which the property information providing page is transmitted displays the property information providing page on the display of the operation display unit 14. The search of the property information by the property information acquisition unit 335 in response to the above search request will be described later in detail with reference to FIG.

  Next, generation of three-dimensional floor plan image data by the floor plan image data generation unit 333 will be specifically described with reference to FIGS. 11 and 12 are diagrams exemplifying a process of creating three-dimensional floor plan image data according to the present embodiment.

  First, the floor plan image data generation unit 333 generates two-dimensional floor plan image data based on the trajectory data and the like and the reference data transmitted from the general consumer terminal 1, and sends the generated two-dimensional floor plan image data to the general consumer terminal 1. Send and display the corresponding two-dimensional floor plan image. Here, it is assumed that the displayed floor plan of the two-dimensional floor plan image is, for example, the floor plan FP shown in FIG. The floor plan FP illustrated in FIG. 11A is a floor plan of the lower left room RMF1 (that is, the left room facing the veranda) in the floor plan FP illustrated in FIG. 3A. In the floor plan FP shown in FIG. 11A, one room RMF1 includes walls WLF1 to WLF4, the wall WLF1 has a sliding door SDF1, the wall WLF2 has a sliding door SDF3, and the wall WLF3 has a sliding door SDF3. There is a window WF and a sliding door SDF2 on the wall WLF4. When the three-dimensionalization request is transmitted from the general consumer terminal 1 on which the floor plan image of the floor plan FP illustrated in FIG. 11A is displayed, the floor plan image data generation unit 333 generates the floor plan image FP. A three-dimensional model is generated by converting the floor plan image into a three-dimensional image. Based on the generated three-dimensional model, three-dimensional floor plan image data corresponding to the three-dimensional floor plan image illustrated in FIG. 11B is generated. More specifically, based on the positions and lengths of the walls WLF1 to WLF4 shown in FIG. 11A, the floor plan image data generation unit 333 sets, for example, a standard ceiling height as a house to a ceiling as a room RMF1. By determining the height and generating a three-dimensional model having the ceiling height, three-dimensional floor plan image data corresponding to the three-dimensional floor plan image illustrated in FIG. 11B is generated. In the three-dimensional floor plan image illustrated in FIG. 11B, a three-dimensional floor plan image is configured to include four wall images WL1 to WL4 viewed from the outside. The wall image WL1 includes the sliding door image SD1 of the sliding door SDF1, the wall image WL2 includes the sliding door image SD3 of the sliding door SDF3, and the wall image WL3 includes the window image WD of the window WF. The wall image WL4 includes a sliding door image SD2 of the sliding door SDF2. In addition, the floor plan image data generation unit 333 corresponds to the horizontal position FP of the sliding doors SDF1 to SDF3 and the window WF in the three-dimensional floor plan image in the three-dimensional floor plan image according to the floor plan FP illustrated in FIG. Position and frontage. Furthermore, the floor plan image data generation unit 333 determines the vertical position and height of the sliding doors SDF1 to SDF3 and the window W in the three-dimensional floor plan image in the standard manner as the sliding doors SDF1 to SDF3 and the window WF. Position and height. Further, in addition to the three-dimensional floor plan image data illustrated in FIG. 11B (that is, three-dimensional floor plan image data for externally viewing the room RMF1), the floor plan image data generation unit 333 also includes Also, three-dimensional floor plan image data for internally viewing the room RMF1 illustrated in FIG. 12B is generated. That is, the floor plan image data generation unit 333 stands, for example, at the center of the room RMF1 of the floor plan FP illustrated in FIG. 11A and views the room RMF1 viewed from the viewpoint and the line of sight of the wall WLF1 and the wall WLF4. 12A is generated as illustrated in FIG. 12A. In the three-dimensional floor plan image illustrated in FIG. 12A, a three-dimensional floor plan image is configured to include the two-wall image WL1 and the wall image WL4 that are viewed in the interior. The wall image WL1 includes the sliding door image SD1, and the wall image WL4 includes the sliding door image SD2. Further, the floor plan image data generating unit 333 stands in the center of the room RMF1 and views the wall WLF2 and the wall WLF3 with the user's viewpoint and the three-dimensional floor plan image data for internally viewing the room RMF1 viewed from the line of sight. It is generated as illustrated in FIG. In the three-dimensional floor plan image illustrated in FIG. 12B, a three-dimensional floor plan image is configured to include the two-wall image WL2 and the wall image WL3 that are viewed in the interior. The wall image WL2 includes the sliding door image SD3, and the wall image WL3 includes the window image WD. Thereafter, the display control unit 334 sends the three-dimensional floor plan image data generated by the floor plan image data generation unit 333 to the general consumer terminal 1 that has transmitted the three-dimensionalization request based on the terminal identification data. And sends them via the network NW to display corresponding three-dimensional floor plan images.

  Then, in response to the operation of the correction button 201, for example, when locus data for correction indicating that the window WF is a window from the floor is transmitted, the floor plan image data generation unit 333 proceeds to FIG. The window image WD in the three-dimensional floor plan image illustrated in FIG. 3 is corrected to be a window from the floor, and the three-dimensional floor plan image corresponding to the three-dimensional floor plan image of the room RMF1 having the window WF after the height correction is performed. Generate data. After that, the display control unit 334 transmits the corrected three-dimensional floor plan image data to the general consumer terminal 1 that has transmitted the correction trajectory data and the like via the network NW, and A three-dimensional floor plan image corresponding to the original floor plan image data is displayed. On the other hand, if, for example, trajectory data for correction indicating that the width of the window WF is to be expanded is transmitted in response to the operation of the correction button 201, the floor plan image data generation unit 333 exemplifies the processing in FIG. 11B. The width of the window image WD in the three-dimensional floor plan image is corrected to be expanded to the width indicated by the trajectory data and the like, and the three-dimensional floor plan image corresponding to the three-dimensional floor plan image of the room RMF1 having the window WF having the corrected width is obtained. Generate floor plan image data. After that, the display control unit 334 transmits the corrected three-dimensional floor plan image data to the general consumer terminal 1 that has transmitted the correction trajectory data and the like via the network NW, and A three-dimensional floor plan image corresponding to the original floor plan image data is displayed.

  Next, when a search request corresponding to the operation of the property search button 203 is transmitted from the general consumer terminal 1 on which the floor plan image is displayed (see FIG. 9), the property information acquisition unit 335 responds to the search request. The property information database 321 is searched using the included search conditions. Here, the search request transmitted from the general consumer terminal 1 includes three-dimensional floor plan image data corresponding to the three-dimensional floor plan image displayed in the display area 200 of the floor plan creation / display page. In addition to the above case, there may be cases in which photographic image data corresponding to the exterior photograph or the indoor space photograph displayed in the search condition designation area R1 of the property information posting page illustrated in FIG. 10 is included. Therefore, when the search request includes the above-described photo image data, the property information acquisition unit 335 searches the property information database 321 using the photo image data (in particular, when the property request is registered in the property information database 321). The exterior information and the indoor photo image are searched for), and the property information including the photo image as the search result is output to the page providing unit 331. On the other hand, when the search request includes the three-dimensional floor plan image data, the property information acquisition unit 335 determines the three-dimensional floor plan image data and the indoor space image ( (3D indoor space image), and searches for an indoor space image similar to the 3D floor plan image data included in the search request. Then, the property information acquisition unit 335 causes the page providing unit 331 to output the property information including the (three-dimensional) indoor space image as the search result from the property information database 321. Accordingly, the page providing unit 331 sets the property information providing page (see FIG. 10) including the output property information (that is, property information including the photograph image or the indoor space image as a search result) as described above. The search request is transmitted to the general consumer terminal 1 that has transmitted the request based on the terminal identification data, and is displayed on the display of the operation display unit 14.

  Next, a method for searching for a similar indoor space image using the three-dimensional floor plan image data when the search request includes the three-dimensional floor plan image data will be specifically described with reference to FIG. I do. FIG. 13 is a diagram illustrating the search processing according to the present embodiment.

  Now, it is assumed that the three-dimensional floor plan image corresponding to the three-dimensional floor plan image data included in the search request is the three-dimensional floor plan image RM10 illustrated in FIG. The three-dimensional floor plan image RM10 illustrated in FIG. 13A is surrounded by wall images WL10 to WL13, the wall image WL10 includes a sliding door image SD10, and the wall image WL11 includes a window image. The wall image WL12 includes a window image WD11. Then, when a search request including the three-dimensional floor plan image data corresponding to such a three-dimensional floor plan image RM10 is transmitted from the general consumer terminal 1, the property information acquisition unit 335 sets a preset value. A feature value extraction algorithm (more specifically, for example, a semantic segmentation method in a deep learning technique) extracts feature values (also referred to as feature points) of each of the four wall images WL10 to WL13. . As the feature at this time, for example, HOG (Histograms of Oriented Gradients) feature is extracted. The HOG feature amount is a feature amount indicating a luminance gradient extracted from a local region of the image. The HOG feature amount is obtained by dividing a local region from an image into cells (for example, dividing the local region into n × n blocks and dividing the divided blocks into m × m (m is a natural number)) according to a feature amount extraction algorithm. The gradient strength and gradient direction are calculated for each cell, and a gradient direction histogram is generated and normalized to be extracted. Alternatively, an EOH (Edge of Orientation Histograms) feature that focuses on edges or a Haar-like feature that focuses on luminance may be extracted as a feature of an image. In addition, various known feature amounts such as SIFT (Scale-Invariant Feature Transform) feature amount and SURF (Speeded Up Robust features) feature amount, or a combination of these may be extracted as the image feature amount. .

  After the characteristic amounts of the wall images WL10 to WL13 are extracted, the property information acquisition unit 335 specifies one wall image based on the extracted characteristic amounts. At this time, the property information acquisition unit 335 may specify, for example, the one wall image with the largest extracted feature amount, or based on the relative values of the feature amounts of the wall images WL10 to WL13. Then, one wall image may be specified according to a preset rule. In the case illustrated in FIG. 13A, it is assumed that the wall image WL11 is specified, for example. Next, in the case illustrated in FIG. 13A, the property information acquisition unit 335 determines between the specified wall image WL11 and each of the wall images in the indoor space image registered in the property information database 321. Calculate the similarity.

  Here, the property information acquisition unit 335 can determine the similarity (coincidence) using a preset image matching algorithm. For this determination, for example, the above-described feature amount is used. For example, the property information acquisition unit 335 calculates the degree of coincidence between the characteristic amount of the specified wall image WL11 and the characteristic amount of each of the wall images in the indoor space image. 80%) or more is determined by the image matching algorithm. If the degree of coincidence is equal to or greater than the threshold value, the feature amount of the specified wall image WL11 matches the wall image in the indoor space image (or similarity). To do).

  On the other hand, it is assumed that a three-dimensional indoor space image MRM10 illustrated in FIG. 13B is registered in the property information database 321. The indoor space image MRM10 is surrounded by wall images MWL10 to MWL13, the wall image MWL10 includes a sliding door image MSD10, the wall image MWL11 includes a window image MWD12, and the wall image MWL12. Includes a window image MWD11. When such an indoor space image MRM10 is registered in the property information database 321, the property information acquisition unit 335 extracts the feature amounts of the four wall images MWL10 to MWL13 by the above-described feature amount extraction algorithm. Then, it is assumed that the image matching algorithm determines that the wall image WL11 illustrated in FIG. 13A and the wall image MWL11 illustrated in FIG. 13B match (similarly).

  Next, the property information acquisition unit 335 determines the feature amount of the wall image WL10 in the first positional relationship (for example, the right side) set in advance with respect to the wall image WL11 illustrated in FIG. The similarity between the feature amount of the wall image MWL10 having the first positional relationship with the wall image MWL11 exemplified in B) is calculated using the image matching algorithm. Then, when the similarity between the wall image WL10 and the wall image MWL10 is equal to or greater than a preset threshold, the property information acquisition unit 335 then determines the second positional relationship (for the wall image WL11). For example, the similarity between the above-described feature amount of the wall image WL12 adjacent to the left) and the above-described feature amount of the wall image MWL12 having the second positional relationship with the wall image MWL11 illustrated in FIG. Is further calculated using the image matching algorithm. Then, when the similarity between the wall image WL12 and the wall image MWL12 is equal to or greater than a preset threshold, the property information acquisition unit 335 outputs the three-dimensional floor plan image RM10 illustrated in FIG. A search is performed assuming that the room space image MRM10 illustrated in FIG. 13B including the image MWL10 to the wall image MWL12 matches (similarly). Then, the property information acquisition unit 335 causes the page providing unit 331 to output the property information including the indoor space image as the search result, and displays the property information providing page including the property information on the general consumer who has transmitted the search request. The data is transmitted to the terminal 1 based on the terminal identification data, and is displayed on the display of the operation display unit 14.

[2. Operation of Information Providing System S]
Next, an operation of the information providing system S of the present embodiment will be described with reference to FIGS.

[2-1. Property information generation processing]
First, the property information processing of the present embodiment, which is executed mainly by the indoor space image generation unit 336, will be described with reference to FIG. FIG. 14 is a sequence diagram and the like showing the entire property information generation process of the present embodiment.

  As shown in FIG. 14A, in the property information processing of the present embodiment, first, when the omnidirectional camera C is installed in one indoor space in a real estate property and its power button is turned on, The control unit 21 of the omnidirectional camera C controls the camera unit 20 to capture all directions in the indoor space as a panoramic image (step S1). Then, the control unit 21 monitors whether the shutter button of the operation display unit 23 has been operated (step S2). In the monitoring of step S2, as long as the shutter button is not operated (step S2: NO), the control unit 21 returns to step S1 and continuously captures the omnidirectional image. On the other hand, in the monitoring of step S2, if the shutter button is operated (step S2: YES), then, the control unit 21 converts the spherical image captured at the timing when the shutter button is operated into a spherical image. The image is stored in the storage unit 22 as an indoor image of the indoor space where the camera C is installed (step S3).

  Next, the control unit 21 monitors whether or not a transmission operation for transmitting the indoor image data corresponding to the indoor image stored in step S3 to the information providing server 3 is performed on the operation display unit 23 (step S3). S4). In the monitoring of step S4, when the transmission operation is not performed (step S4: NO), the control unit 21 returns to step S1 and continues to capture the omnidirectional image. On the other hand, when the transmission operation is performed in the determination of step S4 (step S4: YES), the control unit 21 determines the room identification stored in step S3 and the property identification data and the indoor space identification associated with the indoor image. The data and the installation position data are added and transmitted to the information providing server 3 via the communication unit 24 and the network NW (step S5). The property identification data, the indoor space identification data, and the installation position data added at this time are, for example, when the omnidirectional camera C is installed, for example, by using the operation display unit 23, the real estate agency that installed the camera. The information is input by a trader or the like and stored in the storage unit 22.

  Next, for example, after the power of the information providing server 3 is turned on, the room image data to which the property identification data, the indoor space identification data, and the installation position data are added is received from any of the spherical cameras C. In this case, the indoor space image generation unit 336 of the information providing server 3 generates the indoor space image representing the three-dimensional model of the indoor space reflected in the received indoor image data by the image processing unit 337 and the like, and generates the indoor space image. The corresponding other property information is added to generate property information (step S6). Step S6 will be described later in detail with reference to FIG. Next, the indoor space image generation unit 336 registers (stores) the property information generated in step S6 in the property information database 321 in association with the corresponding property identification data and indoor space identification data (step S7).

  Next, the property information generation processing in step S6 will be described more specifically with reference to FIG.

  That is, when performing the process of generating the property information on the indoor image data transmitted from any spherical camera C (step S6 in FIG. 14A), the indoor space image generation unit 336 sets the indoor image data The indoor space image representing the three-dimensional model of the indoor space reflected in the data is generated. More specifically, the boundary line extraction unit 338 calculates the boundary line between the ceiling image corresponding to the ceiling of the corresponding indoor space and the wall image corresponding to each wall from the indoor image corresponding to the room image data, Each is extracted (step S60; see FIG. 6A). After the respective boundary lines BCW1 and the like are extracted from the indoor image D in step S60, the image extracting unit 339 then determines a plane surrounded by the respective boundary lines BCW1 and the like based on the respective boundary lines BCW1 and the like (FIG. 6A). Is extracted as the ceiling image CL or the like (step S61). When the ceiling image CL or the like is extracted in step S61, the intersection extracting unit 340 then extracts, based on each of the boundary lines BCW1 or the like, an intersection at which each of the boundary lines BCW1 or the like intersects as the room angle CN of the indoor space. (Step S62). After the room angle CN is extracted in step S62, the horizontal distance detection unit 341 then calculates the horizontal distance from the spherical camera C to each room angle CN extracted in step S62 based on the indoor image D. It is detected (step S63). When the horizontal distance from the omnidirectional camera C to each room angle CN is detected in step S63, the distance calculation unit 342 then transmits the omnidirectional camera C to each room angle CN extracted in step S62. The distance L from the camera unit 20 is calculated (step S64). When the distance L from the camera unit 20 to each room angle CN is calculated in step S64, the image processing unit 337 then calculates the calculated ceiling image CL or the like extracted in step S61. The expansion and contraction processing and the expansion processing using the distance L are performed to correct the distortion in each ceiling image CL and the like (step S65; see FIG. 7). Note that the above-described distortion correction processing and the like for the ceiling image CL can be similarly performed on the floor image FL.

  After that, the image processing unit 337 combines the corrected wall images MW1 and the like generated in step S65 as a six-view diagram corresponding to the indoor space (that is, four wall diagrams and a ceiling view and a floor view). Then, the indoor space image R representing the three-dimensional model of the indoor space reflected in the indoor image data received in step S6 is generated (step S66; see FIG. 8A).

  Next, the indoor space image generation unit 336 determines whether or not a plurality of indoor image data to which the same property identification data has been added has been received (step S67). If it is determined in step S67 that a plurality of indoor image data to which the same property identification data has been added has not been received (step S67: NO), the indoor space image generation unit 336 proceeds to step S69 described below. On the other hand, if it is determined in step S67 that a plurality of indoor image data to which the same property identification data has been added has been received (step S67: YES), the image processing unit 337 determines that the indoor corresponding to each indoor image data. The spatial images R are connected to generate an indoor space image representing a three-dimensional model of the entire real estate including the plurality of indoor spaces (step S68; see the above-described methods i) and ii). ). Next, the indoor space image generation unit 336 adds other property information necessary as the real estate property to the indoor space image R or the like generated in steps S60 to S68, and then proceeds to step S7 in FIG. Then, the property information to be registered in the property information database 321 is generated (step S69). Thereafter, the indoor space image generation unit 336 proceeds to step S7 in FIG.

[2-2. 3D Floor Plan Image Generation Processing]
Next, a process of generating a three-dimensional floor plan image of the present embodiment, which is executed mainly by the floor plan image data generation unit 333, will be described with reference to FIG. FIG. 15 is a sequence diagram illustrating a process of generating a three-dimensional floor plan image according to the present embodiment.

  As shown in FIG. 15, in the generation processing of the three-dimensional floor plan image data of the present embodiment, for example, after accessing the property information site in accordance with the user operation on the general consumer terminal 1 and completing the login, A request to transmit the creation / display page is transmitted from the general consumer terminal 1 to the information providing server 3 via the network NW (step S10). Then, in response to the request, the page providing unit 331 of the information providing server 3 provides the floor plan creation / display page illustrated in FIG. 9 to the general consumer terminal 1 via the network NW (step S11). Next, the system control unit 13 of the general consumer terminal 1 to which the floor plan creation / display page has been transmitted displays the received floor plan creation / display page on the display of the operation display unit 14 (step S12; see FIG. 9).

  Then, using the input area 100 of the displayed floor plan creation / display page, a line indicating a component constituting a real estate property for which a floor plan is desired to be created is input freehand for one component. (Step S13), the trajectory data corresponding to the trajectory of the line is transmitted to the information providing server 3 via the network NW together with the terminal identification data of the general consumer terminal 1 (step S14). Next, the search unit 332 of the information providing server 3 searches the reference data database 322 based on the received trajectory data and the like to specify the corresponding reference data (Step S15). Next, the floor plan image data generation unit 333 reads out the specified reference data from the reference data database 322, and generates two-dimensional floor plan image data corresponding to the floor plan corresponding thereto (step S16). Next, the display control unit 334 transmits the generated two-dimensional floor plan image data to the general consumer terminal 1 identified by the terminal identification data based on the terminal identification data transmitted together with the locus data and the like in step S14. It transmits (step S17). Next, the system control unit 13 of the general consumer terminal 1 to which the two-dimensional floor plan image data has been transmitted is the two-dimensional floor plan FP floor plan image FP of one component corresponding to the received two-dimensional floor plan image data. (See FIG. 3A or FIG. 11A) is displayed in the display area 200 of the floor plan creation / display page displayed on the display of the operation display unit 14 (step S18). Next, the system control unit 13 monitors whether the modification button 201 of the floor plan creation / display page has been operated, for example, for a preset time (step S19). If the correction button 201 is operated in the determination of step S19 (step S19: YES), the system control unit 13 returns to step S13 to correct the two-dimensional floor plan displayed in the display area 200. , And waits for input of the correction line or the like. When a correction line or the like is input, thereafter, the above-described step S13 and subsequent steps are repeated for the trajectory data of the trajectory corresponding to the correction line and the like.

  On the other hand, in the determination of step S19, when there is no operation of the correction button 201 (step S19: NO), the system control unit 13 determines whether the three-dimensionalization button 202 of the floor plan creation / display page has been operated. For example, monitoring is performed for a preset time (step S20). If it is determined in step S20 that the three-dimensionalization button 202 has been operated (step S20: YES), the system control unit 13 sets the three-dimensional floor plan FP displayed in the display area 200 to three-dimensionally. The three-dimensional request is transmitted to the information providing server 3 via the network NW together with the terminal identification data (step S21). Next, the floor plan image data generation unit 333 that has received the three-dimensionalization request receives the floor plan image data of the two-dimensional floor plan FP displayed in the display area 200, for example, based on the floor plan image data of FIGS. By using the method described above, three-dimensional floor plan image data corresponding to a three-dimensional model obtained by converting the two-dimensional floor plan image into three dimensions is generated (step S22). Next, the display control unit 334 converts the generated three-dimensional floor plan image data into the general consumer terminal 1 identified by the terminal identification data based on the terminal identification data transmitted together with the three-dimensional request in step S21. (Step S23). Next, the system control unit 13 of the general consumer terminal 1 to which the three-dimensional floor plan image data has been transmitted is the three-dimensional floor plan floor plan image (FIG. 11B or FIG. 11B) corresponding to the received three-dimensional floor plan image data. 12 is displayed in the display area 200 of the floor plan creation / display page (step S24).

[2-3. 3D Floor Plan Image Generation Processing]
Finally, a search process according to the present embodiment, which is executed mainly by the property information acquisition unit 335, will be described with reference to FIG. FIG. 16 is a sequence diagram illustrating a search process according to the present embodiment.

  As shown in FIG. 16, in the search processing of the present embodiment, for example, it is determined whether or not the property search button 203 in the floor plan creation / display page displayed on the general consumer terminal 1 has been operated. The first system control unit 13 monitors (step S30). When the property search button 203 is not operated in the monitoring of step S30 (step S30: NO), the system control unit 13 continues the monitoring as it is. On the other hand, in the monitoring of step S30, when the property search button 203 is operated (step S30: YES), the system control unit 13 sends the search request corresponding to the operation of the property search button 203 via the network NW. The information is transmitted to the information providing server 3 (step S31). This search request is received by the property information acquisition unit 335 of the information providing server 3. Here, as described above, the search request includes three-dimensional floor plan image data corresponding to the three-dimensional floor plan image displayed in the display area 200 of the floor plan creation / display page. In some cases, photographic image data corresponding to the exterior photograph or the indoor space photograph is included. Therefore, based on the received search request, the property information acquisition unit 335 determines whether the search request requests a search using the three-dimensional floor plan image data (step S32). If it is determined in step S32 that the search request requests a search using the photo image data (step S32: NO), then the property information acquisition unit 335 uses the photo image data to perform The exterior image and the indoor photographic image registered in the database 321 are searched, and a real estate property corresponding to the photographic image data as the search result is specified (step S33). After that, the property information acquiring unit 335 proceeds to Step S42 described later.

  On the other hand, in the determination of step S32, if the search request requests a search using the three-dimensional floor plan image data (step S32: YES), then, the property information acquisition unit 335 determines the search request from the search request. The three-dimensional floor plan image data is extracted (step S34). Next, the property information acquisition unit 335 specifies one wall image from a plurality of wall images constituting a three-dimensional floor plan image corresponding to the extracted three-dimensional floor plan image data (step S35). In this step S35, one wall image is specified by the method using the above-described feature amount. Next, the property information acquisition unit 335 determines the identified wall image (for example, the wall image WL11 illustrated in FIG. 13A), and each of the wall images in the indoor space image registered in the property information database 321. Is calculated, and a wall image in the indoor space image that matches or is similar to the wall image specified in step S35 is specified as the first registered wall image based on the similarity (step S36). In this step S36, the similarity is calculated by the above-described image matching algorithm. Next, the property information acquisition unit 335 converts the plurality of wall images constituting the three-dimensional floor plan image corresponding to the three-dimensional floor plan image data extracted in step S34 from the plurality of wall images specified in step S35 to the wall image specified in step S35. The right side wall image as the first positional relationship is specified (step S37). Next, the property information acquisition unit 335 places the wall image specified in step S37 (for example, the wall image WL10 illustrated in FIG. 13A) on the right of the first registered wall image in the indoor space image. The similarity between a certain wall image and the wall image in the indoor space image that matches or is similar to the right adjacent wall image specified in step S37 is determined as the second registered wall image based on the similarity. It is specified (step S38). Next, the property information acquisition unit 335 converts the plurality of wall images constituting the three-dimensional floor plan image corresponding to the three-dimensional floor plan image data extracted in step S34 from the plurality of wall images specified in step S35 to the wall image specified in step S35. The left adjacent wall image as the second positional relationship is specified (step S39). Next, the property information acquisition unit 335 places the wall image specified in step S39 (for example, the wall image WL12 illustrated in FIG. 13A) on the left side of the indoor space image with respect to the first registered wall image. The similarity between a certain wall image and the wall image in the indoor space image that matches or is similar to the left adjacent wall image specified in step S39 is determined as the third registered wall image based on the similarity. It is specified (Step S40). Next, the property information acquisition unit 335 generates an indoor space image including the first to third registered wall images and a three-dimensional floor plan image corresponding to the three-dimensional floor image data extracted from the search request. Are matched or similar, a room space image including the first registered wall image to the third registered wall image is searched in the property information database 321 as a similar room space image (step S41). Next, the property information acquisition unit 335 causes the page providing unit 331 to output the property information including the indoor space image as the search result, and displays the property information providing page including the property information on the general consumer who transmitted the search request. The data is transmitted to the terminal 1 based on the terminal identification data (step S42), and is displayed on the display of the operation display unit 14 (step S43).

  As described above, according to the search processing in the information providing system S of the present embodiment, even when there is no floor plan image as a two-dimensional drawing, using the three-dimensional floor plan image data specified by the user, Property information of a desired real estate property can be presented to the user.

  In addition, for a plurality of wall images constituting a three-dimensional floor plan image corresponding to the three-dimensional floor plan image data, a similar indoor space image is specified by determining the degree of coincidence or similarity using the feature amount. The property information of the real estate property closer to the desired real estate property can be presented to the user.

  Further, by using a wall image from which a feature amount as an image can be easily obtained, it is possible to accurately present the property information of a real estate property closer to a desired real estate property to a user.

  Furthermore, by using three of the first registered wall image to the third registered wall image (see FIG. 16), it is possible to accurately present the property information of the real estate nearer to the desired real estate to the user. .

  In addition, by using either the photograph image or the indoor space image (see FIG. 16), the property information of the real estate near the desired real estate can be accurately presented to the user.

  Note that, in the search processing of the present embodiment, in order to specify an indoor space image using a three-dimensional floor plan image corresponding to the three-dimensional floor plan image data included in the search request, a wall image constituting the three-dimensional floor plan image is specified. However, in addition to the above, the indoor space image may be specified by further using the ceiling image forming the three-dimensional floor plan image. In this case, by using the wall image and the ceiling image from which the feature amount as the image can be easily acquired, the property information of the real estate property closer to the desired real estate property can be accurately presented to the user.

  In addition, programs corresponding to the sequence diagrams shown in FIGS. 14 to 16 are recorded on a recording medium such as an optical disk or a hard disk, or obtained and recorded from a network such as the Internet, and these are stored in a general-purpose computer. By reading and executing the microcomputer, the microcomputer can also function as the system control unit 13 and the system control unit 33 of the present embodiment.

1, 1-1, 1-2, 1-n General consumer terminal 3 Information providing server 11, 24, 31 Communication unit 12, 22, 32 Storage unit 13, 33 System control unit 14, 23 Operation display unit 15, 25 , 34 Bus 20 Camera section 21 Control section 100 Input area 101 Property name 111 Input button 112 Send button 200 Display area 201 Modify button 202 Three-dimensionalization button 203 Property search button 321 Property information database 322 Reference data database 331 Page providing section 332 Search Unit 333 floor plan image data generation unit 334 display control unit 334 property information acquisition unit 336 indoor space image generation unit 337 image processing unit 338 boundary line extraction unit 339 image extraction unit 340 intersection extraction unit 341 horizontal distance detection unit 342 distance calculation unit S information Provision system D Indoor image C, C , C2, Cn spherical camera L illumination image CL ceiling image W1, W2, W3, W4, WL1, WL2, WL3, WL4, WL10, WL11, WL12, WL13, MWL10, MWL11, MWL12, MWL13, wall image WD, WD12, WD11, MWD11, MWD12 Window image WLF1, WLF2, WLF3, WLF4 Wall WF Window SDF1, SDF2, SDF3 Sliding door P position R, R1, R2 Indoor space image FL Floor image NW network FP Floor plan BCW1, BCW, BCW1, BCW3 BW12, BW23, BW34, BW14, BFW1, BFW2, BFW3, BFW4 Boundary line CN Room angle MCL Corrected ceiling image MW1, MW2, MW3, MW4 Corrected wall image MFL Corrected floor image DR Door image R10 Locus input area 20 image display area R1 search condition designation area R2 Property list display area R3 advertising display area R2a, R2b, R2c property display area RM10 floor plan image MRM10 indoor space image SD1, SD2, SD3, SD10, MSD10 sliding door

Claims (11)

An image of a real estate property is a property information providing device that can access a database registered as a registration image for each of the plurality of real estate properties,
Acquiring means for acquiring a search request including a specified three-dimensional model image that is a three-dimensional model image specified by a user;
A first specifying unit that specifies a specific configuration image as a specific configuration image based on a feature amount of each of the configuration images configuring the designated three-dimensional model image;
First calculating means for calculating a first similarity between the specified specific constituent image and each of the registered images;
When the calculated first similarity is equal to or greater than a predetermined first threshold value, the relational constituent image having a predetermined positional relationship with respect to the specific constituent image among the constituent images, Second calculating means for calculating a second similarity between the first registered image, which is the registered image whose first similarity is equal to or greater than the first threshold, and the registered image in the positional relationship with the first registered image When,
When the calculated second similarity is equal to or greater than a preset second threshold, the first registered image and the registered image whose calculated second similarity is equal to or greater than the second threshold are A second specified image, a second specifying means for specifying an image of the real estate article having a similar image in the database,
Presenting means for presenting the property information including the specified similar image to the user as a search result corresponding to the search request;
A property information presentation device comprising:   2. The property information presentation device according to claim 1, wherein the first specifying unit specifies a constituent image having the largest feature amount among the plurality of constituent images as the specific constituent image. 3.   3. The property information presentation device according to claim 1, wherein the first specifying unit specifies the specific configuration image based on a relative value of each of the feature amounts among a plurality of the configuration images. 4. . The specific configuration image is a specific configuration wall image specified based on the feature amount of each of the configuration wall images constituting the designated three-dimensional model image,
The registered image is each of the registered wall images constituting the image of the real estate,
The relationship configuration image is a configuration wall image adjacent to the specific configuration wall image in the configuration wall image,
The first registered image is the registered wall image whose calculated first similarity is equal to or greater than the first threshold,
The said 2nd registration image is the said registration wall image in which the said calculated 2nd similarity was more than the said 2nd threshold value, The Claims 1 to 3 characterized by the above-mentioned. Property information presentation device. The specific configuration image is a specific configuration wall image or a specific configuration ceiling image that is specified based on the feature amount of each of the configuration wall image or the configuration ceiling image that configures the designated three-dimensional model image,
The registered image is a registered wall image or a registered ceiling image constituting the image of the real estate property,
The relationship configuration image is a configuration wall image or a configuration ceiling image adjacent to the specific configuration image in the configuration wall image or the configuration ceiling image,
The first registered image is the registered wall image or the registered ceiling image whose calculated first similarity is equal to or greater than the first threshold,
The said 2nd registration image is the said registration wall image or the said registered ceiling image whose said calculated 2nd similarity was more than the said 2nd threshold value, The Claim 1 characterized by the above-mentioned. Article information presentation device according to one paragraph. When the calculated second similarity is equal to or greater than the second threshold, a second related configuration image having a second positional relationship set in advance with respect to the specific configuration image among the configuration images; A third calculating unit configured to calculate a third similarity between one registered image and the registered image in the second positional relationship,
When the calculated second similarity is greater than or equal to the second threshold, the second specifying unit determines that the first registered image, the second registered image, and the calculated third similarity are The image of the real estate article having the third registered image which is the registered image which is equal to or more than a set third threshold value is specified as the similar image. Item information presentation device described in section. The specific configuration image is a specific configuration wall image specified based on the feature amount of each of the configuration wall images constituting the designated three-dimensional model image,
The registered image is each of the registered wall images constituting the image of the real estate,
The related configuration image is a configuration wall image adjacent to the specific configuration image in the configuration wall image,
The first registered image is the registered wall image whose calculated first similarity is equal to or greater than the first threshold,
The second registered image is the registered wall image in which the calculated second similarity is equal to or greater than the second threshold,
The second related configuration image is a configuration wall image that is in contact with the specific configuration image in the second positional relationship among the configuration wall images,
The property information providing apparatus according to claim 6, wherein the third registered image is the registered wall image whose calculated third similarity is equal to or larger than the third threshold. The specific configuration image is a specific configuration wall image or a specific configuration ceiling image that is specified based on the feature amount of each of the configuration wall image or the configuration ceiling image that configures the designated three-dimensional model image,
The registered image is a registered wall image or a registered ceiling image constituting the image of the real estate property,
The relationship configuration image is a configuration wall image or a configuration ceiling image adjacent to the specific configuration image in the configuration wall image or the configuration ceiling image,
The first registered image is the registered wall image or the registered ceiling image whose calculated first similarity is equal to or greater than the first threshold,
The second registered image is the registered wall image or the registered ceiling image whose calculated second similarity is equal to or greater than the second threshold,
The second related configuration image is a configuration wall image or a configuration ceiling image that is in contact with the specific configuration image in the second positional relationship among the configuration wall images or the configuration ceiling images,
The property information presentation device according to claim 6, wherein the third registered image is the registered wall image or the registered ceiling image whose calculated third similarity is equal to or greater than the third threshold. . In the database, a registered three-dimensional model image that is a three-dimensional model image obtained by modeling the real estate article, and a registered photographic image that is a photographic image of the real estate property, It is registered for each real estate property,
9. The apparatus according to claim 1, wherein the second identification unit identifies at least one of the registered three-dimensional model image and the registered photographic image as the similar image. 10. Property information presentation device. A computer that can access the database registered as a registered image for each of the real estate properties,
Obtaining a search request including a specified three-dimensional model image that is a three-dimensional model image specified by a user;
Based on the characteristic amount of each of the constituent images constituting the specified three-dimensional model image, a step of specifying the specific constituent image as a specific constituent image,
Calculating a first similarity between the specified specific constituent image and each of the registered images;
When the calculated first similarity is equal to or greater than a predetermined first threshold value, the relational constituent image having a predetermined positional relationship with respect to the specific constituent image among the constituent images, Calculating a second similarity between the registered image having the positional relationship with respect to the first registered image, which is the registered image whose first similarity is equal to or greater than the first threshold,
When the calculated second similarity is equal to or greater than a second threshold set in advance, the first registered image and the registered image in which the calculated second similarity is equal to or greater than the second threshold are used. Specifying an image of the real estate object having a second registered image as a similar image in the database;
Presenting the property information including the specified similar image to the user as a search result corresponding to the search request;
A property information presentation program characterized by executing An image of a real estate article is a property information presentation method executed by a computer capable of accessing a database registered as a registration image for each of the plurality of real estate articles,
Obtaining a search request including a specified three-dimensional model image that is a three-dimensional model image specified by a user;
Based on the characteristic amount of each of the constituent images constituting the specified three-dimensional model image, a step of specifying the specific constituent image as a specific constituent image,
Calculating a first similarity between the specified specific constituent image and each of the registered images;
When the calculated first similarity is equal to or greater than a predetermined first threshold value, the relational constituent image having a predetermined positional relationship with respect to the specific constituent image among the constituent images, Calculating a second similarity between the registered image having the positional relationship with respect to the first registered image, which is the registered image whose first similarity is equal to or greater than the first threshold,
When the calculated second similarity is equal to or greater than a second threshold set in advance, the first registered image and the registered image in which the calculated second similarity is equal to or greater than the second threshold are used. Specifying an image of the real estate object having a second registered image as a similar image in the database;
Presenting the property information including the specified similar image to the user as a search result corresponding to the search request;
A property information presentation method characterized by including: