JP7204522B2 - Information processing device, air conditioner controller, portable device, and generation control method - Google Patents

Description

The present invention relates to an information processing device, an air conditioner controller, a portable device, and a generation control method.

Techniques for generating three-dimensional information are known. For example, an imaging device generates a three-dimensional shape based on a captured image (see Patent Literature 1).

JP 2013-206242 A

By the way, it is desirable for air conditioners to control air conditioning using highly accurate three-dimensional spatial information. Highly accurate depth information is required to generate highly accurate three-dimensional spatial information. However, the problem was how to generate highly accurate depth information.

An object of the present invention is to generate highly accurate depth information.

An information processing device according to one aspect of the present invention is provided. The information processing device transmits a first image, which is an image obtained by imaging a target space with the first imaging device, and a second imaging device, which is transmitted by an air conditioner having the first imaging device. obtained by imaging the target space with the second imaging device from a first direction that is different from the direction in which the first imaging device images, transmitted by a portable device having The second image to which depth information corresponding to the information in the second image is added, and the second image obtained by the second imaging device imaging the target space from a second direction different from the first direction a communication unit that receives a plurality of images with depth information including the third image to which depth information corresponding to information in the images of 3 is added; a feature amount detection unit that detects a feature amount of an object in space; a three-dimensional space information generation unit that generates three-dimensional space information in the target space using the feature amount; the three- dimensional space information; A position indicating the position of the air conditioner included in the three-dimensional space information by specifying the air conditioner included in the three-dimensional space information using specifying information that is information for specifying the air conditioner. adjusting the orientation of the three-dimensional spatial information using information; and using the adjusted three-dimensional spatial information and the first image, depth information corresponding to the information in the first image. and a depth information generation unit that generates depth information corresponding to the first image. The communication unit transmits depth information corresponding to the first image.

According to the present invention, highly accurate depth information can be generated.

1 is a diagram showing a communication system according to Embodiment 1; FIG. 4 is a sequence diagram showing an outline of processing according to the first embodiment; FIG. 3 is a diagram showing a hardware configuration of the server of Embodiment 1; FIG. 2 is a functional block diagram showing the configuration of a server according to Embodiment 1; FIG. 4 is a flowchart showing generation processing according to the first embodiment; FIG. 5 is a diagram showing a specific example of comparison processing between three-dimensional spatial information and a planar image according to Embodiment 1; FIG. 10 is a diagram showing a communication system according to a second embodiment; FIG. FIG. 10 is a functional block diagram showing the configuration of a mobile device according to Embodiment 2;

Embodiments will be described below with reference to the drawings. The following embodiments are merely examples, and various modifications are possible within the scope of the present invention.

Embodiment 1.
FIG. 1 is a diagram showing a communication system according to Embodiment 1. FIG. The communication system includes server 100 , mobile device 200 and air conditioner 300 . For example, the portable device 200 and the air conditioner 300 are inside the room 20 .

The server 100 and the mobile device 200 wirelessly communicate via the network 10 . Portable device 200 and air conditioner 300 communicate with each other using Bluetooth (registered trademark), WiFi (registered trademark), or the like. Also, the air conditioner 300 is connected to the server 100 via the mobile device 200 and the network 10 . Thereby, in the communication system, it is not necessary to construct a line for connecting the air conditioner 300 to the network 10 .

The server 100 is also called an information processing device. The server 100 is a device that executes the generation control method. Also, the server 100 may be changed to an air conditioner controller. Note that when the server 100 is changed to an air conditioner controller, the air conditioner controller connects to the air conditioner 300 via the network. The air conditioner controller controls the air conditioner 300 .
For example, mobile device 200 is a smart phone or a tablet device. Portable device 200 has imaging device 201 . The imaging device 201 is also called a second imaging device.

The mobile device 200 generates an image to which depth information corresponding to information in the image obtained by imaging the target space by the imaging device 201 is added. The image is expressed as an image with depth information. Note that an image obtained by imaging by the imaging device 201 is a two-dimensional image. For example, a two-dimensional image is an RGB (Red Green Blue) image. Further, for example, the target space is inside the room 20 .
Here, the image with depth information may be expressed as the image to which the depth information of the information indicated by the image obtained by imaging the target space by the imaging device 201 is added.

The air conditioner 300 has an imaging device 301 . The imaging device 301 is also called a first imaging device. The air conditioner 300 obtains an image obtained by imaging the target space with the imaging device 301 . The image is also called the first image. Also, the image is a two-dimensional image. Hereinafter, the image will be referred to as a planar image. Also, hereinafter, the target space is assumed to be the inside of the room 20 . That is, the target space is indoors.

Next, an overview of processing according to the first embodiment will be described.
FIG. 2 is a sequence diagram showing an outline of processing according to the first embodiment.
(Step S<b>101 ) When the user captures an image of the room using the portable device 200 , the portable device 200 generates a plurality of images with depth information. Portable device 200 transmits a plurality of images with depth information to server 100 .

(Step S102) The air conditioner 300 acquires a planar image obtained by the imaging device 301 capturing an image of the interior of the room. Air conditioner 300 transmits the planar image to server 100 via portable device 200 .
Note that step S101 may be performed after step S102.

(Step S103) The server 100 executes generation processing. The generation process will be explained later. The server 100 generates depth information corresponding to the planar image through generation processing. Depth information corresponding to a planar image will be described later. Note that the depth information corresponding to the planar image may be expressed as depth information within the planar image.

(Step S<b>104 ) The server 100 transmits depth information corresponding to the plane image to the portable device 200 .
(Step S<b>105 ) The portable device 200 transmits depth information corresponding to the plane image to the air conditioner 300 .

Next, hardware included in the server 100 will be described.
3 is a diagram illustrating a hardware configuration of a server according to Embodiment 1. FIG. The server 100 has a processor 101 , a volatile storage device 102 and a non-volatile storage device 103 .

A processor 101 controls the entire server 100 . For example, the processor 101 is a CPU (Central Processing Unit) or an FPGA (Field Programmable Gate Array). Processor 101 may be a multiprocessor. Server 100 may be implemented by processing circuitry, or may be implemented by software, firmware, or a combination thereof. It should be noted that the processing circuit may be a single circuit or multiple circuits.

Volatile storage device 102 is the main storage device of server 100 . For example, the volatile memory device 102 is RAM (Random Access Memory). The nonvolatile storage device 103 is an auxiliary storage device for the server 100 . For example, the nonvolatile memory device 103 is an SSD (Solid State Drive).
Also, the mobile device 200, like the server 100, has a processor, a volatile storage device, and a non-volatile storage device.

4 is a functional block diagram showing the configuration of the server according to the first embodiment; FIG.
The server 100 has a storage unit 110 , a communication unit 120 , a feature quantity detection unit 130 , a 3D spatial information generation unit 140 and a depth information generation unit 150 .

The storage unit 110 may be implemented as a storage area secured in the volatile storage device 102 or the nonvolatile storage device 103 .
A part or all of the communication unit 120 , the feature amount detection unit 130 , the three-dimensional space information generation unit 140 , and the depth information generation unit 150 may be realized by the processor 101 .
Some or all of the communication unit 120, the feature amount detection unit 130, the three-dimensional space information generation unit 140, and the depth information generation unit 150 may be implemented as modules of a program executed by the processor 101.

The storage unit 110 stores specific information. The identification information is information for identifying air conditioner 300 . The server 100 can acquire specific information by executing machine learning. For example, the server 100 learns to identify the air conditioner 300 . Thereby, the server 100 can acquire the specific information. Note that the specific information may include the model name of the air conditioner 300 .

Communication unit 120 communicates with mobile device 200 . The communication unit 120 receives a plurality of images with depth information transmitted by the mobile device 200 . Also, the communication unit 120 may receive a plurality of images with depth information transmitted by the mobile device 200 via another device. The illustration of other devices is omitted.

Here, the multiple images with depth information include the second image and the third image. The second image is added with depth information corresponding to information in the second image obtained by imaging the interior of the room with the imaging device 201 from a first direction that is different from the direction in which the imaging device 301 images. It is Depth information corresponding to information in the third image obtained by imaging the interior of the room with the imaging device 201 from a second direction different from the first direction is added to the third image. Note that the second direction may be the same as the direction in which the imaging device 301 captures an image. Also, the second direction may be different from the direction in which the imaging device 301 captures an image.

The plurality of images with depth information may further include at least one or more images to which depth information is added. At least one or more images are images obtained by imaging the interior of the room with the imaging device 201, and depth information corresponding to information in the images is added. That is, the plurality of images with depth information may be three or more images with depth information.

Communication unit 120 receives the planar image transmitted by air conditioner 300 . Moreover, the communication unit 120 may receive the planar image transmitted by the air conditioner 300 via another device. The illustration of other devices is omitted.

The communication unit 120 transmits depth information corresponding to the planar image transmitted by the air conditioner 300 . Depth information corresponding to a planar image is depth information corresponding to information within the planar image. Depth information corresponding to a planar image may be expressed as depth information corresponding to information indicated by the planar image.
The feature amount detection unit 130 detects feature amounts of objects in the room using a plurality of images with depth information. Here, for example, objects in the room are furniture, walls, people, and animals.

The three-dimensional space information generating section 140 uses the feature amount detected by the feature amount detecting section 130 to generate three-dimensional space information in the room. Here, the three-dimensional space information is a three-dimensional figure obtained by three-dimensionally combining points, lines and planes. Three-dimensional spatial information can be represented on a computer.
Depth information generating section 150 generates depth information corresponding to the planar image using the planar image and three-dimensional space information transmitted by air conditioner 300 .

Next, generation processing executed by the server 100 will be described.
FIG. 5 is a flowchart showing generation processing according to the first embodiment.
(Step S<b>11 ) The communication unit 120 receives a plurality of images with depth information from the mobile device 200 . Communication unit 120 receives the planar image from air conditioner 300 via portable device 200 .
(Step S12) The feature amount detection unit 130 detects feature amounts of objects in the room using a plurality of images with depth information. For example, the feature amount of an object is the edge of the desk and the corner of the desk. Further, for example, the feature amount may be considered as a SHOT (Signature of Histograms of Orientations) feature amount.

In addition, when detecting the feature amount from the two-dimensional image of the image with depth information, the feature amount detection unit 130 detects the feature amount using SIFT (Scale Invariant Feature Transform), FAST (Features from Accelerated Segment Test), or the like. You may

(Step S13) The three-dimensional space information generator 140 uses the detected feature amount to generate three-dimensional space information in the room. Further, for example, the 3D space information generation unit 140 may generate 3D space information in the room using information for generating 3D space information from the feature quantity and the detected feature quantity. . Information for generating three-dimensional space information from feature amounts can be obtained by the server 100 performing machine learning on samples of objects such as people and furniture in the three-dimensional space.

In this way, the three-dimensional space information generator 140 uses the detected feature amount to generate three-dimensional space information in the room. Note that there are various methods for generating indoor three-dimensional spatial information using feature amounts. The three-dimensional space information generation unit 140 may use any method to generate the three-dimensional space information in the room.

(Step S<b>14 ) Depth information generator 150 identifies air conditioner 300 included in the three-dimensional space information using the three-dimensional space information and the specific information stored in storage unit 110 .
For example, when the air conditioner 300 is a wall-mounted air conditioner, the depth information generation unit 150 uses the part that protrudes from the surroundings in the wall indicated by the three-dimensional space information and the specific information to generate the air conditioner Identify the machine 300 .
Further, for example, when the air conditioner 300 is a ceiling-embedded air conditioner, the depth information generation unit 150 uses a portion of the ceiling indicated by the three-dimensional space information that is more uneven than the surroundings and the specific information to , specifies the air conditioner 300 .

In this way, depth information generator 150 uses the identification information to identify air conditioners 300 included in the three-dimensional space information. Thereby, the depth information generator 150 can identify the position of the air conditioner 300 included in the three-dimensional space information. The depth information generator 150 can also identify the positions of the outlets of the imaging device 301 and the air conditioner 300 included in the three-dimensional space information.

(Step S15) The depth information generation unit 150 adjusts the orientation of the three-dimensional space information in the direction in which the imaging device 301 captures images using the position information indicating the position of the air conditioner 300 included in the three-dimensional space information. . As a result, the direction of the air conditioner 300 included in the three-dimensional space information is the same as the direction in which the imaging device 301 captures the image.

(Step S16) The depth information generation unit 150 compares the three-dimensional space information whose orientation has been adjusted with the planar image acquired in step S11. Thereby, the depth information generation unit 150 can specify the depth of each region of the plane image. For example, the depth information generator 150 can identify the depth corresponding to the furniture present in the planar image.
In this way, the depth information generation unit 150 compares the three-dimensional spatial information and the planar image to generate depth information corresponding to the planar image.

(Step S<b>17 ) The communication unit 120 transmits depth information corresponding to the plane image to the portable device 200 .
Note that after step S<b>17 , the portable device 200 transmits depth information corresponding to the planar image to the air conditioner 300 .

Next, a specific example of comparison processing between three-dimensional spatial information and a plane image will be described.
FIG. 6 is a diagram showing a specific example of comparison processing between three-dimensional spatial information and a planar image according to the first embodiment. FIG. 6 shows three-dimensional spatial information 400 and a planar image 500 . An arrow 401 indicates the direction in which the imaging device 301 takes an image.

Depth information generator 150 adjusts the orientation of three-dimensional space information 400 in the direction indicated by arrow 401 using position information indicating the position of air conditioner 300 included in three-dimensional space information 400 . As a result, the direction of air conditioner 300 included in three-dimensional space information 400 is the same as the direction indicated by arrow 401 . That is, the direction in which the imaging device 301 faces when the planar image 500 is generated is the same as the direction in which the three-dimensional space information 400 is directed.

The depth information generator 150 compares the three-dimensional spatial information 400 and the plane image 500 . The depth information generation unit 150 generates depth information corresponding to the planar image 500 by comparing the three-dimensional spatial information 400 and the planar image 500 .

Here, the user can freely move around the room 20 while holding the portable device 200 . Therefore, the user can use the portable device 200 to capture images of objects existing in the room 20 from various angles. For example, the user uses the portable device 200 to capture an image of the direction in which the air conditioner 300 is present. In this way, the mobile device 200 can capture an image of a portion that cannot be captured by the imaging device 301 . Here, it is assumed that air conditioner 300 further has a depth sensor. The air conditioner 300 can generate indoor three-dimensional spatial information using an image captured by the imaging device 301 and depth information generated by the depth sensor. The three-dimensional space information is expressed as first three-dimensional space information. The first three-dimensional spatial information lacks information of a portion that cannot be imaged by the imaging device 301 . On the other hand, the three-dimensional space information generated by the server 100 includes information on a portion that cannot be captured by the imaging device 301 . Therefore, the three-dimensional space information generated by the server 100 is information with higher precision than the first three-dimensional space information.

Depth information corresponding to a planar image is generated using highly accurate three-dimensional spatial information. Therefore, the depth information corresponding to the planar image can be said to be highly accurate depth information. Therefore, the server 100 can generate highly accurate depth information.

Here, for example, when the air conditioner 300 further has a depth sensor, the air conditioner 300 uses the planar image captured by the imaging device 301 and the depth image acquired by the depth sensor to obtain three-dimensional spatial information. can be generated. However, having the depth sensor in the air conditioner 300 increases the cost of the air conditioner 300 . According to Embodiment 1, air conditioner 300 may not have a depth sensor. Therefore, Embodiment 1 can suppress the cost of the air conditioner 300 .

The processor included in air conditioner 300 often has worse performance than processor 101 . In Embodiment 1, the server 100 generates the depth information corresponding to the planar image, thereby quickly generating the depth information corresponding to the planar image.

Further, the server 100 may transmit the three-dimensional space information to the mobile device 200 after generating the three-dimensional space information in step S13. Then, the user uses the mobile device 200 to confirm the three-dimensional spatial information. When the user determines that there is a missing part in the three-dimensional space information, the user further uses the portable device 200 to capture an image of the room. Portable device 200 transmits the image with depth information to server 100 . The server 100 further uses the image with depth information to generate three-dimensional spatial information. Thereby, the server 100 can compensate for missing portions of the three-dimensional spatial information.

After identifying the air conditioner in step S14, the depth information generating unit 150 of the server 100 may identify the model name using the identification information. The communication unit 120 of the server 100 may receive the model name of the air conditioner 300 from the mobile device 200 or the air conditioner 300 . The depth information generating unit 150 of the server 100 can improve the accuracy of identifying the air conditioner 300 by comparing the model name specified based on the specifying information and the model name received by the communication unit 120 .

In addition, the air conditioner 300 may have a thermography (registered trademark). The air conditioner 300 can acquire an image showing the indoor temperature distribution from thermography. The air conditioner 300 can associate the temperature information with the depth information corresponding to the planar image by comparing the image and the depth information corresponding to the planar image. Thereby, the air conditioner 300 can detect the temperature of objects present in the room. For example, the air conditioner 300 can detect the temperature on the desk and the temperature on the floor using the temperature information associated with the depth information corresponding to the planar image. Air conditioner 300 may perform air conditioning control based on the detection result. The angle of view when the imaging device 301 captures an image and the angle of view when the thermography measures the temperature distribution in the room are set to be the same.

In the above description, the case where the air conditioner 300 detects the temperature of an object existing in the room has been described. However, the server 100 may detect the temperature of objects existing in the room. Specifically, the air conditioner 300 transmits an image showing the indoor temperature distribution to the server 100 via the portable device 200 . The depth information generating unit 150 of the server 100 compares the image and the depth information corresponding to the planar image, thereby associating the depth information corresponding to the planar image with the temperature information. The communication unit 120 of the server 100 transmits the temperature information associated with the depth information corresponding to the planar image to the air conditioner 300 via the portable device 200 . Accordingly, the air conditioner 300 can detect the temperature of objects existing in the room.

The server 100 may periodically receive an image showing the indoor temperature distribution from the air conditioner 300 . The server 100 can learn changes in the temperature distribution in the room by periodically receiving an image showing the temperature distribution in the room. Then, server 100 may transmit an operation instruction based on the learned content to air conditioner 300 via portable device 200 .

Moreover, the server 100 may perform an airflow simulation using the three-dimensional space information. Since the three-dimensional space information is highly accurate, the server 100 can perform a highly accurate airflow simulation.

Embodiment 2.
Next, Embodiment 2 will be described. Embodiment 2 will mainly describe matters that are different from Embodiment 1, and will omit description of matters that are common to Embodiment 1. FIG. Embodiment 2 refers to FIGS.

Embodiment 1 describes the case where air conditioner 300 transmits a planar image to server 100 via portable device 200 and network 10 . The planar image contains information about the interior of the room. The information in the room can also be said to be personal information. Personal information may be leaked if the air conditioner 300 transmits a planar image to the server 100 via the network 10 . Therefore, in the second embodiment, a case where the mobile device 200 executes the processing executed by the server 100 in the first embodiment will be described.

FIG. 7 is a diagram showing a communication system according to the second embodiment. The communication system includes mobile device 200 and air conditioner 300 .
FIG. 8 is a functional block diagram showing the configuration of the mobile device according to the second embodiment. Portable device 200 has storage unit 210 , image generation unit 220 , communication unit 230 , feature amount detection unit 240 , 3D spatial information generation unit 250 , depth information generation unit 260 , and imaging unit 270 .

The storage unit 210 may be realized as a storage area secured in a volatile storage device or a non-volatile storage device of the mobile device 200 .
A part or all of the image generation unit 220 , the communication unit 230 , the feature amount detection unit 240 , the 3D spatial information generation unit 250 , and the depth information generation unit 260 may be realized by a processor included in the mobile device 200 .

A part or all of the image generation unit 220, the communication unit 230, the feature amount detection unit 240, the 3D space information generation unit 250, and the depth information generation unit 260 are implemented as program modules executed by the processor of the mobile device 200. You may
The imaging unit 270 can be realized by the imaging device 201 .

The storage unit 210 stores specific information.
The image generator 220 generates a plurality of images with depth information. That is, the image generator 220 generates a plurality of images with depth information including the second image and the third image. Note that the second image is depth information corresponding to information in the second image obtained by imaging the interior of the room with the imaging unit 270 from a first direction that is different from the direction in which the imaging device 301 images. is added. The third image is added with depth information corresponding to information in the third image obtained by imaging the interior of the room with the imaging unit 270 from a second direction different from the first direction.

Also, the plurality of images with depth information may further include at least one or more images to which depth information is added. At least one or more images are images obtained by imaging the interior of the room with the imaging unit 270, and depth information corresponding to information in the images is added. That is, the plurality of images with depth information may be three or more images with depth information.

Communication unit 230 communicates with air conditioner 300 . Communication unit 230 receives the planar image from air conditioner 300 . Communication unit 230 transmits depth information corresponding to the planar image to air conditioner 300 .
The processing performed by the feature amount detection unit 240 is the same as the processing performed by the feature amount detection unit 130 . Therefore, the description of the processing executed by the feature amount detection unit 240 is omitted.

The processing performed by the 3D spatial information generating section 250 is the same as the processing performed by the 3D spatial information generating section 140 . Therefore, the description of the processing executed by the three-dimensional space information generation unit 250 will be omitted.
The processing executed by the depth information generation section 260 is the same as the processing executed by the depth information generation section 150 . Therefore, the description of the processing executed by the depth information generation unit 260 will be omitted.

According to Embodiment 2, depth information corresponding to a planar image is generated using three-dimensional spatial information, which is highly accurate information. Therefore, the depth information corresponding to the planar image can be said to be highly accurate depth information. Therefore, the mobile device 200 can generate highly accurate depth information.
Also, in the second embodiment, the planar image is not transmitted to the network 10 . Therefore, Embodiment 2 can prevent leakage of personal information.

The features of the embodiments described above can be combined as appropriate.

REFERENCE SIGNS LIST 10 network 20 room 100 server 101 processor 102 volatile storage device 103 nonvolatile storage device 110 storage unit 120 communication unit 130 feature amount detection unit 140 three-dimensional spatial information generation unit 150 depth information generation Unit 200 Mobile device 201 Imaging device 210 Storage unit 220 Image generation unit 230 Communication unit 240 Feature amount detection unit 250 Three-dimensional space information generation unit 260 Depth information generation unit 270 Imaging unit 300 Air conditioner machine, 301 imaging device, 400 dimensional spatial information, 401 arrow, 500 plane image.

Claims (6)

A first image, which is an image obtained by imaging a target space by the first imaging device, transmitted by an air conditioner having a first imaging device, and a mobile device having a second imaging device Corresponds to the transmitted information in the second image obtained by imaging the target space by the second imaging device from a first direction different from the direction in which the first imaging device captures the image. and the third image obtained by imaging the target space with the second imaging device from a second direction different from the first direction and the third image to which the depth information is added. a communication unit that receives a plurality of images with depth information including the third image to which depth information corresponding to the information is added;
a feature amount detection unit that detects a feature amount of an object in the target space using the plurality of images with depth information;
a three-dimensional space information generating unit that generates three-dimensional space information in the target space using the feature amount;
The air conditioner included in the three-dimensional space information is specified using the three-dimensional space information and specifying information that is information for specifying the air conditioner, and the air conditioner included in the three-dimensional space information is specified. using the position information indicating the position of the air conditioner to adjust the orientation of the three-dimensional space information; a depth information generating unit that generates depth information corresponding to the first image, which is depth information corresponding to information in the image;
has
wherein the communication unit transmits depth information corresponding to the first image;
Information processing equipment. The plurality of images with depth information further include at least one or more images to which depth information is added,
The information processing device according to claim 1 . The specific information includes the model name of the air conditioner,
The communication unit receives the model name of the air conditioner transmitted by the portable device or the air conditioner,
After identifying the air conditioner, the depth information generation unit identifies the model name of the air conditioner using the identification information, and the identified model name of the air conditioner and the communication unit receive comparing the model names of the air conditioners
The information processing device according to claim 1 . An air conditioner controller for controlling an air conditioner having a first imaging device,
The first image transmitted by the air conditioner, which is an image obtained by imaging the target space with the first imaging device, and the first image transmitted by a portable device having a second imaging device Depth information corresponding to information in a second image obtained by imaging the target space with the second imaging device from a first direction that is different from the direction in which the imaging device of is added. Depth information corresponding to information in the second image obtained by imaging the target space by the second imaging device from a second direction different from the first direction and the third image obtained by imaging the target space from a second direction different from the first direction. a communication unit that receives a plurality of images with depth information including the third image to which is added;
a feature amount detection unit that detects a feature amount of an object in the target space using the plurality of images with depth information;
a three-dimensional space information generating unit that generates three-dimensional space information in the target space using the feature amount;
The air conditioner included in the three-dimensional space information is specified using the three-dimensional space information and specifying information that is information for specifying the air conditioner, and the air conditioner included in the three-dimensional space information is specified. using the position information indicating the position of the air conditioner to adjust the orientation of the three-dimensional space information; a depth information generating unit that generates depth information corresponding to the first image, which is depth information corresponding to information in the image;
has
wherein the communication unit transmits depth information corresponding to the first image;
Air conditioner controller. an imaging unit;
a communication unit that receives a first image, which is an image obtained by imaging a target space with the first imaging device, transmitted by an air conditioner having the first imaging device;
Depth information corresponding to information in a second image obtained by the imaging unit imaging the target space from a first direction different from the direction in which the first imaging device images is added. Depth information corresponding to information in the second image obtained by imaging the target space by the imaging unit from a second direction different from the first direction is added. an image generation unit that generates a plurality of images with depth information including the third image that is
a feature amount detection unit that detects a feature amount of an object in the target space using the plurality of images with depth information;
a three-dimensional space information generating unit that generates three-dimensional space information in the target space using the feature amount;
The air conditioner included in the three-dimensional space information is specified using the three-dimensional space information and specifying information that is information for specifying the air conditioner, and the air conditioner included in the three-dimensional space information is specified. using the position information indicating the position of the air conditioner to adjust the orientation of the three-dimensional space information; a depth information generating unit that generates depth information corresponding to the first image, which is depth information corresponding to information in the image;
has
wherein the communication unit transmits depth information corresponding to the first image;
portable device. The information processing device
A first image, which is an image obtained by imaging a target space by the first imaging device, transmitted by an air conditioner having a first imaging device, and a mobile device having a second imaging device Corresponds to the transmitted information in the second image obtained by imaging the target space by the second imaging device from a first direction different from the direction in which the first imaging device captures the image. and the third image obtained by imaging the target space with the second imaging device from a second direction different from the first direction and the third image to which the depth information is added. receiving a plurality of images with depth information including the third image to which depth information corresponding to the information is added;
Detecting a feature amount of an object in the target space using the plurality of images with depth information,
generating three-dimensional spatial information in the target space using the feature amount;
Identifying the air conditioner included in the three-dimensional space information using the three-dimensional space information and specific information that is information for identifying the air conditioner;
Adjusting the orientation of the three-dimensional space information using the position information indicating the position of the air conditioner included in the three-dimensional space information;
using the oriented three-dimensional spatial information and the first image to generate depth information corresponding to the first image, which is depth information corresponding to information in the first image;
transmitting depth information corresponding to the first image;
Generation control method.

Images