JP2021069031A - Information processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To preferably provide landscapes of different places or different times to people in a moving body such as a vehicle. SOLUTION: A server device 200, which is an information processing device of the present disclosure, acquires an image taken by an autonomous traveling vehicle 100 as a first moving body, and obtains the acquired image as the first moving body. The control unit 204 is provided to provide the autonomous traveling vehicle 100 as the second moving body so as to be displayed on the image display unit inside the autonomous traveling vehicle 100 as the second moving body different from the above. [Selection diagram] Fig. 3

Description

The present invention relates to an information processing device that enables a moving body to display an image captured by another moving body.

Conventionally, it has been proposed to photograph the outside of a vehicle and display the image inside the vehicle (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2019-14456

The scenery outside the car that can be seen from inside the car is a real world and is determined by the place and time. In many cases, the world seen by the people in the car is not particularly interesting. Therefore, an object of the present invention is to make it possible to suitably provide people in a moving body such as a vehicle with landscapes of different places or different times.

One aspect of the embodiment of the present invention is exemplified by an information processing device including a control unit. The control unit acquires the image captured by the first moving body and displays the acquired image on the image display unit inside the second moving body different from the first moving body. What is provided to the second moving body is performed.

According to this information processing device, it is possible to suitably provide people in a moving body with landscapes of different places or different times.

It is a conceptual diagram of the image providing system which concerns on one Embodiment of this invention. It is a block diagram which roughly showed the structure in the system of FIG. 1, and is the figure which showed the structure of the autonomous traveling vehicle in particular. It is a block diagram which roughly showed the structure in the system of FIG. 1, and is the figure which showed the structure of the server apparatus in particular. It is a block diagram which roughly showed the structure in the system of FIG. It is a figure which shows the display example of the display part of the user apparatus of FIG. It is a flowchart of the image acquisition process of the server device in the system of FIG. It is a flowchart of the image provision process of a server device in the system of FIG.

Hereinafter, the information processing apparatus according to the embodiment of the present invention, the information processing method in the information processing apparatus, and the program will be described with reference to the drawings.

FIG. 1 conceptually shows the video providing system S according to the embodiment of the present invention. The video providing system S includes an autonomous traveling vehicle 100 (100A, ...) And a server device 200. The system S further includes a user device 300 (300A, ...).

The autonomous traveling vehicle 100 is an example of a mobile body configured to be able to execute the video providing service of the video providing system S. The server device 200 is an information processing device and is a computer on the network N. The server device 200 is configured to be able to communicate with each of the autonomous traveling vehicles 100 via the network N, and cooperates with the information processing device of the autonomous traveling vehicle 100 via the network N. Note that FIG. 1 illustrates only the autonomous traveling vehicles 100A, 100B, and 100C among the plurality of autonomous traveling vehicles 100 (100A, ...). However, this does not limit the number of autonomous traveling vehicles 100 and the like, and may be any number.

The server device 200 can also communicate with other server devices and the like via the network N. The server device 200 is configured to be communicable with each of the autonomous traveling vehicles 100, and is also configured to be communicable with each of the user devices 300 via the network N.

The user device 300 is configured to be able to communicate with the server device 200 via the network N. Further, the user device 300 is configured to be able to communicate with the autonomous traveling vehicle 100 via the network N. Here, in particular, the user device 300 is configured to be able to directly communicate with the associated autonomous vehicle 100. In FIG. 1, the user device 300B is associated with the autonomous traveling vehicle 100B and is configured to be able to directly communicate with the autonomous traveling vehicle 100B (see arrow NB). This also applies to the user device 300A associated with the autonomous traveling vehicle 100A and the user device 300C associated with the autonomous traveling vehicle 100C. FIG. 1 illustrates only the user devices 300A, 300B, and 300C among the plurality of user devices 300 (300A, ...). However, this does not limit the number of user devices and the like, and may be any number.

The autonomous vehicle 100 is also called an Electric Vehicle (EV) pallet. The autonomous traveling vehicle 100 is a moving body capable of automatic driving and unmanned driving, and there are vehicles having various dimensions. For example, autonomous traveling vehicles 100 of various sizes can be used, from small ones that can only be used by one person to large ones that can be used by dozens of people.

The autonomous traveling vehicle 100 has a control function and a communication function for controlling itself. The autonomous traveling vehicle 100 cooperates with the server device on the network N to provide the user with functions and services added by the server device on the network N in addition to the processing that can be executed by the autonomous traveling vehicle 100 alone. Can be done. The autonomous vehicle 100 does not necessarily have to be an automatic guided vehicle. For example, sales personnel, customer service personnel, security personnel, etc. may be on board. For example, when the service provided by the autonomous traveling vehicle 100 is a food and drink service, a cook, a waiter, or the like can get on, and when the service provided by the autonomous traveling vehicle 100 is a childcare service, a nursery teacher or the like can get on. Further, the autonomous traveling vehicle 100 does not necessarily have to be a vehicle capable of completely autonomous traveling. For example, it may be a vehicle in which a person drives or assists driving depending on the situation. In the present embodiment, the autonomous traveling vehicle 100 is adopted as the moving body, but the moving body in the system S may include a vehicle that cannot autonomously travel, that is, a vehicle in which a driving operation by a driver is indispensable.

As described above, the autonomous traveling vehicle 100 is configured to be able to communicate with the user device 300 (300A, ...) Via the network N. The user device 300 receives an input from the user and an operation corresponding thereto, and can communicate not only with the server device 200 but also with the autonomous traveling vehicle 100 via the network N.

Here, the server device 200 is mainly a device that commands the autonomous traveling vehicle 100 to operate. For example, the server device 200 transmits to the autonomous traveling vehicle 100 an operation command including a traveling plan regarding when, where, when, and where a person who wants to get on board, such as a user who desires a service, gets on and off.

Each component in the system S of FIG. 1 will be described in detail below. FIG. 2 is a block diagram schematically showing the configuration of the system S including the autonomous traveling vehicle 100, the server device 200, and the user device 300, and is particularly a diagram showing the configuration of the autonomous traveling vehicle 100A. FIG. 2 shows the configuration of the autonomous traveling vehicle 100A as an example of the autonomous traveling vehicle 100. The other autonomous traveling vehicles 100B, 100C, etc. have the same configuration as the autonomous traveling vehicle 100A. The plurality of autonomous traveling vehicles 100 are configured here so that different services (for example, eating and drinking service, pick-up service) can be provided. One or more of the plurality of autonomous traveling vehicles 100 may be traveled only for photographing the image described later.

The autonomous traveling vehicle 100A of FIG. 2 includes an information processing device 102, and has a control unit 104 that substantially bears the function thereof. The autonomous traveling vehicle 100A can travel according to the operation command acquired from the server device 200. Specifically, the autonomous traveling vehicle 100A travels in an appropriate manner while sensing the periphery of the vehicle based on the operation command acquired via the network N. Then, during this traveling, the autonomous traveling vehicle 100A can provide services to various users.

The autonomous vehicle 100A further includes a sensor 106, a position information acquisition unit 108, a drive unit 110, a communication unit 112, and a storage unit 114. The autonomous vehicle 100A operates on the electric power supplied from the battery.

The sensor 106 is a means for sensing the periphery of the vehicle, and typically includes a stereo camera, a laser scanner, a Light Detection and Ranging, a Laser Imaging Detection and Ranging (LIDAR), a radar, and the like. The information acquired by the sensor 106 is transmitted to the control unit 104. The sensor 106 includes a sensor for the own vehicle to perform autonomous traveling. The sensor 106 includes a camera 107 provided on the vehicle body of the autonomous vehicle 100A. For example, the camera 107 can be a photographing device using an image sensor such as Charged-Coupled Devices (CCD), Metal-Oxide-Semiconductor (MOS), or Complementary Metal-Oxide-Semiconductor (CMOS). As the image captured by the camera 107, an image captured by an in-vehicle video recording device may be used. Hereinafter, the captured image is simply referred to as a photographed image. Here, a plurality of cameras 107 are provided at a plurality of locations on the vehicle body. Specifically, as shown in FIG. 1, cameras 107 are installed in the front, rear, and left and right sides of the vehicle body, respectively. It should be noted that only one camera 107 may be provided on the vehicle body, and for example, a camera capable of 360 ° photographing may be used.

The position information acquisition unit 108 is a means for acquiring the current position of the vehicle, and typically includes a Global Positioning System (GPS) receiver and the like. The information acquired by the position information acquisition unit 108 is transmitted to the control unit 104. A GPS receiver as a satellite signal receiver receives signals from a plurality of GPS satellites. Each GPS satellite is an artificial satellite that orbits the earth. The satellite positioning system, that is, the Navigation Satellite System (NSS), is not limited to GPS.
Position information may be detected based on signals from various satellite positioning systems. NSS is not limited to the Global Navigation Satellite System, but the Quasi-Zenith Satellite
System) can be included, for example, "Galileo" in Europe and "MICHIBIKI" in Japan, which is operated integrally with GPS.

The control unit 104 is a computer that controls the autonomous traveling vehicle 100A based on the information acquired from the sensor 106, the position information acquisition unit 108, and the like. The control unit 104 is an example of a control means for controlling the traveling of the autonomous traveling vehicle 100A, which is a moving body, and the boarding / alighting work of various users in response to an operation command from the server device 200.

The control unit 104 has a CPU and a main storage unit, and executes information processing by a program. The CPU is also called a processor. The main storage unit of the control unit 104 is an example of the main storage device. The CPU in the control unit 104 executes a computer program executably deployed in the main storage unit to provide various functions. The main storage unit in the control unit 104 stores computer programs, data, and the like executed by the CPU. The main storage unit in the control unit 104 is a Dynamic Random Access Memory (DRAM) or a Static Random Access Memory (SRAM).
, Read Only Memory (ROM), etc.

The control unit 104 is connected to the storage unit 114. The storage unit 114 is a so-called external storage unit, which is used as a storage area for assisting the main storage unit of the control unit 104, and stores computer programs, data, and the like executed by the CPU of the control unit 104. The storage unit 114 is a hard disk drive, a solid state drive (SSD), or the like.

The control unit 104 has an information acquisition unit 1041, a plan generation unit 1042, an environment detection unit 1043, a task control unit 1044, a provision processing unit 1045, and a display processing unit 1046 as functional modules. Each functional module is realized by executing a program stored in the main storage unit or the storage unit 114 by the control unit 104, that is, the CPU thereof.

The information acquisition unit 1041 acquires the operation command information from the server device 200. The operation command includes information on the boarding position (boarding place), the disembarking position (disembarking place), the boarding time, and the disembarking time regarding the user or the person who wants to use the service provided by the autonomous traveling vehicle 100A. Further, the operation command may include user information of the user (for example, user ID or terminal information of the user device 300 associated with the user). The information acquisition unit 1041 acquires information on the own vehicle periodically or irregularly, for example, acquires the riding status and stores it in the own vehicle information database 1141 of the storage unit 114. The information acquisition unit 1041 also acquires information from the user device 300. When the information of the video shooting command is received from the user device 300, the information acquisition unit 1041 transmits the information to the provision processing unit 1045. When the information of the video display command is received from the user device 300, the information acquisition unit 1041 transmits the information to the display processing unit 1046.

The plan generation unit 1042 generates an operation plan of the own vehicle based on the operation command acquired from the server device 200, particularly based on the travel plan information included therein. The operation plan generated by the plan generation unit 1042 is transmitted to the task control unit 1044, which will be described later. In the present embodiment, the operation plan is data that defines a route on which the autonomous vehicle 100A travels and processing to be performed by the autonomous vehicle 100A in a part or all of the route. Examples of data included in the operation plan include the following.

(1) Data representing the route on which the own vehicle travels by a set of road links The route on which the own vehicle travels refers to, for example, the map data stored in the storage unit 114, and the travel plan information included in the operation command. May be automatically generated based on a given origin and destination. Further, the route may be generated by using an external service.

(2) Data representing the processing to be performed by the own vehicle at a point on the route The processing to be performed by the own vehicle on the route includes, for example, "getting on the user", "getting off the user", and "service to be provided". There are things, but they are not limited to these.

The environment detection unit 1043 detects the environment around the vehicle based on the data acquired by the sensor 106. Targets of detection are, for example, the number and position of lanes, the number and position of vehicles around the own vehicle, and obstacles (for example, pedestrians, bicycles, structures, buildings, etc.) around the own vehicle. Numbers and locations, road structures, road signs, etc., but not limited to these. Any object may be detected as long as it is necessary for autonomous driving. In addition, the environment detection unit 1043 may track the detected object. For example, the relative velocity of the object may be obtained from the difference between the coordinates of the object detected one step before and the coordinates of the current object. The data related to the environment (hereinafter referred to as environment data) detected by the environment detection unit 1043 is transmitted to the task control unit 1044 described later.

The task control unit 1044 is a moving body based on the operation plan generated by the plan generation unit 1042, the environment data generated by the environment detection unit 1043, and the position information of the own vehicle acquired by the position information acquisition unit 108. Controls the operation of the own vehicle, that is, the running. For example, the vehicle is driven along a predetermined route and the vehicle is driven so that an obstacle does not enter the predetermined safety area centered on the vehicle. As a method for autonomously traveling the vehicle, a known method can be adopted. In addition, the task control unit 1044 also executes tasks other than traveling based on the operation plan generated by the plan generation unit 1042. Examples of tasks include getting on and off the user, issuing a receipt and a deposit certificate, and the like.

The providing processing unit 1045 provides the server device 200 with the captured image from the camera 107 of the vehicle body. In the autonomous traveling vehicle 100A, the providing processing unit 1045 photographs an image such as a landscape outside the vehicle based on the information of the image shooting command from the user device 300A associated therewith, and provides the image to the server device 200. .. The provided shooting image includes position information by the position information acquisition unit 108 and shooting time information. The time information may include a shooting start time and a shooting end time.

The display processing unit 1046 displays the captured image of another vehicle on the image display unit inside the autonomous traveling vehicle 100A. In the autonomous traveling vehicle 100A, the display processing unit 1046 acquires a photographed image from the server device 200 based on the information of the image display command associated with the user device 300A, and the acquired photographed image is inside the autonomous vehicle 100A. It is displayed on the video display section of. Here, the window W of the autonomous vehicle 100A corresponds to the image display unit that displays the image from the projector in the vehicle, but this is only an example. Specifically, the window W of the autonomous vehicle 100A has a configuration capable of turning between a transparent state in which the outside can be seen from the inside of the vehicle and an opaque state in which the screen can function as a screen. .. By operating the display processing unit 1046, the window W can be changed from a normally transparent state to an opaque state to be a screen. When displaying the captured image on the screen W, the projector adjusts the size of the captured image to be displayed according to the size, shape, inclination, etc. (hereinafter, size, etc.) of the screened window. .. For example, as shown in FIG. 1, since the size of the autonomous traveling vehicle 100A is different from that of the autonomous traveling vehicle 100B, the position of the camera 107 is also different, and the size of the window W is also different. Therefore, when the image taken by the camera 107 of the autonomous vehicle 100A is displayed on the window W of the autonomous vehicle 100B, the photographed image is corrected and displayed so as to match the size of the window W of the autonomous vehicle 100B. .. When the window W is used as a screen, a blackout curtain or the like may be mechanically extended inside the window W.

The drive unit 110 is a means for driving the autonomous traveling vehicle 100A based on a command generated by the task control unit 1044. The drive unit 110 includes, for example, a motor for driving the wheels, an inverter, a brake, a steering mechanism, a secondary battery, and the like.

The communication unit 112 has a communication means for connecting the autonomous traveling vehicle 100A to the network N. In the present embodiment, the autonomous traveling vehicle 100A can communicate with other devices such as the server device 200 and the user device 300A via the network N. The communication unit 112 may further have a communication means for the autonomous traveling vehicle 100A, which is its own vehicle, to perform inter-vehicle communication with another autonomous traveling vehicle 100 (100B, ...).

Next, the server device 200 will be described. The server device 200 is a device that provides information on various operation commands, such as information on services for each of the plurality of autonomous traveling vehicles 100. Further, the server device 200 is a device that acquires a captured image from the autonomous traveling vehicle 100. Further, the server device 200 is a device that provides the autonomous traveling vehicle 100 with captured images of another vehicle based on the information of the command of the image request from the autonomous traveling vehicle 100.

The server device 200 is an information processing device, and as shown in FIG. 3, includes a communication unit 202, a control unit 204, and a storage unit 206. The communication unit 202 is the same as the communication unit 112, and has a communication function for connecting the server device 200 to the network N. The communication unit 202 of the server device 200 is a communication interface for communicating with the autonomous traveling vehicle 100 and the user device 300 via the network N. The control unit 204 has a CPU and a main storage unit like the control unit 104, and executes information processing by a program. Of course, this CPU is also a processor, and the main storage unit of the control unit 204 is also an example of the main storage device. The CPU in the control unit 204 executes a computer program executably deployed in the main storage unit and provides various functions. The main storage unit in the control unit 204 stores computer programs, data, and the like executed by the CPU. The main storage unit in the control unit 204 is a DRAM, SRAM, ROM, or the like.

The control unit 204 is connected to the storage unit 206. The storage unit 206 is an external storage unit, which is used as a storage area that assists the main storage unit of the control unit 204, and stores computer programs, data, and the like executed by the CPU of the control unit 204. The storage unit 206 is a hard disk drive, SSD, or the like.

The control unit 204 is a means for controlling the server device 200. As shown in FIG. 3, the control unit 204 has an information acquisition unit 2041, a vehicle management unit 2042, an information provision unit 2043, and a point addition unit 2044 as functional modules. Each of these functional modules is realized by executing a program stored in the main storage unit or the storage unit 206 by the CPU of the control unit 204.

The information acquisition unit 2041 acquires various information from the autonomous traveling vehicle 100 and the user device 300, for example, a captured image provided by the provision processing unit 1045. Then, the acquired information is transmitted to the vehicle management unit 2042. Further, the information acquisition unit 2041 periodically acquires position information, information of the own vehicle information database 1141 and the like from the autonomous traveling vehicle 100, and transmits the information acquisition unit 2041 to the vehicle management unit 2042. Further, the information acquisition unit 2041 acquires the information of the video request command from the autonomous traveling vehicle 100 and transmits it to the information providing unit 2043.

The vehicle management unit 2042 manages information on a plurality of autonomous traveling vehicles 100 under control. Specifically, the vehicle management unit 2042 receives information such as data related to the autonomous traveling vehicle 100 from the plurality of autonomous traveling vehicles 100 via the information acquisition unit 2041 at predetermined cycles, and the vehicle of the storage unit 206. Stored in the information database 2061. Position information and vehicle information are used as information regarding the autonomous traveling vehicle 100. Vehicle information includes, for example, an identifier of an autonomous vehicle 100, usage / type, information on a standby point (garage or sales office), door type, vehicle body size, luggage compartment size, load capacity, mileage when fully charged, and current time. The mileage in, the current status, etc. However, the vehicle information is not limited to these, and may include other items. The current status includes information such as the user's boarding status and service provision status. Further, the vehicle management unit 2042 stores the captured image provided by the providing processing unit 1045 of the autonomous traveling vehicle 100 in the image information database 2062 so as to be searchable by the position information and the time information. At the time of this storage, it is preferable to associate the user information of the user information database 2063 of the storage unit 206 with the captured image. As a result, the point addition according to the use of the captured image can be performed in association with the user, and more specifically in association with the user information of the user device 300. The user information is stored in the user information database 2063 of the storage unit 206, and is associated with the vehicle information and the like of the vehicle information database 2061.

The information providing unit 2043 provides the captured image to be stored to the autonomous traveling vehicle 100. When the information of the video request command is received from the autonomous traveling vehicle 100 via the information acquisition unit 2041, the information providing unit 2043 searches the video information database 2062 according to a predetermined program. Specifically, the captured video of the time zone corresponding to the time zone requested by the autonomous traveling vehicle 100 is searched and extracted. Also. The past request history from the autonomous traveling vehicle 100, that is, the user device 300 associated with the autonomous vehicle 100, is stored in the user information database 2063 in association with the user information. The genre is narrowed down and extracted from this past request history. For example, in the case of the autonomous traveling vehicle 100 that requires a lot of magnificent images of nature, the images can be extracted based on the area, that is, the position information, in which the natural scenery is a genre. When a request accompanied by a video genre or a keyword related to a video is acquired from the autonomous traveling vehicle 100, the information providing unit 2043 can search the video information database 2062 based on the video genre or the keyword. Therefore, the video stored in the video information database 2062 is automatically or manually classified into genres based on, for example, its position information. The information providing unit 2043 provides the captured video extracted in this way to the autonomous traveling vehicle 100, which is the source of the information of the video request command.

The point addition unit 2044 adds points to the user associated with the video according to the degree of use of the video provided by the information providing unit 2043 based on the request from the autonomous traveling vehicle 100. This point addition process is executed according to a predetermined program. As a result, it is possible to provide compensation for the captured image captured by the camera 107 of the autonomous traveling vehicle 100. This point may be redeemable for cash or merchandise. Further, when the point addition unit 2044 also plays a commercial image in connection with the display of the provided captured image, the point addition unit 2044 may add points according to the number of times the commercial image is displayed and the display time. Further, the point addition unit 2044 may execute the point addition process according to the evaluation from the user who viewed the image provided to the autonomous traveling vehicle on the autonomous traveling vehicle 100.

Next, the user device 300 will be described. The user device 300 is, for example, a mobile terminal, a smartphone, a personal computer, or the like. As an example, the user device 300A of FIG. 4 has a communication unit 302, a control unit 304, and a storage unit 306. The communication unit 302 and the storage unit 306 of the user device 300A are the same as the communication unit 202 and the storage unit 206 of the server device 200, respectively. Further, the user device 300A has a display unit 308 and an operation unit 310. The display unit 308 is, for example, a liquid crystal display, an electroluminescence panel, or the like. The operation unit 310 may be, for example, a keyboard, a pointing device, or the like. More specifically, in the present embodiment, the operation unit 310 includes a touch panel and is substantially integrated with the display unit 308.

The control unit 304 has a CPU and a main storage unit, similarly to the control unit 204 of the server device 200. The CPU of the control unit 304 executes the application program (hereinafter, application) 3061 stored in the storage unit 306. Application 3061 is an application program for accessing information distributed from a web browser or a server device 200. The application 3061 has a GUI, receives input by the user, for example, access, and transmits the input to the autonomous vehicle 100 or the server device 200 via the network N. Through the user device 300, the user can input a service desired to be used and communicate with the server device 200 and the autonomous traveling vehicle 100. When the operation for displaying the captured image is executed, the user device 300 sends the information of the command to the associated autonomous vehicle 100. Further, when the user device 300 wants to take a picture with the camera 107, the user device 300 sends information of a command to take a picture with the camera 107 to the associated autonomous vehicle 100.

In FIGS. 2, 3 and 4, the autonomous traveling vehicle 100, the server device 200, and the user device 300 are connected by the same network N. However, this connection may be realized in a plurality of networks. For example, the network connecting the autonomous vehicle 100 and the server device 200 and the network connecting the server device 200 and the user device 300 may be different networks.

The processing in the system S having the above configuration will be described below. First, the input operation in the user device 300 will be described with reference to FIG. In the following, the terminal device of the user UA is the user device 300A, the terminal device of the user UB is the user device 300B, and the terminal device of the user UC is the user device 300C.

FIG. 5 is an example of the screen of the display unit 308 of the user device 300A by executing the application 3061. The display unit 308 also corresponds to an operation unit 310 as a touch panel.

Of the display unit 308 of the user device 300A, the "vehicle 1" in the display unit 3081 of the photographing area R1 refers to the autonomous traveling vehicle 100A associated with the user device 300A. When there are a plurality of autonomous traveling vehicles 100 associated with the user device 300A, the user UA can select one vehicle from the plurality of autonomous traveling vehicles 100 on the display unit 3081.

When the "start" button 3082a in the shooting area R1 of the user device 300A is pressed, the shooting signal from the user device 300A is transmitted to the autonomous traveling vehicle 100A which is the "vehicle 1" of the display unit 3081. As a result, in the autonomous traveling vehicle 100A, an image is captured by the camera 107, and the captured image is transmitted to the server device 200 as described above. This shooting is performed until the "end" button 3082b in the shooting area R1 of the user device 300A is pressed. As shown in FIG. 1, the user device 300A is in the autonomous traveling vehicle 100A and is operated by the user UA in the autonomous traveling vehicle 100A. This also applies to the operation of the user device 300C by the user UC in the autonomous traveling vehicle 100C. However, as shown in FIG. 1, the user device 300B of the user UB is outside the autonomous traveling vehicle 100B and is operated outside the autonomous traveling vehicle 100B. As described above, the user device 300 may be inside or outside the associated autonomous vehicle 100, and may be fixed to the autonomous vehicle 100 when it is inside.

Of the display units 308 of the user device 300A, the "start" button 3083a and the "end" button 3083b in the image display area R2 start and end the display of the captured image by the display processing unit 1046 on the autonomous vehicle 100A, respectively. It is for the instruction of. The "front" button 3084a and the "rear" button 3084b in the image display area R2 are buttons for switching the displayed image between the images before and after the displayed image. Then, the comment input unit 3085 is an input unit for inputting a comment, for example, an evaluation to the displayed captured image. In addition to or in place of the comment input unit 3085, evaluation buttons such as "good" and "bad" may be provided.

Of the display unit 308 of the user device 300A, the request area R3 has an input unit 3086 for inputting the genre of the photographed image to be displayed in accordance with the display instruction of the photographed image in the image display area R2. The information input in the request area R3 is transmitted to the autonomous traveling vehicle 100A together with instructions for starting and ending the display of the captured image in the image display area R2. The user device 300A can acquire the genre information in the request area R3 by communicating with the server device 200. This genre information is stored in the video information database 2062 of the storage unit 206 of the server device 200, and is provided to the user device 300A by the information providing unit 2043 of the server device 200.

Here, a more specific description will be given. When the "magnificent natural image" is selected in the request area R3 of the user device 300A, the "start" button 3083a of the image display area R2 is pressed. As a result, the image display signal from the user device 300A is transmitted to the autonomous traveling vehicle 100A together with the information of "magnificent natural image". As a result, in the autonomous traveling vehicle 100A, the display processing unit 1046 transmits a signal based on the signal to the server device 200. Then, the information providing unit 2043 of the server device 200 extracts the captured images of the genre related to the "magnificent natural image" according to a predetermined program in the same time zone, and makes the autonomous traveling vehicle 100A. provide. The provided captured image is displayed on the window W as the image display unit by the display processing unit 1046 of the autonomous traveling vehicle 100A. Further, when it is desired to switch the displayed image to another image, the user UA presses the "front" button 3084a or the "rear" button 3084b of the user device 300A. As a result, the signal from the user device 300A is transmitted to the autonomous traveling vehicle 100A. As a result, the autonomous traveling vehicle 100A communicates with the server device 200, acquires another captured image, and displays it.

The flow of information processing in the server device 200 at this time will be described with reference to FIGS. 6 and 7.
The flowchart of FIG. 6 represents the acquisition process of the captured image from the autonomous traveling vehicle 100 as the first moving body in the server device 200. The flowchart of FIG. 7 shows the processing of providing the image taken from the autonomous traveling vehicle 100 as the first moving body to the autonomous traveling vehicle 100 as the second moving body in the server device 200. The autonomous traveling vehicle 100 as the first moving body may be different from the autonomous traveling vehicle 100 as the second moving body. Here, the autonomous traveling vehicle 100 as the first moving body is the autonomous traveling vehicle 100A, and the autonomous traveling vehicle 100 as the second moving body is described below as the autonomous traveling vehicle 100C.

When the information acquisition unit 2041 of the server device 200 acquires the captured image from the autonomous traveling vehicle 100A (step S601 in FIG. 6), the information acquisition unit 2041 transmits it to the vehicle management unit 2042. As a result, the vehicle management unit 2042 stores the acquired information in the video information database 2062 while classifying the acquired information as described above (step S602 in FIG. 6). In this way, a plurality of images are stored in the server device 200. The server device 200 can acquire such an image from another server device and further store it.

When the "start" button 3083a of the image display area R2 of the user device 300C is pressed, the corresponding captured image request signal is transmitted from the autonomous traveling vehicle 100C to the server device 200. When the information acquisition unit 2041 of the server device 200 acquires the request for the captured image from the autonomous traveling vehicle 100C (affirmative determination in step S701 of FIG. 7), the information acquisition unit 2041 transmits the request to the information providing unit 2043. As a result, the information providing unit 2043 of the server device 200 extracts the captured image as described above and provides it to the autonomous traveling vehicle 100C (step S703). Here, it is assumed that the image captured by the autonomous traveling vehicle 100A is provided to the autonomous traveling vehicle 100C. The provision of this image is basically executed until the request from the autonomous traveling vehicle 100C is completed. When the "end" button 3083b of the user device 300C is pressed, the corresponding signal is sent to the server device 200 via the autonomous traveling vehicle 100C. As a result, the information providing unit 2043 of the server device 200 determines that the end request has been made (affirmative determination in step S705), and ends the provision of the captured image. Then, the point addition unit 2044 executes the point addition process as described above (step S707). As a result, the point addition process to the user device 300A, that is, the user UA, which is associated with the autonomous traveling vehicle 100A that captured the provided captured image, is executed.

As described above, according to the system S, the control unit 204 of the server device 200 acquires and stores the captured image from the autonomous traveling vehicle 100 as the first moving body. Then, the control unit 204 of the server device 200 provides the captured image to the autonomous traveling vehicle 100 as the second moving body. Therefore, it is possible to preferably provide the user in the second mobile body with captured images of landscapes of different places or different times by the first mobile body.

In the above embodiment, the server device 200 acquires and stores a captured image from the autonomous traveling vehicle 100 as the first moving body, and then autonomously stores the captured image as the second moving body. Provided to the traveling vehicle 100. However, the server device 200 may provide the photographed image from the autonomous traveling vehicle 100 as the first moving body to the autonomous traveling vehicle 100 as the second moving body in real time. In this case, it is more preferable that the user device 300 can select the vehicle to be photographed in real time.

Further, in the above embodiment, the window W of the autonomous traveling vehicle 100A is used as the image display unit. However, the image display unit may be provided at various locations such as a wall inside the vehicle and the back of the driver's seat. In addition, the image display unit can be any surface such as a wall or a window that forms a section inside the vehicle.

The above embodiment is merely an example, and the present disclosure may be appropriately modified and implemented without departing from the gist thereof. The processes and means described in the present disclosure can be freely combined and carried out as long as there is no technical contradiction.

Further, the processing described as being performed by one device may be shared and executed by a plurality of devices. For example, the server device 200, which is an information processing device, and the information processing device 102 of the autonomous traveling vehicle 100 do not have to be one computer, and may be configured as a system including a plurality of computers. Alternatively, the processing described as being performed by different devices may be performed by one device. In a computer system, it is possible to flexibly change what kind of hardware configuration (server configuration) is used to realize each function.

The present disclosure can also be realized by supplying a computer program to which the functions described in the above-described embodiment are implemented, and having one or more processors of the computer read and execute the program. Such a computer program may be provided to the computer by a non-temporary computer-readable storage medium connectable to the computer's system bus, or may be provided to the computer via a network. Non-temporary computer-readable storage media include, for example, any type of disc such as a magnetic disc (floppy (registered trademark) disc, hard disk drive (HDD), etc.), optical disc (CD-ROM, DVD disc, Blu-ray disc, etc.). Includes read-only memory (ROM), random access memory (RAM), EPROM, EEPROM, magnetic cards, flash memory, optical cards, and any type of medium suitable for storing electronic instructions.

S Video providing system 100, 100A, 100B, 100C Autonomous traveling vehicle 102 Information processing device 104 Control unit 106 Sensor 107 Camera 108 Position information acquisition unit 110 Drive unit 112 Communication unit 114 Storage unit 200 Server device 202 Communication unit 204 Control unit 206 Storage unit Unit 300, 300A, 300B, 300C User device 302 Communication unit 304 Control unit 306 Storage unit

Claims (1)

Acquiring the image taken by the first moving body and
Information processing including a control unit that executes providing the acquired video to the second mobile body so as to display the acquired video on a video display unit inside the second mobile body different from the first mobile body. apparatus.

Images