JP2013134225A - Navigation device, system, method, and computer program - Google Patents

Abstract

The present invention provides a navigation device capable of reproducing a moving image suitable for a current location.
In a navigation device, route candidate acquisition means for acquiring a route candidate from a departure point to a destination by specifying a departure point and a destination, and shooting information including moving image data and a shooting start point of the moving image data And a navigation means for reproducing moving image data related to shooting information when a real or virtual current point on the route candidate passes the shooting start point.
[Selection] Figure 1

Description

  The present invention relates to a navigation device, system, method, and computer program technology.

  Recent mobile phones, smart phones, and the like include, for example, a GPS (Global Positioning System) signal receiving device. When the user inputs a desired “departure place” and “destination”, a route for guiding the user from the departure place to the destination is generated. At this time, for example, a route search condition such as “priority on arrival time” or “priority on easy-to-run road” can be designated.

  Moreover, recent mobile phones, smartphones, and the like are equipped with a camera device in addition to a GPS signal receiving device, and give information (hereinafter referred to as “point information”) indicating a point where the photograph was taken to the photograph taken. be able to. And the taken photograph and point information can be shared with other users (for example, patent documents 1).

JP 2008-84282 A

  In the case of a photograph, by adding point information when the shutter button is pressed, the photograph and the photographing point of the photograph can be associated with each other. However, in the case of a moving image, even if the location information at the time when the shooting start button is pressed is given, the video image and the shooting location cannot be properly associated with each other. This is because there is a possibility that the photographer may shoot a moving image (for example, from a traveling car, train, or bicycle) while moving.

  An object of the present invention is to provide a navigation device, a system, a method, and a computer program that more appropriately associate a video such as a moving image with a shooting location.

  Another object of the present invention is to provide a navigation device, system, method, and computer program capable of more appropriately reproducing a video such as a moving image corresponding to the current location.

  A navigation device according to an embodiment of the present invention includes a route candidate acquisition unit that acquires a route candidate from a departure point to a destination when a departure point and a destination are specified, moving image data, and start of shooting of the moving image data Moving image acquisition means for acquiring shooting information including a point, and navigation means for reproducing moving image data related to the shooting information when a real or virtual current point on the route candidate passes the shooting start point .

It is a block diagram which shows the structure of the navigation system which concerns on the 1st Embodiment of this invention. 2 is a block diagram illustrating an example of a hardware configuration of an image capturing device 2. FIG. 2 is a block diagram illustrating an example of a hardware configuration of a center server 3. FIG. 3 is a block diagram illustrating an example of a hardware configuration of a navigation device 4. FIG. FIG. 3 is a block diagram illustrating an example of a functional configuration that the photographing apparatus 2 has. It is a data block diagram which shows an example of the data of the area information. 3 is a block diagram illustrating an example of a functional configuration of a center server 3. FIG. It is a data block diagram which shows an example of the data of the SNS information 110. It is a data block diagram which shows an example of the data which the characteristic information 120 has. 3 is a block diagram illustrating an example of a functional configuration of a navigation device 4. FIG. 6 is a display example of a route search screen according to the navigation device 4. It is a schematic diagram explaining the outline | summary of a moving image reproduction process. 4 is a display example of a navigation screen according to the navigation device 4. It is an example of the flowchart which shows the production | generation process of a route candidate. It is an example of the flowchart which shows the production | generation process of the route candidate which passes through a recommendation area. It is an example of the flowchart which shows a driving | running | working simulation process or a route guidance process. It is an example of the flowchart which shows the process which reproduces | regenerates a moving image so that it may adapt to the present location. It is a block diagram which shows an example of a function structure of the imaging device 94 which concerns on 2nd Embodiment. It is a data block diagram which shows an example of the data of the area information 800 which concerns on 2nd Embodiment. It is a block diagram which shows an example of a function structure of the navigation apparatus 90 which concerns on 2nd Embodiment. 6 is an example of a flowchart showing a process for controlling the playback speed of a moving image based on the moving speed of the navigation device 90.

  The navigation system according to the present invention generates a route from a departure place to a destination based on information published by a user's friends and the like. Further, the navigation system according to the present invention may generate a route from the departure place to the destination based on the user's attributes or preferences. In addition, the navigation system according to the present invention may reproduce a moving image associated with the current location. Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of a navigation system according to the first embodiment of the present invention.

  The navigation system 1 includes a photographing device 2, a center server 3, and a navigation device 4, and these devices 2 to 4 are connected by a communication network 5. In the present embodiment, the imaging device 2 and the navigation device 4 are described as separate devices, but they may be a single device.

  The communication network 5 enables bidirectional data communication between the devices 2 to 4. The communication network 5 may be wired or wireless. The communication network 5 is configured by, for example, the Internet network, a mobile communication network, or a combination thereof.

  The photographing device 2 can photograph a subject and generate photo data or moving image data. Hereinafter, moving image data will be described as an example. However, the present invention can be applied even to photo data. The imaging device 2 can generate location information by positioning the current location. The imaging device 2 can upload the generated moving image data, point information, and the like to the center server 3 via the communication network 5. The imaging device 2 can be mounted on, for example, a mobile phone, a smartphone, a PC (Personal Computer), an automobile, a motorcycle, or a bicycle. Details of the photographing apparatus 2 will be described later.

  The center server 3 manages the moving image data uploaded from the image capturing device 2, the point information, and the like. Upon receiving the route search request, the center server 3 generates a guide route from the departure point to the destination. The center server 3 transmits the generated guidance route to the navigation device 4. Details of the center server 3 will be described later.

  The navigation device 4 transmits a route search request including the departure point and the destination to the center server 3, and receives a guidance route from the departure point to the destination from the center server 3. The navigation device 4 guides the user to the destination based on the guidance route. Details of the navigation device 4 will be described later.

  FIG. 2 is a block diagram illustrating an example of a hardware configuration of the imaging device 2.

  The photographing apparatus 2 includes a CPU (Central Processing Unit) 21, a memory 22, a photographing device 23, an input device 24, a display device 25, a positioning device 26, a storage device 27, and a communication device 28. The elements 21 to 28 are connected by a bus 29 capable of bidirectional data communication.

  For example, the CPU 21 reads out and executes a computer program (hereinafter referred to as “program”) from the storage device 27 and controls the devices 23 to 27. Thereby, CPU21 implement | achieves each function 51-56 (refer FIG. 5) etc. which the imaging device 2 mentioned later has.

  The memory 22 holds data temporarily required when the CPU 21 executes a program. The memory is composed of, for example, a DRAM (Dynamic Random Access Memory).

  The photographing device 23 photographs a subject and generates still image data (for example, a photograph) or moving image data. The moving image data is held in the storage device 27, for example. The imaging device 23 includes, for example, a camera lens and a CCD (Charge Coupled Device).

  The input device 24 is an interface (hereinafter referred to as “I / F”) that receives input from the user. For example, the user can transmit an instruction to start and end moving image shooting to the image capturing apparatus 2 via the input device 24. For example, the user can transmit an instruction to upload predetermined moving image data to the center server 3 to the photographing apparatus 2 via the input device 24. The input device 24 includes, for example, a physical button or a touch sensor.

  The display device 25 is an I / F that displays an image or the like to the user. For example, the display device 25 displays an image of the subject being shot. The display device 25 is configured by, for example, an organic EL (electroluminescence) display or a liquid crystal display. The input device 24 and the display device 25 may be an integrated device.

  The positioning device 26 measures the current location of the imaging device 2 using a satellite positioning system (for example, GPS). The positioning device 26 is composed of, for example, a receiver that can receive a positioning signal transmitted from a positioning satellite. Alternatively, the positioning device 26 may be a device that measures the current location using a communication signal transmitted from a radio base station related to the communication network 5.

  The storage device 27 holds programs and various data. The storage device 27 is configured by, for example, an HDD (Hard Disk Drive) or a flash memory.

  The communication device 28 controls data transmitted from the imaging device 2 to the communication network 5 and data received by the imaging device 2 from the communication network 5. The communication device 28 is composed of, for example, a wireless transceiver.

  FIG. 3 is a block diagram illustrating an example of a hardware configuration of the center server 3.

  The center server 3 includes a CPU 31, a memory 32, a storage device 33, and a communication device 34. The elements 31 to 34 are connected by a bus 39 capable of bidirectional data communication. The description of the CPU 31, the memory 32, the storage device 33, and the communication device 34 is omitted because it overlaps with the description of the CPU 21, the memory 22, the storage device 27, and the communication device 28 shown in FIG.

  FIG. 4 is a block diagram illustrating an example of a hardware configuration of the navigation device 4.

  The navigation device 4 includes a CPU 41, a memory 42, an input device 43, a display device 44, a positioning device 45, a storage device 46, and a communication device 47. The elements 41 to 37 are connected by a bus 49 capable of bidirectional data communication. The description of the CPU 41, the memory 42, the positioning device 45, the storage device 46, and the communication device 47 is omitted because it overlaps with the description of the CPU 21, the memory 22, the positioning device 26, the storage device 27, and the communication device 28 shown in FIG. .

  The input device 43 is an I / F that accepts input from the user. The user can inform the navigation device 4 of search conditions such as a departure place and a destination via the input device 43. The input device 24 is configured by, for example, a physical button or a touch sensor.

  The display device 44 is an I / F that displays an image or the like to the user. The display device 44 displays, for example, a map, a guidance route, a reproduced video of moving image data, and the like. The display device 44 is configured by, for example, an organic EL display or a liquid crystal display. The input device 43 and the display device 44 may be an integrated device.

  FIG. 5 is a block diagram illustrating an example of a functional configuration of the photographing apparatus 2.

  The imaging device 2 includes a point specifying unit 51, an imaging unit 52, a section information generating unit 53, a moving image storage unit 54, a section information storage unit 55, and a transmission unit 56.

  The point specifying unit 51 specifies the current point of the imaging device 2 based on the positioning signal received by the positioning device 26. And the spot specific | specification part 51 produces | generates the spot information which shows the specified present location. The point specifying unit 51 may perform map matching processing for correcting the current point on the road using the map information. The point information has values (see FIG. 6) such as positioning date and time 104, longitude 105, and latitude 106, for example.

  The photographing unit 52 controls the photographing device 23 to photograph a subject and generates moving image data. The photographing unit 52 registers the generated moving image data in the moving image storage unit 54. At that time, the photographing unit 52 assigns a value (see FIG. 6) of a moving image ID (Identification) 102 that can uniquely identify the moving image data. The imaging unit 52 notifies the section information generation unit 53 of the start and end of shooting. This is because the section information 100 (see FIG. 6) corresponding to the section in which the moving image is shot is generated. And the imaging | photography part 52 includes the value of moving image ID102 in the notification. This is because the moving image data and the section information 100 are associated with each other.

  When the section information generation unit 53 receives a notification of the start of shooting from the shooting unit 52, the section information generation unit 53 acquires information on the longitude 105 and the latitude 106 indicating the current point from the point specifying unit 87. That is, information on the longitude 105 and latitude 106 of the shooting start point is acquired. The section information generation unit 53 acquires and stores information on the longitude 105 and the latitude 106 from the point specifying unit 87 at a predetermined period until receiving a notification of the end of shooting from the shooting unit 52. At this time, the section information generation unit 53 also holds the positioning date and time 104 obtained by positioning the longitude 105 and the latitude 106 together. When the section information generation unit 53 receives a notification of the end of shooting from the shooting unit 52, the section information generation unit 53 associates the value of the moving image ID 102 included in the notification with one or more positioning dates 104, longitude 105, and latitude 106 stored so far. The section information 100 (see FIG. 6) is generated and registered in the section information storage unit 55. This section information 100 may be called photographing information. Hereinafter, the section information 100 will be described in detail.

  FIG. 6 is a data configuration diagram illustrating an example of the data of the section information 100.

  The section information 100 includes, for example, a section ID 101, a moving picture ID 102, a moving picture frame 103, a positioning date 104, a longitude 105, and a latitude 106 as data items. That is, the section information 100 is a data block having the values of these data items 101 to 106.

  The value of the section ID 101 is a value that can uniquely identify the section information 100. The value of the moving image ID 102 is a value that can uniquely identify the moving image as described above. In the section information 100, the value of the section ID 101 and the value of the moving image ID 102 have a one-to-one correspondence.

  The value of the moving image frame 103 is a time during which each frame is reproduced in the moving image data corresponding to the value of the moving image ID 102.

  The value of the positioning date 104 is the date when each moving image frame was shot. Therefore, the positioning date and time value 104a corresponding to the first moving image frame corresponds to the shooting start time, and the positioning date and time value 104d corresponding to the last moving image frame corresponds to the shooting end time.

  The values of the longitude 105 and the latitude 106 are values that indicate the locations that were measured at the date and time when each moving image frame was captured. That is, it is a value indicating the shooting point of each moving image frame. Here, a point at which a certain first moving image frame (for example, row 108a) is shot is set as the first shooting point, and a point at which the subsequent second moving image frame (for example, row 108b) is shot is set as the second shooting point. And a section from the first shooting point to the second shooting point is a sub-section. One or more video frames from the first video frame to the video frame immediately before the second video frame are referred to as a video frame group corresponding to the sub-interval. That is, the moving image frame group corresponding to the sub-section is a moving image frame group photographed in the sub-section. The length of the sub-interval may be arbitrarily set.

  For example, in the data block in the row 108b related to the section information 100, the moving image frame “00:00:04” of the moving image ID “MOV100” was captured at a point of longitude “N35.306263” and latitude “E139.554999”. Indicates that it is a thing. Returning to the description of FIG.

  The transmission unit 56 transmits the moving image data held in the moving image storage unit 54 and the section information 100 held in the section information storage unit 55 to the center server 3 according to a user instruction or automatically.

  FIG. 7 is a block diagram illustrating an example of a functional configuration of the center server 3.

  The center server 3 includes a receiving unit 61, a moving image DB (DataBase) 63, a section information DB 64, an SNS (Social Networking Service) information DB 62, a feature information generating unit 65, a feature information DB 67, and a route candidate generating unit 69. And a transmission unit 70.

  When receiving the moving image data and the section information 100 transmitted from the photographing apparatus 2, the receiving unit 61 registers the moving image data and the section information DB 64 in the moving image DB 63 and the section information DB 64, respectively. When receiving the route search request transmitted from the navigation device 4, the reception unit 61 notifies the route candidate generation unit 69 of the request.

  The moving image DB 63 holds and manages one or more moving image data. From the moving image DB 63, for example, desired moving image data can be extracted using the value of the moving image ID 102 as a search key.

  The section information DB 64 holds and manages one or more section information 100. From the section information DB 64, for example, the desired section information 100 can be extracted using the section ID 101 value or the longitude 105 and latitude 106 values as search keys.

  The SNS information DB 62 holds and manages one or more SNS information 110. The SNS information 110 has information indicating the relationship between users. For example, the SNS information 110 includes information such as who is a friend of a certain user or who is a close friend among friends. The SNS information 110 includes information such as attributes (gender, age, address, school of origin, etc.), preferences, and interests of a certain user. The SNS information 110 includes information such as which community, organization, organization, etc. a certain user belongs to. The SNS information 110 includes moving image data and position information registered by a certain user, information on comments, and the like. The SNS information 110 includes information such as to which friend (or not to disclose) the moving image data and the like. Hereinafter, the SNS information 110 will be described in detail using an example.

  FIG. 8 is a data configuration diagram illustrating an example of the data of the SNS information 110.

  The SNS information 110 includes, for example, a user ID 111, a user name 112, public information 113, and a public range 114 as data items.

  The value of the user ID 111 is an ID value that can uniquely identify each user. The value of the user name 112 is information regarding the name of the user corresponding to the value of the user ID 111. The value of the public information 113 is information indicating moving image data or the like that is disclosed to a friend or the like by the user corresponding to the value of the user ID 111. The value of the disclosure range 114 is information indicating the disclosure range of the moving image data or the like indicated by the value of the disclosure information 113 (that is, to which friends or the like).

  For example, the SNS information 110 illustrated in FIG. 8 indicates that the value of the user name 112 corresponding to the value “U100” of the user ID 111 is “SUZUKI”. Further, the SNS information 110 includes information published by the user with the value “U100” of the user ID 111: movie data with the movie ID “MOV100”, photo data with the photo ID “PIC100”, and comment data with the comment ID “TXT100”. And section information of section ID “C100”. Further, the SNS information 110 indicates that a user with a user ID value “U100” discloses video data with a video ID “MOV100” to users with user ID 111 values “U200” and “U300”. Show. Returning to the description of FIG.

  The feature information generation unit 65 generates feature information 120 for each section held in the section information DB 64. An example of a method for generating the feature information 120 is as follows. For example, the feature information generation unit 65 extracts a certain section from the section information DB 64. The feature information generation unit 65 extracts moving image data corresponding to the section from the moving image DB 63. The feature information generation unit 65 extracts information such as comments related to the moving image data from the SNS information DB 62. The feature information generation unit 65 analyzes the various pieces of extracted information and generates feature information 120. Hereinafter, the feature information 120 will be described in detail.

  FIG. 9 is a data configuration diagram illustrating an example of data included in the feature information 120.

  The feature information 120 includes, for example, a section ID 101, public information 113, and a feature keyword 123 as data items. The section ID 101 and the public information 113 are as described above.

  The value of the feature keyword 123 is a keyword that represents the feature related to the moving image data indicated by the value of the public information 113. The value of the feature keyword 123 is generated by the feature information generation unit 65 analyzing the moving image data indicated by the value of the public information 113. For example, the feature information generation unit 65 analyzes that the scenery of the autumn leaves of the mountain is captured in the moving picture data of the moving picture ID “MOV100”, and “landscape” “mountain” “nature” “autumn leaves” “autumn” etc. The feature keyword 123a is extracted. For example, the feature information generation unit 65 analyzes information such as user attributes, preferences, interests, and the like indicated by the value “U100” of the user ID 111 that captured the moving image of this section, and displays “male” “30s” “drive” Feature keywords 123b such as “like” and “photo lover” are extracted. Note that the values of these feature keywords 123 may be directly input to the user.

  That is, the feature information 120 may include a keyword indicating the feature of a certain section. This feature information 120 is used when generating route candidates to be described later. Returning to the description of FIG.

  The route candidate generating unit 69 generates one or more route candidates that can arrive from the starting point to the destination based on the starting point and the destination included in the route search condition received from the receiving unit 61. The route candidate generation unit 69 generates one or more route candidates that can reach the destination from the departure point via the route point when the route point is designated. A user who has requested a route search (hereinafter referred to as “route search user”) can specify moving image data or an arbitrary point in a moving image section as a transit point. When any point in the moving image data or moving image section is designated as the transit point, the route candidate generation unit 69 generates a route candidate that passes through part or all of the moving image interval.

  An address of a certain point or POI (Point Of Interesting) or the like may be designated as the transit point. A plurality of waypoints may be designated.

  For example, when “prefer friend's recommended section” is designated by the route search condition, the route candidate generation unit 69 passes through a friend's recommended section of the user who has requested the route search (hereinafter referred to as “route search user”). Generate route candidates. Specifically, the route candidate generation unit 69 refers to the SNS information DB 62, identifies a friend of the route search user, and generates a route candidate that passes through a section in which the friend has captured the video data. When a specific friend is specified by the route search condition (for example, “Mr. A's recommended section is prioritized”), the route candidate generation unit 69 generates a route candidate that passes through the specified friend's recommended section.

  The route candidate generation unit 69 generates a route candidate that passes through a section that matches the preference (and attribute) of the route search user, for example, when “preferred recommended section that suits your preference” is specified by the route search condition. To do. Specifically, the route candidate generation unit 69 extracts feature information 120 having a feature keyword 123 that matches the preference (and attribute) of the route search user from the feature information DB 67, and video data having the feature is captured. A route candidate passing through the specified section is generated.

  The transmission unit 70 returns the route candidate generated by the route candidate generation unit 69 to the navigation device 4 of the user who has requested the route search. The transmission unit 70 may return the moving image data taken on and around the route candidate, the section information 100, and the feature information 120 together with the route candidate to the navigation device 4.

  FIG. 10 is a block diagram illustrating an example of a functional configuration of the navigation device 4.

  The navigation device 4 includes a transmission / reception unit 81, a route search unit 82, a moving image storage unit 54, a route information storage unit 84, a navigation processing unit 86, a moving image playback unit 85, and a point specifying unit 87.

  The transmission / reception unit 81 controls the communication device 47 to transmit a route search request to the center server 3 and receive information such as route candidates from the center server 3.

  When a departure place and a destination are designated by the user, the route search unit 82 searches for a route that can be reached from the departure place to the destination. In addition, when a route point is specified, the route search unit 82 searches for a route that can reach the destination from the departure point through the route point. In this embodiment, it is the center server 3 that actually searches for a route. Therefore, the route search unit 82 generates a route search condition including the departure point and the destination (and a transit point if specified) and transmits it to the center server 3, and receives the route candidate generated in the center server 3. To do. At this time, the route search unit 82 may receive the moving image data taken on and around the route candidate, the section information 100, and the feature information 120 together.

  The route search unit 82 registers the route candidate, the section information 100, the feature information 120, and the like received from the center server 3 in the route information storage unit 84. The route search unit 82 registers the moving image data received from the center server 3 in the moving image storage unit 54. Hereinafter, the route search unit 82 will be described in detail using a display example of a route search screen.

  FIG. 11 is a display example of a route search screen according to the navigation device 4.

  The route search screen 200 includes, for example, a departure point and destination input region 205, a search condition selection region 207, and a route search result display region 210.

  First, a case where the user searches for a route from the departure point 206a to the destination 206c under a predetermined search condition will be described.

  It is assumed that the user inputs “current location” as the departure point 206a and “Niigata Station” as the destination 206c. At this stage, it is assumed that the transit point 206b has not been input yet. Then, the user selects “Preferred friend's recommended section” 208b from the search condition and executes route search.

  Then, a route candidate 213a is displayed in the route search result display area 210, for example. This route candidate 213a is generated so as to pass through the moving image sections 214a and 214b in the section where the user's friend has taken a moving image. Then, the moving image data 212a shot in the moving image section 214a and the moving image 212b shot in the moving image section 214b are displayed in the route search result display area 210. Here, the moving image data 212c and 212d photographed on the route candidate 213a and in the vicinity of the route candidate 213a and the moving image sections 214c and 214d are also displayed in the route search result display area 210. The user can designate these moving image data 212c and 212d as a waypoint.

  Next, a case where the user sets moving image data as a waypoint will be described. It is assumed that the user selects and inputs the moving image data “B” (212d) at the waypoint 206. Then, the route candidate 213a is changed to a route candidate that uses the moving image section 214d where the moving image data 212d is photographed as a transit point, and is displayed in the route search result display area 210.

  In the above description, the route is specified after the route candidate is generated using “friend's recommended section is preferred” 208b as a search condition. However, “priority of arrival time” 201a or “recommended section that suits the preference” The same can be done using "priority" 208c as a search condition.

  In addition, after designating a waypoint, a route candidate can be generated by designating a search condition. In this case, when the moving image data displayed in advance on the map is designated as the transit point, route candidates that can arrive at the destination are generated using the moving image section in which the moving image data is captured from the departure point.

  Next, a case where the user starts a travel simulation based on the route candidate 213a will be described. When the user presses the “Start driving simulation” button 231, a driving simulation screen (see, for example, FIG. 13) when driving the route candidate 213 a is displayed. At this time, for example, when the virtual current location moves into the moving image segment 214a, the moving image data 212a corresponding to the moving image segment 214a is reproduced.

  Next, a case where the user starts route guidance based on the route candidate 213a will be described. When the user presses the “start route guidance” button 232, the navigation device 4 starts route guidance from the departure point to the destination using the route candidate 213 a as a guidance route. Then, when the actual current location moves into, for example, the moving image section 214a, moving image data 212a corresponding to the moving image section 214a is reproduced. Returning to the description of FIG.

  The moving image reproducing unit 85 extracts moving image data from the moving image storage unit 54 and reproduces it in accordance with an instruction from the navigation processing unit 86. In addition, the moving image reproduction unit 85 performs processing such as reproduction start, pause, and skip of the moving image in accordance with an instruction from the navigation processing unit 86.

  The point specifying unit 87 specifies the current point of the navigation device 4 based on the positioning signal received by the positioning device 45.

  When the navigation processing unit 86 receives an instruction to start route guidance from the user, the navigation processing unit 86 starts route guidance from the departure point to the destination. The navigation processing unit 86 extracts the guidance route from the route information storage unit 84 and displays it by superimposing it with the map information. The navigation processing unit 86 acquires the point information from the point specifying unit 87 at a predetermined cycle, and displays the current point superimposed on the map information.

  When the current point passes through the section indicated by the section information 100 on the guidance route, the navigation processing unit 86 causes the moving image reproduction unit 85 to reproduce the moving image data corresponding to the section information 100. At this time, the navigation processing unit 86 controls the moving image reproduction unit 85 to reproduce the moving image data so that the shooting point of the image displayed during the reproduction of the moving image data is synchronized with the current point. Hereinafter, processing related to moving image reproduction will be described in detail.

  FIG. 12 is a schematic diagram for explaining the outline of the moving image reproduction process. When the navigation processing unit 86 controls the video reproduction unit 85 to reproduce the video data corresponding to the section, the navigation processing unit 86 performs reproduction so that the current location and the frame image of the video captured at the current location are substantially synchronized. . Hereinafter, this will be described in detail with reference to FIG.

  The diagram of FIG. 12A is a schematic diagram when a vehicle (hereinafter referred to as “photographed vehicle”) 301 equipped with the photographing device 2 captures a moving image from the point P1 to the point P3. Here, the point D when the photographing automobile 301 travels at the speed V from the point P1 for ΔT time is V × ΔT.

  The diagram of FIG. 12B is a schematic diagram in the case where an automobile (hereinafter referred to as “navigation automobile”) 302 on which the navigation device 4 is mounted reproduces a moving image taken from the point P1 to the point P3.

  The point D1 when the navigation car 302 travels from the point P1 at the speed V1 (<V) for ΔT time is V1 × ΔT. In this case, when a moving image is normally reproduced, a moving image frame having a reproduction time ΔT is reproduced at the point D1. That is, even though the current location of the navigation vehicle 302 is D1, a moving image frame captured at the location D by the imaging vehicle 301 is reproduced.

  On the other hand, the point D2 when the navigation car 302 travels from the point P1 at the speed V2 (> V) for ΔT time is V2 × ΔT. In this case as well, when a moving image is normally reproduced, a moving image frame having a reproduction time ΔT is reproduced at the point D2. That is, although the current location of the navigation vehicle 302 is D2, the moving image frame captured at the location D by the imaging vehicle 301 is reproduced.

  As described above, the moving image frame corresponding to the current location of the navigation car 302 cannot be reproduced only by reproducing the moving image normally.

  Therefore, when the playback time of the moving image after the navigation car 302 passes the point D is less than ΔT, the navigation processing unit 86 causes the moving image playback unit 85 to skip to the moving image frame of the playback time ΔT and start playback. Instruct. If the playback time of the moving image reaches ΔT before the navigation car 302 passes the point D, the navigation processing unit 86 instructs the moving picture playback unit 85 to pause the playback until the navigation car 302 passes the point D. Instruct. As a result, the current location of the navigation automobile 302 and the video frame image can be displayed in a substantially synchronized manner in a predetermined section.

  FIG. 13 is a display example of a navigation screen according to the navigation device 4. The navigation screen 400 includes a map area 401, a moving image area 402, and an operation area 403.

  In the map area 401, a map, a guide route, a current location, and the like are displayed. In the moving image area 402, a playback image of a moving image frame corresponding to the current location is displayed. In the operation area 403, buttons for giving instructions regarding navigation and moving image reproduction are displayed.

  In the moving image area 402 shown in FIG. 13, moving image data corresponding to the moving image sections P1 and P2 is reproduced. If the reproduction of the moving image data corresponding to the moving image segments P1 to P2 is not completed when the current point passes P2, the reproduction of the moving image data corresponding to the next moving image segments P2 to P3 is started. If the playback of the video data corresponding to the video segments P1 to P2 has ended before the current location passes P2, the video data corresponding to the video segments P1 to P2 until the current location passes P2. Pause playback.

  Thereby, it is possible to display the current position and the moving image frame photographed at the current position in synchronization in the moving image area 402.

  FIG. 14 is an example of a flowchart illustrating a route candidate generation process. Hereinafter, a route candidate generation method will be described with reference to FIG.

  When the route candidate generation unit 69 receives a route search request including the departure point, the destination, and the route search condition from the navigation device 4 (S101), the route candidate generation unit 69 generates a route candidate by giving priority to a recommended section based on friends or preferences in the search condition. It is determined whether there is an instruction to do so (S102).

  If there is no instruction to generate a route candidate in preference to a recommended section based on friends or preferences in the search condition (S102: NO), the route candidate generation unit 69 performs normal (for example, destination) from the departure point to the destination A route candidate that can arrive at the ground at the shortest time is generated (S104), and the process proceeds to step S105.

  When the search condition includes an instruction to generate a route candidate with priority on a recommended section based on friends or preferences (S102: YES), the route candidate generation unit 69 generates a route candidate that passes through the recommended section (S103). The process proceeds to step S105. Details of the processing in step S103 will be described later.

  The route candidate generation unit 69 extracts moving image data photographed on the generated route candidate and in the vicinity of the route candidate (S105).

  The route candidate generation unit 69 presents the generated route candidate and the extracted moving image data to the navigation device 4 (S106).

  When a certain moving image data is designated as a route point from the navigation device 4 (S107: YES), the route candidate generating unit 69 generates a route candidate having the shooting point of the moving image data as a route point (S108). The process proceeds to step S109. On the other hand, if no new moving image data is designated as a transit point from the navigation device 4 (S107: NO), the route candidate generation unit 69 proceeds to the process of step S109 as it is.

  The route candidate generation unit 69 ends the route generation process and starts the route guidance process when the user gives an instruction to start route guidance (S1098: YES). On the other hand, when the user does not give an instruction to start route guidance (S109: NO), the route candidate generating unit 69 returns to the process of step S107.

  FIG. 15 is an example of a flowchart illustrating a process for generating a route candidate passing through the recommended section. Hereinafter, a method for generating route candidates passing through the recommended section will be described with reference to FIG.

  The route candidate generation unit 69 extracts the SNS information 110 corresponding to the value of the user ID 111 of the user who transmitted the route search request (hereinafter referred to as “route search user”) from the SNS information DB 62 (S201).

  The route candidate generation unit 69 extracts information such as friends of the route search user and information such as attributes and preferences of the route search user from the extracted SNS information 110 (S202).

  The route candidate generation unit 69 extracts, as recommended sections, sections in which the extracted friends and the like have photographed moving images and sections in which moving images that match the extracted attributes and preferences are photographed (S203).

  The route candidate generating unit 69 generates a route candidate that passes through the extracted recommended section (S204).

  Through the above processing, the navigation device 4 can present route candidates that use the point where the moving image selected by the user is taken as a transit point. Moreover, the navigation apparatus 4 can present the route candidate which passes the point which the user's friend imaged the moving image. Moreover, the navigation apparatus 4 can present a route candidate that passes through a point where a moving image that matches the user's preference or the like is taken.

  FIG. 16 is an example of a flowchart showing a travel simulation process or a route guidance process. Hereinafter, a method of running simulation or route guidance will be described with reference to FIG.

  The navigation processing unit 86 sets one of route candidates as a guide route when an instruction to start running simulation or start route guidance is given by the user (S301). The navigation processing unit 86 extracts the section information 100 included in the set guidance route from the route information DB (S302).

  The navigation processing unit 86 sets the reproduction start point and reproduction end point of the moving image data included in the section information 100 on the guidance route (S303).

  The navigation processing unit 86 starts route guidance (S304). The navigation processing unit 86 periodically acquires the current location from the location specifying unit 87 (S305). The navigation processing unit 86 determines whether or not the current location is within the moving image playback section (S306).

  When the current location is outside the video playback section (S306: NO), the navigation processing unit 86 determines whether or not the current location has passed the video data playback start location (S310). Here, when the current point passes the reproduction start point of the moving image data (S310: YES), the navigation processing unit 86 starts reproducing the moving image data corresponding to the section (S311), and proceeds to the process of step S312. . If the current point does not pass the reproduction start point of the moving image data (S310: NO), the navigation processing unit 86 proceeds to the process of step S312 without doing anything.

  In step S306, when the current location is within the playback section of the video data (S306: YES), the navigation processing unit 86 determines whether or not the current location has passed the playback end location of the video data (S307). Here, when the current point passes the reproduction end point of the moving image data (S307: YES), the navigation processing unit 86 ends the reproduction of the moving image data corresponding to the section (S308), and proceeds to the process of step S312. . On the other hand, when the current point does not pass the reproduction end point of the moving image data (S307: NO), the navigation processing unit 86 continues to reproduce the moving image (S309), and proceeds to the process of step S312.

  The navigation processing unit 86 determines whether or not the current point has arrived near the destination (S312). If the current point has not arrived near the destination (S312: NO), the navigation processing unit 86 returns to the process of step S305. If the current location has arrived near the destination (S312: YES), the navigation processing unit 86 ends the processing.

  FIG. 17 is an example of a flowchart showing a process of playing back a moving image so as to match the current location. Hereinafter, the moving image reproduction processing according to step S309 in FIG. 15 will be described in detail with reference to FIG.

  The navigation processing unit 86 determines whether or not the current location has shifted to a new subsection (S401).

  When the current location is shifted to a new sub-section (S401: NO), the navigation processing unit 86 controls the moving picture reproduction unit 85 to skip and reproduce the moving picture time corresponding to the new sub-section (S402). In other words, even when the video corresponding to the previous sub-section is being played back, if the current location is shifted to a new sub-section, the playback of the video corresponding to the new sub-section is started.

  If the current location has not shifted to a new subsection (same subsection) (S401: YES), the navigation processing unit 86 determines whether or not the reproduction of the moving image corresponding to the subsection has been completed (S403). ).

  When the reproduction of the moving image corresponding to the sub-section is completed (S403: YES), the navigation processing unit 86 controls the moving image reproducing unit 85, and temporarily stops the reproduction of the moving image (S404). That is, the playback of the moving image is paused until the current point moves to the new sub-section and the playback of the moving image corresponding to the new sub-section is started.

  When the reproduction of the moving image corresponding to the sub-section has not been completed (S403: NO), the navigation processing unit 86 controls the moving image reproducing unit 85 to continuously reproduce the moving image (S403).

  Through the above processing, the navigation device 4 can reproduce the current location and the moving image taken at the current location almost in synchronization. That is, the navigation device 4 can display a moving image frame shot at the current location.

  In the second embodiment, in the navigation device 4, a modification is shown in the case where the current location and the video frame of the moving image captured at the current location are played back almost synchronously.

  FIG. 18 is a block diagram illustrating an example of a functional configuration of the imaging device 94 according to the second embodiment. The photographing apparatus includes a point specifying unit 51, a photographing unit 52, a section information generating unit 96, a moving image storage unit 54, a section information storing unit 55, a transmitting unit 56, a speed detecting unit 95, and a moving image compressing unit 96. And have. Hereinafter, only functional blocks different from those of the imaging device 2 shown in FIG. 5 will be described, and the same functional blocks will be denoted by the same reference numerals and description thereof will be omitted.

  The speed detection unit 95 detects or calculates the current speed of the imaging device 94. The speed detection unit 95 detects the current moving speed based on a detection value of a speed detection device (not shown) provided in the photographing apparatus 94. Alternatively, the speed detection unit 95 may calculate the current speed based on the temporal movement distance of the point information measured by the point specifying unit 51 at a predetermined cycle.

  In addition to the functions of the section information generating unit 53 shown in FIG. 5, the section information generating unit 96 includes section information 800 (see FIG. 19) that associates moving image data with the moving speed when the moving image data is captured. Generate. That is, the section information generation unit 96 acquires speed information from the speed detection unit 95 and associates the speed information with a predetermined section (or a predetermined frame) of the moving image being shot. Hereinafter, the function of the section information generation unit 96 will be further described with reference to an example of the data of the section information 800.

  FIG. 19 is a data configuration diagram showing an example of the data of the section information 800 according to the second embodiment.

  The section information 800 includes, for example, a section ID 101, a moving picture ID 102, a moving picture frame 103, a positioning date and time 104, a longitude 105 and a latitude 106, and a moving speed 107 as data items. Since the data items 101 to 106 have been described with reference to FIG. 6, description thereof is omitted here.

  The value of the moving speed 107 is the moving speed in the corresponding sub-section of the photographing apparatus 94. The section information generation unit 96 may use the average value of the moving speeds in the sub-sections of the imaging device 94 as the value of the moving speed 107. Alternatively, the section information generation unit 96 may use the movement speed 107 as the value of the movement speed 107 at a certain moment in the sub-section of the photographing apparatus 94. Returning to the description of FIG.

  The moving image compression unit 97 compresses the moving image data based on the section information 800 before the moving image data is uploaded to the center server 3. That is, the moving image compression unit 97 thins out (or compresses) the moving image frame corresponding to the sub-section in which the value of the moving speed 107 is a predetermined speed or less. For example, the moving image compression unit 97 thins out (or compresses) moving image frames corresponding to the sub-intervals 801b and 801c in which the value of the moving speed 107 is 1 km / h or less in the interval information 800 illustrated in FIG. Because the value of the moving speed 107 is 1 km / h or less, the photographing apparatus 94 is almost stopped due to, for example, waiting for a signal, and the same point is continuously photographed in the photographed image. This is because there is a high possibility of only. Thereby, the imaging device 94 can upload the moving image data to the center server 3 in a shorter time. Further, the navigation device 90 can download the moving image data from the center server 3 in a shorter time.

  FIG. 20 is a block diagram illustrating an example of a functional configuration of the navigation device 90 according to the second embodiment.

  The navigation device 90 includes a transmission / reception unit 81, a route search unit 82, a moving image storage unit 54, a route information storage unit 84, a navigation processing unit 91, a moving image playback unit 92, a point specifying unit 87, and a speed detection unit. 93. Hereinafter, only functional blocks different from the navigation device 4 shown in FIG. 10 will be described, and the same functional blocks will be denoted by the same reference numerals and description thereof will be omitted.

  The speed detection unit 93 detects or calculates the current speed of the navigation device 90. The speed detector 93 detects the current speed based on speed information detected by a speed detection device (not shown) included in the navigation device 90. Alternatively, the speed detection unit 93 may calculate the current speed based on the temporal movement distance of the point information measured by the point specifying unit 87 at a predetermined cycle.

  The navigation processing unit 91 is a ratio between the current speed of the navigation device 90 detected by the speed detection unit 93 and the speed at which the video at the current location was shot (hereinafter referred to as “playback ratio”) in the video playback section. ) Is calculated. Then, the navigation processing unit 91 controls the moving image reproduction unit 92 to reproduce the moving image at the reproduction speed indicated by the reproduction ratio. Details of this processing will be described later. Other processes are the same as those of the navigation processing unit 86 shown in FIG. The moving image reproducing unit 92 reproduces the moving image at the reproduction speed instructed from the navigation processing unit 91.

  FIG. 21 is an example of a flowchart illustrating a process for controlling the moving image playback speed based on the moving speed of the navigation device 90.

  The processing in steps S501 to S504 is the same as the processing in steps S401 to S404 shown in FIG. Hereinafter, only the processing after step S505 will be described.

  The navigation processing unit 91 acquires or calculates the moving speed “V1” of the imaging device 2 that has captured the sub-section related to the current location (S505).

  The navigation processing unit 91 calculates the moving speed “V2” of the navigation device 90 related to the current location (S506).

  The navigation processing unit 91 controls the moving image reproducing unit 85 to reproduce the moving image data corresponding to this sub-section at a reproduction speed “V2 / V1” (S507).

  Through the above processing, the navigation device 90 can reproduce the current location and the moving image data captured at the current location more synchronously. That is, the navigation device 90 can display the video of the moving image frame captured at the current location.

  The above-described embodiments of the present invention are examples for explaining the present invention, and are not intended to limit the scope of the present invention only to those embodiments. Those skilled in the art can implement the present invention in various other modes without departing from the gist of the present invention.

  For example, in the present embodiment, the route candidate is generated by the center server 3, but the route candidate may be generated by the navigation device 4. In this case, for example, the following processing is performed. The navigation device 4 transmits the value of the user ID to the center server 3, information on a section where a friend corresponding to the value of the user ID has shot a video, and a section where a video that matches the user's preferences is shot, Get the video data. Then, the navigation device 4 presents the acquired moving image data to the user. When the user designates certain moving image data as a transit point, the navigation device 4 generates route candidates that can arrive at the destination from the departure point through the section where the moving image data was captured. Thereby, even if the center server 3 does not have a function of generating route candidates, this embodiment can be realized.

DESCRIPTION OF SYMBOLS 1 ... Navigation system 2,94 ... Shooting device 3 ... Center server 4,90 ... Navigation device

Claims (11)

Route candidate obtaining means for designating a starting point and a destination and obtaining route candidates from the starting point to the destination;
Moving image acquisition means for acquiring shooting information including moving image data and a shooting point of the moving image data;
A navigation device comprising navigation means for reproducing moving image data relating to the shooting information when a real or virtual current location on the route candidate passes the shooting point. 2. The navigation device according to claim 1, wherein the navigation unit reproduces the moving image data so that a shooting point of an image displayed during reproduction of the moving image data is synchronized with the current point. 3. . The shooting information associates a first frame that is a video frame included in the moving image data with a shooting point at which the first frame was shot,
The navigation means includes
3. The navigation device according to claim 1, wherein when the current location passes the shooting location of the first frame, reproduction after the first frame is started. 4. The shooting information associates a second frame, which is a frame located later in time than the first frame, with a shooting point where the second frame was shot,
The navigation means includes
If the moving image data is not reproduced up to the second frame when the current point passes the shooting point of the second frame, the second frame is skipped to the second frame. Subsequent playback starts,
When the moving picture data is being played up to the second frame when the current point has not reached the shooting point of the second frame, the playback is paused at the second frame. The navigation device according to claim 3, wherein It further comprises speed detecting means for detecting the moving speed,
The shooting information associates a shooting side moving speed, which is a moving speed when the first frame is shot, with the first frame,
The navigation means includes
When the current point passes the shooting point of the first frame, the playback side moving speed that is the moving speed at that time is acquired from the speed detecting means, and the playback side moving speed and the shooting side moving speed are acquired. The navigation device according to claim 3, wherein a reproduction speed of the moving image data is controlled based on a ratio of the moving image data. Storage means for storing map data;
6. The navigation unit according to claim 1, further comprising: a display unit that displays map information based on the map data and the current location, and displays a playback video of the moving image data. The navigation device according to item. The navigation according to any one of claims 1 to 6, wherein the moving image acquisition means acquires only the moving image data in which the shooting point is included on the route candidate or in the vicinity of the route candidate. apparatus. Obtaining a route candidate from the starting point to the destination when a starting point and a destination are specified; and
Acquiring shooting information including moving image data and a shooting start point of the moving image data;
When the actual or virtual current location on the route candidate passes the shooting location, reproducing the moving image data related to the shooting information;
A navigation method. When executed on a computer,
Obtaining a route candidate from the starting point to the destination when a starting point and a destination are specified; and
Acquiring shooting information including moving image data and a shooting point of the moving image data;
When the actual or virtual current location on the route candidate passes the shooting location, reproducing the moving image data related to the shooting information;
A computer program that executes. A navigation system comprising: a photographing device that shoots a subject to generate moving image data; a server device that manages the moving image data; and a navigation device that reproduces the moving image data.
The imaging device
Photographing means for generating photographing information including the moving image data and a photographing point of the moving image data;
Transmission means for transmitting the moving image data and the shooting information to the server device,
The server device
Management means for managing the moving image data and the shooting information;
Route candidate generating means for generating a route candidate from a starting point to a destination designated from the navigation device;
Extraction means for extracting the moving image data and the shooting information corresponding to the route candidate from the management means,
The navigation device
Route acquisition means for specifying a starting point and a destination and acquiring the route candidate from the starting point to the destination from the server device;
Moving image acquisition means for acquiring the moving image data and the shooting information corresponding to the route candidate from the server device;
A navigation unit that reproduces the moving image data related to the shooting information when a real or virtual current point on the route candidate passes the shooting point;
Navigation system. The imaging device
Speed detecting means for detecting the moving speed;
Video compression means for compressing video frames included in the video data, and
In the photographing means, the video frame included in the moving image data, the photographing point where the video frame was photographed, and the photographing side moving speed that is the moving speed when the video frame is photographed are associated and photographed. Generate information,
In the moving image compression means, compress a video frame associated with the shooting side moving speed that is equal to or lower than a predetermined speed to generate compressed moving image data,
The navigation system according to claim 10, wherein the transmission means stores the compressed moving image data and the shooting information in the server device.

Images