WO2024135034A1 - Playback device and playback method - Google Patents

Abstract

A playback device 10 comprises an image acquisition unit 200 that acquires a captured moving image, a playback control unit 121 that plays back the moving image acquired by the image acquisition unit 200, and a display control unit 119 that causes a display unit 216 to display the moving image played back by the playback control unit 121, wherein the playback control unit 121 changes the method for playing back the moving image depending on the state of the line of sight corresponding to the moving image acquired by the image acquisition unit 200.

Description

REPRODUCTION DEVICE AND REPRODUCTION METHOD

The present invention relates to a playback device and a playback method.

When the captured video is constantly recorded, as in the case of a so-called drive recorder, it can be difficult to search through a long period of video for a scene that contains, for example, a specific vehicle or a specific person. Technology related to drive recorders that switch between and play back video from multiple cameras is known (see, for example, Patent Document 1).

JP 2021-185666 A

For example, in the case of event data recorded when an event occurs, the fact that the event occurred is recorded, and the recording time is relatively short, so there is little need to search for the desired scene. In contrast, with regular recording data that is constantly recorded, if it is difficult to identify the desired scene from information such as the recording time and recording location, it is necessary to play back and check the video within the range where the desired scene is expected to be captured.

The present disclosure has been made in consideration of the above, and aims to make it easier to detect scenes from video.

In order to solve the above-mentioned problems and achieve the objectives, the playback device according to the present disclosure includes an image acquisition unit that acquires a captured video image, a playback control unit that plays the video image acquired by the image acquisition unit, and a display control unit that displays the video image played by the playback control unit on a display unit, and the playback control unit changes the playback method of the video image depending on the line of sight state corresponding to the video image acquired by the image acquisition unit.

The playback method according to the present disclosure is carried out by a playback device, which performs the steps of acquiring a captured video image, playing the captured video image, displaying the played video image on a display unit, and changing the playback method of the video image depending on the line of sight state corresponding to the video image.

The present disclosure has the effect of making it easier to detect scenes from video.

FIG. 1 is a block diagram showing an example of the configuration of a playback device according to the first embodiment. FIG. 2 is a block diagram showing another example of the configuration of the playback device according to the first embodiment. FIG. 3 is a flowchart showing an example of the flow of the regeneration process in the control device according to the first embodiment. FIG. 4 is a flowchart showing an example of the flow of a regeneration process in the control device according to the second embodiment. FIG. 5 is a block diagram showing an example of the configuration of a playback device having a control device according to the third embodiment. FIG. 6 is a flowchart showing an example of the flow of a recording process in the control device according to the third embodiment. FIG. 7 is a flowchart showing an example of the flow of a regeneration process in the control device according to the third embodiment. FIG. 8 is a flowchart showing an example of the flow of the regeneration process in the control device according to the fourth embodiment. FIG. 9 is a diagram for explaining the area on the display screen where the gazes are concentrated. FIG. 10 is a flowchart showing an example of the flow of the regeneration process in the control device according to the fifth embodiment. FIG. 11 is a flowchart showing an example of the flow of the regeneration process in the control device according to the sixth embodiment.

Below, embodiments of the playback device and playback method according to the present disclosure will be described in detail with reference to the attached drawings. Note that the present invention is not limited to the following embodiments.

[First embodiment]
The playback device is a device that plays back moving images. In this embodiment, the playback device changes a playback method for moving images depending on whether or not a person's line of sight is focused on a certain range of the display screen of the display unit 216. The playback device of this embodiment is implemented as, for example, a so-called drive recorder, or an electronic device such as a personal computer or a smartphone.

<Playback device (drive recorder)>
With reference to FIG. 1, a case will be described in which the reproducing device 10 is, for example, a drive recorder as a recording and reproducing device that records a moving image when an event occurs in a vehicle. FIG. 1 is a block diagram showing an example of a configuration example of the reproducing device 10 having a reproducing control device (hereinafter, referred to as a "control device") 100 according to the first embodiment. The reproducing device 10 shown in FIG. 1 captures images of the periphery of the vehicle and reproduces the captured files. The reproducing device 10 may be a portable device that can be used in a vehicle, in addition to a device that is mounted on a vehicle, which is an example of a moving body. The reproducing device 10 may also be realized by including the functions or configurations of a device that is installed in advance in the vehicle, a navigation system, and the like. The reproducing device 10 has a first camera 210, a second camera 211, a recording unit 212, an operation unit 213, an acceleration sensor 214, a GNSS (Global Navigation Satellite System) receiving unit 215, a display unit 216, and a control device 100.

The first camera 210 is a camera mounted on the vehicle. The first camera 210 is a camera that captures at least one of the surroundings and the interior of the vehicle. The first camera 210 may be a group of multiple cameras. The first camera 210 is disposed, for example, at a position in the front of the vehicle interior where it can capture images of the area in front of the vehicle. In this embodiment, the first camera 210 constantly captures video while the accessory power of the vehicle is ON. The first camera 210 outputs the captured image data to the image data acquisition unit 111 of the control device 100. The captured image data is, for example, a moving image composed of images at 27.5 frames per second.

The second camera 211 is a camera provided around the display screen of the display unit 216. The second camera 211 captures an image in a direction opposite to the display screen of the display unit 216. The second camera 211 is a camera provided in the vehicle. In this embodiment, the second camera 211 is, for example, a camera that captures the face of a user, such as a vehicle occupant. The second camera 211 is a camera that captures an image so as to detect the user's line of sight. The second camera 211 may be provided, for example, inside the vehicle's inner mirror, near the inner mirror, or on the dashboard. The second camera 211 may be a group of multiple cameras. The second camera 211 is, for example, disposed in a position where it can capture an image of an occupant in each seat of the vehicle. The second camera 211 is, for example, composed of a visible light camera or a near-infrared camera. The second camera 211 may be, for example, composed of a combination of a visible light camera and a near-infrared camera. In this embodiment, the second camera 211 constantly captures images while the accessory power of the vehicle is ON. The second camera 211 outputs the captured image data to the image data acquisition unit 111 of the control device 100. The image data is, for example, a moving image composed of images at 27.5 frames per second.

The recording unit 212 is used for temporary storage of data in the playback device 10. The recording unit 212 is, for example, a semiconductor memory element such as RAM (Random Access Memory) or flash memory, or a recording unit such as a memory card. Alternatively, it may be an external recording unit that is wirelessly connected via a communication device (not shown). The recording unit 212 records a shooting file that is continuous recording data or event recording data based on a control signal output from the recording control unit 122 of the control device 100.

The operation unit 213 can accept various operations on the playback device 10. The operation unit 213 is, for example, a touch panel provided on the display unit 216. For example, the operation unit 213 can accept an operation to manually save captured image data in the recording unit 212 as event recording data. For example, the operation unit 213 can accept an operation to play back continuous recording data or event recording data recorded in the recording unit 212. For example, the operation unit 213 can accept an operation to erase event recording data recorded in the recording unit 212. For example, the operation unit 213 can accept an operation to end continuous recording. The operation unit 213 outputs operation information to the operation control unit 116 of the control device 100.

The acceleration sensor 214 is a sensor that detects acceleration occurring to the vehicle. The acceleration sensor 214 outputs the detection result to the event detection unit 117 of the control device 100. The acceleration sensor 214 is a sensor that detects acceleration in, for example, three axial directions. The three axial directions are the forward/rearward direction, the left/right direction, and the up/down direction of the vehicle.

The GNSS receiving unit 215 is composed of a GNSS receiver that receives GNSS signals from GNSS satellites. The GNSS receiving unit 215 outputs the received position information signal to the position information acquisition unit 118 of the control device 100.

The display unit 216 is, for example, a display device specific to the playback device 10, or a display device shared with other systems including a navigation system. The display unit 216 may be formed integrally with the first camera 210. The display unit 216 is, for example, a display including a liquid crystal display or an organic EL (Electro-Luminescence) display. In this embodiment, the display unit 216 is disposed in front of the driver of the vehicle on the dashboard, instrument panel, center console, or the like. The display unit 216 displays an image based on a video signal output from the display control unit 119 of the control device 100. The display unit 216 displays an image captured by the first camera 210 or an image recorded in the recording unit 212.

<Playback control device (drive recorder control device)>
The control device 100 is an arithmetic processing device (control device) configured with, for example, a CPU (Central Processing Unit) and the like. The control device 100 loads a stored program into a memory and executes instructions included in the program. The control device 100 includes an internal memory (not shown), which is used for temporary storage of data in the control device 100. The control device 100 includes an image data acquisition unit 111, a buffer memory 112, an image data processing unit 113, a gaze detection unit 114, an operation control unit 116, an event detection unit 117, a position information acquisition unit 118, a display control unit 119, a storage unit 120, a playback control unit 121, and a recording control unit 122.

The image acquisition unit 200 acquires the captured video image. In this embodiment, the image acquisition unit 200 is composed of a first camera 210, a capture data acquisition unit 111, a buffer memory 112, a capture data processing unit 113, and a recording unit 212.

The image capture data acquisition unit 111 controls the first camera 210 and the second camera 211 used in the vehicle, and acquires image capture data captured by the first camera 210 and the second camera 211. The image capture data acquisition unit 111 outputs the image capture data acquired from the first camera 210 to the buffer memory 112.

The buffer memory 112 is an internal memory provided in the control device 100, and is a memory that temporarily records, while updating, a certain period of shooting data acquired by the shooting data acquisition unit 111.

The shooting data processing unit 113 generates shooting files for each predetermined time from the shooting data. The shooting data processing unit 113 converts the shooting data temporarily stored in the buffer memory 112 into an arbitrary file format, such as MP4 format, encoded with an arbitrary codec such as H.264 or MPEG-4 (Moving Picture Experts Group). The shooting data processing unit 113 generates shooting files for a certain period of time from the shooting data temporarily stored in the buffer memory 112. As a specific example, the shooting data processing unit 113 generates shooting files for 60 seconds of shooting data in the order of recording from the shooting data temporarily stored in the buffer memory 112. The shooting data processing unit 113 outputs the generated shooting files to the recording control unit 122. In addition, the shooting data processing unit 113 outputs the generated shooting files to the display control unit 119 after decoding the images through the playback control unit 121. The period of the generated shooting files is set to 60 seconds as an example, but is not limited to this. The shooting data referred to here may be data that includes audio in addition to the video captured by the first camera 210.

The gaze detection unit 114 detects the gaze direction of a person from the image captured by the second camera 211, which captures the direction facing the display screen of the display unit 216. The gaze detection unit 114 recognizes the user's face from the shooting data captured by the second camera 211 and acquired by the shooting data acquisition unit 111, and detects the gaze direction from the detected eye image. The user is a person who is viewing the display screen of the display unit 216. In the playback device 10, the user may be limited to the driver of the vehicle. In the playback device 10, the user may be passengers, including passengers, in addition to the driver.

In this embodiment, the gaze detection unit 114 detects which range of the display screen of the display unit 216 the person's gaze is directed towards. More specifically, the gaze detection unit 114 detects the range on the display screen of the display unit 216 where the person's gaze is concentrated. For example, the gaze detection unit 114 detects a state where the person's gaze direction fluctuates little and the person is looking at a range centered on one point on the display screen as the gaze being concentrated on a certain range of the display screen of the display unit 216. For example, when the person is gazing at an object of interest on the display screen, the gaze is likely to be concentrated on a certain range of the display screen. For example, the gaze detection unit 114 detects a state where the person's gaze direction fluctuates a lot and the person is looking at the entire display screen as the gaze not being concentrated on a certain range of the display screen of the display unit 216. For example, when checking the entire display screen rather than a specific object on the display screen, the gaze is not concentrated on a certain range of the display screen.

The operation control unit 116 acquires operation information of the operation accepted by the operation unit 213. For example, the operation control unit 116 acquires playback operation information indicating a playback operation or erase operation information indicating an erase operation, and outputs a control signal. For example, the operation control unit 116 acquires end operation information indicating an operation to end continuous recording, and outputs a control signal.

The event detection unit 117 detects an event based on the acceleration applied to the vehicle. More specifically, the event detection unit 117 detects an event based on the detection result of the acceleration sensor 214. If the acceleration information acquired by the event detection unit 117 from the acceleration sensor 214 is equal to or greater than a threshold value, the event detection unit 117 detects that an event has occurred.

The location information acquisition unit 118 acquires location information indicating the current location of the vehicle. The location information acquisition unit 118 calculates the location information of the current location of the vehicle using a known method based on the GNSS signal received by the GNSS receiving unit 215.

The display control unit 119 controls the display on the display unit 216. The display control unit 119 causes the display unit 216 to display the continuous recording data or event recording data, which is the moving image played back by the playback control unit 121. The display control unit 119 outputs a video signal that causes the continuous recording data or event recording data to be output to the display unit 216. More specifically, the display control unit 119 outputs a video signal that displays the video captured by the first camera 210, or the continuous recording data or event recording data recorded in the recording unit 212 by playing back the data.

The storage unit 120 is an internal memory that stores data and other information necessary for processing in the control device 100.

The playback control unit 121 controls the playback of the video captured by the first camera 210, and the continuous recording data or event recording data recorded in the recording unit 212, based on a playback operation control signal output from the operation control unit 116. The playback control unit 121 includes a decoder (not shown), and plays back various types of data by decoding the compressed data supplied to it.

The playback control unit 121 changes the playback method of the video depending on whether the gaze detected by the gaze detection unit 114 is concentrated on a certain range of the display screen of the display unit 216. More specifically, the playback control unit 121 changes the playback speed of the video depending on whether the gaze detected by the gaze detection unit 114 is concentrated on a certain range of the display screen of the display unit 216.

In this embodiment, when the gaze detected by the gaze detection unit 114 is concentrated on a certain range of the display screen of the display unit 216, the playback control unit 121 performs playback at a slower speed than when the gaze detected by the gaze detection unit 114 is not concentrated on a certain range of the display screen of the display unit 216.

In this embodiment, the playback control unit 121 performs slow playback or pause when the gaze detected by the gaze detection unit 114 is concentrated on a certain range of the display screen of the display unit 216, and performs playback at normal speed when the gaze detected by the gaze detection unit 114 is not concentrated on a certain range of the display screen of the display unit 216.

When pausing, the playback control unit 121 may cancel the pause when the user cancels the pause operation, or may only stop the playback for a period of time, such as three seconds.

The recording control unit 122 records the shooting data acquired by the shooting data acquisition unit 111. In the embodiment, the recording control unit 122 controls the recording unit 212 to record the shooting files filed by the shooting data processing unit 113. During the period when the continuous recording process is being performed, such as when the vehicle accessory power is ON, the recording control unit 122 records the shooting files filed by the shooting data processing unit 113 in the recording unit 212 as overwritable shooting files. More specifically, during the period when the continuous recording process is being performed, the recording control unit 122 continues to record the shooting files generated by the shooting data processing unit 113 in the recording unit 212, and when the capacity of the recording unit 212 becomes full, it overwrites the oldest shooting file with a new shooting file and records it.

When an event is detected by the event detection unit 117, the recording control unit 122 saves event recording data, which is the shooting data corresponding to the detection of the event. Event recording data is a shooting file of a predetermined period in the shooting file generated by the shooting data processing unit 113. The recording control unit 122 saves the shooting file corresponding to the detection of the event in the recording unit 212 as event recording data that is prohibited from being overwritten. When an event is detected by the event detection unit 117, the recording control unit 122 copies the shooting file of a predetermined period, for example, about 10 seconds before and after the time the event is detected, from the buffer memory 112 and saves it as event recording data.

<Playback device (electronic device)>
A case where the playback device 30 is an electronic device such as a personal computer or a smartphone that plays back a file captured by a drive recorder will be described with reference to Fig. 2. Fig. 2 is a block diagram showing another example of the configuration of the playback device 30 having the control device 400 according to the first embodiment. The playback device 30 shown in Fig. 2 plays back a file captured in an external system.

The playback device 30 may be a device that is installed in a vehicle, which is an example of a moving object, or may be a portable device that can be used in a vehicle. The playback device 30 has a camera 310, an interface unit (hereinafter referred to as "I/F") 311, an operation unit 312, a display unit 313, and a control device 400.

Camera 310 is a camera provided around the display screen of display unit 313. Camera 310 captures images in the direction opposite to the display screen of display unit 313. Camera 310 is configured in the same manner as second camera 211 of playback device 10 shown in FIG. 1.

I/F311 is an interface for acquiring captured files from an external system. In this embodiment, I/F311 is an interface for acquiring captured files from a drive recorder. I/F311 is, for example, a communication function such as Wi-Fi (registered trademark) for communicating with the drive recorder, or a memory card reader.

The operation unit 312 is, for example, a touch panel provided on the display unit 313. The operation unit 312 is configured similarly to the operation unit 213 of the playback device 10 shown in FIG. 1. The operation unit 312 outputs operation information to the operation control unit 413 of the control device 400.

The display unit 313 is, for example, a display device specific to the playback device 30. The display unit 313 is configured in the same manner as the display unit 216 shown in FIG. 1.

<Playback control device (control device for electronic device)>
The control device 400 is, for example, an arithmetic processing device configured with a CPU or the like. The control device 400 loads a stored program into memory and executes instructions included in the program. The control device 400 includes an internal memory (not shown), which is used for temporary storage of data in the control device 400, etc. The control device 400 includes an image acquisition unit 411, a gaze detection unit 412, an operation control unit 413, a playback control unit 418, and a display control unit 419.

The image acquisition unit 411 acquires a shooting file based on shooting data captured by an external system. It acquires a shooting file based on shooting data captured by a camera (not shown) installed in the vehicle. In this embodiment, the image acquisition unit 411 acquires a shooting file based on shooting data captured by the first camera 210 of the drive recorder.

The gaze detection unit 412 detects the user's gaze from the image data captured by the camera 310. The gaze detection unit 412 has the same function as the gaze detection unit 114 of the playback device 10 shown in FIG. 1.

The operation control unit 413 acquires operation information of the operation accepted by the operation unit 312. The operation control unit 413 has the same function as the operation control unit 116 of the playback device 10 shown in FIG. 1.

The playback control unit 418 controls the image acquisition unit 411 to play back the captured file acquired based on the playback operation control signal output from the operation control unit 413. The playback control unit 418 has the same function as the playback control unit 121 of the playback device 10 shown in FIG. 1.

The display control unit 419 controls the display on the display unit 313. The display control unit 419 has the same functions as the display control unit 119 of the playback device 10 shown in FIG. 1.

<Information processing in the playback control device>
Next, the flow of the playback process will be described with reference to Fig. 3. As an example, the playback process in the control device 100 of the playback device 10 will be described. Fig. 3 is a flowchart showing an example of the flow of the playback process in the control device 100 according to the first embodiment. The playback process is similar in the control device 400 of the playback device 30. During the playback process, the second camera 211 captures an image so that the user's gaze can be detected. Then, the gaze detection unit 114 detects the person's gaze.

The process in FIG. 3 is premised on the fact that the photographic data to be played back has been selected in the playback device 10 or the playback device 30, and a playback instruction has been issued for the selected photographic data. The photographic data to be played back may be either continuous recording data or event recording data.

The control device 100 starts playing back the captured image data (step S101). More specifically, the control device 100 outputs a control signal for the playback operation from the playback operation information indicating the playback operation on the operation unit 213, via the operation control unit 116. The control device 100 proceeds to step S102.

The control device 100 plays back at normal speed (step S102). More specifically, the control device 100 plays back the continuous recorded data or event recorded data at normal speed using the playback control unit 121. The control device 100 causes the display control unit 119 to display video based on the played back continuous recorded data or event recorded data on the display unit 216 during the period when the continuous recorded data or event recorded data is being played back by the playback control unit 121, in other words, during the period from the start of playback to the end of playback. The control device 100 proceeds to step S103.

The control device 100 determines whether the gaze is concentrated (step S103). More specifically, the control device 100 detects, using the gaze detection unit 114, a state in which there is little fluctuation in the person's gaze direction and the person is looking at a single point on the display screen as the gaze being concentrated on a certain range of the display screen on the display unit 216. If the control device 100 determines from the detection result of the gaze detection unit 114 that the gaze is concentrated (Yes in step S103), it proceeds to step S104. If the control device 100 does not determine from the detection result of the gaze detection unit 114 that the gaze is concentrated (No in step S103), it proceeds to step S108.

If it is determined that the gaze is concentrated (Yes in step S103), the control device 100 performs slow playback or pauses (step S104). More specifically, the control device 100 causes the playback control unit 121 to perform slow playback or pause of the continuous recording data or event recording data that began playback in step S101. Slow playback refers to playback slower than the normal playback speed, for example playback at 0.5 times speed. Slow playback also includes frame-by-frame playback. Pausing refers to playback being temporarily stopped, and the frame image at the time of the pause in the moving image is displayed in a still state. The control device 100 proceeds to step S105.

The control device 100 determines whether the state of concentrated gaze continues (step S105). If the control device 100 determines from the detection result of the gaze detection unit 114 that the state of concentrated gaze of the person continues (Yes in step S105), it proceeds to step S106. If the control device 100 does not determine from the detection result of the gaze detection unit 114 that the state of concentrated gaze of the person continues (No in step S105), it proceeds to step S107.

If it is determined that the gaze is still concentrated (Yes in step S105), the control device 100 determines whether or not to end playback (step S106). For example, the control device 100 determines to end playback when the vehicle's power or motive power is turned off, or when the operation unit 213 is operated. If the control device 100 determines to end playback (Yes in step S106), it ends this process. If the control device 100 does not determine to end playback (No in step S106), it executes the process of step S105 again.

If it is not determined that the state of focused gaze continues (No in step S105), playback is performed at normal speed (step S107). More specifically, the control device 100 causes the playback control unit 121 to play back at normal speed the continuous recording data or event recording data that was played back in slow motion or paused in step S104. The control device 100 proceeds to step S108.

The control device 100 determines whether or not to end regeneration (step S108). For example, the control device 100 determines to end regeneration when the vehicle's power or motive power is turned off, or when the operation unit 213 is operated. If the control device 100 determines to end regeneration (Yes in step S108), it ends this process. If the control device 100 does not determine to end regeneration (No in step S108), it executes the process of step S103 again.

When this process ends, playback of the continuous recording data or event recording data will end.

In this way, the control device 100 changes the way the video is played back depending on whether the person's line of sight is focused on a certain area of the display screen of the display unit 216.

＜Effects＞
As described above, in this embodiment, the method of playing back moving images can be changed depending on whether or not the person's line of sight is focused on a certain range on the display screen of the display unit 216 .

In this embodiment, when a person's gaze is focused on a certain range of the display screen on the display unit 216, playback is performed at a slower speed than when the gaze is not focused on a certain range of the display screen. According to this embodiment, when the gaze is focused on a certain range of the display screen, the playback speed is slowed down, making it easier to check the moving image.

In this embodiment, when a person's gaze is focused on a certain area of the display screen of the display unit 216, slow playback or pausing is performed, and when the gaze is not focused on a certain area of the display screen, normal speed playback is performed. According to this embodiment, when the gaze is focused on a certain area of the display screen, slow playback or pausing is performed, making it easier to check the moving image.

In this way, according to this embodiment, it is easy to play back and check the video within the range in which the desired scene is expected to be captured. According to this embodiment, it is easy to detect the scene from the video.

[Second embodiment]
The playback device according to this embodiment will be described with reference to FIG. 4. The playback device 10 is a drive recorder. When the playback device is an electronic device, the playback device 30 is equipped with similar functions. FIG. 4 is a flowchart showing an example of the flow of playback processing in a control device according to a second embodiment. The playback device 10 has a basic configuration similar to that of the playback device 10 of the first embodiment. In the following description, the same or corresponding reference symbols are used for components similar to those in the first embodiment, and detailed description thereof will be omitted. The same applies to the following embodiments. In this embodiment, the processing in the playback control unit 121 is different from that in the first embodiment.

When the gaze detected by gaze detection unit 114 is not concentrated on a certain range of the display screen of display unit 216, playback control unit 121 performs playback at a faster speed than when the gaze detected by gaze detection unit 114 is concentrated on a certain range of the display screen of display unit 216. For example, when the gaze is not concentrated on the display screen, there is a high possibility that a video other than the video the user particularly wants to check is being displayed. In such a case, the playback speed is increased so that the video the user wants to check can be checked more quickly.

When the gaze detected by the gaze detection unit 114 is not concentrated in a certain range on the display screen of the display unit 216, the playback control unit 121 performs fast-forward playback or skip playback, and when the gaze detected by the gaze detection unit 114 is concentrated in a certain range on the display screen of the display unit 216, playback at normal speed.

Next, the flow of the playback process will be described with reference to FIG. 4. As an example, the playback process in the control device 100 of the playback device 10 will be described. The playback process is similar in the control device 400 of the playback device 30. The processes in steps S111 to S113 and steps S115 to S118 shown in FIG. 4 are the same as those in steps S101 to S103 and steps S105 to S108 in the flowchart shown in FIG. 3.

If it is not determined that the gaze is concentrated (Yes in step S113), the control device 100 performs fast-forward playback (step S114). More specifically, the control device 100 causes the playback control unit 121 to perform fast-forward playback or skip playback of the continuous recording data or event recording data that began playback in step S111. Fast-forward playback means playback faster than the normal playback speed, for example, playback at 2.0 times speed. Skip playback means playback while skipping forward in units of, for example, 0.5 seconds to 1 second. The control device 100 proceeds to step S115.

＜Effects＞
As described above, in this embodiment, when the person's line of sight is not focused on a certain range of the display screen of the display unit 216, playback can be performed at a faster speed than when the line of sight is focused on a certain range of the display screen. According to this embodiment, when the person's line of sight is not focused on a certain range of the display screen, the playback speed is increased, and the moving image can be checked efficiently.

In this embodiment, when the person's line of sight is not focused on a certain range of the display screen of the display unit 216, fast-forward playback or skip playback is performed, and when the person's line of sight is focused on a certain range of the display screen, normal speed playback is performed. According to this embodiment, the video can be checked efficiently.

[Third embodiment]
The playback device according to this embodiment will be described with reference to Figures 5 to 7. Figure 5 is a block diagram showing an example of the configuration of a playback device having a control device according to a third embodiment. Figure 6 is a flowchart showing an example of the flow of a recording process in the control device according to the third embodiment. Figure 7 is a flowchart showing an example of the flow of a playback process in the control device according to the third embodiment. In this embodiment, the playback device changes the playback method of the moving image depending on whether there is little variation in the line of sight of a person when the moving image is captured.

<Playback device (drive recorder)>
The playback device 10 has a basic configuration similar to that of the playback device 10 of the first embodiment.

<Playback control device (drive recorder control device)>
The control device 100 has a basic configuration similar to that of the control device 100 of the first embodiment.

The image acquisition unit 200 acquires information on the captured video and the detected gaze direction of the person when the video was captured. In this embodiment, the image acquisition unit 200 is composed of a first camera 210, a capture data acquisition unit 111, a buffer memory 112, a capture data processing unit 113, a recording unit 212, a second camera 211, and a gaze detection unit 114.

Information that detects a person's gaze direction is at least one of information that indicates the person's gaze direction and information that indicates changes in the person's gaze direction.

The gaze detection unit 114 detects at least one of information indicating the gaze direction of a person and information indicating changes in the gaze direction of a person.

The recording control unit 122 records information detecting the gaze direction of the person when the video was captured in the recording unit 212 in association with the captured video. More specifically, the recording control unit 122 records information detecting the gaze direction of the person when the video was captured based on the detection result of the gaze detection unit 114 in association with the captured video in the recording unit 212.

The recording control unit 122 stores information indicating the gaze direction of a passenger, such as a driver of a vehicle, together with the captured video, when the passenger gazes at an object such as a facility, person, or other vehicle while the vehicle is traveling, in other words, while a video is being captured. The recording control unit 122 stores information indicating that there is little fluctuation in the gaze direction of a passenger, such as a driver of a vehicle, together with the captured video, when the passenger gazes at an object while the video is being captured.

The playback control unit 121 changes the playback method of the video depending on whether there is little fluctuation in the gaze direction of the person when the video was captured. In other words, the playback control unit 121 changes the playback method of the video depending on whether there is little fluctuation in the gaze direction of the person in the video being played back. More specifically, the playback control unit 121 changes the playback speed of the video and plays it back depending on whether there is little fluctuation in the gaze direction of the person, based on information that detects the gaze direction of the person stored together with the video.

When a vehicle driver is driving, he or she visually checks in various directions to ensure safety. "When there is little change in gaze direction" refers, for example, to a state in which the driver's gaze is mainly directed in the direction of travel and the main change in gaze direction is to ensure safety. For example, when the vehicle is driving, the driver's gaze is mainly directed in the direction of travel, and even if the driver turns his or her gaze in a direction other than the direction of travel, it is for less than one second. "When there is a lot of change in gaze direction" refers, for example, when the vehicle is driving and the driver's gaze goes from being mainly directed in the direction of travel to turning to the right or left of the direction of travel multiple times in succession, for example, twice within one second or more or two seconds.

For example, if there are multiple passengers in a vehicle, and all of the passengers (e.g., about two people) or a specified percentage or more (two or more people when four people are on board) look in the same direction at almost the same time, it may be determined that there is a lot of variation in the gaze direction of the vehicle's passengers. Determining this based on the gaze of all passengers may be limited to cases where there are a small number of passengers, for example, about two people. A specified percentage or more may be, for example, more than half of the passengers.

In this embodiment, when there is little variation in the gaze direction of a person during the capture period of the video, the playback control unit 121 plays back the video at a faster speed than when there is a lot of variation in the gaze direction. When there is little variation in the gaze direction of a person during playback of the video, the playback control unit 121 plays back the video at a faster speed than when there is a lot of variation in the gaze direction.

In this embodiment, the playback control unit 121 fast-forwards or skips the video when there is little change in the person's gaze direction during the video capture period, and plays the video at normal speed when there is a lot of change in the person's gaze direction. The playback control unit 121 fast-forwards or skips the video when there is little change in the person's gaze direction during playback of the video, and plays the video at normal speed when there is a lot of change in the person's gaze direction. For example, the playback control unit 121 may perform fast-forward playback at double speed during periods when there is little gaze change. For example, the playback control unit 121 may perform skip playback during periods when there is little gaze change, in other words, during the period when the gaze change decreases and increases. The timing when the playback control unit 121 cancels fast-forward playback or skip playback and starts playback at normal speed may be the point when the gaze change decreases and then increases. It is preferable that the timing is changed to a certain time before the point when the gaze change decreases and then increases.

<Playback device (electronic device)>
5, the playback device 30A includes an I/F 311, an operation unit 312, a display unit 313, and a control device 400A. The I/F 311, the operation unit 312, and the display unit 313 are configured in the same manner as in the first embodiment.

<Playback control device (control device for electronic device)>
The control device 400A has an image acquisition unit 411, an operation control unit 413, a playback control unit 418, and a display control unit 419. The operation control unit 413 and the display control unit 419 are configured similarly to the first embodiment. The playback control unit 418 is configured similarly to the playback control unit 121 of the playback device 10 of this embodiment.

The image acquisition unit 411 acquires information on the direction of a person's gaze when the video was captured, along with the captured video, from an external system such as a drive recorder.

<Information processing in the playback control device>
Next, the flow of the recording process in the control device 100 will be described with reference to Fig. 6. While the reproducing device 10 is operating, the process of the flowchart shown in Fig. 6 is executed.

When the process of FIG. 6 starts, the control device 100 starts gaze detection, event detection, and normal recording (step S201), and while the process of FIG. 6 is being executed, in other words, while the playback device 10 is operating, the control device 100 continues gaze detection by the gaze detection unit 114, event detection by the event detection unit 117, and normal recording by the recording control unit 122. The control device 100 proceeds to step S202.

The control device 100 determines whether or not an event has been detected (step S202). More specifically, the control device 100 detects that an event has occurred when the acceleration information acquired from the acceleration sensor 214 by the event detection unit 117 is equal to or greater than a threshold value. If the control device 100 determines that an event has been detected (Yes in step S202), it proceeds to step S203. If the control device 100 does not determine that an event has been detected (No in step S202), it proceeds to step S204.

If it is determined that an event has been detected (Yes in step S202), the control device 100 executes an event recording process (step S203). The control device 100 proceeds to step S204.

In the event recording process in step S203, the control device 100 causes the recording control unit 122 to store the captured video data as event data in the recording unit 212 while prohibiting overwriting. The event data is captured data that includes the time before and after the event detection point.

If it is not determined that an event has been detected (No in step S202), the control device 100 proceeds to step S204 while continuing normal recording processing.

In normal recording processing, the control device 100 causes the recording control unit 122 to store the captured image data in the recording unit 212 as an overwritable normal file.

The control device 100 determines whether or not to end the recording process (step S204). For example, the control device 100 determines to end the process when the vehicle's power or motive power is turned off or the operation unit 213 is operated. If the control device 100 determines to end the process (Yes in step S204), it ends this process. If the control device 100 does not determine to end the process (No in step S204), it proceeds to step S202. In other words, gaze detection, event detection, and normal recording continue. By performing such processing, the control device 100 generates and records shooting data that includes information on the detected gaze direction.

Next, the playback process will be described with reference to FIG. 7. As an example, the playback process in the control device 100 of the playback device 10 will be described. The playback process is similar in the control device 400A of the playback device 30A. The processes in steps S211, S212, and S216 to S218 shown in FIG. 7 are the same as those in steps S101, S102, and S106 to S108 in the flowchart shown in FIG. 3.

The control device 100 determines whether there is little gaze change (step S213). More specifically, the control device 100 detects that there is little change in the person's gaze direction based on information detecting the person's gaze direction that is stored in association with the video being played back. If the control device 100 determines that there is little gaze change (Yes in step S213), it proceeds to step S214. If the control device 100 does not determine that there is little gaze change (No in step S213), it proceeds to step S218.

If it is determined that there is little eye movement (Yes in step S213), the control device 100 performs fast-forward playback or skip playback (step S214). More specifically, the control device 100 performs fast-forward playback or skip playback of the continuous recorded data or event recorded data by the playback control unit 121. The control device 100 causes the display control unit 119 to display the continuous recorded data or event recorded data that has been fast-forward played by the playback control unit 121 on the display unit 216. The control device 100 proceeds to step S215.

The control device 100 determines whether the state of minimal gaze movement continues (step S215). More specifically, the control device 100 determines whether the state of minimal gaze movement continues based on information detecting the gaze direction of the person stored in association with the video being played back. If the control device 100 determines that the state of minimal gaze movement continues (Yes in step S215), it proceeds to step S216. If the control device 100 does not determine that the state of minimal gaze movement continues (No in step S215), it proceeds to step S217.

In this way, the control device 100 changes the playback method of the video depending on whether there is little fluctuation in the person's line of sight when the video is captured.

＜Effects＞
As described above, in this embodiment, the playback method of the moving image can be changed depending on whether there is little change in the line of sight of the person when the moving image is captured.

According to this embodiment, when there is little fluctuation in the gaze direction of a person when the video is being captured, the video can be played back at a faster speed than when there is a lot of fluctuation in the gaze direction. According to this embodiment, when there is little fluctuation in the gaze direction when the video is being captured, the video can be played back at a faster speed, allowing the video to be checked efficiently.

In this embodiment, when there is little variation in the gaze direction of a person when the video is shot, the video can be played back in fast forward or in skip playback, and when there is a lot of variation in the gaze direction, the video can be played back at normal speed. According to this embodiment, when there is little variation in the gaze direction when the video is shot, the video can be played back in fast forward or in skip playback, allowing the video to be checked efficiently. According to this embodiment, when there is a lot of variation in the gaze direction when the video is shot, the playback speed can be slowed down to make the video easier to check.

In this way, according to this embodiment, it is easy to play back and check the video within the range in which the desired scene is expected to be captured. According to this embodiment, it is easy to detect the scene from the video.

[Fourth embodiment]
The playback device 10 according to this embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the flow of playback processing in a control device according to the fourth embodiment. The playback device 10 has a basic configuration similar to that of the playback device 10 of the third embodiment. A case where the playback device is a drive recorder will be described. When the playback device is an electronic device, the same functions are implemented in the playback device 30A.

The playback control unit 121 plays the video at normal speed when there is little fluctuation in the person's gaze direction when the video is captured, and plays the video in slow motion or pauses it when there is a lot of fluctuation in the person's gaze direction. More specifically, based on information detecting the person's gaze direction stored together with the video, the playback control unit 121 plays the video at normal speed when there is little fluctuation in the gaze direction, and plays the video in slow motion or pauses it when there is a lot of fluctuation in the person's gaze direction.

When pausing, the playback control unit 121 may cancel the pause when the user cancels the pause operation, or may only stop the playback for a period of time, such as three seconds.

Next, the playback process will be described with reference to FIG. 8. As an example, the playback process in the control device 100 of the playback device 10 will be described. The playback process is similar in the control device 400 of the playback device 30. The processes in steps S221, S222, and S226 to S228 shown in FIG. 8 are the same as those in steps S211, S212, and S216 to S218 in the flowchart shown in FIG. 7.

The control device 100 determines whether there is a lot of gaze change (step S223). More specifically, the control device 100 detects that there is a lot of change in the person's gaze direction based on information detecting the person's gaze direction that is stored in association with the video being played back. If the control device 100 determines that there is a lot of gaze change (Yes in step S223), it proceeds to step S224. If the control device 100 does not determine that there is a lot of gaze change (No in step S223), it proceeds to step S228.

If it is determined that there is a lot of eye movement (Yes in step S223), the control device 100 plays back in slow motion or pauses (step S224). More specifically, the control device 100 plays back or pauses the continuous recorded data or event recorded data in slow motion using the playback control unit 121. The control device 100 causes the display control unit 119 to display on the display unit 216 the continuous recorded data or event recorded data that has been played back in fast forward by the playback control unit 121. The control device 100 proceeds to step S225.

The control device 100 determines whether the state of frequent gaze changes continues (step S225). More specifically, the control device 100 determines whether the state of frequent gaze changes continues based on information detecting the gaze direction of the person stored in association with the video being played back. If the control device 100 determines that the state of frequent gaze changes continues (Yes in step S225), it proceeds to step S226. If the control device 100 does not determine that the state of frequent gaze changes continues (No in step S225), it proceeds to step S227.

＜Effects＞
As described above, in this embodiment, when the fluctuation of the gaze direction of the person during shooting of the moving image is small, the moving image is played back at normal speed, and when the fluctuation of the gaze direction is large, the moving image can be played back in slow motion or paused. According to this embodiment, when the fluctuation of the gaze direction of the person during shooting of the moving image is large, the playback speed can be slowed down to make the moving image easier to check.

[Fifth embodiment]
The playback device 30A according to the present embodiment will be described with reference to Figs. 9 and 10. Fig. 9 is a diagram illustrating the range on the display screen where the gaze is concentrated. Fig. 10 is a flowchart showing an example of the flow of playback processing in the control device according to the fifth embodiment. In this embodiment, the playback device changes the playback method of the moving image based on the range on which the gaze of the person is concentrated during shooting and the gaze direction with respect to the display unit 216.

<Playback device (drive recorder)>
The playback device 10 has a basic configuration similar to that of the playback device 10 of the first and third embodiments. The playback device 10 changes a playback method for a moving image based on the range in which a person's gaze is concentrated when the moving image is captured and the gaze direction with respect to the display unit 216.

<Playback control device (drive recorder control device)>
The control device 100 has a basic configuration similar to that of the control device 100 of the first and third embodiments. The photographed data acquisition unit 111, the buffer memory 112, the photographed data processing unit 113, the operation control unit 116, the event detection unit 117, the position information acquisition unit 118, the display control unit 119, and the storage unit 120 are similar to those of the first embodiment. The image acquisition unit 200, the gaze detection unit 114, and the recording control unit 122 are similar to those of the third embodiment.

The playback control unit 121 changes the playback method of the video based on the range in which the gaze of the person in the video being played is concentrated and the gaze direction detected by the gaze detection unit 114 with respect to the display unit 216. More specifically, the playback control unit 121 changes the playback method of the video based on the information on the detected gaze direction of the person stored together with the video and the gaze direction detected by the gaze detection unit 114 with respect to the display unit 216, in accordance with the range in which the gaze of the person in the video being played is concentrated and the gaze direction of the user who is the viewer of the video.

In this embodiment, when the range in which the gaze of a person in the video being played back coincides with the gaze direction detected by gaze detection unit 114 relative to display unit 216, playback control unit 121 plays the video at a slower speed than when they do not coincide. More specifically, based on information on the detected gaze direction of the person stored together with the video and the gaze direction detected by gaze detection unit 114 relative to display unit 216, when the range in which the gaze of a person in the video being played back coincides with the gaze direction detected by gaze detection unit 114 relative to display unit 216, playback control unit 121 plays the video at a slower speed than when they do not coincide.

In this embodiment, when the range in which the gaze of the person in the video being played matches the gaze direction detected by gaze detection unit 114 relative to display unit 216, the playback control unit 121 plays the video at normal speed, and when they do not match, plays the video at fast forward. More specifically, based on information on the detected gaze direction of the person stored together with the video and the gaze direction detected by gaze detection unit 114 relative to display unit 216, when the range in which the gaze of the person in the video being played matches the gaze direction detected by gaze detection unit 114 relative to display unit 216, the playback control unit 121 plays the video at normal speed, and when they do not match, plays the video at fast forward.

As shown in FIG. 9, for example, the display screen 216a of the display unit 216 on which the video is displayed is virtually divided into three sections, such as a left section, a center section, and a right section. Vertical division is not required. The number of sections is not limited. The displayed video is an image from the first camera 210 facing forward of the vehicle. In the video being played back, the range in which the gaze is concentrated on the display screen 216a of the display unit 216 is indicated by A. For example, when the gaze direction detected by the gaze detection unit 114 during playback of the video matches range A, the playback control unit 121 plays the video at normal speed, and when it does not match, plays the video in fast forward.

When a video is being played back, if the gaze direction detected by the gaze detection unit 114, in other words, the gaze direction of the user who is the viewer of the video, indicates a tendency to gaze to the right, it is determined that there is a match if the gaze information of the person associated with the video indicates that the person is gazing to the right of the vehicle's traveling direction. The direction in which the person is gazing does not need to be an exact angle, and can be determined to be forward, to the left, to the right, etc.

<Playback device (electronic device)>
The playback device 30 is similar to the playback device 30 in the first embodiment.

<Playback control device (control device for electronic device)>
The control device 400 is similar to the control device 400 of the first and third embodiments. The gaze detection unit 412, the operation control unit 413, and the display control unit 419 are configured similarly to the first embodiment. The image acquisition unit 411 is configured similarly to the third embodiment. The playback control unit 418 is configured similarly to the playback control unit 121 of the playback device 10 of this embodiment.

<Information processing in the playback control device>
Next, the flow of processing in the control device will be described with reference to Fig. 10. As an example, the playback processing in the control device 100 of the playback device 10 will be described. The playback processing is similar in the control device 400 of the playback device 30. The processing in steps S301, S302, and S306 shown in Fig. 10 is the same as that in steps S101, S102, and S108 of the flowchart shown in Fig. 3.

The control device 100 determines whether the gaze directions match (step S303). More specifically, the control device 100 detects whether the range in which the person's gaze is concentrated in the video being played back matches the gaze direction detected by the gaze detection unit 114 for the display unit 216. If the control device 100 determines that the gaze directions match (Yes in step S303), it proceeds to step S304. If the control device 100 does not determine that the gaze directions match (No in step S303), it proceeds to step S305.

If it is determined that the line of sight directions match (Yes in step S303), the control device 100 performs normal speed playback or continues normal speed playback (step S304). More specifically, the control device 100 performs normal speed playback or continues normal speed playback of the continuous recording data or event recording data through the playback control unit 121. In the process of step S304, if the process has progressed from step S302 via Yes in step S303, playback at normal speed is continued for the continuous recording data or event recording data being played at normal speed. In the process of step S304, if the process has progressed from step S305 via No in step S306 and Yes in step S303, playback of the continuous recording data or event recording data being played at fast forward is changed to playback at normal speed. The control device 100 proceeds to step S306.

If it is not determined that the line of sight directions match (No in step S303), the control device 100 performs fast-forward playback (step S305). More specifically, the control device 100 performs fast-forward playback of the continuous recording data or the event recording data by the playback control unit 121. The control device 100 proceeds to step S306.

In this way, the control device 100 changes the playback method of the video image based on the area in which the gaze of the passengers in the vehicle is concentrated and the direction of their gaze toward the display unit 216.

＜Effects＞
As described above, in this embodiment, the playback method of a moving image can be changed based on the range in which a person's gaze is concentrated in the moving image being played back and the gaze direction detected by gaze detection unit 114 relative to display unit 216.

According to this embodiment, when the range in which a person's gaze is concentrated in the video being played back matches the gaze direction detected by gaze detection unit 114 relative to display unit 216, the video can be played back at a slower speed than when they do not match. According to this embodiment, when the range in which a person's gaze is concentrated in the video being played back matches the gaze direction detected by gaze detection unit 114, the playback speed can be slowed down to make the video easier to view.

According to this embodiment, when the range in which the person's gaze is concentrated in the video being played back matches the gaze direction detected by gaze detection unit 114 relative to display unit 216, the video can be played back at normal speed, and when they do not match, the video can be played back in fast forward. According to this embodiment, when the range in which the person's gaze is concentrated in the video being played back matches the gaze direction detected by gaze detection unit 114, the video can be played back at a fast speed, allowing the video to be checked efficiently.

[Sixth embodiment]
The playback device 10 according to this embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing an example of the flow of playback processing in a control device according to the sixth embodiment. The playback device 10 has a basic configuration similar to that of the playback device 10 of the first embodiment. A case where the playback device is a drive recorder will be described. When the playback device is an electronic device, the playback device 30 is equipped with similar functions.

When the range in which the gaze of a person in the video being played back coincides with the gaze direction detected by the gaze detection unit 114 relative to the display unit 216, the playback control unit 121 plays back the video in slow motion or pauses it, and when they do not coincide, plays back the video at normal speed.

Next, the flow of processing in the control device 100 will be described with reference to FIG. 11. As an example, the playback processing in the control device 100 of the playback device 10 will be described. The playback processing is also equivalent in the control device 400 of the playback device 30. The processing in steps S311, S312, and S316 shown in FIG. 11 is the same as that in steps S101, S102, and S108 in the flowchart shown in FIG. 3. The processing in step S312 shown in FIG. 11 is the same as that in step S302 in FIG. 10.

If it is determined that the line of sight directions match (Yes in step S313), the control device 100 performs slow playback or pauses (step S314). More specifically, the control device 100 performs slow playback or pauses the continuous recording data or event recording data using the playback control unit 121. The control device 100 proceeds to step S316.

If it is not determined that the line of sight directions match (No in step S313), the control device 100 continues normal speed playback or normal speed playback (step S315). More specifically, the control device 100 uses the playback control unit 121 to perform normal speed playback or continue normal speed playback of the continuous recording data or event recording data. In the process of step S315, if the process has progressed from step S312 via No in step S313, playback at normal speed of the continuous recording data or event recording data being played at normal speed is continued. In the process of step S315, if the process has progressed from step S314 via No in step S316 and No in step S313, playback of the continuous recording data or event recording data being played back in slow motion or paused is changed to playback at normal speed.

＜Effects＞
As described above, according to this embodiment, when the range in which the gaze of a person in the moving image being played matches the gaze direction detected by the gaze detection unit 114 with respect to the display unit 216, the moving image can be played back in slow motion or paused, and when they do not match, the moving image can be played back at normal speed. According to this embodiment, when the range in which the gaze of a person in the moving image being played matches the gaze direction detected by the gaze detection unit 114, the moving image can be played back in slow motion or paused to make it easier to check the moving image.

The playback device according to the present disclosure may be implemented in various different forms other than the above-mentioned embodiment.

Each component of the illustrated playback device is a functional concept, and does not necessarily have to be physically configured as illustrated. In other words, the specific form of each device is not limited to that shown in the figure, and all or part of it may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

The configuration of the playback device is realized, for example, as software, by a program loaded into memory. In the above embodiment, these functional blocks are described as being realized by the cooperation of hardware or software. In other words, these functional blocks can be realized in various forms, by hardware alone, software alone, or a combination of both.

The above-mentioned components include those that a person skilled in the art would easily imagine and those that are substantially the same. Furthermore, the above-mentioned configurations can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the configurations are possible without departing from the spirit of the present invention.

The playback device and playback method disclosed herein can be used, for example, in so-called drive recorders, or electronic devices such as personal computers or smartphones.

10 Playback device 100 Control device (playback control device)
REFERENCE SIGNS LIST 111 Shooting data acquisition unit 112 Buffer memory 113 Shooting data processing unit 114 Gaze detection unit 116 Operation control unit 117 Event detection unit 118 Position information acquisition unit 119 Display control unit 120 Storage unit 121 Playback control unit 122 Recording control unit 200 Image acquisition unit 210 First camera 211 Second camera 212 Recording unit 213 Operation unit 214 Acceleration sensor 215 GNSS receiving unit 216 Display unit

Claims (9)

1. an image acquisition unit for acquiring a captured video image;
   a playback control unit that plays the moving image acquired by the image acquisition unit;
   a display control unit that causes the moving image reproduced by the reproduction control unit to be displayed on a display unit;
   Equipped with
   the reproduction control unit changes a reproduction method of the moving image depending on a line of sight state corresponding to the moving image acquired by the image acquisition unit.
   Playback device.
2. a gaze detection unit that detects a gaze direction of a person from an image captured by a camera that captures a direction facing a display screen of the display unit;
   Further equipped with
   the playback control unit changes a playback method of the video depending on whether the line of sight detected by the line of sight detection unit is concentrated in a certain range on the display screen.
   The playback device according to claim 1 .
3. when the line of sight detected by the line of sight detection unit is concentrated in a certain range on the display screen of the display unit, the reproduction control unit performs reproduction at a slower speed than when the line of sight detected by the line of sight detection unit is not concentrated in the certain range on the display screen of the display unit.
   The playback device according to claim 2.
4. when the line of sight detected by the line of sight detection unit is not concentrated in a certain range on the display screen of the display unit, the reproduction control unit performs reproduction at a faster speed than when the line of sight detected by the line of sight detection unit is concentrated in a certain range on the display screen of the display unit.
   The playback device according to claim 2.
5. The image acquisition unit further acquires information detecting a line of sight direction of a person when the moving image is captured,
   the reproduction control unit changes a reproduction method of the moving image depending on whether or not there is little variation in the line of sight of the person.
   The playback device according to claim 1 .
6. the reproduction control unit reproduces the moving image at a faster speed when the person's line of sight is fluctuating little, than when the person's line of sight is fluctuating much.
   The playback device according to claim 5.
7. a gaze detection unit that detects a gaze direction of a person from an image captured by a camera that captures a direction facing a display screen of the display unit;
   Further equipped with
   The image acquisition unit further acquires information detecting a line of sight direction of a person when the moving image is captured,
   the playback control unit changes a playback method of the moving image based on a range in which the person's gaze is concentrated in the moving image being played back and a gaze direction detected by the gaze detection unit with respect to the display unit.
   The playback device according to claim 1 .
8. when a range in which the gaze of the person in the moving image being played back coincides with a gaze direction detected by the gaze detection unit with respect to the display unit, the playback control unit plays back the moving image at a slower speed than when the range does not coincide with the gaze direction.
   The playback device according to claim 7.
9. acquiring a captured video image;
   A step of playing back the captured video image;
   displaying the reproduced moving image on a display unit;
   changing a playback method of the moving image according to a line of sight state corresponding to the moving image;
   A playback method executed by a playback device.

Images