JP7609803B2 - Signal processing device, image display device, and signal processing method - Google Patents

Description

The present disclosure relates to a signal processing device, an image display device, and a signal processing method.

In image display devices such as television receivers, controls such as frame control and image quality control are performed to display high-quality images. In recent years, in addition to image control, a wide variety of functions have been added, such as connecting to the Internet, and the number of signal paths that image display devices must support has become enormous. As the processing of image display devices has become more diverse and complex, the software that realizes these controls and functions has become increasingly important.

To output images without distortion, it is necessary to ensure that processing of the input image is completed before processing related to image output is performed. For this reason, processing related to image output is set to start a fixed time after the start timing of processing of the input image, and the length of this fixed time is determined assuming the case where processing of the input image is delayed to the maximum.

JP 2008-252585 A

In recent years, as the processing performed by software has become more diverse and complex, the processing time for input images has become longer and the length of fixed times has also tended to become longer.

However, the responsiveness of image display devices is also becoming important. For example, when game images are displayed, emphasis is placed on responsiveness to game operations. Also, emphasis is placed on responsiveness from when an instruction to perform a function is given to the time that instruction is actually carried out. In other words, the longer the fixed time, the more responsiveness is lost, and the lower the evaluation of the image display device will be.

The present disclosure provides a signal processing device and the like that achieves both high image quality and responsiveness.

A signal processing device according to one aspect of the present disclosure includes a first processing unit, an image signal storage unit, a second processing unit, a detection unit, and a determination unit. The first processing unit performs a first processing on an image signal. The image signal storage unit stores the image signal on which the first processing has been performed. The second processing unit performs a second processing including at least a process of reading out the image signal stored in the image signal storage unit. The detection unit detects the end of the first processing. The determination unit determines whether or not to advance the scheduled start timing of the second processing based on at least the end timing of the first processing. Furthermore, if it is determined that the advance should be performed, the second processing unit starts the second processing before the scheduled start timing.

The signal processing device may be configured such that the planned start timing of the second processing is separated from the planned start timing of the first processing by a predetermined fixed time, and if the second processing unit determines not to implement the advance, the second processing unit starts the second processing at the planned start timing of the second processing.

The signal processing device may be configured to further include a calculation unit that calculates the length of the differential time from the end timing of the first processing to the scheduled start timing of the second processing, and the determination unit determines whether or not to implement the advance based on the length of the differential time.

The signal processing device may be configured such that the detection unit detects the end of the first processing and the start of the second processing and notifies the determination unit, and when a predetermined time has elapsed between receiving a notification of the end of the first processing and receiving a notification of the start of the second processing, the determination unit decides to advance the scheduled start timing of the second processing.

The signal processing device may be configured to further include a calculation unit that calculates the length of time required from the start timing of the first processing to the end timing of the first processing, the detection unit detects the start and end of the first processing and notifies the calculation unit, and the determination unit determines whether or not to advance the scheduled start timing of the second processing based on the required time.

The signal processing device may be configured such that the detection unit detects the start and end of the first processing and notifies the determination unit, and if the determination unit receives a notification of the end of the first processing before a predetermined time has elapsed since receiving the notification of the start of the first processing, the determination unit decides to advance the scheduled start timing of the second processing.

The signal processing device may be configured to further include a timing determination unit that determines a start timing of the second processing, and the second processing unit starts the second processing at the determined start timing.

The signal processing device may be configured such that the timing determination unit determines the start timing of the second processing between the timing when a predetermined time has elapsed from the scheduled start timing of the first processing and the scheduled start timing of the second processing.

The signal processing device may be configured to further include an information detection unit that detects image signal information from the image signal used when displaying an image based on the image signal, and the judgment unit determines whether or not to advance the scheduled start timing of the second processing based further on the image signal information.

The signal processing device may be configured to further include a user interface unit that generates or receives operation information regarding operations performed on the signal processing device, and the determination unit determines whether or not to advance the scheduled start timing of the second processing based on the operation information.

The signal processing device may be configured such that, when the processing time of the current cycle of the first processing is longer than the processing time of the previous cycle of the first processing, and a predetermined condition is satisfied, the timing determination unit sets the scheduled start timing of the current cycle of the second processing to be the same as the scheduled start timing of the previous cycle of the second processing.

The signal processing device may be configured so that it further includes a third processing unit that performs a third processing including at least a process of reading out the image signal stored from the image signal storage unit after the second processing, the detection unit detects the end of the second processing, the determination unit determines whether or not to advance the scheduled start timing of the third processing based on at least the end timing of the second processing, and the third processing unit starts the third processing before the scheduled start timing of the third processing when it is determined to advance the scheduled start timing of the third processing.

In another aspect of the present disclosure,
a first processing unit that performs a first processing on the image signal;
an image signal storage unit that stores the image signal that has been subjected to the first processing;
a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit;
a display unit that displays the image signal that has been subjected to the second processing;
A detection unit that detects the end of the first process;
a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process;
Equipped with
The image display device is configured such that, when it is decided to advance the execution of the image display device, the second processing unit starts the second process earlier than the scheduled start timing.

In another aspect of the present disclosure,
detecting an end of a first processing performed on the image signal;
a step of determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has ended; and a step of starting the second process prior to the scheduled start timing when it is determined that the second process should be advanced.
A signal processing method is provided, comprising:

FIG. 1 is a block diagram showing a configuration example of an image display device according to an embodiment of the present disclosure. FIG. 4 is a diagram for explaining start timings of an input task and an output task. 11A and 11B are diagrams for explaining the advancement of the scheduled start timing of an output task. 11 is a diagram showing an example of the transition of the end timing of an input task and the start timing of an output task. 11 is a flowchart of an example of adjusting the start timing of an output task. FIG. 13 is a diagram for explaining the advancement of the scheduled start timing of an output task when an interrupt output is required.

Below, an embodiment of the present disclosure is described with reference to the drawings.

Figure 1 is a block diagram showing an example configuration of an image display device according to an embodiment of the present disclosure. The image display device 100 of Figure 1 includes a UI (user interface) unit 110, an input processing unit (first processing unit) 120, an image signal storage unit 130, an output processing unit (second processing unit) 140, a control unit 150, and a synchronization signal generation unit 160. The input processing unit 120 includes an image signal receiving unit 121, an information detection unit 122, and a pre-processing unit 123. The output processing unit 140 includes an image processing unit 141 and a display unit 142. The control unit 150 includes a detection unit 151, a calculation unit 152, a determination unit 153, and a timing determination unit 154.

Note that the embodiments of the present disclosure may include components or functions that are not shown or described. The following description does not exclude components or functions that are not shown or described. For example, it is conceivable that the image display device 100 may include a first storage unit that stores information that should be permanently retained by the image display device 100, such as selectable image quality settings, and a second storage unit that temporarily stores information input to the image display device 100.

The image display device 100 is a device that performs image processing on an image represented by an input image signal and displays the processed image. For example, the image display device 100 is realized by a television receiver that receives broadcast waves from various broadcast stations and displays an image. Also, for example, the image display device 100 is realized by a computer that receives an image signal from a communication network and displays an image, such as a personal computer, tablet, or smartphone.

In this disclosure, the term "image" is a concept that encompasses both still images and moving images. Therefore, "image" in this disclosure may be replaced with still images or moving images, provided there is no particular problem. In other words, the image displayed on the image display device 100 may be either a moving image or a still image. The concept of "video" is also included in "image." The image displayed on the image display device 100 may be an image that can give the viewer a three-dimensional impression, such as a stereoscopic image or a 3D image.

In this disclosure, it is assumed that, as a general aspect, the image display device 100 displays an image. However, a series of processes of the image display device 100 of the present disclosure may be distributed and performed among multiple devices. For example, a series of processes on an image signal may be performed on a personal computer, but the image may ultimately be displayed on a display device such as a monitor. In this way, the image display device 100 may be divided into a device that processes images and a device that displays images. In such a case, the image display device 100 corresponds to a system that includes both a computer that processes images and a monitor that displays images.

In addition, the image display device 100 and the device for processing the above-mentioned images can be said to be signal processing devices from the viewpoint of processing signals related to images, and can be said to be image processing devices from the viewpoint of performing processing such as alteration on images.

The UI unit 110 is a user interface that generates information regarding operations performed on the image display device 100. The generated information is output to the control unit 150. This information is referred to as operation information.

The UI unit 110 is realized by operation members such as a keyboard, buttons, dials, and a touch panel. Operation information is generated when these operation members are operated by a user of the image display device 100.

Alternatively, the UI unit 110 may not generate operation information, but may simply receive operation information from an operation member. For example, a receiver that receives a wireless signal including operation information from an operation member that is separate from the image display device 100, such as a wireless keyboard or a remote controller, may also be included in the UI unit 110.

For example, multiple image quality settings may be preregistered in the image display device 100, and the user may select a desired image quality setting via the UI unit 110. In this case, the desired image quality setting corresponds to the operation information. Alternatively, which of multiple buttons provided in the UI unit 110 has been pressed corresponds to the operation information, and the desired image quality setting may be determined by the control unit 150 based on the operation information and the display screen.

The input processing unit (first processing unit) 120 processes the input image signal and writes it to the image signal storage unit 130. An example of components included in the input processing unit 120 is described below.

The image signal receiving unit 121 receives an image signal. For example, the image signal receiving unit 121 is realized by a tuner of a television receiver. The image signal receiving unit 121 may receive the image signal via either a wired line or a wireless line. An image generating unit (not shown) may be present within the image display device 100, and the image signal receiving unit 121 may receive an image signal related to an image generated by the image generating unit. In other words, the transmission source of the image signal may be inside the image display device 100 or outside the image display device 100.

The information detection unit 122 detects image information related to the image signal received by the image signal receiving unit 121 from the image signal. For example, the image signal may contain information about a format such as 4K broadcasting or 8K broadcasting, and the image display device 100 may change the image quality setting to a suitable format. In addition, the image signal may contain information about an optimal frame rate, and the writing and reading of the image signal to the image signal storage unit 130 may be adjusted to the frame rate. Information detected from the image signal is described as image signal information. In this manner, it is assumed that the image signal information is various information. In this disclosure, the image signal information is sent to the control unit 150, and the control unit 150 or a component instructed by the control unit 150 performs processing based on the image signal information. However, the image signal information may be sent directly from the information detection unit 122 to a component that performs processing based on the image signal information.

The pre-processing unit 123 processes the image signal and then writes the processed image signal to the image signal storage unit 130. The processing performed by the pre-processing unit 123 is for implementing the processing of the image processing unit 141, and is performed before the processing of the image processing unit 141. Therefore, this processing is referred to as pre-processing. Note that the pre-processing unit 123 may receive the image signal directly from the image signal receiving unit 121, or may receive it via the information detection unit 122, etc.

In order to output an image without disturbance, processing such as writing an image signal by the input processing unit 120 must be completed before processing such as reading an image signal by the output processing unit 140 begins. In this way, processing by the input processing unit 120 that needs to be coordinated with processing related to image output is defined as an input task (first processing). Note that input tasks are not necessarily performed only by the input processing unit 120, and some are performed by the control unit 150. Note that it is assumed that there are multiple input tasks, and when there are multiple input tasks, the multiple input tasks are collectively defined as an input task (first processing). Each of the combined input tasks will be described as a part of the input task.

The tasks included in the input task vary depending on the situation. For example, if the image signal information indicates that the image format has been changed, a task related to the changed format will be performed. The time required for the input task also varies depending on the situation. For example, if the image quality setting is set to display images in high quality, the processing time for each task will be longer than if the normal image quality setting is set.

The image signal storage unit 130 is a memory that holds (captures) the image signal that has been preprocessed by the preprocessing unit 123 on a frame-by-frame basis. The image signal storage unit 130 is generally referred to as a frame memory, a frame buffer, or a VRAM (Video Random Access Memory), but is not limited to these. The image signal held in the image signal storage unit 130 is read out by the output processing unit 140.

The output processing unit (second processing unit) 140 reads out the image signal from the image signal storage unit 130, processes the read-out image signal, and then displays the image. An example of components included in the output processing unit 140 is described below.

The image processing unit 141 reads out the image signal stored in the image signal storage unit 130 and performs various processes on the image signal. Examples of image processing performed by the image processing unit 141 include I/P (Interlace/Progressive) conversion, zoom display processing, cropping, colorimetry processing, and image quality control processing. In addition, a type of image processing, namely, superimposition processing, may be performed in which an OSD (On Screen Display) image is superimposed on the image signal that has been subjected to image processing.

The display unit 142 displays an image corresponding to the image signal from the image processing unit 141. The display unit 142 is realized, for example, by a display panel. The input image is displayed at the timing when the image signal is input from the image processing unit 141 to the display unit 142, although there is a processing delay in the display unit 142.

In order to output an image without distortion, processing such as reading an image signal by the output processing unit 140 must begin after processing such as writing an image signal by the input processing unit 120 is completed. In this way, the processing of the output processing unit 140 that needs to be coordinated with the processing on the input image is defined as an output task (second processing). Note that output tasks are not necessarily performed only by the output processing unit 140, and some are performed by the control unit 150. Note that when there are multiple output tasks, the multiple output tasks are collectively defined as an output task (second processing). Each of the combined output tasks will be described as a part of the output task. In this case, the processing to read the image signal is at least included in the output task.

The output task is started at a timing based on a signal such as a vertical synchronization signal (V _sync ). In other words, the start timing of the output task is specified by a signal such as a vertical synchronization signal (V _sync ). The start timing of the output task is separated from the scheduled start timing of the input task by a predetermined fixed time. In other words, the scheduled start timing of the output task is set to a timing when a fixed time has elapsed from the scheduled start timing of the input task. This fixed time is referred to as a fixed delay. The length of the fixed delay is appropriately determined taking into consideration the specifications of the image display device 100, the contents of the input task, etc.

Figure 2 is a diagram explaining the start timing of an input task and an output task. Blocks A, B, and C are each task within the input task. As shown in Figure 2, the input task is executed periodically every time a period equivalent to one frame has elapsed. Blocks D and E are each task within the output task. Like the input task, the output task is also executed periodically. The period between the scheduled start timing of the input task and the scheduled start timing of the output task within the same period corresponds to a fixed delay.

Note that in Figure 2, each task within the input task and output task is the same in the next cycle (next frame), but this is not necessarily the case. For example, in a stable state where there will be no switching of image quality settings for some time, only tasks that are performed periodically are performed, so it is possible that the tasks are the same as in Figure 2. For example, immediately after switching image quality settings, a temporary task related to the switch is performed, so the tasks may be different.

Tasks within an input task vary depending on the situation, and the end timing of an input task is not necessarily the same for each cycle. For this reason, a fixed delay is set long enough to ensure that the end timing of an input task does not occur after the start timing of an output task. This allows images to be output without distortion. On the other hand, responsiveness is reduced because the output task does not start until the fixed delay has elapsed.

The control unit 150 performs various controls on the other components of the image display device 100. As one of these controls, the control unit 150 determines whether to advance the scheduled start timing of an output task. Advancing the scheduled start timing of an output task means that the output task is performed before its scheduled start timing. Advancing the start timing improves the responsiveness of the image display device 100. The components for performing the control related to the advance are described below.

The detection unit 151 monitors input tasks and detects the end of the input tasks. If necessary, it may also detect the start of an input task. If necessary, it may also monitor output tasks and detect the start or end of an output task.

When the image display device 100 is implemented by a computer, for example, the monitoring of input tasks and output tasks can be implemented by using the functions of the OS running on the computer. Furthermore, detection of the start or end of a task can be implemented using a general method. For example, the detection may be performed based on a specific event when a task starts or ends, or based on the creation or disappearance of a process on the OS that corresponds to the task being monitored.

Note that the process in which the detection unit 151 detects the end of the input task also corresponds to a task within the input task. Therefore, the timing for detecting the end of the input task actually occurs before the end of the input task. For example, the detection task is performed in parallel with other tasks or periodically, and the end of a task other than the detection task (the end of task C in Figure 2) is detected. Then, after the detection is notified to the determination unit 153, etc., the task for detection ends, and the input task ends.

The calculation unit 152 calculates the length of the differential time from the detected end timing of the input task to the scheduled start timing of the output task. The scheduled start timing of the output task may be that detected by the detection unit 151. Alternatively, the length of the fixed delay or the end timing of the input task, which is determined in advance, may be calculated.

The calculation unit 152 may also calculate the time from the scheduled start timing of the input task to the detected end timing of the input task, i.e., the required time for the input task.

The judgment unit 153 judges whether or not to advance the scheduled start timing of the output task. This judgment is made based at least on the end timing of the input task.

For example, the judgment unit 153 may determine whether to advance the time based on the length of the differential time. For example, if the length of the differential time is equal to or greater than a threshold, it may decide to advance the time. Alternatively, the judgment unit 153 may make a judgment based on the time required for the input task. If the time required for the input task is equal to or less than a threshold, it may decide that the length of the differential time is sufficient and decide to advance the time. Because the length of the differential time and the required time are calculated based on the end timing of the input task, a judgment based on the length of the differential time or the required time can also be said to be a judgment based on the end timing of the input task.

The determination unit 153 may also receive a notification of the end of an input task and a notification of the start of an output task from the detection unit 151. If a predetermined time has elapsed between receiving the notification of the end of the input task and receiving the notification of the start of the output task, the determination unit 153 may determine that the difference in time is sufficiently long and may decide to advance the task. In this case, the calculation unit 152 may be omitted because the processing result of the calculation unit 152 is not used.

In addition, the determination unit 153 may determine whether or not to advance the time based on at least one of the operation information from the UI unit 110 and the image signal information from the image signal receiving unit 121. For example, when the determination unit 153 receives an instruction to change the settings from the operation information or the image signal information, the determination unit 153 may determine that the time required for the input task will increase due to the setting change and determine not to advance the time. Alternatively, a rule may be set in advance that when setting change A is performed, the time advance is not performed, but when setting change B is performed, the time advance may be performed. In addition, when multiple tasks occur, a predetermined value may be added for each of the multiple tasks, and when the sum of the values exceeds a threshold value, it may be determined that the tasks are not to be performed.

Figure 3 is a diagram explaining the advancement of the scheduled start timing of an output task. The length of the differential time is determined by the detection unit 151 detecting the end of the input task. The length of the differential time is the maximum length of time that can be advanced. However, it is possible that an unexpected task occurs in the input task, causing the end of the input task to be delayed more than expected. Therefore, in practice, it is preferable to provide a margin and make the length of time related to the advancement, that is, the length from the start timing of the output task to the scheduled start timing of the output task, shorter than the length of the differential time.

When it is determined that the task is to be brought forward, the timing determination unit 154 determines the start timing of the output task. When it is determined that the task is to be brought forward, the length of time related to the forwarding may be changed as appropriate. For example, the time that can be brought forward may be determined to be a time that is shorter than the difference time by a predetermined margin. That is, the time when a predetermined margin has passed from the expected end timing of the input task may be determined as the start timing of the output task. In FIG. 3, the output task is brought forward to the time when a predetermined margin has passed from the expected end timing of the input task. Note that the thick black line on the start timing of the output task represents the output interrupt processing. Since the output task is registered and executed at the timing of the output interrupt, the timing of the output interrupt is also brought forward in the same way as the output task. Therefore, as described above, it is preferable to make the length from the start timing of the output task to the scheduled start timing of the output task shorter than the length of the difference time, but more precisely, it is preferable to make the length from the start timing of the output task to the interruption of the output task shorter than the length of the difference time. Alternatively, the task may be brought forward by a predetermined fixed time. Furthermore, the timing determination section 154 may adjust the length of time related to the advancement based on at least one of the operation information and the image signal information.

Alternatively, the length of time to advance may be determined based on past advancement records. For example, if advancement was performed in the previous cycle, the advance time in the current cycle may be shorter than the previous time, and the advance time may vary from cycle to cycle. Also, if the input task in the current cycle is the same as the input task in the previous cycle, or if the required time for the input task in the current cycle is the same as the required time for the input task in the previous cycle, the length of advancement in the current cycle may be set to the same as the length of advancement in the previous cycle. The start timing of the output task is determined according to the advance time determined in this way.

Figure 4 shows an example of the transition between the end timing of an input task and the start timing of an output task. The horizontal axis shows the frame (period) number, and the vertical axis shows the elapsed time from the start timing of the input task. The dotted line graph shows the end timing of the input task. The solid line graph shows the start timing of the output task.

At the origin of Figure 4, various processes are started, and the end timing of the input task is initially slow, but as the number of tasks gradually decreases, the end timing of the input task is advanced. In other words, the graph of the end timing of the input task is initially large but gradually becomes smaller. The start timing of the output task also gradually becomes earlier due to the advancement. Then, during the stable period in Figure 4, the output task is started a predetermined margin α later than the end timing of the input task. Note that here, only registers with settings changes are controlled, and unnecessary tasks are not generated.

In addition, even if the end timing of the input timing is delayed from the previous cycle, if it is sudden or sufficiently small compared to the margin, the length of the advance may remain the same as the previous cycle. For example, in the stable period shown in FIG. 4, there is a frame in which the end timing of the input task rises for a moment, but the start timing of the corresponding output task remains the same as the previous frame. In this way, even if the required time of the current cycle of the input task is extended more than the required time of the previous cycle of the input task, the timing determination unit may make the scheduled start timing of the current cycle of the output task the same as the scheduled start timing of the previous cycle of the output task when a predetermined condition is satisfied. The predetermined condition may be, for example, the difference time of the current cycle, or the processing time of the current cycle of the input task is equal to or less than a predetermined threshold. Alternatively, the difference between the difference time of the current cycle and the previous cycle, or the difference between the required time of the current cycle and the previous cycle of the input task may be equal to or less than a predetermined threshold.

The synchronization signal generating unit 160 generates a signal indicating the start timing of the output task determined by the timing determining unit 154, and transmits it to the output processing unit 140. This allows the output processing unit 140 to recognize the start timing of the output task whether or not an advance is implemented. In other words, if it is determined that an advance is to be implemented, the output processing unit 140 can start the output task before the scheduled start timing of the output task. Also, if it is determined that an advance is not to be implemented, the output processing unit 140 can start the output task at the scheduled start timing of the output task.

Next, the flow of processing by each component will be described. Figure 5 is a flowchart of an example of adjusting the start timing of an output task. Here, a case is shown in which the scheduled start timing is determined based on the differential time.

The detection unit 151 detects the end of the input task (S101). After that, the detection unit 151 detects the start of the output task (S102). In response to these detections, the calculation unit 152 calculates the differential time (S103).

Meanwhile, the control unit 150 receives operation information from the UI unit 110 (S104) and image signal information from the information detection unit 122 (S105). Then, the determination unit 153 determines whether or not to advance the schedule based on the difference time, the operation information, the image signal information, etc. (S106).

If it is determined that the task should be brought forward (YES in S107), the timing determination unit 154 determines the task start timing to be earlier than the scheduled start timing (S108). If it is determined that the task should not be brought forward (NO in S107), the timing determination unit 154 determines the task start timing to be the original scheduled start timing (S109).

The synchronization signal generating unit 160 generates a synchronization signal indicating the determined task start timing (S110). The synchronization signal is sent to the output processing unit 140, and the output processing unit 140 starts the output task based on the synchronization signal (S111). In this manner, the start timing of the output task is adjusted.

Note that this flowchart is an example, and the advance processing does not necessarily have to be performed according to this flow. For example, in cases where the advance is determined not based on the differential time, the processing of S103 may be omitted. In addition, in cases where the judgment unit 153 does not use operation information or image signal information, the processing of S104 or S105 may be omitted. In addition, although not shown, the processing results of each process may be stored sequentially in another storage unit different from the image signal storage unit 130, and each component may acquire the processing results via that storage unit.

It is also possible that there may be further interrupt outputs. Figure 6 is a diagram explaining the advancement of the scheduled start timing of the output task when there is a further interrupt output. Hereinafter, the further interrupt output will simply be referred to as an interrupt output, and the output in Figure 3 will be referred to as a normal output. The interrupt output is performed before the normal output. Therefore, the timing when a first fixed delay has elapsed from the scheduled start timing of the input task is defined as the scheduled start timing of the output task related to the interrupt output. In addition, the timing when a second fixed delay has elapsed from the scheduled start timing of the output task related to the interrupt output is defined as the scheduled start timing of the normal output task. Hereinafter, the output task related to the interrupt output will be described as an interrupt output task.

The output of the interrupt may be processed by the output processing unit 140. Alternatively, although not shown, the image display device 100 may be provided with an interrupt output processing unit (third processing unit) that outputs the interrupt, separate from the output processing unit 140.

The advancement of an interrupt output task is the same as when the interrupt output task is considered to be a normal output task in Figure 3. On the other hand, the advancement of a normal output task is the same as when the interrupt output task is considered to be an input task. Therefore, when there is an interrupt output, the detection unit 151 of the control unit 150 also monitors the tasks of the output processing unit 140 or the interrupt output processing unit. Note that the advancement of an interrupt output task and the advancement of an output task are carried out independently, and it is not necessary for the implementation of advancement and the length of advancement to be the same.

As described above, according to this embodiment, the image display device 100, which is capable of performing various processes using software, can output high-quality images without distortion and can improve responsiveness.

Furthermore, performing complex processing to determine the start timing of processing related to image output places an additional burden on the software, which is undesirable, but the image display device 100 of the present disclosure can also determine the start timing of an output task without placing a burden on the software. For example, when calculating the differential time, the end timing of the input task and the start timing of the output task are detected, and these processes can be performed simply by using the functions of the OS running on the computer that realizes the image display device 100. For example, there is no need for complex processing such as monitoring the image signal line by line and detecting lines on which writing has not been completed. Therefore, the image display device 100 of the present disclosure is also superior in terms of the load on the image display device 100.

The processing of the device in the embodiment of the present disclosure can be realized by software (programs) executed by a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), etc. Note that, instead of executing all the processing of the device by software, some of the processing may be executed by hardware such as a dedicated circuit.

Note that the above-described embodiment shows one example for realizing the present disclosure, and the present disclosure can be implemented in various other forms. For example, various modifications, substitutions, omissions, or combinations thereof are possible without departing from the gist of the present disclosure. Forms in which such modifications, substitutions, omissions, etc. have been made are also included in the scope of the invention and its equivalents as set forth in the claims, just as they are included in the scope of the present disclosure.

The processing steps described in the above embodiments may be considered as a method having a series of steps. Alternatively, they may be considered as a program for causing a computer to execute the series of steps, or as a recording medium for storing the program. The type of recording medium is not particularly limited, as it does not affect the embodiments of the present disclosure.

The present disclosure can also be configured as follows.
[1]
a first processing unit that performs a first processing on the image signal;
an image signal storage unit that stores the image signal that has been subjected to the first processing;
a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit;
A detection unit that detects the end of the first process;
a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process;
Equipped with
the second processing unit starts the second process earlier than the scheduled start timing when it is determined that the process is to be brought forward.
[2]
the scheduled start timing of the second process is separated from the scheduled start timing of the first process by a predetermined fixed time,
The signal processing device according to the above-mentioned [1], wherein the second processing unit starts the second process at a scheduled start timing of the second process when it is determined not to advance the processing.
[3]
a calculation unit that calculates a difference in time from an end timing of the first process to a scheduled start timing of the second process,
The signal processing device according to the above-mentioned [1] or [2], wherein the determination unit determines whether or not to advance the execution of the signal processing based on the length of the difference time.
[4]
the detection unit detects the end of the first process and the start of the second process and notifies the calculation unit;
The signal processing device according to the above-mentioned [3], wherein the calculation unit calculates the length of the differential time based on a notification from the detection unit.
[5]
The detection unit detects the end of the first process and notifies the determination unit;
The signal processing device according to the above-mentioned [3], wherein the determination unit calculates the length of the difference time based on a detected end timing of the first process and a predetermined scheduled start timing of the second process.
[6]
the detection unit detects the end of the first process and the start of the second process and notifies the determination unit;
The signal processing device according to the above-mentioned [1] or [2], wherein the determination unit determines to advance the scheduled start timing of the second processing when a predetermined time has elapsed since receiving a notification of the end of the first processing or from the end timing of the first processing to receiving a notification of the start of the second processing.
[7]
a calculation unit that calculates a required time from a start timing of the first process to an end timing of the first process,
the detection unit detects the start and end of the first process and notifies the calculation unit;
The signal processing device according to the above-mentioned [1] or [2], wherein the determination unit determines whether or not to advance a scheduled start timing of the second process based on the required time.
[8]
the detection unit detects the start and end of the first process and notifies the determination unit;
The signal processing device according to the above-mentioned [1] or [2], wherein the determination unit determines to advance the scheduled start timing of the second processing when the determination unit receives a notification of the end of the first processing before a predetermined time has elapsed since receiving the notification of the start of the first processing.
[9]
A timing determination unit that determines a start timing of the second process,
The signal processing device according to any one of the above [1] to [8], wherein the second processing unit starts the second processing at a determined start timing.
[10]
The signal processing device according to [9], wherein the timing determination unit determines the start timing of the second processing between a timing when a predetermined time has elapsed from the scheduled start timing of the first processing and the scheduled start timing of the second processing.
[11]
A synchronization signal generating unit that generates a synchronization signal indicating the determined start timing,
The signal processing device according to any one of the above [9] and [10], wherein the second processing unit starts the second process or a task related to the second processing unit based on the synchronization signal.
[12]
an information detection unit that detects, from the image signal, image signal information used when displaying an image based on the image signal;
The signal processing device according to any one of the above [1] to [11], wherein the determination unit determines whether or not to advance the scheduled start timing of the second processing based further on the image signal information.
[13]
a user interface unit that generates or receives operation information related to an operation performed on the signal processing device,
The signal processing device according to any one of the above [1] to [12], wherein the determination unit determines whether or not to advance the scheduled start timing of the second process based further on the operation information.
[14]
The signal processing device described in any of [1] to [13] above, wherein when the processing time of a current cycle of the first processing is longer than the processing time of a previous cycle of the first processing, and a predetermined condition is satisfied, the timing determination unit sets the scheduled start timing of the current cycle of the second processing to be the same as the scheduled start timing of the previous cycle of the second processing.
[15]
a third processing unit that performs a third process including at least a process of reading out the image signal stored in the image signal storage unit after the second process,
The detection unit detects the end of the second process,
The determination unit determines whether or not to advance the scheduled start timing of the third process based on at least the end timing of the second process,
The signal processing device according to any one of [1] to [14] above, wherein the third processing unit starts the third processing earlier than the scheduled start timing of the third processing when it is decided to advance the scheduled start timing of the third processing.
[16]
a first processing unit that performs a first processing on the image signal;
an image signal storage unit that stores the image signal that has been subjected to the first processing;
a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit;
a display unit that displays the image signal that has been subjected to the second processing;
A detection unit that detects the end of the first process;
a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process;
Equipped with
the second processing unit starts the second process earlier than the scheduled start timing when it is decided to advance the start timing of the image display device.
[17]
detecting an end of a first processing performed on the image signal;
a step of determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has ended; and a step of starting the second process prior to the scheduled start timing when it is determined that the second process should be advanced.
A signal processing method comprising:

100 Image display device 110 UI unit 120 Input processing unit (first processing unit)
121 Image signal receiving unit 122 Information detection unit 123 Pre-processing unit 130 Image signal storage unit 140 Output processing unit (second processing unit)
141 Image processing unit 142 Display unit 150 Control unit 151 Detection unit 152 Calculation unit 153 Determination unit 154 Timing determination unit 160 Synchronization signal generation unit

Claims (19)

a first processing unit that performs a first processing on the image signal;
an image signal storage unit that stores the image signal that has been subjected to the first processing;
a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit;
A detection unit that detects the end of the first process;
a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process;
Equipped with
the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing;
the detection unit detects the end of the first process and the start of the second process and notifies the determination unit;
the determination unit determines to advance a scheduled start timing of the second process when a predetermined time has elapsed from when the determination unit receives a notification of the end of the first process to when the determination unit receives a notification of the start of the second process. a first processing unit that performs a first processing on the image signal;
an image signal storage unit that stores the image signal that has been subjected to the first processing;
a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit;
A detection unit that detects the end of the first process;
a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process;
Equipped with
the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing;
a calculation unit that calculates a required time from a start timing of the first process to an end timing of the first process,
the detection unit detects the start and end of the first process and notifies the calculation unit;
The signal processing device according to claim 1, wherein the determination unit determines whether or not to advance a scheduled start timing of the second process based on the required time. a first processing unit that performs a first processing on the image signal;
an image signal storage unit that stores the image signal that has been subjected to the first processing;
a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit;
A detection unit that detects the end of the first process;
a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process;
Equipped with
the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing;
the detection unit detects the start and end of the first process and notifies the determination unit;
when the determination unit receives a notification of the end of the first processing before a predetermined time has elapsed since receiving the notification of the start of the first processing, the determination unit determines to advance the scheduled start timing of the second processing. a first processing unit that performs a first processing on the image signal;
an image signal storage unit that stores the image signal that has been subjected to the first processing;
a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit;
A detection unit that detects the end of the first process;
a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process;
Equipped with
the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing;
A timing determination unit that determines a start timing of the second process,
The second processing unit starts the second process at the determined start timing;
the timing determination unit determines the start timing of the second processing between a timing when a predetermined time has elapsed from the scheduled start timing of the first processing and the scheduled start timing of the second processing. a first processing unit that performs a first processing on the image signal;
an image signal storage unit that stores the image signal that has been subjected to the first processing;
a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit;
A detection unit that detects the end of the first process;
a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process;
Equipped with
the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing;
an information detection unit that detects, from the image signal, image signal information used when displaying an image based on the image signal;
The signal processing device according to claim 1, wherein the determination unit determines whether or not to advance the scheduled start timing of the second processing based on the image signal information. 1. A signal processing device, comprising:
a first processing unit that performs a first processing on the image signal;
an image signal storage unit that stores the image signal that has been subjected to the first processing;
a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit;
A detection unit that detects the end of the first process;
a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process;
Equipped with
the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing;
a user interface unit that generates or receives operation information related to an operation performed on the signal processing device,
The signal processing device, wherein the determination unit determines whether or not to advance the scheduled start timing of the second process based further on the operation information. a first processing unit that performs a first processing on the image signal;
an image signal storage unit that stores the image signal that has been subjected to the first processing;
a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit;
A detection unit that detects the end of the first process;
a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process;
Equipped with
the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing;
A timing determination unit that determines a start timing of the second process,
The second processing unit starts the second process at the determined start timing;
The timing determination unit, when a processing time of a current cycle of the first processing is longer than a processing time of a previous cycle of the first processing, satisfies a predetermined condition, sets a scheduled start timing of the current cycle of the second processing to be the same as a scheduled start timing of the previous cycle of the second processing. a first processing unit that performs a first processing on the image signal;
an image signal storage unit that stores the image signal that has been subjected to the first processing;
a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit;
A detection unit that detects the end of the first process;
a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process;
Equipped with
the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing;
a third processing unit that performs a third process including at least a process of reading out the image signal stored in the image signal storage unit after the second process,
The detection unit detects the end of the second process,
The determination unit determines whether or not to advance the scheduled start timing of the third process based on at least the end timing of the second process,
the third processing unit starts the third processing earlier than the scheduled start timing of the third processing when it is determined to advance the scheduled start timing of the third processing. the scheduled start timing of the second process is separated from the scheduled start timing of the first process by a predetermined fixed time,
The signal processing device according to claim 1 , wherein the second processing unit starts the second process at a scheduled start timing of the second process when it is determined not to advance the start of the second process. a calculation unit that calculates a difference in time from an end timing of the first process to a scheduled start timing of the second process,
The signal processing device according to claim 1 , wherein the determination unit determines whether or not to advance the execution of the advance based on a length of the difference time. A signal processing device according to any one of claims 1 to 10;
a display unit that displays the image signal that has been subjected to the second processing;
An image display device comprising: detecting an end of a first processing performed on the image signal;
determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has ended;
When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing;
The signal processing device executes the above .
The detecting step detects an end of the first process and a start of the second process,
The signal processing method, in which the determining step determines to advance the scheduled start timing of the second process when a predetermined time has elapsed from when the end of the first process is detected to when the start of the second process is detected. detecting an end of a first processing performed on the image signal;
determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has ended;
When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing;
The signal processing device executes the above .
the detecting step detects the start and end of the first process;
The signal processing device further executes a step of calculating a length of time required from a start timing of the first process to an end timing of the first process;
The signal processing method, wherein the determining step determines whether or not to advance a scheduled start timing of the second process based on the required time. detecting an end of a first processing performed on the image signal;
determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has ended;
When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing;
The signal processing device executes the above .
the detecting step detects the start and end of the first process;
The signal processing method, wherein the determining step determines to advance the scheduled start timing of the second process when the end of the first process is detected before a predetermined time has elapsed since the start of the first process. detecting an end of a first processing performed on the image signal;
determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has ended;
When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing;
The signal processing device executes the above .
the signal processing device further executes a step of determining a start timing of the second process;
the starting step starts the second process at the determined start timing;
the step of determining the start timing determines the start timing of the second processing between a timing when a predetermined time has elapsed from the scheduled start timing of the first processing and the scheduled start timing of the second processing. detecting an end of a first processing performed on the image signal;
determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has ended;
When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing;
The signal processing device executes the above .
the signal processing device further executes a step of detecting, from the image signal, image signal information used when displaying an image based on the image signal;
The signal processing method, wherein the determining step determines whether or not to advance the scheduled start timing of the second process based further on the image signal information. detecting an end of a first processing performed on the image signal;
determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has ended;
When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing;
The signal processing device executes the above .
The signal processing method, wherein the determining step determines whether or not to advance the scheduled start timing of the second process, further based on operation information generated or received by a user interface unit that generates or receives the operation information. detecting an end of a first processing performed on the image signal;
determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has ended;
When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing;
The signal processing device executes the above .
the signal processing device further executes a step of determining a start timing of the second process;
The step of starting the second process includes starting the second process at a determined start timing;
The step of determining the start timing comprises making the scheduled start timing of the current cycle of the second processing the same as the scheduled start timing of the previous cycle of the second processing when a processing time of a current cycle of the first processing is longer than a processing time of a previous cycle of the first processing and a predetermined condition is satisfied. detecting an end of a first processing performed on the image signal;
determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has ended;
When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing;
The signal processing device executes the above .
a step of performing a third process including at least a process of reading out the stored image signal from the image signal storage unit after the second process,
the step of detecting detects an end of the second process,
The determining step determines whether or not to advance a scheduled start timing of the third process based on at least an end timing of the second process;
The signal processing method, wherein the step of performing the third process includes starting the third process before a scheduled start timing of the third process when it is decided to advance the scheduled start timing of the third process.

Images