JP6431301B2 - Movie processing apparatus, method, and computer program - Google Patents

Description

  The present application relates to a technique for wirelessly transmitting moving image data from a moving image output device having a function of outputting moving image data, which is moving image data, to a terminal device.

As an apparatus having a function of outputting moving image data, for example, there is a digital video camera. The video camera generates moving image data by shooting. Most video cameras record moving image data on a recording medium built into the video camera. In addition, a video camera is usually configured to output moving image data to an external device simultaneously with imaging or at an appropriate time after imaging.
By the way, when an external device is provided with a display, especially when the video camera does not have a display, a display (monitor) for the user to check a moving image captured by the video camera of the display of the external device. Is available as In addition, when an external device and a video camera are connected wirelessly, the video caused by the trouble of connecting the video camera and the external device with a cable, the annoyance of the cable itself, the length of the cable, etc. Since there is no restriction on the positional relationship between the camera and external devices, nothing is more convenient.
When the video camera is, for example, an endoscope camera, it is also possible to distribute the endoscope image to external devices each of which is held by a plurality of doctors.
The mobile terminals that are now very popular can be external devices as described above. The portable terminal includes a notebook personal computer, a smartphone, a tablet, and the like, but these are provided with a display, and most of them are equipped with a wireless LAN function.

As another example of the moving image output apparatus, there is a computer such as a notebook computer or a tablet. If an image displayed on a display of a notebook personal computer can be displayed on a display of a portable terminal such as another notebook personal computer, it is convenient in the following cases, for example.
For presentations at conferences, projectors have been used for a long time. When giving a presentation, the presenter projects a desired image on a screen or the like from a projector connected to a notebook computer or the like. The audience attending the conference listens to the presentation of the presenter while viewing the projected image. Here, it is convenient if the image displayed on the display of the notebook computer operated by the presenter can be displayed on the display of the portable terminal held by the audience. That way, paper handouts are no longer needed, and people far from the image projected by the projector have a hard time recognizing the image, especially if the image contains small letters. Nothing will happen. This is not only applied to presentations, but it is also possible to send desired information to visitors from a single notebook computer, etc. to visitors who watch theater, watch concerts, or watch sports. Application is also possible. Speaking of the mechanism as described above, it is like a “small scale, simplified television broadcasting system”, and if such a system can be realized, there is a possibility that a completely new demand can be generated.
The same situation exists when conducting a video conference. In a video conference, a plurality of conference halls are connected by a network such as the Internet, and images captured by a video camera at each venue are distributed and displayed on a large display arranged at each venue. At this time, the large displays arranged at each venue are often difficult to see for participants who are far away from the venue or participants with a bad angle. In such a case, if the same image as that displayed on the large display placed in the conference hall is displayed on the display of the portable terminal of each person (in this case, the large display is no longer May be unnecessary.), Very convenient.

Any of the above examples is a system that can be realized by sending moving image data over a wireless LAN from a moving image output device having a function of outputting moving image data to a terminal device including a display such as a portable terminal.
However, there are also restrictions on realizing such things.
That is, it is difficult to send general moving image data at the line speed of an existing wireless LAN. In order to solve this, there can be an approach of reducing the data amount of data to be transmitted by reducing the image quality, and an approach of reducing the data amount of data to be transmitted by reducing the frame rate of the moving image. In either case, transmission of moving image data is realized by reducing the quality of the moving image, but it is often not permitted to reduce the quality of the moving image.
The problem of video delay is a problem when trying to transmit without degrading the quality of the video. If the delay time of a moving image becomes large, it becomes almost unusable for medical purposes such as an endoscope, and the user may feel uncomfortable in other uses.

  The present invention is a technology capable of sending moving image data over a wireless LAN from a moving image output device to a terminal device equipped with a display such as a portable terminal, and in particular, a practical technology that suppresses problems due to delay time. The issue is to provide.

The present invention is a moving image processing apparatus that is used in combination with a moving image output apparatus that outputs moving image data, which is data of moving images including a large number of frame data, which is data of continuous frames.
The moving image processing apparatus includes a receiving unit that receives input of moving image data output from the moving image output apparatus, and a compression that is obtained by compressing data of each frame in the moving image data received by the receiving unit as digital data. Compression means for executing processing to convert data; and output means for sequentially outputting the compressed data generated by the compression means to a transmission apparatus including a transmission means for transmitting to the terminal device by communication via a wireless LAN, I have.
The moving image processing apparatus of the present invention is used in combination with a moving image output apparatus that outputs moving image data, which is moving image data including a large number of frame data, which is data of continuous frames. In other words, the video output device itself may or may not be able to output wireless LAN, but does not perform special processing as described below, so the video processing device is a video output device, It functions as a device that enters a terminal device and realizes communication via a wireless LAN from the moving image output device to the terminal device.
The provision of the video data from the video output device to the video processing device is wired in consideration of the transfer speed of the video data, and among the video output devices, the video data cannot be output by wire. Considering the fact that does not exist.
The moving image processing device includes receiving means for receiving input of moving image data output from the moving image output device, and is obtained by compressing the data of each frame in the moving image data received by the receiving means as digital data. A compressing unit is provided for executing processing for converting to compressed data. This moving image processing apparatus uses a compression technique to reduce the amount of data to be sent to the terminal device without reducing the image quality and the frame rate, thereby suppressing the delay of the moving image.
The compressed data is sent by the output means to the transmission apparatus provided with the transmission means for transmitting to the terminal apparatus by communication via the wireless LAN. The transmission means of the transmission device transmits the compressed data received from the moving image processing device to the terminal device. As a result, each terminal device can receive the compressed data with a small delay time, and reproduce the moving image based on the moving image data on the display of the compressed data based on the frame data returned by decompressing the compressed data. .
Further, the moving image processing apparatus of the present application may be integrated with the transmission apparatus by including the transmission unit. With such a moving image processing apparatus, since the moving image processing apparatus itself becomes an adhoc base station, a simple network can be realized without another transmitting apparatus such as a wireless router.

The compression unit may compress the frame data of the moving image data received by the reception unit into a compressed data by compressing the frame data using a standardized predetermined method. If the compression means uses a standardized compression method, the terminal device can decompress the compressed data using the standardized software of the terminal device without installing special software on the terminal device. Can be done.
The compression unit may compress the frame data of the moving image data received by the receiving unit as compressed data by compressing each frame as a still image. For example, in the MPEG4 standard, frame data for a certain frame is compressed by referring to two frames before and after the frame data. If compression is performed by such a method, the compression means starts compressing the frame data for the frame until it receives the frame data two frames ahead of the frame when compressing the frame data for the frame. Can not. This causes a delay of 2 frames. On the other hand, if the compression means compresses the frame data as a single still image as it is to form compressed data, such a delay may occur. Absent. However, since such a compression method usually has a lower compression rate than that of moving image compression such as MPEG4, the time required for transmission of compressed data from the moving image processing device to the terminal device by the wireless LAN increases. Problems such as omissions may occur. However, if the terminal device is only a mobile terminal device (for example, a smartphone or a tablet), or if many of the terminal devices are planned to be mobile terminal devices, or if at least a mobile terminal is included. The resolution of an image required for viewing a moving image on a display provided in the mobile terminal device is at most about 4K or at most about 8K, and it is unlikely that a very high resolution is required. If the rate is smaller than about 60 fps, especially if the frame rate is about 30 fps, the compressed data is transmitted from the video processing device to the terminal device using the wireless LAN because the transmission is a simultaneous transmission. Is not difficult.
If the compression means does not use the frame data of the subsequent frame following that frame when compressing the frame data for a certain frame, in other words, When compressing the frame data, if only the frame data of the frame or only the frame data of the frame and the frame data of the previous frame are used for the compression of the frame, the above-described delay problem does not occur. .
If the above-described compression is performed by compressing each frame as a single still image to obtain compressed data, the compression unit may perform JPEG compression, for example.
When the compression unit is configured to compress the frame data of the moving image data received by the reception unit as compressed data by compressing each frame as a single still image, the compression unit includes the frame data The data may be compressed in a plurality of times in order from the portion of the frame data received from the receiving means. If the compression means starts compression after receiving all the frame data, the time until the compression means reads all the frame data is the delay time. For example, when compressing frame data with compression means, if the frame data is compressed in 10 times, 1/10 every time the frame data is read 1/10, the time required for the compression can be reduced. Therefore, the delay time cannot be reduced to 1/10, but the delay time can be reduced. By compressing the frame data from the amount received by the compression unit, the delay time generated when the compression unit performs compression can be reduced.

The compression means compresses the frame data of the moving image data received by the receiving means using at least one frame data before and after the frame data to be compressed to obtain compressed data. It may be.
As described above, the compression by the compression means can be performed using the frame data before or after the frame data to be compressed. Although typical for MPEG compression, if such a compression method is used, the compression rate of moving image data can be increased. However, if such a compression method is used, especially when the frame data after the frame data to be compressed is used for compression, the data is delayed by the time required for reading the subsequent frame data. It will occur. However, if the compression rate is high, it is possible to shorten the time required for transmitting compressed data by the wireless LAN. If the effect of shortening the transmission time exceeds the effect of shortening the time required for reading the frame data, this is also a useful technique for eliminating the data delay.
When the compression means compresses the frame data of the moving image data received by the reception means using at least one of the frame data before and after the frame data to be compressed to obtain compressed data, The compression means may perform MPEG compression.

The compression means may end the process of converting the frame data into the compressed data before 200 ms elapses after the reception means receives the frame data.
In particular, when the present invention is used in the medical field, for example, a moving image captured by an endoscope is distributed to a terminal device, and a doctor or the like confirms the moving image displayed on the display of the terminal device in substantially real time. In such a case, if there is a delay of the moving image of 200 ms or more, doctors or the like cannot accurately perform diagnosis, treatment, surgery and the like. This limitation in the medical field is likely to be more severe than in other fields.
If the compression means converts the frame data into compressed data within the time limit as described above, the user who handles the terminal device does not need to be stressed by the delay of the moving image, even in the medical field.
The compression unit may end the process of converting the frame data into the compressed data before 100 ms elapses after the reception unit receives the frame data.
According to the inventor's research, in order for a doctor or the like to accurately perform diagnosis, treatment, surgery, etc., the delay of the moving image should preferably be within 100 ms. If the compression means converts the frame data into compressed data with a delay of 100 ms or less, the user who handles the terminal device does not need to be further stressed by the delay of the moving image, not in the medical field.
The compression unit may end the process of converting the frame data into the compressed data before the reception unit starts receiving the frame data three frames after the frame data.
This also leads to not giving stress due to the delay of the moving image to the user who handles the terminal device as in the case described above.

When the transmission unit is provided, the transmission unit of the moving image processing apparatus according to the present invention may transmit the compressed data to the terminal device using a UDP (User Datagram Protocol) / IP protocol.
The present invention has a very high affinity with a technique using UDP when transmitting data from the moving image processing apparatus to the terminal apparatus. Unlike TCP (Transmission Control Protocol), which is a well-known communication protocol alongside it, UDP is a protocol that allows one-to-many communication, not just one-to-one, from a transmission device to a terminal device. One-to-many communication that UDP / IP is good at is very useful for presentations such as “small-scale TV broadcasts”, video conferencing, and video sharing of endoscopes among multiple doctors. . Further, this protocol does not perform a so-called shake hand between the transmission side device and the reception side device, and has a characteristic that the communication speed is high. This is exactly the case when compressed data is transmitted from the moving image processing device to the terminal device although the capacity is reduced by compression.
However, when only one-to-one communication is required, TCP / IP communication may be performed by the transmission unit of the moving image processing apparatus. Unlike communication using UDP / IP, communication using TCP / IP does not omit delivery confirmation, so data integrity is guaranteed.
When the transmission unit transmits the compressed data using the UDP / IP protocol, the transmission unit sets the destination IP address of the terminal device as “255.255.255.255”. Also good. For example, when communication is performed using the UDP / IP protocol using the Wi-Fi (trademark) standard, 253 units (8-bit data is used for identification data) at the same time by default in the standard. ) Or 65533 computers (when 16-bit data is used for identification data), wireless communication can be performed. On the other hand, the inventor of the present application has found that if the destination IP address of the terminal device is set as described above, the number of receiving side terminal devices can be unlimited or infinite. By performing such setting, the restriction on the number of terminal devices can be eliminated, and the trouble of setting the IP address for each terminal device can be saved.
In this case, the IP address may be fixed from the time of shipment of the moving image processing apparatus, or may be set by the user of the moving image processing apparatus. In that case, the moving image processing apparatus may be provided with means for performing input for enabling the user of the moving image processing apparatus to set the IP address.

When provided with a transmission means, the transmission means of the video processing device of the present invention is a port number for designating which software installed in the terminal device is to process the compressed data received by the terminal device. The video processing apparatus includes port number input means for inputting information for setting the port number, and sets the port number set in the transmission means. Only the terminal device may be able to display a moving image based on the received compressed data.
The compressed data sent from the moving image processing device to the terminal device is decompressed and returned to frame data, and a moving image based on the frame data is displayed on the display of the terminal device. In order to display such a moving image on the display of the terminal device, it is necessary for the terminal device to select software for performing a series of processes after decompression of the compressed data. Normally, such selection is specified by a number called a port number, whether the compressed data is transmitted using UDP / IP or TCP / IP. If such a number can be arbitrarily set by the moving image processing apparatus, a series of processes after decompression of the compressed data can be automatically executed by the terminal apparatus. At the same time, enabling the moving picture processing device to set the port number can also make it possible to display the moving image on the display only on an arbitrary terminal device. In other words, in the video processing device, an arbitrary port number is set when transmitting compressed data, and the port number is set to each user having a terminal device, for example, verbally or visually or by sending an e-mail. If the user sets the port number in the software that performs a series of processing after decompression of the compressed data in the terminal device, the terminal device of the user who made the setting Only the moving image based on the compressed data sent from the moving image processing apparatus is displayed. The setting of the port number can be used for security in this way. In particular, when compressed data is transmitted to an unspecified number of terminal devices using UDP / IP, this technology enables selection of a terminal device that can view a moving image and a terminal device that cannot view a moving image. Is highly useful.

The compression unit may generate the compressed data as having header information, and may convert at least a part of the header information according to a predetermined algorithm. In this case, only the terminal device that can perform inverse transformation, which is the inverse transformation of the transformation, on the header information may be able to display a moving image based on the received compressed data.
As described above, using the port number, a terminal device that can display a moving image based on compressed data on the display and a terminal device that cannot display a moving image based on compressed data on the display are selectively determined. It is possible. However, this technique forces a user to set a port number for a terminal device used by the user.
On the other hand, the compression means converts at least part of the header information, and only the terminal device that can perform reverse conversion on the header information can display a moving image based on the received compressed data. This is also a technique for selectively determining a terminal device that can display a moving image. However, software for performing an inverse transform is, for example, one of software that performs a series of processes after decompression of compressed data. Only a terminal device installed as a part can display a moving image based on the compressed data. This technology is, for example, software (a so-called viewer software) distributed by Company A that performs a series of processing after the above-mentioned decompression of compressed data when sending compressed data with a video processing device sold by Company A. In the terminal device in which is installed, it is possible to display a moving image based on the compressed data, and to perform a series of processes after the above-described decompression of the compressed data distributed by Company B. In the terminal device in which the software is installed, it is possible to disable the display of moving images based on the compressed data.

The moving image processing apparatus of the present application may further include a changing unit that changes the frame data so that at least one of a predetermined character, symbol, and design is superimposed on the image indicated by the frame data. good.
As described above, the moving image based on the compressed data transmitted by the moving image processing apparatus of the present application can be recorded in the terminal device depending on the case. The recorded moving image or the still image captured from the moving image may be distributed via the Internet, for example. By displaying at least one of the characters, symbols, and designs as described above on the image indicated by the frame data, for example, characters indicating that the copyright of the predetermined person exists on the moving image or still image, etc. It becomes possible to prevent illegal distribution of recorded moving images or still images.
Note that such addition of characters or the like is not necessarily performed by the moving image processing apparatus, and may be performed by the terminal apparatus. In order to make it possible, for example, the following may be performed. That is, the moving image processing device is a command that causes the terminal device to execute a process of changing the frame data so that at least one of a predetermined character, symbol, and design is superimposed on the image indicated by the frame data There may be provided an instruction adding means for adding the change instruction data, which is the instruction data, to the compressed data transmitted from the transmitting means to the terminal device.

The same effects as those of the moving image processing apparatus of the present invention can also be obtained by the following method.
An example of the method is a method executed by a moving image processing apparatus including a computer, which is used in combination with a moving image output apparatus that outputs moving image data that is data of moving images including a lot of frame data that is data of continuous frames. It is.
In this method, the computer executes an accepting process for accepting input of moving picture data output from the moving picture output device, and compresses each frame of the moving picture data accepted by the accepting process as digital data. A compression process for executing a process for converting to compressed data, and a compressed data generated by the compression process are sequentially output to a transmission device including a transmission unit for transmitting the compressed data to a terminal device by communication via a wireless LAN Output processing.

Even with a computer obtained by installing the following computer program, for example, a general-purpose computer, the same effects as those of the moving image processing apparatus of the present invention can be obtained.
An example of the computer program is to cause a computer to function as a moving image processing device used in combination with a moving image output device that outputs moving image data that is data of moving images including a lot of frame data that is data of continuous frames. It is a computer program.
Then, the computer program compresses, as digital data, an accepting process for accepting input of moving picture data output from the moving picture output device and data of each frame in the moving picture data accepted by the accepting process. Compressed data for performing compressed data processing, and compressed data generated by the compressed data are sequentially output to a transmission device having transmission means for transmitting to the terminal device by communication via a wireless LAN. And output processing.

1 is a diagram illustrating an overview of a communication system according to a first embodiment. The figure which shows the hardware constitutions of the moving image processing apparatus contained in the communication system shown in FIG. The block diagram which shows the functional block formed inside the moving image processing apparatus contained in the communication system shown in FIG. The figure which shows notionally an example of the compression process performed with the communication system shown in FIG. The figure which shows the hardware constitutions of the terminal device contained in the communication system shown in FIG. The block diagram which shows the functional block formed inside the terminal device contained in the communication system shown in FIG. The figure which shows the external appearance of the communication system of 2nd Embodiment.

Hereinafter, first and second embodiments of the present invention will be described.
In the description of each embodiment, overlapping objects are denoted by overlapping symbols, and overlapping descriptions are omitted in some cases.

<< First Embodiment >>
In this embodiment, a communication system including a moving image output device, a moving image processing device according to the present invention, and a terminal device that receives compressed data described later from the moving image processing device will be described. FIG. 1 shows an outline of a communication system in this embodiment.
The communication system includes a moving image output device 100, a moving image processing device 200, and a terminal device 300.

The moving image output device 100 is a device that outputs moving image data, which is moving image data, in a wired manner. As long as it is possible, the moving image output apparatus 100 may be basically any type.
The moving image output apparatus 100 is, for example, a video camera (for example, a video camera for shooting a moving image for television broadcasting or an endoscope) that can output moving image data of a captured moving image simultaneously with the image capturing. An example is a built-in video camera), or receives video data from other venues in a video conference system, and generally outputs the video data to a large display in the conference hall. It may be a notebook-type or desktop-type computer, or a tablet-type computer such as iPad (trademark) sold by Apple Japan LLC.
In the first embodiment, it is assumed that the moving image output apparatus 100 is a computer and a notebook computer for the time being. In addition, the communication system in this embodiment is not limited to this, but is assumed to be a presentation system used for presentation at a conference.
The moving image output device 100 and the moving image processing device 200 are operated by a presenter (or an assistant, the same applies hereinafter) for giving a presentation, and the terminal device 300 is operated by an audience. The terminal device 300 may be a private item of the audience, or may be distributed or lent to the audience by a presenter or a collaborator of the presenter.
The terminal device 300 needs to be able to perform communication using a wireless LAN. The terminal device 300 is preferably sized to be portable and includes a display. The terminal device 300 may be a smartphone, a tablet, or a notebook computer. The example of a tablet is as having mentioned by the moving image output device 100, and a smart phone is iPhone which Apple Japan limited company manufactures and sells, for example. In this embodiment, since the case where the communication system is a presentation system is taken as an example, a plurality of terminal devices 300 exist. However, it is not always necessary that a plurality of terminal devices 300 exist.

Returning to the description of the video output device 100.
The moving image output apparatus 100 is a notebook computer provided with a display 101. Both the hardware configuration and the installed computer program may be known ones. The video output device 100 also includes an input device 102. Although the input device 102 of this embodiment is a keyboard, the moving image output device 100 may include other input devices such as a trackball, a mouse, and a touch panel in addition to or instead of the keyboard. The moving image output apparatus 100 also includes an output terminal (not shown). The output terminal may be a known one. The output terminal can output moving image data.
The output terminal may output moving image data as an analog signal, or may output it as a digital signal. Examples of the former include analog RGB terminals, and examples of the latter include HDMI terminals and thunderbolt terminals.
The moving image output apparatus 100 is equipped with known presentation software and can perform a presentation. The presentation software is, for example, PowerPoint (trademark) manufactured by Microsoft Japan. A display image, which is an image used for the presentation, is displayed on the display 101, and the presenter performs the presentation while watching it.

Next, the moving image processing apparatus 200 will be described.
The moving image processing device 200 is connected to the moving image output device 100 and has a function of compressing the moving image data received from the moving image output device 100 and transmitting the compressed data to each of the terminal devices 300. As a result, an image that is substantially the same as the image displayed on the display 101 of the video output device 100 is displayed on the display of the terminal device 300, as will be described later.

The moving image processing apparatus 200 is a computer. The moving image processing apparatus 200 also includes an input device 202. Although the input device 202 of this embodiment is a numeric keypad, a keyboard, a mouse, a touch panel, or the like can be used as the input device 202.
The moving image processing apparatus 200 includes an input terminal (not shown). The input terminal is paired with the output terminal of the moving image output apparatus 100 and receives moving image data output from the output terminal. The input terminal is wired and connected to the output terminal of the video output device 100. The cable 100A connects the input terminal and the output terminal.
In addition, the moving image processing apparatus 200 has a wireless LAN function. The wireless LAN function is realized by a wireless LAN communication unit (not shown) provided with an antenna. As will be described later, the wireless LAN communication unit is controlled by the wireless LAN control unit, and performs communication by the wireless LAN with the terminal device 300. The wireless LAN communication unit of this embodiment may be a known one, and can perform communication by Wi-Fi.

The moving image processing apparatus 200 includes hardware as shown in FIG.
The hardware includes a CPU 211, a ROM 212, a RAM 213, and an interface 214, which are connected to each other by a bus 216.
The CPU 211 is an arithmetic device that performs arithmetic operations. For example, the CPU 211 executes processing described later by executing a computer program recorded in the ROM 212. The computer program here includes at least a computer program for causing the moving image processing apparatus 200 to function as the moving image processing apparatus of the present invention. This computer program may be preinstalled in the moving image processing apparatus 200 or may be installed afterwards. The installation of the computer program in the moving image processing apparatus 200 may be performed via a predetermined recording medium such as a memory card, or may be performed via a communication line such as a LAN or the Internet.
The ROM 212 records computer programs and data necessary for the CPU 211 to execute processing to be described later.
The RAM 213 provides a work area necessary for the CPU 211 to perform processing. A part of the RAM 213 serves as a frame buffer described later.
The interface 214 exchanges data between the CPU 211, RAM 213, and the like connected via the bus 216 and the outside. The interface 214 is connected to the input device 202 described above, an input terminal (not shown), and the wireless LAN communication unit described above. The operation content from the input device 202 and the input from the input terminal are inputted to the bus 216 from the interface 214, and the compressed data described later outputted from the interface 214 to the wireless LAN communication unit is a wireless LAN. The data is output from the communication unit to the terminal device 300.

When the CPU 211 executes the computer program, a functional block as shown in FIG. 3 is generated in the moving image processing apparatus 200. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the moving image processing apparatus 200. May be. Further, at least a part of the processing performed in the following functional blocks may be executed by hardware, not by the computer program.
Inside the moving image processing apparatus 200, an operation signal analysis unit 221, a control unit 222, a moving image data reception unit 223, an image data processing unit 224, a compression unit 225, and a wireless LAN control unit 226 are generated.

The operation signal analysis unit 221 analyzes the content of the operation signal input from the input device 202. In this embodiment, a numerical value that is information for setting an IP address and a port number, which will be described later, is input from the input device 202. When an operation signal related to the numerical value is input from the input device 202, the operation signal analysis unit 221 analyzes the numerical value specified by the operation signal. The operation content analyzed by the operation signal analysis unit 221, that is, a numerical value is sent to the control unit 222. Note that the information regarding the numerical value may be input not from the input device 202 but from the input device 102 of the video output device 100.
Whether the operation signal analysis unit 221 also includes, from the input device 202, data about at least one of characters, symbols, and designs (to be referred to as “characters” hereinafter) included in the frame data. An operation signal for character / symbol information, which is information for determining what character data is included in the frame data if characters are included in the frame data described later, is input. Is done. The operation signal analysis unit 221 that has received the operation signal for the character / symbol information analyzes the content and sends the content to the control unit 222.

The control unit 222 sends necessary data to the image data processing unit 224 and the wireless LAN control unit 226. Specifically, the control unit 222 determines whether or not to include at least one of the content specified by the character / symbol information received from the operation signal analysis unit 221, that is, at least one of a character, a symbol, and a design, in the frame data. If the frame data includes at least one of the character, symbol, or design, information for determining at least one of the character, symbol, or design to be included in the frame data is an image data processing unit. 224 is sent. In addition, the control unit 222 sends a numerical value for specifying the IP address and the port number received from the operation signal analysis unit 221 to the wireless LAN control unit 226.
Note that the control unit 222 may use the port number as the numerical value input by the input device 202 or a numerical value determined after performing a predetermined calculation on the numerical value. In this embodiment, the latter is not limited thereto.

  The moving image data receiving unit 223 receives the moving image data received by the input terminal via the interface 214. The moving image data is a series of frame data that is data specifying each frame. If the frame rate of the moving image is, for example, 60 fps, the frame data is received by the moving image data receiving unit 223 60 times per second. The moving picture data receiving unit 223 sends the frame data to the image data processing unit 224 every time it receives the frame data.

The image data processing unit 224 performs necessary image processing on the frame data.
The image processing performed by the image data processing unit 224 is as follows.
First, when the frame data is an analog signal, the image data processing unit 224 converts it into a digital signal.
In addition, when the frame data is compressed, the image data processing unit 224 decompresses the frame data. For example, some recent digital video cameras can output compressed MPEG images by wire. If the moving image output apparatus 100 outputs such compressed frame data, the image data processing unit 224 decompresses the frame data.
The image data processing unit 224 also receives data on character / symbol information from the control unit 222, and at least one of characters, symbols, and designs “XXXX (arbitrary characters and symbols)” is converted into frame data. If the content is “writeable”, the process is performed on the frame data. Specifically, processing is performed on the frame data, basically all the frame data so that the frame or image based on the frame data includes the characters “XXXX”. Characters and the like in this embodiment are static and are common to all frame data. Although the character etc. to be written are not limited to this, in this embodiment, it indicates that the original moving image data has a copyright. For example, characters such as “This video has copyright”, characters such as “author Yamamoto”, combinations of characters and symbols such as “(c) YAMAMOTO”, logos of corporations with copyrights, etc. Or a combination of the characters of the design and the corporate name.
The process of adding characters or the like to the frame data can be performed, for example, as in the following 1-3.
1. Although the frame data is compressed as will be described later, in the previous state, the frame data is expanded on an image memory such as RGB or YUV (which may be part of the RAM 213 described above). Each time frame data is developed on the image memory, for example, BMP (Microsoft Windows Bitmap Image: “Microsoft” and “Windows” are trademarks) format characters that have been read in advance on the frame or image based on the frame data. The above purpose can be achieved by overwriting and the like.
2. If an alpha channel for a layer different from the frame or image developed on the image memory exists in the image memory as described above, once characters and the like are written in the alpha channel, the image memory can store the alpha channel. When a frame or image is developed, characters or the like are automatically written in the frame or image.
3. If there is an integrated circuit that can be configured by the purchaser or designer after the manufacture of, for example, an FPGA (field-programmable gate array) before the image memory, data such as characters is stored in the FPGA. The above object can be achieved by superimposing data such as characters directly on the frame data passing through the FPGA.
When the image data processing unit 224 finishes the image processing, the processed frame data is sequentially sent to the compression unit 225.

The compression unit 225 sequentially compresses each frame data received from the image data processing unit 224. The compression method may be a known one, for example, a standardized one. The compressed frame data is the compressed frame data.
The compression unit 225 may be configured such that each frame is a single still image and the frame data is compressed as it is to be compressed data. An example of such compression is JPEG compression, for example.
In the case where the compression unit 225 compresses each frame data as each frame as a single still image, the compression unit 225 receives the frame data from the portion of the frame data received from the image data processing unit 224. You may come to compress in multiple times in order. Frame data is usually in the order of the top row of the frame from left to right, the bottom row from left to right, and the bottom row from left to right. For example, in the example of FIG. 4, frame data has already been read in the hatched range of the frame F, that is, the data has been received by the compression unit 225. Then, among the zones (a) to (x) constituting the frame F, the frame data (to be exact, part of) is already read for the zones (a) to (f). Compression can be performed prior to the zone.
The compression unit 225 may also compress the frame data of the moving image data using at least one of the frame data before and after the frame data to be compressed to obtain compressed data. Such compression techniques include, for example, MPEG compression, h. There is H.264 compression. In MPEG4, which is a kind of MPEG compression, in addition to discrete cosine transform and entropy encoding techniques, motion prediction inter-frame interpolation techniques using two frame data before and after the frame data are compressed. Use to increase compression rate. However, if it is important to avoid the problem of the delay of the moving image, the compression rate is lowered. However, the compression unit 225 uses only the previous frame data and compresses the subsequent frame data to compress certain frame data. It is preferable not to use it. However, if the compression rate is high, the time required to transmit the compressed data from the video processing device 200 to the terminal device 300 can be shortened. The problem of delay is less likely to occur.
The compression unit 225 in this embodiment converts the frame data into compressed data within 200 ms, preferably within 100 ms, after the moving image data receiving unit 223 receives the frame data.
In addition, the compression unit 225 may end the process of converting certain frame data into compressed data before the moving image data reception unit 223 starts to receive frame data that is three frames after the frame data. In the case of 60 fps moving image data, the delay time until the end of compression in this case is 50 ms. In the case of 30 fps moving image data, the delay time until the end of compression in this case is 100 ms.
Although not limited to this, the compression unit 225 of this embodiment compresses the frame data by JPEG compression. The compression rate is lower than MPEG compression, but the speed until the compression is overwhelming. Even in the prototype machine created by the applicant of the present application, the compression unit 225 may convert the frame data into the compressed data within 200 ms, preferably within 100 ms, after the moving image data receiving unit 223 receives the frame data. In the case of a 60 fps moving image, it has been confirmed that the moving image data receiving unit 223 can also be terminated before starting to receive the frame data that is three frames after the frame data. In the case of MPEG compression,
However, even when the compression unit 225 performs the MPEG compression, the applicant has received the frame data within 200 ms, preferably within 100 ms, after the compression unit 225 receives the frame data received by the moving image data reception unit 223. It has also been confirmed that the data can be compressed.
The compression unit 225 can also add the following conversion to the header of the compressed data. In both JPEG compression and MPEG compression, header information is attached to data after compression is performed using existing technology. In the header information, data such as a compression type and a reference table necessary for decompression are written in accordance with a standardized rule. Accordingly, for example, the terminal device 300 that has received the compressed data needs the data written in the header when decompressing the compressed data, and the compressed data cannot be decompressed without it. The compression unit 225 of this embodiment is not necessarily limited to this, but converts a part of the header information according to a predetermined algorithm. This is because the compressed data can be decompressed only by the terminal device 300 having such an algorithm that can perform the reverse conversion on the header information of the compressed data. The header information is converted by, for example, reversing the order of the character strings constituting the header information for a part of the header information, dividing the header information into several parts, and replacing some of the order, Although the amount of data increases, it is performed by adding a noise character every several characters to at least a part of the character string constituting the header information. In this embodiment, the above-described algorithm executed by the compression unit 225 is set from the time of shipment of the moving image processing apparatus 200. However, it can be set by an input from the input device 202. .

The wireless LAN control unit 226 receives an IP address and a numerical value for specifying a port number from the operation signal analysis unit 221 and receives compressed data from the compression unit 225. The wireless LAN control unit 226 receives the compressed data sent from the compression unit 225 one after another, and sequentially sends the received compressed data to the wireless LAN communication unit.
On the other hand, the wireless LAN control unit 226 sets the IP address received from the operation signal analysis unit 221 in the wireless LAN communication unit as described above. The IP address specifies the terminal device 300 to which the compressed data is transmitted wirelessly from the wireless LAN communication unit. The IP address setting method may be a known technique. The numerical value set as the IP address can also be a known value. In this embodiment, the destination IP address of the terminal device 300 is set to “255.255.255.255”. With this setting, the number of terminal devices 300 that can accept compressed data is virtually infinite.
On the other hand, the wireless LAN control unit 226 sets the port number received from the operation signal analysis unit 221 as described above in the wireless LAN communication unit. The port number is a numerical value for specifying which software installed in the terminal device 300 to which the compressed data is wirelessly sent from the wireless LAN communication unit is to handle the compressed data.

  The wireless LAN communication unit has a function of transmitting the compressed data received from the wireless LAN control unit 226 to the terminal device 300 using a wireless LAN function. Although not limited to this, the wireless LAN communication unit of this embodiment is configured to send compressed data to the terminal device 300 by Wi-Fi. At this time, the IP address identifying the terminal device 300 is “255.255.255.255” as described above.

Next, the terminal device 300 will be described.
The terminal device 300 is a portable computer.
The terminal device 300 includes a display 301. The terminal device 300 also includes an input device 302. In addition to the physical keys as shown in FIG. 1, the input device 302 can be configured by a touch panel integrated with the display 301 as is well known.
In addition, the terminal device 300 has a wireless LAN function. The wireless LAN function is realized by a wireless LAN communication unit (not shown). The wireless LAN is Wi-Fi in this embodiment, although not limited to this. The wireless LAN communication unit of the terminal device 300 can communicate with the wireless LAN communication unit of the moving image processing device 200.

The terminal device 300 includes hardware as shown in FIG.
The hardware includes a CPU 311, a ROM 312, a RAM 313, an interface 314, and these are mutually connected by a bus 315. The hardware may include a hard disk drive similar to that included in the moving image processing apparatus 200.
The functions of the CPU 311, ROM 312, RAM 313, interface 314, and bus 315 are basically the same as the functions of the CPU 211, ROM 212, RAM 213, interface 214, and bus 215 in the moving image processing apparatus 200.
However, the ROM 312 stores computer programs necessary for realizing the following processing executed by the terminal device 300. The ROM 312 stores software necessary for executing enlargement processing (for example, by pinch), which will be described later, and recording of a display image (for example, by a print screen).
The interface 314 of the terminal device 300 is connected to the above-described wireless LAN communication unit mounted on the terminal device 300, and the wireless LAN communication unit receives compressed data received from the moving image processing device 200. ing. The interface 314 is connected to the input device 302 so as to receive operation contents from the input device 302. This operation content includes at least designation information described later. The interface 314 is also connected to the display 301 so as to send data for displaying a predetermined display image on the display 301.

When the CPU 311 executes the computer program, a functional block as shown in FIG. 6 is generated in the terminal device 300. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the terminal device 300. Also good. Further, at least some of the functions of the following functional blocks may be realized by hardware instead of software.
Inside the terminal device 300, an operation signal analysis unit 321, a control unit 322, a port number determination unit 323, an expansion unit 324, and a display image data generation unit 325 are generated.

  The operation signal analysis unit 321 analyzes the content of the operation signal input from the input device 302. The operation signal related to this embodiment includes designation information. The designation information is information for determining a port number which is a numerical value for determining which software installed in the terminal device 300 is to process the compressed data received by the terminal device 300 as described later. Specifies a numeric value that is This numerical value is sent to the control unit 322.

  When the control unit 322 receives this numerical value from the operation signal analysis unit 321, a numerical value for determining which software installed in the terminal device 300 processes the compressed data received by the terminal device 300. Has a function of determining a port number. This numerical value may be the numerical value itself indicated by the operation content input from the operation signal analysis unit 321, or may be a numerical value obtained as a result of performing some operation on the numerical value. In this embodiment, as a result of such calculation, a numerical value for determining which software installed in the terminal device 300 processes the compressed data received by the terminal device 300 is determined. It has become. This numerical value is sent to the port number determination unit 323.

The port number determination unit 323 receives the header and the compressed data packet received from the wireless LAN communication unit of the moving image processing apparatus 200 and received by the wireless LAN communication unit of the terminal device 300 via the interface 314 each time. It is like that.
The port number determination unit 323 compares the port number specified by the video processing device 200 with the port number received from the control unit 322, and if they match, receives the compressed data and matches them. If not, the compressed data is not received. The comparison process described above may be performed only when the first compressed data is received or every predetermined time interval such as every 10 minutes. In this embodiment, it is assumed that the processing is performed only when the first compressed data is received.
When the port number determining unit 323 receives the compressed data, the port number determining unit 323 sends the compressed data to the decompressing unit 324.

When the decompression unit 324 receives compressed data from the port number determination unit 323, the decompression unit 324 decompresses the compressed data and returns it to frame data. The decompression unit 324 sends frame data obtained by decompressing the compressed data to the display image data generation unit 325.
The decompression unit 324 of this embodiment implements an algorithm for performing so-called inverse transformation that restores the above-described transformation added to the header information of the compressed data. This is achieved, for example, by installing the software designated by the presenter in the terminal device 300 owned by the audience. For example, if the presenter designates software individually, it is possible to select the audience who can view the video distributed by the presenter for each presenter.
The decompression unit 324 of this embodiment restores the header information to the original by the above-described inverse transformation, and then decompresses the compressed data and returns it to the frame data using the header information. A known method may be used for decompressing the compressed data.
The decompression unit 324 sends the frame data to the display image data generation unit 325 each time. The display image data generation unit 325 causes the display 301 to display an image based on the frame data based on the frame data received from the decompression unit 324. Each time the display image data generation unit 325 receives frame data, the display image data generation unit 325 displays an image based on the frame data on the display 301.

  Next, the usage method and operation | movement of this communication system are demonstrated.

To use this communication system, the presenter first connects the output terminal of the moving image output apparatus 100 and the input terminal of the moving image processing apparatus 200 with a cable 100A. In this embodiment, although not limited to this, both devices are connected by an HDMI cable.
Next, regardless of whether the above work is performed or not, the presenter operates the input device 202 of the moving image processing apparatus 200 to input a numerical value for determining the port number to the moving image processing apparatus 200 and In addition, the terminal device 300 that the terminal device 300 has is input with a numerical value for determining a port number that specifies software for processing the compressed data when the terminal device 300 receives the compressed data. The numerical value is transmitted to the audience, for example, verbally or by e-mail.
A numerical value input from the input device 202 to the moving image processing device 200 is sent to the control unit 222 via the operation signal analysis unit 221. As described above, the control unit 222 of this embodiment determines the port number as a numerical value determined after performing a predetermined calculation on the numerical value input by the input device 202. For example, in general, the port number is determined by adding a predetermined numerical value to the default numerical value of 8255. In this embodiment, the presenter operates the input device 202 to input 8255 + a predetermined numerical value (for example, 1000) + a numerical value (for example, 10) that is input to an audience to be permitted to receive and decompress compressed data by the terminal device 300. Among these, a numerical value obtained by adding a predetermined numerical value (for example, 1000) and a numerical value (for example, 10) to be input to the terminal device 300 owned by the terminal device 300 to the audience who is permitted to receive and decompress the compressed data by the terminal device 300 is input. . The control unit 222 determines a numerical value of 9265 obtained by adding these as a port number, and sends this numerical value to the wireless LAN control unit 226.
On the other hand, in this embodiment, 8255 + a predetermined numerical value (for example, 1000) is input in advance to the computer program installed in the terminal device 300 held by the audience, and the audience operates the input device 302 to input it. The numerical value thus added is further added by the control unit 322. And 8255 + predetermined numerical value (for example, 1000) is set so as not to be seen from the audience. The presenter can also enter the correct numerical value that the audience should enter (this is, for example, 10 as described above), participate in the presentation, receive and decompress the compressed data, and eventually view the video. Notify only good audiences. Only the terminal device 300 of the audience who knows the notification correctly can obtain the correct port number. As described above, in addition to the default port number value of 8255, a predetermined number (for example, 1000) invisible to the user is used to determine the port number. Knowing the number is getting harder.
In the moving image processing apparatus 200, the determined port number is sent from the control unit 222 to the wireless LAN control unit 226.
In the terminal device 300, the port number is sent from the control unit 322 to the port number determination unit 323.
The presenter inputs a numerical value for designating the IP address of the terminal device 300 from the input device 202. The numerical value is sent from the operation signal analysis unit 221 to the wireless LAN control unit 226 via the control unit 222. Here, it is assumed that the IP address of the terminal device 300 is set to “255.255.255.255”. Note that such an IP address may be set as a default so that input by the presenter is omitted.

In this state, the presenter starts the presentation.
When the presenter operates the input device 102, the moving image output device 100 executes known presentation software. An image based on the execution result is displayed on the display 101 of the moving image output apparatus 100. This image includes a moving image in at least a part of the screen in at least a part of the time zone.
The moving image data that is data about the image displayed on the display 101 is sent from the output terminal to the input terminal of the moving image processing apparatus 200 via the cable 100A.

The following processing in the moving image processing apparatus 200 is basically performed automatically.
The moving image data including a large number of continuous frame data input from the input terminal is sent to the image data processing unit 224. The image data processing unit 224 performs the necessary processing described above on the frame data, for example, superimposes copyright display data on each frame data, and sends the data to the compression unit 225.
Each time the compression unit 225 receives the frame data, the compression unit 225 compresses the frame data, and performs the above-described conversion on the header information of the generated compressed data. The compression unit 225 converts the frame data into compressed data within 200 ms, preferably within 100 ms, after the moving image data reception unit 223 receives the frame data. Alternatively, the compression unit 225 ends the process of converting certain frame data into compressed data before the moving image data reception unit 223 starts to receive frame data that is three frames after the frame data.
Each time the compression unit 225 generates compressed data, it sends it to the wireless LAN control unit 226.
The wireless LAN control unit 226 divides the compressed data into packets and attaches a header to the leading end of the packets. The header is written with its own IP address, capacity information that is information indicating the capacity of compressed data to be transmitted, the above-described port number, and the like. Packets of these headers and a lot of compressed data are sent to the wireless LAN communication unit, and are sent from the wireless LAN communication unit to each terminal device 300.
Since the moving image processing device 200 itself includes a wireless LAN communication unit and serves as an adhoc base station, communication with the terminal device 300 can be realized with a simple network without other transmission devices such as a wireless router.

A series of packets for compressed data starting from the header is received by the wireless LAN communication unit of the terminal device 300. If the IP address is set as described above, the number of terminal devices 300 is not limited. Those data received by the terminal device 300 is sent to the port number determination unit 323.
When the port number determination unit 323 receives the data, the port number determination unit 323 reads the port number written in the header. The port number determination unit 323 compares the port number written in the header of the compressed data packet with the port number sent from the control unit 322. If the numerical values match, the port number determination unit 323 sends the compressed data packet received by the terminal device 300 to the decompression unit 324. If the numerical values of the two port numbers do not match, the terminal device 300 does not perform subsequent processing.

When the decompression unit 324 receives the compressed data from the port number determination unit 323, the decompression unit 324 first performs the above-described inverse transform on the header information, and restores the header information to the original. Then, the decompressing unit 324 decompresses the compressed data by using the restored header information, and restores the original frame data. The decompression unit 324 sends frame data obtained by decompressing the compressed data to the display image data generation unit 325.
Based on the frame data received from the decompression unit 324, the display image data generation unit 325 causes the display 301 to display an image based on the frame data every time frame data is received. Thereby, on the display 301, a moving image that can be said to be substantially the same as that displayed on the display 101 of the moving image output apparatus 100 is displayed with a small delay.

The audience can listen to the presentation provided by the presenter while viewing the image displayed on the display 301 of the terminal device 300. Thereby, it is not necessary to distribute the distribution material for presentation on paper.
If the image is difficult to see because, for example, small characters are displayed on the image, the audience can enlarge the image using a function such as pinch if the terminal device 300 is provided. Small characters can be clearly recognized, and the portion of the display image that the user particularly wants to focus on can be enlarged and viewed.
Also, if the audience device is equipped with the terminal device 300 at the timing when the image to be saved is displayed on the display 301 while watching the image displayed on the display 301, the audience can use the function of saving an image such as a print screen. A part of the image data can be stored in, for example, the RAM 313 of the terminal device 300. As a result, the need to distribute handouts on paper is increasingly reduced.
Current smartphones and the like that are also planned to be used as the terminal device 300 are usually provided with functions for enlarging the display image and saving the display image. At least one of these functions is disclosed in the present invention. A computer program for causing the computer to function as the terminal device 300 may be provided.
The image includes the above-mentioned characters and the like that mean that the copyright exists in the moving image in all frames. Therefore, there is little possibility that the moving image recorded in the terminal device 300 or the data of the still image captured from the moving image is misused by a person who has performed recording or the like.
In this embodiment, the process of superimposing image data such as characters on the frame data is performed by the moving image processing apparatus 200. However, such processing may be performed by the terminal device 300. In this case, data about a command for causing the terminal device 300 to execute processing for superimposing image data such as characters on frame data is transmitted from the moving image processing device 200 to the terminal device 300. The terminal device 300 executes the process according to the command based on the received data regarding the command. The data of such an instruction is that such characters and the like can be written in each frame. That is, the command data basically includes a combination of image information for specifying characters and the like for each frame and a command for writing characters and the like specified by the information in each frame. However, if the characters etc. to be written in the frame data are determined in advance, the data about the command is an instruction to write only one type of the characters etc. to each frame if the character etc. is one type. If there are multiple types of characters, etc., the data for selecting the characters to select from among the multiple types and the selected characters etc. for each frame It can be composed of a combination with the command to write to. The data about the command may be performed only once, for example, when transmission of compressed data from the moving image processing apparatus 200 to the terminal apparatus 300 is started, or may be performed multiple times at an appropriate time, or It may be performed each time transmission is performed. For example, the command data may be generated by the control unit 222 according to an input from the input device 202 and transmitted to the terminal device 300 via the wireless LAN control unit 226. In addition, it is free how the terminal device 300 performs the process which superimposes image data, such as a character, on frame data. Although the above-described processes 1 to 3 that can be executed by the moving image processing apparatus 200 depend on the hardware configuration of the terminal apparatus 300, any of them can be applied thereto.

<< Second Embodiment >>
A communication system according to the second embodiment is shown in FIG.
This communication system is almost the same as that described in the first embodiment. The moving image output device 100 and the terminal device 300 are the same as those described in the first embodiment.
The difference between the communication system of the second embodiment and the communication system of the first embodiment is that, in the first embodiment, the moving image processing apparatus 200 has a built-in wireless LAN communication unit, but in the second embodiment, the moving image processing apparatus. 200 has no built-in wireless LAN communication unit. In the second embodiment, the wireless LAN communication unit corresponds to the wireless router 210 connected to the moving image processing apparatus 200 via a predetermined cable 100B.
In the second embodiment, the compressed data generated by the compression unit 225 is sequentially sent to the wireless router 210 via the cable 100B. In the first embodiment, the wireless router 210 transmits the received compressed data to the terminal device 300 one after another in the same manner as the wireless LAN communication unit transmits the compressed data to the terminal device 300 one after another.
In the first embodiment, the wireless LAN control unit 226 that controls the wireless LAN communication unit exists in the functional block. However, in the second embodiment, this may exist in the moving image processing apparatus 200. It may exist inside the wireless router 210. If the wireless LAN control unit 226 is present in the wireless router 210, the wireless router 210 is provided with an input device 212, and the operation signal analysis unit 221 and some of the functions of the control unit 222 are also included in the wireless router 210. It is only necessary that a numerical value for determining the port number and a numerical value for specifying the IP address of the terminal device 300 can be input from the input device 212.

DESCRIPTION OF SYMBOLS 100 Movie output device 101 Display 102 Input device 200 Movie processing device 202 Input device 221 Operation signal analysis unit 222 Control unit 223 Movie data reception unit 224 Image data processing unit 225 Compression unit 226 Wireless LAN control unit 300 Terminal device 301 Display 302 Input device 321 Operation signal analysis unit 322 Control unit 323 Port number determination unit 324 Expansion unit 325 Display image data generation unit

Claims (19)

A moving image processing device used in combination with a moving image output device that outputs moving image data that is data of moving images including a large number of frame data that is continuous frame data, by wire,
Receiving means for receiving input of moving image data output from the moving image output device;
Compression means for executing processing for converting the data of each frame of the moving image data received by the receiving means into compressed data that is compressed as digital data;
Output means for sequentially outputting the compressed data generated by the compression means to a transmission device comprising a transmission means for transmitting to the terminal device by communication via a wireless LAN;
Equipped with a,
The compression means generates the compressed data as having header information, and can convert at least a part of the header information according to a predetermined algorithm.
Only the terminal device that can perform inverse transformation, which is the inverse transformation of the transformation, on the header information can display a moving image based on the received compressed data.
Movie processing device. A moving image processing device used in combination with a moving image output device that outputs moving image data that is data of moving images including a large number of frame data that is continuous frame data, by wire,
Receiving means for receiving input of moving image data output from the moving image output device;
Compression means for executing processing for converting the data of each frame of the moving image data received by the receiving means into compressed data that is compressed as digital data;
Output means for sequentially outputting the compressed data generated by the compression means to a transmission device comprising a transmission means for transmitting to the terminal device by communication via a wireless LAN;
Equipped with a,
By providing the transmission means, it is integrated with the transmission device ,
A change instruction that is data of a change instruction that is an instruction that causes the terminal device to execute a process of changing the frame data so that at least one of predetermined characters, symbols, and designs is superimposed on the image indicated by the frame data Command adding means for causing data to be added to the compressed data transmitted from the transmitting means to the terminal device and transmitted.
Movie processing device. By providing the transmission means, it is integrated with the transmission device,
The moving image processing apparatus according to claim 1. The compression means compresses the frame data of the moving image data received by the reception means as compressed data by compressing each of the frames as a still image.
The moving image processing apparatus according to claim 1 or 2. The compression means performs JPEG compression.
The moving image processing apparatus according to claim 4 . The compression means compresses the frame data in a plurality of times in order from the portion of the frame data received from the receiving means.
The moving image processing apparatus according to claim 4 . The compression means compresses the frame data of the moving image data received by the receiving means using at least one frame data before and after the frame data to be compressed to obtain compressed data. Has become,
The moving image processing apparatus according to claim 1 or 2. The compression means performs MPEG compression.
The moving image processing apparatus according to claim 7 . The compression means ends the process of converting the frame data into the compressed data before the reception means starts receiving frame data three times after the frame data.
The moving image processing apparatus according to claim 4 or 7 . The compression means ends the process of converting the frame data into the compressed data before 200 ms elapses after the reception means receives the frame data.
The moving image processing apparatus according to claim 4 or 7 . The compression means ends the process of converting the frame data into the compressed data before 100 ms elapses after the reception means receives the frame data.
The moving image processing apparatus according to claim 10 . The transmission means is configured to transmit the compressed data to the terminal device using a UDP / IP protocol.
The moving image processing apparatus according to claim 2 or 3 . The transmission means has a destination IP address of the terminal device set to “255.255.255.255”.
The moving image processing apparatus according to claim 2, 3 or 12 . The transmission means can arbitrarily set a port number for designating which software installed in the terminal device is to process the compressed data received by the terminal device,
A port number input means for inputting information for setting the port number;
Only the terminal device that has set the port number set in the transmission means can display a moving image based on the received compressed data.
The moving image processing apparatus according to claim 2, 3 or 12 . A changing unit that changes the frame data so that at least one of a predetermined character, symbol, and design is superimposed and displayed on the image indicated by the frame data;
The moving image processing apparatus according to claim 1 . A method executed by a moving image processing apparatus including a computer, which is used in combination with a moving image output apparatus that outputs moving image data that is data of moving images including a large number of frame data that is continuous frame data, by wire,
The computer executes,
An accepting process for accepting input of moving image data output from the moving image output device;
A compression process for executing a process of converting the data of each frame of the moving image data received by the receiving process into compressed data that is compressed as digital data;
An output process for sequentially outputting the compressed data generated by the compression process to a transmission device including a transmission unit that transmits the compressed data to a terminal device by communication via a wireless LAN;
Only including,
In the compression process, the compressed data is generated as having header information, and at least a part of the header information is converted according to a predetermined algorithm,
Only the terminal device that can perform inverse transformation, which is the inverse transformation of the transformation, on the header information, can display a moving image based on the received compressed data.
Video processing method. A method executed by a moving image processing apparatus including a computer, which is used in combination with a moving image output apparatus that outputs moving image data that is data of moving images including a large number of frame data that is continuous frame data, by wire,
The computer executes,
An accepting process for accepting input of moving image data output from the moving image output device;
A compression process for executing a process of converting the data of each frame of the moving image data received by the receiving process into compressed data that is compressed as digital data;
A transmission process for transmitting the compressed data generated in the compression process to a terminal device by communication via a wireless LAN;
A change instruction that is data of a change instruction that is an instruction that causes the terminal device to execute a process of changing the frame data so that at least one of predetermined characters, symbols, and designs is superimposed on the image indicated by the frame data An instruction addition process for causing data to be transmitted by being added to the compressed data transmitted to the terminal device by the transmission process;
including,
Video processing method. A computer program for causing a computer to function as a moving image processing device used in combination with a moving image output device that outputs moving image data that is data of moving images including a large number of frame data that is data of continuous frames.
In the computer,
An accepting process for accepting input of moving image data output from the moving image output device;
A compression process for executing a process of converting the data of each frame of the moving image data received by the receiving process into compressed data that is compressed as digital data;
An output process for sequentially outputting the compressed data generated by the compression process to a transmission device including a transmission unit that transmits the compressed data to a terminal device by communication via a wireless LAN;
Is supposed to be executed,
In the compression process, the compressed data is generated as having header information, and at least a part of the header information is converted according to a predetermined algorithm,
Only the terminal device that can perform inverse transformation, which is the inverse transformation of the transformation, on the header information, can display a moving image based on the received compressed data.
Computer program. A computer program for causing a computer to function as a moving image processing device used in combination with a moving image output device that outputs moving image data that is data of moving images including a large number of frame data that is data of continuous frames.
In the computer,
An accepting process for accepting input of moving image data output from the moving image output device;
A compression process for executing a process of converting the data of each frame of the moving image data received by the receiving process into compressed data that is compressed as digital data;
A transmission process for transmitting the compressed data generated in the compression process to a terminal device by communication via a wireless LAN;
A change instruction that is data of a change instruction that is an instruction that causes the terminal device to execute a process of changing the frame data so that at least one of predetermined characters, symbols, and designs is superimposed on the image indicated by the frame data An instruction addition process for causing data to be transmitted by being added to the compressed data transmitted to the terminal device by the transmission process;
To execute,
Computer program.

Images