FR2875326A1

FR2875326A1 - Digital audio/video multimedia display and recording functions providing method for e.g. personal computer, involves transmitting compressed and synchronized digital disinterleaved video signal and digital audio signal to processing unit

Info

Publication number: FR2875326A1
Application number: FR0409664A
Authority: FR
Inventors: Hao Chieh Chang; Hung Heng Hsu; Yi Chu Wang; Kou Chou Chen; Jui Hsiang Yang
Original assignee: Avermedia Technologies Inc
Current assignee: Avermedia Technologies Inc
Priority date: 2004-09-13
Filing date: 2004-09-13
Publication date: 2006-03-17
Anticipated expiration: 2024-09-13
Also published as: FR2875326B1

Abstract

The method involves demodulating and performing a disinterleaving operation on a modulated interleaving video signal to convert it into a digital disinterleaved video signal. An analog audio signal is digitized to obtain a digital audio signal. The digital signals are compressed, then synchronized and transmitted to a processing unit of a digital apparatus for choosing storing or displaying of the synchronized signals. An independent claim is also included for a device for providing digital audio/video multimedia display and recording functions to a personal computer.

Description

Page 1Page 1

PROCEDE ET DISPOSITIF POUR MUNIR DES APPAREILS PERSONNELS METHOD AND DEVICE FOR PROVIDING PERSONAL DEVICES

NUMERIQUES DE FONCTIONS D'ENREGISTREMENT ET D'AFFICHAGE DE MULTIMEDIAS VIDEO / AUDIO NUMERIQUES. DIGITAL FUNCTIONS FOR RECORDING AND DISPLAYING MULTIMEDIA VIDEO / AUDIO DIGITAL.

HISTORIQUE DE LA PRÉSENTE INVENTION DOMAINE DE L'INVENTION L'invention concerne un procédé de traitement de multimédias vidéo / audio numériques par des appareils personnels numériques et en particulier, un procédé et un dispositif pour munir les appareils personnels numériques de fonctions d'enregistrement et d'affichage de multimédias vidéo / audio numériques. BACKGROUND OF THE INVENTION FIELD OF THE INVENTION The invention relates to a method for processing digital video / audio multimedia by digital personal devices and in particular to a method and a device for providing digital personal devices with recording functions and display of digital video / audio multimedia.

ÉTAT DE L'ART Avec le développement des technologies de l'information d'aujourd'hui, les appareils comme la télévision analogique, les chaînes Hi-Fi et le magnétoscope ont été progressivement remplacés par des appareils numériques tels que l'Ordinateur Personnel, l'Ordinateur Portable, l'Assistant Personnel Numérique, le Caméscope Numérique, l'Appareil Photo Numérique, et la Télévision à Haute Définition (TVHD), qui sont devenus des appareils électroménagers très courants. STATE OF THE ART With the development of today's information technology, devices such as analog television, Hi-Fi and VCR have been gradually replaced by digital devices such as the Personal Computer. Laptop, Digital Personal Assistant, Digital Camcorder, Digital Camera, and High Definition Television (HDTV), which have become very common household appliances.

La tendance du numérique a pris corps depuis que l'information numérique est devenue facile à stocker et que la puissante fonction de compression a également aidé à accroître la quantité d'informations transmises. Par exemple, une chaîne de télévision analogique ne peut transmettre qu'un programme tandis qu'une chaîne de télévision numérique peut transmettre trois ou quatre programmes à la fois, voire plus. En outre, les signaux numériques peuvent être traités de différentes manières. Ainsi, la mise en oeuvre du Multimédia a considérablement progressé, dont les systèmes vidéo / audio de transmission et de visualisation ont constitué le vecteur de développement principal sur le marché de la grande consommation. Est appelé Multimédia, tout média contenant de l'information telle que: mots, diagrammes, images, sons et animations; cette information étant émise par au moins deux types de contenus de médias simultanément, c'est pour cela qu'elle est appelée information multimédia. The digital trend has grown since digital information has become easy to store and the powerful compression function has also helped to increase the amount of information transmitted. For example, an analog TV channel can transmit only one program while a digital television channel can transmit three or four programs at a time or more. In addition, digital signals can be processed in different ways. Thus, the implementation of Multimedia has progressed considerably, including video / audio transmission and visualization systems were the main vector of development in the consumer market. Is called Multimedia, any media containing information such as: words, diagrams, images, sounds and animations; this information being transmitted by at least two types of media contents simultaneously, that is why it is called multimedia information.

Page 2 De plus, il existe une autre raison principale expliquant la mise en oeuvre du numérique. Dans le processus de transmission et de traitement de tout signal analogique, de nombreux bruits s'accumulent et ne peuvent pas être éliminés, mais un signal numérique peut éliminer ces bruits et conserver la qualité et la clarté du signal source et donc, la qualité de l'image est parfaite. Prenons pour exemple, le téléphone analogique encore utilisé il y a plusieurs années: lorsque l'utilisateur appelle de l'étranger à Taiwan, sa voix semblera vague et peu distincte puisqu'il y a trop de bruit; il doit hurler fortement au téléphone. Aujourd'hui, avec la numérisation du signal du téléphonique, la voix de l'utilisateur semble très nette, comme s'il était juste à côté. Ainsi, avec le passage de l'industrie de la vidéo de l'ère de l'analogique à celle du numérique, de plus en plus d'équipements de traitement vidéo devront être munis de fonctions de conversion de signaux analogiques en signaux numériques. In addition, there is another main reason for implementing digital. In the process of transmitting and processing any analog signal, many noises accumulate and can not be eliminated, but a digital signal can eliminate these noises and maintain the quality and clarity of the source signal and thus, the quality of the signal. the picture is perfect. Take for example, the analog phone still used several years ago: when the user calls from abroad to Taiwan, his voice will sound vague and indistinct because there is too much noise; he must scream loudly on the phone. Today, with the digitization of the telephone signal, the user's voice seems very clear, as if it were right next to it. Thus, with the transition of the video industry from the era of analog to that of digital, more and more video processing equipment will have to provide functions of converting analog signals into digital signals.

En outre, il existe actuellement deux types de normes de télévision analogique: la norme NTSC (acronyme de l'expression anglaise Nation Television Systems Committee) et la norme PAL (acronyme de l'expression anglaise Phase Alternation Line). La norme NTSC est utilisée au Japon et aux USA; selon cette norme, une image est constituée de 525 lignes de balayage ou bien les 525 lignes de balayage s'appellent une image; ce qui signifie que l'image est affichée répétitivement à la vitesse de 30 images par seconde. Cependant, les 525 lignes de balayage qui forment une image ne sont pas complètes en un seul balayage. L'image est affichée en balayant une ligne, puis la ligne après la ligne suivante. Autrement dit, après le balayage de la première ligne, la troisième ligne est balayée au lieu de la deuxième, puis les cinquième, septième, jusqu'à la 525ème ligne. Puis le processus de balayage revient à la deuxième ligne et se répète pour les quatrième, sixième, huitième ligne, etc. Ainsi, l'image affichée unie et nette est en fait constituée d'un chiffre impair, d'un chiffre pair et puis d'un chiffre impair, dont le procédé d'assemblage s'appelle "balayage à double trame". In addition, there are currently two types of analogue television standards: the NTSC (National Television Systems Committee) and the PAL (English Alternate Line). The NTSC standard is used in Japan and the USA; according to this standard, an image consists of 525 scan lines or the 525 scan lines are called an image; which means that the image is displayed repetitively at the speed of 30 frames per second. However, the 525 scan lines that form an image are not complete in one scan. The image is displayed by sweeping one line and then the line after the next line. In other words, after scanning the first line, the third line is scanned instead of the second, then the fifth, seventh, until the 525th line. Then the scanning process returns to the second line and repeats for the fourth, sixth, eighth line, etc. Thus, the plain and sharp displayed image is in fact made up of an odd number, an even number and then an odd number, whose assembly method is called "double-frame scanning".

Le signal vidéo entrelacé est constitué de deux trames, contenant chacune les lignes impaires ou paires de l'image. En effectuant une prise d'image, une camera fournit les lignes impaires de l'image à un instant donné, puis les lignes paires de l'image après 16,7 millisecondes. Un décalage temporel se produit entre la production des lignes impaires et des lignes paires de l'image. Pour une image fixe, une bonne image peut être obtenue à partir de cette méthode. Mais pour une image en mouvement, l'image deviendra floue puisqu'une dentelure se produira au bord de l'image. En outre, puisque les trames des lignes impaires et paires sont constituées par seulement la moitié du nombre de lignes de balayage (262,5 lignes), chaque trame des lignes impaires et paires ont seulement une Page 3 résolution moitié de celle de l'image d'origine. Et chaque trame des lignes impaires et paires est affichée à la vitesse de 60 trames par seconde. Une image résultante ne semblera pas avoir des défauts de mouvement aux yeux de l'être humain, mais si l'image est agrandie, les lignes de balayage sembleront épaisses et l'image deviendra floue. The interlaced video signal consists of two frames, each containing the odd or even lines of the image. By taking an image, a camera provides the odd lines of the image at a given moment, then the even lines of the image after 16.7 milliseconds. A time shift occurs between the production of odd lines and even lines of the image. For a still image, a good image can be obtained from this method. But for a moving image, the image will become fuzzy since a serration will occur at the edge of the image. In addition, since the odd and even lines of frames are made up of only half the number of scan lines (262.5 lines), each frame of the odd and even lines has only half the resolution of the image. original. And each frame of odd and even lines is displayed at the rate of 60 frames per second. A resulting image will not appear to have movement defects in the eyes of humans, but if the image is enlarged, the scan lines will appear thick and the image will become blurred.

Les inconvénients du "balayage entrelacé" décrit ci-dessus peuvent être éliminés par une technique appelée "balayage progressif". Avec le balayage progressif, la première, deuxième, troisième, jusqu'à la 525ème ligne sont balayées dans l'ordre et affichées à la vitesse de 60 images par seconde. Par conséquent, sa vitesse de balayage est deux fois la vitesse de balayage de l'entrelacement et l'image est affichée sur le moniteur avec 525 lignes de balayage, ce qui rend l'image unie et nette, ce qui est le meilleur atout du "balayage progressif". Ainsi, la majorité des équipements vidéo et audio développés actuellement utilise ce procédé de balayage et d'affichage. The disadvantages of "interlaced scanning" described above can be eliminated by a technique called "progressive scanning". With progressive scan, the first, second, third, up to the 525th line are scanned in order and displayed at the speed of 60 frames per second. Therefore, its scanning speed is twice the scanning speed of the interlacing and the image is displayed on the monitor with 525 scan lines, which makes the image sharp and clean, which is the best asset of the "progressive scan". Thus, the majority of video and audio equipment currently being developed uses this scanning and display method.

Cependant jusqu'ici, tout signal vidéo issu du système NTSC actuel utilise principalement la méthode d'entrelacement. Par conséquent, si une image constituée par entrelacement est affichée par un système d'affichage à balayage progressif tel qu'un film DVD formé par un entrelacement directement émis et affiché sur la TVHD, seule l'image des lignes impaires et celle des lignes paires peuvent être affichées et la résolution de l'image sera plus mauvaise (puisque sa résolution est seulement la moitié de celle de l'image d'origine). Pour résoudre ce problème, la technique de "désentrelacement" doit être utilisée. Autrement dit, le désentrelacement est un procédé de conversion de balayage entrelacé en balayage progressif. Par exemple, pour convertir la Télévision à Définition Standard (TVDS) à la TVHD, les lignes de balayage ont été améliorées de 480i à 720p. La transformation de l'émission et de cette amélioration est composée de deux étapes: le désentrelacement et le ré échantillonnage. Le désentrelacement est la plus complexe des deux étapes puisque l'image d'entrelacement des lignes impaires et des lignes paires est temporellement décalée et, si la combinaison est fixe, un désalignement de l'image se produira. Ce désalignement de l'image doit être modifié pour obtenir une image régulière visuellement satisfaisante. Lorsqu'une image alignée est produite, elle est alors soumise au procédé de ré- échantillonnage pour assemblage en image. So far, however, any video signal from the current NTSC system mainly uses the interleaving method. Therefore, if an interlaced image is displayed by a progressive scan display system such as a DVD movie formed by interleaving directly transmitted and displayed on the HDTV, only the odd-numbered and even-line image can be displayed and the resolution of the image will be worse (since its resolution is only half of that of the original image). To solve this problem, the technique of "deinterlacing" must be used. In other words, deinterlacing is an interlaced scanning conversion method in progressive scanning. For example, to convert Standard Definition Television (TVDS) to HDTV, scan lines have been improved from 480i to 720p. The transformation of the emission and this improvement consists of two stages: deinterlacing and resampling. Deinterlacing is the most complex of the two steps since the interleaving image of the odd and even lines is temporally shifted and, if the combination is fixed, misalignment of the image will occur. This misalignment of the image must be modified to obtain a visually satisfactory regular image. When an aligned image is produced, it is then subjected to the resampling process for image assembly.

Bien que la technique de désentrelacement puisse résoudre le problème d'affichage d'un système d'entrelacement sur un système de balayage progressif avec une faible résolution, il reste cependant un autre problème non négligeable de l'image émise toujours en mouvement, et si ceci est négligé et que les trames des lignes impaires paires sont encore combinées, on ne peut alors obtenir qu'une image nette dans le cas d'une Page 4 image fixe, et une image floue avec des défauts de mouvement dans le cas d'une image en mouvement et donc, il n'est pas possible d'afficher une image de haute qualité comme dans le problème décrit précédemment. Aussi, existe t-il deux algorithmes élémentaires à choisir dans le procédé de désentrelacement, l'un sans compensation de mouvement et l'autre avec compensation de mouvement. Although the deinterlacing technique can solve the problem of displaying an interleaving system on a progressive scanning system with a low resolution, there remains however another significant problem of the transmitted image still moving, and if this is neglected and the frames of even odd lines are still combined, only a sharp image can be obtained in the case of a still image, and a blurred image with motion defects in the case of a still image. a moving image and therefore, it is not possible to display a high quality image as in the problem described above. Also, there are two basic algorithms to choose from in the deinterlacing process, one without motion compensation and the other with motion compensation.

1) Algorithme de désentrelacement sans compensation de mouvement II existe deux méthodes élémentaires de transformation linéaire pour l'algorithme de désentrelacement sans compensation de mouvement, appelées "Weave" and "Bob", dont 10 "Weave" est la plus simple des deux. 1) Deinterlacing Algorithm without Motion Compensation There are two basic linear transformation methods for the motionless deinterlacing algorithm, called "Weave" and "Bob", of which 10 "Weave" is the simpler of the two.

Weave consiste à superposer ou à assembler deux trames d'entrée pour produire une image régulière. Bien que les différentes trames d'image puissent être complètement alignées dans le traitement d'une image fixe par cette technique, et qu'une image désentrelacée et nette puisse être produite, il se trouve cependant que, lors du traitement d'une image en mouvement, des dentelures ou des lobes notables se produisent puisque l'image en mouvement se déplace dans le temps et donc, lorsque l'image des lignes impaires et celle des lignes paires sont assemblées en une image, un désalignement de l'image se produira, dû au décalage temporel entre l'image des lignes impaires et celle des lignes paires. Par conséquent, il y aura présence de dentelures ou de lobes et donc, production d'une image floue. Les situations de dentelures ou de lobes visibles sont inacceptables dans les émissions radio ou télévisée professionnelle. Weave consists of overlaying or joining two input frames to produce a regular image. Although the different image fields can be completely aligned in the processing of a still image by this technique, and a deinterleaved and sharp image can be produced, it does happen that, when processing an image in movement, notches or noticeable lobes occur as the moving image moves in time and so when the image of the odd and even lines are assembled into an image, misalignment of the image will occur , due to the time difference between the image of the odd lines and that of the even lines. Therefore, there will be presence of serrations or lobes and therefore, production of a fuzzy image. Visible serrations or lobes are unacceptable in professional radio or television programs.

Par ailleurs, puisque la méthode "Bob" accepte seulement l'une des trames de l'image d'entrée (par exemple, l'image des lignes paires), et que l'autre image (image des lignes impaires) est mise à l'écart, la résolution verticale de l'image décroîtra de 720 x 486 à 720 x 243. Les vides des lignes mises à l'écart sont complétés par les lignes de balayage adjacentes à cette image avec seulement une résolution moitié pour retrouver la résolution de 720 x 486. Le mérite de cette méthode est qu'elle peut éliminer des défauts de mouvement d'image et a les moindres besoins en ressources de calcul. Cependant, son inconvénient est que la résolution verticale de l'image d'entrée est la moitié de celle de l'image d'origine après interpolation, ce qui fait décroître la résolution de l'image à balayage progressif. Moreover, since the "Bob" method only accepts one of the frames of the input image (for example, the image of the even lines), and the other image (image of the odd lines) is set to the difference, the vertical resolution of the image will decrease from 720 x 486 to 720 x 243. The voids of the sidelined lines are complemented by the scanning lines adjacent to this image with only a half resolution to find the resolution The merit of this method is that it can eliminate flaws in image movement and has the least need for computing resources. However, its disadvantage is that the vertical resolution of the input image is half that of the original image after interpolation, which decreases the resolution of the progressive scan image.

2) Algorithme de désentrelacement avec compensation de mouvement Le meilleur procédé de désentrelacement consiste en la compensation de mouvement. Cette technique a été employée dans la transformation des TVDS et Page 5 chaînes Hi-Fi développées en télévision numérique. Le procédé de désentrelacement avec compensation de mouvement consiste à mesurer les mouvements d'inter trame et à déplacer les pixels de deux trames temporellement décalées à un même endroit à un instant donné. Une évaluation de mouvement est réalisée pour décider de la valeur de déplacement de chaque pixel dont l'identification et le suivi du vecteur de mouvement se fait d'une trame à l'autre. Une procédure-type d'assemblage par pavés est mise en oeuvre et une taille de pavé typique s'étend de 4 x 4 pixels à 8 x 8 pixels. L'emploi de ces pavés est justifié par le fait qu'à un instant donné, seuls ces pavés de pixels de taille relative peuvent être déplacés au bon endroit. 2) Deinterlacing Algorithm with Motion Compensation The best method of deinterlacing is motion compensation. This technique has been used in the transformation of TVDS and Hi-Fi channels developed in digital television. The motion compensation deinterleaving method is to measure interframe motions and to move the pixels of two time-shifted frames to the same location at a given time. A motion evaluation is performed to decide the displacement value of each pixel whose identification and tracking of the motion vector is from one frame to another. A typical cobblestone assembly procedure is implemented and a typical tile size ranges from 4 x 4 pixels to 8 x 8 pixels. The use of these tiles is justified by the fact that at a given moment, only these blocks of pixels of relative size can be moved to the right place.

Concernant la technique de compression vidéo dynamique, il s'agit de la méthode de compression MPEG (acronyme de l'expression anglaise Moving Picture Experts Group) utilisée en pratique actuellement. Les normes de production peuvent être divisées en trois: Vidéo, Audio, et Système. Avec l'accroissement de la demande, de nouvelles générations de normes MPEG sont développées comme MPEG-1, MPEG-2, MPEG-4 et MPEG-7. Concerning the dynamic video compression technique, this is the MPEG (acronym for the English Moving Picture Experts Group) compression method currently used in practice. Production standards can be divided into three: Video, Audio, and System. As demand grows, new generations of MPEG standards are being developed such as MPEG-1, MPEG-2, MPEG-4 and MPEG-7.

D'une manière générale, dans un film cinématographique émis en continu, il existe une cohérence forte entre une image et sa précédente, donc dans une série d'images d'un film cinématographique original, il existe une cohérence spatiale et temporelle forte entre une image et sa précédente. Par ailleurs, la compression vidéo est réalisée en supprimant l'information redondante selon la cohérence de ces deux types d'information pour parvenir à une compression. Le procédé de suppression d'information spatiale redondante est généralement réalisé par rapport aux caractéristiques de la vision humaine à partir d'une transformation spatiale (telle que la Transformation en Cosinus Discrète ou la Transformation par Ondelettes) et d'une quantification pour filtrer et supprimer la partie haute fréquence, pour réaliser la compression. Quant à la suppression d'information temporellement redondante, le principe de l'Evaluation de Mouvement est utilisé pour identifier et supprimer l'information temporellement redondante pour réaliser la compression. Et concernant le processus de compression (ou d'encodage) MPEG, trois différentes méthodes sont utilisées pour compresser chaque image: Intraimage, Image bidirectionnelle, et Image prédictive. Elles sont caractérisées en ce que l'lntra image n'a pas besoin de se mettre en relation avec d'autres images puisqu'une image complète est enregistrée; l'image prédictive prend l'Intra image précédente comme image de référence, dont la partie redondante de l'image n'est pas enregistrée et dont seulement la partie différente de l'image est enregistrée; l'Image bidirectionnelle a le même principe que celui de l'Image prédictive, la seule différence Page 6 étant que cette Image bidirectionnelle peut prendre la précédente Intra- image ou l'Image prédictive comme référence et qu'elle peut également prendre la dernière Image prédictive comme référence. Generally, in a film film transmitted continuously, there is a strong coherence between an image and its previous, so in a series of images of an original cinematographic film, there is a strong spatial and temporal coherence between a picture and his previous. Moreover, the video compression is performed by removing the redundant information according to the consistency of these two types of information to achieve compression. The redundant spatial information suppression method is generally performed with respect to the characteristics of human vision from a spatial transformation (such as Discrete Cosine Transformation or Wavelets Transformation) and quantization to filter and suppress the high frequency part, to achieve the compression. As for the deletion of temporally redundant information, the Motion Evaluation principle is used to identify and delete the temporally redundant information to realize the compression. And concerning the MPEG compression (or encoding) process, three different methods are used to compress each image: Intrusion, Bidirectional Image, and Predictive Image. They are characterized in that the image does not need to be related to other images since a complete image is recorded; the predictive image takes the previous Intra image as a reference image, whose redundant part of the image is not recorded and of which only the different part of the image is recorded; the Bidirectional Image has the same principle as that of the Predictive Image, the only difference being that this Bidirectional Image can take the previous Intra-image or Predictive Image as a reference and that it can also take the last Image. predictive as a reference.

Lorsque l'image est décompressé (lors de l'émission), elle est traitée dans l'ordre inverse à celui de l'encodage, tout d'abord en décodant, puis en réalisant la Quantification Inverse et la Transformation en Cosinus Discrète Inverse, en convertissant ensuite le signal de la plage de fréquence en signal spatial pour retransformer le signal en flux d'informations avant la compression, et ces flux d'information sont alors intégrés et envoyés vers une mémoire tampon de l'image vidéo reconstituée (ou mémoire tampon de l'image vidéo), laquelle restitue les informations reçues en images originales. When the image is decompressed (during transmission), it is processed in the reverse order to that of the encoding, first by decoding, then realizing the Inverse Quantization and the Inverse Discrete Cosine Transformation, then converting the signal from the frequency range into a spatial signal to retransform the signal into an information stream prior to compression, and these information streams are then integrated and sent to a buffer of the reconstructed video image (or memory buffer of the video image), which restores the received information in original images.

Comme décrit ci-dessus, la réalisation d'une image en mouvement désentrelacée de haute qualité exige un traitement d'image très complexe et donc, l'utilisation de beaucoup de ressources en calcul. Ainsi, lorsqu'un ordinateur personnel ou portable est utilisé pour projeter une image multimédia vidéo / audio numérique de haute qualité, le système du PC est généralement conçu pour utiliser un algorithme plus simple de traitement de la méthode de désentrelacement de l'image entrelacée de sorte à ne pas utiliser trop de ressources de l'unité centrale de traitement du PC et à ne pas empêcher le PC d'exécuter d'autres fonctions. Par exemple, seul l'algorithme Bob est utilisé pour traiter le désentrelacement d'une image de mouvement. De la sorte, bien que l'image d'un multimédia numérique puisse être visualisée sur PC, la qualité de l'image multimédia numérique ne peut cependant pas être considérablement améliorée. De plus, une image résultant du processus de désentrelacement est la reconstitution d'une image compressée, donc la bande passante de l'image s'accroîtra et ne pourra pas être acheminée au moniteur par le Bus de sortie du PC, si bien que l'image désentrelacée doit être transmise directement au moniteur pour affichage. Par conséquent, la bande passante d'une image désentrelacée doit être abaissée pour permettre à cette image désentrelacée de passer par un Bus de sortie du système du PC pour affichage de l'image désentrelacée et d'enregistrer des programmes vidéo numériques avec le système du PC. As described above, achieving a high quality de-interlaced motion picture requires very complex image processing and therefore the use of a lot of computing resources. Thus, when a personal or portable computer is used to project a high quality digital video / audio multimedia image, the PC system is generally designed to use a simpler algorithm for processing the deinterlacing method of the interlaced image of so that you do not use too much of the PC's CPU and do not prevent the PC from performing other functions. For example, only the Bob algorithm is used to process the deinterlacing of a motion image. In this way, although the image of a digital multimedia can be viewed on a PC, the quality of the digital multimedia image can not however be considerably improved. In addition, an image resulting from the deinterleaving process is the reconstruction of a compressed image, so the bandwidth of the image will increase and can not be fed to the monitor by the PC's output bus, so that De-interlaced image must be transmitted directly to the monitor for display. Therefore, the bandwidth of a de-interlaced image must be lowered to allow this de-interlaced image to pass through a PC system output bus for display of the deinterleaved image and to record digital video programs with the PC system. PC.

Claims

SUMMARY OF THE INVENTION The problem described above is that a digital video signal of a high quality image can not be processed and displayed by a digital personal apparatus; Also, the invention provides a method and a hardware structure for keeping the video signal of a high quality image and decreasing the system resource demand of the digital personal device, which may be in the future a perfect solution for viewing a multimedia video signal on an advanced digital personal device. Thus, digital video / audio multimedia can be perfectly displayed with high resolution by a PC system, and TV programs can also take a smaller recording size on the hard disk of a PC after performing the compression and compression processes. encoding. As described above, the present invention provides a method for providing digital personal devices with digital video / audio video recording and display functions by means of a device that processes digital video / audio multimedia, the personal computer system being provided with a display device of high quality digital multimedia images, to effectively reduce the processing resources by these systems. Another main target of the present invention is to provide a method for providing digital personal digital audio and video recording and display devices with a device that processes digital video / audio multimedia as programs and TV programs that may take a smaller recording size on a PC's hard drive after the compression and encoding process has been performed to provide the PC system with pre-recorded and broadcast functions . Another main target of the present invention is also to provide a device for providing digital personal digital audio and video recording and display functions, by combining different processing units in an ASIC which can easily be used. integrate with the interface of a PC system and effectively reduce design complexity and cost of production. According to the targets described above, the present invention provides a method for providing digital personal digital recording and display devices with video / audio digital media, characterized in that it: first provides a signal modulated interleaving video and an analog audio signal for demodulating and deinterleaving the interleaved video signal; transforms this interleaving video signal into a deinterleaved video signal; at the same time performs the digital conversion of the analog audio signal to provide a digital audio signal; Then compresses the deinterleaved video signal and the digital audio signal to provide a compressed deinterleaved video signal and a compressed digital audio signal; submits the compressed deinterleaved video signal and the compressed digital audio signal to a synchronization process to provide synchronized compressed and compressed audio video signals; provides output and finally displays synchronized compressed video and compressed audio signals. The present invention also provides a device for providing digital personal digital recording and viewing devices with digital video / audio media, comprising: a digital video signal compression unit which compresses a deinterleaved dynamic video signal to reduce the band pass-through used by the deinterleaved dynamic video signal; a digital audio signal compression unit which compresses a digital audio signal to reduce the bandwidth used by the digital audio signal; a video / audio synchronization unit which synchronizes the compressed deinterleaved video signal and the compressed digital audio signal to obtain synchronized compressed and compressed audio video signals and output the synchronized compressed and compressed audio video signals. Furthermore, the device may further include a digital video signal decoding unit, a deinterlacing unit, an audio signal analog / digital conversion unit, and an output bus interface unit providing the compressed video and audio signals. compressed synchronized for viewing or recording synchronized compressed video and compressed audio signals. BRIEF DESCRIPTION OF THE FIGURES FIG. 1 is the flowchart of the present invention. Figure 2 is a block diagram of an embodiment of the present invention. Figure 3 is a block diagram of an embodiment of the present invention. Figure 4 is a block diagram of an embodiment of the present invention. DETAILED DESCRIPTION OF THE BEST EMBODIMENT OF THE INVENTION Since the techniques and methods of interleaving, deinterleaving, as well as the MPEG compression standard have been described in detail in the prior art, the entire process of these techniques and methods is therefore not included in the description which follows. Moreover, the encoding and decoding art used in the present invention, adapted from the MPEG compression technique, is summarized here to support the description of the invention. And the functional diagrams of the following text have not been produced according to the actual relative position and complete the connection diagram whose function is to illustrate only the characteristics of the invention. According to the targets described above, the present invention provides a method for providing digital personal digital recording and display devices with video / audio digital media, characterized in that it: first provides a signal modulated interleaving video and an analog audio signal for demodulating and deinterleaving the interleaved video signal; transforms this interleaving video signal into a deinterleaved video signal; at the same time performs the digital conversion of the analog audio signal to provide a digital audio signal; then compresses the deinterleaved video signal and the digital audio signal to provide a compressed deinterleaved video signal and a compressed digital audio signal; submits the compressed deinterleaved video signal and the compressed digital audio signal to a synchronization process to provide synchronized compressed and compressed audio video signals; provides output and finally displays synchronized compressed video and compressed audio signals. The present invention also provides a device for providing digital personal digital recording and viewing devices with digital video / audio media, comprising: a digital video signal compression unit which compresses a deinterleaved dynamic video signal to reduce the band pass-through used by the deinterleaved dynamic video signal; a digital audio signal compression unit which compresses a digital audio signal to reduce the bandwidth used by the digital audio signal; a video / audio synchronization unit which synchronizes the compressed deinterleaved video signal and the compressed digital audio signal to obtain synchronized compressed and compressed audio video signals and output the synchronized compressed and compressed audio video signals. Furthermore, the device may further include a digital video signal decoding unit, a deinterlacing unit, an audio signal analog / digital conversion unit, and an output bus interface unit providing the compressed video signals. and synchronized compressed audio for viewing or recording synchronized compressed video and compressed audio signals; and a processing unit in the personal digital apparatus having a function of controlling recording and displaying synchronized compressed and compressed audio video signals. The present invention then provides a device for providing PCs with digital video / audio multimedia recording and display functions, comprising: a digital video signal decoding unit which subjects a modulated interleaving video signal to a video signal process; demodulation to obtain a dynamic video signal; a deinterleaving processing unit which subjects the dynamic video signal to a deinterlacing process for converting the interleaving video signal to a deinterleaved dynamic video signal; an analog / digital audio signal conversion unit which subjects an analog audio signal to a digital conversion process to obtain a digital audio signal; a digital video signal compression unit which compresses the deinterleaved dynamic video signal to reduce the bandwidth used by the deinterleaved dynamic video signal; a digital audio signal compression unit which compresses a digital audio signal to reduce the bandwidth used by the digital audio signal; a video / audio synchronization unit which synchronizes the compressed deinterleaved video signal and the compressed digital audio signal to obtain synchronized compressed and compressed audio video signals; an output bus interface unit outputting synchronized compressed and compressed audio video signals for displaying synchronized compressed and compressed audio video signals; and a central processing unit CPU (Central Processing Unit) located in the personal digital apparatus, provided with a function of recording control or display of compressed compressed video and compressed audio signals. In the following is shown the detailed description of the invention with reference to FIG.1 to FIG.4, in which FIG.1 is a flowchart of the embodiment of the invention, and FIG. 2 to FIG. 4 are block diagrams of the embodiments of the invention. First of all, FIG. 1 illustrates the method of the invention. With regard to current multimedia information transmitting means, VCD / DVD players, PC CD-ROM players, cable TV channel programs, and program programs can be used to transmit information whose content includes modulated interleaving video and analog audio signals. Thus, the input port of a personal digital apparatus receives the modulated interleaving video signal and the analog audio signal, as indicated in step 110. Then decoding the video signal in step 120 and digitizing the audio signal in step 150 are performed simultaneously. With respect to the video signal, step 120 demodulates the modulated interleaving video signal it receives to digitize the input modulated interleaving video signal into a dynamic image produced by a continuous interleaving frame. Then the decoded dynamic image is deinterleaved at step 130, for example using the pad assembly algorithm, in which a series of deinterleaving processes are performed on the base tiles to convert the interlaced image of entry into a deinterlaced image. Then, step 140 subjects the de-interlaced dynamic image to a compression and encoding process to reduce the bandwidth used by the dynamic image, in which compression and encoding methods such as those of the MPEG series and several standards MJPEG (acronym for Motion Joint Photographic Experts Group) can be used. As for the received analog audio signal, it is digitized in step 150 and the digitized audio signal is compressed and encoded according to the audio standard in step 160. For example, standards such as MPEG-1 Layer-1, -2, -3, MPEG-2, AC3, or Adaptive Differential Pulse Code Modulation can be used. Since the compression ratios of the video and audio signals are different, the compressed video signal and the audio signal must be synchronized and multiplexed in step 170, the purpose of which is to subject the video and audio signals to the multiplexing process to one. fixed rate, according to the standard of compression and encoding in order to obtain a flow of information of the synchronization image. Regarding the MPEG compression standard, the compression ratio of the video signal must be greater than that of the audio signal, so the compressed video bit rate is divided by the compressed audio bit rate and the resulting decimal is then unconditionally carried to obtain a whole number. Then, the synchronization and multiplexing processes are performed according to this entire report to obtain an image information stream of synchronized compressed and compressed audio video signals. Finally, it is determined whether this stream of synchronized image information is transmitted in step 180 to be stored in memory or directly transmitted to the monitor for display at step 190. Here, a PC system is taken as an example of DESCRIPTION OF AN EMBODIMENT OF THE INVENTION Referring to FIG. 2, in which is shown a PC provided with the device 20 which records and displays the digital video / audio multimedia according to the invention. The device 20 receives a modulated analog video signal or an analog audio signal from communicating apparatus such as the VCD / DVD player, the PC CDROM player, the cable TV channel programs and the broadcast programs, which are respectively processed. by the digital video signal decoding unit 21 and the audio signal analog / digital conversion unit 23. When the digital video signal decoding unit 21 receives an interleaved modulated video signal, it demodulates the modulated video signal. When the modulated analog video signal is demodulated and digitized by the digital video signal decoding unit 21, an interlaced image can be obtained. Then, the deinterlacing process of the image is processed by the deinterleaving unit 22 to convert the original image, composed of the interleaving video signal, into a progressive image. A default method can be used for the deinterlacing process. The Weave algorithm can be chosen by default and the method used for the deinterlacing process can also be changed by the external control interface (not shown). Then the progressive image is compressed by the digital video signal compression unit 24. The MPEG-2 compression standard is used, for example, to perform the compression of the progressive image in order to obtain a compressed progressive image which is then sent to the synchronization and multiplexing unit 26 for the next step of the process. When the digital video signal is subjected to a series of de-interleaving and compression processes, the device 20 provided by the invention will also transmit the analog audio signal it receives to the analog / digital audio signal conversion unit 23 for perform the digitization of the audio signal and obtain a digital audio signal. The digital audio signal is then compressed by the digital audio signal compression unit according to the standard in relation to that of compressing the video signal, such as the MPEG-2 audio signal compression standard for example. The compressed digital audio signal is then sent to the synchronization and multiplexing unit 26 for the next step of the process. Since, according to the current compression standard, video and audio signals are compressed in different ratios, compressed video and audio signals must be synchronized and multiplexed before being sent to multimedia for broadcast or recording. Thus, when the synchronization and multiplexing unit 26 simultaneously receives the video and audio signals compressed from the digital video signal compression unit 24 and the digital audio signal compression unit 25, it submits the video signals. and compressed audio to a ratio ratio multiplexing process determined by a mixed ratio to obtain a compressed video signal and a synchronized compressed audio signal. The synchronized compressed video and compressed audio signals are finally sent to the PC Bus interface processing unit 27 to be transformed according to universal fast information transmission standards, so as to be transmitted by the bus. For example, the PCI bus (Peripheral Component Interconnect) or the USB bus (Universal Serial Bus) are used to display synchronized compressed video and compressed audio signals. With the development of semiconductor production techniques, the memory capacity per unit area has increased. Thus, the capacity of hard drives currently used in PCs has reached fifty thousand million bytes (50 gigabytes). For a high-quality image-quality multimedia movie, the DPI resolution (English acronym for Dots Per Inches) of each of these images is at least 720 x 480 pixels. Thus, a 120-minute multimedia movie needs at least 12 gigabytes to be stored in memory, which is rather large to record a movie and is not very economical for using the memory capacity of the discs. hard. Also, the main purpose of the device that provides the digital personal digital audio recording and display functions of the invention is to perform a deinterleaving of the interleaved video signal transmitted by the digital audio system. ordinary multimedia program to transform the multimedia image into a high quality progressive image. The progressive image is then compressed so that a multimedia film only needs one tenth to one twentieth of the original size (about 650 megabytes at 1, 2 gigabytes), which is very economical. If the user wishes to record a digital multimedia film transmitted by a cable TV channel or a TV program, and then watch it, he can record the film by the device of the invention which can store the film on hard disk. In addition, if the user wishes to view this digital media movie directly through the VGA display interface, the movie may be presented by directly sending the de-interlaced progressive image to the monitor via the bus interface unit. Since the progressive image is not processed by the PC CPU (not shown) and its recording or transmission, or simultaneously its recording and transmission are controlled only by the PC interface system (not shown) most of the CPU resources will not be used. As a result, the user can work at the same time with his PC and record the program he wants to watch; while watching, the recorded program can be connected to the HDTV for display by the PC system and the PC can still perform the tasks to which it is assigned. Thus, the user can enjoy multimedia entertainment while using the ordinary process calculation resources of the PC, without being overloaded. If the user only uses the PC's CD-ROM drive to play a VCD / DVD movie, the fact that the CD-ROM player has already decoded the video signal and the audio signal implies that the output signal includes the video of digital interleaving and the audio signal. Thus, a device 30 equipping the digital personal apparatus with a function for recording and displaying digital video / audio multimedia is proposed according to another embodiment of the invention, the elements comprising it being: a unit 22 deinterleaving device, a digital video signal compression unit 24, a digital audio signal compression unit 25 and a synchronization and multiplexing unit 26, with reference to FIG. The functions of each element composing the device of the invention and those of the device of the invention described above are identical and are not described again. In addition, if the user is using an advanced DVD player for movie playback, the fact that the output video signal has been deinterlaced and the audio signal has also been digitized implies the proposition of another embodiment of the invention. invention via another device 40 equipping the digital personal apparatus provided with recording and multimedia video / digital audio display functions; it comprises: a digital video signal compression unit 24, a digital audio signal compression unit 25, and a synchronization and multiplexing unit 26, with reference to FIG. The functions of each element composing the device 40 of the invention and those of the device 20 of the invention described above are identical and are not described again. With the improvement of semiconductor production techniques to a 0.13 pm process, the ASIC (Application Specific Integrated Circuits) and SoC chip (acronym for English System-on-Chip) are also progressing. Thus, in each embodiment of the invention, the device which can provide digital personal digital audio video recording / display and recording functions provided by the invention can be integrated on a SoC chip; and since the components of the device which provides a digital personal digital audio / video recording and display device provided by the invention are digital signals, the functions of the device can also be processed by an ASIC circuit. . The foregoing descriptions are only preferred embodiments of the invention and in no way restrict the claims of the invention; the above description can be assimilated and put into practice by people familiar with this technical field; so any variation or modification of the same effect, made in the spirit of the invention must be included in the appended claims. The claims relate to: 5

1) A method for providing digital personal digital audio and video recording and display functions, characterized by: * providing a modulated interleaving video signal and an analog audio signal; demodulates and performs a deinterlace operation on said modulated interleaving video signal to convert said modulated interleaving video signal to a digitized deinterleaved video signal; * digitally converting said analog audio signal to digitize said analog audio signal and obtain a digital audio signal; * compresses said deinterleaved video signal to obtain a compressed deinterleaved video signal; * compresses said digital audio signal to obtain a compressed digital audio signal; * synchronizes said compressed deinterleaved video signal with said compressed digital audio signal to provide synchronized compressed and compressed audio video signals; and * outputs said synchronized compressed and compressed audio video signals to a processing unit of said digital apparatus for choice of recording or viewing, or recording and viewing of said synchronized compressed and compressed audio video signals.

2) A device for providing a personal computer PC with digital video / audio multimedia recording and display functions, comprising: a digital video signal compression unit which compresses a deinterleaved dynamic video signal to reduce the bandwidth used by said deinterleaved dynamic video signal; a digital audio signal compression unit which compresses a digital audio signal to reduce the bandwidth used by said digital audio signal; and a video / audio synchronization unit which synchronizes said compressed deinterleaved video signal and said compressed digital audio signal to obtain synchronized compressed and compressed audio video signals, and outputting said synchronized compressed and compressed audio video signals.

Page 17

The apparatus of claim 2, further comprising a digital video signal decoding unit, said digital video signal decoding unit demodulating an interleaved video signal modulated to provide a digitized dynamic video signal.

4) Device according to claim 2, further comprising a deinterleaving unit, said deinterleaving unit performing a deinterlacing operation on a dynamic video signal to convert said interleaving video signal to a deinterleaved dynamic video signal.

5) Device according to claim 2, further comprising an audio signal analog / digital conversion unit, said audio signal analog to digital conversion unit subjecting an analog audio signal to a digital conversion process to provide a digital audio signal.

The apparatus of claim 2, further comprising an output bus interface unit, said output bus interface unit outputting said compressed compressed audio and compressed audio signals to display said compressed compressed audio and compressed audio signals. synchronized.

7) Device according to claim 6, characterized in that said interface unit for output bus is a bus type USB (acronym for the expression Universal Serial Bus).

8) Device according to claim 6, characterized in that said interface unit for output bus is a bus type PCI (acronym for the English expression Peripheral Component Interconnect).

9) A device for providing digital personal digital recording and viewing devices with digital video / audio multimedia, comprising: a digital video signal decoding unit which demodulates a modulated interleaving video signal to obtain a video signal digitized dynamic; a deinterleaving unit which performs a deinterleaving operation on said dynamic video signal to convert said interleaved video signal to a deinterleaved dynamic video signal; an analog / digital audio signal conversion unit which subjects an analog audio signal to a digital conversion process to obtain a digital audio signal; A digital video signal compression unit which compresses said de-interlaced video-dynamic signal to reduce the bandwidth used by said deinterleaved dynamic video signal; a digital audio signal compression unit, which compresses a digital audio signal to reduce the bandwidth used by said digital audio signal; a video / audio synchronization unit which synchronizes said compressed deinterleaved video signal with said compressed digital audio signal to obtain synchronized compressed and compressed audio video signals; an output bus interface unit that outputs synchronized compressed and compressed audio video signals to display said synchronized compressed and compressed audio video signals; and a processing unit installed in said personal digital apparatus, used to control the recording or viewing or recording and viewing of said synchronized compressed and compressed audio video signals.

10) Device according to claim 9, characterized in that said interface unit for output bus is a bus type USB.

11) Device according to claim 9, characterized in that said interface unit for output bus is a bus type PCI.

A device for providing PC personal computers with digital video / audio multimedia recording and display functions, comprising: a digital video signal decoding unit which demodulates a modulated interleaving video signal to obtain a video signal digitized dynamic; a deinterleaving unit which performs a deinterleaving operation on said dynamic video signal to convert said interleaved video signal to a deinterleaved dynamic video signal; an analog / digital audio signal conversion unit which submits an analog audio signal to a digital conversion process to obtain a digital audio signal; a digital video signal compression unit which compresses said deinterleaved dynamic video signal to reduce the bandwidth used by said deinterleaved dynamic video signal; a digital audio signal compression unit which compresses a digital audio signal to reduce the bandwidth used by said digital audio signal; and a video / audio synchronization unit which synchronizes said compressed deinterleaved video signal and said compressed digital audio signal to obtain synchronized compressed and compressed audio video signals, and outputs said synchronized compressed and compressed audio video signals.

The apparatus of claim 12, further comprising an output bus interface unit, said output bus interface unit outputting said compressed compressed audio and compressed audio signals for displaying said compressed video and compressed audio signals. synchronized.

14) Device according to claim 13, characterized in that said interface unit for output bus is a bus type USB.

15) Device according to claim 13, characterized in that said interface unit 15 for output bus is a bus type PCI.