CN108271038A - A kind of data flow processing method and intelligent glasses system - Google Patents

Abstract

An embodiment of the present invention provides a kind of data flow processing method and intelligent glasses system, wherein the method is applied in intelligent glasses system, and the intelligent glasses system includes lens body and smart machine, the method includes video processing procedure, including：Receive the video data information for including video information；The video data information is pre-processed, and the video data information of pretreatment is sent to smart machine and performs two stage treatment operation；It receives and plays video data information of the display through two stage treatment.The characteristics of embodiment of the present invention has the configuration that need not increase intelligent glasses and realizes the functional diversities of intelligent glasses.

Description

A data stream processing method and smart glasses system

technical field

The invention relates to an audio and video processing method, in particular to a data stream processing method applied in smart glasses and a smart glasses system.

Background technique

At present, smart electronic devices are becoming more and more popular among a large number of user groups, and smart glasses, as an emerging device, are also attracting more and more attention. However, the current research and development point for smart electronic devices is generally to make the smart glasses more powerful, and to continuously increase the configuration of the smart glasses. For example, in order to improve the signal quality of audio information or video information, audio and video editing devices may be added to smart glasses equipment. That is to say, while increasing the functional configuration, it is necessary to increase the configuration of electronic devices, chips, etc. in the smart glasses device, which in turn increases the size of the smart glasses device. Although smart glasses have more and more functions and have attracted the attention of users, due to the increase in their volume and weight, they have also affected the user experience.

Contents of the invention

Embodiments of the present invention provide a data stream processing method and a smart glasses system for realizing diversified functions of the smart glasses without increasing the configuration of the smart glasses.

In order to solve the above technical problems, embodiments of the present invention provide the following technical solutions:

A data stream processing method, which is applied to a smart glasses system, the smart glasses system includes a glasses body and a smart device, and the method includes a video processing process, including:

receiving video data information including video information;

Preprocessing the video data information, and sending the preprocessed video data information to the smart device for secondary processing;

Receive and display the secondary processed video data information.

Preferably, preprocessing the video data information includes:

Convert the received video data information from an analog image signal form to a parallel digital signal form;

The video data information in the form of parallel digital signals is converted into video data information in the form of serial digital signals.

Preferably, the secondary processing operations performed by the smart device include:

Process the preprocessed video data information into multiple channels of video data information with different resolutions;

Optimizing the multiple channels of video data information with different resolutions respectively;

Encoding and superimposing the optimized video data information of different resolutions, wherein the encoded video data information is stored in the smart device for reading, and the superimposed video The data information is returned to the glasses body for playback and display.

Preferably, processing the preprocessed video data information into multiple channels of video data information with different resolutions includes: performing cutting and scaling processing on the preprocessed video data information to generate multiple channels of different resolutions Video data information.

Preferably, the optimization processing includes at least image enhancement processing and anti-shake processing, and the image enhancement processing includes denoising processing and sharpening processing.

Preferably, the encoding process includes: encoding into JPG format, MJPEG format, H.264 or H.265 format.

Preferably, the superimposing process includes: superimposing time information or identification information.

Preferably, it also includes that the encoded video data information is executed by the smart device in a three-level processing operation; wherein the three-level processing operation includes:

Decoding the encoded video data information for display or format conversion;

The format conversion includes converting the decoded video data information into a YUV format;

The format-converted video data information is stored or sent to the glasses body for display.

Preferably, the method also includes an audio processing process, which includes:

Receive audio data information;

Denoising the audio data information, and transmitting the denoised audio data information to the smart device;

receiving and playing the processed audio data information sent back from the smart device.

Preferably, the processing operation performed by the smart device on the denoised audio data information includes: encoding the denoised audio data information through at least one audio protocol, and encoding the encoded audio data information Send back to the glasses body for playback or send the audio data information to an electronic device connected to the smart device for voice analysis and processing.

Wherein, the processed audio data information sent back from the smart device includes: encoded audio data information of the smart device and audio information stored in the electronic device.

The present invention also provides a smart glasses system applying the data stream processing method described in the above embodiment, which includes a glasses body and a smart device connected to the glasses body; wherein,

The glasses body includes: an audio and video acquisition device for obtaining audio data information and video data information, an audio and video playback device for playing audio data information and video data information, and the audio and video acquisition device and the audio and video playback device Electrically connected data processing equipment;

The data processing device is configured to preprocess the video data information acquired by the audio and video acquisition device, and send the preprocessed video data information to the smart device; The data information is stored and displayed on the audio and video playback device.

Wherein, the data processing device includes a first conversion part and a second conversion part electrically connected, wherein the first conversion part is configured to convert the video data information received by the audio and video acquisition device from an analog image signal to a parallel digital signal format, the second conversion section is configured to convert the video data information in the form of parallel digital signals into video data information in the form of serial digital signals.

Wherein, the smart device is configured to process the received preprocessed video data information into multiple channels of video data information with different resolutions, and optimize the multiple channels of video data information with different resolutions respectively, And carry out coding processing and superposition processing on the video data information of different resolutions after optimization processing, wherein, the video data information after coding processing is stored in the smart device for reading, and the superimposed processing The video data information is returned to the glasses body for playback and display.

Wherein, the smart device is configured to perform a video decoding operation on the encoded video data information; and is configured to perform display control on the decoded video data information.

Wherein, the data processing device is also configured to denoise the audio data information received by the audio and video acquisition device, and transmit the denoised audio data information to the smart device, and is configured to convert the smart device The audio data information returned by the device is stored and played on the audio and video playback device.

Compared with the prior art, the beneficial effects of the embodiments of the present invention are:

1. In the embodiment of the present invention, the audio and video information received by the smart glasses can be processed by the smart device without adding additional configurations to the smart glasses, so that the wearing of the smart glasses can be made lighter and more convenient. Multiple functional configurations;

2. The processing of the audio and video data information in the embodiment of the present invention can enhance the signal strength and display and playback effects of the audio and video information.

Description of drawings

Fig. 1 is the principle flowchart of the video processing procedure in the embodiment of the present invention;

Fig. 2 is the principle flowchart of the method for preprocessing video data information in the embodiment of the present invention;

FIG. 3 is a flow chart of a method for secondary processing performed by a terminal connection device in an embodiment of the present invention;

FIG. 4 is a flowchart of a method for an electronic device to perform three-level processing operations in an embodiment of the present invention;

FIG. 5 is a schematic flow chart of the audio processing process in the embodiment of the present invention;

FIG. 6 is a schematic structural diagram of a smart glasses system in an embodiment of the present invention;

Fig. 7 is a schematic structural diagram of the glasses body in the embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a data processing device in an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of a terminal connection device in an embodiment of the present invention;

FIG. 10 is a schematic structural diagram of an electronic device in an embodiment of the present invention.

Detailed ways

Below, specific embodiments of the present invention will be described in detail in conjunction with the accompanying drawings, but it is not intended to further limit the present invention.

Embodiments of the present invention provide a data stream processing method applied in a smart glasses system and the smart glasses system. Moreover, the method and system provided by the embodiments of the present invention have the characteristics of making the wearing of the smart glasses lighter and more portable, and at the same time can realize the diversification of the functions of the smart glasses. In addition, the signal strength of the audio and video information and the display and Play effects.

Specifically, the smart glasses system in the embodiment of the present invention includes a glasses body and a smart device connected to the glasses body in communication, and the data stream processing method provided by the embodiment of the invention may include a video processing process and an audio processing process, as shown in 1 is a schematic flowchart of the video processing process in the embodiment of the present invention, wherein the process may include:

S1: receiving video data information including video information;

In this embodiment, an audio and video acquisition device for acquiring audio and video data information may be provided in the glasses body, and the audio and video acquisition device may include a camera (camera), or may also include a sound receiving device. The audio and video acquisition device can acquire external audio data information and video data information according to the configuration in the glasses book.

S2: Preprocessing the video data information, and sending the preprocessed video data information to the smart device to perform secondary processing operations;

That is to say, after the audio and video acquisition device in the glasses body receives the video data information, it will preprocess the audio and video data information. The main purpose of this preprocessing is to convert the video data information in the form of image analog signals into digital signals. In order to improve the subsequent processing speed and reduce the occupied storage capacity. In addition, after the pre-processing operation is performed, the pre-processed video data information is sent to the smart device to perform a secondary processing operation. The purpose of the secondary processing operation is to encode the video data information and convert it into the required encoded form , and can overlay the desired content.

S3: receiving and displaying the secondary processed video data information.

That is, after the smart device performs secondary processing on the video data information, the video data information can be returned to the glasses body for playback and storage.

Through the above configuration, there is no need to install devices for processing video data information in the glasses body, thereby reducing the size of the glasses body and increasing the data processing speed.

In addition, it should be noted here that the connection mode between the glasses body and the smart device in the embodiment of the present invention is preferably a wired connection, without using WiFi, Bluetooth and other transmission modes for data transmission. This is because the transmission of the data stream between the glasses body and the smart device or other electronic devices in the embodiment of the present invention through Bluetooth or WiFi requires that the hardware structure of the glasses body must include Bluetooth, WiFi modules or network cards. And other hardware support, and the glasses body needs to maintain Bluetooth or WiFi connection and communication with smart terminal devices or other electronic devices in real time, which will increase the power consumption of smart glasses and smart terminal devices and electronic devices. Moreover, data streaming via Bluetooth is limited by bandwidth. Data stream transmission over a WiFi network will be affected by the stability of the WiFi network. However, in this embodiment, the glasses body is connected to the smart device and other electronic devices in a wired manner, which can improve the stability of data transmission, and at the same time, it is not necessary to set additional hardware devices in the glasses body. In addition, the connection port provided at one end of the glasses body in the embodiment of the present invention is a Type C interface, and the terminal device can be provided with a MicroB interface, and the two can be connected through a Type C USB to Type B USB cable for communication. Furthermore, the smart terminal can further perform connection communication with other electronic devices or communication between electronic devices in the smart terminal through a USB cable.

Next, the above configuration process will be described in detail.

In step S2, since the video data information obtained directly from the outside is in the form of an image analog signal, in order to facilitate the subsequent image processing process, the image analog signal can be converted into a digital signal, so as to facilitate transmission and subsequent processing, thereby improving the data quality. Processing speed and efficiency.

Specifically, as shown in FIG. 2 , it is a principle flowchart of a method for preprocessing video data information in an embodiment of the present invention. Wherein, the method steps may include:

S21: converting the received video data information from an analog image signal form to a parallel digital signal form;

S22: Convert video data information in the form of parallel digital signals into video data information in the form of serial digital signals.

Through the above configuration process, the video data information received by the audio and video acquisition device can be converted from the image analog signal form to the parallel digital signal form, thereby reducing the amount of storage occupied by the information and facilitating transmission and processing.

In addition, since the video data information received from the outside may include unnecessary information such as noise, it is necessary to perform optimization processing such as denoising on the received video data information. Specifically, FIG. 3 is a flowchart of a method for secondary processing performed by the smart device in the embodiment of the present invention. Among other things, the process can include:

A1: Process the preprocessed video data information into multiple channels of video data information with different resolutions;

In this embodiment, in order to automatically select the video data information corresponding to the resolution according to the current signal transmission capability when displaying the video, the preprocessed video data information can be cut and compressed first in the smart device etc. to generate multiple channels of video data information with different resolutions.

A2: Optimizing the multiple channels of video data information with different resolutions;

As mentioned above, there may be noise signals in the received video data information, and the quality of the video information needs to be improved. Therefore, image optimization processing can also be performed on the video data information in the smart device. That is, the above-mentioned optimization processing in this embodiment may include performing image enhancement processing and anti-shake processing on the preprocessed video data information, wherein the image enhancement processing includes at least image denoising processing and sharpening processing to improve the image quality of the video data. video quality.

A3: Encoding and superimposing the optimized video data information of different resolutions, wherein the encoded video data information is stored in the smart device for reading, and after the superimposition processing The video data information is returned to the glasses body for playback and display.

In the embodiment of the present invention, the optimized video data information may be encoded according to different protocols to obtain different encoded data streams. For example, the above-mentioned protocols may include JPG protocol, MJPEG protocol, H.264 protocol and H.265 protocol. .264 or H.265 format.

In addition, in this embodiment, other information may also be superimposed on the video data information to present different display states. That is, the above superimposition processing may include superimposing time information or identification information on the optimized video data information of different resolutions. The identification information may include graphic information and text information in any form that need to be superimposed. The above superimposed information can be used for displaying, prompting and other functions.

In a preferred embodiment of the present invention, the smart device can also perform three-level processing operations on the encoded video data information; as shown in Figure 4, the method for performing three-level processing operations by the electronic device in the embodiment of the present invention A flowchart, the method may include:

B1: Decoding the encoded video data information received from the smart device for display or format conversion; the format conversion includes converting the decoded video data information into a YUV format;

B2: storing or sending the format-converted video data information to the glasses body for display.

In the embodiment of the present invention, the smart device may include one or more electronic devices connected to the glasses body. As in the embodiment of the invention, the smart device may include a terminal connection device connected to the glasses body, and a The electronic device, the terminal connection device can be configured as a connector capable of accommodating or installing the electronic device, and the terminal connection device and the electronic device can process the video and audio data acquired by the glasses body to reduce the size of the glasses body. In addition, since the electronic device can be installed in the terminal connection device, it can achieve the effect of being convenient to carry.

Specifically, the electronic device receives the transmitted video data information by connecting with the terminal connection device, or sends processed video data information that needs to be played to the smart terminal connection device. That is, the electronic device side can also further edit the video data information.

For example, the electronic device in the embodiment of the present invention can decode the received encoded video data information, and convert the decoded video data information into a data format that can be displayed on a display device, such as YUV format . On the one hand, the electronic device can display the video data information adapted to the format on its equipped display device, and on the other hand, it can also send the adapted video data information to the terminal connection device, so that The video data information is superimposed and finally displayed in the glasses body. It should be noted here that the communication between the electronic device and the smart terminal device may include data information for controlling superimposition thereof, so that the terminal connection device performs superimposition processing.

In addition, the data processing and device in the glasses body in the embodiment of the present invention can also process the audio data information received by the audio and video acquisition device, and output the processed audio data information.

Specifically, as shown in FIG. 5, it is a schematic flowchart of the audio processing process in the embodiment of the present invention, which may include:

C1: Receive audio data information;

Similarly, the audio and video acquisition device in the glasses body in the embodiment of the present invention can also receive audio information, and the audio information may generally include various noise information, and the data processing device in the glasses body can perform a Optimized operation of audio data information.

C2: Denoise the audio data information, and transmit the denoised audio data information to the terminal connection device;

That is to say, the data processing apparatus in the embodiment of the present invention may include a denoising module to remove noise information in audio data information. Moreover, the denoised audio data information can also be sent to the terminal connection device for further processing.

The processing operation performed by the terminal connection device on the denoised audio data information may include: encoding the denoised audio data information through at least one audio protocol, and returning the encoded audio data information to the glasses The main body plays or sends the audio data information to the electronic device connected to the terminal connection device for voice analysis and processing.

C3: receiving and playing the processed audio data information returned from the terminal connection device.

The glasses body in this embodiment receives the processed audio data information from the terminal connection device, and can perform audio playback processing and storage processing on the part of the audio data information. In addition, the processed audio data information returned from the terminal connection device may include: the encoded audio data information of the terminal connection device and the audio information stored in the electronic device, and the stored audio data information may include the audio data information directly received by the electronic device Audio information and audio information decoded by electronic devices.

The electronic device in this embodiment can receive the encoded audio data information sent by the terminal connection device connected to it, and can decode the audio data information, store it and output audio at the same time.

In addition, in a preferred embodiment, when transmitting data information between the glasses body and the terminal connection device, and between the terminal connection device and the electronic device, before sending the video data stream and the audio data stream, preferably the data to be sent The stream performs compression operations to reduce the amount of transmitted data and speed up the transmission speed. As the receiver side, when receiving the compressed data, it can obtain the corresponding data flow information through decompression operations, and then perform corresponding operations .

In addition, the embodiment of the present invention also provides a smart glasses system that applies the method described in the above embodiments, as shown in FIG. 6 is a schematic structural diagram of the smart glasses system in the embodiment of the present invention, and FIG. The principle structure diagram of the glasses body in the embodiment of the invention; FIG. 8 is the principle structure diagram of the data processing device in the embodiment of the invention; FIG. 9 is the principle structure diagram of the intelligent terminal device in the embodiment of the invention.

Wherein, the smart glasses system may include a glasses body 100 and a smart device connected to the glasses body 100 . It should be noted here that the smart device may include at least one device for processing and analyzing the audio data and video data acquired by the glasses body 100, so as to speed up data processing and reduce the difficulty of data processing. In the following embodiments, the smart device includes the terminal connection device 200 and the electronic device 300 as an example for illustration, but in other embodiments, the functional configuration of the terminal connection device 200 and the electronic device 300 may be integrated on one device, or They are respectively integrated on multiple different devices, that is to say, the smart device in the embodiment of the present invention may include one or more devices that can be connected through communication, and the description of the following embodiments is not intended as a limitation of the present invention.

As mentioned above, the smart glasses system in the embodiment of the present invention may further include a terminal connection device 200 connected to the glasses body 100 . In addition, in a preferred embodiment, the terminal connection device 200 can also be connected with other electronic devices 300 to establish a connection between the glasses body 100 and the electronic device 300 . It should be noted that, in the embodiment of the present invention, the communication between the glasses body 100 and the terminal connection device 200 and between the terminal connection device 200 and the electronic device 300 is preferably performed in a wired connection manner.

The glasses body 100 in this embodiment serves as a terminal for acquiring audio and video data, and can play and display processed video information and audio information. That is to say, the glasses body 100 in the embodiment of the present invention may include: an audio and video acquisition device 101 for acquiring audio data information and video data information, an audio and video playback device 102 for playing audio data information and video data information, And a data processing device 103 electrically connected to the audio and video acquisition device and the audio and video playback device. Wherein, the audio and video acquisition device 101 may include a camera and a sound receiving device. The audio and video playback device 102 may include a display screen, a speaker, and the like.

In addition, the data processing device 103 in this embodiment can preprocess the video data information acquired by the audio and video acquisition device, and send the preprocessed video data information to the terminal connection device; and be configured to connect the terminal The video data information returned by the device is stored and displayed on the audio and video playback device. Specifically, the data processing device 103 in this embodiment may include a first conversion unit 1031 and a second conversion unit 1032 that are electrically connected, wherein the first conversion unit 1031 can be connected to the glasses body 100 by wire, and the audio and video acquisition device The video data information received by 101 is converted from an analog image signal form to a parallel digital signal form, and the second conversion unit 1032 can convert the video data information in the form of a parallel digital signal output by the first conversion unit 1031 into video data in the form of a serial digital signal information. Through the above configuration process, the video data information received by the audio and video acquisition device 101 can be converted from the image analog signal form to the parallel digital signal form, thereby reducing the occupied storage capacity of the information and facilitating transmission and processing.

In addition, for the processing of audio streams, the data processing device 103 in the embodiment of the present invention may also include a denoising module 1033, which can denoise the audio data information received by the audio and video acquisition module 101, and The denoised audio data is sent to the terminal connection device for further encoding and other processing.

The audio and video playback device 102 can obtain processed audio information and video information from the terminal connection device 200 by connecting to the terminal connection device 200 for display and playback. The audio and video playback device 102 in this embodiment may include devices such as a display screen and a speaker.

As shown in FIG. 9 , the terminal connection device 200 can process the received video data information preprocessed by the data processing device 103 into multiple channels of video data information with different resolutions, and respectively resolve the multiple channels of different resolutions. The video data information of different resolutions is optimized, and the optimized video data information of different resolutions is encoded and superimposed, wherein the encoded video data information is stored in the terminal connection device for read, and the superimposed video data information is returned to the glasses body for playback and display.

For example, the terminal connection device 200 in this embodiment of the present invention may include a resolution processing module 201 , an optimization module 202 , an encoding module 203 and a superposition module 204 . Among them, the resolution processing module 201 is connected with the data processing module 103, and receives the preprocessed video data information, and performs cutting and scaling processing on the received video data information, thereby obtaining multiple channels of video data information with different resolutions . The optimization module 202 may be connected with the resolution processing module 201 , the encoding module 203 and the superposition module 204 . Since there may be noise signals in the video data information received by the audio and video acquisition device 101, and the quality of the video information needs to be improved, the optimization module 202 can also perform image optimization processing on the video data information. Specifically, the optimization module 202 can perform image enhancement processing and anti-shake processing on the preprocessed video data information, wherein the image enhancement processing at least includes image denoising processing and sharpening processing, so as to improve the video quality of the video data. The encoding module 203 can encode the video data information output by the optimization module 202. In the embodiment of the present invention, the optimized video data information can be encoded according to different protocols to obtain different encoded data streams. For example, the above-mentioned protocols may include JPG protocol, MJPEG protocol, H.264 protocol and H.265 protocol. .264 or H.265 format.

In addition, the overlay module 204 may also perform overlay processing on the video data information optimized by the optimization module 202 . By superimposing other information in the video data information, different display states can be presented. That is, the above superimposition processing may include superimposing time information or identification information on the optimized video data information of different resolutions. The identification information may include graphic information and text information in any form that need to be superimposed. The above superimposed information can be used for displaying, prompting and other functions.

In this embodiment, the encoded video data information is stored in the terminal connection device for reading, and the superimposed video data information is returned to the glasses body for playback and display.

For audio data processing, the encoding module in the terminal connection device 200 can also encode the audio data information denoised by the denoising module 1033, and the encoded audio data information can be transmitted to the electronic device connected to the terminal connection device 200. Alternatively, the device 300 may output the decoded audio data information returned by the electronic device to the glasses body 100 for playback.

As mentioned above, the smart glasses system in the embodiment of the present invention may further include an electronic device 300 installed on and connected to the terminal connection device 200 . The electronic device 300 can receive encoded video data information from the terminal connection device, and perform video decoding operations; and is configured to display and control the decoded video data information and send it back to the terminal connection device .

Next, the process of establishing a connection and realizing a communication connection between the terminal connection device 200 and the electronic device 300 will be described in detail.

The way to establish communication between the terminal connection device 200 and the electronic device 300 may be to use the ADB service module in the terminal connection device 200 to establish a TCP connection with the electronic device. At this time, the glasses body 100 is equivalent to an adb server. Electron is equivalent to an adb client.

Moreover, the format of the transmission control command between the terminal connection device 200 and the electronic device 300 is: public header+message, according to the different types of messages in the public header, and the data formats of different messages, the length of the message in the public header is the length of the attached message. Effective data length, if the message length is 0, it indicates that the current message packet has only the header and no other data. Messages are transmitted in network byte order. The following table 1 is the format of the public header:

Table 1

illustrate type size (byte) message type enumerate 4 error number integer 4 message length unsigned integer 4

The format of the transmission data information (video stream and audio stream) between the terminal connection device 200 and the electronic device 300 is: public packet header + message body) + attached data load, depending on the type of the message in the public packet header, and the attached different messages Data format, the message length in the public header is the effective data length of the attached message body and attached data payload, if the message length is 0, it indicates that the current message packet only has the header and no other data. Messages are transmitted in network byte order.

In addition, the following describes the processing of the data stream in detail. For video data processing, the electronic device 300 may include a decoding module 301 , a format processing module 302 and an audio processing module 303 . Wherein, the decoding module 301 can be connected with the encoding module 203 in the terminal connection device 200, and can decode the encoded video data information. The format conversion module 302 can convert the decoded video data information into an adapted format that can be played by the display device, such as YUV format. On the one hand, the electronic device 300 can display the format-adapted video data information on its equipped display device, and on the other hand, it can also send the adapted video data information to the terminal connection device, so that the terminal connection device The video data information is superimposed, that is, sent to the superimposing module 204, and finally displayed in the glasses body. It should be noted here that the communication between the electronic device and the smart terminal device may include data information for controlling superimposition thereof, so that the terminal connection device performs superimposition processing.

For audio data processing, the audio processing module 303 in the electronic device can also process and analyze the audio data information encoded by the encoding module to perform speech recognition, so as to obtain specific information of the audio data. The electronic device in the embodiment of the present invention can also send the audio information stored in it to the smart terminal connection device, and the audio information after processing and analysis, and control the smart terminal connection device to send the audio information to be played to the glasses body. Similarly, the electronic device 300 can also control the terminal connection device 200 to send the video information stored therein to the glasses body, and display and play the processed video information.

To sum up, the embodiment of the present invention can process the audio and video information received by the smart glasses through the terminal connection device without adding additional configurations in the smart glasses, so that the smart glasses can be worn more lightly and at the same time More functional configurations can be realized; in addition, the processing of audio and video data information in the embodiment of the present invention can enhance the signal strength and display and playback effects of audio and video information.

The above embodiments are only exemplary embodiments of the present invention, and are not intended to limit the present invention, and the protection scope of the present invention is defined by the claims. Those skilled in the art can make various modifications or equivalent replacements to the present invention within the spirit and protection scope of the present invention, and such modifications or equivalent replacements should also be deemed to fall within the protection scope of the present invention.

Claims (16)

1. A data stream processing method applied in a smart eyewear system comprising an eyewear body and a smart device, the method comprising a video processing process comprising:

receiving video data information including video information;

preprocessing the video data information, and sending the preprocessed video data information to intelligent equipment to execute secondary processing operation;

and receiving, playing and displaying the video data information subjected to the secondary processing.

2. The method of claim 1, wherein pre-processing the video data information comprises:

converting the received video data information from an analog image signal form to a parallel digital signal form;

and converting the video data information in the form of the parallel digital signals into video data information in the form of serial digital signals.

3. The method of claim 1, wherein the smart device performing secondary processing operations comprises:

processing the preprocessed video data information into a plurality of paths of video data information with different resolutions;

respectively carrying out optimization processing on the multiple paths of video data information with different resolutions;

and carrying out encoding processing and overlapping processing on the video data information with different resolutions after the optimization processing, wherein the video data information after the encoding processing is stored in the intelligent equipment for reading, and the video data information after the overlapping processing is returned to the glasses body for playing and displaying.

4. The method of claim 3, wherein processing the pre-processed video data information into a plurality of different resolution video data information comprises:

and generating a plurality of paths of video data information with different resolutions by cutting and scaling the preprocessed video data information.

5. The method according to claim 3, characterized in that said optimization process comprises at least: the image enhancement processing comprises denoising processing and sharpening processing.

6. The method of claim 3, wherein the encoding process comprises: encoding into JPG format, MJPEG format, H.264 or H.265 format.

7. The method of claim 3, wherein the overlay process comprises: superimposing time information or identification information.

8. The method of claim 3, further comprising: performing three-level processing operation on the video data information subjected to the encoding processing by the intelligent equipment; wherein the three-stage processing operation comprises:

performing a decoding operation on the encoded video data information for display or format conversion;

the format conversion comprises converting the decoded video data information into YUV format;

and storing the video data information after format conversion or sending the video data information to the glasses body for display.

9. The method of claim 1, wherein the method further comprises an audio processing process comprising:

receiving audio data information;

denoising the audio data information, and transmitting the denoised audio data information to the intelligent equipment;

and receiving and playing the processed audio data information returned from the intelligent equipment.

10. The method of claim 9, wherein the processing operations performed by the smart device on the denoised audio data information comprise: and coding the denoised audio data information through at least one audio protocol, and transmitting the coded audio data information back to the glasses body for playing or transmitting the audio data information to the electronic equipment connected with the intelligent equipment for voice analysis and processing.

11. The method of claim 10, wherein the processed audio data information transmitted back from the smart device comprises: the audio data information coded by the intelligent equipment and the audio information stored in the electronic equipment.

12. An intelligent glasses system comprises a glasses body and an intelligent device connected with the glasses body; wherein,

the glasses body includes: the system comprises audio and video acquisition equipment for acquiring audio data information and video data information, audio and video playing equipment for playing the audio data information and the video data information, and data processing equipment electrically connected with the audio and video acquisition equipment and the audio and video playing equipment;

the data processing equipment is configured to preprocess the video data information acquired by the audio and video acquisition equipment and send the preprocessed video data information to the intelligent equipment; and the intelligent device is configured to store the video data information returned by the intelligent device and display the video data information on the audio and video playing device.

13. The system of claim 12, wherein the data processing device includes a first conversion portion and a second conversion portion electrically connected, wherein the first conversion portion is configured to convert video data information received by the audio video capture device from an analog image signal form to a parallel digital signal form, and the second conversion portion is configured to convert the video data information in the parallel digital signal form to video data information in a serial digital signal form.

14. The system of claim 12, wherein the smart device is configured to process the received preprocessed video data information into multiple paths of video data information with different resolutions, optimize the multiple paths of video data information with different resolutions, and encode and superimpose the optimized video data information with different resolutions, wherein the encoded video data information is stored in the smart device for reading, and the superimpose processed video data information is returned to the glasses body for playing and displaying.

15. The system of claim 12, wherein the smart device is configured to perform a video decoding operation on the encoded processed video data information; and is configured to perform display control on the decoded video data information.

16. The system according to claim 12, wherein the data processing device is further configured to denoise the audio data information received by the audio/video acquisition device, transmit the denoised audio data information to the smart device, and store and play the audio data information returned by the smart device on the audio/video playing device.