CN107817964A - Electronic equipment, display system and its integrated control device - Google Patents

Abstract

The application discloses electronic equipment, a display system and an integrated control device thereof. The integrated control device includes: a display unit, used to provide a display drive signal to the display screen; a plurality of sensor units, respectively used to collect sensing data from various sensors; a processor, used to control the display unit and the plurality of sensor units , managing and coordinating the multiple sensor units according to the received application instructions; and a communication interface, used for communicating with the main control unit of the electronic device. Simplifies system design complexity and reduces the burden on the main control chip.

Description

Electronic equipment, display system and its integrated control device

technical field

The present application relates to the field of display technology, and more specifically, to electronic equipment, a display system and an integrated control device thereof.

Background technique

With the advent of the era of big data, the security of massive data has become a key issue that must be effectively resolved in "human-computer interaction". The display screens configured on electronic devices are not only used to display images and texts, but also further develop into an important way of human-computer interaction. A touch sensor, a fingerprint sensor, an audio sensor, an image sensor, etc. can be integrated on the display screen to form a display system. Users can directly input text on the display screen, select icons, gesture control, and perform biometric identification operations such as fingerprints, voiceprints, irises, and faces.

In the traditional technology, various sensors and display screens are independent components, and each is connected to the main control unit of the electronic device through a separate control unit. Due to the large number of components and complex functions, the assembly process is complicated, it takes up a lot of space and may interfere with each other, the size of the whole machine is large, and it is difficult to make it thinner. For smart devices such as mobile phones, due to the limitations of the above components, the screen-to-body ratio is relatively small, assembly is difficult, and the cost is high. On the other hand, since various components are directly coordinated and managed by the main control chip, the main control unit of the electronic device has a heavy workload.

Contents of the invention

In view of the above problems, the object of the present invention is to provide an electronic device, a display system and an integrated control device thereof, wherein a plurality of sensor units are integrated in the integrated control device of the display system, and the integrated control device performs display driving while, It can also uniformly manage and coordinate the multiple sensor units for data collection and transmission, thereby simplifying system design complexity and reducing the burden on the main control chip.

According to the first aspect of the present invention, an integrated control device is provided, comprising: a display unit, used to provide a display driving signal to the display screen; a plurality of sensor units, respectively used to collect sensing data from various sensors; a processor, used to For controlling the display unit and multiple sensor units, managing and coordinating the multiple sensor units according to the received application instructions; and a communication interface for communicating with the main control unit of the electronic device.

Preferably, at least one sensor unit of the plurality of sensor units includes: a first interface for communicating with a corresponding sensor; a logic module for providing a driving signal to a corresponding sensor and receiving an induction from the corresponding sensor signal, and amplifying and digital-to-analog conversion on the received sensing signal to generate sensing data; and a second interface for communicating with the processor.

Preferably, at least one sensor unit among the plurality of sensor units further includes: a third interface for communicating with the main control unit.

Preferably, the processor is further configured to process at least part of the sensing data, and output at least one of sensing data, processed sensing data and processing results through the communication interface.

Preferably, the integrated control device further includes: a non-volatile memory for storing at least one of sensing data, processed sensing data and processing results.

Preferably, the various sensors include at least one of a touch sensor, a fingerprint sensor, a palm sensor, an audio sensor, and an image sensor.

Preferably, the integrated control device is a single chip.

According to a second aspect of the present invention, a display system is provided, including: a display screen for displaying images according to display data; at least one sensor for acquiring user interaction sensing signals; and the aforementioned integrated control device.

According to a third aspect of the present invention, there is provided an electronic device, including: the above-mentioned display system; and a main control unit, configured to send an application command to the display system and perform data transmission with the display system, the application command Contains information related to the management and scheduling of the various sensors in the display system.

According to the embodiment of the present invention, in addition to the display driving function, the integrated control chip also integrates a plurality of sensor units inside. The processor can assist the main control unit of electronic equipment to manage and coordinate the data collection and transmission of various sensor units, which simplifies the system design and reduces the burden on the main control unit compared with traditional technologies.

In a preferred embodiment, each module of the integrated control device is integrated into a single chip. Further, the flash memory is also integrated into the chip of the integrated control device. The use of the integrated control device can reduce the structural size of the existing display module, reduce the number of electronic components, reduce design complexity, and increase the yield.

Description of drawings

The above and other objects, features and advantages of the present invention will be more apparent through the following description of the embodiments of the present invention with reference to the accompanying drawings.

FIG. 1 shows an equivalent circuit diagram of a liquid crystal display device in a display system according to an embodiment of the present invention.

FIG. 2 shows an equivalent circuit diagram of a touch device in a display system according to an embodiment of the present invention.

Fig. 3 shows a schematic diagram of the internal structure of a display system according to an embodiment of the present invention.

FIG. 4 shows a schematic diagram of circuit connections of an electronic device including a display system according to an embodiment of the present invention.

Fig. 5 shows a schematic block diagram of an electronic device including a display system according to an embodiment of the present invention.

Fig. 6 shows a schematic block diagram of a sensor unit according to an embodiment of the invention.

Fig. 7 shows a schematic block diagram of an integrated control device in a display system according to an embodiment of the present invention.

Fig. 8 shows a schematic block diagram of another integrated control device in a display system according to an embodiment of the present invention.

FIG. 9 shows a time sequence diagram of display and touch in a display system using a time-division multiplexing method according to an embodiment of the present invention.

Detailed ways

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings. In the various figures, identical elements are indicated with similar reference numerals. For the sake of clarity, various parts in the drawings have not been drawn to scale. Also, some well-known parts may not be shown.

In the following, many specific details of the present invention are described, such as device structures, materials, dimensions, processing techniques and techniques, for a clearer understanding of the present invention. However, the invention may be practiced without these specific details, as will be understood by those skilled in the art.

In this application, the term "local" means that it is arranged inside the chip of the integrated control device at the display screen side, or located on the same printed circuit board as the integrated control device. For example, "local verification" means that the verification program is executed by the processor inside the chip of the integrated control device, and "local storage" means that the non-volatile memory for storing characteristic data, encryption program and verification program is located inside the chip of the integrated control device , or on the same printed circuit board as the integrated control unit.

The invention can be embodied in various forms, some examples of which are described below.

A display system according to an embodiment of the present invention includes a display device and at least one sensor for acquiring user information. The display device is, for example, any one selected from a liquid crystal display, an LED display, an AMOLED display, a quantum dot display, electronic paper, and a MicroLED display. The sensor is, for example, any one selected from a touch device, a fingerprint sensor, an optical sensor, and an acoustic sensor. In the following embodiments, a touch liquid crystal display is taken as an example for illustration, wherein the display device is a liquid crystal display device, and the sensor is a touch device.

FIG. 1 shows an equivalent circuit diagram of a liquid crystal display device in a display system according to an embodiment of the present invention.

The liquid crystal display device 110 includes a gate driving module 111 , a source driving module 112 , a plurality of thin film transistors T, and a plurality of pixel capacitors C _LC formed between a pixel electrode and a common electrode. The multiple thin film transistors T form an array. The gate driving module 111 is respectively connected to the gates of the thin film transistors T in the corresponding row via a plurality of gate scanning lines, and is used to provide gate voltages G1 to Gm in a scanning manner, so that in one image frame period, the gates are different from each other. line of thin film transistors. The source driving module 112 is respectively connected to the sources of the thin film transistors T in the corresponding columns via a plurality of source data lines, and is used to provide the plurality of thin film transistors T in each column when the plurality of thin film transistors T in each row are gated. Gray scale voltages S1 to Sn corresponding to gray scales. Among them, m and n are natural numbers. The drains of the plurality of thin film transistors T are respectively connected to a corresponding pixel capacitor C _LC .

In the gate-on state, the source driving module 112 applies the grayscale voltage to the pixel capacitor C _LC via the source data line and the thin film transistor T. The voltage on the pixel capacitor C _LC acts on the liquid crystal molecules, thereby changing the orientation of the liquid crystal molecules, so as to realize the light transmittance corresponding to the gray scale. In order to hold the voltage between refresh cycles of the pixel, the pixel capacitor C _LC can be connected in parallel with the storage capacitor Cs for a longer holding time.

FIG. 2 shows an equivalent circuit diagram of a touch device in a display system according to an embodiment of the present invention.

The touch device 120 includes a touch driving module 121 , a touch sensing module 122 , and a plurality of sensing capacitors CT formed between the excitation electrodes and the sensing electrodes. The plurality of sensing capacitors CT form an array. The touch driving module 121 is connected to the excitation electrodes of all rows, and is used for providing excitation signals Tx1 to Txm in a scanning manner, so as to sequentially provide excitation signals to the excitation electrodes of different rows in one touch frame period. The touch sensing module 122 is connected to the sensing electrodes of all columns, so as to receive the receiving signals Rx1 to Rxn of the corresponding columns. Among them, m and n are natural numbers.

The touch driving module 121, for example, generates an alternating current signal as an excitation signal, and the touch sensing module 122, for example, receives the alternating current signal, detects the current value according to the received signal, and further obtains the capacitance value at the intersection of the driving electrode and the sensing electrode according to the magnitude of the current value , so as to determine whether a touch action occurs at this point.

Fig. 3 shows a schematic diagram of the internal structure of a display system according to an embodiment of the present invention. In this embodiment, the display system is a touch screen 100 .

As shown in the figure, the touch display screen 100 includes a liquid crystal screen, a touch sensor 171 and a glass cover 172 sequentially stacked on it. The liquid crystal screen includes a backlight illuminating unit 131 for providing backlight and a liquid crystal panel for changing light transmittance according to grayscale signals. The touch sensor 171 uses, for example, a plastic sheet as a substrate.

The liquid crystal panel further includes a first glass substrate 141, a second glass substrate 142, and a liquid crystal layer 161 sandwiched between them in sequence. A first polarizer 142 and a TFT array 143 are formed on the first glass substrate 141. A second polarizer 152 and a color filter 153 are formed on the second glass substrate 142 . exist

The first glass substrate 141 also forms a plurality of gate scanning lines, a plurality of source data lines and a plurality of pixel electrodes, and the TFT array 143 includes a plurality of thin film transistors, and the gates of the thin film transistors are connected to a corresponding gate scanning line. line, the source is connected to a corresponding source data line, and the drain is connected to a corresponding pixel electrode. A pixel capacitance is formed between the pixel electrode and the common electrode. As described below, the liquid crystal panel also includes a driver chip, and the gate driver module and the source driver module in the driver chip provide gate voltage and gray scale voltage respectively.

In the gate-on state of the thin film transistor, the source driving module applies the gray scale voltage to the pixel capacitor C _LC via the source data line and the thin film transistor. The voltage on the pixel capacitor C _LC acts on the liquid crystal molecules, thereby changing the orientation of the liquid crystal molecules, so as to realize the light transmittance corresponding to the gray scale, thereby realizing the corresponding gray scale display.

In this embodiment, a touch display screen 100 with "sensor embedded in the cover" is shown to illustrate the basic principle of the present invention. However, the present invention can be applied to touch display screens of various structures, and is not limited to the type of sensor and its integration method in the display screen.

Using this design method, the touch sensor 171 is either added on the cover glass (Cover Glass, CG), or placed in a dedicated sensor layer. The method of integrating the touch sensor 171 on the glass cover is sometimes called "Sensor-on-Lens (SoL)" or "One Glass Solution (OGS)", because This method does not need to add a separate sensor layer, only the glass cover can be used. The design method of using a separate touch sensor 171 is called glass-film (Glass-Film, GF) or glass-film-film (Glass-Film) -Film, GFF), the former uses a single-layer electrode, and the latter uses a two-layer electrode. These design methods are called "separated", that is, the touch sensor 171 is stacked on the surface of the liquid crystal screen as an independent structure. Separated The advantage of the touch sensor overlay is that the technology is mature, the risk is low, and the product is launched quickly. When adopting the latest display and touch technology, a separate design is also used. In this case, the separate design is often used in the subsequent design process. design integrated.

In a further improved structure, the electrode array of the touch sensor 171 is directly integrated on one or more layers of the liquid crystal screen. This integration can be implemented on or within the basic unit in the display, that is, On-Cell integration or In-Cell integration.

The method of disposing the touch electrode array on the second glass substrate 151 is called out-of-cell integration, because the sensor is located on the basic unit of the display screen. The drive and receive electrodes of the sensor can be electrically isolated from the jumper wires, or can be arranged in a special layout so that these grids can be implemented without bridging. The latter design is called Single-Layer-On-Cell (SLOC), which is very common because of its lower cost and higher yield.

It is simple and reliable to add touch function to the display screen by adopting out-embedded technology, and this method is often the best choice for Active-Matrix Organic Light Emitting Diode (AMOLED) display screen. For larger displays and curved or flexible displays, out-of-the-box integration of jumperless metal mesh sensors is also a good option.

Another type of embedded integration is a hybrid design, in which the driving electrodes of the touch sensor are embedded on the first glass substrate 141 , while the receiving electrodes are externally embedded on the second glass substrate 151 . This approach is called a hybrid multi-point embedded (Hybrid In-Cell) design. To avoid confusion, the term "Full In-Cell" means that both the driving electrodes and the receiving electrodes are located within the base unit.

In this embodiment, a touch sensor is integrated in the display system. In an alternative embodiment, in addition to the touch sensor, various bio-optical sensors, such as fingerprint sensors, acoustic sensors, and optical sensors, can also be integrated to collect biometric information such as fingerprints, voiceprints, and irises.

FIG. 4 shows a schematic diagram of circuit connections of a display system according to an embodiment of the present invention. In this embodiment, the display system is a touch screen 100 . The touch display screen 100 further includes an integrated control chip 210, which is used to provide display driving signals for the thin film transistors in the liquid crystal screen, including gate voltage and gray scale voltage, and to control the touch driving signals for the driving electrodes in the touch sensor, And the receiving signal is obtained from the receiving electrode in the touch sensor to determine the touch position. The integrated control chip 210 is connected to the main board 410 via the connecting component 310 . The connection component 310 is, for example, a flexible circuit board. The mainboard 410 includes a main processor (hereinafter referred to as the main control unit 410 ) as a main control unit for realizing the function of the operating system.

The integrated control device in the prior art is used to realize at least one of display driving and touch driving functions, but cannot manage data collection of other sensors such as fingerprint sensor, audio sensor, image sensor, pressure sensor, temperature sensor, humidity sensor, etc. and transmission. Usually these sensors are connected to the main board of the electronic device through a separate control circuit, and are independently controlled by the main control unit on the main board.

Different from the integrated control device of the prior art, the integrated control chip of the embodiment of the present invention not only has the function of display driving, but also integrates a plurality of sensor units inside, respectively for such as fingerprint sensor, audio sensor, image sensor, pressure sensor, etc. , temperature sensor, humidity sensor and other sensors, the processor integrated with the control chip can assist the main control unit of the electronic device to manage and coordinate the data collection and transmission of various sensor units, which simplifies the system design and reduces the The burden on the main control unit.

Fig. 5 shows a schematic block diagram of an electronic device including a display system according to an embodiment of the present invention. As shown in FIG. 5 , the electronic device includes a main control unit 410 and a display system, such as the touch display screen 100 described above. The display system may include: a display device 110; at least one sensor, including but not limited to a touch sensor 120, a fingerprint sensor 130, an audio sensor 140, an image sensor 150, etc.; and an integrated control device, such as the above-mentioned integrated control chip 210.

The integrated control device 210 includes a processor 211 , a storage unit 24 , a display unit 21 , a plurality of sensor units 22 and a communication interface 261 .

As shown in Figure 5, a plurality of sensor units comprise touch unit 221, fingerprint unit 222, audio unit 223 and image unit 224 (hereinafter collectively referred to as sensor unit 22), respectively with touch sensor 120, fingerprint sensor 130, audio sensor 140 and The image sensors 150 are connected to collect sensing data from corresponding sensors and provide them to the processor 211 under the control of the processor 211 .

The main control unit 410 of the electronic device is used to implement the function of the operating system, which may be implemented by an application processor (AP, application processor) of the electronic device.

The processor 211 controls the display unit 21 and the plurality of sensor units 22, and manages and coordinates the plurality of sensor units 22 according to the received application instructions. For example, the main control unit 410 can send application instructions to the integrated control device 210 according to the application requirements, and the application instructions can include information related to the management and coordination of each sensor unit 22, and the processor 211 of the integrated control device 210 can send the application instructions according to the application instructions. Manage and coordinate each sensor unit 22 to collect and transmit sensing data. As an example, the user needs fingerprint verification to turn on the phone. After the fingerprint verification is passed, the user chooses to take a photo through the touch control, then the integrated control device 210 needs to first control the fingerprint unit 222 to collect fingerprint data from the fingerprint sensor 130, and then control the touch control after the fingerprint verification is passed. The unit 221 collects touch data from the touch sensor 120 , and obtains image data from the image sensor 150 through the image unit 224 after the touch operation triggers a photographing operation. The main control unit 410 may send an application instruction to the integrated control device 210 to notify the start and end of the series of operations and the coordination among them. In some embodiments, the processor 211 can also determine whether there is a conflict event from the application instructions. When there is a conflict in the data collection of two or more sensor units, it can be based on preset rules or according to the information from the main control unit 410. coordination information to coordinate the operation of conflicting sensor units. The processor 211 can also perform data processing operations such as data encryption, security verification, and biometric identification based on the sensing data, and provide at least one of the sensing data, data-processed sensing data, and data processing results to the host after packaging. control unit 410. For example, a start bit and a type identifier can be added before the data content, and an end bit and a check bit can be added after the data content. The main control unit 410 can identify the data content as sensing data, processed sensing data and data processing results according to the type flag. Which one of them can also identify which one of the sensing data is touch sensing data, fingerprint data, image data, and audio data.

The storage unit 24 may be a non-volatile memory, such as a flash memory, which may store at least one of sensing data, sensing data subjected to data processing, and data processing results.

The communication interface 231 can support multiple communication protocols and digital I/O, such as I2C protocol and SPI protocol, and provide multiple digital I/O pins. The processor 211 communicates with the main control unit 410 via the communication interface 231 .

The structure of the plurality of sensor units 22 is described below with reference to FIG. 6 , wherein at least one of the plurality of sensor units 22 may have the structure of FIG. 6 . As shown in FIG. 6 , the sensor unit may include a first interface 1 , a second interface 2 , a third interface 3 and a logic module 4 . The first interface 1 is used for communicating with the corresponding sensor, the second interface 2 is used for communicating with the processor 211 , and the third interface 3 is optional and used for communicating with the main control unit 410 . For example, the fingerprint unit 222 in FIG. 5 may include a first interface 1 for communicating with the fingerprint sensor 130, a second interface 2 for communicating with the processor 211, and a fingerprint logic module 4. The fingerprint logic module 4 may be connected via the first interface. 1. Applying a driving signal to the fingerprint sensor 130 and obtaining a sensing signal from the fingerprint sensor 130, amplifying and digital-to-analog converting the received sensing signal to generate sensing data, and providing the sensing data to the processor 211 via the second interface 2. Optionally, the fingerprint unit 222 may further include a third interface 3 for communicating with the main control unit 410 , and the processor 211 may control the fingerprint unit 222 to provide sensing data to the main control unit 410 through the third interface 3 . In some embodiments, when the sensor unit 22 has both the second interface 2 and the third interface 3, two working modes can be set, and in the first working mode, the sensing data collected by the sensor unit 22 is provided to the processor 211, The main control unit 410 obtains sensing data or its processed data through the assistance of the processor 211; in the second working mode, the main control unit 410 directly obtains sensing data from the control sensor unit 22 via the third interface 3, thereby enhancing flexibility , improve processing efficiency.

In addition, in some embodiments, the sensor unit 22 can also adopt other structures as required, for example, for an image sensor 150 such as a camera, it can provide image data that can be processed by the processor 211 and the main control unit 410, the image The unit 224 may include an image data interface for connecting with the processor 211 to realize communication between the image sensor 150 and the processor 211 . In some embodiments, the image unit 244 may include two image data interfaces, one for connecting with the processor 211 and the other for connecting with the main control unit 410, in this case, similar to the above-mentioned manner, the main The control unit 410 can obtain the image data through the assistance of the processor 211 , and can also directly obtain the data from the image sensor 150 .

In addition to the display driving function, the integrated control chip of the embodiment of the present invention also integrates a plurality of sensor units inside, respectively for various sensors such as fingerprint sensor, audio sensor, image sensor, pressure sensor, temperature sensor, humidity sensor, etc. The processor integrated with the control chip can assist the main control unit of the electronic device to manage and coordinate the data collection and transmission of various sensor units, which simplifies the system design and reduces the burden on the main control unit compared with traditional technologies.

Fig. 7 shows a schematic block diagram of an integrated control device in a display system according to an embodiment of the present invention. The display system is, for example, a liquid crystal display.

As shown in the figure, the integrated control chip 210 includes a processor 211 , a communication interface 231 , a storage unit 24 , a display unit 21 and a sensor unit 22 .

The processor 211 is a RISC CPU of von Neumann or Harvard architecture, including but not limited to ARM, MIPS, OPENRISC, etc., preferably ARM; it can also be a DSP, etc. The processor 211 can manage and coordinate the multiple sensor units 22 to collect and transmit sensing data according to the received application instructions. The processor 211 may also be optimized for touch detection or for other types of sensors. Touch input can be handled locally to determine if the operating system needs to be woken up to handle the user request. In some embodiments, the processor 211 can also perform data processing operations such as data encryption, security verification, and biometric identification based on the sensing data, and provide corresponding data to the main control unit 410 via the communication interface 231 as required. For example, the processor 211 may package one or more of unprocessed sensing data, biometric templates, security verification results, and encrypted data to the main control unit 410 .

The communication interface 231 can support multiple communication protocols and digital I/O, such as I2C protocol and SPI protocol, and provide multiple digital I/O pins. The user interface 231 can communicate with the main processor on the motherboard.

The storage unit 24 may include a data RAM 241 , a program RAM 242 , a boot ROM 243 and a flash memory 244 . At least one of the following can be stored in the flash memory 244: sensing data, encrypted data, feature data, encryption program, secret key and verification program. For example, during power-on of the integrated control chip 210, the boot program in the boot ROM 243 detects the flash memory 244, and when encryption is required, an encryption program is loaded from the flash memory 244 to encrypt sensitive data and store the encrypted sensitive data. Data generated by the processor 211 during operation may be stored in the data RAM 241 . In this embodiment, the characteristic data in the flash memory 244 may come from the main processor on the motherboard, or may be characteristic data obtained by local collection and data processing under the control of the processor 211 . In the latter case, not only the user's sensitive data but also characteristic data are generated locally. The operating system only obtains the verification result from the integrated control chip 210, but cannot obtain both sensitive data and characteristic data, which is beneficial to improve security.

The display unit 21 includes a display controller 212, a graphics engine 213, a timing controller 214, a display and graphics interface 215, a gate driver module 216, a source driver module 217, a common voltage driver module 218, a backlight control module 219 and a gamma reference Module 251. The display controller 212 is used for generating graphic data according to the input display data. The graphics engine 213 is used to control memory windows, cursors, pointers and sprite graphics, thereby providing high-performance optimized graphics for touch. The display and graphics interface 215 provides various industry-standard display interfaces for receiving display data, such as DSI TCVR, DBI I/F, and DPI I/F. The backlight control module 219 is used to control the backlight of the liquid crystal screen to realize low power consumption management, so that it can be combined with the existing backlight energy-saving technology. The gate driving module 216 , the source driving module 217 , and the common voltage driving module 218 are respectively used to generate a gate voltage, a gray scale voltage and a common voltage. The timing controller 214 is used to control the output timing of the gate electrodes and the grayscale voltages, so that in one image frame period, the gate voltages G1 to Gm are provided in a scanning manner, and when the thin film transistors in the corresponding row are gated, each A plurality of thin film transistors T in a column provide gray scale voltages S1 to Sn corresponding to gray scales, so as to apply voltages on pixel capacitors to change the orientation of liquid crystal molecules, so as to realize light transmittance corresponding to gray scales. The gamma reference module 251 is used for storing the gamma correction curve, and providing a correction signal to the source driver module 217 for correcting the gray scale voltage, so as to meet the non-linear requirement of the human eye on brightness changes.

The sensor unit 22 includes but is not limited to the above-mentioned touch unit 221, fingerprint unit 222, audio unit 223 and image unit 224, which are respectively connected to the touch sensor 120, fingerprint sensor 130, audio sensor 140 and image sensor 150 for processing Under the control of the controller 211, the sensing data is collected from corresponding sensors and provided to the processor 211. At least one of the plurality of sensor units 22 may have the structure described above with reference to FIG. 6 . In some embodiments, the integrated control chip 210 obtains the identification of each sensor through the hardware interface of the sensor unit 22. For example, it can be considered that the sensing data from the touch unit 221 is provided by the touch sensor 120, and the sensing data from the fingerprint unit 222 is Fingerprint sensor 130 is provided. In an alternative embodiment, each sensor 120 to 150 may transmit the identification and the sensing signal to the integrated control chip 210, so that the integrated control chip 210 can identify which sensor the sensing data comes from. .

The integrated control device according to the prior art has at least one of display driving and touch driving functions, and sensors such as fingerprint sensors, audio sensors, image sensors, pressure sensors and the like are connected to the main board through a separate control unit, and are controlled by the main board on the main board. The main control unit to manage and control.

Different from the prior art, in this embodiment, the integrated control chip 210 integrates a plurality of sensor units 22 for various sensors 120 to 150 respectively, and the processor 211 not only has display driving and touch driving functions, but also It can have multiple sensor functions such as fingerprint collection and image collection. On the one hand, the original independent and scattered sensor control circuits are integrated together to achieve a highly integrated integration effect, reduce assembly processes and minimize the space occupied by components, and simplify the design of human-computer interaction systems. On the other hand, the main control unit of the electronic device does not need to connect and manage a large number of sensors one by one, which reduces the workload of the main control unit. In some embodiments, the integrated control device can also perform some data processing locally, such as data encryption, security verification, etc., so as to further improve security. However, the present invention is not limited thereto. The integrated control chip 210 can form a plurality of chips, and are jointly installed on the circuit board at the display screen end.

In the integrated control chip 210 of this embodiment, the flash memory 244 is used to store at least one of sensing data, feature data, encryption program, encryption data and verification program. However, the present invention is not limited thereto. In an alternative embodiment, the integrated control chip 210 may use any type of non-volatile memory, such as any one selected from flash memory, SRAM, DRAM, EEPROM, and EPROM.

In this embodiment, the flash memory 244 is integrated in the integrated control chip 210 to improve security. In an alternative embodiment, the flash memory 244 may be located outside the integrated control chip 210 and connected to the integrated control chip 210 via a bus to reduce system cost.

Fig. 8 shows a schematic block diagram of another integrated control device in a display system according to an embodiment of the present invention. The display system, for example, uses an AMOLED display.

As shown in the figure, the integrated control chip 220 includes a processor 211, a communication interface 231, a storage unit, a display unit and a touch control unit.

The processor 211 is a RISC CPU of von Neumann or Harvard architecture, including but not limited to ARM, MIPS, OPENRISC, etc., preferably ARM; it can also be a DSP, etc. The processor 211 can manage and coordinate the multiple sensor units 22 to collect and transmit sensing data according to the received application instructions. The processor 211 may also be optimized for touch detection or for other types of sensors. Touch input can be handled locally to determine if the operating system needs to be woken up to handle the user request. In some embodiments, the processor 211 can also perform data processing operations such as data encryption, security verification, and biometric identification based on the sensing data, and provide corresponding data to the main control unit 410 via the communication interface 231 as required. For example, the processor 211 may package one or more of unprocessed sensing data, biometric templates, security verification results, and encrypted data to the main control unit 410 .

The communication interface 231 can support multiple communication protocols and digital I/O, such as I2C protocol and SPI protocol, and provide multiple digital I/O pins. The user interface 231 can communicate with the main processor on the motherboard.

The storage unit 24 may include a data RAM 241 , a program RAM 242 , a boot ROM 243 and a flash memory 244 . At least one of sensing data, feature data, secret key, encrypted data, encryption program and verification program is stored in the flash memory 244 . During power-up of the integrated control chip 220, the boot program in the boot ROM 243 detects the flash memory 244, and loads the encryption program and the authentication program from the flash memory 244, and decrypts and stores the data in the program RAM. Data generated by the processor 211 during operation may be stored in the data RAM 241 . In this embodiment, the characteristic data in the flash memory 244 may come from the main processor on the motherboard, or may be characteristic data obtained by local collection and data processing under the control of the processor 211 . In the latter case, not only the user's sensitive data but also characteristic data are generated locally. The operating system only obtains the verification result from the integrated control chip 220, but cannot obtain both sensitive data and feature data, which is beneficial to further improve security.

The display unit 21 includes a display controller 212 , a graphics engine 213 , a timing controller 214 , a display and graphics interface 215 , a row driver module 226 , a column driver module 227 and a gamma reference module 251 . The display controller 212 is used for generating graphic data according to the input display data. The graphics engine 213 is used to control memory windows, cursors, pointers and sprite graphics, thereby providing high-performance optimized graphics for touch. The display and graphics interface 215 provides various industry-standard display interfaces for receiving display data, such as DSI TCVR, DBI I/F, and DPI I/F. The row driving module 226 and the column driving module 227 are used to generate gate voltage and gray scale voltage respectively. The timing controller 214 is used to control the output timing of the gate electrodes and the grayscale voltages, so that in one image frame period, the gate voltages G1 to Gm are provided in a scanning manner, and when the thin film transistors in the corresponding row are gated, each A plurality of thin film transistors T in a row provide grayscale voltages S1 to Sn corresponding to grayscales, so that currents corresponding to the grayscale voltages are applied to the light emitting diodes to emit light, so as to achieve light brightness corresponding to grayscales. The gamma reference module 251 is used for storing the gamma correction curve, and providing a correction signal to the column driving module 227 for correcting the gray scale voltage, so as to meet the non-linear requirement of human eyes on brightness changes.

The sensor unit 22 includes but is not limited to the above-mentioned touch unit 221, fingerprint unit 222, audio unit 223 and image unit 224, which are respectively connected to the touch sensor 120, fingerprint sensor 130, audio sensor 140 and image sensor 150 for processing Under the control of the controller 211, the sensing data is collected from corresponding sensors and provided to the processor 211. At least one of the plurality of sensor units 22 may have the structure described above with reference to FIG. 6 . In some embodiments, the integrated control chip 220 obtains the identification of each sensor through the hardware interface of the sensor unit 22, for example, it can be considered that the sensing data from the touch unit 221 is provided by the touch sensor 120, and the sensing data from the fingerprint unit 222 is Fingerprint sensor 130 is provided. In an alternative embodiment, each sensor 120 to 150 may transmit the identification and the sensing signal to the integrated control chip 220 so that the integrated control chip 220 can identify which sensor the sensing data comes from.

In this embodiment, a plurality of sensor units 22 for various sensors 120 to 150 are integrated in the integrated control chip 220. In addition to display driving and touch driving functions, the processor 211 can also have fingerprint collection, Various sensor functions such as image acquisition. On the one hand, the original independent and scattered sensor control circuits are integrated together to achieve a highly integrated integration effect, reduce assembly processes and minimize the space occupied by components, and simplify the design of human-computer interaction systems. On the other hand, the main control unit of the electronic device does not need to connect and manage a large number of sensors one by one, which reduces the workload of the main control unit. In some embodiments, the integrated control device can also perform some data processing locally, such as data encryption, security verification, etc., so as to further improve security. In some embodiments, the integrated control device can also perform some data processing locally, such as data encryption, security verification, etc., so as to further improve security. However, the present invention is not limited thereto. The integrated control chip 210 can form a plurality of chips, and are jointly installed on the circuit board at the display screen end.

In the integrated control chip 210 of this embodiment, the flash memory 244 is used to store at least one of sensing data, feature data, encryption program, encryption data and verification program. However, the present invention is not limited thereto. In an alternative embodiment, the integrated control chip 210 may use any type of non-volatile memory, such as any one selected from flash memory, SRAM, DRAM, EEPROM, and EPROM.

In this embodiment, the flash memory 244 is integrated in the integrated control chip 220 to improve security. In an alternative embodiment, the flash memory 244 may be located outside the integrated control chip 220 and connected to the integrated control chip 220 via a bus to reduce system cost.

FIG. 9 shows a time sequence diagram of display and touch in a display system using a time-division multiplexing method according to an embodiment of the present invention.

In practical applications, the display system can integrate various types of sensors. The processor in the integrated control chip 210 has three functions of display driver, sensor driver and security verification, thereby providing a hardware-level security verification mechanism. Various sensing units are in a periodic polling state with a lower operating frequency.

For touch detection, when the sensing unit senses an object touch, it switches to the working state and collects touch data. At this time, the display data and touch data are time-division multiplexed.

For contact biometric identification, such as fingerprint identification, contact biometric identification requires touch. Therefore, the biometric data collected in this way is similar to touch data, and is time-division multiplexed with display data.

For contactless biometrics, presets are available. For the collection that requires manual monitoring, serial data frames can be used to switch the displayed data to the current collected data, and then switch to the original screen to be displayed after the currently displayed collected data is terminated. And if the non-contact biometric identification collection process does not require manual supervision (unsupervised), it can be processed in the background in a time-division multiplexing manner with the display data. For example, when using an image sensor to collect images, it is necessary to manually check whether the real-time collected images meet the requirements, then it can display that the object is currently being captured, and the displayed data at this time is the current data collected by the image sensor.

The situation where touch and display need to be performed synchronously is taken as an example for illustration.

During the blanking period during the image frame switching process, the display unit has little influence on the noise of the touch unit. Therefore, when the device is actually working, the display and touch control adopt the principle of time-division multiplexing, and the display data processing can be separated from the touch data processing in time to reduce mutual interference. During image frame scanning, some time slots are divided as touch frames.

As shown in FIG. 9 , one image frame period includes multiple display time periods TP and multiple touch time periods TP. In different time periods, the display data and the touch data are processed alternately. That is, display and touch are time-shared and multiplexed. Because the human eye has a certain recognition time window for screen changes, there are certain requirements for the frame rate and the time ratio of the two time periods. Adopting this driving method can effectively reduce the influence of the noise electrical signal of the liquid crystal display array on the touch working layer, and also saves the shielding layer and reduces the thickness of the touch display screen.

The above time-division multiplexing function can be operated by a software program, and can also be switched in combination with the MUX multiplexing selection unit.

It should be noted that in this document, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is a relationship between these entities or operations. There is no such actual relationship or order between them. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

Embodiments according to the present invention are described above, and these embodiments do not describe all details in detail, nor do they limit the invention to only the specific embodiments described. Obviously, based on the above description, many modifications and changes can be made, including but not limited to changes to the local structure of the circuit, and replacements of types or models of components. This description selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that those skilled in the art can make good use of the present invention and its modification on the basis of the present invention. The invention is to be limited only by the claims, along with their full scope and equivalents.

Claims (9)

1. An integrated control device, characterized in that, comprising: a display unit, configured to provide display drive signals to the display screen; A plurality of sensor units are respectively used to collect sensing data from various sensors; a processor for controlling the display unit and a plurality of sensor units, managing and coordinating the plurality of sensor units according to received application instructions; and The communication interface is used for communication with the main control unit of the electronic equipment. 2. The integrated control device according to claim 1, wherein at least one sensor unit in the plurality of sensor units comprises: The first interface is used to communicate with the corresponding sensor; a logic module for providing a driving signal to a corresponding sensor and receiving a sensing signal from the corresponding sensor, and amplifying and digital-to-analog converting the received sensing signal to generate sensing data; and The second interface is used for communicating with the processor. 3. The integrated control device according to claim 2, wherein at least one sensor unit in the plurality of sensor units further comprises: The third interface is used for communicating with the main control unit. 4. The integrated control device according to claim 1, wherein the processor is further configured to process at least part of the sensing data, and output the sensing data through the communication interface, after processing At least one of the sensing data and processing results. 5. The integrated control device according to claim 1, further comprising: a non-volatile memory for storing at least one of sensing data, processed sensing data and processing results. 6. The integrated control device according to claim 1, wherein the multiple sensors include at least one of a touch sensor, a fingerprint sensor, a palmprint sensor, an audio sensor, and an image sensor. 7. The integrated control device according to claim 1, wherein the integrated control device is a single chip. 8. A display system comprising: a display screen for displaying images according to the display data; At least one sensor, used to obtain a sensing signal of user interaction; An integrated control device according to any one of claims 1 to 8. 9. An electronic device comprising: A display system according to claim 8; The main control unit is used to send application instructions to the display system and perform data transmission with the display system. The application instructions include information related to the management and scheduling of various sensors in the display system.