CN117724671B - Data communication method, device and storage medium based on multi-screen multi-touch display system - Google Patents
Data communication method, device and storage medium based on multi-screen multi-touch display system Download PDFInfo
- Publication number
- CN117724671B CN117724671B CN202311772639.7A CN202311772639A CN117724671B CN 117724671 B CN117724671 B CN 117724671B CN 202311772639 A CN202311772639 A CN 202311772639A CN 117724671 B CN117724671 B CN 117724671B
- Authority
- CN
- China
- Prior art keywords
- control system
- master control
- data
- communication
- slave
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004891 communication Methods 0.000 title claims abstract description 124
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000012360 testing method Methods 0.000 claims description 20
- 238000010586 diagram Methods 0.000 claims description 16
- 230000005540 biological transmission Effects 0.000 claims description 11
- 238000000605 extraction Methods 0.000 claims description 9
- 230000002269 spontaneous effect Effects 0.000 claims description 5
- 230000006870 function Effects 0.000 description 10
- 230000003993 interaction Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 238000011161 development Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012905 input function Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Digital Computer Display Output (AREA)
Abstract
The invention discloses a data communication method based on a multi-screen multi-touch display system, which comprises the following steps: after the master control system and the slave system are connected in serial ports, the communication protocol of the master control system is modified to debug the communication of the serial ports of the master control system and the slave system; the serial port receiving and transmitting communication between the master control system and the slave system is realized through a definition service; compiling an HTML format file by the main control system, and sending the HTML format file to the slave system for display; and transmitting the operation information of the slave system to the master control system. The invention also discloses a data communication device and a storage medium. The invention can simplify the realization mode of the multi-screen display system and enlarge the applicable scene.
Description
Technical Field
The present invention relates to the field of multi-screen display technologies, and in particular, to a data communication method, apparatus and storage medium based on a multi-screen multi-touch display system.
Background
In the prior art, the intelligent terminal equipment needs to be based on other display interfaces except a main screen on a main control chip when realizing multi-screen display. For example, the platform of MT8390 or the display device of DP and eDP interfaces can be connected with MIPIDSI interfaces on RK3568, but only 2-3 screens can be connected on the whole. Meanwhile, the equipment manufactured by the chip scheme is high in cost, if the display of a plurality of screens is further expanded, a plurality of high-end chips are needed to be used as cascade arrays to customize the equipment, the complexity and the cost of the equipment are increased, and the equipment is not suitable for the requirement of simple display of the auxiliary screen. Many of these products are now forced to cascade multiple higher-order SoC schemes together to do so. The application is dedicated to display based on a virtual one screen out of the host system on the displayed content. All displays and operational feedback (TP feedback) to the display are functions implemented in one system, with some difficulty in the implementation technology.
Disclosure of Invention
The invention mainly aims to provide a data communication method, a device and a storage medium based on a multi-screen multi-touch display system, and aims to solve the problem that the realization difficulty of multi-screen display is high in the prior art.
To achieve the above object, the present invention provides a data communication method,
The method is applied to a multi-terminal display system, the multi-terminal display system at least comprises a master control system and a slave system which are connected through a serial port and are communicated, and the method comprises the following steps:
after the master control system and the slave system are connected in serial ports, the communication protocol of the master control system is modified to debug the communication of the serial ports of the master control system and the slave system;
the serial port receiving and transmitting communication between the master control system and the slave system is realized through a definition service;
Compiling an HTML format file by the main control system, and sending the HTML format file to the slave system for display;
and transmitting the operation information of the slave system to the master control system.
Optionally, the step of debugging the communication of the serial ports of the master system and the slave system by modifying the communication protocol of the master system includes:
Searching a general purpose input/output interface GPIO of the main control system based on a hardware schematic diagram;
Customizing a default function of the GPIO by using a platform tool of the main control system;
Modifying the serial port mode of the GPIO;
and modifying the communication direction of the GPIO.
Optionally, the enabling the serial port of the master control system to send and receive communications with the slave system through the definition service includes:
the serial port spontaneous self-receiving communication between the master control system and the slave system is realized through a definition service;
And the serial port mutual transmission communication between the master control system and the slave system is realized based on the definition service.
Optionally, the step of implementing serial port transceiving communication between the master control system and the slave system through a definition service includes:
Defining serial communication service SerialPortService;
defining a data receiving thread READTHREAD and a data transmitting thread SENDTHREAD in the SerialPortService;
starting service and initializing port information of a serial port;
Initializing an input stream object and an output stream object;
Instantiating a thread READTHREAD object and starting the READTHREAD to monitor and receive data of the input stream object;
and calling SENDTHREAD to write data into the output stream object.
Optionally, after the step of starting the service and initializing the port information of the serial port, the method further includes:
transmitting test data from one end to the other end in the master control system and the slave system;
And if the receiving end does not receive the test data within the preset time, carrying out secondary initialization based on the standby port information.
Optionally, the step of compiling the HTML format file by the master control system and sending the target data to the slave system for display includes:
Compiling an HTML format file based on the target data through the main control system;
Sending the HTML format file to the slave system through the master control system;
And interpreting and displaying the HTML format file through the slave system.
Optionally, the slave system includes an information extraction sensing device, and the step of transmitting the operation information of the slave system to the master system includes:
extracting sensing data by using the information extraction sensing device;
and sending the sensor data to the main control system for display by the main control system.
Optionally, the master system includes an MT8781 platform, and the slave system includes an SC7731E platform; the port of SCAN_TXD1_RST of the MT8781 platform is connected with the U3RXD communication of the SC7731E platform, the port of SCAN_RXD1_PDN of the MT8781 platform is connected with the U3TXD communication of the SC7731E platform
In order to achieve the above object, the present invention further provides a data communication device based on a multi-screen multi-touch display system, the data communication device comprising:
The debugging module is used for debugging the communication of serial ports of the master control system and the slave system by modifying the communication protocol of the master control system after the serial ports of the master control system and the slave system are connected;
the definition service module is used for realizing the serial port transceiving communication between the master control system and the slave system through definition service;
The first sending module is used for compiling the target data into an HTML format file through the main control system and sending the HTML format file to the slave system for display;
And the second sending module is used for sending the operation information of the slave system to the master control system.
In addition, in order to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a data communication program which, when executed by a processor, implements the steps of the data communication method as described above.
The data communication method, the device and the computer readable storage medium based on the multi-screen multi-touch display system provided by the invention are used for debugging the communication of serial ports of the master control system and the slave system by modifying the communication protocol of the master control system after the serial ports of the master control system and the slave system are connected; the serial port receiving and transmitting communication between the master control system and the slave system is realized through a definition service; compiling an HTML format file by the main control system, and sending the HTML format file to the slave system for display; and transmitting the operation information of the slave system to the master control system. Compared with the prior art, the beneficial effects are as follows:
The multi-terminal display system is built based on the independent main control system and the independent sub-system, and the control of the display and the TP is controlled by the independent systems, so that the control is convenient, the main control system and the system can independently process the respective display and TP operation, and even so, the cost is not increased too much; the corresponding application is relatively easy to develop on own system, not only the display operation of the different display is easy to realize, but also the feedback of the display system through own TP operation is easy to realize
When information interaction is needed, serial communication between systems is used, and the serial access of the master control system and the slave system is utilized, so that the expansion is convenient;
The interaction of the display information is realized by adopting a unified interface protocol (HTML), the application scene is enlarged, the convenience of the intervention development of a third party is improved, and the realization stability of the method is enhanced;
and the whole cost of the whole multi-terminal display system is reduced without adopting the expansion of a plurality of main control systems.
Drawings
FIG. 1 is a schematic diagram of a system architecture of a hardware operating environment according to an embodiment of the present invention;
FIG. 2-1 is a schematic diagram of a serial port of an MT8781 platform in an embodiment of a data communication method according to the present invention;
Fig. 2-2 is a schematic diagram of a serial port of an SC7731E platform in an embodiment of the data communication method of the present invention;
FIG. 3 is a flow chart of an embodiment of a data communication method according to the present invention;
FIG. 4 is a diagram illustrating an exemplary display interface for billing a bill according to an embodiment of the data communication method of the present invention;
fig. 5 is an exemplary diagram of the HTML format file corresponding to fig. 4 in the data communication method according to the embodiment of the present invention.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the prior art, the multi-terminal display system has the problem of high implementation difficulty.
In order to solve the technical problem, the present invention provides a data communication method based on a multi-screen multi-touch display system, which is applied to a multi-terminal display system, wherein the multi-terminal display system at least comprises a master control system and a slave system which are connected through a serial port for communication, and the method comprises: after the master control system and the slave system are connected in serial ports, the communication protocol of the master control system is modified to debug the communication of the serial ports of the master control system and the slave system; the serial port receiving and transmitting communication between the master control system and the slave system is realized through a definition service; compiling an HTML format file by the main control system, and sending the HTML format file to the slave system for display; and transmitting the operation information of the slave system to the master control system. Therefore, a multi-terminal display system is built based on data communication between the master control system and the slave system, the mode and difficulty of the multi-terminal display system are simplified, and the applicable scene is expanded.
Referring to fig. 1, fig. 1 is a schematic system architecture diagram of a hardware running environment according to an embodiment of the present invention.
The terminal of the embodiment of the invention can be a terminal device with computing capability, a PC, a mobile terminal device with display function such as a smart phone, a tablet personal computer, an electronic book reader, an MP3 (Moving Picture Experts Group Audio Layer III, dynamic image expert compression standard audio layer 3) player, an MP4 (Moving Picture Experts Group Audio Layer IV, dynamic image expert compression standard audio layer 4) player, a portable computer and the like.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
Optionally, the terminal may also include a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, and so on. Among other sensors, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display screen according to the brightness of ambient light, and a proximity sensor that may turn off the display screen and/or the backlight when the mobile terminal moves to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and the direction when the mobile terminal is stationary, and the mobile terminal can be used for recognizing the gesture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, and the like, which are not described herein.
It will be appreciated by those skilled in the art that the terminal structure shown in fig. 1 is not limiting of the terminal and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a data communication program may be included in the memory 1005, which is a type of computer storage medium.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a background server and performing data communication with the background server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to call a data communication program stored in the memory 1005 and perform the following operations:
after the master control system and the slave system are connected in serial ports, the communication protocol of the master control system is modified to debug the communication of the serial ports of the master control system and the slave system;
the serial port receiving and transmitting communication between the master control system and the slave system is realized through a definition service;
Compiling an HTML format file by the main control system, and sending the HTML format file to the slave system for display;
and transmitting the operation information of the slave system to the master control system.
Further, the processor 1001 may call a data communication program stored in the memory 1005, and further perform the following operations:
Searching a general purpose input/output interface GPIO of the main control system based on a hardware schematic diagram;
Customizing a default function of the GPIO by using a platform tool of the main control system;
Modifying the serial port mode of the GPIO;
and modifying the communication direction of the GPIO.
Further, the processor 1001 may call a data communication program stored in the memory 1005, and further perform the following operations:
the serial port spontaneous self-receiving communication between the master control system and the slave system is realized through a definition service;
And the serial port mutual transmission communication between the master control system and the slave system is realized based on the definition service.
Further, the processor 1001 may call a data communication program stored in the memory 1005, and further perform the following operations:
Defining serial communication service SerialPortService;
defining a data receiving thread READTHREAD and a data transmitting thread SENDTHREAD in the SerialPortService;
starting service and initializing port information of a serial port;
Initializing an input stream object and an output stream object;
Instantiating a thread READTHREAD object and starting the READTHREAD to monitor and receive data of the input stream object;
and calling SENDTHREAD to write data into the output stream object.
Further, the processor 1001 may call a data communication program stored in the memory 1005, and further perform the following operations:
transmitting test data from one end to the other end in the master control system and the slave system;
And if the receiving end does not receive the test data within the preset time, carrying out secondary initialization based on the standby port information.
Further, the processor 1001 may call a data communication program stored in the memory 1005, and further perform the following operations:
Compiling an HTML format file based on the target data through the main control system;
Sending the HTML format file to the slave system through the master control system;
And interpreting and displaying the HTML format file through the slave system.
Further, the processor 1001 may call a data communication program stored in the memory 1005, and further perform the following operations:
extracting sensing data by using the information extraction sensing device;
and sending the sensor data to the main control system for display by the main control system.
The data communication method is applied to the multi-terminal display system, and the multi-terminal display system at least comprises a master control system and a slave system which are connected through a serial port and are used for communication. In a specific implementation scenario of a multi-terminal display system, the number of the master control system and/or the slave system may be one or more than two, and the number is not limited. Specifically, the master control system includes, but is not limited to, an MT8781 platform, the slave system includes, but is not limited to, an SC7731E platform, and the embodiment of the present invention is described by taking the master control system as the MT8781 platform, and the slave system as the SC7731E platform as an example. 2-1 and 2-2, wherein FIG. 2-1 is a schematic diagram of a serial port of an MT8781 platform in an embodiment of the data communication method according to the present invention, and FIG. 2-1 is a schematic diagram of a serial port of an SC7731E platform in an embodiment of the data communication method according to the present invention; when the data communication method is implemented, in the multi-terminal display system, the port of the SCAN_TXD1_RST of the MT8781 is connected with the U3RXD communication of the SC7731E, and the port of the SCAN_RXD1_PDN of the MT8781 is connected with the U3TXD communication of the SC 7731E.
Because a single main control system in the prior art, such as a SoC based on MT8781, does not have multiple interfaces for display, a main controller chip in the market generally cannot support multiple display interfaces on the SoC, because a single main control chip cannot realize the requirements of multiple screen displays. The display requirement also needs to have input control of reverse operation, generally a touch screen is used, so that even if a multi-touch hardware control channel is arranged on a main control system, the support on the corresponding system is also needed on the software implementation, the modification of multi-TP operation is needed on the system (Android) of the main control chip, and the control is needed to be re-carried out in the system, so that the multi-touch consideration is needed on the corresponding application development.
Based on the data communication method, two independent Android systems control the display and TP by separate systems, so that the control is convenient. When information interaction is needed, serial communication between two systems is used. 4 pairs of serial communication paths are arranged on the system of the two, so that the display can be conveniently expanded to 4 groups, and the subsystems of the four groups of SC7731E can independently process the respective display and TP operation, so that the cost is not increased too much. The display information is realized by adopting a unified interface protocol (HTML), so that the method has wider application in the design of the UI interface display of the conventional intelligent system and can enlarge the applicable scene of the multi-terminal display system.
Referring to fig. 3, fig. 3 is a flow chart of an embodiment of a data communication method according to the present invention, and in some embodiments, the data communication method includes:
step S10, after the master control system and the slave system are connected in serial, the communication of the serial ports of the master control system and the slave system is debugged by modifying the communication protocol of the master control system.
Specifically, in some embodiments, step S10 includes:
step S11, searching a general purpose input/output interface GPIO of the main control system based on a hardware schematic diagram.
Step S12, customizing default functions of the GPIO by using a platform tool of the main control system.
Step S13, modifying the serial port mode of the GPIO;
And S14, modifying the communication direction of the GPIO.
Specifically, for the MT8781 platform as the master control system, the hardware schematic diagram is checked to find that the GPIO port corresponding to scan_rxd1_pdn is 21 and the GPIO port corresponding to scan_txd1_rst is 23. Then using a platform tool: mediatek/dct/drvgen. Exe tool customizes the default function of the GPIO port. The initial mode def.mode of GPIO21 and GPIO23 is then modified to 4, i.e. serial mode (corresponding functions may be selected in the DCT Tool). Modifying the direction of the GPIO, i.e. the output/input function; the data transmission direction of the GPIO21 is modified as input, and the data transmission direction of the GPIO23 is modified as output, thereby completing the configuration of the serial port mode. For the 7731E platform, the serial port of the system is used by default, and only the output of log of the serial port needs to be shielded.
And step S20, the serial port transceiving communication between the master control system and the slave system is realized through a definition service.
Specifically, in some embodiments, step S20 includes:
Step S21, the serial port spontaneous self-receiving communication of the master control system and the slave system is realized through a definition service;
And step S22, the serial port mutual communication between the master control system and the slave system is realized based on the definition service.
When the step S20 is implemented, the self-receiving of the UART serial port on the MT8781 Kernel5.10 system is realized by defining a service, then the self-receiving of the UART serial port on the SC7731E Kernel4.19 system is realized, and then the SCAN_TXD1 transmission on the MT8781 Kernel5.10 system is realized, and the U3RXD of the SC7731E is received. While the U3TXD of SC7731E transmits scan_rxd1_pdn reception on the MT8781 kernell5.10 system.
Specifically, in some embodiments, to implement self-receiving and inter-sending communications between the master control system and the slave system, step S20 includes:
In step S23, serial communication service SerialPortService is defined.
Specifically, the RX interface of the serial port is used for receiving data, and the TX interface of the serial port is used for transmitting data; the port of SCAN_TXD1_RST of the MT8781 on hardware is connected with U3RXD of the SC7731E, so that the MT8781 end can send data, the SC7731E end can receive data, the port of SCAN_RXD1_PDN of the MT8781 on hardware is connected with U3TXD of the SC7731E end, the SC7731E end can send data, and the MT8781 end can receive data.
The method can be realized by means of an open source framework Android-serialport-api of Google based on an Android system, and a service name SerialPortService, namely serial communication service, is defined.
In step S24, a data receiving thread READTHREAD and a data transmitting thread SENDTHREAD are defined in SerialPortService.
Defining a data receiving thread in the service, wherein the thread is called READTHREAD, and a while loop is used in the thread to read data in an input stream; and a data sending thread, thread name SENDTHREAD, for writing data into the output stream.
Step S25, starting service and initializing port information of the serial port.
The service is started, data transmission and reception are realized through an open source framework definition service, and in order to ensure the stability of transmission and reception, the serial ports need to be uniformly initialized (an initialization port and a baud rate). Initializing port information of a serial port, such as a port number and a baud rate, at the time of service creation, including: setting the baud rate; setting data flow control; the format of the frame is set.
In some embodiments, step S25 further comprises, after:
step S251, using the master control system and one end of the slave system to send test data to the other end;
In step S252, if the receiving end does not receive the test data within the preset time, the secondary initialization is performed based on the spare port information.
Since each end of the multi-end display system performs the initialization operation, there is a possibility that the initialization of one end fails (such as the port number is occupied), and thus after the initialization is successful, a communication test (the test content includes the transmission data and the reception data) needs to be performed through the established service, if the corresponding reception data is not received within a set time, the two ends perform the secondary initialization based on the spare port information (to prevent the current port information from being unable to be initialized normally). The test data is communication test data for testing whether each end is initialized normally. When testing, the main control system and one end of the slave system in the multi-end display system are taken as transmitting ends, the other ends are data receiving ends, the transmitting ends are utilized to transmit test data to the receiving ends, then timing is carried out, whether the receiving ends receive the test data in preset time is judged, and if the receiving ends receive the test data in the preset time, the ports are initialized normally. If the receiving end does not receive the test data within the preset time, the port initialization is abnormal, and secondary initialization is needed.
Step S26, initializing an input stream object and an output stream object.
Wherein the input stream object and the output stream object are used to read and write data from the serial port in the thread. The input stream object refers to reading data of an external device such as a keyboard input, a mouse, and a scanner into a memory (program), and for the multi-terminal display system, the input stream object of a specific terminal (e.g., a master control system) further includes reading data of other terminals (e.g., slave systems) in the external multi-terminal display system into the memory (program). Output stream objects refer to outputting data in memory (programs) to a peripheral device.
In step S27, the thread READTHREAD object is instantiated, and the READTHREAD is started to monitor and receive data on the input stream object.
And step S28, calling SENDTHREAD to write data into the output stream object.
The thread READTHREAD object is instantiated and the thread is started to monitor whether data in the input stream is sent or not, if so, all the data in the input stream is circularly read, and when the data needs to be sent to the serial port, SENDTHREAD is called to write the data in the output stream.
And step S30, compiling an HTML format file by the main control system, and sending the HTML format file to the slave system for display.
Specifically, in some embodiments, step S30 includes:
Step S31, compiling an HTML format file based on the target data through the main control system;
Step S32, the HTML format file is sent to the slave system through the master control system;
And step S33, the HTML format file is interpreted and displayed through the slave system.
Based on the steps, after the mutual transmission communication between the master control system and the slave system is realized, when the data of the master control system is required to be displayed on the slave system in the application process of the multi-terminal display system, the target data corresponding to the content to be displayed is compiled into an HTML format file, and the HTML format file is transmitted to the slave system through a serial port based on the communication functional link between the master control system and the slave system realized by the steps, and then is analyzed and displayed by the slave system.
Specifically, an upper layer application service sent by the organization of the HTML file on the MT8781Android13 system can be developed. The interface to be displayed, the text display effect and the file in the HTML format are predefined on the system. The interface to be displayed by the sub-screen is represented in HTML language. For example, as shown in fig. 4 and fig. 5, fig. 4 is an exemplary diagram of a display interface of a bill for cashing, and fig. 5 is an exemplary diagram of an HTML format file corresponding to fig. 4 in an embodiment of the present invention, where data is organized on an MT8781Android13 system and ready to be sent to an Android13 system at an SC7731E end. Android13 at SC7731E receives and parses the HTML file sent from MT8781, and parses HTML with webview for display. The corresponding display background picture or animation can also embed information in the HTML, but the resource file is preset in the Android13 system at the SC7731E end.
Through the data communication method, the data communication interaction of each end of the multi-end display system is realized by adopting the HTML format file, the realization mode of the communication interaction can be simplified, and the applicable scene of the multi-end display system is enlarged.
And step S40, the operation information of the slave system is sent to the master control system.
When the system end of the device SC7731E has TP operation, the TP operation information is returned to the Android13 end of the MT8781 through the UART interface, wherein the returned TP information is mainly that the operation information content is returned to the main control system through content. Taking a personnel information interaction authentication scene of a foreground in hotel check-in as an example, information operated by a foreground main control terminal is displayed on another check-in oriented display terminal to check in a check-in client, and meanwhile, when the check-in client completes certain operation on a display subsystem, the corresponding operation information is sent to the main control terminal for interaction.
In some embodiments, the slave system includes an information extraction sensing device. The information extraction sensing device refers to an information acquisition device with a sensing function, including but not limited to an NFC device, an image acquisition device, and the like. Step 40 comprises:
step S41, extracting sensing data by using the information extraction sensing device;
Step S42, sending the sensor data to the master control system for display by the master control system.
The sensing data refers to data extracted by the information extraction means. Taking the scene of the ticket purchasing system requiring the on-site input of personnel identity information as an example, the scene needs to be interacted with ticket vending personnel, and in the one-to-many occasion, the auxiliary screen end is added with an NFC chip which can rapidly identify and upload NFC information to the main control end, so that ticket purchasing in a real-name system or a non-real-name system is realized. Thus, some important information on the display subsystem can be uploaded to the main system for processing, and the processing result is displayed on the display subsystem.
And (2) integrating the steps S10 to S40, realizing the multi-screen display function of master control information by controlling the lightweight SoCs of a plurality of subsystems by the SoCs of the main system on the intelligent terminal equipment, and controlling the other 2 screens except the main screen by using more serial ports on the main chip, wherein the two screens are controlled by a relatively lightweight SC7731E profile chip. The MT8781 and the SC7731E realize interconnection on serial ports to realize simple data communication, real-time character-level data communication is realized on the serial ports, interface information of an interface to be displayed on the subsystem is uploaded to the SC7731E from the MT8781 through the serial ports by using an HTML-format file, and the Android system of the SC7731E is used for analyzing and displaying the layout interface information on the HTML. The method comprises the steps that larger pictures and animation information are preset in a system of an SC7731E according to a certain rule in advance, display information is obtained through analysis of HTML uploaded from the MT8781 system, and display of a secondary screen connected to the SC7731E is achieved by combining calling picture video resources preset at a designated position of the SC 7731E. Meanwhile, because the two systems are adopted, the TP operation control can be operated respectively, and only the system information after operation is interacted on serial port communication among the systems, and both sides can operate the interaction information.
In the data communication method, the multi-terminal display system at least comprises a master control system and a slave system which are connected through serial ports and are used for communicating, and after the master control system is connected with the slave system through serial ports, the serial ports of the master control system and the slave system are debugged by modifying the communication protocol of the master control system; the serial port receiving and transmitting communication between the master control system and the slave system is realized through a definition service; compiling an HTML format file by the main control system, and sending the HTML format file to the slave system for display; and transmitting the operation information of the slave system to the master control system. By the mode, the display and the main control are respectively provided with the independent systems, so that the corresponding application is relatively easy to develop on the own system, the display operation of the different display is easy to realize, and the display system is also easy to realize by feeding back through the own TP operation. No matter the display is different or the touch is different, secondary development is not needed on the system, but the development is convenient for the operation flow of the existing system (such as an Android system). The method has the advantages that the more general UI processing mode of HTML is used in the process of transmitting the display information from the main control system to the display subsystem, the more convenient uniformity is brought when the third party UI is developed, the three-party intervention development is easier, and the method has good implementation stability. The scheme brings convenience to the development of specific service fields. And the whole cost of the multi-terminal display system can be reduced without expanding a plurality of master control systems.
In addition, the invention also provides a data communication device based on the multi-screen multi-touch display system.
The data communication device of the present invention includes:
The debugging module is used for debugging the communication of serial ports of the master control system and the slave system by modifying the communication protocol of the master control system after the serial ports of the master control system and the slave system are connected;
the definition service module is used for realizing the serial port transceiving communication between the master control system and the slave system through definition service;
The first sending module is used for compiling the target data into an HTML format file through the main control system and sending the HTML format file to the slave system for display;
And the second sending module is used for sending the operation information of the slave system to the master control system.
The specific embodiments of the data communication device of the present invention may refer to various embodiments of the data communication method of the present invention, and will not be described herein again.
In addition, the embodiment of the invention also provides a computer readable storage medium.
The computer-readable storage medium of the present invention has stored thereon a data communication program which, when executed by a processor, implements the steps of the data communication method as described above.
The method implemented when the data communication program running on the processor is executed may refer to various embodiments of the data communication method of the present invention, which are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (5)
1. A data communication method based on a multi-screen multi-touch display system, which is characterized by being applied to a multi-terminal display system, wherein the multi-terminal display system at least comprises a master control system and a slave system which are connected through a serial port for communication, and the method comprises the following steps:
after the main control system is connected with the slave system through a serial port, searching a general purpose input/output interface GPIO of the main control system based on a hardware schematic diagram; customizing a default function of the GPIO by using a platform tool of the main control system; modifying the serial port mode of the GPIO; modifying the communication direction of the GPIO; the serial port spontaneous self-receiving communication between the master control system and the slave system is realized through a definition service; based on the definition service, the serial port mutual transmission communication between the master control system and the slave system is realized;
Compiling an HTML format file by the main control system, and sending the HTML format file to the slave system for display;
Transmitting the operation information of the slave system to the master control system;
the step of implementing serial port transceiving communication between the master control system and the slave system through the definition service comprises the following steps:
Defining serial communication service SerialPortService;
defining a data receiving thread READTHREAD and a data transmitting thread SENDTHREAD in the SerialPortService;
starting service and initializing port information of a serial port; wherein initializing includes setting baud rate, setting data flow control, and setting frame format;
transmitting test data from one end to the other end in the master control system and the slave system;
If the receiving end does not receive the test data within the preset time, carrying out secondary initialization based on the standby port information;
Initializing an input stream object and an output stream object;
Instantiating a thread READTHREAD object and starting the READTHREAD to monitor and receive data of the input stream object;
invoking the SENDTHREAD to write data into an output stream object;
The master control system comprises an MT8781 platform, and the slave system comprises an SC7731E platform; the port of the SCAN_TXD1_RST of the MT8781 platform is in communication connection with the U3RXD of the SC7731E platform, and the port of the SCAN_RXD1_PDN of the MT8781 platform is in communication connection with the U3TXD of the SC7731E platform.
2. The data communication method as claimed in claim 1, wherein the step of compiling the target data into an HTML format file by the master control system and transmitting the HTML format file to the slave system for display comprises:
Compiling an HTML format file based on the target data through the main control system;
Sending the HTML format file to the slave system through the master control system;
And interpreting and displaying the HTML format file through the slave system.
3. The data communication method of claim 1, wherein the slave system includes an information extraction sensing device, and the step of transmitting the operation information of the slave system to the master system includes:
extracting sensing data by using the information extraction sensing device;
and sending the sensing data to the main control system for display by the main control system.
4. A data communication device based on a multi-screen multi-touch display system, which is applied to a multi-terminal display system, wherein the multi-terminal display system at least comprises a master control system and a slave system which are connected through a serial port for communication, and the communication device comprises:
the debugging module is used for searching a general purpose input/output interface GPIO of the master control system based on a hardware schematic diagram after the master control system is connected with the slave system through a serial port; customizing a default function of the GPIO by using a platform tool of the main control system; modifying the serial port mode of the GPIO; modifying the communication direction of the GPIO; the serial port spontaneous self-receiving communication between the master control system and the slave system is realized through a definition service; based on the definition service, the serial port mutual transmission communication between the master control system and the slave system is realized;
the definition service module is used for realizing the serial port transceiving communication between the master control system and the slave system through definition service;
The first sending module is used for compiling the target data into an HTML format file through the main control system and sending the HTML format file to the slave system for display;
The second sending module is used for sending the operation information of the slave system to the master control system;
wherein the step of implementing serial port transceiving communication between the master control system and the slave system through the definition service comprises the following steps:
Defining serial communication service SerialPortService;
defining a data receiving thread READTHREAD and a data transmitting thread SENDTHREAD in the SerialPortService;
starting service and initializing port information of a serial port;
transmitting test data from one end to the other end in the master control system and the slave system;
If the receiving end does not receive the test data within the preset time, carrying out secondary initialization based on the standby port information;
Initializing an input stream object and an output stream object;
Instantiating a thread READTHREAD object and starting the READTHREAD to monitor and receive data of the input stream object;
invoking the SENDTHREAD to write data into an output stream object;
The master control system comprises an MT8781 platform, and the slave system comprises an SC7731E platform; the port of the SCAN_TXD1_RST of the MT8781 platform is in communication connection with the U3RXD of the SC7731E platform, and the port of the SCAN_RXD1_PDN of the MT8781 platform is in communication connection with the U3TXD of the SC7731E platform.
5. A computer-readable storage medium, characterized in that a data communication program is stored, which, when executed by a processor, implements the steps of the data communication method according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311772639.7A CN117724671B (en) | 2023-12-20 | 2023-12-20 | Data communication method, device and storage medium based on multi-screen multi-touch display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311772639.7A CN117724671B (en) | 2023-12-20 | 2023-12-20 | Data communication method, device and storage medium based on multi-screen multi-touch display system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117724671A CN117724671A (en) | 2024-03-19 |
| CN117724671B true CN117724671B (en) | 2024-10-22 |
Family
ID=90210446
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311772639.7A Active CN117724671B (en) | 2023-12-20 | 2023-12-20 | Data communication method, device and storage medium based on multi-screen multi-touch display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117724671B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1607480A (en) * | 2000-03-17 | 2005-04-20 | 迪吉多电子股份有限公司 | Control server, control terminal, control system, and recording medium storing control communication program |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6473609B1 (en) * | 1995-12-11 | 2002-10-29 | Openwave Systems Inc. | Method and architecture for interactive two-way communication devices to interact with a network |
| CN105006134A (en) * | 2015-08-07 | 2015-10-28 | 南通航大电子科技有限公司 | Center controller of multi-communication-protocol intelligent housing system |
| CN112532564B (en) * | 2019-09-17 | 2022-09-13 | 中国移动通信集团广东有限公司 | Service calling method and device and electronic equipment |
| CN117155981A (en) * | 2022-06-17 | 2023-12-01 | 深圳Tcl新技术有限公司 | Internet of things connection control method, device, system, storage medium and control equipment |
-
2023
- 2023-12-20 CN CN202311772639.7A patent/CN117724671B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1607480A (en) * | 2000-03-17 | 2005-04-20 | 迪吉多电子股份有限公司 | Control server, control terminal, control system, and recording medium storing control communication program |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117724671A (en) | 2024-03-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10824449B2 (en) | Application running method and device | |
| CN110188044B (en) | Software error processing method, device, storage medium and equipment | |
| CN109947650B (en) | Script step processing method, device and system | |
| CN111399819B (en) | Data generation method, device, electronic equipment and storage medium | |
| US20190227764A1 (en) | Multi-screen interaction method and system in augmented reality scene | |
| WO2014206055A1 (en) | A method and system for generating a user interface | |
| CN110020293B (en) | Multimedia data display method, device and storage medium | |
| CN110658971A (en) | Screen capturing method and terminal equipment | |
| CN103607510A (en) | Terminal combination use method, terminals and communication system | |
| US9977661B2 (en) | Method and system for generating a user interface | |
| CN112420217B (en) | Message pushing method, device, equipment and storage medium | |
| CN111557097B (en) | Control method and terminal of power button in virtual remote controller | |
| CN110275836A (en) | Security testing method, device and storage medium for unreal engine application | |
| CN110908554B (en) | Long screenshot method and terminal device | |
| US10613724B2 (en) | Control method for selecting and pasting content | |
| CN108780400B (en) | Data processing method and electronic equipment | |
| CN117724671B (en) | Data communication method, device and storage medium based on multi-screen multi-touch display system | |
| CN111178306B (en) | A display control method and electronic device | |
| KR20210101075A (en) | Electronic device and method for operating clipboard thereof | |
| KR20200079081A (en) | Method for sharing content and electronic device thereof | |
| WO2023169157A1 (en) | Sub application running method and apparatus, electronic device, program product, and storage medium | |
| CN111949150B (en) | Method and device for controlling peripheral switching, storage medium and electronic equipment | |
| KR20150115169A (en) | Electronic apparatus and dispalying method thereof | |
| EP3042292B1 (en) | Electronic device and method of processing user input by electronic device | |
| CN113377475B (en) | Content display method and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |