CN113012034A - Method, device and system for image display processing - Google Patents
Method, device and system for image display processing Download PDFInfo
- Publication number
- CN113012034A CN113012034A CN202110246067.3A CN202110246067A CN113012034A CN 113012034 A CN113012034 A CN 113012034A CN 202110246067 A CN202110246067 A CN 202110246067A CN 113012034 A CN113012034 A CN 113012034A
- Authority
- CN
- China
- Prior art keywords
- terminal
- zero
- sending
- zero terminal
- behavior
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 83
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000012544 monitoring process Methods 0.000 claims abstract description 12
- 238000004806 packaging method and process Methods 0.000 claims description 6
- 238000013473 artificial intelligence Methods 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 claims description 3
- 208000008918 voyeurism Diseases 0.000 abstract description 12
- 230000006399 behavior Effects 0.000 description 78
- 230000008569 process Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 6
- 239000000243 solution Substances 0.000 description 5
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000003672 processing method Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000005034 decoration Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002265 prevention Effects 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 244000144985 peep Species 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/04—Context-preserving transformations, e.g. by using an importance map
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6245—Protecting personal data, e.g. for financial or medical purposes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/64—Protecting data integrity, e.g. using checksums, certificates or signatures
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Security & Cryptography (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Bioethics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Databases & Information Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method, a device and a system for image display processing. Wherein, this system includes: the zero terminal is used for acquiring a user image through image acquisition equipment and sending the user image to the server; the server is connected with the zero terminal and used for judging whether the user behavior in the user image is matched with the preset behavior or not, if the user behavior is matched with the preset behavior, sending a fuzzy instruction to the zero terminal and sending warning information to a virtual machine of a terminal set which is located in the same group with the zero terminal, wherein the warning information is used for indicating whether the zero terminal in the virtual machine control terminal set executes fuzzy processing or not; and if the user behavior is not matched with the preset behavior, monitoring a user image sent by the zero terminal. The invention solves the technical problem of information leakage caused by peeping or candid shooting when the cloud desktop system is used in the prior art.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a method, an apparatus, and a system for image display processing.
Background
At present, a cloud desktop system mainly comprises: zero terminal and Virtual Desktop server; wherein, zero terminal includes: VGTP-R end (receiving end), the virtual desktop server includes: VM (Virtual machines), and VGTP-S terminal (sender); the VGTP-R end is used for receiving the Virtual Desktop image from the cloud server, and meanwhile, reversely transmitting the information of the local mouse and the keyboard to the cloud server so as to be injected into the Virtual Desktop; the VGTP-S end runs in a VM (virtual machine) of the cloud server, and the S end comprises an image acquisition module and an image encoder and is responsible for the injection function of user input data. A Virtual Desktop server is generally an Infrastructure As A Service (IAAS) architecture, and has a server with a strong Virtual host.
At present, the cloud desktop system has wider application in special industries with high secret relation due to higher safety. Its higher safety is realized in that: the user has no data storage locally, all data sources and video images are from images of the cloud, and the user watermarks can be added to the images at the cloud, so that the data cannot be easily leaked.
However, how to realize peeping prevention or candid shooting prevention based on a cloud desktop system is a problem to be solved.
Aiming at the problem of information leakage caused by peeping or candid shooting when the cloud desktop system is used in the prior art, an effective solution is not provided at present.
Disclosure of Invention
The embodiment of the invention provides a method, a device and a system for image display processing, which are used for at least solving the technical problem of information leakage caused by peeping or candid shooting when a cloud desktop system is used in the prior art.
According to an aspect of an embodiment of the present invention, there is provided a system of image display processing, including: the system comprises a zero terminal, a virtual machine and a server, wherein the virtual machine and the server are in the same group of terminal sets as the zero terminal; the server is connected with the zero terminal and used for judging whether the user behavior in the user image is matched with the preset behavior or not, if the user behavior is matched with the preset behavior, sending a fuzzy instruction to the zero terminal and sending warning information to a virtual machine of a terminal set which is located in the same group with the zero terminal, wherein the warning information is used for indicating whether the zero terminal in the virtual machine control terminal set executes fuzzy processing or not; and if the user behavior is not matched with the preset behavior, monitoring a user image sent by the zero terminal.
Optionally, the image capturing device includes: zero terminal external equipment or zero terminal embedded equipment.
According to another aspect of the embodiments of the present invention, there is also provided an image display processing method, including: receiving a user image sent by a zero terminal; judging whether the user behavior in the user image is matched with the preset behavior or not; if the user behavior is matched with the preset behavior, sending a fuzzy instruction to a zero terminal, and sending warning information to a virtual machine of a terminal set which is located in the same group with the zero terminal, wherein the warning information is used for indicating whether the zero terminal in the virtual machine control terminal set executes fuzzy processing or not; and if the user behavior is not matched with the preset behavior, monitoring a user image sent by the zero terminal.
Optionally, the determining whether the user behavior in the user image matches the preset behavior includes: carrying out user behavior identification on the user image through an artificial intelligence algorithm, and judging whether the user behavior in the user image is matched with a preset behavior; or, carrying out user behavior identification on the user image through a similarity algorithm and carrying out similarity calculation on the user image and the preset behavior to determine whether the user behavior is matched with the preset behavior.
Optionally, sending the fuzzy instruction to the zero terminal, and sending the warning information to the virtual machine in the terminal set in the same group as the zero terminal includes: carrying out fuzzy processing on data to be displayed and coding to obtain coded data to be displayed; packaging the coded data to be displayed to a fuzzy instruction, and sending the fuzzy instruction to a zero terminal; determining a zero terminal as a target terminal; acquiring virtual machine identifications corresponding to terminal sets in the same group with a target terminal; and sending the warning information to the corresponding virtual machine according to the virtual machine identification.
Further, optionally, the warning information includes: and the terminal identification of the target terminal.
According to another aspect of the embodiments of the present invention, there is also provided an image display processing method, including: receiving warning information; judging whether the terminal identification in the warning information is in a preset terminal set or not; if the judgment result is yes, carrying out fuzzy coding on the data to be displayed in the preset terminal set, and sending the coded data to be displayed to the preset terminal set; if the judgment result is negative, marking a zero terminal in the preset terminal set, which belongs to the same group with the terminal identifier, and sending a fuzzy instruction to the zero terminal; and the fuzzy instruction is used for carrying out fuzzy processing on the coded data to be displayed.
According to another aspect of the embodiments of the present invention, there is also provided an apparatus for image display processing, including: the receiving module is used for receiving the user image sent by the zero terminal; the judging module is used for judging whether the user behavior in the user image is matched with the preset behavior; the sending module is used for sending a fuzzy instruction to the zero terminal and sending warning information to a virtual machine of a terminal set which is located in the same group with the zero terminal if the user behavior is matched with the preset behavior, wherein the warning information is used for indicating whether the zero terminal in the virtual machine control terminal set executes fuzzy processing or not; and the monitoring module is used for monitoring the user image sent by the zero terminal if the user behavior is not matched with the preset behavior.
Optionally, the sending module includes: the encoding unit is used for carrying out fuzzy processing on the data to be displayed and encoding the data to be displayed to obtain encoded data to be displayed; the sending unit is used for packaging the coded data to be displayed to the fuzzy instruction and sending the fuzzy instruction to the zero terminal; the determining unit is used for determining the zero terminal as a target terminal; the acquisition unit is used for acquiring virtual machine identifications corresponding to terminal sets of which the target terminals are positioned in the same group; and the information sending unit is used for sending the warning information to the corresponding virtual machine according to the virtual machine identifier.
According to another aspect of the embodiments of the present invention, there is also provided an apparatus for image display processing, including: the receiving module is used for receiving the warning information; the judging unit is used for judging whether the terminal identification in the warning information is in a preset terminal set or not; the encoding module is used for carrying out fuzzy encoding on the data to be displayed in the preset terminal set under the condition that the judgment result is yes and sending the encoded data to be displayed to the preset terminal set; the sending module is used for marking a zero terminal which belongs to the same group with the terminal identifier in the preset terminal set and sending a fuzzy instruction to the zero terminal under the condition that the judgment result is negative; and the fuzzy instruction is used for carrying out fuzzy processing on the coded data to be displayed.
In the embodiment of the invention, the zero terminal is used for acquiring the user image through the image acquisition equipment and sending the user image to the server; the server is connected with the zero terminal and used for judging whether the user behavior in the user image is matched with the preset behavior or not, if the user behavior is matched with the preset behavior, sending a fuzzy instruction to the zero terminal and sending warning information to a virtual machine of a terminal set which is located in the same group with the zero terminal, wherein the warning information is used for indicating whether the zero terminal in the virtual machine control terminal set executes fuzzy processing or not; if the user behavior is not matched with the preset behavior, the user image sent by the zero terminal is monitored, and the purpose of effectively avoiding information leakage is achieved, so that the risk level is dynamically adjusted, the technical effect of avoiding information leakage to the maximum extent while user experience is considered is achieved, and the technical problem of information leakage caused by the fact that peeping or candid exists when a cloud desktop system is used in the prior art is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a schematic diagram of a system for image display processing according to a first embodiment of the invention;
FIG. 2 is a flowchart illustrating a method of image display processing according to a second embodiment of the present invention;
fig. 3 is a flowchart illustrating a method of image display processing according to a third embodiment of the present invention;
fig. 4 is a schematic diagram of an apparatus of image display processing according to a fourth embodiment of the present invention;
fig. 5 is a schematic diagram of an apparatus of image display processing according to the fifth embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
According to an embodiment of the present invention, an embodiment of a system for image display processing is provided, and fig. 1 is a schematic diagram of a system for image display processing according to a first embodiment of the present invention, and as shown in fig. 1, the system for image display processing provided by the embodiment of the present application includes:
the zero terminal 12, the virtual machine and the server 14 which are located in the same group of terminal set as the zero terminal 12, wherein the zero terminal 12 is used for acquiring a user image through an image acquisition device and sending the user image to the server 14; the server 14 is connected with the zero terminal 12 and is configured to determine whether a user behavior in the user image matches a preset behavior, send a fuzzy instruction to the zero terminal 12 if the user behavior matches the preset behavior, and send warning information to a virtual machine in a terminal set that is in the same group as the zero terminal 12, where the warning information is used to indicate whether the zero terminal 12 in the virtual machine control terminal set executes fuzzy processing; and if the user behavior is not matched with the preset behavior, monitoring a user image sent by the zero terminal 12.
Optionally, the image capturing device includes: a zero terminal 12 external device or a zero terminal 12 embedded device.
The image display processing system provided by the embodiment of the present application can be applied to a cloud desktop system, wherein the zero terminal 12 includes a receiving terminal (denoted as an R terminal) and is connected to the server 14 through a wide area network/a local area network, wherein the server 14 in the embodiment of the present application can be a cloud server, and the server 14 includes a virtual desktop server and a transmitting terminal (denoted as an S terminal).
In the system for image display processing provided by the embodiment of the application, the zero terminals are all connected with a display screen with a camera (namely, the image acquisition device in the embodiment of the application), and the zero terminals can be grouped in advance according to attributes such as physical areas or security levels; when the cloud server determines that someone secretly shoots the screen of the zero terminal according to the image acquired by the zero terminal, the VM corresponding to the zero terminal can be informed to perform fuzzy processing on the virtual desktop image, and meanwhile, a warning instruction can be sent to the VM connected with the zero terminal in the same group as the zero terminal, so that the image displayed on the zero terminal in the same group is also subjected to fuzzy processing.
When the screen of the zero terminal is peeped or captured, the image on the screen of the peeped or projected zero terminal and the image on the screen of the zero terminal in the same group with the zero terminal can be immediately blurred, information leakage is prevented, and the safety of the cloud desktop system is improved.
Meanwhile, suspicious personnel information can be shared to the same group of personnel (such as head portrait, clothing and other personal characteristic information) through the snapshot live images of the zero terminal so as to warn people and prevent information leakage.
The camera of the zero terminal obtains a user image in real time in the using process of a user, and uploads the shot user image to the cloud server.
It should be noted that the camera of the zero terminal is usually disposed on a front panel of a display screen connected to the zero terminal, or a separate camera may be used, and the camera can shoot a picture in a certain range in front of the current display by adjusting the position of the camera. In the system for image display processing provided by the embodiment of the application, in the working process of the camera, a shot image is called a user image.
In the system for image display processing provided by the embodiment of the application, the image is transmitted from a remote terminal (S terminal) to a local zero terminal (R terminal), and then the image is decoded by the R terminal of the zero terminal and then is sent to a screen connected with the zero terminal for display. Based on the above, when a peeping event occurs, the image display processing system provided by the embodiment of the application can perform blurring processing on an image by controlling encoding or decoding, so that information is protected from being leaked.
In addition, before the zero terminal sends the user image to the cloud server, cloud desktop office staff logs in the VM through the zero terminal. The method comprises the steps that an S end in the VM encodes a virtual desktop source image acquired by image source equipment and sends the encoded data to an R end, wherein the R end is built in a zero terminal.
The present application is described by taking the above example as an example, and is not limited to the system for implementing the image display processing provided in the embodiment of the present application.
In the embodiment of the invention, the zero terminal is used for acquiring the user image through the image acquisition equipment and sending the user image to the server; the server is connected with the zero terminal and used for judging whether the user behavior in the user image is matched with the preset behavior or not, if the user behavior is matched with the preset behavior, sending a fuzzy instruction to the zero terminal and sending warning information to a virtual machine of a terminal set which is located in the same group with the zero terminal, wherein the warning information is used for indicating whether the zero terminal in the virtual machine control terminal set executes fuzzy processing or not; if the user behavior is not matched with the preset behavior, the user image sent by the zero terminal is monitored, and the purpose of effectively avoiding information leakage is achieved, so that the risk level is dynamically adjusted, the technical effect of avoiding information leakage to the maximum extent while user experience is considered is achieved, and the technical problem of information leakage caused by the fact that peeping or candid exists when a cloud desktop system is used in the prior art is solved.
Example 2
In accordance with an embodiment of the present invention, there is provided a method embodiment of a method of image display processing, it being noted that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer-executable instructions and that while a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than presented herein.
Fig. 2 is a schematic flowchart of a method of image display processing according to a second embodiment of the present invention, and as shown in fig. 2, on the server side, the method of image display processing provided in the embodiment of the present application includes the following steps:
step S202, receiving a user image sent by a zero terminal;
step S204, judging whether the user behavior in the user image is matched with the preset behavior;
specifically, the image display processing method provided in the embodiment of the present application may be applied to a server side, where the server may be a cloud server, and the cloud server receives a user image sent by a zero terminal and determines whether a user behavior in the user image matches a preset behavior, specifically as follows:
optionally, the step S204 of determining whether the user behavior in the user image matches the preset behavior includes: carrying out user behavior identification on the user image through an artificial intelligence algorithm, and judging whether the user behavior in the user image is matched with a preset behavior; or, carrying out user behavior identification on the user image through a similarity algorithm and carrying out similarity calculation on the user image and the preset behavior to determine whether the user behavior is matched with the preset behavior. .
The server in the embodiment of the application takes a cloud server as an example for explanation, the cloud server can use an AI algorithm to identify whether other people exist in the current user image except a legal user of the current zero terminal, if so, analyze the current user image according to the actions, the eye-minds, the positions of the other people and the like (namely, the user behaviors in the embodiment of the application), judge whether the other people peep the screen, or judge whether someone uses a shooting tool to perform candid shooting according to the actions (namely, the preset behaviors in the embodiment of the application); thereby determining whether a peek event has occurred.
Step S206, if the user behavior is matched with the preset behavior, sending a fuzzy instruction to the zero terminal, and sending warning information to the virtual machine of the terminal set which is in the same group with the zero terminal, wherein the warning information is used for indicating whether the zero terminal in the virtual machine control terminal set executes fuzzy processing or not;
optionally, the sending the fuzzy instruction to the zero terminal in step S206, and sending the warning information to the virtual machine in the terminal set in the same group as the zero terminal includes: carrying out fuzzy processing on data to be displayed and coding to obtain coded data to be displayed; packaging the coded data to be displayed to a fuzzy instruction, and sending the fuzzy instruction to a zero terminal; determining a zero terminal as a target terminal; acquiring virtual machine identifications corresponding to terminal sets in the same group with a target terminal; and sending the warning information to the corresponding virtual machine according to the virtual machine identification.
Further, optionally, the warning information includes: and the terminal identification of the target terminal.
Specifically, the cloud server sends a fuzzy instruction to the S end of the VM; after receiving the fuzzy instruction, the S-terminal performs fuzzy processing on the acquired virtual desktop image, encodes the virtual desktop image after the fuzzy processing, and sends encoded data (i.e., encoded data to be displayed in the embodiment of the present application) to the R-terminal of the zero terminal; a zero terminal that receives encoded data (i.e., encoded data to be displayed in this embodiment of the present application) is denoted as a target zero terminal (i.e., a target terminal in this embodiment of the present application).
And the S end of the VM receives the fuzzy instruction, and carries out fuzzy processing on the acquired virtual desktop image. Specifically, the blurring process may include: the resolution of the virtual desktop image is modified to be lower, part of the image layer is discarded in the encoding process, and frames are discarded in the sending process of the encoded data (namely, the encoded data to be displayed in the embodiment of the application). In a particular implementation, at least one of three methods may be employed to achieve the blurring effect of the virtual desktop image.
For convenience of description, a zero terminal that receives the encoded data after the blurring process is referred to as a target zero terminal.
After the target zero terminal receives the encoded data after the blurring processing (i.e., the encoded data to be displayed in the embodiment of the application), the R end of the target zero terminal decodes the encoded data, and the blurred virtual desktop image is obtained after the decoding processing.
Because the target zero terminal can be peeped or candid, the user sees a fuzzy virtual desktop image on the screen of the target zero terminal, and the effect of avoiding information leakage is achieved.
The VM of the cloud server acquires VMids of VMs corresponding to the target zero terminal and other zero terminals in the same group (namely, acquiring virtual machine identifications corresponding to terminal sets in the same group as the target terminal in the embodiment of the application); and sending warning information to the VM according to the VMid of the VM, wherein the warning information carries a zero terminal id of the target zero terminal (namely, a terminal identifier of the target terminal in the embodiment of the application).
The VM determines other zero terminals in the same group with the target zero terminal, and acquires VMids of the VMs corresponding to the zero terminals; and sending warning information to the VM according to the VMid of the VM, wherein the warning information carries the zero terminal id of the target zero terminal.
It should be noted that the zero terminals may be grouped in advance according to attributes such as a geographical location set by the zero terminal, or a privacy level, and specifically, may be grouped and summarized according to the zero terminal id.
For example, the terminals with the positions relatively close to each other and the screen facing one direction can be grouped into one group; because the screen of one of the zero terminals is peeped or candid, other zero terminals all have the risk of being peeped or candid.
For another example, the zero terminals with the same security level or higher than a certain security level can be grouped, and the method is particularly suitable for the zero terminals with higher security levels;
when a zero terminal is found to be peeped or candid, a plurality of persons with the prior organization conspiracy can sneak in and steal the key information, so that the screen of the zero terminal with high security level can be completely blurred, and the key information is prevented from being leaked.
And step S208, if the user behavior is not matched with the preset behavior, monitoring a user image sent by the zero terminal.
Specifically, when the user behavior is determined to be not matched with the preset behavior in step S204, step S204 is continuously executed to determine the user image sent by the at least one terminal.
In the embodiment of the invention, the user image sent by the zero terminal is received; judging whether the user behavior in the user image is matched with the preset behavior or not; if the user behavior is matched with the preset behavior, sending a fuzzy instruction to a zero terminal, and sending warning information to a virtual machine of a terminal set which is located in the same group with the zero terminal, wherein the warning information is used for indicating whether the zero terminal in the virtual machine control terminal set executes fuzzy processing or not; if the user behavior is not matched with the preset behavior, the user image sent by the zero terminal is monitored, and the purpose of effectively avoiding information leakage is achieved, so that the risk level is dynamically adjusted, the technical effect of avoiding information leakage to the maximum extent while user experience is considered is achieved, and the technical problem of information leakage caused by the fact that peeping or candid exists when a cloud desktop system is used in the prior art is solved.
Example 3
In accordance with an embodiment of the present invention, there is provided a method embodiment of a method of image display processing, it being noted that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer-executable instructions and that while a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than presented herein.
Fig. 3 is a schematic flowchart of a method of image display processing according to a third embodiment of the present invention, and as shown in fig. 3, on the VM side, the method of image display processing provided in the embodiment of the present application includes the following steps:
step S302, receiving warning information;
step S304, judging whether the terminal identification in the warning information is in a preset terminal set;
step S306, carrying out fuzzy coding on the data to be displayed in the preset terminal set under the condition that the judgment result is yes, and sending the coded data to be displayed to the preset terminal set;
step S308, under the condition that the judgment result is negative, marking a zero terminal which belongs to the same group with the terminal identification in the preset terminal set, and sending a fuzzy instruction to the zero terminal; and the fuzzy instruction is used for carrying out fuzzy processing on the coded data to be displayed.
In summary, with reference to steps S30-308, the method for image display processing according to the embodiment of the present application includes:
after receiving the warning information, the VM determines, according to a zero terminal id (i.e., a terminal identifier in this application embodiment) of a target zero terminal (i.e., the target terminal in embodiment 2, the zero terminal corresponding to the terminal identifier in this application embodiment), whether the connected zero terminal and the target zero terminal are both set in a group;
the VM receives the warning information, and obtains a zero terminal id of the target zero terminal from the warning information; and judging whether at least one zero terminal connected with the zero terminal is in the same group with the target zero terminal or not according to the zero terminal id of the target zero terminal.
If so, the image blurring processing is carried out at the VM end.
The VM sends a fuzzy instruction to the S terminal; the method comprises the following steps that S-side blurring processing is carried out on a collected virtual desktop image (namely, blurring coding is carried out on data to be displayed in a preset terminal set in the embodiment of the application), the blurred virtual desktop image is coded, and the coded data are sent to a connected zero terminal; the flow ends.
After determining that at least one connected zero terminal and the target zero terminal are both set in one group, the VM may send a fuzzy instruction to the S-terminal of the VM.
And then, after the S end receives the fuzzy instruction, the acquired virtual desktop image is subjected to fuzzy processing. Specifically, the blurring process may include at least one of a missing layer in the progressive coding, a sharpness modification of the image, a use of a blurring algorithm, and the like.
And finally, the S terminal encodes the virtual desktop image after the fuzzy processing, transmits the encoded data to a connected zero terminal, and decodes and displays the encoded data by the zero terminal.
It should be noted that after the VM determines that the suspected peeping event is ended according to the image shot by the target zero terminal, a stop fuzzy instruction may be sent to the S-side, so that the S-side restores the normal encoding of the collected virtual desktop image.
If not, it is described that some zero terminals and the target zero terminal are in the same group, and some zero terminals and the target zero terminal are not in the same group, among the plurality of zero terminals connected by the VM. In order to avoid influencing the normal use of users of zero terminals which are not in a group with the target zero terminal, the zero terminals which are in the same group with the target zero terminal in the connected zero terminals can only be determined through the VM, and the zero terminals which are in the same group with the target zero terminal are marked as suspicious zero terminals; and sending a fuzzy instruction 2 to the R end of the suspicious zero terminal, and carrying out image fuzzy processing on the R end of the zero terminal.
After determining that some zero terminals and target zero terminals in at least one connected zero terminal are not set in a group, the VM firstly marks the zero terminals, which are set in a group with the target zero terminals, in the at least one zero terminal connected with the VM as suspicious zero terminals, and sends a fuzzy instruction 2 to an R end of the suspicious zero terminals, so that the R end of the suspicious zero terminals performs fuzzy processing on the received virtual desktop image.
It should be noted that, because some zero terminals and target zero terminals in at least one zero terminal connected to the VM are not set in one group, if the S-side of the VM blurs the virtual desktop image, normal use of other R-side users connected to the VM may be affected, and therefore, the R-side of a suspicious zero terminal in the same group as the target zero terminal may blur the virtual desktop image, so that only image display of the suspicious zero terminal is affected.
And after the R end of the suspicious zero terminal receives the fuzzy instruction 2, carrying out fuzzy processing on the coded data, and displaying the image after the fuzzy processing on a display screen.
After receiving the fuzzy instruction 2, the R end of the suspicious zero terminal performs fuzzy processing on the acquired virtual desktop image. Specifically, the blurring process may include at least one of progressive encoding, discarding a part of an image layer after decoding, modifying sharpness of an image, using a blurring algorithm, and the like.
It should be noted that after the VM determines that the suspected peeping event is ended according to the image shot by the target zero terminal, the stop fuzzy instruction 2 may be sent to the R end of the suspected zero terminal, so that the R end of the suspected zero terminal restores to normal decoding of the encoded data.
In addition, the VM can also acquire the head portrait of the suspicious person shot by the target zero terminal and subjected to candid shooting or peeping, and the acquired head portrait is sent to the suspicious zero terminal to be displayed so as to remind the user of paying attention to the suspicious person and avoid information leakage.
In the embodiment of the invention, the warning information is received; judging whether the terminal identification in the warning information is in a preset terminal set or not; if the judgment result is yes, carrying out fuzzy coding on the data to be displayed in the preset terminal set, and sending the coded data to be displayed to the preset terminal set; if the judgment result is negative, marking a zero terminal in the preset terminal set, which belongs to the same group with the terminal identifier, and sending a fuzzy instruction to the zero terminal; the fuzzy instruction is used for carrying out fuzzy processing on the coded data to be displayed, and the purpose of effectively avoiding information leakage is achieved, so that the risk level is dynamically adjusted, the technical effect of avoiding information leakage to the maximum extent while user experience is considered is achieved, and the technical problem of information leakage caused by the fact that peeping or candid exists when a cloud desktop system is used in the prior art is solved.
Example 4
According to another aspect of the embodiments of the present invention, there is also provided an apparatus for image display processing, and fig. 4 is a schematic diagram of an apparatus for image display processing according to a fourth embodiment of the present invention, as shown in fig. 4, including: a receiving module 42, configured to receive a user image sent by a terminal; a judging module 44, configured to judge whether a user behavior in the user image matches a preset behavior; a sending module 46, configured to send a fuzzy instruction to a zero terminal and send warning information to a virtual machine in a terminal set in the same group as the zero terminal if the user behavior matches the preset behavior, where the warning information is used to indicate whether the zero terminal in the virtual machine control terminal set executes fuzzy processing; and the monitoring module 48 is configured to monitor the user image sent by the terminal if the user behavior does not match the preset behavior.
Optionally, the sending module 46 includes: the encoding unit is used for carrying out fuzzy processing on the data to be displayed and encoding the data to be displayed to obtain encoded data to be displayed; the sending unit is used for packaging the coded data to be displayed to the fuzzy instruction and sending the fuzzy instruction to the zero terminal; the determining unit is used for determining the zero terminal as a target terminal; the acquisition unit is used for acquiring virtual machine identifications corresponding to terminal sets of which the target terminals are positioned in the same group; and the information sending unit is used for sending the warning information to the corresponding virtual machine according to the virtual machine identifier.
Example 5
According to another aspect of the embodiments of the present invention, there is also provided an apparatus for image display processing, and fig. 5 is a schematic diagram of an apparatus for image display processing according to a fifth embodiment of the present invention, as shown in fig. 5, including: a receiving module 52, configured to receive the warning information; a determining unit 54, configured to determine whether the terminal identifier in the warning information is in a preset terminal set; the encoding module 56 is configured to perform fuzzy encoding on the data to be displayed in the preset terminal set if the determination result is yes, and send the encoded data to be displayed to the preset terminal set; a sending module 58, configured to mark a zero terminal in the preset terminal set that belongs to the same group as the terminal identifier and send a fuzzy instruction to the zero terminal if the determination result is negative; and the fuzzy instruction is used for carrying out fuzzy processing on the coded data to be displayed.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (10)
1. A system for image display processing, comprising:
a zero terminal, a virtual machine and a server of a terminal set located in the same group with the zero terminal, wherein,
the zero terminal is used for acquiring a user image through image acquisition equipment and sending the user image to the server;
the server is connected with the zero terminal and used for judging whether the user behavior in the user image is matched with a preset behavior or not, if so, sending a fuzzy instruction to the zero terminal and sending warning information to a virtual machine of a terminal set which is in the same group as the zero terminal, wherein the warning information is used for indicating the virtual machine to control the zero terminal in the terminal set to execute fuzzy processing or not; and if the user behavior is not matched with the preset behavior, monitoring the user image sent by the zero terminal.
2. The system of claim 1, wherein the image capture device comprises: and the zero terminal external equipment or the zero terminal embedded equipment.
3. A method of image display processing, comprising:
receiving a user image sent by a zero terminal;
judging whether the user behavior in the user image is matched with a preset behavior or not;
if the user behavior is matched with the preset behavior, sending a fuzzy instruction to the zero terminal, and sending warning information to a virtual machine of a terminal set which is located in the same group with the zero terminal, wherein the warning information is used for indicating the virtual machine to control whether the zero terminal in the terminal set executes fuzzy processing or not;
and if the user behavior is not matched with the preset behavior, monitoring the user image sent by the zero terminal.
4. The method of claim 3, wherein the determining whether the user behavior in the user image matches a preset behavior comprises:
carrying out user behavior identification on the user image through an artificial intelligence algorithm, and judging whether the user behavior in the user image is matched with the preset behavior; or the like, or, alternatively,
and performing user behavior identification on the user image through a similarity algorithm and performing similarity calculation on the user image and the preset behavior to determine whether the user behavior is matched with the preset behavior.
5. The method of claim 3, wherein sending the fuzzy instruction to the zero terminal and sending the warning message to the virtual machine of the terminal set in the same group as the zero terminal comprises:
carrying out fuzzy processing on data to be displayed and coding to obtain the coded data to be displayed;
packaging the coded data to be displayed to the fuzzy instruction, and sending the fuzzy instruction to the zero terminal;
determining the zero terminal as a target terminal;
acquiring virtual machine identifications corresponding to terminal sets in the same group as the target terminal;
and sending the warning information to the corresponding virtual machine according to the virtual machine identification.
6. The method of claim 5, wherein the alert information comprises: and the terminal identification of the target terminal.
7. A method of image display processing, comprising:
receiving warning information;
judging whether the terminal identification in the warning information is in a preset terminal set or not;
if the judgment result is yes, carrying out fuzzy coding on the data to be displayed in the preset terminal set, and sending the coded data to be displayed to the preset terminal set;
under the condition that the judgment result is negative, marking a zero terminal in the preset terminal set, which belongs to the same group with the terminal identification, and sending a fuzzy instruction to the zero terminal; and the fuzzy instruction is used for carrying out fuzzy processing on the coded data to be displayed.
8. An apparatus for image display processing, comprising:
the receiving module is used for receiving the user image sent by the zero terminal;
the judging module is used for judging whether the user behavior in the user image is matched with a preset behavior;
the sending module is used for sending a fuzzy instruction to the zero terminal and sending warning information to a virtual machine of a terminal set which is located in the same group as the zero terminal if the user behavior is matched with the preset behavior, wherein the warning information is used for indicating the virtual machine to control whether the zero terminal in the terminal set executes fuzzy processing or not;
and the monitoring module is used for monitoring the user image sent by the zero terminal if the user behavior is not matched with the preset behavior.
9. The apparatus of claim 8, wherein the sending module comprises:
the encoding unit is used for carrying out fuzzy processing on the data to be displayed and encoding the data to be displayed to obtain the encoded data to be displayed;
the sending unit is used for packaging the coded data to be displayed to the fuzzy instruction and sending the fuzzy instruction to the zero terminal;
the determining unit is used for determining the zero terminal as a target terminal;
the acquisition unit is used for acquiring virtual machine identifications corresponding to terminal sets of which the target terminals are positioned in the same group;
and the information sending unit is used for sending the warning information to the corresponding virtual machine according to the virtual machine identifier.
10. An apparatus for image display processing, comprising:
the receiving module is used for receiving the warning information;
the judging unit is used for judging whether the terminal identification in the warning information is in a preset terminal set or not;
the encoding module is used for carrying out fuzzy encoding on the data to be displayed in the preset terminal set under the condition that the judgment result is yes, and sending the encoded data to be displayed to the preset terminal set;
the sending module is used for marking the zero terminal which belongs to the same group with the terminal identifier in the preset terminal set and sending a fuzzy instruction to the zero terminal under the condition that the judgment result is negative; and the fuzzy instruction is used for carrying out fuzzy processing on the coded data to be displayed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110246067.3A CN113012034A (en) | 2021-03-05 | 2021-03-05 | Method, device and system for image display processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110246067.3A CN113012034A (en) | 2021-03-05 | 2021-03-05 | Method, device and system for image display processing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113012034A true CN113012034A (en) | 2021-06-22 |
Family
ID=76407045
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110246067.3A Pending CN113012034A (en) | 2021-03-05 | 2021-03-05 | Method, device and system for image display processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113012034A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114283565A (en) * | 2021-12-10 | 2022-04-05 | 西安万像电子科技有限公司 | Multi-screen seat machine early warning method and device, electronic equipment and storage medium |
| CN115859335A (en) * | 2023-02-03 | 2023-03-28 | 合肥科颖医药科技有限公司 | Remote control technology-based remote information data lookup method and system |
| CN116522417A (en) * | 2023-07-04 | 2023-08-01 | 广州思涵信息科技有限公司 | Security detection method, device, equipment and storage medium for display equipment |
| WO2023174144A1 (en) * | 2022-03-17 | 2023-09-21 | 阿里巴巴（中国）有限公司 | Super-resolution reconstruction method and apparatus for cloud desktop image, device, and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015117383A1 (en) * | 2014-08-21 | 2015-08-13 | 中兴通讯股份有限公司 | Method for call, terminal and computer storage medium |
| CN106303628A (en) * | 2016-09-23 | 2017-01-04 | 西安数拓网络科技有限公司 | Information-pushing method based on multimedia display screen and device |
| CN112087625A (en) * | 2020-08-27 | 2020-12-15 | 西安万像电子科技有限公司 | Image processing method, image processing apparatus, server, and storage medium |
| CN112188282A (en) * | 2020-09-15 | 2021-01-05 | 西安万像电子科技有限公司 | Image data display method and device and image data display system |
| CN112257123A (en) * | 2020-09-07 | 2021-01-22 | 西安万像电子科技有限公司 | Image processing method and system |
| CN112257124A (en) * | 2020-09-29 | 2021-01-22 | 西安万像电子科技有限公司 | Image processing method and device |
| CN112270647A (en) * | 2020-09-16 | 2021-01-26 | 西安万像电子科技有限公司 | Image processing method and system |
-
2021
- 2021-03-05 CN CN202110246067.3A patent/CN113012034A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015117383A1 (en) * | 2014-08-21 | 2015-08-13 | 中兴通讯股份有限公司 | Method for call, terminal and computer storage medium |
| CN106303628A (en) * | 2016-09-23 | 2017-01-04 | 西安数拓网络科技有限公司 | Information-pushing method based on multimedia display screen and device |
| CN112087625A (en) * | 2020-08-27 | 2020-12-15 | 西安万像电子科技有限公司 | Image processing method, image processing apparatus, server, and storage medium |
| CN112257123A (en) * | 2020-09-07 | 2021-01-22 | 西安万像电子科技有限公司 | Image processing method and system |
| CN112188282A (en) * | 2020-09-15 | 2021-01-05 | 西安万像电子科技有限公司 | Image data display method and device and image data display system |
| CN112270647A (en) * | 2020-09-16 | 2021-01-26 | 西安万像电子科技有限公司 | Image processing method and system |
| CN112257124A (en) * | 2020-09-29 | 2021-01-22 | 西安万像电子科技有限公司 | Image processing method and device |
Non-Patent Citations (2)
| Title |
|---|
| 伍丹;夏雪玲;沈力;廖振松;: "基于零终端的虚拟桌面云应用研究", 信息通信, no. 04 * |
| 叶艾彦;: "虚拟化技术与终端融合的云教学系统", 移动通信, no. 10 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114283565A (en) * | 2021-12-10 | 2022-04-05 | 西安万像电子科技有限公司 | Multi-screen seat machine early warning method and device, electronic equipment and storage medium |
| WO2023174144A1 (en) * | 2022-03-17 | 2023-09-21 | 阿里巴巴（中国）有限公司 | Super-resolution reconstruction method and apparatus for cloud desktop image, device, and storage medium |
| CN115859335A (en) * | 2023-02-03 | 2023-03-28 | 合肥科颖医药科技有限公司 | Remote control technology-based remote information data lookup method and system |
| CN116522417A (en) * | 2023-07-04 | 2023-08-01 | 广州思涵信息科技有限公司 | Security detection method, device, equipment and storage medium for display equipment |
| CN116522417B (en) * | 2023-07-04 | 2023-09-19 | 广州思涵信息科技有限公司 | Security detection method, device, equipment and storage medium for display equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113012034A (en) | Method, device and system for image display processing | |
| CN111586361B (en) | Image processing method and related device | |
| CN109727180B (en) | Screen information leakage tracing system and tracing method | |
| EP2832102B1 (en) | Methods and systems for cryptographic access control of video | |
| CN108040230B (en) | Monitoring method and device for protecting privacy | |
| CN112257123B (en) | Image processing method and system | |
| CN111950042B (en) | Image data processing method, system and device | |
| CN112257124A (en) | Image processing method and device | |
| CN112087625B (en) | Image processing method, device, server and storage medium | |
| JPWO2009013822A1 (en) | Video surveillance device and video surveillance program | |
| JP7641215B2 (en) | Modified Video Encoding | |
| CN112270647A (en) | Image processing method and system | |
| CN112884641A (en) | Method, device and system for image display processing | |
| CN112367496A (en) | Intelligent safe operation method and device for power distribution room | |
| CN111294543A (en) | System and method for video monitoring photographing protection | |
| KR20130114037A (en) | Masking and recovering method of privacy region | |
| CN115359539A (en) | Office place information security detection method, device, equipment and storage medium | |
| CN113012033A (en) | Method, device and system for image display processing | |
| CN113077354A (en) | Insurance application verification method and device for electronic equipment | |
| CN107292133B (en) | Artificial intelligence confusion technical method and device | |
| CN113079371A (en) | Recovery and analysis method, device and equipment for video Internet of things | |
| CN111177770B (en) | Sensitive information protection method, mobile equipment and storage device | |
| CN111770242A (en) | Image processing method and device | |
| JP2002281486A (en) | System for acquiring image | |
| CN113012035A (en) | Method, device and system for image display processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |