CN115190335A - Internet of things home interaction method, system, electronic device and storage medium - Google Patents

Abstract

The invention discloses an Internet of Things home interaction method, system, electronic equipment and storage medium. The method includes: receiving an interaction request instruction sent by a server; in response to the interaction request instruction, invoking a multimedia collection device configured on the set-top box to collect first multimedia data of the environment where the set-top box is located; The first multimedia data is sent to the server. The invention solves the technical problem in the related art that the interactive communication cannot be performed through the set-top box.

Description

Internet of things home interaction method, system, electronic device and storage medium

technical field

The present invention relates to the technical field of information processing, and in particular, to an Internet of Things home interaction method, system, electronic device and storage medium.

Background technique

With the popularization of smart phones, smart TVs and home broadband networks, as well as the improvement of urbanization, people are more dependent on mobile phones. Usually, they mainly rely on mobile phone calls or WeChat to communicate with relatives, friends and family members in different places. However, because the screen of the mobile phone is too small, it is often impossible to see the whole picture and cannot interact with each other, and the current smart TV can only be used for watching TV programs, not for communication and interaction between family members, and the user experience is not good. .

SUMMARY OF THE INVENTION

Embodiments of the present invention provide an Internet of Things home interaction method, system, electronic device, and storage medium, so as to at least solve the technical problem in the related art that interactive communication cannot be performed through a set-top box.

According to an aspect of the embodiments of the present invention, there is provided an IoT home interaction method, applied to a set-top box, comprising: receiving an interaction request instruction sent by a server; in response to the interaction request instruction, invoking a multimedia system configured on the set-top box The collection device collects the first multimedia data of the environment where the set-top box is located; and sends the first multimedia data to the server.

According to another aspect of the embodiments of the present invention, there is provided an Internet of Things home interaction method, applied to a server, comprising: receiving an interactive service request instruction sent by a client, wherein the interactive service request instruction carries a log in to the client user information; when it is determined that the user corresponding to the user information has interactive application service authority, send an interactive request instruction to the target set-top box, so that the target set-top box collects the first multimedia data around the set-top box; wherein, the The target set-top box is a set-top box that has a binding relationship with the user; the first multimedia data sent by the target set-top box is received.

According to yet another aspect of the embodiments of the present invention, there is provided an Internet of Things home interaction method, applied to a client, comprising: sending an interactive service request instruction to a server, so that the server obtains first multimedia data; wherein, The interactive service request instruction carries user information for logging in to the client, and the first multimedia data is multimedia data collected by a set-top box that has a binding relationship with the client; the first multimedia data sent by the server is received. a multimedia data.

According to another aspect of the embodiments of the present invention, an Internet of Things home interaction system is also provided, including the set-top box, the server and the client in the above-mentioned embodiments.

According to another aspect of the embodiments of the present invention, an electronic device is also provided, including a memory and a processor, the memory stores a computer program, and the processor is configured to execute the above-mentioned Internet of Things home interaction method through the above-mentioned computer program .

According to yet another aspect of the embodiments of the present invention, a computer-readable storage medium is also provided, where a computer program is stored in the computer-readable storage medium, wherein the computer program is configured to execute the above-mentioned Internet of Things home when running. interactive method.

In the embodiment of the present invention, the interaction request instruction sent by the receiving server is adopted; in response to the interaction request instruction, the multimedia collection device configured on the set-top box is invoked to collect the first multimedia data of the environment where the set-top box is located. The method for sending the first multimedia data to the server, in the above-mentioned method, the first multimedia data of the environment in which the set-top box is located is collected by invoking a multimedia acquisition device configured on the set-top box. , and send the first multimedia data to the server, which not only solves the problem of interacting with the mobile terminal through the set-top box, but also directly interacts with the mobile terminal through different set-top boxes, thereby solving the problem that in the related art, the interactive communication cannot be conducted through the set-top box. technical issues.

Description of drawings

The accompanying drawings described herein are used to provide further understanding of the present invention and constitute a part of the present application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the attached image:

1 is a schematic diagram of an application environment of an optional IoT home interaction method according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of an application environment of another optional IoT home interaction method according to an embodiment of the present invention;

3 is a schematic flowchart of an optional Internet of Things home interaction according to an embodiment of the present invention;

4 is a schematic diagram of an optional Internet of Things home interaction system according to an embodiment of the present invention;

5 is a schematic diagram of different functional modules in an optional IoT home interaction method according to an embodiment of the present invention;

6 is a schematic flowchart of another optional IoT home interaction method according to an embodiment of the present invention;

7 is a schematic flowchart of another optional IoT home interaction method according to an embodiment of the present invention;

8 is a schematic structural diagram of an optional IoT home interaction device according to an embodiment of the present invention;

9 is a schematic structural diagram of an optional electronic device according to an embodiment of the present invention;

10 is a schematic structural diagram of an optional IoT home interaction device according to an embodiment of the present invention;

11 is a schematic structural diagram of an optional electronic device according to an embodiment of the present invention;

12 is a schematic structural diagram of an optional IoT home interaction device according to an embodiment of the present invention;

FIG. 13 is a schematic structural diagram of an optional electronic device according to an embodiment of the present invention.

Detailed ways

In order to make those skilled in the art better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only Embodiments are part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

It should be noted that the terms "first", "second" and the like in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used may be interchanged under appropriate circumstances such that the embodiments of the invention described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those expressly listed Rather, those steps or units may include other steps or units not expressly listed or inherent to these processes, methods, products or devices.

According to an aspect of the embodiments of the present invention, an Internet of Things home interaction method is provided. Optionally, as an optional implementation manner, the above-mentioned Internet of Things home interaction method may be applied, but not limited to, the method shown in FIG. 1 . in the application environment. The application environment includes: a terminal device 102 for man-machine interaction with a user, a network 104, and a server 106. Human-computer interaction can be performed between the user 108 and the terminal device 102, and the terminal device 102 runs an Internet of Things home interactive application. The above-mentioned terminal device 102 includes a human-computer interaction screen 1022 , a processor 1024 and a memory 1026 . The human-computer interaction screen 1022 is used to display multimedia data; the processor 1024 is used to send an interactive service request instruction to the server, so that the server obtains the first multimedia data; wherein, the interactive service request instruction carries the login information. the user information of the client, the first multimedia data is multimedia data collected by a set-top box that has a binding relationship with the client; and the first multimedia data sent by the server is received. The memory 1026 is used to store the above-mentioned multimedia data.

In addition, the server 106 includes a database 1062 and a processing engine 1064, and the database 1062 is used to store the above-mentioned multimedia data. The processing engine 1064 is configured to receive an interactive service request instruction sent by the client, and the interactive service request instruction carries the user information logging in to the client; when it is determined that the user corresponding to the user information has the interactive application service authority, send an interactive service request. A request instruction is sent to the target set-top box, so that the target set-top box collects multimedia data around the set-top box; wherein, the target set-top box is a set-top box with a binding relationship with the user; and the multimedia data sent by the target set-top box is received.

The set-top box 108 includes a processor 1082 and a memory 1084; the processor 1082 is configured to receive an interactive request instruction sent by the server; in response to the interactive request instruction, call the multimedia collection device configured on the set-top box to collect the environment where the set-top box is located the multimedia data; sending the multimedia data to the server. The memory 1084 is used to store the above-mentioned multimedia data.

In one or more embodiments, the above-mentioned IoT home interaction method of the present application may be applied to the application environment shown in FIG. 2 . As shown in FIG. 2 , human-computer interaction may be performed between the user 202 and the user equipment 204 . The user equipment 204 includes a memory 206 and a processor 208 therein. In this embodiment, the user equipment 204 may obtain multimedia data by referring to, but not limited to, performing the operations performed by the above-mentioned terminal equipment 102 .

Optionally, the above-mentioned terminal equipment 102 and user equipment 204 include but are not limited to terminals such as mobile phones, set-top boxes, televisions, tablet computers, notebook computers, PCs, in-vehicle electronic equipment, wearable devices, etc. The above-mentioned network 104 may include but not limited to Wi-Fi or wired network. Wherein, the wireless network includes: WIFI and other networks that realize wireless communication. The above wired network may include, but is not limited to, a wide area network, a metropolitan area network, and a local area network. The above-mentioned server 106 may include, but is not limited to, any hardware device that can perform computing. The above server may be a single server, a server cluster composed of multiple servers, or a cloud server. The above is only an example, which is not limited in this embodiment.

As an optional implementation manner, as shown in FIG. 3 , an embodiment of the present invention provides an IoT home interaction method, applied to a set-top box, including the following steps:

S302, the set-top box receives the interaction request instruction sent by the server.

In this embodiment of the present invention, the above interaction request instruction includes but is not limited to a voice dialogue request instruction, a video session request instruction, an image text interaction request instruction, or a game interaction request instruction.

S304: In response to the interaction request instruction, the set-top box invokes a multimedia collection device configured on the set-top box to collect first multimedia data of the environment where the set-top box is located.

Specifically, after receiving the above interaction request instruction, the set-top box collects the first multimedia data of the environment where the set-top box is located through the multimedia collection device configured on the set-top box; and other equipment; the above-mentioned first multimedia data includes but is not limited to image data, video data or voice data.

S306: Send the first multimedia data to the server.

In the embodiment of the present invention, a set-top box is used to receive an interactive request instruction sent by a server; in response to the interactive request instruction, a multimedia collection device configured on the set-top box is invoked to collect the first multimedia information of the environment where the set-top box is located. volume data; a method for sending the first multimedia data to the server, in the above method, since the multimedia collection device configured on the set-top box is used to collect the first multimedia data of the environment where the set-top box is located volume data, and send the first multimedia data to the server, which not only solves the problem of interacting with the mobile terminal through the set-top box, but also directly interacts with the mobile terminal through different set-top boxes, thus solving the problem that in the related art Technical issues of interactive communication.

In one or more embodiments, the IoT home interaction further includes:

receiving second multimedia data sent by the server, where the second multimedia data is data sent by another set-top box or mobile terminal to the server;

determining whether the display terminal associated with the set-top box is in an open state;

If yes, send the second multimedia data to the display terminal for display;

If not, send an opening instruction to the display terminal, and after the display terminal is turned on, send the second multimedia data to the display terminal for display.

Specifically, taking the display terminal as a TV connected to the set-top box as an example, after the set-top box receives the second multimedia data sent by the server, it determines whether the TV associated with the set-top box is in an on state; The second multimedia data is sent to the display terminal for display; if it is in a shutdown state, a turn-on instruction is sent to the TV through the infrared transmitter configured in the set-top box, and the second multimedia data is sent after the TV is turned on to the display terminal for presentation.

In one or more embodiments, the interaction request instruction is a game interaction request instruction, and the method further includes:

It is determined that the display terminal is in an open state, and the interactive game scene is output to the display terminal for display; wherein the interactive game scene includes dynamic portraits and/or audios of interactive game participants, and the dynamic portraits and/or audios is the data extracted from the first multimedia file and the second multimedia data.

Specifically, after receiving the game interaction request instruction sent by the server, the set-top box determines that the display terminal is in an open state, collects dynamic portraits and/or audios of interactive game participants through a multimedia collection device, and then records the dynamic portraits and/or audios. Send to the server, the server integrates the dynamic portrait and/or audio into the interactive game scene and then sends the interactive game scene to the set-top box, and the set-top box outputs the interactive game scene to the display terminal for display.

In one or more embodiments, the IoT home interaction further includes:

The parameter information of the environment where the set-top box is located is collected by the sensor configured in the set-top box, the parameter information includes one or more of temperature, humidity, smoke, air quality, and sound intensity; the parameter information is sent to the server.

Specifically, the indoor temperature collected by the above-mentioned temperature sensor configured on the set-top box, the indoor humidity collected by the humidity sensor, the smoke detection data collected by the smoke detector, the indoor air quality data collected by the air quality sensor, and the sound intensity decibel data collected by the microphone, The real-time snapshot picture data collected by the camera, the set-top box sends the collected parameter information to the server, the equipment management module of the server receives the set-top box to report the data, and forwards it to the rule engine module. The rule engine module analyzes and processes according to the configuration rules to identify smoke, fire, Abnormal conditions such as harmful gas, gas leakage, children's crying, impact sound, etc., and automatically alarm to notify family members, and send an alarm message to the APP of the user's mobile terminal. Third-party apps, such as DingTalk, WeChat, etc.

As an optional implementation manner, as shown in FIG. 6 , an embodiment of the present invention provides an IoT home interaction method, which is applied to a server and includes the following steps:

S602, receiving an interactive service request instruction sent by a client, where the interactive service request instruction carries user information logging in to the client;

S604, when it is determined that the user corresponding to the user information has the interactive application service authority, then send an interactive request instruction to the target set-top box, so that the target set-top box collects the first multimedia data around the set-top box; wherein, the The target set-top box is a set-top box that has a binding relationship with the user;

S606: Receive the first multimedia data sent by the target set-top box.

Specifically, the server receives an interactive service request instruction sent by the client and carries the user information logging in to the client. Taking the interactive service request instruction as a video chat instruction as an example, after determining that the user corresponding to the user information has the video interactive service When the permission is granted, a video interaction request instruction is sent to the target set-top box, so that the target set-top box collects real-time video information around the set-top box; wherein, the target set-top box is a set-top box that has a binding relationship with the user.

In the embodiment of the present invention, an interactive service request instruction sent by the client is received, and the interactive service request instruction carries the user information logging in the client; after it is determined that the user corresponding to the user information has the interactive application service authority , then send an interactive request instruction to the target set-top box, so that the target set-top box collects the first multimedia data around the set-top box; wherein, the target set-top box is a set-top box that has a binding relationship with the user; The method for the first multimedia data sent by the target set-top box, in the above-mentioned method, since the first multimedia data of the environment in which the set-top box is located is collected by invoking the multimedia acquisition device configured on the set-top box, and Sending the first multimedia data to the server not only solves the problem of interacting with the mobile terminal through the set-top box, but also directly interacts with the mobile terminal through different set-top boxes, thereby solving the technology in the related art that the interactive communication cannot be conducted through the set-top box. question.

In one or more embodiments, the IoT home interaction method further includes:

receiving the interactive service request of the first user sent by the client, where the interactive service request carries the user information of the second user to be interacted with;

Sending an interactive connection request to the second user's client or set-top box when it is determined that both the first user and the second user have the interactive application service authority;

In the embodiment of the present invention, the above-mentioned first user and second user are friends who both have interaction rights.

When receiving the confirmation message from the client terminal of the second user or the set-top box, receive the second multimedia data sent by the first set-top box and the third multimedia data sent by the second set-top box; wherein the first set-top box is the the set-top box bound by the first user, and the second set-top box is the set-top box bound by the second user;

Fusion of the second multimedia data and the third multimedia data to obtain target streaming media data;

sending the target streaming media data to the first set-top box and the second set-top box, so that the first display terminal associated with the first set-top box and the second display terminal associated with the second set-top box both display the Target streaming data.

In one or more embodiments, the interactive service request includes an interactive game request, and accordingly, the second multimedia data includes a dynamic portrait and/or audio of the first user, the third multimedia data the volume data includes a dynamic portrait and/or audio of the second user;

The fusion of the second multimedia data and the third multimedia data to obtain target streaming media data includes:

The target streaming media data is obtained by merging the dynamic portrait and/or audio of the first user and the dynamic portrait and/or audio of the second user with the scene of the current interactive game.

In one or more embodiments, the IoT home interaction method further includes:

receiving the sensor in the target set-top box to collect parameter information of the environment in which the set-top box is located, the parameter information including one or more of temperature, humidity, smoke, air quality, and sound intensity;

When it is judged that the parameter information is in the abnormal threshold range based on the preset early warning rules, alarm information is sent to the target set-top box or client.

As an optional implementation manner, as shown in FIG. 7 , an embodiment of the present invention provides an IoT home interaction method, which is applied to a client and includes the following steps:

S702: Send an interactive service request instruction to a server, so that the server obtains first multimedia data; wherein, the interactive service request instruction carries user information logging in to the client, and the first multimedia data is related to The multimedia data collected by the set-top box of which the client has a binding relationship;

S704: Receive the first multimedia data sent by the server.

In one or more embodiments, the IoT home interaction method further includes:

Send the interactive service request of the first user to the server, where the interactive service request carries the user information of the second user to be interacted with; wherein, the first user is a user logged in the current client;

In the case that it is determined that both the first user and the second user have the permission of the interactive application service, a confirmation message of the second user sent by the server is received.

In this embodiment of the present invention, the system assigns a system-unique family number to each user's family. Users need to set their own family name, and optionally can set family remarks. When adding a friendly family, they can directly input the other party's family number. Add, or search for a family by family name, the system displays the searched family list on the user client interface, including family name, family ID, family remarks, the user selects the family they want to add to add, and can enter verification when adding The information is so that the other party can understand the verification. After the user adds a friendly family, the other party needs to verify and authorize the official addition. When a user receives a verification request for adding a friendly family, he can see the other party's family information. The other party's family information includes family name, family number, family remarks, family member name, and family member mobile phone number.

Based on the foregoing embodiment, as shown in FIG. 4 , in an application embodiment, the foregoing IoT home interaction system further includes:

The TV is connected to the smart set-top box, and is used for receiving video output information and audio output information of the smart set-top box, displaying video images and playing sound. And can receive the infrared remote control command sent by the smart set-top box through the infrared receiver.

The smart set-top box is connected to the TV, outputs video information and audio information to the TV through the video interface and audio interface, and sends infrared remote control commands to the TV through the infrared transmitter to remotely control the TV. Return, direction control and other commands; connect with the server through the Internet, upload the audio and video data collected by the camera and microphone to the server through the network; upload the real-time captured pictures of the camera to the server; upload the collected indoor temperature, indoor humidity, and smoke detection data , air quality data and sound intensity decibel data are reported to the server.

The server deploys the IoT home interactive system software, connects with the smart set-top box through the Internet, receives the data reported by the smart set-top box, manages the online status of the smart set-top box, and sends service instruction requests to the smart set-top box, including calling the smart set-top box camera real-time video images, real-time Collect audio data, turn on the TV remotely through the smart set-top box, and remotely control the TV, conduct video interaction with family members, and remotely turn off the TV.

Mobile phone, install the APP software of the family interaction management system, and connect with the server through the Internet to log in to the family interaction management system system, manage family equipment and family members, initiate interactive service requests, interact with family members, and receive system alarm messages.

Based on the above embodiment, as shown in FIG. 5 , in an application embodiment, the above-mentioned IoT home interaction system further includes: a device management module, a user management module, a family management module, an application management module, a rule engine module, an interaction management module module.

In addition, the user logs in to the home interaction management system (the above-mentioned Internet of Things home interaction system) through the mobile phone APP or computer web browser, and the user management module performs login authentication and security verification processing. After the login is successful, the user can initiate a remote monitoring command service. ask. The application management module processes the remote monitoring command service request, checks whether the user has the remote monitoring application service authority, and then sends the command request to the device management module. The device management module checks whether the set-top box device is online, and if it is online, the generated streaming media protocol playback address , and play the real-time monitoring video (multimedia data) collected by the smart set-top box through the streaming media player of the user client (mobile phone APP or computer web browser).

In another embodiment, the user logs in to the home interaction management system through a mobile phone APP or a computer web browser, and the user management module performs login authentication and security verification processing. After the login is successful, the user can initiate a service request for home interaction instructions. The application management module processes the request for interactive services within the home, checks whether the user has the right to interact with the application within the home, and then sends an instruction request to the device management module. The device management module checks whether the set-top box device is online. Address, play the real-time monitoring video collected by the smart set-top box through the streaming media player of the user client (mobile phone APP or computer web browser), and at the same time send the home interactive instructions to the smart set-top box, after the smart set-top box receives the instruction, the infrared transmitter transmits Send the power-on command to the infrared receiver of the TV, and control the TV to display and play the real-time video and audio data output by the smart set-top box through the infrared command. The video and audio data come from the video collected by the camera and microphone of the remote user's mobile phone or computer and audio data, so as to realize the interactive traffic scene service within the home.

In one embodiment, the user logs in to the home interaction management system through a mobile phone APP or a computer web browser. Optionally, the user may log in to the home interaction management system through a smart set-top box APP. After success, users can add and delete friendly families through the family management module. The specific implementation method of adding a friendly family is as follows: the system assigns a unique family ID to each family. Users need to set their own family name and optionally set family notes. When adding a friendly family, they can directly input the other party's family ID. Add, or search for a family by family name, the system displays the searched family list on the user client interface, including family name, family ID, family remarks, the user selects the family they want to add to add, and can enter verification when adding The information is so that the other party can understand the verification. After the user adds a friendly family, the other party needs to verify and authorize the official addition. After the addition request is initiated, it is in the pending verification state, waiting for the other party's authorization and verification. After receiving the verification request to add a friendly family, the user can see the information of the other's family, including family name, family number, family remarks, family member's name, and family member's mobile phone number (such as desensitization display, that is, only the first three digits and the last three digits are displayed. 3 digits, the middle 5 digits are hidden with asterisks), add verification information, and confirm that the verification is passed, then the two parties are each other's friendly families and can conduct friendly family interactions.

The specific implementation method of deleting a friendly family is as follows: the user clicks the "Delete" button after the friendly family that needs to be deleted on the friendly family list page, and the system pops up a deletion confirmation page. After clicking the "OK" button on the confirmation page, the friendly family is deleted. When the other party logs in to the system, the system will prompt the other party that the friendly family has been deleted. After the deletion, the other party's family cannot be seen and cannot be interacted with the other party's family.

In one embodiment, the specific implementation of the friendly family interaction is as follows: the user selects a friendly family in the friendly family list, initiates a friendly interaction service request, the application management module processes the friendly family interaction service request, and checks whether the user has the friendly family interaction application service permission, and then forwards the family interaction request to the interaction management module for processing. The interaction management module searches for the smart set-top box devices of both families, and sends the interaction request to the other party's family administrator user. After the other party's family administrator user accepts the interaction request, an interactive connection is established. , the interactive management module sends an interactive command request to the device management module, the device management module checks whether the smart set-top boxes of both parties are online, and if both are online, it sends an interactive command to the smart set-top boxes of both parties, and the smart set-top box checks whether the TV is turned on. When turned on, send a power-on command to the infrared receiver of the TV through the infrared transmitter, and then control the TV to display and play the real-time video and audio data output by the smart set-top box through the infrared command. Real-time video and audio data collected by microphones, enabling interactive communication between friendly families.

In one embodiment, the user logs in to the home interaction management system through a mobile phone APP or a computer web browser. Optionally, the user may log in to the home interaction management system through a smart set-top box APP, and the user management module performs login authentication and security verification processing. After the login is successful, if the user has not added a friendly family, the friendly family can be added in the manner provided in the above embodiment. Users can interact with the game with friendly families.

In one embodiment, the specific implementation of the friendly family game interaction is: the game software is managed by the application management module, and the user downloads the set-top box APP software to the set-top box for installation and storage before the game interaction. The game includes but is not limited to somatosensory interaction. Games can also be collected and manipulated by gamepads or other collection terminals. The user selects a friendly family in the friendly family list, initiates a game interaction service request, and the application management module processes the game interaction service request, checks whether the user has the application service permission to interact with the friendly family game, and then forwards the game interaction request to the interaction management module for processing. , the interaction management module searches for the smart set-top box devices of the families of both parties, and sends a game interaction request to the administrator user of the other party. After the administrator user of the other party accepts the interaction request, an interactive connection is established, and the interaction management module sends the game interaction instruction to the device management module. Request, the device management module checks whether the smart set-top boxes of both parties are online, and if both are online, it will send game interaction instructions to the smart set-top boxes of both parties, and the smart set-top boxes will check whether the TV is turned on. The device sends a power-on command, and then controls the TV to display and play the real-time video and audio data output by the smart set-top box through infrared commands. The real-time video and audio data output by the smart set-top box is a 3D game scene. The dynamic portraits of the participants and the audio data collected by the microphones of the other party's smart set-top boxes enable game interaction between friendly families.

In one embodiment, the smart set-top box device periodically reports data collected by the device to the server through the home broadband and the Internet, and the collected data includes: indoor temperature collected by a temperature sensor, indoor humidity collected by a humidity sensor, smoke detection data collected by a smoke detector, The indoor air quality data collected by the air quality sensor, the sound intensity decibel data collected by the microphone, and the real-time snapshot image data collected by the camera. The device management module receives the data reported by the device and forwards it to the rule engine module. The rule engine module analyzes and processes according to the configuration rules, identifies abnormal conditions such as smoke, fire, harmful gas, gas leakage, children's crying, and impact sound, and automatically alerts family members. Send the alarm message to the user's mobile phone APP, optionally, send the alarm message to the user as a short message or send it to the user's third-party APP, such as DingTalk and WeChat, after receiving the alarm message, the user can remotely monitor the home situation, or communicate with the user. Family members engage in intra-family interactions to confirm details, or otherwise handle alerts.

The embodiment of the present invention also has the following beneficial effects:

1. Through the above technical solutions, users can remotely turn on the TV at home through the mobile phone APP, conduct video interaction with the elderly, children or other members of the family at any time, supervise children's learning, or check the situation at home, and can also remotely control the TV to turn off. . Friendly family members can interact and communicate through the Internet through TV and mobile APPs, and hold multi-party video conferences. Interactive games can be played between family members or between friendly families. The game screen is displayed on the TV, simulating real scenes, such as simulating running in the park together, simulating games such as playing table tennis together, and displaying the game members in real time at appropriate positions in the game scene. dynamic image.

2. It can monitor the home indoor environment information in real time. After receiving the abnormal alarm information, it can dispatch the smart set-top box at home to view the monitoring information in real time, and carry out corresponding security prevention and control processing to ensure the safety of the home environment.

It should be noted that, for the sake of simple description, the foregoing method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence. As in accordance with the present invention, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

According to another aspect of the embodiments of the present invention, there is also provided an IoT home interaction device for implementing the above IoT home interaction method. As shown in Figure 8, the device includes:

a first receiving unit 802, configured to receive an interaction request instruction sent by the server;

a first collection unit 804, configured to, in response to the interaction request instruction, call a multimedia collection device configured on the set-top box to collect first multimedia data of the environment where the set-top box is located;

The first sending unit 806 is configured to send the first multimedia data to the server.

In the embodiment of the present invention, in the embodiment of the present invention, the acquired billing task to be processed is used to split according to business logic, so as to obtain multiple billing subtasks; Each billing subtask in the subtask is configured to the Kafka message queue; the method of configuring multiple billing subtasks in the above Kafka message queue to different task processing nodes for processing, in the above method, because the billing task is used Decompose it into multiple billing subtasks, and use the Kafka message queue to store multiple billing subtasks, which not only solves the problem of improving the processing efficiency of billing bills, but also improves the utilization rate of computing nodes, thereby solving the problem of higher processing efficiency of billing bills. Low technical issues.

In one or more embodiments, the above-mentioned IoT home interactive device further includes:

a second receiving unit, configured to receive second multimedia data sent by the server, where the second multimedia data is data sent by another set-top box or mobile terminal to the server;

a first determining unit, configured to determine whether the display terminal associated with the set-top box is in an open state;

If yes, send the second multimedia data to the display terminal for display;

If not, send an opening instruction to the display terminal, and after the display terminal is turned on, send the second multimedia data to the display terminal for display.

In one or more embodiments, the above-mentioned IoT home interactive device further includes:

a third receiving unit, configured to receive second multimedia data sent by the server, where the second multimedia data is data sent by another set-top box or mobile terminal to the server;

a second determining unit, configured to determine whether the display terminal associated with the set-top box is in an open state;

If yes, send the second multimedia data to the display terminal for display;

If not, send an opening instruction to the display terminal, and after the display terminal is turned on, send the second multimedia data to the display terminal for display.

In one or more embodiments, the above-mentioned IoT home interactive device further includes:

The third determination unit is configured to determine that the display terminal is in an on state, and output the interactive game scene to the display terminal for display; wherein, the interactive game scene includes dynamic portraits and/or audios of interactive game participants, so The dynamic portrait and/or audio are data extracted from the first multimedia file and the second multimedia data.

In one or more embodiments, the above-mentioned IoT home interactive device includes:

The second collection unit is configured to collect parameter information of the environment in which the set-top box is located through a sensor configured in the set-top box, where the parameter information includes one or more of temperature, humidity, smoke, air quality, and sound intensity ;

The second sending unit is configured to send the parameter information to the server.

According to yet another aspect of the embodiments of the present invention, there is also provided an electronic device for implementing the above-mentioned IoT home interaction method, where the electronic device may be the terminal device or the server shown in FIG. 9 . This embodiment is described by taking the electronic device as a terminal as an example. As shown in FIG. 9 , the electronic device includes a memory 902 and a processor 904, where a computer program is stored in the memory 902, and the processor 904 is configured to execute the steps in any of the above method embodiments through the computer program.

Optionally, in this embodiment, the above-mentioned electronic device may be located in at least one network device among multiple network devices of a computer network.

Optionally, in this embodiment, the above-mentioned processor may be configured to execute the following steps through a computer program:

S11, receiving the interactive request instruction sent by the server;

S12, in response to the interaction request instruction, call a multimedia collection device configured on the set-top box to collect first multimedia data of the environment where the set-top box is located;

S13: Send the first multimedia data to the server.

Optionally, those of ordinary skill in the art can understand that the structure shown in FIG. 10 is only for illustration, and the electronic device can also

storage, flash memory, or other non-volatile solid-state memory. In some instances, memory 1002 may further include memory located remotely from processor 1004, and these remote memories may be connected to the terminal through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof. Wherein, the memory 1002 can be specifically, but not limited to, a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a handheld computer, and terminal devices such as Mobile Internet Devices (MID) and PAD. FIG. 9 does not limit the structure of the above-mentioned electronic device. For example, the electronic device may also include more or fewer components (eg, network interfaces, etc.) than shown in FIG. 9 , or have a different configuration than that shown in FIG. 9 .

The memory 902 may be used to store software programs and modules, such as program instructions/modules corresponding to the IoT home interaction method and device in the embodiments of the present invention, and the processor 904 runs the software programs and modules stored in the memory 902 to thereby Execute various functional applications and data processing, that is, to realize the above-mentioned IoT home interaction method. The memory 902 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic memories for storing information such as multimedia volume data. As an example, as shown in FIG. 9 , the above-mentioned memory 902 may include, but is not limited to, the first receiving unit 802 , the first collecting unit 804 and the first sending unit 806 in the above-mentioned IoT home interactive device. In addition, it may also include, but is not limited to, other module units in the above-mentioned IoT home interactive device, which will not be repeated in this example.

Optionally, the above-mentioned transmission device 906 is configured to receive or send data via a network. Specific examples of the above-mentioned networks may include wired networks and wireless networks. In one example, the transmission device 906 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices and routers through a network cable so as to communicate with the Internet or a local area network. In one example, the transmission device 906 is a radio frequency (RF) module, which is used for wirelessly communicating with the Internet.

In addition, the above-mentioned electronic equipment further includes: a display 908 for displaying the above-mentioned multimedia data; and a connection bus 910 for connecting various module components in the above-mentioned electronic equipment.

According to another aspect of the embodiments of the present invention, there is also provided an IoT home interaction device for implementing the above IoT home interaction method. As shown in Figure 10, the device includes:

The first receiving unit 1002 receives an interactive service request instruction sent by a client, where the interactive service request instruction carries user information logging in to the client;

The first sending unit 1004 is configured to send an interactive request instruction to the target set-top box when it is determined that the user corresponding to the user information has the interactive application service authority, so that the target set-top box collects the first multimedia data around the set-top box ; wherein, the target set-top box is a set-top box that has a binding relationship with the user;

The second receiving unit 1006 is configured to receive the first multimedia data sent by the target set-top box.

In one or more embodiments, the above-mentioned IoT home interactive device further includes:

a third receiving unit, configured to receive the interactive service request of the first user sent by the client, where the interactive service request carries the user information of the second user to be interacted with;

a second sending unit, configured to send an interactive connection request to the second user's client or set-top box when it is determined that both the first user and the second user have the interactive application service authority;

a fourth receiving unit, configured to receive the second multimedia data sent by the first set-top box and the third multimedia data sent by the second set-top box when receiving the confirmation message of the second user's client or the set-top box; Wherein, the first set-top box is a set-top box bound by the first user, and the second set-top box is a set-top box bound by the second user;

a fusion unit, configured to fuse the second multimedia data and the third multimedia data to obtain target streaming media data;

a third sending unit, configured to send the target streaming media data to the first set-top box and the second set-top box, so that the first display terminal associated with the first set-top box and the second set-top box associated with the second set-top box Both display terminals display the target streaming media data.

In one or more embodiments, in the above-mentioned IoT home interactive device, the interactive service request includes an interactive game request, and accordingly, the second multimedia data includes a dynamic portrait and/or audio of the first user , the third multimedia data includes a dynamic portrait and/or audio of the second user;

The fusion unit specifically includes:

A fusion module, configured to fuse the dynamic portrait and/or audio of the first user, the dynamic portrait and/or audio of the second user and the scene of the current interactive game to obtain the target streaming media data.

In one or more embodiments, the above-mentioned IoT home interactive device further includes:

a fifth receiving unit, configured to receive parameter information of the environment where the set-top box is located by a sensor in the target set-top box, where the parameter information includes one or more of temperature, humidity, smoke, air quality, and sound intensity;

The fourth sending unit is configured to send alarm information to the target set-top box or client when it is judged that the parameter information is in the abnormal threshold range based on a preset warning rule.

According to yet another aspect of the embodiments of the present invention, there is also provided an electronic device for implementing the above-mentioned IoT home interaction method, where the electronic device may be the terminal device or the server shown in FIG. 11 . This embodiment is described by taking the electronic device as a terminal as an example. As shown in FIG. 11 , the electronic device includes a memory 1102 and a processor 1104, where a computer program is stored in the memory 1102, and the processor 1104 is configured to execute the steps in any of the above method embodiments through the computer program.

Optionally, in this embodiment, the above-mentioned electronic device may be located in at least one network device among multiple network devices of a computer network.

Optionally, in this embodiment, the above-mentioned processor may be configured to execute the following steps through a computer program:

S21, receiving an interactive service request instruction sent by the client, where the interactive service request instruction carries user information logging in to the client;

S22, when it is determined that the user corresponding to the user information has the interactive application service authority, send an interactive request instruction to the target set-top box, so that the target set-top box collects first multimedia data around the set-top box; wherein the target set-top box The set-top box is a set-top box that has a binding relationship with the user;

S23: Receive the first multimedia data sent by the target set-top box.

Optionally, those of ordinary skill in the art can understand that the structure shown in FIG. 11 is only for illustration, and the electronic device of the electronic device may also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a palmtop computer, and a mobile Internet device. (Mobile Internet Devices, MID), PAD and other terminal equipment. FIG. 11 does not limit the structure of the above-mentioned electronic device. For example, the electronic device may also include more or fewer components (eg, network interfaces, etc.) than shown in FIG. 11 , or have a different configuration than that shown in FIG. 11 .

The memory 1102 may be used to store software programs and modules, such as program instructions/modules corresponding to the IoT home interaction method and device in the embodiments of the present invention, and the processor 1104 runs the software programs and modules stored in the memory 1102, thereby Execute various functional applications and data processing, that is, to realize the above-mentioned IoT home interaction method. Memory 1102 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 1102 may further include memory located remotely from the processor 1104, and these remote memories may be connected to the terminal through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof. Wherein, the memory 1102 may specifically, but not be limited to, be used to store multimedia data information. As an example, as shown in FIG. 11 , the above-mentioned memory 1102 may include, but is not limited to, the first receiving unit 1002 , the first sending unit 1004 and the second receiving unit 1006 in the above-mentioned IoT home interactive device. In addition, it may also include, but is not limited to, other module units in the above-mentioned IoT home interactive device, which will not be repeated in this example.

Optionally, the above-mentioned transmission device 1106 is configured to receive or send data via a network. Specific examples of the above-mentioned networks may include wired networks and wireless networks. In one example, the transmission device 1106 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices and routers through a network cable so as to communicate with the Internet or a local area network. In one example, the transmission device 1106 is a radio frequency (RF) module, which is used for wirelessly communicating with the Internet.

In addition, the above-mentioned electronic device further includes: a display 1108 for displaying the above-mentioned multimedia data; and a connection bus 1110 for connecting various module components in the above-mentioned electronic device.

According to another aspect of the embodiments of the present invention, there is also provided an IoT home interaction device for implementing the above IoT home interaction method. As shown in Figure 12, the device includes:

The first sending unit 1202 sends an interactive service request instruction to the server, so that the server obtains the first multimedia data; wherein, the interactive service request instruction carries the user information logging in the client, the first multimedia data The volume data is multimedia data collected by a set-top box that has a binding relationship with the client;

The first receiving unit 1204 is configured to receive the first multimedia data sent by the server.

In one or more embodiments, the above-mentioned IoT home interactive device further includes:

The second sending unit is configured to send the interactive service request of the first user to the server, where the interactive service request carries the user information of the second user to be interacted with; wherein, the first user is a user logged in the current client user;

The second receiving unit is configured to receive the confirmation message of the second user sent by the server when it is determined that both the first user and the second user have the interactive application service authority.

According to yet another aspect of the embodiments of the present invention, there is also provided an electronic device for implementing the above-mentioned IoT home interaction method, where the electronic device may be the terminal device or the server shown in FIG. 13 . This embodiment is described by taking the electronic device as a terminal as an example. As shown in FIG. 13 , the electronic device includes a memory 1302 and a processor 1304, where a computer program is stored in the memory 1302, and the processor 1304 is configured to execute the steps in any of the above method embodiments through the computer program.

Optionally, in this embodiment, the above-mentioned electronic device may be located in at least one network device among multiple network devices of a computer network.

Optionally, in this embodiment, the above-mentioned processor may be configured to execute the following steps through a computer program:

S31: Send an interactive service request instruction to a server, so that the server obtains first multimedia data; wherein, the interactive service request instruction carries user information logging in to the client, and the first multimedia data is related to The multimedia data collected by the set-top box of which the client has a binding relationship;

S32: Receive the first multimedia data sent by the server.

Optionally, those of ordinary skill in the art can understand that the structure shown in FIG. 13 is only for illustration, and the electronic device of the electronic device can also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a palmtop computer, and a mobile Internet device. (Mobile Internet Devices, MID), PAD and other terminal equipment. FIG. 13 does not limit the structure of the above-mentioned electronic device. For example, the electronic device may also include more or fewer components (eg, network interfaces, etc.) than shown in FIG. 13 , or have a different configuration than that shown in FIG. 13 .

The memory 1302 may be used to store software programs and modules, such as program instructions/modules corresponding to the Internet of Things home interaction method and device in the embodiment of the present invention. The processor 1304 runs the software programs and modules stored in the memory 1302, thereby Execute various functional applications and data processing, that is, to realize the above-mentioned IoT home interaction method. Memory 1302 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, memory 1302 may further include memory located remotely from processor 1304, and these remote memories may be connected to the terminal through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof. Wherein, the memory 1302 can be specifically, but not limited to, used to store information such as multimedia data. As an example, as shown in FIG. 13 , the above-mentioned memory 1302 may include, but is not limited to, the first sending unit 1202 and the first receiving unit 1204 in the above-mentioned IoT home interactive device. In addition, it may also include, but is not limited to, other module units in the above-mentioned IoT home interactive device, which will not be repeated in this example.

Optionally, the above-mentioned transmission means 1306 is configured to receive or transmit data via a network. Specific examples of the above-mentioned networks may include wired networks and wireless networks. In one example, the transmission device 1306 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices and routers through a network cable so as to communicate with the Internet or a local area network. In one example, the transmission device 1306 is a radio frequency (RF) module, which is used for wirelessly communicating with the Internet.

In addition, the above-mentioned electronic equipment further includes: a display 1308 for displaying the above-mentioned multimedia data; and a connection bus 1310 for connecting various module components in the above-mentioned electronic equipment.

In other embodiments, the above-mentioned set-top box, terminal device or server may be a node in a distributed system, wherein the distributed system may be a blockchain system, and the blockchain system may be configured by the multiple nodes through A distributed system formed by connection in the form of network communication. Among them, a peer-to-peer (P2P, Peer To Peer) network can be formed between nodes, and any form of computing device, such as servers, terminals and other electronic devices can become a node in the blockchain system by joining the peer-to-peer network.

According to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the above-mentioned Internet of Things home interaction method, wherein the computer program is configured to execute any one of the above-mentioned methods when running. steps in a method embodiment.

Optionally, in this embodiment, the above-mentioned computer-readable storage medium may be configured to store a computer program for executing the following steps:

S11, receiving the interactive request instruction sent by the server;

S12, in response to the interaction request instruction, call a multimedia collection device configured on the set-top box to collect first multimedia data of the environment where the set-top box is located;

S13: Send the first multimedia data to the server. Alternatively, a computer program that performs the following steps:

S21, receiving an interactive service request instruction sent by the client, where the interactive service request instruction carries user information logging in to the client;

S22, when it is determined that the user corresponding to the user information has the interactive application service authority, send an interactive request instruction to the target set-top box, so that the target set-top box collects first multimedia data around the set-top box; wherein the target set-top box The set-top box is a set-top box that has a binding relationship with the user;

S23: Receive the first multimedia data sent by the target set-top box. Or a computer program that performs the following steps:

S31: Send an interactive service request instruction to a server, so that the server obtains first multimedia data; wherein, the interactive service request instruction carries user information logging in to the client, and the first multimedia data is related to The multimedia data collected by the set-top box of which the client has a binding relationship;

S32: Receive the first multimedia data sent by the server.

Optionally, in this embodiment, those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing the hardware related to the terminal device through a program, and the program can be stored in a In the computer-readable storage medium, the storage medium may include: a flash disk, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.

If the integrated units in the above-mentioned embodiments are implemented in the form of software functional units and sold or used as independent products, they may be stored in the above-mentioned computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, Several instructions are included to cause one or more computer devices (which may be personal computers, servers, or network devices, etc.) to perform all or part of the steps of the methods of various embodiments of the present invention.

In the above-mentioned embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed client may be implemented in other manners. The device embodiments described above are only illustrative, for example, the division of units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components may be combined or integrated into Another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of units or modules, and may be in electrical or other forms.

Units described as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The above are only the preferred embodiments of the present invention. It should be pointed out that for those skilled in the art, some improvements and modifications can be made without departing from the principles of the present invention, and these improvements and modifications should also be regarded as It is the protection scope of the present invention.

Claims (13)

1. The Internet of things family interaction method is applied to a set top box and comprises the following steps:

receiving an interaction request instruction sent by a server;

responding to the interaction request instruction, and calling multimedia acquisition equipment configured on the set top box to acquire first multimedia data of the environment where the set top box is located;

and sending the first multimedia data to the server.

2. The method of claim 1, further comprising:

receiving second multimedia data sent by a server, wherein the second multimedia data is data sent to the server by another set top box or a mobile terminal;

determining whether a display terminal associated with the set top box is in an on state;

if yes, sending the second multimedia data to the display terminal for displaying;

and if not, sending a starting instruction to the display terminal, and sending the second multimedia data to the display terminal for displaying after the display terminal is started.

3. The method of claim 2, wherein the interaction request command is a game interaction request command, the method further comprising:

determining that the display terminal is in an open state, and outputting an interactive game scene to the display terminal for displaying; the interactive game scene comprises dynamic portraits and/or audios of interactive game participants, and the dynamic portraits and/or audios are data extracted from the first multimedia file and the second multimedia data.

4. The method of claim 1, further comprising:

acquiring parameter information of an environment where the set top box is located through a sensor configured in the set top box, wherein the parameter information comprises one or more of temperature, humidity, smoke, air quality and sound intensity;

and sending the parameter information to the server.

5. The Internet of things family interaction method is applied to a server and comprises the following steps:

receiving an interactive service request instruction sent by a client, wherein the interactive service request instruction carries user information for logging in the client;

when determining that a user corresponding to the user information has an interactive application service right, sending an interactive request instruction to a target set top box so that the target set top box acquires first multimedia data around the set top box; the target set top box is a set top box which has a binding relation with the user;

and receiving the first multimedia data sent by the target set top box.

6. The method of claim 5, further comprising:

receiving an interactive service request of a first user sent by the client, wherein the interactive service request carries user information of a second user to be interacted;

under the condition that the first user and the second user are determined to have the interactive application service authority, sending an interactive connection request to a client side or a set top box of the second user;

when receiving a confirmation message of the client of the second user or the set top box, receiving second multimedia data sent by the first set top box and third multimedia data sent by the second set top box; the first set top box is a set top box bound by the first user, and the second set top box is a set top box bound by the second user;

fusing the second multimedia data and the third multimedia data to obtain target streaming media data;

and sending the target streaming media data to the first set top box and the second set top box so as to display the target streaming media data on a first display terminal associated with the first set top box and a second display terminal associated with the second set top box.

7. The method of claim 6, wherein the interactive service request comprises an interactive game request, and accordingly, the second multimedia data comprises a dynamic portrait and/or audio of the first user, and the third multimedia data comprises a dynamic portrait and/or audio of the second user;

the fusing the second multimedia data and the third multimedia data to obtain target streaming media data includes:

and fusing the dynamic portrait and/or audio of the first user, the dynamic portrait and/or audio of the second user and the scene of the current interactive game to obtain the target streaming media data.

8. The method of claim 5, further comprising:

receiving parameter information of an environment where a sensor in the target set top box collects the set top box, wherein the parameter information comprises one or more of temperature, humidity, smoke, air quality and sound intensity;

and when judging that the parameter information is in the abnormal threshold range based on a preset early warning rule, sending warning information to the target set top box or the client.

9. The Internet of things family interaction method is applied to a client and comprises the following steps:

sending an interactive service request instruction to a server so that the server acquires first multimedia data; the interactive service request instruction carries user information for logging in the client, and the first multimedia data is multimedia data acquired by a set top box which has a binding relationship with the client;

and receiving the first multimedia data sent by the server.

10. The method of claim 9, further comprising:

sending an interactive service request of a first user to a server, wherein the interactive service request carries user information of a second user to be interacted; the first user is a user logged in the current client;

and receiving a confirmation message of the second user sent by a server under the condition that the first user and the second user are both determined to have the interactive application service authority.

11. An electronic device comprising a memory and a processor, wherein the processor is arranged to execute the method of any one of claims 1 to 4, or 5 to 8, or 9 to 10 by means of a computer program.

12. An Internet of things family interaction system is characterized by comprising a set top box, a server and a client; wherein,

the set-top box is configured to: receiving an interaction request instruction sent by a server;

responding to the interaction request instruction, calling multimedia acquisition equipment configured on the set top box to acquire first multimedia data of the environment where the set top box is located;

sending the first multimedia data to the server;

the server is configured to: receiving an interactive service request instruction sent by a client, wherein the interactive service request instruction carries user information for logging in the client;

when it is determined that a user corresponding to the user information has an interactive application service right, sending an interactive request instruction to a target set top box so that the target set top box acquires first multimedia data around the set top box; the target set top box is a set top box which has a binding relation with the user;

receiving the first multimedia data sent by the target set top box;

the client is used for: sending an interactive service request instruction to a server so that the server acquires first multimedia data; the interactive service request instruction carries user information for logging in the client, and the first multimedia data is multimedia data acquired by a set top box which has a binding relationship with the client;

and receiving the first multimedia data sent by the server.

13. A computer-readable storage medium comprising a stored program, wherein the program when executed performs the method of any of claims 1 to 4, or 5 to 8, or 9 to 10.

Images