WO2021013136A1

WO2021013136A1 - Apparatus control method, and electronic apparatus

Info

Publication number: WO2021013136A1
Application number: PCT/CN2020/103129
Authority: WO
Inventors: 陈文军; 王雷
Original assignee: 华为技术有限公司
Priority date: 2019-07-25
Filing date: 2020-07-20
Publication date: 2021-01-28
Also published as: CN110519444A

Abstract

Embodiments of the present application provide an apparatus control method and an electronic apparatus, pertaining to the technical field of electronic communications, and enabling, when an electronic apparatus is not unlocked, apparatus control for the electronic apparatus by inputting a control gesture, thereby simplifying an apparatus control manner. The method is applicable to an electronic apparatus used to control at least one first apparatus, and comprises: when the electronic apparatus is in a pre-determined state, receiving a first touch operation input by a user on a touch screen, and acquiring fingerprint information corresponding to the first touch operation, wherein the electronic apparatus displays a first interface or an off screen when in the pre-determined state; the electronic apparatus determining, from at least one first apparatus connected thereto, one or more first apparatus corresponding to the fingerprint information; and the electronic apparatus sending to the one or more first apparatuses a first control instruction used to trigger the one or more first apparatuses to enable a corresponding event to take place.

Description

Device control method and electronic device

This application claims the priority of a Chinese patent application filed with the State Intellectual Property Office, the application number is 201910677017.3, and the invention title is "a device control method and electronic device" on July 25, 2019. The entire content is incorporated by reference in In this application.

Technical field

The embodiments of the present application relate to the field of electronic communication technology, and in particular to a device control method and electronic equipment.

Background technique

With the advancement of technology, various types of home appliances have appeared one after another, bringing great convenience to users' lives. In order to further facilitate the user's life, all existing household equipment can be connected to the home network, and the user can connect to the home network through a terminal device to realize the control of the household equipment. The realization of remote control of the household equipment generally requires the use of a communication module.

The specific implementation process is: the user uses a mobile terminal to connect to the smart home through the Internet platform, and manages the devices of the smart home through the mobile terminal. By inputting control commands on the mobile terminal, the mobile terminal transmits the control commands to the smart home network , The smart home network sends control commands to the corresponding home equipment to realize remote control of the smart home equipment.

However, the inventor found that in the current smart home management system, it is generally necessary to install a special application program on the mobile terminal, and enter the control command for the smart home device in the application program. When the user wants to control the smart device, the user needs to The mobile terminal unlocks the screen and enters the relevant application program to input the relevant control commands. This method of starting the smart home is complicated to operate, resulting in slower opening or closing of the home equipment.

Summary of the invention

The embodiments of the present application provide a device control method and an electronic device. When the electronic device is not unlocked, the electronic device can control the device by inputting a control gesture. This control method can realize rapid control of the device. Simplify the control method of the equipment.

In order to achieve the above technical objectives, the following technical solutions are adopted in the embodiments of this application:

The embodiments of the present application are applied to electronic devices, and the electronic devices are used to control at least one first device, and the electronic devices include a touch screen. The control method of the first device in the embodiment of the present application includes: when the electronic device is in a preset state, receiving a first touch operation input by the user on the touch screen, and collecting fingerprint information corresponding to the first touch operation, wherein the electronic device is in the preset state. When the state is set, the first interface or a black screen is displayed; the electronic device determines one or more first devices corresponding to the fingerprint information from at least one first device connected to it; the electronic device sends the first device to the one or more first devices A control command, the first control command is used to trigger one or more first devices to execute corresponding events.

The electronic device in the preset state can acquire the user's first touch operation on the touch screen, and respond to the first touch operation to send a first control command to one or more first devices connected to it. This method of controlling the first device can be performed when the electronic device has a black screen, without entering a related control program or control interface, and the first device can be quickly controlled. The control of the first device is realized directly through the first touch operation, which simplifies the control method of the first device.

With reference to the first aspect, in a possible implementation manner, after the electronic device sends the first control command to one or more first devices, the method provided in this embodiment of the present application further includes: the electronic device displays a second interface, where: The second interface includes: one or more control switches of the first device and/or one or more adjustment switches of the first device; the electronic device receives the user's second touch operation on the control switch or the adjustment switch in the second interface; In response to the second touch operation, the electronic device sends a second control command to one or more first devices, where the second control command is used to trigger one or more first devices to perform an event corresponding to the second touch operation.

In the above possible implementation, after the electronic device sends the first control command to one or more first devices, the second interface is displayed, which helps the user to control other operations of the first device. For example, the first device is a speaker, and the speaker is triggered by the first control command to play music, and the second interface displays a music playback interface, which is convenient for the user to perform operations such as adjusting the volume and switching music. The display of the second interface helps the user to further control the first device and improve the user experience.

With reference to the first aspect, in a possible implementation manner, after sending the first control command to the one or more first devices, the method provided in this embodiment of the present application further includes: the electronic device receives one or more first devices A first control response sent by a device, where the first control response carries status information of one or more first devices; the electronic device displays status information of one or more first devices.

The status information carried in the first control response sent by the first device is displayed on the electronic device, so that the user can understand the current operating status of the first device through the display status of the electronic device, and further improve the user experience. It is worth mentioning that the status information in this embodiment and the control switch or adjustment switch of the first device can be displayed on the second interface, so that the user can perform further operations and control the first device according to the display of the electronic device. .

With reference to the first aspect, in a possible implementation manner, after the electronic device determines the one or more first devices corresponding to the fingerprint information, before the electronic device sends the first control command to the one or more first devices, this application The method provided by the embodiment further includes: the electronic device determines that the first touch operation is a preset touch operation.

The fingerprint information is carried in the first touch operation, and the first device that receives the first control command is determined according to the fingerprint information. If only the fingerprint information is used to determine the recipient of the first control command, for an electronic device unlocked using a fingerprint, the electronic device may be unlocked due to the fingerprint information of the first operation. After determining that the first touch operation is a preset touch operation, the first control command is sent to the first device, which improves the accuracy of the response of the electronic device and avoids false triggering.

With reference to the first aspect, in a possible implementation manner, after the electronic device determines the one or more first devices corresponding to the fingerprint information, before the electronic device sends the first control command to the one or more first devices, this application The method provided by the embodiment further includes: the electronic device determines that the first touch operation is a first control command issued by the electronic device to one or more first devices through a preset manner; wherein the preset manner includes at least: a voice confirmation manner and a gesture Confirmation method.

Both the voice confirmation mode and the gesture confirmation mode are set to avoid misoperations that may be caused by the first touch operation, so that the electronic device accurately responds to the first touch operation, and further improves the user experience.

With reference to the first aspect, in a possible implementation manner, the electronic device further includes one or more sensors; the one or more sensors include at least one or more of an ambient light sensor, an acceleration sensor, a distance sensor, a camera, and a microphone. Before the electronic device determines that the first touch operation is the first control command issued by the electronic device to one or more first devices in a preset manner, the method provided in this embodiment of the present application further includes: the electronic device according to one or more The parameters collected by the sensor determine the preset mode.

Determining the preset mode according to the parameters of the sensor helps to determine the preset mode according to different scenarios or states of the electronic device, so that the preset mode is more in line with the user's current operating habits, and the user experience is further improved.

With reference to the first aspect, in a possible implementation manner, the fingerprint information includes fingerprint characteristics of one or more fingers.

In a second aspect, an embodiment of the present application provides an electronic device, which is used to control at least one first device. The electronic device may include a touch screen, a memory, and one or more processors. The touch screen, memory and processor are coupled. The memory is used to store computer program code, the computer program code includes computer instructions, when the processor executes the computer instructions, the processor is configured to receive the first touch input by the user on the touch screen when the electronic device is in a preset state Operate, and collect fingerprint information corresponding to the first touch operation. The touch screen is used to display the first interface or a black screen when the electronic device is in a preset state. The processor is further configured to: the electronic device determines one or more first devices corresponding to fingerprint information from at least one first device connected to it; the electronic device sends a first control command to the one or more first devices, The first control command is used to trigger one or more first devices to execute corresponding events.

With reference to the second aspect, in a possible implementation manner, the processor is further configured to control the touch screen to display a second interface, the touch screen is also configured to display a second interface, the second interface includes: one or more first The control switch of the device and/or the adjustment switch of one or more first devices. The processor is further configured to receive a second touch operation of the user on the control switch or adjustment switch in the second interface; in response to the second touch operation, the electronic device sends a second control command to one or more first devices , Where the second control command is used to trigger one or more first devices to perform an event corresponding to the second touch operation.

With reference to the second aspect, in a possible implementation manner, the processor is further configured to receive a first control response sent by one or more first devices, where the first control response carries the status of one or more first devices information. The processor is also configured to control the touch screen to display status information of one or more first devices. The touch screen is also used to display status information of one or more first devices.

With reference to the second aspect, in a possible implementation manner, the processor is further configured to determine that the first touch operation is a preset touch operation.

With reference to the second aspect, in a possible implementation manner, the processor is further configured to determine that the first touch operation is the first control command issued by the electronic device to one or more first devices in a preset manner; Among them, the preset modes include at least: a voice confirmation mode and a gesture confirmation mode.

With reference to the second aspect, in a possible implementation manner, the electronic device further includes one or more sensors; the one or more sensors include at least one or more of an ambient light sensor, an acceleration sensor, a distance sensor, and a microphone. The device is also used to determine the preset mode according to the parameters collected by one or more sensors.

With reference to the second aspect, in a possible implementation manner, the fingerprint information includes fingerprint characteristics of one or more fingers.

In a third aspect, the embodiments of the present application also provide an electronic device that can be used to control at least one device, the electronic device further includes: an input module, a determination module, and a sending module; the input module is used to receive a user The first touch operation is input on the touch screen, and the fingerprint information corresponding to the first touch operation is collected. When the electronic device is in the preset state, the first interface or the black screen is displayed; the determining module is used to retrieve at least one In a device, determine one or more first devices corresponding to the fingerprint information; the sending module is used to send a first control command to one or more first devices, and the first control command is used to trigger one or more first devices Perform the corresponding event.

With reference to the third aspect, the input module is further used to receive a second touch operation of the user on the control switch or adjustment switch in the second interface; the electronic device further includes a display module, and the sending module is used to respond to the second touch operation, Sending a second control command to one or more first devices, and the second control command is used to trigger one or more first devices to execute corresponding events.

With reference to the third aspect, the input module is also used to receive a first control response sent by one or more first devices, the first control response carries one or more first device status information; the display module is also used to display one Or multiple first device status information.

With reference to the third aspect, the determining module is further configured to determine that the first touch operation is a preset touch operation.

With reference to the third aspect, the determining module is further configured to determine that the first touch operation is a first control command issued by the electronic device to one or more first devices through a preset confirmation method; wherein the preset confirmation method includes at least: voice confirmation Ways and gesture confirmation methods.

With reference to the third aspect, the electronic device further includes one or more sensors; at least including: one or more of an ambient light sensor, an acceleration sensor, a camera, a distance sensor, and a microphone; the determining module is also used to, according to one or more The parameters collected by the sensor determine the preset confirmation method.

With reference to the third aspect, the fingerprint information includes fingerprint characteristics of one or more fingers.

In a fourth aspect, an embodiment of the present application provides a chip system, which is applied to an electronic device including the aforementioned touch screen. The chip system includes one or more interface circuits and one or more processors. The interface circuit and the processor are interconnected by wires. The interface circuit is used to receive a signal from the memory of the electronic device and send the signal to the processor, and the signal includes a computer instruction stored in the memory. When the processor executes the computer instruction, the electronic device executes the method described in the first aspect and any one of its possible implementation manners.

In a fifth aspect, an embodiment of the present application provides a computer storage medium that includes computer instructions. When the computer instructions are executed on an electronic device, the electronic device is caused to perform operations as in the first aspect and any of them. The methods described in possible implementations.

In the sixth aspect, the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the method described in the first aspect and any of its possible implementations .

Understandably, the electronic device described in the second aspect, the third aspect and any one of the possible implementations thereof provided above, the chip system described in the fourth aspect, the computer storage medium described in the fifth aspect, the first For the beneficial effects that can be achieved by the computer program product described in the six aspects, please refer to the beneficial effects in the first aspect and any of its possible design methods, which will not be repeated here.

Description of the drawings

FIG. 1 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the application;

Figure 2 is a flowchart of a device control method provided by an embodiment of the application;

FIG. 3 is a schematic diagram of a mobile phone displaying a first interface according to an embodiment of the application;

FIG. 4a is an operation schematic diagram of a first touch operation provided by an embodiment of this application;

4b is an operation schematic diagram of another first touch operation provided by an embodiment of this application;

4c is an operation schematic diagram of another first touch operation provided by an embodiment of this application;

Figure 5 is a schematic structural diagram of a smart home network provided by an embodiment of the application;

FIG. 6 is a schematic structural diagram including all smart home devices provided by an embodiment of the application;

Figure 7a is a schematic structural diagram of a mobile phone controlling a device in an application scenario provided by an embodiment of the application;

FIG. 7b is a schematic structural diagram of a mobile phone controlling a device in another application scenario provided by an embodiment of the application;

FIG. 7c is a schematic structural diagram of a mobile phone controlling a device in another application scenario provided by an embodiment of this application;

8 is a mobile phone display interface diagram of a gesture confirmation method provided by an embodiment of the application;

9 is a mobile phone display interface diagram of another gesture confirmation method provided by an embodiment of the application;

FIG. 10 is a flowchart of another device control method provided by an embodiment of the application;

11 is a schematic diagram of a display image of a second interface provided by an embodiment of the application;

12 is a schematic diagram of a display image of another second interface provided by an embodiment of the application;

FIG. 13 is a schematic diagram of a display image of another second interface provided by an embodiment of the application;

14a is a schematic diagram of a display image of another second interface provided by an embodiment of the application;

FIG. 14b is a schematic diagram of a display image of another second interface provided by an embodiment of the application;

15 is a schematic diagram of a display image of another second interface provided by an embodiment of the application;

FIG. 16 is a schematic diagram of a display image of another second interface provided by an embodiment of the application;

FIG. 17 is a schematic diagram of a module structure of an electronic device provided by an embodiment of this application;

FIG. 18 is a schematic structural diagram of a chip system provided by an embodiment of the application.

Detailed ways

Hereinafter, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of these features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

The embodiment of the present application provides a method for controlling a device. The method is applied to an electronic device, and the electronic device is used to control at least one device, and the electronic device includes a touch screen. By using the method in the embodiment of the present application, the electronic device acquires the first touch operation input by the user when the electronic device is not unlocked, and sends a control command to the device according to the first touch operation to realize the control of the device. This control method can not only realize the control of the equipment, but also simplifies the control method of the equipment to a certain extent.

Exemplarily, the electronic devices in the embodiments of the present application may be mobile phones, tablet computers, desktops, laptops, handheld computers, notebook computers, ultra-mobile personal computers (UMPC), netbooks, and cellular computers. Telephones, personal digital assistants (PDA), augmented reality (AR)\virtual reality (VR) devices, including touch screen devices, and the electronic devices that can control the devices, this application is implemented The example does not impose special restrictions on the specific form of the electronic equipment.

The implementation of the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings. Please refer to FIG. 1, which is a schematic structural diagram of an electronic device 100 provided by an embodiment of this application. As shown in FIG. 1, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, and a battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

Among them, the aforementioned sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, an acceleration sensor 180D, a distance sensor 180E, a proximity sensor 180F, a fingerprint sensor 180G, a temperature sensor 180H, a touch sensor 180I, and an ambient light sensor 180J Wait for the sensor.

It can be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Among them, the different processing units may be independent devices or integrated in one or more processors.

The controller may be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

A memory may also be provided in the processor 110 to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter (universal asynchronous transmitter) interface. receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / Or Universal Serial Bus (USB) interface, etc.

It can be understood that the interface connection relationship between the modules illustrated in this embodiment is merely a schematic description, and does not constitute a structural limitation of the electronic device 100. In other embodiments, the electronic device 100 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.

The charging management module 140 is used to receive charging input from the charger. Among them, the charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive the charging input of the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 may receive the wireless charging input through the wireless charging coil of the electronic device 100. While the charging management module 140 charges the battery 142, it can also supply power to the electronic device through the power management module 141.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may also be provided in the same device.

The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.

The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna can be used in combination with a tuning switch.

The mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform processing such as filtering, amplifying and transmitting the received electromagnetic waves to the modem processor for demodulation.

The mobile communication module 150 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation via the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellites. System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.

The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, perform frequency modulation, amplify it, and convert it into electromagnetic wave radiation via the antenna 2.

In some embodiments, the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).

The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode). emitting diode, AMOLED, flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.

The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

The ISP is used to process the data fed back from the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transfers the electrical signal to the ISP for processing and is converted into an image visible to the naked eye. ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. ISP outputs digital image signals to DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats. In some embodiments, the electronic device 100 may include 1 or N cameras 193, and N is a positive integer greater than 1.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects the frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in a variety of encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.

NPU is a neural-network (NN) computing processor. By learning from the structure of biological neural networks, such as the transfer mode between human brain neurons, it can quickly process input information, and it can also continuously self-learn. The NPU can realize applications such as intelligent cognition of the electronic device 100, such as image recognition, face recognition, voice recognition, text understanding, and so on.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.

The internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121. For example, in the embodiment of the present application, the processor 110 may execute instructions stored in the internal memory 121, and the internal memory 121 may include a storage program area and a storage data area.

Among them, the storage program area can store an operating system, at least one application program (such as a sound playback function, an image playback function, etc.) required by at least one function. The data storage area can store data (such as audio data, phone book, etc.) created during the use of the electronic device 100. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.

The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110, or part of the functional modules of the audio module 170 may be provided in the processor 110. The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. The microphone 170C, also called "microphone", "microphone", is used to convert sound signals into electrical signals.

The earphone interface 170D is used to connect wired earphones. The earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, and a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be provided on the display screen 194.

Among them, there are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors and so on. The capacitive pressure sensor may include at least two parallel plates with conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch location but have different touch operation strengths may correspond to different operation instructions. In the embodiment of the present application, the electronic device 100 may collect the pressing force (or called pressing pressure) of the touch operation input by the user on the touch screen (ie, the display screen 194) through the pressure sensor 180A.

The gyro sensor 180B may be used to determine the movement posture of the electronic device 100. The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

The acceleration sensor 180D can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices, and used in applications such as horizontal and vertical screen switching, pedometers and so on.

Distance sensor 180E, used to measure distance. The electronic device 100 can measure the distance by infrared or laser. The proximity light sensor 180F may include, for example, a light emitting diode (LED) and a light detector such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light to the outside through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100.

The ambient light sensor 180J is used to sense the brightness of the ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived brightness of the ambient light. The ambient light sensor 180J can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180J can also cooperate with the proximity light sensor 180F to detect whether the electronic device 100 is in the pocket to prevent accidental touch.

The fingerprint sensor 180G is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, access application locks, fingerprint photographs, fingerprint answering calls, etc.

The temperature sensor 180H is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180H to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180H exceeds a threshold value, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180H, so as to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In some other embodiments, when the temperature is lower than another threshold, the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

The touch sensor 180I is also called "touch panel". The touch sensor 180I can be disposed on the display screen 194, and the touch screen is composed of the touch sensor 180I and the display screen 194, which is also called a “touch screen”. The touch sensor 180I is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. The visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180I may also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194.

In the embodiment of the present application, the electronic device 100 can detect the touch operation input by the user on the touch screen through the touch sensor 180I, and collect the touch position, touch area, touch direction, and touch time of the touch operation on the touch screen. One or more of. In some embodiments, the electronic device 100 may combine the touch sensor 180I and the pressure sensor 180A to determine the touch position of the touch operation on the touch screen.

The button 190 includes a power button, a volume button, and so on. The button 190 may be a mechanical button. It can also be a touch button. The electronic device 100 may receive key input, and generate key signal input related to user settings and function control of the electronic device 100.

The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration notification, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as photographing, audio playback, etc.) can correspond to different vibration feedback effects. Acting on touch operations in different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminding, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

The indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, or to indicate messages, missed calls, notifications, and so on.

The SIM card interface 195 is used to connect to the SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100. The electronic device 100 may support 1 or N SIM card interfaces, and N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc.

The methods in the following embodiments can all be implemented in the electronic device 100 having the above hardware structure. In the following embodiments, the above-mentioned electronic device 100 is a mobile phone as an example to describe the method of the embodiment of the present application.

The embodiment of the present application provides a device control method, and the method flow is shown in FIG. 2, including steps 201 to 203.

It should be noted that the mobile phone in this embodiment can be used to control the device, and the mobile phone includes a touch screen. Among them, the mobile phone and the device can perform wired communication or wireless remote communication. For example, a mobile phone can communicate with the device via a serial bus interface. For another example, the mobile phone can establish a wireless communication connection with the device through the mobile communication module 150 or the wireless communication module 160, and the mobile phone sends a control command to the device through the wireless communication connection to control the device. In the embodiments of this application, the specific communication method between the mobile phone and the device is not limited.

It is worth mentioning that the touch screen of the mobile phone in the embodiment of this application also has the ability to recognize fingerprints. Specifically, the mobile phone can adopt an optical under-screen fingerprint recognition technology, OLED (Organic Light-Emitting Diode, organic light-emitting diode) The screen emits light to illuminate the finger touch area. The light irradiated to the fingerprint is reflected and returned to the fingerprint sensor through the gap of the screen pixels. The fingerprint sensor forms image data according to the received reflected light, and the fingerprint sensor sends the image data to the processor. The processor compares and analyzes the image data formed by the fingerprint sensor with the stored fingerprint image, and recognizes the fingerprint information on the screen. The mobile phone can also use the fingerprint recognition under the ultrasonic screen. When the touch screen obtains the touch operation of the finger, the ultrasonic sensor transmits the ultrasonic wave to the part touched by the finger and receives the echo. According to the information of the obtained echo, the surface of the fingerprint and the air are used. Different densities between different densities construct a 3D image of a fingerprint, and the processor compares and analyzes the acquired 3D image of the fingerprint with the pre-stored fingerprint information, and recognizes the fingerprint information on the touch screen. If the mobile phone is a mobile phone with non-full-screen fingerprint recognition, a capacitive fingerprint recognition method can also be used. This is only an example and does not specifically limit the fingerprint recognition method of the mobile phone.

Step 201: When the mobile phone is in a preset state, receive a first touch operation input by the user on the touch screen, and collect fingerprint information corresponding to the first touch operation.

Among them, when the mobile phone is in a preset state, the first interface or a black screen is displayed.

Specifically, the device control method in this application is to simplify the device control method. Generally, when controlling a device through a mobile phone, the mobile phone needs to display a special control interface. The mobile phone can receive related control operations of the user on the control interface; in response to the related control operations, the mobile phone can send control commands to the device. The control method of the mobile phone control device is cumbersome and the user operation is complicated. In order to simplify the above-mentioned method of controlling the device, in this embodiment of the application, when the mobile phone is in the preset state, it can receive the user's first touch operation, and determine the first device corresponding to the fingerprint information according to the fingerprint information of the first touch operation , And control the first device. Among them, the mobile phone in the preset state displays the first interface or a black screen. The first interface can be the mobile phone lock screen interface as shown in Figure 3, the main interface or the application control interface, etc. Here is an example of the display of the first interface . The first touch operation of the user can be obtained when the mobile phone displays the first interface or the black screen, that is, in the control of the first device, the user does not need to display a special control interface to obtain the user’s first touch operation. The control operation (first touch operation) simplifies the control of the first device.

It should be noted that the first device in the embodiment of this application refers to a device that can be controlled by a mobile phone, and does not mean a certain type of device or a specific device. For example, a mobile phone can be used to control smart home devices, and can also control smart medical Equipment, etc., are not specifically limited, and the distance between the mobile phone and the device is also not limited.

Optionally, in the process of receiving the user's first touch operation, the mobile phone collects fingerprint information corresponding to the first touch operation, and determines that the first touch operation is a preset touch operation. Among them, the preset touch operation may be long pressing the touch screen or touching the screen and moving a certain distance, or touching the screen and drawing a preset graphic, etc., which is not specifically limited. Figure 4a shows that the user's finger long presses on the touch screen, Figure 4b shows that the user's finger presses on the touch screen and slides down for a certain distance, and Figure 4c shows that the user's finger touches the screen and draws a figure "2". The mobile phone obtains the fingerprint information corresponding to the first touch operation to match the preset fingerprint information, and determines that the first touch operation is the preset touch operation, and then determines that the first touch operation is an operation that can start the first device. In addition, for mobile phones that use fingerprint information for unlocking, in order to avoid false triggers that may be caused by the fingerprint information in the first touch operation, the fingerprint information for the first touch operation should be set to be different from the fingerprint information for unlocking the mobile phone.

In a specific scenario, the mobile phone displays a black screen in a preset state, the first touch operation is a long press operation, and the fingerprint information is the fingerprint of the index finger of the right hand. When the mobile phone is in a black screen state, the user long presses the touch screen of the mobile phone with his right index finger. After the mobile phone receives the user's long press operation, it obtains the fingerprint information of the long press operation and determines that the obtained fingerprint information corresponds to the first operation The fingerprint information determines that the user's current operation is the first touch operation.

Step 202: The mobile phone determines one or more first devices corresponding to the fingerprint information from the at least one first device connected to it.

Specifically, since the mobile phone can be used to control at least one first device, each first device can be set with different triggering methods. For example, if different fingerprint information is carried in the first touch operation, different first devices can be triggered correspondingly. Taking the first device controlled by the mobile phone as an example of a smart home, for example, the fingerprint information in the first touch operation is the fingerprint feature of the index finger of the right hand, and the first device used for triggering by the first touch operation is the speaker; in the first touch operation The fingerprint information of is the fingerprint feature of the right middle finger, and the first device used to trigger the first touch operation is the water heater.

In a specific implementation, the mobile phone determines the first device corresponding to the control command according to the acquired fingerprint information in the first touch operation. The fingerprint information may correspond to one first device, and the fingerprint information may also correspond to multiple first devices. , There is no specific limitation here. For example, the first device corresponding to the fingerprint information in the first touch operation is a bedroom wall lamp, and the first device corresponding to the fingerprint information in the first touch operation may also be an air conditioner and a computer.

It should be noted that the fingerprint information in the first touch operation may be the fingerprint characteristics of one finger or the fingerprint characteristics of multiple fingers. The specific settings are shown in Table 1 and Table 2. Table 1 indicates that the fingerprint information in the first touch operation is the fingerprint information of one finger and the corresponding first device, and Table 2 indicates that the fingerprint information in the first touch operation is multiple fingers. The fingerprint characteristics and the corresponding first device. In practical applications, the mobile phone stores various marks of the first device, and the correspondence between the fingerprint information and the mark of the first device is determined according to the correspondence between the fingerprint information and the first device.

指纹信息Fingerprint information	第一设备First device
右手食指指纹特征Fingerprint characteristics of right index finger	音响的标志Sign of sound

右手中指指纹特征Fingerprint Features of Right Middle Finger	音响、卧室壁灯和热水器的标志Signs of speakers, bedroom wall lamps and water heaters
右手无名指指纹特征Fingerprint characteristics of right ring finger	客厅窗帘和电视的标志Sign of living room curtains and TV
左手食指指纹特征Fingerprint characteristics of left index finger	空气净化器的标志Air purifier logo
左手中指指纹特征Fingerprint features of left middle finger	空调和电脑的标志Air conditioning and computer signs
左手无名指指纹特征Fingerprint characteristics of left ring finger	洗衣机和电饭煲的标志Signs of washing machine and rice cooker

Table 1: Correspondence between fingerprint information and the first device

Table 2: Correspondence between fingerprint information and the first device

It is worth mentioning that it can be determined from Table 1 and Table 2 that there is no absolute correspondence between the number of fingerprint information in the first touch operation and the number of corresponding first devices. In specific implementation, the user can set the corresponding relationship between the fingerprint information and the first device according to preferences and operating habits. This is only an example and is not specifically limited. In this embodiment, fingerprints and smart home devices are taken as examples for description. In practice, fingerprint information may also correspond to remote medical devices, wearable devices, and the like. For example, the first device is an electronic watch carried by a child, the fingerprint information in the first touch operation corresponds to the electronic watch, when the mobile phone acquires the first touch operation, and the fingerprint information in the first touch operation corresponds to the electronic watch , The mobile phone sends control commands to the electronic watch. The control command may be to control the electronic watch to respond to the current position information, or to send out a prompt message to control the electronic watch, etc. This is only an example.

Step 203: The mobile phone sends a first control command to one or more first devices.

The first control command is used to trigger one or more first devices to execute the corresponding event.

Specifically, after the first device corresponding to the fingerprint information in the first touch operation is determined, the first control command is sent to the corresponding first device to achieve control of the first device. Wherein, the content of the first control command may be to start or shut down the first device, or to respond to certain data information.

In a specific application scenario, when the user just wakes up, he does not open his eyes in the morning and performs the first touch operation on the phone. The right index finger presses the touch screen of the phone, and the first device corresponding to the right index finger is the speaker. When the mobile phone is black, the first touch operation input by the user is received, the fingerprint information in the first touch operation is determined to be the fingerprint feature of the index finger of the right hand, and the first device corresponding to the first touch operation is determined to be the speaker. One control command, the first control command controls the speaker to start and play music. For another example, the user’s left index finger presses on the touch screen of the mobile phone and performs a first touch operation. The mobile phone receives the first touch operation and determines that the first device corresponding to the fingerprint information in the first touch operation is the sign of the air conditioner. The first control command is sent, and the first control command controls the air conditioner to start.

Specifically, the method steps in the embodiments of this application can be executed repeatedly. The mobile phone receives the same first touch operation. It can be that the mobile phone sends the same first control command to the first device every time, or the mobile phone sends the same first control command to the first device every time. Different control commands to the first device. For example, the mobile phone receives the first touch operation, and determines that the first device corresponding to the fingerprint information in the first touch operation is an electronic watch carried by the child. The first control command returns the current position information in response to the mobile phone and sends the first control command to The electronic watch. Repeated execution of the above method steps, each time the mobile phone acquires the first touch operation and sends the first control command to the electronic watch, it can receive the position information responded by the electronic watch. In another specific implementation, the mobile phone receives the first touch operation, and determines that the first device corresponding to the fingerprint information in the first touch operation is the sign of the air conditioner. The mobile phone receives the first touch operation for the first time, and the first control command is start Air conditioner, the mobile phone sends a control command to start the air conditioner; the mobile phone receives the first touch operation for the second time, the first control command is to turn off the air conditioner, and the mobile phone sends a control command to turn off the air conditioner. That is to say, through the method in the embodiment of the present application, the first device can be quickly turned on and off without requiring the user to make special settings, thereby optimizing the user experience.

It is worth mentioning that the mobile phone in the implementation of this application is used to control the first device. It does not mean that the mobile phone needs to directly communicate with the first device. In specific implementation, the mobile phone can directly establish a communication connection with the first device, or through The gateway establishes a communication connection with the first device. Therefore, in this embodiment, when the mobile phone sends the first control command to the first device, it may not be directly sent to the first device, or it may be sent to the gateway, and the gateway forwards the first control command to the first device. .

Specifically, the smart home device can directly communicate with the mobile phone through the Internet of Things, the smart home receives the first control command sent by the mobile phone through the Internet, the smart home device can also establish a communication connection with the home router, and obtain the first control command sent by the mobile phone through the home router. One control command. As shown in Figure 5, the air conditioner establishes a communication connection with the home router. The mobile phone can establish communication with the home router via the Internet or the Internet of Things. After the mobile phone obtains the first touch operation, it determines that the fingerprint information in the first touch operation corresponds to the air conditioner. The first control command is sent to the home router, and the home router forwards the first control command to the air conditioner.

In a specific application scenario, the home router establishes a communication connection with the home computer, TV, washing machine, stereo, lamp, air conditioner, microwave oven, curtain, floor heating, air purifier, water heater, oven, coffee machine, etc., as shown in the figure 6 shown. Among them, the above-mentioned smart home device can be connected to the home router wirelessly via WIFI or Bluetooth, or connected to the home router through a physical interface, and the smart home device can be connected to the home router via wired communication. By establishing a communication connection with the home router, the mobile phone can send control commands to any smart home device in the home.

In a specific application scenario, the first device corresponding to the fingerprint information in the first touch operation is the sign of the speaker and the bedroom wall lamp. As shown in Figure 7a, the mobile phone receives the first touch operation and determines the The first device corresponding to the fingerprint information is the sign of the speaker and the bedroom wall light. The mobile phone sends the first control command to the home router, and the home router sends the first control command to the speaker and bedroom wall light.

In another specific application, as shown in FIG. 7b, the first device corresponding to the fingerprint information in the first touch operation is a water heater, a computer, a coffee machine, and an air conditioner. If the user expects to be home in 1 hour, the fingerprint information of the first touch operation is the fingerprint characteristics of two fingers, the user performs the first touch operation on the mobile phone, and the mobile phone receives the first touch operation input by the user, and confirms the first touch operation The fingerprint information in is the fingerprint features of two fingers, and the first device corresponding to the fingerprint feature is the sign of water heater, computer, coffee machine, and air conditioner. The mobile phone sends the first control command to the home router, and the home router sends the first control command Send to water heater, computer, coffee machine and air conditioner respectively. As a result, the user returns home an hour later, the room temperature is good, the computer is turned on, and there is hot water and hot coffee.

In another specific application, as shown in FIG. 7c, the first device corresponding to the fingerprint information in the first touch operation is a microwave oven, an oven, a water heater, and a speaker. When just getting up in the morning, the user enters the first touch operation on the mobile phone. After the mobile phone receives the first touch operation, it is determined that the first device corresponding to the fingerprint information in the touch operation is the logo of microwave oven, oven, water heater, and audio. Send the first control command to the home router. After receiving the first control command, the home router sends the first control command to the microwave oven, the oven, the water heater, and the audio device. In this way, after the user gets up, the breakfast is hot, the hot water is also boiled, and music is playing in the room.

Compared with the prior art, a mobile phone in a preset state can acquire a user's first touch operation on the touch screen, and respond to the first touch operation to send a first control command to one or more first devices connected to it. This method of controlling the first device can be carried out when the mobile phone has a black screen, without entering the relevant control program or control interface, and the first device can be quickly controlled. The control of the first device is realized directly through the first touch operation, which simplifies the control method of the first device.

Specifically, if the mobile phone can perform full-screen fingerprint recognition, it may be possible to use fingerprints to unlock the mobile phone. When the mobile phone recognizes the fingerprint of the first touch operation, the fingerprint information carried in the first touch operation will be recognized. In order to avoid the first touch If the fingerprint information in the operation causes the mobile phone to be touched by mistake, the preset mode is set to determine that the first touch operation is the control operation of the mobile phone on the first device. In a specific implementation, after the mobile phone acquires the first touch operation, it is determined through a preset manner that the first touch operation is the electronic device issuing a first control command to one or more first devices. Among them, the preset mode includes a voice confirmation mode and a gesture confirmation mode.

In addition, the confirmation method for the first touch operation may also be an interface confirmation method. Specifically, the mobile phone interacts with the user by displaying an interface dialog box to obtain the user's confirmation operation. For example, the first device controlled by the user through the mobile phone is an air purifier. After the mobile phone obtains the first touch operation, it determines that the first device corresponding to the first touch operation is an air purifier, and the mobile phone pops up a dialog box that includes "Please confirm whether Start the air purifier" and display the options "Yes" and "No". After obtaining the user's click operation on the "Yes" option, the first control command is sent to the air conditioner.

In a specific application scenario, after the mobile phone receives the first touch operation, it will give a voice prompt "Please confirm to control the first device" and obtain the user's voice information, where the voice information can be "yes" or "yes" Voice sounds such as "", "Yes" or "Confirm". It should be noted that there is no need to store the user's voiceprint information in advance, as long as the corresponding voice information is received. In addition, after the mobile phone sends out the voice prompt, it can also receive the user's operation on the touch screen for confirmation. For example, the user can confirm by double-clicking or clicking on the mobile phone screen. In other words, during the voice confirmation process of the mobile phone, the mobile phone will give out a voice prompt, and the user can make a voice answer or perform a screen operation to confirm. In the process of voice confirmation by the mobile phone, the mobile phone screen can always be displayed on a black screen, or the shape of the voice print of the voice can also be displayed, which is not specifically limited.

In a specific application scenario, after the mobile phone receives the first touch operation, the preset mode is the gesture confirmation mode. For example, the mobile phone displays an icon to confirm the gesture, turns on the camera, and obtains the current user's gesture. As shown in Figure 8, the gesture is "OK", the screen of the mobile phone displays the gesture as shown in the figure, and the camera captures the user's gesture. If the user's gesture is the same as the gesture of the displayed image, it is determined that the first gesture is the mobile phone's gesture to the first device. Control operation. In addition, the gesture confirmation method can also be to display an arrow sign on the mobile phone, as shown in FIG. 9, the mobile phone displays a downward arrow, and the user can slide in the direction of the arrow. Wherein, the gesture operation may also be a shape in which the user draws a number 1, 2, 3, or 4 on the touch screen, etc. The specific form of the gesture operation is not limited.

In addition, in practical applications, in order to prevent the fingerprint information in the first touch operation from erroneously triggering the unlock operation of the mobile phone, the fingerprint information may be limited during the process of entering the first touch operation. That is to say, in the process of entering the first touch operation, if the fingerprint feature in the unlocking operation of the mobile phone is found to be the same as the fingerprint feature in the fingerprint information of the first touch operation, the user is prompted to change the finger and enter a fingerprint with a different fingerprint feature information.

The second mode of the present application provides a device control method. This embodiment is roughly the same as the first embodiment. The main difference is: in this embodiment, the electronic device determines that before sending the first control command to the first device According to the environmental information of the electronic device, the corresponding preset confirmation method is selected according to the environmental information, and the method flow is shown in FIG. 10. Those skilled in the art can understand that the method of determining the current environmental information of the electronic device in this embodiment is only an example, and other methods for determining the current environmental information of the electronic device may also be applied in this application.

In this embodiment, the electronic device is still a mobile phone as an example for description. If the electronic device is of another type, the implementation steps can be adjusted adaptively, which will not be repeated here.

It should be noted that step 301 to step 302 and step 306 in this embodiment are the same as steps 201 to step 202 and step 203 in the first embodiment, respectively. In order to reduce repetition, we will not repeat them, and only the differences will be described here. .

Step 303: Obtain the parameters of the sensors in the mobile phone, and determine the current environmental information of the mobile phone corresponding to the sensor parameters.

Step 304: Determine a preset confirmation method corresponding to the current environmental information of the mobile phone.

Step 305: Send a confirmation message according to a preset confirmation mode, and receive confirmation feedback information.

Step 306: Determine whether the confirmation feedback information indicates that the user confirms to trigger one or more first devices. If yes, go to step 307; otherwise, go to step 308.

Step 307: Send a first control command to one or more first devices.

Step 308: Prohibit sending the first control command to one or more first devices.

Specifically, the mobile phone is provided with a sensor module. The electronic device 100 in FIG. 1 has a sensor module 180, which can determine the current state of the mobile phone with the help of various sensors in the mobile phone, and then select the first touch of the mobile phone according to the current state of the mobile phone. The specific determination method of the operation. Among them, the sensors in the mobile phone include at least one or more of an ambient light sensor, an acceleration sensor, a camera, a distance sensor, and a microphone. A specific implementation is that after the mobile phone acquires the first touch operation, the mobile phone acquires data from one or more sensors, determines the current environmental information of the mobile phone according to the sensor data, and determines the preset confirmation method according to the current environmental information of the mobile phone.

It should be noted that the current environment information of the mobile phone represents the current environment described by the mobile phone, for example, the environment information of the mobile phone is dull, static, and unheld. The current environmental information of the mobile phone may infer the current state of the user. For example, no light, static, or unhandled means the mobile phone is not used. At this time, the mobile phone system time is obtained. If it is 12:00 at night, it may mean that the user has rested. According to the environmental information of the mobile phone, the state of the possible user is inferred, and the appropriate confirmation method of the first touch operation is selected according to the inferred user's state, which improves the intelligence of the mobile phone and optimizes the user experience. Therefore, after acquiring the data of the sensors in the mobile phone, information such as the system time of the mobile phone can also be obtained to further determine the environmental information of the mobile phone.

Optionally, the preset confirmation mode includes a gesture confirmation mode, a voice confirmation mode, and an interface confirmation mode. For example, to obtain the parameters of the microphone in the mobile phone, to confirm whether the environmental information of the mobile phone is a bass environment, if it is a bass environment, the voice confirmation can be done with all efforts, and the preset confirmation method selects the voice confirmation method.

Optionally, the environmental information of the mobile phone can be confirmed based on the parameters of one sensor, or the environmental information of the mobile phone can be confirmed based on the parameters of at least two sensors. For example, to obtain the parameters of the acceleration sensor of the mobile phone to determine the current acceleration of the mobile phone, if the acceleration is 0, the interface confirmation mode or the gesture confirmation mode can be selected. Further, the current environmental information of the mobile phone can also be confirmed according to the sensor parameters and system information. For example, the system information is the current time information of the mobile phone to obtain the parameters of the touch sensor and the light sensor and the system time, and the touch sensor confirms whether the mobile phone is being held. For example, confirm that the mobile phone is held according to the parameters of the touch sensor and confirm according to the parameters of the light sensor The phone is in a bright environment, the system time is 12:00 am, and the preset confirmation method can be determined to be the interface confirmation method or the gesture confirmation method.

In a specific application scenario, the fingerprint information of the first touch operation is the left index finger corresponding to the air purifier. When the mobile phone is black, the user's first touch operation is received and the fingerprint information in the first touch operation is determined to be the fingerprint of the left index finger. Information, it is determined that the first device is an air purifier. Obtain the parameters of the sensors in the mobile phone, and determine that the mobile phone is outdoors and the user may be walking according to the parameters of the ambient light sensor, microphone, and acceleration sensor. The first touch operation can be determined by an interface confirmation method or a gesture confirmation method.

It is worth mentioning that determining the current environmental information of the mobile phone requires acquiring data from multiple sensors, judging possible user behaviors based on the current environmental information of the mobile phone, and giving an appropriate confirmation method for the first touch operation. This setting helps simplify the control method of the first device, make it as convenient as possible for users to use, and optimize the user experience.

The above method of confirming the current environment of the mobile phone can be determined based on the sensor parameters, or determined based on the usage mode of the mobile phone. For example, the mobile phone is in sports mode and the mobile phone displays a black screen, and the mobile phone receives the user's first touch Operation, select the voice confirmation method according to the current mobile phone mode.

Specifically, according to the sensor to determine the environment of the mobile phone and further determine the confirmation method of the first touch operation, some possible situations are shown in Table 3.

Table 3: Correspondence between sensor parameters and mobile phone environment and the correspondence between the first touch operation confirmation method

Specifically, after the mobile phone sends the first control command to the first device, in order to facilitate the user's subsequent operations on the first device, the control switch or adjustment switch of the first device may be displayed on the mobile phone. A specific implementation is that the mobile phone displays a second interface, where the second interface includes: one or more control switches of the first device and/or one or more adjustment switches of the first device; In response to the second touch operation, the mobile phone sends a second control command to one or more first devices, where the second control command is used to trigger one or more first devices An event corresponding to a device performing a second touch operation.

It should be noted that the second interface is displayed on the mobile phone, the second interface includes the control switch of the first device, and the second interface is an adaptive interface, the control switch in the second interface can display different If the control interface or the second interface displays a general control interface, a preset control interface is displayed for any first device.

Optionally, if the second interface is an adaptive interface, the device type of the first device is acquired, and the control interface of the first device is determined according to the device type of the first device, and the second interface displays the control interface of the first device. For example, if it is determined that the first device is an air conditioner, the control interface of the air conditioner is determined, and the control interface of the air conditioner is displayed in the second interface.

It should be noted that in the above embodiments, the control interfaces of multiple devices can be stored in the mobile phone in advance, so that the mobile phone directly determines the corresponding control interface according to the device type, or the mobile phone automatically generates the control interface of the device according to the device type.

Optionally, if the second interface is a general control interface, the second interface includes at least an increase button, a decrease button, a mode selection button, etc., wherein the mode selection button includes a first selection button and a second selection button.

It should be noted that for the first device that cannot be adjusted, only the switch control buttons are displayed on the second interface. For example, if the first device is a wall lamp, but the wall lamp cannot adjust the brightness, only the switch button of the wall lamp can be displayed in the second interface, as shown in FIG. 11.

In a specific application scenario, if the first device corresponding to the fingerprint information in the first touch operation is a water heater and an air conditioner, the second interface can display the control interface of the hot water and the air conditioner at the same time, as shown in FIG. 12. The hot water display interface includes the current water temperature of the water heater, switch control buttons and water temperature adjustment buttons. The display interface of the air conditioner includes the current operating temperature of the air conditioner, the switch control button of the air conditioner, the temperature adjustment button of the air conditioner, and the mode adjustment button of the air conditioner.

For example, the display of the foregoing second interface is shown in FIG. 13, which may be several arrows of "up", "down", "left" and "right", and the name of the first device displayed on the second interface. Taking the display in Figure 13 as an example, different first devices can achieve different control purposes. The following table 4 corresponds to the first device and the control switch of the second interface:

Table 4: Correspondence table of the first device and operation keys

It should be noted that if Figure 13 corresponds to a general interface, "up" corresponds to "increase button", "down" corresponds to "decrease button", "left" corresponds to "first selection button", and "right" corresponds to "Second selection button". Not all the first devices in the above table 4 correspond to four control buttons. For example, there are only two control buttons corresponding to the water heater, light and floor heating in the table. In specific applications, only two control buttons can be displayed for these three first devices. Control buttons.

In a specific application scenario, if the first device is a speaker, the second interface is displayed as shown in Figure 14a, where "up", "down", "left" and "right" correspond to each other, and "volume up", "Volume Down", "Previous Song" and "Next Song". In order to beautify the display interface, the audio control interface can be as shown in Figure 14b, including a volume adjustment switch, a playback control switch, and so on.

Specifically, the control switch or adjustment switch of the first device is displayed on the second interface. In addition, the current status information of the first device can also be displayed on the second interface. For example, if the first device is an air conditioner, in addition to In addition to displaying the air conditioner's switch and temperature adjustment buttons, it can also display the current temperature and operating mode of the air conditioner, as shown in Figure 15. The specific implementation process is that after the mobile phone sends the first control command to the first device, it receives the first control response sent by the first device. The first control response carries one or more status information of the first device, and the mobile phone displays a Or multiple first device status information.

It is worth mentioning that if the first device includes more than one device, for example, the first device includes air conditioners, curtains, speakers, and coffee machines, it is difficult to display all the control interfaces of the four devices in the second display interface of the mobile phone. A specific implementation is that the vertical menu is displayed in the first interface, and the corresponding control interface is displayed according to the obtained user's selection operation. As shown in FIG. 16, the user selects the air conditioner.

It should be noted that the specific description of each step in this embodiment is only to reflect the implementation details of the implementation step, and is only for the convenience of those skilled in the art to understand the technical details of this implementation, and is not the implementation step. Must. In addition, each specific implementation in this embodiment is only an example for illustration, and does not limit the technical solution of the present application.

The embodiment of the present application also provides an electronic device, which is used to control at least one device and has a touch screen. The module structure is shown in Fig. 17, including an input module 1701, a determination module 1702, and a sending module 1703.

The input module 1701 is configured to receive the first touch operation input by the user on the touch screen, and collect fingerprint information corresponding to the first touch operation, wherein, when the electronic device is in a preset state, a first interface or a black screen is displayed.

The determining module 1702 is configured to determine one or more first devices corresponding to fingerprint information from among at least one first device connected to the electronic device.

The sending module 1703 is configured to send a first control command to one or more first devices by the electronic device, and the first control command is used to trigger one or more first devices to execute a corresponding event.

Since the electronic device in this application is a device corresponding to the control method of the device described above, the implementation manner of this application can be implemented in cooperation with the foregoing implementation manner. The relevant technical details mentioned in the method implementation are still valid in this embodiment, and the technical effects that can be achieved in the method implementation can also be achieved in this embodiment. In order to reduce repetition, details are not repeated here.

Some other embodiments of the present application also provide an electronic device, which may include the above-mentioned touch screen, a memory, and one or more processors. The touch screen, memory and processor are coupled. The memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device can execute the steps related to the countdown display method in the foregoing method embodiment. The structure of the electronic device can refer to the structure of the electronic device 100 shown in FIG. 1.

An embodiment of the present application also provides a chip system. As shown in FIG. 18, the chip system includes at least one processor 1801 and at least one interface circuit 1802. The processor 1801 and the interface circuit 1802 may be interconnected by wires. For example, the interface circuit 1802 can be used to receive signals from other devices (such as the memory of an electronic device). For another example, the interface circuit 1802 may be used to send signals to other devices (such as the processor 1801). Exemplarily, the interface circuit 1802 can read instructions stored in the memory and send the instructions to the processor 1801. When the instructions are executed by the processor 1801, the electronic device can execute the steps in the foregoing embodiments. Of course, the chip system may also include other discrete devices, which are not specifically limited in the embodiment of the present application.

The embodiments of the present application also provide a computer storage medium, which includes computer instructions, which when the computer instructions run on the above-mentioned electronic device, cause the electronic device to execute each step of the above-mentioned method embodiment.

The embodiment of the present application also provides a computer program product, which when the computer program product runs on a computer, causes the computer to execute each step of the foregoing method embodiment.

Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and conciseness of the description, only the division of the above-mentioned functional modules is used as an example. In practical applications, the above-mentioned functions can be allocated by Different functional modules are completed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed device and method may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components may be It can be combined or integrated into another device, or some features can be omitted or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described above as separate components may or may not be physically separated, and the components displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed to multiple different places. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application are essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of software products, which are stored in a storage medium There are several instructions to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods described in the embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

The above content is only the specific implementation of this application, but the protection scope of this application is not limited to this, and any changes or substitutions within the technical scope disclosed in this application shall be covered by the protection scope of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the claims.

Claims

A device control method applied to an electronic device, characterized in that the electronic device is used to control at least one first device, the electronic device includes a touch screen, and the method includes:

When the electronic device is in the preset state, it receives the first touch operation input by the user on the touch screen, and collects fingerprint information corresponding to the first touch operation; wherein, when the electronic device is in the preset state, Display the first interface or a black screen;

Determining, by the electronic device, one or more first devices corresponding to the fingerprint information from the at least one first device;

The electronic device sends a first control command to the one or more first devices, and the first control command is used to trigger the one or more first devices to execute a corresponding event.
The device control method according to claim 1, wherein after the electronic device sends the first control command to the one or more first devices, the method further comprises:

The electronic device displays a second interface, where the second interface includes: control switches of the one or more first devices and/or adjustment switches of the one or more first devices;

Receiving, by the electronic device, a user's second touch operation on the control switch or the adjustment switch in the second interface;

In response to the second touch operation, the electronic device sends a second control command to the one or more first devices, and the second control command is used to trigger the one or more first devices to execute the corresponding event.
The device control method according to claim 1 or 2, characterized in that, after the sending the first control command to the one or more first devices, the method further comprises:

Receiving, by the electronic device, a first control response sent by the one or more first devices, the first control response carrying status information of the one or more first devices;

The electronic device displays status information of the one or more first devices.
The device control method according to any one of claims 1-3, wherein after the electronic device determines the one or more first devices corresponding to the fingerprint information, the electronic device reports to the Before the one or more first devices send the first control command, the method further includes:

The electronic device determines that the first touch operation is a preset touch operation.
The device control method according to any one of claims 1-3, wherein after the electronic device determines the one or more first devices corresponding to the fingerprint information, the electronic device reports to the Before the one or more first devices send the first control command, the method further includes:

The electronic device determines through a preset confirmation method that the first touch operation is the electronic device issuing the first control command to the one or more first devices; wherein the preset confirmation method includes at least : Voice confirmation mode and gesture confirmation mode.
The device control method according to claim 5, wherein the electronic device further includes one or more sensors; the one or more sensors at least include: an ambient light sensor, an acceleration sensor, a camera, a distance sensor, and One or more of the microphones;

Before the electronic device determines that the first touch operation is a first control command issued by the electronic device to the one or more first devices through a preset confirmation method, the method further includes:

The electronic device determines the preset confirmation mode according to the parameters collected by the one or more sensors.
The device control method according to any one of claims 1-6, wherein the fingerprint information includes fingerprint characteristics of one or more fingers.
An electronic device, characterized in that the electronic device is used to control at least one first device, and the electronic device further includes: an input module, a determination module, and a sending module;

The input module is used to receive the first touch operation input by the user on the touch screen when the electronic device is in the preset state, and collect fingerprint information corresponding to the first touch operation; wherein, the electronic device is in the In the preset state, the first interface or a black screen is displayed;

The determining module is configured to determine one or more first devices corresponding to the fingerprint information from the at least one first device;

The sending module is configured to send a first control command to the one or more first devices, and the first control command is used to trigger the one or more first devices to execute a corresponding event.
The electronic device according to claim 8, wherein the electronic device further comprises: a display module;

The display module is configured to display a second interface, where the second interface includes: control switches of the one or more first devices and/or adjustment switches of the one or more first devices;

The input module is further configured to receive a second touch operation of the user on the control switch or the adjustment switch in the second interface;

The sending module is further configured to, in response to the second touch operation, send a second control command to the one or more first devices, and the second control command is used to trigger the one or more first devices. The device executes the corresponding event.
The electronic device according to claim 8 or 9, wherein:

The input module is further configured to receive a first control response sent by the one or more first devices, where the first control response carries status information of the one or more first devices;

The display module is also used to display status information of the one or more first devices.
The electronic device according to any one of claims 8-10, wherein:

The determining module is further configured to determine that the first touch operation is a preset touch operation.
The electronic device according to any one of claims 8-10, wherein:

The determining module is further configured to determine, through a preset confirmation manner, that the first touch operation is the electronic device issuing the first control command to the one or more first devices; wherein, the preset The confirmation methods include at least: voice confirmation and gesture confirmation.
The electronic device according to claim 12, wherein the electronic device further comprises one or more sensors; the one or more sensors at least include: an ambient light sensor, an acceleration sensor, a camera, a distance sensor, and a microphone. One or more of

The determining module is further configured to determine the preset confirmation mode according to the parameters collected by the one or more sensors.
The electronic device according to any one of claims 8-13, wherein the fingerprint information includes fingerprint characteristics of one or more fingers.
An electronic device, characterized in that the electronic device includes a touch screen, a memory, and at least one processor; the touch screen, the memory and the processor are coupled; the memory is used to store computer program codes, the The computer program code includes computer instructions, which when the processor executes the computer instructions, cause the electronic device to execute the method according to any one of claims 1-7.
A chip system, characterized in that the chip system is applied to an electronic device including a touch screen; the chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor pass through Line interconnection; the interface circuit is used to receive a signal from the memory of the electronic device, and send the signal to the processor, the signal includes the computer instructions stored in the memory; when the processor executes all When the computer instruction is used, the electronic device executes the method according to any one of claims 1-7.
A computer storage medium, characterized by comprising computer instructions, which when the computer instructions run on an electronic device, causes the electronic device to execute the method according to any one of claims 1-7.
A computer program product, characterized in that, when the computer program product runs on a computer, the computer is caused to execute the method according to any one of claims 1-7.