WO2021013136A1 - Procédé de commande d'appareil électronique et appareil électronique - Google Patents

Procédé de commande d'appareil électronique et appareil électronique Download PDF

Info

Publication number
WO2021013136A1
WO2021013136A1 PCT/CN2020/103129 CN2020103129W WO2021013136A1 WO 2021013136 A1 WO2021013136 A1 WO 2021013136A1 CN 2020103129 W CN2020103129 W CN 2020103129W WO 2021013136 A1 WO2021013136 A1 WO 2021013136A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
devices
touch operation
control
interface
Prior art date
Application number
PCT/CN2020/103129
Other languages
English (en)
Chinese (zh)
Inventor
陈文军
王雷
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2021013136A1 publication Critical patent/WO2021013136A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/66—Substation equipment, e.g. for use by subscribers with means for preventing unauthorised or fraudulent calling
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions

Definitions

  • the embodiments of the present application relate to the field of electronic communication technology, and in particular to a device control method and electronic equipment.
  • the specific implementation process is: the user uses a mobile terminal to connect to the smart home through the Internet platform, and manages the devices of the smart home through the mobile terminal. By inputting control commands on the mobile terminal, the mobile terminal transmits the control commands to the smart home network , The smart home network sends control commands to the corresponding home equipment to realize remote control of the smart home equipment.
  • the embodiments of the present application provide a device control method and an electronic device.
  • the electronic device can control the device by inputting a control gesture.
  • This control method can realize rapid control of the device. Simplify the control method of the equipment.
  • the embodiments of the present application are applied to electronic devices, and the electronic devices are used to control at least one first device, and the electronic devices include a touch screen.
  • the control method of the first device in the embodiment of the present application includes: when the electronic device is in a preset state, receiving a first touch operation input by the user on the touch screen, and collecting fingerprint information corresponding to the first touch operation, wherein the electronic device is in the preset state. When the state is set, the first interface or a black screen is displayed; the electronic device determines one or more first devices corresponding to the fingerprint information from at least one first device connected to it; the electronic device sends the first device to the one or more first devices A control command, the first control command is used to trigger one or more first devices to execute corresponding events.
  • the electronic device in the preset state can acquire the user's first touch operation on the touch screen, and respond to the first touch operation to send a first control command to one or more first devices connected to it.
  • This method of controlling the first device can be performed when the electronic device has a black screen, without entering a related control program or control interface, and the first device can be quickly controlled.
  • the control of the first device is realized directly through the first touch operation, which simplifies the control method of the first device.
  • the method provided in this embodiment of the present application further includes: the electronic device displays a second interface, where: The second interface includes: one or more control switches of the first device and/or one or more adjustment switches of the first device; the electronic device receives the user's second touch operation on the control switch or the adjustment switch in the second interface; In response to the second touch operation, the electronic device sends a second control command to one or more first devices, where the second control command is used to trigger one or more first devices to perform an event corresponding to the second touch operation.
  • the second interface is displayed, which helps the user to control other operations of the first device.
  • the first device is a speaker
  • the speaker is triggered by the first control command to play music
  • the second interface displays a music playback interface, which is convenient for the user to perform operations such as adjusting the volume and switching music.
  • the display of the second interface helps the user to further control the first device and improve the user experience.
  • the method provided in this embodiment of the present application further includes: the electronic device receives one or more first devices A first control response sent by a device, where the first control response carries status information of one or more first devices; the electronic device displays status information of one or more first devices.
  • the status information carried in the first control response sent by the first device is displayed on the electronic device, so that the user can understand the current operating status of the first device through the display status of the electronic device, and further improve the user experience. It is worth mentioning that the status information in this embodiment and the control switch or adjustment switch of the first device can be displayed on the second interface, so that the user can perform further operations and control the first device according to the display of the electronic device. .
  • the electronic device determines the one or more first devices corresponding to the fingerprint information, before the electronic device sends the first control command to the one or more first devices, this application
  • the method provided by the embodiment further includes: the electronic device determines that the first touch operation is a preset touch operation.
  • the fingerprint information is carried in the first touch operation, and the first device that receives the first control command is determined according to the fingerprint information. If only the fingerprint information is used to determine the recipient of the first control command, for an electronic device unlocked using a fingerprint, the electronic device may be unlocked due to the fingerprint information of the first operation. After determining that the first touch operation is a preset touch operation, the first control command is sent to the first device, which improves the accuracy of the response of the electronic device and avoids false triggering.
  • the electronic device determines that the first touch operation is a first control command issued by the electronic device to one or more first devices through a preset manner; wherein the preset manner includes at least: a voice confirmation manner and a gesture Confirmation method.
  • Both the voice confirmation mode and the gesture confirmation mode are set to avoid misoperations that may be caused by the first touch operation, so that the electronic device accurately responds to the first touch operation, and further improves the user experience.
  • the electronic device further includes one or more sensors; the one or more sensors include at least one or more of an ambient light sensor, an acceleration sensor, a distance sensor, a camera, and a microphone.
  • the method provided in this embodiment of the present application further includes: the electronic device according to one or more The parameters collected by the sensor determine the preset mode.
  • Determining the preset mode according to the parameters of the sensor helps to determine the preset mode according to different scenarios or states of the electronic device, so that the preset mode is more in line with the user's current operating habits, and the user experience is further improved.
  • the fingerprint information includes fingerprint characteristics of one or more fingers.
  • an embodiment of the present application provides an electronic device, which is used to control at least one first device.
  • the electronic device may include a touch screen, a memory, and one or more processors.
  • the touch screen, memory and processor are coupled.
  • the memory is used to store computer program code
  • the computer program code includes computer instructions, when the processor executes the computer instructions, the processor is configured to receive the first touch input by the user on the touch screen when the electronic device is in a preset state Operate, and collect fingerprint information corresponding to the first touch operation.
  • the touch screen is used to display the first interface or a black screen when the electronic device is in a preset state.
  • the processor is further configured to: the electronic device determines one or more first devices corresponding to fingerprint information from at least one first device connected to it; the electronic device sends a first control command to the one or more first devices, The first control command is used to trigger one or more first devices to execute corresponding events.
  • the processor is further configured to control the touch screen to display a second interface, the touch screen is also configured to display a second interface, the second interface includes: one or more first The control switch of the device and/or the adjustment switch of one or more first devices.
  • the processor is further configured to receive a second touch operation of the user on the control switch or adjustment switch in the second interface; in response to the second touch operation, the electronic device sends a second control command to one or more first devices , Where the second control command is used to trigger one or more first devices to perform an event corresponding to the second touch operation.
  • the processor is further configured to receive a first control response sent by one or more first devices, where the first control response carries the status of one or more first devices information.
  • the processor is also configured to control the touch screen to display status information of one or more first devices.
  • the touch screen is also used to display status information of one or more first devices.
  • the processor is further configured to determine that the first touch operation is a preset touch operation.
  • the processor is further configured to determine that the first touch operation is the first control command issued by the electronic device to one or more first devices in a preset manner;
  • the preset modes include at least: a voice confirmation mode and a gesture confirmation mode.
  • the electronic device further includes one or more sensors; the one or more sensors include at least one or more of an ambient light sensor, an acceleration sensor, a distance sensor, and a microphone.
  • the device is also used to determine the preset mode according to the parameters collected by one or more sensors.
  • the fingerprint information includes fingerprint characteristics of one or more fingers.
  • the embodiments of the present application also provide an electronic device that can be used to control at least one device, the electronic device further includes: an input module, a determination module, and a sending module; the input module is used to receive a user The first touch operation is input on the touch screen, and the fingerprint information corresponding to the first touch operation is collected.
  • the electronic device is in the preset state, the first interface or the black screen is displayed; the determining module is used to retrieve at least one In a device, determine one or more first devices corresponding to the fingerprint information; the sending module is used to send a first control command to one or more first devices, and the first control command is used to trigger one or more first devices Perform the corresponding event.
  • the input module is further used to receive a second touch operation of the user on the control switch or adjustment switch in the second interface;
  • the electronic device further includes a display module, and the sending module is used to respond to the second touch operation, Sending a second control command to one or more first devices, and the second control command is used to trigger one or more first devices to execute corresponding events.
  • the input module is also used to receive a first control response sent by one or more first devices, the first control response carries one or more first device status information; the display module is also used to display one Or multiple first device status information.
  • the determining module is further configured to determine that the first touch operation is a preset touch operation.
  • the determining module is further configured to determine that the first touch operation is a first control command issued by the electronic device to one or more first devices through a preset confirmation method; wherein the preset confirmation method includes at least: voice confirmation Ways and gesture confirmation methods.
  • the electronic device further includes one or more sensors; at least including: one or more of an ambient light sensor, an acceleration sensor, a camera, a distance sensor, and a microphone; the determining module is also used to, according to one or more The parameters collected by the sensor determine the preset confirmation method.
  • the fingerprint information includes fingerprint characteristics of one or more fingers.
  • an embodiment of the present application provides a chip system, which is applied to an electronic device including the aforementioned touch screen.
  • the chip system includes one or more interface circuits and one or more processors.
  • the interface circuit and the processor are interconnected by wires.
  • the interface circuit is used to receive a signal from the memory of the electronic device and send the signal to the processor, and the signal includes a computer instruction stored in the memory.
  • the processor executes the computer instruction, the electronic device executes the method described in the first aspect and any one of its possible implementation manners.
  • an embodiment of the present application provides a computer storage medium that includes computer instructions.
  • the computer instructions When the computer instructions are executed on an electronic device, the electronic device is caused to perform operations as in the first aspect and any of them.
  • the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the method described in the first aspect and any of its possible implementations .
  • the beneficial effects that can be achieved by the computer program product described in the six aspects please refer to the beneficial effects in the first aspect and any of its possible design methods, which will not be repeated here.
  • FIG. 1 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the application.
  • Figure 2 is a flowchart of a device control method provided by an embodiment of the application
  • FIG. 3 is a schematic diagram of a mobile phone displaying a first interface according to an embodiment of the application
  • FIG. 4a is an operation schematic diagram of a first touch operation provided by an embodiment of this application.
  • 4b is an operation schematic diagram of another first touch operation provided by an embodiment of this application.
  • 4c is an operation schematic diagram of another first touch operation provided by an embodiment of this application.
  • Figure 5 is a schematic structural diagram of a smart home network provided by an embodiment of the application.
  • FIG. 6 is a schematic structural diagram including all smart home devices provided by an embodiment of the application.
  • Figure 7a is a schematic structural diagram of a mobile phone controlling a device in an application scenario provided by an embodiment of the application;
  • FIG. 7b is a schematic structural diagram of a mobile phone controlling a device in another application scenario provided by an embodiment of the application;
  • FIG. 7c is a schematic structural diagram of a mobile phone controlling a device in another application scenario provided by an embodiment of this application.
  • FIG. 8 is a mobile phone display interface diagram of a gesture confirmation method provided by an embodiment of the application.
  • FIG. 9 is a mobile phone display interface diagram of another gesture confirmation method provided by an embodiment of the application.
  • FIG. 10 is a flowchart of another device control method provided by an embodiment of the application.
  • FIG. 11 is a schematic diagram of a display image of a second interface provided by an embodiment of the application.
  • FIG. 12 is a schematic diagram of a display image of another second interface provided by an embodiment of the application.
  • FIG. 13 is a schematic diagram of a display image of another second interface provided by an embodiment of the application.
  • 14a is a schematic diagram of a display image of another second interface provided by an embodiment of the application.
  • FIG. 14b is a schematic diagram of a display image of another second interface provided by an embodiment of the application.
  • 15 is a schematic diagram of a display image of another second interface provided by an embodiment of the application.
  • FIG. 16 is a schematic diagram of a display image of another second interface provided by an embodiment of the application.
  • FIG. 17 is a schematic diagram of a module structure of an electronic device provided by an embodiment of this application.
  • FIG. 18 is a schematic structural diagram of a chip system provided by an embodiment of the application.
  • first and second are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined with “first” and “second” may explicitly or implicitly include one or more of these features. In the description of this embodiment, unless otherwise specified, “plurality” means two or more.
  • the embodiment of the present application provides a method for controlling a device.
  • the method is applied to an electronic device, and the electronic device is used to control at least one device, and the electronic device includes a touch screen.
  • the electronic device acquires the first touch operation input by the user when the electronic device is not unlocked, and sends a control command to the device according to the first touch operation to realize the control of the device.
  • This control method can not only realize the control of the equipment, but also simplifies the control method of the equipment to a certain extent.
  • the electronic devices in the embodiments of the present application may be mobile phones, tablet computers, desktops, laptops, handheld computers, notebook computers, ultra-mobile personal computers (UMPC), netbooks, and cellular computers.
  • PDA personal digital assistants
  • AR augmented reality
  • VR virtual reality
  • FIG. 1 is a schematic structural diagram of an electronic device 100 provided by an embodiment of this application.
  • the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, and a battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the aforementioned sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, an acceleration sensor 180D, a distance sensor 180E, a proximity sensor 180F, a fingerprint sensor 180G, a temperature sensor 180H, a touch sensor 180I, and an ambient light sensor 180J Wait for the sensor.
  • the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100.
  • the electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait.
  • AP application processor
  • modem processor modem processor
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • the controller may be the nerve center and command center of the electronic device 100.
  • the controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 to store instructions and data.
  • the memory in the processor 110 is a cache memory.
  • the memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.
  • the processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter (universal asynchronous transmitter) interface.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB Universal Serial Bus
  • the interface connection relationship between the modules illustrated in this embodiment is merely a schematic description, and does not constitute a structural limitation of the electronic device 100.
  • the electronic device 100 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.
  • the charging management module 140 is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module 140 may receive the charging input of the wired charger through the USB interface 130.
  • the charging management module 140 may receive the wireless charging input through the wireless charging coil of the electronic device 100. While the charging management module 140 charges the battery 142, it can also supply power to the electronic device through the power management module 141.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.
  • the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 141 may also be provided in the processor 110.
  • the power management module 141 and the charging management module 140 may also be provided in the same device.
  • the wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.
  • the antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 100.
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.
  • the mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform processing such as filtering, amplifying and transmitting the received electromagnetic waves to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation via the antenna 1.
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110.
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is processed by the baseband processor and then passed to the application processor.
  • the application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194.
  • the modem processor may be an independent device.
  • the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellites.
  • WLAN wireless local area networks
  • BT wireless fidelity
  • BT wireless fidelity
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication technology
  • IR infrared technology
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110.
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110, perform frequency modulation, amplify it, and convert it into electromagnetic wave radiation via the antenna 2.
  • the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite-based augmentation systems
  • the electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor.
  • the GPU is a microprocessor for image processing, connected to the display 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • the processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos, etc.
  • the display screen 194 includes a display panel.
  • the display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active-matrix organic light-emitting diode active-matrix organic light-emitting diode
  • emitting diode AMOLED, flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.
  • the electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
  • the ISP is used to process the data fed back from the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transfers the electrical signal to the ISP for processing and is converted into an image visible to the naked eye.
  • ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 193.
  • the camera 193 is used to capture still images or videos.
  • the object generates an optical image through the lens and projects it to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • ISP outputs digital image signals to DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats.
  • the electronic device 100 may include 1 or N cameras 193, and N is a positive integer greater than 1.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects the frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in a variety of encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.
  • MPEG moving picture experts group
  • NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • the NPU can realize applications such as intelligent cognition of the electronic device 100, such as image recognition, face recognition, voice recognition, text understanding, and so on.
  • the external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.
  • the internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121.
  • the processor 110 may execute instructions stored in the internal memory 121, and the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, at least one application program (such as a sound playback function, an image playback function, etc.) required by at least one function.
  • the data storage area can store data (such as audio data, phone book, etc.) created during the use of the electronic device 100.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.
  • the electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal.
  • the audio module 170 can also be used to encode and decode audio signals.
  • the audio module 170 may be provided in the processor 110, or part of the functional modules of the audio module 170 may be provided in the processor 110.
  • the speaker 170A also called a "speaker” is used to convert audio electrical signals into sound signals.
  • the receiver 170B also called “earpiece”, is used to convert audio electrical signals into sound signals.
  • the microphone 170C also called “microphone”, “microphone”, is used to convert sound signals into electrical signals.
  • the earphone interface 170D is used to connect wired earphones.
  • the earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, and a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA, CTIA
  • the pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal.
  • the pressure sensor 180A may be provided on the display screen 194.
  • the capacitive pressure sensor may include at least two parallel plates with conductive material.
  • the electronic device 100 determines the intensity of the pressure according to the change in capacitance.
  • the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A.
  • the electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A.
  • touch operations that act on the same touch location but have different touch operation strengths may correspond to different operation instructions.
  • the electronic device 100 may collect the pressing force (or called pressing pressure) of the touch operation input by the user on the touch screen (ie, the display screen 194) through the pressure sensor 180A.
  • the gyro sensor 180B may be used to determine the movement posture of the electronic device 100.
  • the air pressure sensor 180C is used to measure air pressure.
  • the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
  • the acceleration sensor 180D can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices, and used in applications such as horizontal and vertical screen switching, pedometers and so on.
  • the electronic device 100 can measure the distance by infrared or laser.
  • the proximity light sensor 180F may include, for example, a light emitting diode (LED) and a light detector such as a photodiode.
  • the light emitting diode may be an infrared light emitting diode.
  • the electronic device 100 emits infrared light to the outside through the light emitting diode.
  • the electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100.
  • the ambient light sensor 180J is used to sense the brightness of the ambient light.
  • the electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived brightness of the ambient light.
  • the ambient light sensor 180J can also be used to automatically adjust the white balance when taking pictures.
  • the ambient light sensor 180J can also cooperate with the proximity light sensor 180F to detect whether the electronic device 100 is in the pocket to prevent accidental touch.
  • the fingerprint sensor 180G is used to collect fingerprints.
  • the electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, access application locks, fingerprint photographs, fingerprint answering calls, etc.
  • the temperature sensor 180H is used to detect temperature.
  • the electronic device 100 uses the temperature detected by the temperature sensor 180H to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180H exceeds a threshold value, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180H, so as to reduce power consumption and implement thermal protection.
  • the electronic device 100 when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature.
  • the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
  • the touch sensor 180I is also called “touch panel”.
  • the touch sensor 180I can be disposed on the display screen 194, and the touch screen is composed of the touch sensor 180I and the display screen 194, which is also called a “touch screen”.
  • the touch sensor 180I is used to detect touch operations acting on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • the visual output related to the touch operation can be provided through the display screen 194.
  • the touch sensor 180I may also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194.
  • the electronic device 100 can detect the touch operation input by the user on the touch screen through the touch sensor 180I, and collect the touch position, touch area, touch direction, and touch time of the touch operation on the touch screen. One or more of. In some embodiments, the electronic device 100 may combine the touch sensor 180I and the pressure sensor 180A to determine the touch position of the touch operation on the touch screen.
  • the button 190 includes a power button, a volume button, and so on.
  • the button 190 may be a mechanical button. It can also be a touch button.
  • the electronic device 100 may receive key input, and generate key signal input related to user settings and function control of the electronic device 100.
  • the motor 191 can generate vibration prompts.
  • the motor 191 can be used for incoming call vibration notification, and can also be used for touch vibration feedback.
  • touch operations applied to different applications can correspond to different vibration feedback effects.
  • Acting on touch operations in different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects.
  • Different application scenarios for example: time reminding, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, or to indicate messages, missed calls, notifications, and so on.
  • the SIM card interface 195 is used to connect to the SIM card.
  • the SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100.
  • the electronic device 100 may support 1 or N SIM card interfaces, and N is a positive integer greater than 1.
  • the SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc.
  • the methods in the following embodiments can all be implemented in the electronic device 100 having the above hardware structure.
  • the above-mentioned electronic device 100 is a mobile phone as an example to describe the method of the embodiment of the present application.
  • the embodiment of the present application provides a device control method, and the method flow is shown in FIG. 2, including steps 201 to 203.
  • the mobile phone in this embodiment can be used to control the device, and the mobile phone includes a touch screen.
  • the mobile phone and the device can perform wired communication or wireless remote communication.
  • a mobile phone can communicate with the device via a serial bus interface.
  • the mobile phone can establish a wireless communication connection with the device through the mobile communication module 150 or the wireless communication module 160, and the mobile phone sends a control command to the device through the wireless communication connection to control the device.
  • the specific communication method between the mobile phone and the device is not limited.
  • the touch screen of the mobile phone in the embodiment of this application also has the ability to recognize fingerprints.
  • the mobile phone can adopt an optical under-screen fingerprint recognition technology, OLED (Organic Light-Emitting Diode, organic light-emitting diode)
  • OLED Organic Light-Emitting Diode, organic light-emitting diode
  • the screen emits light to illuminate the finger touch area.
  • the light irradiated to the fingerprint is reflected and returned to the fingerprint sensor through the gap of the screen pixels.
  • the fingerprint sensor forms image data according to the received reflected light, and the fingerprint sensor sends the image data to the processor.
  • the processor compares and analyzes the image data formed by the fingerprint sensor with the stored fingerprint image, and recognizes the fingerprint information on the screen.
  • the mobile phone can also use the fingerprint recognition under the ultrasonic screen.
  • the ultrasonic sensor transmits the ultrasonic wave to the part touched by the finger and receives the echo. According to the information of the obtained echo, the surface of the fingerprint and the air are used. Different densities between different densities construct a 3D image of a fingerprint, and the processor compares and analyzes the acquired 3D image of the fingerprint with the pre-stored fingerprint information, and recognizes the fingerprint information on the touch screen. If the mobile phone is a mobile phone with non-full-screen fingerprint recognition, a capacitive fingerprint recognition method can also be used. This is only an example and does not specifically limit the fingerprint recognition method of the mobile phone.
  • Step 201 When the mobile phone is in a preset state, receive a first touch operation input by the user on the touch screen, and collect fingerprint information corresponding to the first touch operation.
  • the mobile phone when the mobile phone is in a preset state, the first interface or a black screen is displayed.
  • the device control method in this application is to simplify the device control method.
  • the mobile phone when controlling a device through a mobile phone, the mobile phone needs to display a special control interface.
  • the mobile phone can receive related control operations of the user on the control interface; in response to the related control operations, the mobile phone can send control commands to the device.
  • the control method of the mobile phone control device is cumbersome and the user operation is complicated.
  • the mobile phone when the mobile phone is in the preset state, it can receive the user's first touch operation, and determine the first device corresponding to the fingerprint information according to the fingerprint information of the first touch operation , And control the first device.
  • the mobile phone in the preset state displays the first interface or a black screen.
  • the first interface can be the mobile phone lock screen interface as shown in Figure 3, the main interface or the application control interface, etc.
  • the first touch operation of the user can be obtained when the mobile phone displays the first interface or the black screen, that is, in the control of the first device, the user does not need to display a special control interface to obtain the user’s first touch operation.
  • the control operation simplifies the control of the first device.
  • the first device in the embodiment of this application refers to a device that can be controlled by a mobile phone, and does not mean a certain type of device or a specific device.
  • a mobile phone can be used to control smart home devices, and can also control smart medical Equipment, etc., are not specifically limited, and the distance between the mobile phone and the device is also not limited.
  • the mobile phone collects fingerprint information corresponding to the first touch operation, and determines that the first touch operation is a preset touch operation.
  • the preset touch operation may be long pressing the touch screen or touching the screen and moving a certain distance, or touching the screen and drawing a preset graphic, etc., which is not specifically limited.
  • Figure 4a shows that the user's finger long presses on the touch screen
  • Figure 4b shows that the user's finger presses on the touch screen and slides down for a certain distance
  • Figure 4c shows that the user's finger touches the screen and draws a figure "2".
  • the mobile phone obtains the fingerprint information corresponding to the first touch operation to match the preset fingerprint information, and determines that the first touch operation is the preset touch operation, and then determines that the first touch operation is an operation that can start the first device.
  • the fingerprint information for the first touch operation should be set to be different from the fingerprint information for unlocking the mobile phone.
  • the mobile phone displays a black screen in a preset state
  • the first touch operation is a long press operation
  • the fingerprint information is the fingerprint of the index finger of the right hand.
  • the mobile phone When the mobile phone is in a black screen state, the user long presses the touch screen of the mobile phone with his right index finger. After the mobile phone receives the user's long press operation, it obtains the fingerprint information of the long press operation and determines that the obtained fingerprint information corresponds to the first operation The fingerprint information determines that the user's current operation is the first touch operation.
  • Step 202 The mobile phone determines one or more first devices corresponding to the fingerprint information from the at least one first device connected to it.
  • each first device can be set with different triggering methods. For example, if different fingerprint information is carried in the first touch operation, different first devices can be triggered correspondingly.
  • the fingerprint information in the first touch operation is the fingerprint feature of the index finger of the right hand
  • the first device used for triggering by the first touch operation is the speaker
  • the first touch operation is the fingerprint information of the right middle finger
  • the first device used to trigger the first touch operation is the water heater.
  • the mobile phone determines the first device corresponding to the control command according to the acquired fingerprint information in the first touch operation.
  • the fingerprint information may correspond to one first device, and the fingerprint information may also correspond to multiple first devices.
  • the first device corresponding to the fingerprint information in the first touch operation is a bedroom wall lamp, and the first device corresponding to the fingerprint information in the first touch operation may also be an air conditioner and a computer.
  • the fingerprint information in the first touch operation may be the fingerprint characteristics of one finger or the fingerprint characteristics of multiple fingers.
  • Table 1 indicates that the fingerprint information in the first touch operation is the fingerprint information of one finger and the corresponding first device
  • Table 2 indicates that the fingerprint information in the first touch operation is multiple fingers.
  • the fingerprint characteristics and the corresponding first device In practical applications, the mobile phone stores various marks of the first device, and the correspondence between the fingerprint information and the mark of the first device is determined according to the correspondence between the fingerprint information and the first device.
  • Fingerprint information First device Fingerprint characteristics of right index finger Sign of sound
  • the user can set the corresponding relationship between the fingerprint information and the first device according to preferences and operating habits.
  • fingerprints and smart home devices are taken as examples for description.
  • fingerprint information may also correspond to remote medical devices, wearable devices, and the like.
  • the first device is an electronic watch carried by a child
  • the fingerprint information in the first touch operation corresponds to the electronic watch
  • the mobile phone acquires the first touch operation
  • the fingerprint information in the first touch operation corresponds to the electronic watch
  • the mobile phone sends control commands to the electronic watch.
  • the control command may be to control the electronic watch to respond to the current position information, or to send out a prompt message to control the electronic watch, etc. This is only an example.
  • Step 203 The mobile phone sends a first control command to one or more first devices.
  • the first control command is used to trigger one or more first devices to execute the corresponding event.
  • the first control command is sent to the corresponding first device to achieve control of the first device.
  • the content of the first control command may be to start or shut down the first device, or to respond to certain data information.
  • the user when the user just wakes up, he does not open his eyes in the morning and performs the first touch operation on the phone.
  • the right index finger presses the touch screen of the phone, and the first device corresponding to the right index finger is the speaker.
  • the mobile phone is black, the first touch operation input by the user is received, the fingerprint information in the first touch operation is determined to be the fingerprint feature of the index finger of the right hand, and the first device corresponding to the first touch operation is determined to be the speaker.
  • One control command the first control command controls the speaker to start and play music.
  • the user’s left index finger presses on the touch screen of the mobile phone and performs a first touch operation.
  • the mobile phone receives the first touch operation and determines that the first device corresponding to the fingerprint information in the first touch operation is the sign of the air conditioner.
  • the first control command is sent, and the first control command controls the air conditioner to start.
  • the method steps in the embodiments of this application can be executed repeatedly.
  • the mobile phone receives the same first touch operation. It can be that the mobile phone sends the same first control command to the first device every time, or the mobile phone sends the same first control command to the first device every time. Different control commands to the first device. For example, the mobile phone receives the first touch operation, and determines that the first device corresponding to the fingerprint information in the first touch operation is an electronic watch carried by the child. The first control command returns the current position information in response to the mobile phone and sends the first control command to The electronic watch. Repeated execution of the above method steps, each time the mobile phone acquires the first touch operation and sends the first control command to the electronic watch, it can receive the position information responded by the electronic watch.
  • the mobile phone receives the first touch operation, and determines that the first device corresponding to the fingerprint information in the first touch operation is the sign of the air conditioner.
  • the mobile phone receives the first touch operation for the first time, and the first control command is start Air conditioner, the mobile phone sends a control command to start the air conditioner; the mobile phone receives the first touch operation for the second time, the first control command is to turn off the air conditioner, and the mobile phone sends a control command to turn off the air conditioner. That is to say, through the method in the embodiment of the present application, the first device can be quickly turned on and off without requiring the user to make special settings, thereby optimizing the user experience.
  • the mobile phone in the implementation of this application is used to control the first device. It does not mean that the mobile phone needs to directly communicate with the first device.
  • the mobile phone can directly establish a communication connection with the first device, or through The gateway establishes a communication connection with the first device. Therefore, in this embodiment, when the mobile phone sends the first control command to the first device, it may not be directly sent to the first device, or it may be sent to the gateway, and the gateway forwards the first control command to the first device. .
  • the smart home device can directly communicate with the mobile phone through the Internet of Things, the smart home receives the first control command sent by the mobile phone through the Internet, the smart home device can also establish a communication connection with the home router, and obtain the first control command sent by the mobile phone through the home router.
  • One control command As shown in Figure 5, the air conditioner establishes a communication connection with the home router.
  • the mobile phone can establish communication with the home router via the Internet or the Internet of Things. After the mobile phone obtains the first touch operation, it determines that the fingerprint information in the first touch operation corresponds to the air conditioner.
  • the first control command is sent to the home router, and the home router forwards the first control command to the air conditioner.
  • the home router establishes a communication connection with the home computer, TV, washing machine, stereo, lamp, air conditioner, microwave oven, curtain, floor heating, air purifier, water heater, oven, coffee machine, etc., as shown in the figure 6 shown.
  • the above-mentioned smart home device can be connected to the home router wirelessly via WIFI or Bluetooth, or connected to the home router through a physical interface, and the smart home device can be connected to the home router via wired communication.
  • the mobile phone can send control commands to any smart home device in the home.
  • the first device corresponding to the fingerprint information in the first touch operation is the sign of the speaker and the bedroom wall lamp.
  • the mobile phone receives the first touch operation and determines the The first device corresponding to the fingerprint information is the sign of the speaker and the bedroom wall light.
  • the mobile phone sends the first control command to the home router, and the home router sends the first control command to the speaker and bedroom wall light.
  • the first device corresponding to the fingerprint information in the first touch operation is a water heater, a computer, a coffee machine, and an air conditioner.
  • the fingerprint information of the first touch operation is the fingerprint characteristics of two fingers
  • the user performs the first touch operation on the mobile phone
  • the mobile phone receives the first touch operation input by the user, and confirms the first touch operation
  • the fingerprint information in is the fingerprint features of two fingers
  • the first device corresponding to the fingerprint feature is the sign of water heater, computer, coffee machine, and air conditioner.
  • the mobile phone sends the first control command to the home router, and the home router sends the first control command Send to water heater, computer, coffee machine and air conditioner respectively.
  • the user returns home an hour later, the room temperature is good, the computer is turned on, and there is hot water and hot coffee.
  • the first device corresponding to the fingerprint information in the first touch operation is a microwave oven, an oven, a water heater, and a speaker.
  • the user enters the first touch operation on the mobile phone.
  • the mobile phone receives the first touch operation, it is determined that the first device corresponding to the fingerprint information in the touch operation is the logo of microwave oven, oven, water heater, and audio.
  • the home router After receiving the first control command, the home router sends the first control command to the microwave oven, the oven, the water heater, and the audio device. In this way, after the user gets up, the breakfast is hot, the hot water is also boiled, and music is playing in the room.
  • a mobile phone in a preset state can acquire a user's first touch operation on the touch screen, and respond to the first touch operation to send a first control command to one or more first devices connected to it.
  • This method of controlling the first device can be carried out when the mobile phone has a black screen, without entering the relevant control program or control interface, and the first device can be quickly controlled.
  • the control of the first device is realized directly through the first touch operation, which simplifies the control method of the first device.
  • the mobile phone can perform full-screen fingerprint recognition, it may be possible to use fingerprints to unlock the mobile phone.
  • the mobile phone recognizes the fingerprint of the first touch operation, the fingerprint information carried in the first touch operation will be recognized.
  • the preset mode is set to determine that the first touch operation is the control operation of the mobile phone on the first device.
  • the preset mode includes a voice confirmation mode and a gesture confirmation mode.
  • the confirmation method for the first touch operation may also be an interface confirmation method.
  • the mobile phone interacts with the user by displaying an interface dialog box to obtain the user's confirmation operation.
  • the first device controlled by the user through the mobile phone is an air purifier.
  • the mobile phone determines that the first device corresponding to the first touch operation is an air purifier, and the mobile phone pops up a dialog box that includes "Please confirm whether Start the air purifier” and display the options "Yes” and "No".
  • the first control command is sent to the air conditioner.
  • the mobile phone After the mobile phone receives the first touch operation, it will give a voice prompt "Please confirm to control the first device" and obtain the user's voice information, where the voice information can be "yes” or “yes” Voice sounds such as "", “Yes” or “Confirm”. It should be noted that there is no need to store the user's voiceprint information in advance, as long as the corresponding voice information is received.
  • the mobile phone sends out the voice prompt, it can also receive the user's operation on the touch screen for confirmation. For example, the user can confirm by double-clicking or clicking on the mobile phone screen.
  • the mobile phone will give out a voice prompt, and the user can make a voice answer or perform a screen operation to confirm.
  • the mobile phone screen can always be displayed on a black screen, or the shape of the voice print of the voice can also be displayed, which is not specifically limited.
  • the preset mode is the gesture confirmation mode.
  • the mobile phone displays an icon to confirm the gesture, turns on the camera, and obtains the current user's gesture.
  • the gesture is "OK"
  • the screen of the mobile phone displays the gesture as shown in the figure, and the camera captures the user's gesture.
  • the gesture confirmation method can also be to display an arrow sign on the mobile phone, as shown in FIG. 9, the mobile phone displays a downward arrow, and the user can slide in the direction of the arrow.
  • the gesture operation may also be a shape in which the user draws a number 1, 2, 3, or 4 on the touch screen, etc. The specific form of the gesture operation is not limited.
  • the fingerprint information may be limited during the process of entering the first touch operation. That is to say, in the process of entering the first touch operation, if the fingerprint feature in the unlocking operation of the mobile phone is found to be the same as the fingerprint feature in the fingerprint information of the first touch operation, the user is prompted to change the finger and enter a fingerprint with a different fingerprint feature information.
  • the second mode of the present application provides a device control method.
  • This embodiment is roughly the same as the first embodiment.
  • the main difference is: in this embodiment, the electronic device determines that before sending the first control command to the first device According to the environmental information of the electronic device, the corresponding preset confirmation method is selected according to the environmental information, and the method flow is shown in FIG. 10.
  • the method of determining the current environmental information of the electronic device in this embodiment is only an example, and other methods for determining the current environmental information of the electronic device may also be applied in this application.
  • the electronic device is still a mobile phone as an example for description. If the electronic device is of another type, the implementation steps can be adjusted adaptively, which will not be repeated here.
  • step 301 to step 302 and step 306 in this embodiment are the same as steps 201 to step 202 and step 203 in the first embodiment, respectively. In order to reduce repetition, we will not repeat them, and only the differences will be described here. .
  • Step 303 Obtain the parameters of the sensors in the mobile phone, and determine the current environmental information of the mobile phone corresponding to the sensor parameters.
  • Step 304 Determine a preset confirmation method corresponding to the current environmental information of the mobile phone.
  • Step 305 Send a confirmation message according to a preset confirmation mode, and receive confirmation feedback information.
  • Step 306 Determine whether the confirmation feedback information indicates that the user confirms to trigger one or more first devices. If yes, go to step 307; otherwise, go to step 308.
  • Step 307 Send a first control command to one or more first devices.
  • Step 308 Prohibit sending the first control command to one or more first devices.
  • the mobile phone is provided with a sensor module.
  • the electronic device 100 in FIG. 1 has a sensor module 180, which can determine the current state of the mobile phone with the help of various sensors in the mobile phone, and then select the first touch of the mobile phone according to the current state of the mobile phone.
  • the specific determination method of the operation include at least one or more of an ambient light sensor, an acceleration sensor, a camera, a distance sensor, and a microphone.
  • a specific implementation is that after the mobile phone acquires the first touch operation, the mobile phone acquires data from one or more sensors, determines the current environmental information of the mobile phone according to the sensor data, and determines the preset confirmation method according to the current environmental information of the mobile phone.
  • the current environment information of the mobile phone represents the current environment described by the mobile phone, for example, the environment information of the mobile phone is dull, static, and unheld.
  • the current environmental information of the mobile phone may infer the current state of the user. For example, no light, static, or unhandled means the mobile phone is not used.
  • the mobile phone system time is obtained. If it is 12:00 at night, it may mean that the user has rested.
  • the environmental information of the mobile phone the state of the possible user is inferred, and the appropriate confirmation method of the first touch operation is selected according to the inferred user's state, which improves the intelligence of the mobile phone and optimizes the user experience. Therefore, after acquiring the data of the sensors in the mobile phone, information such as the system time of the mobile phone can also be obtained to further determine the environmental information of the mobile phone.
  • the preset confirmation mode includes a gesture confirmation mode, a voice confirmation mode, and an interface confirmation mode.
  • a gesture confirmation mode For example, to obtain the parameters of the microphone in the mobile phone, to confirm whether the environmental information of the mobile phone is a bass environment, if it is a bass environment, the voice confirmation can be done with all efforts, and the preset confirmation method selects the voice confirmation method.
  • the environmental information of the mobile phone can be confirmed based on the parameters of one sensor, or the environmental information of the mobile phone can be confirmed based on the parameters of at least two sensors.
  • the interface confirmation mode or the gesture confirmation mode can be selected.
  • the current environmental information of the mobile phone can also be confirmed according to the sensor parameters and system information.
  • the system information is the current time information of the mobile phone to obtain the parameters of the touch sensor and the light sensor and the system time, and the touch sensor confirms whether the mobile phone is being held.
  • the preset confirmation method can be determined to be the interface confirmation method or the gesture confirmation method.
  • the fingerprint information of the first touch operation is the left index finger corresponding to the air purifier.
  • the user's first touch operation is received and the fingerprint information in the first touch operation is determined to be the fingerprint of the left index finger.
  • Information it is determined that the first device is an air purifier.
  • the first touch operation can be determined by an interface confirmation method or a gesture confirmation method.
  • determining the current environmental information of the mobile phone requires acquiring data from multiple sensors, judging possible user behaviors based on the current environmental information of the mobile phone, and giving an appropriate confirmation method for the first touch operation. This setting helps simplify the control method of the first device, make it as convenient as possible for users to use, and optimize the user experience.
  • the above method of confirming the current environment of the mobile phone can be determined based on the sensor parameters, or determined based on the usage mode of the mobile phone. For example, the mobile phone is in sports mode and the mobile phone displays a black screen, and the mobile phone receives the user's first touch Operation, select the voice confirmation method according to the current mobile phone mode.
  • the control switch or adjustment switch of the first device may be displayed on the mobile phone.
  • the mobile phone displays a second interface, where the second interface includes: one or more control switches of the first device and/or one or more adjustment switches of the first device;
  • the mobile phone sends a second control command to one or more first devices, where the second control command is used to trigger one or more first devices An event corresponding to a device performing a second touch operation.
  • the second interface is displayed on the mobile phone, the second interface includes the control switch of the first device, and the second interface is an adaptive interface, the control switch in the second interface can display different If the control interface or the second interface displays a general control interface, a preset control interface is displayed for any first device.
  • the second interface is an adaptive interface
  • the device type of the first device is acquired, and the control interface of the first device is determined according to the device type of the first device, and the second interface displays the control interface of the first device. For example, if it is determined that the first device is an air conditioner, the control interface of the air conditioner is determined, and the control interface of the air conditioner is displayed in the second interface.
  • control interfaces of multiple devices can be stored in the mobile phone in advance, so that the mobile phone directly determines the corresponding control interface according to the device type, or the mobile phone automatically generates the control interface of the device according to the device type.
  • the second interface is a general control interface
  • the second interface includes at least an increase button, a decrease button, a mode selection button, etc., wherein the mode selection button includes a first selection button and a second selection button.
  • the switch control buttons are displayed on the second interface.
  • the first device is a wall lamp, but the wall lamp cannot adjust the brightness
  • only the switch button of the wall lamp can be displayed in the second interface, as shown in FIG. 11.
  • the second interface can display the control interface of the hot water and the air conditioner at the same time, as shown in FIG. 12.
  • the hot water display interface includes the current water temperature of the water heater, switch control buttons and water temperature adjustment buttons.
  • the display interface of the air conditioner includes the current operating temperature of the air conditioner, the switch control button of the air conditioner, the temperature adjustment button of the air conditioner, and the mode adjustment button of the air conditioner.
  • FIG. 13 the display of the foregoing second interface is shown in FIG. 13, which may be several arrows of "up”, “down”, “left” and “right", and the name of the first device displayed on the second interface.
  • FIG. 13 the display in Figure 13 as an example, different first devices can achieve different control purposes.
  • Table 4 corresponds to the first device and the control switch of the second interface:
  • Table 4 Correspondence table of the first device and operation keys
  • the second interface is displayed as shown in Figure 14a, where "up”, “down”, “left” and “right” correspond to each other, and “volume up”, “Volume Down”, “Previous Song” and “Next Song”.
  • the audio control interface can be as shown in Figure 14b, including a volume adjustment switch, a playback control switch, and so on.
  • the control switch or adjustment switch of the first device is displayed on the second interface.
  • the current status information of the first device can also be displayed on the second interface.
  • the first device is an air conditioner, in addition to In addition to displaying the air conditioner's switch and temperature adjustment buttons, it can also display the current temperature and operating mode of the air conditioner, as shown in Figure 15.
  • the specific implementation process is that after the mobile phone sends the first control command to the first device, it receives the first control response sent by the first device.
  • the first control response carries one or more status information of the first device, and the mobile phone displays a Or multiple first device status information.
  • the first device includes more than one device, for example, the first device includes air conditioners, curtains, speakers, and coffee machines, it is difficult to display all the control interfaces of the four devices in the second display interface of the mobile phone.
  • a specific implementation is that the vertical menu is displayed in the first interface, and the corresponding control interface is displayed according to the obtained user's selection operation. As shown in FIG. 16, the user selects the air conditioner.
  • the embodiment of the present application also provides an electronic device, which is used to control at least one device and has a touch screen.
  • the module structure is shown in Fig. 17, including an input module 1701, a determination module 1702, and a sending module 1703.
  • the input module 1701 is configured to receive the first touch operation input by the user on the touch screen, and collect fingerprint information corresponding to the first touch operation, wherein, when the electronic device is in a preset state, a first interface or a black screen is displayed.
  • the determining module 1702 is configured to determine one or more first devices corresponding to fingerprint information from among at least one first device connected to the electronic device.
  • the sending module 1703 is configured to send a first control command to one or more first devices by the electronic device, and the first control command is used to trigger one or more first devices to execute a corresponding event.
  • the electronic device in this application is a device corresponding to the control method of the device described above, the implementation manner of this application can be implemented in cooperation with the foregoing implementation manner.
  • the relevant technical details mentioned in the method implementation are still valid in this embodiment, and the technical effects that can be achieved in the method implementation can also be achieved in this embodiment. In order to reduce repetition, details are not repeated here.
  • Some other embodiments of the present application also provide an electronic device, which may include the above-mentioned touch screen, a memory, and one or more processors.
  • the touch screen, memory and processor are coupled.
  • the memory is used to store computer program code, and the computer program code includes computer instructions.
  • the processor executes the computer instructions, the electronic device can execute the steps related to the countdown display method in the foregoing method embodiment.
  • the structure of the electronic device can refer to the structure of the electronic device 100 shown in FIG. 1.
  • the chip system includes at least one processor 1801 and at least one interface circuit 1802.
  • the processor 1801 and the interface circuit 1802 may be interconnected by wires.
  • the interface circuit 1802 can be used to receive signals from other devices (such as the memory of an electronic device).
  • the interface circuit 1802 may be used to send signals to other devices (such as the processor 1801).
  • the interface circuit 1802 can read instructions stored in the memory and send the instructions to the processor 1801.
  • the electronic device can execute the steps in the foregoing embodiments.
  • the chip system may also include other discrete devices, which are not specifically limited in the embodiment of the present application.
  • the embodiments of the present application also provide a computer storage medium, which includes computer instructions, which when the computer instructions run on the above-mentioned electronic device, cause the electronic device to execute each step of the above-mentioned method embodiment.
  • the embodiment of the present application also provides a computer program product, which when the computer program product runs on a computer, causes the computer to execute each step of the foregoing method embodiment.
  • the disclosed device and method may be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of the modules or units is only a logical function division.
  • there may be other division methods for example, multiple units or components may be It can be combined or integrated into another device, or some features can be omitted or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described above as separate components may or may not be physically separated, and the components displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed to multiple different places. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium.
  • the technical solutions of the embodiments of the present application are essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of software products, which are stored in a storage medium.
  • a device which may be a single-chip microcomputer, a chip, etc.
  • a processor processor
  • the aforementioned storage medium includes: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Environmental & Geological Engineering (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Selon des modes de réalisation, la présente invention, qui concerne le domaine technique des communications électroniques, concerne un procédé de commande d'appareil et un appareil électronique, ledit procédé permettant, lorsqu'un appareil électronique n'est pas déverrouillé, une commande d'appareil destinée à l'appareil électronique par entrée d'un geste de commande, simplifiant ainsi la façon de commander l'appareil. Le procédé est applicable à un appareil électronique utilisé pour commander au moins un premier appareil et consiste : lorsque l'appareil électronique est dans un état prédéterminé, à recevoir une première entrée d'opération tactile d'un utilisateur sur un écran tactile et à acquérir des informations d'empreinte digitale correspondant à la première opération tactile, l'appareil électronique affichant une première interface ou un écran éteint lorsqu'il est dans l'état prédéterminé ; à déterminer, au moyen de l'appareil électronique, et d'au moins un premier appareil connecté à celui-ci, un ou plusieurs premiers appareils correspondant aux informations d'empreinte digitale ; à envoyer, au moyen de l'appareil électronique auxdits premiers appareils, une première instruction de commande utilisée pour amener lesdits premiers appareils à permettre l'occurrence d'un événement correspondant.
PCT/CN2020/103129 2019-07-25 2020-07-20 Procédé de commande d'appareil électronique et appareil électronique WO2021013136A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910677017.3A CN110519444A (zh) 2019-07-25 2019-07-25 一种设备的控制方法及电子设备
CN201910677017.3 2019-07-25

Publications (1)

Publication Number Publication Date
WO2021013136A1 true WO2021013136A1 (fr) 2021-01-28

Family

ID=68623530

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/103129 WO2021013136A1 (fr) 2019-07-25 2020-07-20 Procédé de commande d'appareil électronique et appareil électronique

Country Status (2)

Country Link
CN (1) CN110519444A (fr)
WO (1) WO2021013136A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115442474A (zh) * 2021-06-02 2022-12-06 华为技术有限公司 信息保护方法及电子设备

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110519444A (zh) * 2019-07-25 2019-11-29 华为技术有限公司 一种设备的控制方法及电子设备
CN114268617B (zh) * 2020-09-15 2023-09-01 华为技术有限公司 电子设备及其定位控制方法和介质
CN112333504B (zh) * 2020-10-26 2023-03-10 深圳Tcl数字技术有限公司 智能设备控制方法、遥控设备及可读存储介质
CN115904057A (zh) * 2021-08-17 2023-04-04 华为技术有限公司 一种设备控制方法与电子设备

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120129496A1 (en) * 2010-11-23 2012-05-24 Jonghoon Park Content control apparatus and method thereof
CN103631733A (zh) * 2012-08-21 2014-03-12 联想(北京)有限公司 一种控制方法和设备
CN104574932A (zh) * 2015-01-07 2015-04-29 广东欧珀移动通信有限公司 一种基于智能终端的遥控方法、装置及智能终端
CN106331353A (zh) * 2016-08-26 2017-01-11 广东欧珀移动通信有限公司 基于移动终端的遥控方法、装置和移动终端
CN106611493A (zh) * 2017-02-06 2017-05-03 邯郸美的制冷设备有限公司 智能设备控制方法、控制系统和终端
CN107395889A (zh) * 2017-07-28 2017-11-24 广东欧珀移动通信有限公司 降低移动终端功耗的方法、装置、存储介质及移动终端
CN109166580A (zh) * 2018-09-17 2019-01-08 珠海格力电器股份有限公司 一种语音反馈提示控制方法、系统及空调器
CN110519444A (zh) * 2019-07-25 2019-11-29 华为技术有限公司 一种设备的控制方法及电子设备

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9420464B2 (en) * 2014-12-15 2016-08-16 Intel Corporation Technologies for controlling network access based on electronic device communication fingerprints
CN106527160B (zh) * 2016-09-28 2020-03-03 北京小米移动软件有限公司 设备控制方法及装置

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120129496A1 (en) * 2010-11-23 2012-05-24 Jonghoon Park Content control apparatus and method thereof
CN103631733A (zh) * 2012-08-21 2014-03-12 联想(北京)有限公司 一种控制方法和设备
CN104574932A (zh) * 2015-01-07 2015-04-29 广东欧珀移动通信有限公司 一种基于智能终端的遥控方法、装置及智能终端
CN106331353A (zh) * 2016-08-26 2017-01-11 广东欧珀移动通信有限公司 基于移动终端的遥控方法、装置和移动终端
CN106611493A (zh) * 2017-02-06 2017-05-03 邯郸美的制冷设备有限公司 智能设备控制方法、控制系统和终端
CN107395889A (zh) * 2017-07-28 2017-11-24 广东欧珀移动通信有限公司 降低移动终端功耗的方法、装置、存储介质及移动终端
CN109166580A (zh) * 2018-09-17 2019-01-08 珠海格力电器股份有限公司 一种语音反馈提示控制方法、系统及空调器
CN110519444A (zh) * 2019-07-25 2019-11-29 华为技术有限公司 一种设备的控制方法及电子设备

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115442474A (zh) * 2021-06-02 2022-12-06 华为技术有限公司 信息保护方法及电子设备

Also Published As

Publication number Publication date
CN110519444A (zh) 2019-11-29

Similar Documents

Publication Publication Date Title
CN112351322B (zh) 一种通过遥控器实现一碰投屏的终端设备、方法以及系统
WO2021013136A1 (fr) Procédé de commande d'appareil électronique et appareil électronique
WO2020224449A1 (fr) Procédé de manœuvre d'affichage à écran partagé et dispositif électronique
WO2020041952A1 (fr) Procédé et appareil électronique pour commander une armoire de livraison express sur la base d'un message de livraison express
EP4024168A1 (fr) Procédé et appareil d'interaction par geste de la main et dispositif terminal
CN111650840B (zh) 智能家居场景编排方法及终端
CN111752443A (zh) 显示设备控制页面的方法、相关装置及系统
EP3570527B1 (fr) Synchronisation entre deux appareils electroniques de valeurs pour reglage de configuration
WO2021238230A1 (fr) Système domestique intelligent ainsi que ses procédé et dispositif de commande
WO2021004527A1 (fr) Procédé d'affichage de compte à rebours et dispositif électronique
JP2022548910A (ja) 近距離通信方法及び電子デバイス
WO2021052344A1 (fr) Procédé de réglage de paramètres et dispositif électronique
WO2021082564A1 (fr) Procédé d'invite d'opération et dispositif électronique
WO2021037146A1 (fr) Procédé et dispositif de partage de fichier pour terminal mobile
CN114115770B (zh) 显示控制的方法及相关装置
WO2020019355A1 (fr) Procédé de commande tactile pour dispositif vestimentaire, et système et dispositif vestimentaire
WO2022028537A1 (fr) Procédé de reconnaissance de dispositif et appareil associé
WO2020221062A1 (fr) Procédé d'opération de navigation et dispositif électronique
EP3883299A1 (fr) Procédé permettant à un appareil domestique intelligent d'accéder à un réseau et dispositif associé
CN111492678B (zh) 一种文件传输方法及电子设备
CN113572798B (zh) 设备控制方法、系统、设备和存储介质
CN115701032A (zh) 设备控制方法、电子设备及存储介质
CN113867520A (zh) 设备控制方法、电子设备和计算机可读存储介质
CN114079809A (zh) 终端及其输入方法与装置
WO2023071497A1 (fr) Procédé de réglage de paramètre de photographie, dispositif électronique et support de stockage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20843726

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20843726

Country of ref document: EP

Kind code of ref document: A1