CN110568767B

CN110568767B - Intelligent household equipment selection method and terminal

Info

Publication number: CN110568767B
Application number: CN201910704762.2A
Authority: CN
Inventors: 杨嘉辰
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2019-07-31
Filing date: 2019-07-31
Publication date: 2021-01-29
Anticipated expiration: 2039-07-31
Also published as: CN110568767A

Abstract

An intelligent home device selection method and a terminal relate to the technical field of terminals and are applied to an intelligent home environment, wherein the intelligent home environment comprises a plurality of intelligent home devices and terminals for controlling the intelligent home devices, and target intelligent home devices pointed by the terminals are determined, wherein the pointing direction refers to the direction of signals collected by direction sensors of the terminals, and the target intelligent home devices are any one of the intelligent home devices; and displaying a control interface of the target intelligent household equipment on a display screen of the terminal. Therefore, the process that the user manually searches the control interface of the target intelligent household equipment is simplified, the target intelligent household equipment is quickly selected, the confusion and inconvenience caused when the user selects the target intelligent household equipment are avoided, and the user experience is improved.

Description

Intelligent household equipment selection method and terminal

Technical Field

The application relates to the technical field of terminals, in particular to an intelligent household equipment selection method and a terminal.

Background

At present, more and more intelligent household devices are installed in a household environment of a user, such as an intelligent television, an intelligent air conditioner, an intelligent lamp, an intelligent socket and the like. In addition to controlling the smart home devices through the remote controller, the user also generally uses application software (APP) installed on the terminal to control the smart home devices, where the APP is an APP for controlling the smart home devices. Generally, when a user controls smart home devices through an APP, the user needs to select a target smart home device to be controlled in an application interface of the APP, and then correspondingly controls the target smart home device. Then, as the number of the smart home devices in the user's home increases, the process of selecting the target smart home device by the user in the APP becomes more and more troublesome, and it is difficult to accurately distinguish the names of the various smart home devices, which may cause difficulty in selection, thereby causing the problem that the process of selecting the smart home device is cumbersome and difficult to select when controlling the smart home device.

Disclosure of Invention

The application provides an intelligent household equipment selection method and a terminal, which are used for solving the problems that in the prior art, the process of selecting an icon corresponding to intelligent household equipment by a user is complicated, the user selection is easily confused, and the user experience is reduced.

In a first aspect, an embodiment of the present application provides a method for selecting an intelligent home device, where the method may be applied to an intelligent home environment, where the intelligent home environment includes a plurality of intelligent home devices and terminals for controlling the intelligent home devices, an execution subject selected by the intelligent home device may be an intelligent home device or a terminal, and the intelligent home device may further include a router. The method specifically comprises the following steps: determining target intelligent home equipment pointed by the terminal, wherein the pointing direction refers to the direction of a signal acquired by a direction sensor of the terminal, and the target intelligent home equipment is any one of the intelligent home equipment; and displaying a control interface of the target intelligent household equipment on a display screen of the terminal.

In the technical scheme, the direction of the signal collected by the direction sensor of the terminal is determined, the target intelligent household equipment pointed by the terminal can be determined, the control interface of the target intelligent household equipment is directly displayed on the display screen of the terminal, so that the process of manually searching the control interface of the target intelligent household equipment by a user can be simplified, the quick selection of the target intelligent household equipment is realized, the confusion and inconvenience in selecting the target intelligent household equipment by the user are avoided, and the experience of selecting the intelligent household equipment by the user is improved.

In a possible design, the specific process when determining the target smart home device pointed by the terminal may be: determining a first vector under a first coordinate system when the terminal points at the target intelligent household equipment according to the direction angle and the inclination angle of the terminal when the terminal points at the target intelligent household equipment, wherein the first coordinate system is a natural coordinate system; the terminal converts the first vector into a second vector under a second coordinate system according to a preset conversion relation, wherein the second coordinate system is an intelligent home environment coordinate system, and the conversion relation is the conversion relation between the first coordinate system and the second coordinate system; determining the position coordinates of the terminal in the second coordinate system according to the strength information of the signals transmitted by the intelligent home devices received when the terminal points to the target intelligent home devices and the position coordinates of the intelligent home devices in the second coordinate system; respectively calculating a third vector of the terminal and each intelligent household device in a second coordinate system according to the position coordinates of each intelligent household device in the second coordinate system and the position coordinates of the terminal in the second coordinate system; matching each third vector with the second vector, and determining a target third vector with the highest matching degree; and determining the intelligent household equipment corresponding to the target third vector with the highest matching degree as target intelligent household equipment.

In the technical scheme, the target intelligent household equipment is determined by calculating the matching degree of the direction between the intelligent household equipment and the terminal and the actual pointing angle of the terminal, so that the process of manually searching the control interface of the target intelligent household equipment by a user can be simplified.

In one possible design, the transformation relationship between the first coordinate system and the second coordinate system is determined according to the following process: selecting at least three pieces of reference equipment from the intelligent household equipment; determining a fourth vector in a first coordinate system when the terminal equipment points at first reference equipment according to a direction angle and an inclination angle acquired by a direction sensor of the terminal when the terminal equipment points at the first reference equipment, wherein the first reference equipment is one of the reference equipment; determining the position coordinates of the terminal in the second coordinate system according to the strength information of the signals transmitted by the reference devices received when the terminal points to the first reference device and the position coordinates of the reference devices in the second coordinate system; calculating a fifth vector in a second coordinate system when the terminal points to the first reference device according to the position coordinate of the first reference device in the second coordinate system and the position coordinate of the terminal in the second coordinate system; and determining the conversion relation between the first coordinate system and the second coordinate system according to the fourth vector and the fifth vector.

In the technical scheme, a fourth vector in the first coordinate system and a fifth vector in the second coordinate system are determined when the terminal points to the reference device, and the conversion relation between the first coordinate system and the second coordinate system is determined based on the fourth vector and the fifth vector, so that the determination of the target intelligent home device can be realized, and the user experience is facilitated to be improved.

In a possible design, before determining the target smart home device to which the terminal is pointing, the method further includes: and recognizing that the application program of the intelligent household equipment in the terminal is opened.

It can be understood that the identified smart home device application is opened, and only one trigger time of the target smart home device pointed by the terminal is determined, but the trigger time in the application is not limited.

In the technical scheme, the intelligent household equipment application program is identified to be opened, the user can be considered to have a selection control requirement for selecting and controlling the intelligent household equipment, and then the target intelligent household equipment is determined, so that the user cannot operate by mistake when the user walks in the house at the handheld terminal, and the user experience is favorably improved.

In a possible design, calculating, according to the position coordinates of the smart home devices in the second coordinate system and the position coordinates of the terminal in the second coordinate system, third vectors of the terminal and each smart home device in the second coordinate system, respectively, includes: and calculating a third vector of the terminal and any intelligent household equipment in the second coordinate system to be (X-X, Y-Y, Z-Z) according to the position coordinate (X, Y, Z) of any intelligent household equipment in the second coordinate system and the position coordinate (X, Y, Z) of the terminal in the second coordinate system.

In one possible design, the terminal determines a vector of the terminal in a first coordinate system according to the direction angle and the tilt angle, including:

and A is a vector of the terminal under a first coordinate system, and A is a direction angle and B is an inclination angle.

In one possible design, selecting a reference device from among the smart home devices includes: the terminal identifies reference equipment selected by a user in each intelligent household equipment; or the terminal randomly selects reference equipment from the intelligent household equipment; or the terminal selects preset reference equipment from the intelligent household equipment.

In a second aspect, a terminal is provided, which includes: one or more processors and one or more memories, a display screen and an orientation sensor, and one or more computer programs stored in the memories, the one or more computer programs comprising instructions;

the display screen is used for displaying a user interface;

the direction sensor is used for acquiring a direction angle and an inclination angle of the terminal under a natural coordinate system;

the instructions, when executed by the one or more processors, cause the terminal to perform the method as described in the first aspect or any possible design of the first aspect.

In a third aspect, a chip is provided, the chip being coupled to a memory, such that the chip, when running, invokes a computer program stored in the memory to implement the method described in the first aspect or any of the possible designs of the first aspect.

In a fourth aspect, there is provided a computer storage medium comprising a computer program which, when run on the terminal, causes the terminal to perform the method as described in the first aspect or any of the possible designs of the first aspect.

In a fifth aspect, there is provided a computer program product comprising instructions which, when run on a terminal, cause the terminal to perform the method of the first aspect or any possible design of the first aspect.

Drawings

Fig. 1 is a schematic diagram of an intelligent home control system according to an embodiment of the present application connected to various devices;

fig. 2 is a schematic diagram of a hardware structure of a terminal according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a user interface according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a user interface according to an embodiment of the present application;

FIG. 5 is a schematic view of a user interface according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a user interface according to an embodiment of the present application;

FIG. 7 is a schematic illustration of a user interface according to an embodiment of the present application;

fig. 8 is a schematic diagram of an intelligent home environment according to an embodiment of the present application;

fig. 9 is a schematic view of another smart home environment according to an embodiment of the present application;

FIG. 10 is a flowchart illustrating an initialization process according to an embodiment of the present application;

fig. 11 is a schematic flowchart of smart home device selection according to an embodiment of the present application;

fig. 12 is a schematic diagram of an intelligent home environment according to an embodiment of the present application;

fig. 13 is a schematic flowchart of smart home device selection according to an embodiment of the present application;

fig. 14 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 15 is a schematic structural diagram of another electronic device according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions of the embodiments of the present application will be described in detail below with reference to the drawings and specific embodiments of the specification.

Some basic concepts related to the embodiments of the present application will be first described so that those skilled in the art will understand that:

firstly, smart home: the residential building is used as a platform, facilities related to home life are integrated by utilizing a comprehensive wiring technology, a network communication technology, a safety precaution technology, an automatic control technology and an audio and video technology, an efficient management system for residential facilities and family schedule affairs is constructed, home safety, convenience, comfortableness and artistry are improved, and the environment-friendly and energy-saving residential environment is realized. As shown in fig. 1, fig. 1 is a schematic diagram of an intelligent home control system connecting various devices, and the intelligent home connects various devices (such as audio and video devices, lighting systems, curtain control, air conditioner control, security system, digital cinema system, audio and video server, video cabinet system, network home appliances, etc.) in a home together through internet of things technology, and provides multiple functions and means of home appliance control, lighting control, telephone remote control, indoor and outdoor remote control, anti-theft alarm, environment monitoring, heating and ventilation control, infrared forwarding, programmable timing control, etc. The user can control various equipment in the family through the intelligent house APP who installs on the terminal, promptly through intelligent house APP access to intelligent house control system after, the user just can control various household equipment in the family through this APP.

II, electronic equipment: the device is used for assisting a user to select and control various home intelligent home devices, and comprises an intelligent home device (such as an intelligent television, an intelligent sound box and the like), a terminal used by the user, and a third-party device such as a router accessed by the home device.

Thirdly, intelligent household equipment: the intelligent anti-theft alarm system is applied to various household equipment in an intelligent household, for example, intelligent anti-theft series products and intelligent anti-theft series products are coordinated with each other mainly through various alarms and detectors, alarm information is triggered in a laying state, and a safety anti-theft effect is achieved. The intelligent lighting system can also be an intelligent lighting product, and a user can directly check and control the on-off state of the lighting equipment in home through a mobile phone, a tablet personal computer and other terminals. The infrared remote controller can also be a household appliance control product and an intelligent household appliance controller, and can be used for associating infrared wireless signals and controlling any equipment using the infrared remote controller, such as a television, an air conditioner, a motorized window curtain and the like, through a terminal. In addition, the user can conveniently check the indoor temperature and humidity and the environmental condition monitored by the air quality sensor on the APP of the terminal, and can be linked with other household electric equipment to improve the indoor environment, so that better enjoyment is provided for the user. The intelligent door lock can also be a mobile phone intelligent door lock, and a user only needs to take out a mobile phone, a tablet personal computer and other terminals and input a password, so that automatic unlocking can be realized. Meanwhile, the user can remotely unlock the lock for family or visitors.

Fourthly, the router: the router is a special intelligent network device which reads the address of each data packet and then determines how to transmit, and can be conveniently and easily controlled by a user by using a mobile phone or a tablet computer and other terminals through wireless connection with the host. The general router provides a Wi-Fi hotspot, the intelligent home equipment and the terminal access a Wi-Fi network through the Wi-Fi hotspot accessed to the router, and the routers accessed by the intelligent home equipment and the terminal can be the same or different.

Fifthly, intelligent household APP: the software program capable of selecting and controlling various household equipment in a house is installed on a terminal used by a user. The smart home APP referred to below may be an application installed when the terminal leaves a factory, or an application downloaded from a network or acquired from another device during the process of using the terminal by the user.

Sixthly, the terminal: the smart home APP is installed and used for controlling the smart home device, and may be a portable device, such as a mobile phone, a tablet computer, an Artificial Intelligence (AI) intelligent voice terminal, a wearable device, an Augmented Reality (AR)/Virtual Reality (VR) device, and the like. Portable devices include, but are not limited to, a dock

Or other operating system. The user can control the intelligent household equipment in the house through the intelligent household APP installed on the terminal.

Exemplarily, as shown in fig. 2, the present invention is a schematic diagram of a hardware structure of a terminal according to an embodiment of the present application. Specifically, as shown in the figure, the terminal 100 includes a processor 110, an internal memory 121, an external memory interface 122, a camera 131, a display 132, a sensor module 140, a key 151, a Universal Serial Bus (USB) interface 152, a charging management module 160, a power management module 161, a battery 162, a mobile communication module 171, and a wireless communication module 172. In other embodiments, the terminal 100 may further include a Subscriber Identity Module (SIM) card interface, an audio module, a speaker, a receiver, a microphone, an earphone interface, a motor, an indicator, a key, and the like.

It should be understood that the hardware configuration shown in fig. 2 is only one example. The terminal 100 of embodiments of the present application may have more or fewer components than the terminal 100 shown in the figures, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

Processor 110 may include one or more processing units, among others. For example: the processor 110 may include an Application Processor (AP), a modem, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), and the like. The different processing units may be separate devices or may be integrated into one or more processors.

In some embodiments, a buffer may also be provided in processor 110 for storing instructions and/or data. As an example, the cache in the processor 110 may be a cache memory. The buffer may be used to hold instructions and/or data that have just been used, generated, or recycled by processor 110. If the processor 110 needs to use the instruction or data, it can be called directly from the buffer. Helping to reduce the time for processor 110 to fetch instructions or data and thus helping to improve the efficiency of the system.

The internal memory 121 may be used to store programs and/or data. In some embodiments, the internal memory 121 includes a program storage area and a data storage area. The storage program area may be used to store an operating system (e.g., an operating system such as Android and IOS), a computer program required by at least one function (e.g., a voice wake-up function, a sound playing function), and the like. The storage data area may be used to store data (e.g., audio data) created, and/or collected during use of the terminal 100, etc. For example, the processor 110 may implement one or more functions by calling programs and/or data stored in the internal memory 121 to cause the terminal 100 to perform corresponding methods. For example, the processor 110 calls some programs and/or data in the internal memory, so that the terminal 100 executes the voice wake-up method provided in the embodiment of the present application, thereby implementing the voice wake-up function. The internal memory 121 may be a high-speed random access memory, a nonvolatile memory, or the like. For example, the non-volatile memory may include at least one of one or more magnetic disk storage devices, flash memory devices, and/or universal flash memory (UFS), among others.

The external memory interface 122 may be used to connect an external memory card (e.g., a Micro SD card) to extend the memory capability of the terminal 100. The external memory card communicates with the processor 110 through the external memory interface 122 to implement a data storage function. For example, the terminal 100 can save files such as images, music, videos, and the like in an external memory card through the external memory interface 122.

The camera 131 may be used to capture motion, still images, and the like. Typically, the camera 131 includes a lens and an image sensor. The optical image generated by the object through the lens is projected on the image sensor, and then is converted into an electric signal for subsequent processing. For example, the image sensor may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The image sensor converts the optical signal into an electrical signal and then transmits the electrical signal to the ISP to be converted into a digital image signal. It should be noted that the terminal 100 may include 1 or N cameras 131, where N is a positive integer greater than 1.

The display screen 132 may include a display panel for displaying a user interface. The display panel may be a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-o led, a quantum dot light-emitting diode (QLED), or the like. It should be noted that the terminal 100 may include 1 or M display screens 132, where M is a positive integer greater than 1. Illustratively, the terminal 100 may implement display functionality via a GPU, display screen 132, application processor, or the like. In the embodiment of the present invention, the terminal 100 may display a user interface of the smart home APP, such as a main interface of the smart home APP and a control interface of the smart home device, through the display screen 132, which will be described in detail later.

The sensor module 140 may include one or more sensors. For example, a touch sensor 140A, a gyroscope 140B, a direction sensor 140C, a fingerprint sensor 140D, a pressure sensor 140E, and the like. In some embodiments, the sensor module 140 may also include an ambient light sensor, a distance sensor, a proximity light sensor, a bone conduction sensor, a temperature sensor, and the like.

Here, the touch sensor 140A may also be referred to as a "touch panel". The touch sensor 140A may be disposed on the display screen 132, and the touch sensor 140A and the display screen 132 form a touch screen, which is also called a "touch screen". The touch sensor 140A is used to detect a touch operation applied thereto or nearby. The touch sensor 140A may pass the detected touch operation to an application processor to determine the touch event type. The terminal 100 may provide visual output related to touch operations, etc. through the display 132. In other embodiments, the touch sensor 140A may be disposed on a surface of the terminal 100 at a different location than the display 132.

Gyroscope 140B may be used to determine the motion pose of terminal 100. In some embodiments, the angular velocity of terminal 100 about three axes (i.e., the x, y, and z axes) may be determined by gyroscope 140B. The gyroscope 140B may be used for photographing anti-shake. Illustratively, when the shutter is pressed, the gyroscope 140B detects a shaking angle of the user terminal 100, calculates a distance to be compensated for by the lens module according to the shaking angle, and allows the lens to counteract shaking of the terminal 100 through a reverse movement, thereby achieving anti-shaking. The gyro sensor 140B may also be used for navigation, body sensing game scenes.

The orientation sensor 140C may be used to determine orientation information, such as an orientation angle and/or a tilt angle, of the terminal 100. For example, the direction sensor 140C may include a magnetic field sensor, a gravity sensor, an acceleration sensor, and the like, wherein a direction angle refers to a rotation angle of the electronic device with respect to a set direction in a horizontal plane, and an inclination angle refers to an angle at which the electronic device is tilted with respect to the horizontal plane. If the natural coordinate system of the electronic device is used, the direction angle can be understood as the angle of rotation of the electronic device around the z-axis, and the tilt angle can be understood as the angle of change generated when the electronic device is tilted around the x-axis, and the specific explanation of the direction angle and/or the tilt angle will be explained in detail in the following embodiments. In some embodiments, the orientation angle of the terminal 100 may be determined by a magnetic field sensor, and the tilt angle of the terminal 100 may be determined by a gravity sensor.

The fingerprint sensor 140D is used to capture a fingerprint. The terminal 100 can implement fingerprint unlocking, access to an application lock, fingerprint photographing, fingerprint incoming call answering, etc. using the collected fingerprint characteristics.

The pressure sensor 140E is used for sensing a pressure signal, and can convert the pressure signal into an electrical signal. For example, the pressure sensor 140E may be disposed on the display screen 132. The touch operations which act on the same touch position but have different touch operation intensities can correspond to different operation instructions.

The keys 151 may include a power-on key, a volume key, and the like. The keys 151 may be mechanical keys or touch keys. The terminal 100 may receive a key input, and generate a key signal input related to user setting and function control of the terminal 100.

The USB interface 152 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 152 may be used to connect a charger to charge the terminal 100, and may also be used to transmit data between the terminal 100 and peripheral devices. And the earphone can also be used for connecting an earphone and playing audio through the earphone. For example, the USB interface 152 may be used to connect other devices, such as AR devices, computers, and the like, in addition to being a headset interface.

The charging management module 160 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 160 may receive charging input from a wired charger via the USB interface 152. In some wireless charging embodiments, the charging management module 160 may receive a wireless charging input through a wireless charging coil of the terminal 100. The charging management module 160 may also supply power to the terminal 100 through the power management module 161 while charging the battery 162.

The power management module 161 is used to connect the battery 162, the charging management module 160 and the processor 110. The power management module 161 receives input from the battery 162 and/or the charging management module 160, and supplies power to the processor 110, the internal memory 121, the display 132, the camera 131, and the like. The power management module 161 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In other embodiments, the power management module 161 may also be disposed in the processor 110. In other embodiments, the power management module 161 and the charging management module 160 may be disposed in the same device.

The mobile communication module 171 may provide a solution including wireless communication of 2G/3G/4G/5G, etc. applied to the terminal 100. The mobile communication module 171 may include a filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 171 can receive the electromagnetic wave signal from the antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic wave signal, and transmit the electromagnetic wave signal to the modem processor for demodulation. The mobile communication module 171 can also amplify the signal modulated by the modem processor, and convert the signal into an electromagnetic wave signal through the antenna 1 to radiate the electromagnetic wave signal. In some embodiments, at least some of the functional modules of the mobile communication module 171 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 171 may be disposed in the same device as at least some of the modules of the processor 110. For example, the mobile communication module 171 may transmit voice to other devices and may also receive voice transmitted by other devices.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to speakers, headphones, etc.) or displays images or video through the display screen 132. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 171 or other functional modules, independent of the processor 110.

The wireless communication module 172 may provide solutions for wireless communication applied to the user terminal 100, including WLAN (e.g., Wi-Fi network), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 172 may be one or more devices integrating at least one communication processing module. The wireless communication module 172 receives an electromagnetic wave signal via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 172 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into an electromagnetic wave signal through the antenna 2 to radiate the signal. In some embodiments, the terminal 100 may connect to a router through the wireless communication module 172 to access a Wi-Fi network.

In some embodiments, the antenna 1 of the terminal 100 is coupled to the mobile communication module 171 and the antenna 2 is coupled to the wireless communication module 172 so that the terminal 100 can communicate with other devices. Specifically, the mobile communication module 171 may communicate with other devices through the antenna 1, and the wireless communication module 172 may communicate with other devices through the antenna 2. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (TD-SCDMA), Long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

In this embodiment, the terminal 100 may also be connected to the smart home device through the mobile communication module 171 or the wireless communication module 172 based on wireless signal transmission. For example, the terminal 100 sends an input operation based on a wireless signal form to the smart home device through the mobile communication module 171 or the wireless communication module 172; alternatively, the terminal 100 receives status data or the like based on a wireless signal form transmitted by the smart home device through the mobile communication module 171 or the wireless communication module 172, which will be described later.

It should be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only an exemplary illustration, and does not limit the structure of the terminal 100. In other embodiments of the present application, the terminal 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments. It should be understood that the hardware configuration shown in fig. 2 is only one example. A terminal of an embodiment of the application may have more or fewer components than shown, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The following describes in detail a method for selecting smart home devices according to an embodiment of the present application, with reference to the terminal shown in fig. 2 as an example, and with reference to the accompanying drawings. Hereinafter, the plurality referred to in the embodiments of the present application means two or more. It should be noted that, in the description of the embodiments of the present application, the terms "first", "second", and the like are used for distinguishing the description, and are not to be construed as indicating or implying relative importance or order.

The terminology used in the following examples is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of this application and the appended claims, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, such as "one or more", unless the context clearly indicates otherwise. It should also be understood that in the embodiments of the present application, "one or more" means one, two, or more than two; "and/or" describes the association relationship of the associated objects, indicating that three relationships may exist; for example, a and/or B, may represent: a alone, both A and B, and B alone, where A, B may be singular or plural. The character "is a relationship generally indicating that the former and latter associated objects are an" or ".

Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.

At present, the control for the smart home devices is realized by displaying a human-computer interaction interface provided by the smart home APP through the terminal 100. The terminal 100 displays a main interface, such as the first user interface 200 shown in FIG. 3, on the display screen 132. Where the user interface 200 may include a status bar 201, time and weather gadgets 202, icons for a plurality of applications (e.g., smart home icons 203), and the like. The status bar 201 may include the name of the operator (china mobile), time and remaining power. After the terminal detects a first operation (e.g., a touch operation) of a finger (or a touch pen, etc.) of a user on the "smart home" icon 203, in response to the first operation, a second user interface 210 is displayed on the display screen 132, where the second user interface 210 is one of the human-computer interaction interfaces provided by the smart home APP, and is used for the user to select a target smart home device to be controlled, and enter a control interface of the target smart home device to be controlled. The second user interface 210 includes icons with multiple functions, for example, icons including multiple room icons and multiple smart home devices, for example, icons of 3 rooms such as a bedroom, a study room, and a living room shown in fig. 3, and icons of 6 smart home devices such as a smart photographing lamp, a smart fragrance lamp, an air purifier, an infrared remote controller, a router, and a smart speaker.

With the increase of the number of home devices in the home of the user, in order to facilitate the user to select a target smart home device to be controlled, generally, a classification of rooms may be added to the APP, such as a main bed, a study room, and a living room shown in the second user interface 210, and the smart home device may also be named in the APP, so as to distinguish the smart home device according to a room to which the smart home device belongs, or distinguish the smart home device by different names. However, the process of searching for the target smart home device by the user is still too cumbersome, for example, the terminal responds to a second operation of the user on a room to which the target smart home device belongs, the second operation is a touch operation for the "living room" icon, a third user interface 220 is displayed on the display screen 132, and the icon of the smart home device in the "living room" room is displayed in the third user interface 220: an icon of the air purifier and an icon of the infrared remote controller, the third user display interface 220 may further display a return button 221 and a setting button 222, the terminal may return to the second user interface 210 in response to an operation of the return button 221 by the user, and the user terminal may display the setting interface in response to an operation of the setting button 222. The terminal then responds to a third operation of the target smart home device by the user, for example, the third operation is a touch operation aiming at an icon of an air purifier, a fourth user interface 230 is displayed on the display screen 132, the fourth user interface 230 being a control interface of the smart home device (air purifier), the fourth user interface 230 including an icon 233 of the air purifier, a status bar 234 of the air purifier, and a function bar 235 of the air purifier, the status bar 234 of the air purifier includes an on status of the air purifier (in fig. 2, the on status), an air quality (in fig. 2, the air quality is excellent, and the PM2.5 value is 34), and an off button of the air purifier, and the function bar 235 of the air purifier includes function modes of the air purifier, specifically including function modes of an automatic mode, a sleep mode (in fig. 2, the sleep mode is an on status), a wind speed adjustment, a timing setting, and the like.

Therefore, a user needs to perform multiple operations in the process of selecting the intelligent home device to enter the control interface of the intelligent home device, the operation is complicated, and the problem that the user cannot select the icon corresponding to the intelligent home device or select the icon incorrectly for other users who do not participate in the classification process or the naming process regardless of classifying the room to which the target intelligent home device belongs or naming the intelligent home device is solved. Therefore, in the existing process of selecting the target smart home devices, the process of selecting the icons corresponding to the smart home devices by the user is complicated, the confusion of user selection is easily caused, and the user experience is reduced.

In order to solve the above technical problem, in the method for selecting the smart home devices provided in this embodiment of the application, the terminal 100 may point to the target smart home device under the operation of the user, that is, the user controls the terminal 100 to point to the target smart home device that the terminal wants to control, the terminal 100 may automatically identify the pointed target smart home device according to the pointing information, and display a control interface of the pointed target smart home device on the display screen 132, thereby simplifying a process in which the user manually searches for the control interface of the target smart home device, achieving quick selection of the target smart home device, avoiding confusion and inconvenience in selecting the target smart home device by the user, and improving user experience. The pointing direction can be understood as the direction from which the direction sensor 140C of the terminal 100 collects the signal, and the pointing direction will be illustrated in the description of the following drawings.

For example, if the smart home device in the smart home environment includes a controller purifier and a smart sound box, as shown in fig. 4, if the target smart home device pointed by the terminal 100 is an air purifier, a control interface 230 of the air purifier is automatically displayed on the display screen 132 of the terminal 100. As shown in fig. 5, if the target smart home device pointed by the terminal 100 is a smart speaker, a control interface 240 of the smart speaker is automatically displayed on the display screen 132 of the terminal 100, where the control interface 240 of the smart speaker includes an icon 243 of the smart speaker, a status bar 244 of the smart speaker, and a function bar 245 of the smart speaker, where the status bar 244 of the smart speaker includes an on state of the smart speaker (an on state in fig. 5), a currently executed function (music is being played in fig. 5), and a close button of the smart speaker, and the function bar 245 of the smart speaker includes an executable function of the smart speaker, which specifically includes: the functions of making a call, controlling the smart home, playing music, setting voice instructions and the like.

Optionally, the terminal 100 may implement quick selection of a target smart home device by pointing to the target smart home device to be controlled when any user interface in the smart home APP is opened, so as to avoid misoperation of the user when the user holds the terminal 100 in motion in the smart home environment, and further improve user experience.

In some embodiments, after the terminal 100 is pointed at an air purifier in the living room, the display interface of the terminal 100 may jump directly from the second user interface 210 shown in fig. 3 to the control interface 230 of the air purifier, as shown in fig. 6 in particular.

In other embodiments, after the terminal 100 points at the air purifier in the living room, a prompt message indicating whether to control the air purifier may be displayed on the basis of the second user interface 210 shown in fig. 2, as shown in fig. 7, so that the user can confirm whether the air purifier is the home device that the user wants to select to control, and the prompt message in fig. 7 indicates whether you want to control the air purifier, and provides the user with two options of YES (YES) and NO (NO). If it is recognized that the user selects "YES", the terminal 100 confirms that the confirmation information of the user is received, and the terminal determines that the air purifier is the smart home device that the user wants to select to control, enters the control interface 230 of the air purifier, and displays the smart home device.

In the smart home environment shown in fig. 1, any smart home device, terminal, and router may determine a target smart home device to which the terminal 100 points. That is, the process of determining the smart home devices to which the terminal 100 is directed may be implemented by the terminal 100, a router, or any smart home devices that are controlled. Here, the implementation of the process of determining the smart home device pointed by the terminal 100 is generally referred to as an electronic device. Specifically, the electronic device (including one of the smart home devices, the terminal, the router, and the like) may calculate a direction pointed by the terminal 100 according to the posture information of the terminal 100, and calculate a target smart home device pointed by the terminal 100 according to the pointed direction, so as to realize quick selection and display of a control interface of the target smart home device.

It can be understood that, in the embodiment of the present application, the electronic device may be a terminal, an intelligent home device (e.g., an intelligent television, an intelligent sound box, etc.), or may also be a third-party device such as a router accessed by the terminal and/or the intelligent home device.

For example, as shown in fig. 8, a schematic diagram of an intelligent home environment provided in an embodiment of the present application is shown, where the intelligent home environment includes an intelligent home device (such as an intelligent home device 1 and an intelligent home device 2), and the intelligent home environment further includes a terminal 100, and the terminal 100 may be installed with an intelligent home APP, so as to control various intelligent home devices in a home through the intelligent home APP. The smart home devices and the terminal 100 may access the smart home control system by accessing the network of the smart home environment, where the network access modes commonly used in the smart home environment include Wi-Fi, ZigBee, and the like.

After the smart home device and the terminal are accessed to the network, the smart home device and the terminal can acquire their own access information, for example, the access information includes a network access mode, a communication address (e.g., an IP address), and the access information may further include an access signal strength indication (RSSI) parameter. After the smart home devices and the terminals access the network of the smart home environment, data interaction can be performed between the smart home devices and the terminals to control the home devices by the terminals, as shown in fig. 8, after the technical scheme provided by the embodiment of the invention is applied, the target smart home device pointed by the terminal is the smart home device 2, and the terminal or any smart home device can determine that the user wants to control the smart home device 2 through the terminal.

For another example, as shown in fig. 9, a schematic view of another smart home environment provided in the embodiment of the present application is provided, where the smart home environment includes smart home devices (e.g., smart home device 1 and smart home device 2), a terminal and a router, and taking an electronic device as an example, an intelligent home APP may be installed on the terminal, so as to control various smart home devices in a home through the smart home APP. The intelligent home equipment and the terminal are accessed to a Wi-Fi network in the intelligent home environment through the access router, and data interaction can be carried out among the intelligent home equipment, the terminal and the router through a Wi-Fi communication protocol. The smart home devices and the terminals may send Wi-Fi RSSI parameters to the router after accessing the Wi-Fi network, for example, the smart home devices and the terminals may send Wi-Fi RSSI parameters to the router according to a set time interval, the smart home devices and the terminals may also send Wi-Fi RSSI parameters to the router after receiving a trigger operation, and the trigger operation is used to trigger the smart home devices and/or the terminals to send the Wi-Fi RSSI parameters.

The method for selecting the smart home device according to the embodiment of the present application is described below by taking an electronic device as a terminal and a router as examples. For the case that the electronic device is an intelligent home device or other third-party device, the process of selecting the intelligent home device is basically similar, and therefore the process of selecting the intelligent home device in the scene of the intelligent home device or other third-party device is not repeatedly described. In addition, the following description takes an example in which the smart home devices and the terminals access the routers in the smart home environment through the Wi-Fi network, and other network access methods (such as ZigBee) are similar to the access process under Wi-Fi, and are not described herein again. The terminal and the intelligent household equipment can be connected to the same router or different routers.

In the embodiment of the application, a coordinate system of the smart home environment may be constructed, and an electronic map based on the coordinate system of the smart home environment may be constructed, and since the installation positions of the smart home devices and the routers are generally not changed after the smart home devices and the routers are installed, the position coordinates of the smart home devices and the routers in the coordinate system of the smart home environment shown in fig. 9 are generally not changed. Therefore, the position coordinates of the intelligent household equipment and the router can be stored in the electronic map based on the coordinate system of the intelligent household environment. The process of constructing the coordinate system of the smart home environment and the process of constructing the electronic map based on the coordinate system of the smart home environment can be completed in an initialization process in the selection process of the smart home device.

In addition, a natural coordinate system may be further constructed, and for convenience of description, the natural coordinate system is hereinafter referred to as a first coordinate system, a direction in which the terminal points under the first coordinate system is referred to as a first direction, the smart home environment coordinate system is referred to as a second coordinate system, and a direction in which the terminal points under the second coordinate system is referred to as a second direction, where the first coordinate system and the second coordinate system may overlap or may not overlap. For example, the first coordinate system is a coordinate system constructed according to a natural direction, specifically a coordinate system constructed according to a natural direction such as south-east-west-north and a direction of an included angle with a horizontal plane, and the second coordinate system is a coordinate system generally constructed according to a relative position relationship between the smart home devices in the smart home environment, specifically a relative position relationship such as front-back, left-right, up-down, and the like, rather than being constructed according to a natural direction, and is not dependent on a natural direction, so that the first coordinate system and the second coordinate system are not overlapped, and a conversion relationship exists between the first coordinate system and the second coordinate system.

In the initialization process, besides the position coordinates of the intelligent household equipment and the router, the Wi-Fi RSSI parameters of the intelligent household equipment when the intelligent household equipment is connected with the router at the position can be determined, the positions of the intelligent household equipment are different, and the corresponding Wi-Fi RSSI values are also different. It can be understood that the Wi-Fi RSSI parameter of the intelligent household equipment connecting router can be stored in the electronic map.

The electronic device may store the electronic map of the smart home environment, where the electronic device stores the position coordinates of each smart home device and the position coordinates of the router, and the position coordinates of each smart home device and the position coordinates of the router are coordinates in a smart home environment coordinate system. Optionally, according to the position coordinates of each smart home device and the position coordinates of the router, the relative position relationship between the smart home device and the router in the electronic map may be determined.

It should be understood that the first direction is the same as the direction corresponding to the direction parameter (including the collected direction angle and/or the inclination angle) actually collected by the direction sensor 140C in the terminal, and the second direction may be different from the direction corresponding to the direction parameter actually collected by the direction sensor 140C in the terminal, wherein the direction corresponding to the direction parameter actually collected by the direction sensor 140C in the terminal may be calculated according to the direction angle and/or the inclination angle actually collected by the direction sensor 140C.

In the first embodiment, taking the electronic device as an example, the smart home device and the terminal are both connected to the router.

If the first coordinate system and the second coordinate system are not overlapped, since the second direction in the second coordinate system may be different from the direction corresponding to the direction parameter actually acquired by the direction sensor 140C in the terminal, the terminal 100 may determine the conversion relationship between the first coordinate system and the second coordinate system before selecting the smart home device. In the subsequent process of selecting the smart home devices, the terminal 100 may automatically identify the target smart home device that the user wants to control based on the conversion relationship and the direction parameters actually acquired by the direction sensor 140C in the terminal 100.

The process of determining the transformation relationship between the first coordinate system and the second coordinate system by the terminal 100 may be as shown in fig. 10, and specifically includes the following steps:

step 1001: the terminal 100 selects a reference device from the smart home devices and the router, and determines the position coordinates of the selected reference devices stored in the electronic map in the second coordinate system.

For example, the terminal 100 may select at least three reference devices by one of the following manners:

1. the user manually selects, for example, the terminal 100 displays a selection interface of the reference device on the display screen 132, where identification information (such as IP address information, MAC address information, name information, or icon information) of each smart home device and router is displayed in the selection interface, the terminal device 100 detects a fourth operation of the user, determines that the selected reference device is the smart home device 1 if the fourth operation is an operation for the identification information of the smart home device 1, and determines that the selected reference device is the router if the fourth operation is an operation for the identification information of the router.

2. The terminal 100 selects arbitrarily, that is, the terminal 100 selects one device from each smart home device and router as a reference device.

3. Target identification information of a reference device is pre-stored in the terminal 100, the terminal 100 determines identification information identical to the target identification information in the identification information of the smart home device and the router, and a device corresponding to the identification information identical to the target identification information is used as the reference device.

Illustratively, the terminal 100 selects at least three reference devices to realize more accurate calculation of the position coordinates of the terminal 100 according to the position coordinates of the at least three reference devices. For example, the selected reference devices include a router, an intelligent home device 1 and an intelligent home device 2. Here, it is assumed that the position coordinates corresponding to the router in the electronic map of the smart home environment are (X1, Y1, Z1), the position coordinates corresponding to the smart home device 1 in the electronic map of the smart home environment are (X2, Y2, Z2), and the position coordinates corresponding to the smart home device 2 in the electronic map of the smart home environment are (X3, Y3, Z3).

Step 1002: the terminal 100 directs to a router under the operation of a user, the terminal 100 collects Wi-Fi RSSI parameters of received Wi-Fi signals transmitted by the selected at least three smart home devices (e.g., the router, the smart home device 1, and the smart home device 2), respectively, and the direction sensor 140C in the terminal 100 collects first direction parameters (e.g., a direction angle a and a tilt angle B shown in fig. 9).

For example, the terminal 100 may receive a Wi-Fi signal sent by the router, and since the terminal 100 may be linked with the smart home devices, the terminal 100 may also receive Wi-Fi signals sent by the smart home devices 1 and 2. Therefore, the Wi-Fi RSSI parameters collected by the terminal 100 include a first Wi-Fi RSSI parameter of a Wi-Fi signal sent by the collected router, a second Wi-Fi RSSI parameter of a Wi-Fi signal sent by the collected smart home device 1, and a third Wi-Fi RSSI parameter of a Wi-Fi signal sent by the collected smart home device 2.

When the user operates the terminal 100 to point at the router, the pointing direction can be understood as the direction in which the direction sensor 140C of the terminal 100 collects the signal, that is, the direction in which the direction sensor 140C of the terminal 100 collects the signal is the direction in which the terminal 100 points to the router, that is, the direction parameters (including the direction angle and the tilt angle) collected by the direction sensor of the terminal 100, can be used to indicate the direction in which the terminal 100 points to the router, if the direction from which the direction sensor 140C collects the signal, i.e., the pointing motion of the user operating the terminal 100, is at the head of the terminal 100 (the end of the terminal 100 having the earpiece), it can be understood that the head of the terminal 100 points to the router, if the direction from which the direction sensor 140C collects the signal is at the rear of the terminal 100 (the end of the terminal 100 having the microphone), it is understood that the head of the terminal 100 points to the router, and of course, the direction of the signal collected by the direction sensor 140C may be in other parts of the terminal 100.

For example, when recognizing a triggering behavior of a user, the terminal 100 collects Wi-Fi RSSI parameters of Wi-Fi signals sent by each selected smart home device, where the triggering behavior of the user may be an opening operation of the user for the smart home APP, or a selection operation of a specific control, and the specific control may be located in a user interface of the smart home APP.

Step 1003: the terminal 100 estimates a first distance between the terminal 100 and the router according to the collected first Wi-Fi RSSI parameter of the Wi-Fi signal sent by the router, estimates a second distance between the terminal 100 and the intelligent household equipment 1 according to the collected second Wi-Fi RSSI parameter of the Wi-Fi signal sent by the intelligent household equipment 1, and estimates a third distance between the terminal 100 and the intelligent household equipment 2 according to the collected third Wi-Fi RSSI parameter of the Wi-Fi signal sent by the intelligent household equipment 2.

Step 1004: the terminal 100 estimates the corresponding position coordinates of the terminal 100 in the electronic map of the smart home environment according to the estimated first distance, second distance and third distance and the corresponding position coordinates of the router, the smart home device 1 and the smart home device 2 in the electronic map of the smart home environment (X4, Y4, Z4).

Step 1005: the terminal 100 determines a first direction in which the terminal 100 points to the router according to the first direction parameter; the terminal 100 calculates a second direction in which the terminal 100 points under the second coordinate system based on the first position coordinates (X1, Y1, Z1) of the router and the second position coordinates (X4, Y4, Z4) of the terminal 100.

The first direction is a direction pointed by the terminal 100 in a first coordinate system, and the second direction 100 is a direction pointed by the terminal in a second coordinate system. Specifically, the terminal 100 may be based on a first router in an electronic map of the smart home environmentCalculating the direction vector of the terminal 100 pointing to the router under the second coordinate system by using the position coordinates (X1, Y1, Z1) and the second position coordinates (X4, Y4, Z4) of the terminal 100 in the electronic map of the intelligent household environment

And calculate

First unit vector of

Then

Indicating a second direction in which the terminal 100 points to the router in a second coordinate system.

The terminal 100 determines a second unit vector of the terminal 100 according to the direction angle A and the tilt angle B in the first direction parameter

Representing a first orientation of the terminal 100 in a first coordinate system.

Step 1006: the terminal 100 determines a conversion relationship between the first direction and the second direction according to the first direction pointing to the router in the first coordinate system and the second direction pointing to the router in the second coordinate system, and the conversion relationship may be expressed by a transformation matrix, for example, that is

And the transformation matrix R is satisfied

It is understood that the terminal 100 selects at least three reference devices to mainly determine the position coordinates of the terminal 100 in the second coordinate system, and in the process of actually determining the transformation relationship, if the position coordinates of the terminal 100 in the second coordinate system are determined in advance, the determination of the transformation relationship can be implemented by actually selecting one reference device by the terminal 100, and then step 1003 and step 1004 may be omitted.

Based on the conversion relationship determined in fig. 10, a process of the terminal 100 determining the smart home device pointed by the terminal 100 may be as shown in fig. 11, and includes the following steps:

step 1101: the terminal 100 points to a target smart home device to be controlled under the operation of the user, as shown in fig. 12, here, the terminal 100 points to the smart home device 1 to be controlled is taken as an example for explanation. The terminal 100 collects a fourth Wi-Fi RSSI parameter of the Wi-Fi signal transmitted by the router, collects a fifth Wi-Fi RSSI parameter of the Wi-Fi signal transmitted by the smart home device 1, and collects a sixth Wi-Fi RSSI parameter of the Wi-Fi signal transmitted by the smart home device 2. And the direction sensor 140C in the terminal 100 may collect a second direction parameter (including a direction angle a 'and an inclination angle B') when the terminal 100 points to the target smart home device 1 that is desired to be controlled. It is understood that the direction angle a 'and the tilt angle B' of the second direction parameter are the direction angle and the tilt angle B of fig. 12 when the terminal 100 points to the target smart home device 1, and not the direction angle a and the tilt angle B of the first direction parameter when the terminal 100 points to the router.

It is understood that, in the process of selecting the smart home devices, the pointing action of the user operating terminal 100 should be consistent with or the same as the pointing action in step 1002, that is, if the head of the user operating terminal 100 points to the router in step 1002, the head of the user operating terminal 100 points to the target smart home device in this step, and if the tail of the user operating terminal 100 points to the router in step 1002, the tail of the user operating terminal 100 points to the target smart home device in this step, and so on.

Step 1102: the terminal 100 determines that the terminal 100 points at the smart home devices 1 to be controlled in the first coordinate system according to the direction angle a 'and the inclination angle B' in the second direction parameterThe first direction of the smart home device 1. According to the first direction pointing to the target smart home device 1 in the first coordinate system

And the above-mentioned learned conversion relation

Determining a second direction in which the terminal 100 points to the smart home device 1 in the smart home environment

Step 1103: the terminal 100 estimates a fourth distance from the terminal 100 to the router according to a fourth Wi-Fi RSSI parameter of the Wi-Fi signal transmitted by the router, estimates a fifth distance from the terminal 100 to the smart home device 1 according to a fifth Wi-Fi RSSI parameter of the Wi-Fi signal transmitted by the smart home device 1, and estimates a sixth distance from the terminal 100 to the smart home device 2 according to a sixth Wi-Fi RSSI parameter of the Wi-Fi signal transmitted by the smart home device 2.

Step 1104: the terminal 100 estimates the position coordinates of the terminal 100 in the second coordinate system (X4, Y4, Z4) according to the fourth distance, the fifth distance and the sixth distance estimated above, as well as the position coordinates of the router in the electronic map of the smart home environment being (X1, Y1, Z1), the position coordinates of the smart home device 1 in the electronic map of the smart home environment being (X2, Y2, Z2), and the position coordinates of the smart home device 2 in the electronic map of the smart home environment being (X3, Y3, Z3).

The execution sequence of step 1002 and step 1003 may be to execute step 1002 and then execute step 1003, may be to execute step 1003 and then execute step 1002, or may be to execute step 1002 and step 1003 simultaneously.

Step 1105: the terminal 100 determines the position coordinates (X4, Y4, Z4) between the position coordinates of the smart home device 1 and the position coordinates (X4, Y4, Z4) of the terminal 100 in the second coordinate system according to the position coordinates (X2, Y2, Z2) of the smart home device 1 in the second coordinate systemThree unit vector

And determining a fourth unit vector between the position coordinates of the smart home devices 2 and the position coordinates (X4, Y4, Z4) of the terminal 100 in the second coordinate system according to the position coordinates (X3, Y3, Z3) of the smart home devices 2 in the second coordinate system

The terminal 100 determines the calculated third unit vectors

The terminal 100 determined in step 1102 points to the second direction of the smart home device 1 in the smart home environment

First degree of matching therebetween, and determining the fourth unit vector calculated as described above

A second degree of match therebetween. If the result of the vector dot product is taken as the degree of match, i.e. calculation

As a first degree of match and calculation

As a second degree of matching.

The terminal 100 determines the highest matching degree value in the first matching degree and the second matching degree, and if the first matching degree is higher than the second matching degree, it is determined that the smart home device 1 corresponding to the first matching degree is the target smart home device pointed by the terminal 100.

Alternatively, in an alternative arrangement parallel to step 1105, as referred to as step 1105' (not shown in fig. 11), the terminal 100 calculates the third unit vector according to the position coordinates (X4, Y4, Z4) of the terminal 100 in the second coordinate system and the calculated third unit vector

Determining that the terminal 100 is in the second direction

A corresponding straight line.

The terminal determines the distance D1 from the intelligent household equipment 1 to the straight line, and determines the distance D2 from the intelligent household equipment 2 to the straight line.

The terminal determines the shortest distance value from the distances D1 and D2, and assuming that the distance D1 is shorter than the distance D2, the smart home devices 1 corresponding to the distance D1 are determined as the target smart home devices pointed by the terminal 100, wherein the shorter the distance is, the higher the matching degree is, and the longer the distance is, the lower the matching degree is.

And if the first coordinate system is overlapped with the second coordinate system, the coordinate system of the intelligent household environment is the first coordinate system.

In this case, the terminal 100 does not need to determine the conversion relationship of the first coordinate system and the second coordinate system.

The position coordinates of the intelligent household equipment and the router in the electronic map are position coordinates in a first coordinate system.

In this case, the smart home device selection process is similar to the flowchart shown in fig. 11, except that: when the terminal 100 executes step 1102, the determined first direction is directly determined as a second direction in which the terminal 100 points to the target smart home device 1 in the smart home environment.

And in the second embodiment, the electronic equipment is a router, and the intelligent household equipment and the terminal are both accessed to the router.

When the router is the execution main body, the process is similar to the process shown when the terminal is the execution main body, and the difference is that: the parameters required in the router calculation process are transmitted by the terminal 100.

Specifically, when the router executes step 1002, the router receives a Wi-Fi RSSI parameter and a first direction parameter sent by the terminal 100, where the terminal 100 directs to the router under the operation of a user, the terminal 100 collects the received Wi-Fi RSSI parameters of Wi-Fi signals transmitted by at least three smart home devices (e.g., the router, the smart home device 1, and the smart home device 2), and the direction sensor 140C in the terminal 100 collects the first direction parameter (e.g., a direction angle a and a tilt angle B shown in fig. 9).

When the router executes step 1101, the router receives a Wi-Fi RSSI parameter and a second direction parameter sent by the terminal 100, the terminal 100 points to a target smart home device to be controlled under the operation of a user, the terminal 100 collects the Wi-Fi RSSI parameter of a received Wi-Fi signal, and the direction sensor 140C in the terminal 100 collects the second direction parameter (including a direction angle a 'and a tilt angle B'), where the Wi-Fi RSSI parameter of the received Wi-Fi signal includes a fourth Wi-Fi RSSI parameter of the Wi-Fi signal transmitted by the router, a fifth Wi-Fi RSSI parameter of the Wi-Fi signal transmitted by the smart home device 1, and a sixth Wi-Fi RSSI parameter of the Wi-Fi signal transmitted by the smart home device 2.

In addition, it can be understood that, after determining the target smart home device, the router sends the information of the target smart home device to the terminal 100, so that the terminal 100 determines the target smart home device and displays the control interface of the target smart home device on the display screen 132.

With reference to the foregoing embodiments and the accompanying drawings, an embodiment of the present application provides an intelligent home device selection method, where the method is applied to an intelligent home environment, where the intelligent home environment includes a plurality of intelligent home devices and a terminal for controlling each intelligent home device, and the method may be implemented in an electronic device, where the electronic device includes a third-party device such as a terminal, an intelligent home device (e.g., an intelligent television, an intelligent sound box), and a router to which the terminal and/or the intelligent home device access. It is understood that the router can also be regarded as a kind of smart home device.

As shown in fig. 13, a flow diagram of a home device selection method provided in the embodiment of the present application includes the following steps:

step 1301, determining target intelligent home equipment pointed by the terminal, wherein the pointing direction refers to a direction in which a direction sensor of the terminal acquires a signal, and the target intelligent home equipment is any one of the intelligent home equipment.

In an example, determining a target smart home device to which the terminal is pointing includes:

determining a first vector under a first coordinate system when the terminal points at the target intelligent household equipment according to the direction angle and the inclination angle of the terminal when the terminal points at the target intelligent household equipment, wherein the first coordinate system is a natural coordinate system;

the terminal converts the first vector into a second vector under a second coordinate system according to a preset conversion relation, wherein the second coordinate system is an intelligent home environment coordinate system, and the conversion relation is the conversion relation between the first coordinate system and the second coordinate system;

determining the position coordinates of the terminal in the second coordinate system according to the strength information of the signals transmitted by the intelligent home devices received when the terminal points to the target intelligent home devices and the position coordinates of the intelligent home devices in the second coordinate system;

respectively calculating a third vector of the terminal and each intelligent household device in a second coordinate system according to the position coordinates of each intelligent household device in the second coordinate system and the position coordinates of the terminal in the second coordinate system; matching each third vector with the second vector, and determining a target third vector with the highest matching degree; determining the intelligent household equipment corresponding to the target third vector with the highest matching degree as target intelligent household equipment; or determining a straight line in a second coordinate system when the terminal points to the target intelligent household equipment according to the position coordinate and the second vector of the terminal in the second coordinate system; respectively calculating the distance between each intelligent household device and the straight line according to the position coordinates of each intelligent household device in the second coordinate system, and determining the target position coordinate with the shortest distance; and determining the intelligent household equipment corresponding to the target position coordinate with the shortest distance as the target intelligent household.

Optionally, the transformation relationship between the first coordinate system and the second coordinate system is determined according to the following process:

selecting at least three pieces of reference equipment from the intelligent household equipment;

determining a fourth vector in a first coordinate system when the terminal equipment points at first reference equipment according to a direction angle and an inclination angle acquired by a direction sensor of the terminal when the terminal equipment points at the first reference equipment, wherein the first reference equipment is one of the reference equipment;

determining the position coordinates of the terminal in the second coordinate system according to the strength information of the signals transmitted by the reference devices received when the terminal points to the first reference device and the position coordinates of the reference devices in the second coordinate system;

calculating a fifth vector in a second coordinate system when the terminal points to the first reference device according to the position coordinate of the first reference device in the second coordinate system and the position coordinate of the terminal in the second coordinate system;

and determining the conversion relation between the first coordinate system and the second coordinate system according to the fourth vector and the fifth vector.

Optionally, before determining the target smart home device pointed by the terminal, the method further includes:

and recognizing that the application program of the intelligent household equipment in the terminal is opened.

In an embodiment, calculating, according to the position coordinates of the smart home devices in the second coordinate system and the position coordinates of the terminal in the second coordinate system, a third vector of the terminal and each smart home device in the second coordinate system respectively includes:

and calculating a third vector of the terminal and any intelligent household equipment in the second coordinate system to be (X-X, Y-Y, Z-Z) according to the position coordinate (X, Y, Z) of any intelligent household equipment in the second coordinate system and the position coordinate (X, Y, Z) of the terminal in the second coordinate system.

In one embodiment, the terminal determines a vector of the terminal in a first coordinate system according to the direction angle and the inclination angle, and the method includes:

Optionally, selecting reference equipment from the smart home devices includes:

the terminal identifies reference equipment selected by a user in each intelligent household equipment; or

The terminal randomly selects reference equipment from the intelligent household equipment; or

The terminal selects preset reference equipment from the intelligent household equipment.

Optionally, if the non-terminal electronic device of the electronic device determines the target smart home device, the information of the target smart home device may also be sent to the terminal 100, and the terminal 100 directly displays the control interface of the target smart home device.

Step 1302, displaying a control interface of the target smart home device on a display screen of the terminal.

The specific implementation manner of the method shown in fig. 13 in the embodiment of the present application may be referred to the description of the related embodiment above.

The embodiments in the present application can be used in combination with each other, or can be used alone to achieve different technical effects.

In the embodiments provided in the present application, the method provided in the embodiments of the present application is described from the perspective of an electronic device as an execution subject. In order to implement the functions in the method provided by the embodiments of the present application, the electronic device may include a hardware structure and/or a software module, and the functions are implemented in the form of a hardware structure, a software module, or a hardware structure and a software module. Whether any of the above-described functions is implemented as a hardware structure, a software module, or a hardware structure plus a software module depends upon the particular application and design constraints imposed on the technical solution.

Based on the same concept, fig. 14 illustrates an electronic device 1400 provided in the present application. As an example, the electronic device 1400 comprises a transceiver module 1401 and a processing module 1402.

The electronic device performs the steps performed by the electronic device of fig. 4-13.

Based on the same concept, the application provides an electronic device. The electronic device includes at least one processor, a memory, and a transceiver. The processor is coupled with the memory and the transceiver, and the coupling in the embodiment of the present application is an indirect coupling or a communication connection between devices, units or modules, and may be an electrical, mechanical or other form for information interaction between the devices, units or modules. The connection medium among the transceiver, the processor and the memory is not limited in the embodiments of the present application. For example, in the embodiment of the present application, the memory, the processor, and the transceiver may be connected by a bus, and the bus may be divided into an address bus, a data bus, a control bus, and the like.

In particular, the memory is used to store program instructions.

The transceiver is used for receiving or transmitting data.

The processor is configured to invoke program instructions stored in the memory to cause the electronic device to perform the steps performed by the electronic device of fig. 4-13.

Based on the above embodiment, the application further provides an electronic device, and the electronic device is used for realizing the intelligent home device selection method in the above figures. Referring to fig. 15, the electronic device 1500 may include one or more processors 1510 and one or more memories (not shown in fig. 15), a display 1520, and an orientation sensor 1530, as well as one or more computer programs stored in the memories, the one or more computer programs including instructions;

the display screen 1520 for displaying a user interface;

the direction sensor 1530 is used for acquiring a direction angle and an inclination angle of the terminal under a natural coordinate system;

when invoked for execution by the one or more processors 1510, cause the terminal to perform various method embodiments that may be described above in fig. 4-13.

In the embodiments of the present application, the processor may be a general-purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and may implement or execute the methods, steps, and logic blocks disclosed in the embodiments of the present application. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of a method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software modules in a processor.

In the embodiment of the present application, the memory may be a nonvolatile memory, such as a Hard Disk Drive (HDD) or a solid-state drive (SSD), and may also be a volatile memory, for example, a random-access memory (RAM). The memory is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited to such. The memory in the embodiments of the present application may also be circuitry or any other device capable of performing a storage function for storing program instructions and/or data.

It should be understood that the electronic device may be used to implement the methods shown in fig. 4 to 13 according to the embodiments of the present application, and reference may be made to the above for related features, which are not described herein again.

Based on the above embodiments, the present application also provides a computer storage medium, in which a computer program is stored, and when the computer program is executed by a computer, the computer program causes the computer to execute the various method embodiments shown in fig. 4 to 13.

Also provided in embodiments of the present application is a computer program product comprising instructions which, when executed on a computer, cause the computer to perform the various method embodiments illustrated in fig. 4-13 above.

In the embodiments provided in the present application, the method provided in the embodiments of the present application is described from the perspective of an electronic device as an execution subject. In order to implement the functions in the method provided by the embodiments of the present application, the electronic device may include a hardware structure and/or a software module, and the functions are implemented in the form of a hardware structure, a software module, or a hardware structure and a software module. Whether such functionality is implemented as a hardware structure, a software module, or a combination of hardware and software modules depends upon the particular application and design constraints imposed on the computing arrangement.

The processors referred to in the various embodiments above may be general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules may be located in a Random Access Memory (RAM), a flash memory, a read-only memory (ROM), a programmable ROM, an electrically erasable programmable memory, a register, or other storage media that are well known in the art. The storage medium is located in a memory, and a processor reads instructions in the memory and combines hardware thereof to complete the steps of the method.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application shall be covered by the scope of the present application, and therefore the scope of the present application shall be subject to the protection scope of the claims.

Claims

1. The intelligent household equipment selection method is applied to an intelligent household environment, wherein the intelligent household environment comprises a plurality of intelligent household equipment and terminals for controlling the intelligent household equipment, and the method is characterized by comprising the following steps of:

determining target intelligent home equipment pointed by the terminal, wherein the pointing direction refers to the direction of a signal acquired by a direction sensor of the terminal, and the target intelligent home equipment is any one of the intelligent home equipment;

displaying a control interface of the target intelligent household equipment on a display screen of the terminal;

the method for determining the target intelligent household equipment pointed by the terminal comprises the following steps:

respectively calculating a third vector of the terminal and each intelligent household device in a second coordinate system according to the position coordinates of each intelligent household device in the second coordinate system and the position coordinates of the terminal in the second coordinate system;

matching each third vector with the second vector, and determining a target third vector with the highest matching degree;

and determining the intelligent household equipment corresponding to the target third vector with the highest matching degree as target intelligent household equipment.

2. The method of claim 1, wherein the transformation relationship of the first coordinate system and the second coordinate system is determined according to the following process:

3. The method according to claim 1 or 2, wherein before determining the target smart home device pointed to by the terminal, the method further comprises:

4. The method according to claim 1, wherein calculating a third vector of the terminal and each smart home device in the second coordinate system according to the position coordinates of the smart home devices in the second coordinate system and the position coordinates of the terminal in the second coordinate system respectively comprises:

5. The method of claim 1, 2 or 4, wherein the terminal determining the vector of the terminal in the first coordinate system according to the direction angle and the tilt angle comprises:

6. The method of claim 2, wherein selecting the reference device from among the smart home devices comprises:

7. A terminal, comprising: one or more processors and one or more memories, a display screen and an orientation sensor, and one or more computer programs stored in the memories, the one or more computer programs comprising instructions;

the display screen is used for displaying a user interface;

the instructions, when executed by the one or more processors, cause the terminal to perform the method of any of claims 1 to 6.

8. A chip, wherein the chip is coupled to a memory, such that the chip, when executed, invokes a computer program stored in the memory to implement the method of any of claims 1 to 6.

9. A computer storage medium, characterized in that the computer-readable storage medium comprises a computer program which, when run on the terminal, causes the terminal to perform the method according to any of claims 1 to 6.