WO2023045830A1 - Home appliance control method, related apparatus, and system - Google Patents

Home appliance control method, related apparatus, and system Download PDF

Info

Publication number
WO2023045830A1
WO2023045830A1 PCT/CN2022/119115 CN2022119115W WO2023045830A1 WO 2023045830 A1 WO2023045830 A1 WO 2023045830A1 CN 2022119115 W CN2022119115 W CN 2022119115W WO 2023045830 A1 WO2023045830 A1 WO 2023045830A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
mobile terminal
home
information
family
Prior art date
Application number
PCT/CN2022/119115
Other languages
French (fr)
Chinese (zh)
Inventor
华佳烽
任兵飞
叶晓贞
付天福
王成录
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023045830A1 publication Critical patent/WO2023045830A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G05B15/02—Systems controlled by a computer electric
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • the present application relates to the field of communication technologies, and in particular to a method for controlling home equipment, related devices and systems.
  • Smart home can also be called a smart home service platform.
  • Information technology combined with automatic control technology, effectively combines home life such as intelligent control of home equipment, home environment awareness, family health awareness, home safety awareness, information exchange, and consumer services to create a healthy, safe, comfortable, low-carbon, Convenient personalized home life.
  • the present application provides a method for controlling household equipment, a related device and a system.
  • Home devices can be controlled according to the user's association with the home space.
  • the user breaks the usage rules of the home device, he also needs to cooperate with other home devices to complete specified tasks.
  • the mobile terminal detects that the user is away from home, it can also control the home device to perform an operation corresponding to the event stored in the mobile terminal. So as to create a more convenient, healthy, low-carbon and harmonious smart home.
  • the present application provides a device control method, the method is applied to a communication system including a first device and a second device; the second device is located in a first area in a first space; the method includes: the The first device receives the first operation; the first device identifies the identity of the user inputting the first operation as the first user; the first device triggers the second device to start the first function; the first device receives the first function again A first operation; the first device identifies the identity of the user inputting the first operation as a second user; the first device refuses to trigger the second device to start the first function.
  • the present application provides a device control method, the method is applied to a communication system between a first device and a second device; the second device is located in a first area in a first space; the method includes: the first device A device receives a first operation, and the first operation is used to trigger the second device to start a first function; the first device identifies the identity of the user who inputs the first operation; the user has permission to control the first area In the case of a device, the first device triggers the second device to start the first function; if the user has no authority to control the device in the first area, the first device refuses to trigger the second device to start the a function.
  • the first device can set the user's control authority to the family device according to the relationship between the user and the family space, so as to ensure that family members can only use the family device within the scope of authority. It can also prevent people who do not have permission to use home devices from performing some dangerous operations or malicious operations. For example, in order to prevent the elderly or children from using dangerous electrical appliances, or family visitors from using private devices in the family, such as expensive insurance, etc., which will bring losses to the family.
  • the above-mentioned communication system further includes a third device; before the first device receives the first operation, the method further includes: the first device receives After the second operation, it is determined that the second device is located in the first area in the first space; or, the first device receives first information sent by the third device, and the first information indicates that the second device is located in the first area. The first region in the first space.
  • the mobile terminal can classify the association relationship between rooms and family members and the association relationship between rooms and home devices according to user operations, or the mobile terminal can classify the association relationship between rooms and family members and the relationship between rooms and family devices detected by other home devices.
  • the device association relationship automatically generates family members' permissions to control family devices.
  • the mobile terminal can also re-change the corresponding relationship between rooms and devices according to the user's manual operation. In this way, the mobile terminal can be implemented in a variety of ways, increasing the practicability of this solution, and increasing the accuracy of permission setting.
  • the first information also indicates the type of the first area; the type includes: bedroom, kitchen, study room, living room, bathroom, gym, and entertainment room.
  • the mobile terminal can finely divide the rooms included in the home space, so that the user can manage the devices in a certain room in a targeted manner.
  • the type of the first area is determined by the third device according to the recognized type of the second device.
  • the sweeping robot can obtain household equipment when cleaning the house, and judge the type of room containing these equipment according to the type of household equipment.
  • the second device includes the third device.
  • the second device is a household device; the third device is a cleaning robot.
  • the first device when the user has no authority to control the devices in the first area, the first device outputs first prompt information, and the first prompt information is used to remind the user that the second device does not control the startup Permissions for this first function.
  • the mobile terminal can inform the user that it is impossible to control the home device outside the authorized range, so as to avoid the user from repeatedly inputting control operations.
  • the communication system further includes a fourth device; when the user has no authority to control devices in the first area, the first device displays a first control; the first device detects that the The operation of the first control; the first device sends a first request to the fourth device, and the first request is used to request the user to obtain permission to control the first function of the second device; the first device receives The authorization message sent by the fourth device triggers the second device to start the first function.
  • the member when a family member such as a child does not have the authority to control a certain device, the member can send an authorization request to other family members such as the parent, and the parent can authorize the child when the parent ensures that the operation the child will perform is safe. In this way, the safety of family members can be guaranteed without affecting the use of family equipment.
  • the method further includes: the first device identifies again the identity of the user who input the first operation; When the authority controls the equipment in the first area, the first equipment triggers the second equipment to start the first function; when the user does not have the authority to control the equipment in the first area, the first equipment refuses to trigger The second device activates the first function.
  • the first device when the first device recognizes that the identity of the current user does not have the right to control the device for the first time, the first device can continue to authenticate the identity of the user. In this process, it is assumed that the current user has other family members such as parents. If you are accompanied by the side, you can request the parents to enter the identity information of the parents, so that you can continue to control the family device normally.
  • the method further includes one or more of the following: the first device determines that there are other users in the first space; Or, the first device determines that the distance between the user and the first space is smaller than the first value; or, the first device determines that the time for receiving the first operation is the user's non-working time; or, the first device determines that This first function serves to reduce household electricity consumption.
  • the mobile terminal can combine more factors to control the family equipment, and ensure the quality of family life in an all-round way on the basis of low carbon and health.
  • the method further includes: storing in the first device the control permissions of multiple users for devices in various areas in the first space.
  • the first space includes: family space and office space.
  • the device control method provided by the present application can be used in a home scene, an office scene, or other scenes.
  • the present application provides a device control method, the method is applied to the communication system of the fourth device and the fifth device; the method includes: the fourth device detects that the fourth device is located outside the first electronic fence ; The fourth device outputs second prompt information, or the fourth device sends second information to the fifth device, and the second information is used to indicate that the fourth device is located outside the first electronic fence; the first electronic fence It includes multiple closed areas and routes between the multiple closed areas.
  • the fourth device detects that the fourth device is located in the second electronic fence; the fourth device outputs third prompt information, or the fourth device sends third information to the fifth device , the third information is used to indicate that the fourth device is located within the second geo-fence.
  • the detecting by the fourth device that the fourth device is outside the first geo-fence specifically includes: the fourth device detecting that the fourth device is located in the plurality of enclosures within the first geo-fence; or, the fourth device detects that the fourth device is located outside the route in the first electronic fence for more than a first distance and/or is located outside the route in the first electronic fence for longer than a first time part.
  • the first device can set an electronic fence according to the user's operation, and can also generate an electronic fence according to the user's daily activity track.
  • the fourth device detects that the fourth device is located outside the first electronic fence. Before that, the method further includes: the fourth device sets the first electronic fence according to a third operation input by the user; Alternatively, the fourth device generates the first e-fence according to the movement track within the second time period, and the first e-fence includes the movement track.
  • the first device can set an electronic fence according to the user's operation, and can also generate an electronic fence according to the user's daily activity track.
  • the boundary of the first electronic fence corresponds to the boundary of the area corresponding to the movement track, and the area enclosed by the first electronic fence is greater than or equal to the area corresponding to the movement track.
  • the fifth device includes any one or more of the following: a mobile phone, a tablet, a smart watch, a bracelet, a home device, or a vehicle-mounted computer.
  • the present application provides a device control method, the method is applied to the communication system of the first device, the second device, and the fourth device; the method includes: the fourth device detects the usage of the fourth device The first rule is not met; the fourth device stops providing some or all functions of the fourth device; the fourth device receives the fourth information sent by the second device, and the fourth information indicates that the user has completed the first task ; In response to receiving the fourth information, the fourth device continues to provide some or all of the functions of the fourth device; or, the fourth device receives fifth information sent by the first device, and the fifth information is used to indicate The fourth device continues to provide part or all of the functions of the fourth device; in response to receiving the fifth information, the fourth device continues to provide part or all of the functions of the fourth device.
  • the method before or after the fourth device stops providing some or all functions of the fourth device, the method further includes: the fourth device outputs fourth prompt information, and the fourth prompt information uses to instruct the user to perform the first task.
  • the user may be prompted to perform a corresponding unlocking task to unlock the functions.
  • the method further includes: the fourth device sets the first rule according to a fourth operation input by the user; The fourth device receives the first rule sent by the first device.
  • the user's usage rules for using a certain device can be set in the local device or remotely in other devices.
  • the method further includes: The second device sends the fourth information to the first device; the first device detects a fifth operation; the first device sends the fifth information to the fourth device, and the fifth information is used to indicate that the first The fourth device continues to provide some or all of the functions of the fourth device.
  • the method further includes: the first The fourth device sends the third information to the first device; the first device detects the fifth operation, the first device sends the fifth information to the fourth device, and the fifth information is used to indicate that the fourth device Continue to provide some or all functions of the fourth device.
  • the first rule includes any one or more of the following: the duration of the fourth device being in the unlocked state every day is less than the first duration; the duration of the fourth device being in the unlocked state is shorter than the second duration ; The fourth device is in a locked screen state at other times than the third time period; the fourth device refuses to run applications other than the first application; the fourth device continues to run the first application for less than the third duration .
  • the first application program includes: an instant messaging application program, an education and learning application program, a sports and health application program, and an event reminder application program.
  • the first application program is a third-party application program and/or a system application program.
  • the first task includes any one or more of the following: study, exercise, rest or housework.
  • the method further includes: the fourth device outputs the first message for prompting the user to use the fourth device. rule.
  • the fourth device receives the fourth information sent by the second device, specifically including: the second device authenticates the identity of the user, and when the identity of the user is the second user, Send third information to the fourth device.
  • the above-mentioned second user is a child.
  • the first device is the mobile phone, tablet or notebook of the parent of the second user;
  • the fourth device is the smart watch, bracelet, mobile phone, tablet or notebook of the second user;
  • the second device is the device that provides sports services or learning services.
  • the present application provides a device control method, the method is applied to the communication system of the first device, the second device, the fourth device and the sixth device; the method includes: the first device detects the sixth operation, The sixth operation is used to start the second function; the first device obtains the status of the second user according to the seventh operation input by the user, or obtains the status of the second user through the second device or the fourth device or the sixth device ; When the state of the second user is one or more of the following: not sleeping, studying, the distance between the second user and the first user is less than the second distance and the preset distance, or the distance between the second user and the The first user is in a room; the first device refuses to activate the second function.
  • Implementing the method provided in the fifth aspect can set rules for parents to use electronic devices, so that parents can efficiently accompany their children to grow up and establish a good image for their children.
  • the present application provides a device control method, which is applied to a communication system between a first device and a sixth device; the method includes: the first device detects an eighth operation input by the second user, The eighth operation is used to start the third function; the first device acquires the status of the first user; when the status of the first user is one or more of the following: sleeping, leaving home, working; the second A device refuses to activate the third function.
  • the status of the first user is set by the first device according to the operation input by the first user; or, the status of the first user is set by the first device or the sixth device After being detected, it is sent to the first device.
  • parents can set their own status, and then restrict themselves to use electronic devices according to regulations, so as to actively ask themselves to accompany their children with high quality and establish a good image for their children. It can also be that the electronic equipment detects the status at home to restrict the parents to use the electronic equipment according to regulations.
  • the second user is a child; the first user is a parent of the second user.
  • the method provided in conjunction with the fifth aspect or the sixth aspect is characterized in that the first device is the first user's mobile phone, tablet or notebook; the sixth device includes any one or more of the following: the first user's home monitoring The device is the smart watch, bracelet, mobile phone, tablet or notebook of the second user.
  • the present application provides a device control method, the method is applied to a communication system including a smart door lock, a first device, and a second device; the method includes: the smart door lock detects a ninth operation, the The smart door lock opens the door; when the distance between the smart door lock and the first device gradually increases, the smart door lock performs one or more of the following: refuse to close the door, and output a signal for prompting the user to carry the first device The fifth prompt information, or, trigger the first device and/or the second device to output fifth prompt information for prompting the user to carry the first device.
  • the user when the user leaves home without an electronic device, the user can be reminded to carry the electronic device, so as to avoid wasting time and delaying the schedule when the user leaves home and returns home.
  • the method further includes: the smart door lock determines that the distance between the user and the smart door lock is less than the second value; The fifth prompt information for prompting the user to carry the first device, or triggering the first device and/or the second device to output fifth prompt information for prompting the user to carry the first device.
  • the smart door lock, the first device, and the second device are located in the first space; the method further includes: in the fourth time period, the first device determines that the user leaves the first space, and the user leaves the first space; The fourth time period will carry the first item for travel; the first device outputs sixth prompt information, and the sixth prompt information is used to prompt the user to carry the first item.
  • the electronic device when the electronic device detects that the user needs to carry necessary items such as an ID card and a notebook when traveling, the electronic device can remind the user to bring the relevant items when going out, so as to avoid wasting time and delaying the itinerary when the user leaves home and returns home.
  • the first device stores sixth information, and the sixth information indicates that the user travels with the first item during the fourth time period.
  • the electronic device can obtain information related to the travel event of the user in advance.
  • the smart door lock, the first device, and the second device are located in a first space, and the method further includes: during a fifth time period, the first device determines that the user leaves the first space; Extreme weather occurs within the fifth time period; the first device outputs seventh prompt information, and the seventh prompt information is used to remind the user to bring protective equipment.
  • the electronic device when the electronic device detects that the user is traveling, it can remind the user to carry the corresponding protective equipment according to the current weather conditions, so as to prevent the user from wasting time when leaving home and returning home, delaying the itinerary, and improving travel efficiency.
  • the first device determining that the user leaves the first space specifically includes: the first device receiving seventh information sent by the smart door lock, the seventh information instructing the user to leave the first space, Alternatively, the first device detects that the user leaves the first space.
  • the electronic device may receive a message from other devices that the user leaves home, or detect the user leaving home by itself to determine the user's leaving home state.
  • the first device detecting that the user leaves the first space specifically includes: the first device detecting that the communication connection with the router in the home is disconnected; The second device disconnects the communication connection; or, the first device acquires the travel event recorded in the first device; or, the first device detects that the user takes a car by using the NFC function or scanning a barcode; or, the first device A device detects that the distance between the user and the first space exceeds a third value.
  • the electronic device can detect that the user leaves home in various ways, thereby improving the implementability of the solution.
  • the communication system further includes a vehicle; the method further includes: the vehicle detects a tenth operation, the door of the vehicle is opened; the distance between the first door and the first device gradually increases , the vehicle performs one or more of the following: refuse to close the door, output an eighth prompt message for prompting the user to carry the first device, or trigger the first device and/or the second device to output a prompt The eighth prompt information of the first device carried by the user.
  • the communication system further includes a vehicle; the method further includes: the vehicle determines that the distance between the user and the vehicle door is less than a fourth value; the vehicle outputs a first value for prompting the user to carry the first device Eighth prompt information, or trigger the first device and/or the second device to output eighth prompt information for prompting the user to carry the first device.
  • the communication system further includes a vehicle; the method further includes: the vehicle detects the eleventh operation, the vehicle locks the doors and windows; the vehicle detects that there is a user in the vehicle, and the vehicle executes One or more of the following: open the window, open the door, output the ninth prompt information for prompting that there is still a user in the vehicle, or trigger the first device and/or the second device to output a prompt for prompting that there is still a user in the vehicle There is a ninth prompt message for the user.
  • the vehicle after the vehicle opens the window or the door, it sends eighth information to the first device, and the eighth information indicates that the vehicle has opened the window or door; the first device displays the second control, and the first The device detects the operation acting on the second control, and the first device triggers the locking of windows and doors of the vehicle.
  • the present application provides a device control method, the method is applied to a communication system including a first device, a second device, and a vehicle; the method includes: during the sixth time period, the first device executes the tenth Two operations; the user will execute the first event in the sixth time period; the twelfth operation includes any one or more of the following: the first device triggers the third device to start the fifth function, and the fifth function supports the user to perform The first event; or, the first device triggers the vehicle to start, and the vehicle starts to support the user to execute the first event.
  • the electronic device can control the home device to perform corresponding operations according to the event information recorded in the electronic device, reducing user operations and reducing the user's memory burden.
  • the method before the first device triggers the third device to execute the fifth function; or, before the first device triggers the vehicle to start, the method further includes: the first device outputs a tenth prompt Information; the tenth prompt information is used to remind the user that the third device is about to perform the fifth function, or that the vehicle is about to start.
  • the electronic device can notify the user in advance that it will control other devices to perform corresponding operations, ensuring the user's right to know.
  • the method further includes: the first device displays a third control, the first device detects an operation acting on the third control, and the first The device undoes the twelfth operation.
  • the electronic device after the electronic device automatically controls other devices to execute corresponding events, it can also display a corresponding control for the user to withdraw the above-mentioned control operation.
  • the present application provides a device control method, the method is applied to a fourth device; the method includes: the fourth device detects that the fourth device is located outside the first electronic fence; the fourth device outputs the Two reminder information, or, the fourth device sends second information to the fifth device, the second information is used to indicate that the fourth device is located outside the first electronic fence; the first electronic fence includes multiple closed areas and the Routes between multiple enclosed areas.
  • the fourth device detects that the fourth device is located in the second electronic fence; the fourth device outputs third prompt information, or the fourth device sends third information to the fifth device , the third information is used to indicate that the fourth device is located within the second geo-fence.
  • the fourth device detecting that the fourth device is located outside the first electronic fence specifically includes: the fourth device detecting that the fourth device is located in the plurality of enclosures within the first electronic fence or, the fourth device detects that the fourth device is located outside the route in the first electronic fence for more than a first distance and/or is located outside the route in the first electronic fence for longer than a first time part.
  • the fourth device detects that the fourth device is located outside the first electronic fence. Before that, the method further includes: the fourth device sets the first electronic fence according to a third operation input by the user; Alternatively, the fourth device generates the first e-fence according to the movement track within the second time period, and the first e-fence includes the movement track.
  • the boundary of the first electronic fence corresponds to the boundary of the area corresponding to the movement track, and the area enclosed by the first electronic fence is greater than or equal to the area corresponding to the movement track.
  • the fifth device includes any one or more of the following: a mobile phone, a tablet, a smart watch, a bracelet, or a household device.
  • the present application provides an example of a device control method, the method is applied to a fourth device, and the method includes: the fourth device detects that the use of the fourth device does not comply with the first rule; the fourth device stop providing some or all of the functions of the fourth device; the fourth device receives fourth information sent by the second device, the fourth information indicating that the user has completed the first task; in response to receiving the fourth information, the fourth The fourth device continues to provide part or all of the functions of the fourth device; or, the fourth device receives fifth information sent by the first device, and the fifth information is used to instruct the fourth device to continue to provide part of the fourth device or all functions; in response to receiving the fifth information, the fourth device continues to provide some or all functions of the fourth device.
  • the method further includes: the fourth device outputs fourth prompt information, and the fourth prompt information uses to instruct the user to perform the first task.
  • the method further includes: the fourth device sets the first rule according to a fourth operation input by the user; The fourth device receives the first rule sent by the first device.
  • the method further includes: the first The fourth device sends the third information to the first device; the fourth device receives the fifth information sent after the first device detects the fifth operation, and the fifth information is used to instruct the fourth device to continue to provide the Some or all of the functions of the fourth device.
  • the first rule includes any one or more of the following: the duration of the fourth device being in the unlocked state every day is less than the first duration; the duration of the fourth device being in the unlocked state is shorter than the second duration ; The fourth device is in a locked screen state at other times than the third time period; the fourth device refuses to run applications other than the first application; the fourth device continues to run the first application for less than the third duration .
  • the first application program includes: an instant messaging application program, an education and learning application program, a sports and health application program, and an event reminder application program.
  • the first application program is a third-party application program and/or a system application program.
  • the first task includes any one or more of the following: study, exercise, rest or housework.
  • the method further includes: the fourth device outputs the first message for prompting the user to use the fourth device. rule.
  • the fourth device receiving the fourth information sent by the second device specifically includes: the fourth device receiving the information sent by the second device under the condition that the user is authenticated as the second user. the third information.
  • the second user is a child.
  • the first device is the mobile phone, tablet or notebook of the parent of the second user;
  • the fourth device is the smart watch, bracelet, mobile phone, tablet or notebook of the second user;
  • the second device is the device that provides sports services or learning services.
  • the present application provides a device control method, which is applied to a first device; the method includes: the first device detects a sixth operation, and the sixth operation is used to start a second function; A device acquires the status of the second user according to the seventh operation input by the user, or acquires the status of the second user through the sixth device; when the status of the second user is one or more of the following: not sleeping, Learning, the distance between the second user and the first user is less than the second distance and the preset distance, or the second user and the first user are in the same room; the first device refuses to activate the second function.
  • the present application provides a device control method, the method is applied to a first device; the method includes: the first device detects an eighth operation input by the second user, and the eighth operation is used for Start the third function; the first device acquires the status of the first user; when the status of the first user is one or more of the following: sleeping, leaving home, and working; the first device refuses to start the second Three functions.
  • the status of the first user is set by the first device according to the operation input by the first user; or, the status of the first user is set by the first device or the After the sixth device detects it, it sends it to the first device.
  • the second user is a child; the first user is a parent of the second user.
  • the method provided in conjunction with the eleventh aspect or the twelfth aspect is characterized in that the first device is the first user's mobile phone, tablet or notebook; the sixth device includes any one or more of the following: the first user's Home monitoring equipment, the second user's smart watch, bracelet, mobile phone, tablet or notebook.
  • the present application provides an electronic device, which includes one or more processors and one or more memories; wherein, the one or more memories are coupled with the one or more processors, the One or more memories are used to store computer program codes, and the computer program codes include computer instructions.
  • the electronic device executes the eighth aspect, the ninth aspect, and the tenth aspect. aspect and the method described in any one of the eleventh aspect.
  • the present application provides a computer program product containing instructions. When the computer program product runs on an electronic device, the electronic device executes the eighth aspect, the ninth aspect, the tenth aspect and the tenth aspect. The method of any one of the aspects.
  • the present application provides a computer-readable storage medium, including instructions.
  • the instructions When the instructions are run on an electronic device, the electronic device executes the eighth aspect, the ninth aspect, the tenth aspect and the tenth aspect.
  • the present application provides a communication system, the communication system includes a first electronic device and a second electronic device, and the first electronic device is used to implement the eighth aspect, the ninth aspect, the tenth aspect and the first electronic device The method described in any one of eleven aspects.
  • Figure 1A is the management process for user data in the data bank provided by the embodiment of the present application.
  • FIG. 1B is a schematic diagram of a communication system provided by an embodiment of the present application.
  • FIG. 2A-FIG. 2B are respectively the software and hardware architecture diagrams of the mobile terminal provided by the embodiment of the present application.
  • FIG. 3 is a hardware architecture diagram of a home device provided by an embodiment of the present application.
  • FIG. 4 is a hardware architecture diagram of a home device provided by an embodiment of the present application.
  • Fig. 5A is a schematic diagram of the family member relationship provided by the embodiment of the present application.
  • FIG. 5B is a schematic diagram of authority levels owned by family members provided by the embodiment of the present application.
  • FIG. 5C is a schematic diagram of the family plane layout structure provided by the embodiment of the present application.
  • FIG. 5D is a schematic diagram of the family space layout structure provided by the embodiment of the present application.
  • 6A-6V exemplarily show a series of operation interface diagrams for users to create a "smart home"
  • Fig. 7A-Fig. 7T exemplarily show a series of operation interface diagrams of the user setting the control rights of family members
  • 8A-8E exemplarily show a schematic diagram of an initialization operation interface for a user to set an identity authentication mode
  • Fig. 8F-Fig. 8X exemplarily show the user interface of family members controlling the family devices through the smart home APP;
  • 9A-9G exemplarily show a series of user interface diagrams after the mobile terminal detects a sensitive operation
  • FIG. 9H-FIG. 9M exemplarily show a series of user interface diagrams after the mobile terminal detects another sensitive operation
  • FIG. 9N-FIG. 9Q exemplarily show a series of user interface diagrams after the mobile terminal detects another sensitive operation
  • 9R-9W exemplarily show a series of user interface diagrams after the mobile terminal detects another sensitive operation
  • 9X-9Y exemplarily show a series of user interface diagrams after the mobile terminal detects another sensitive operation
  • 10A-10H exemplarily show a series of operation interface diagrams for setting usage rules and related tasks
  • Fig. 11A-Fig. 11R exemplarily show a series of schematic diagrams of the operation interface when the rules of use are broken;
  • FIG. 11S-FIG. 11X exemplarily show a series of schematic diagrams of the operation interface when the user performs an unlocking task
  • Fig. 11Y-Fig. 11Z-5 exemplarily show a series of schematic diagrams of the operation interface when the user performs another unlocking task
  • FIG. 12A-FIG. 12V exemplarily show a series of schematic diagrams of user interfaces in which the mobile terminal actively detects the user status
  • 12W-12Z exemplarily show a series of schematic diagrams of the operation interface when the user inputs the user status to the mobile terminal;
  • FIGS. 13A-13C exemplarily show a schematic diagram of a user interface for a mobile terminal to control a home device according to a user status
  • FIG. 13D-FIG. 13J exemplarily show a schematic diagram of a user interface in which a mobile terminal controls a home device according to user status and acquired event information;
  • FIG. 13K-FIG. 13L exemplarily show user interface diagrams in which a mobile terminal controls a home device only according to acquired events.
  • first and second are used for descriptive purposes only, and cannot be understood as implying or implying relative importance or implicitly specifying the quantity of indicated technical features. Therefore, the features defined as “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the embodiments of the present application, unless otherwise specified, the “multiple” The meaning is two or more.
  • UI user interface
  • the term "user interface (UI)” in the following embodiments of this application is a medium interface for interaction and information exchange between an application program or an operating system and a user, and it realizes the difference between the internal form of information and the form acceptable to the user. conversion between.
  • the user interface is the source code written in a specific computer language such as java and extensible markup language (XML).
  • the source code of the interface is parsed and rendered on the electronic device, and finally presented as content that can be recognized by the user.
  • the commonly used form of user interface is the graphical user interface (graphic user interface, GUI), which refers to the user interface related to computer operation displayed in a graphical way. It may be text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, and other visible interface elements displayed on the display screen of the electronic device.
  • User data is large in scale, diverse in structure and growing rapidly.
  • user data has great value, for example, it can be used to build user attributes, improve user experience, and develop new application technologies, etc.
  • User attributes may also be referred to as user portraits.
  • Sharing and opening user data can effectively connect all kinds of information, dig out the value contained in user data, and bring more convenient services to users' lives.
  • sharing and opening user data also has the risk of leaking user privacy information, causing users to worry about the security of personal data.
  • users are usually concerned about opening their own user data, which brings obstacles to mining the value of user data.
  • the embodiment of the present application provides a data bank management mechanism, which can protect user privacy from being leaked while sharing and opening user data.
  • the data bank has the characteristics of full life cycle governance control, data leakage prevention and tamper resistance, participant identity authentication and access control, and value sharing. Specifically, the data bank guarantees the orderly and controllable storage, sharing, application and destruction of data in the digital world within the life cycle, and guarantees all participants such as data providers, data processors, data trading platforms and data consumers. can obtain income.
  • the data bank promotes data as the base for the prosperity of the digital economy and meets the demand for data to become a factor of production in the market economy. By marking the entire life cycle of data, the data bank conducts identity identification and authority control for all parties involved in the digital economy, tracks and records the entire process of data transfer, prevents information leakage and tampering within the data life cycle, and provides technical support.
  • a data bank is a trusted organization that manages user data. It is responsible for the storage, sharing, distribution, withdrawal, traceability, use, etc. of user data. It can also be used to manage the life cycle of user data, that is, the validity period.
  • the data bank can manage user data under the authorization of the user, and pay for the user who owns the user data.
  • the data bank uses the interconnection between devices and the understanding of each device's capabilities to other devices to store the generated data in an orderly manner.
  • When storing data put relevant tags on the data, such as time, place, task, event, and then store it in a similar relational database to facilitate subsequent search or use of the data.
  • User data can be stored on an individual, family, company or other group basis. When storing data, it can also be classified and graded according to the importance and sensitivity of the data, and the user can set the access rights of various types of data, so as to ensure that it will not be leaked or misused during the life cycle of the data.
  • Encryption techniques include but are not limited to attribute-based encryption (ABE) algorithms and the like.
  • User data can also be desensitized and stored in the data bank. For example, data that is strongly related to user privacy in user data, including the user's name, address, contact information, etc., can be deleted and then stored in the data bank.
  • the embodiment of the present application also provides a possible desensitization solution based on an intermediate server.
  • the intermediate server can obtain the user data uploaded by the user through the end-side device, and provide off-the-shelf services for service providers based on user data (such as servers providing medical and health services, servers providing traffic accident analysis, servers providing advertising recommendations, etc.) Sensitized or blurred user data, and not directly publish all user data to the service provider, so as to ensure that user data is not leaked or abused, and protect user privacy.
  • the intermediate server binds the user's real identity information (such as name, contact information, address, etc.)
  • the intermediate server can bind the user data with the user's virtualized identity information and send it to the service provider, and store the relationship between the virtualized identity information and the real identity information.
  • the service provider will not know the relationship between the user data and the real user identity, thus avoiding the disclosure of the user's sensitive data and privacy.
  • the intermediate server may also be called an intermediate agent, a proxy server, a relay server and other names.
  • the data bank can obtain massive user data, and combine massive user data from various industries and various types with the consent of the user, and use these user data to perform more operations and mine these user data.
  • the economic value and social value of user data promote the development of various industries. If the user stops the authorization later, the data bank will stop the corresponding operations. For example, after the user stops the authorization, the data bank can clean up the corresponding data and will not back up or copy the data. This ensures that user data is used reasonably and orderly, and also protects user privacy.
  • the data bank integrates the data encryption system, key management, and access control policies into the data itself in the form of data tags, so that data can still obtain consistent protection when flowing across physical nodes.
  • the data bank itself can also be implemented as a multi-level or multi-category structure, and different levels of data banks have different permissions.
  • a data bank may include a total data bank and a sub-data bank.
  • a data bank may include a data bank for managing exercise and health data, a data bank for managing travel data, and the like.
  • user data is like currency
  • a data bank is like a currency bank.
  • the management of user data by a data bank is similar to the management of currency by a currency bank.
  • Data bank (data bank) is just a noun used in the embodiment of this application, and its representative meaning has been recorded in this embodiment, and its name does not constitute any limitation to this embodiment. In some other embodiments, "data bank (data bank)” may also be called other terms such as "data bank”.
  • FIG. 1A schematically shows a management process for user data in a data bank provided by an embodiment of the present application.
  • the anonymized smart service data application platform shown in Figure 1A is the intermediate server mentioned above, and the various organizations shown in Figure 1A are the above-mentioned service providers based on user data , such as organizations that provide medical and health services, organizations that provide traffic accident analysis, organizations that provide advertising recommendations, and so on.
  • User data may include but not limited to the following types: exercise health data, travel data, habit data, equipment data, etc.
  • Sports health data used to characterize the user's physical state.
  • Sports health data can include physiological data such as age, gender, height, weight, blood pressure, blood sugar, blood oxygen, respiration rate, heart rate, ECG waveform, body fat percentage, body temperature, etc.
  • the travel data represents the user's executed or to-be-executed travel plan, as well as the actual travel situation.
  • Travel data may include: order (such as air tickets, train tickets, hotels, takeaway orders, etc.) data, schedule data, memorandum data, etc.
  • Travel data can also include: vehicle information (such as vehicle speed, fuel level, navigation information, driving mode, etc.), road conditions, road infrastructure information (such as traffic light signals), historical travel records, etc.
  • Habit data refers to data related to the user's living habits, including sleep data and activity area related data.
  • the device data represents the configuration of the electronic device used by the user, and the connection between the electronic device and other devices.
  • the device data may include, for example: the list of application programs (application, APP) installed in the electronic device, the device model and configuration, the login account and password of the operating system (operating system, OS), the login account and password of each APP, and the electronic device connection.
  • the type, quantity and other information of other devices such as smart home devices, etc.
  • user data may also include more content, such as bank data, wealth management data, personal identity information, social relations, education background, contact information, etc.
  • the form of user data may include symbols, text, numbers, voice, images, videos, and so on.
  • User data can be digital information or paper information.
  • the user data processing process mainly follows the following steps:
  • Methods of collecting user data may include, but are not limited to, the following:
  • User data can be collected through various devices. These devices can be interconnected and form an ecological chain, or they can be independent of each other and not connected.
  • medical devices or wearable devices or sports equipment can collect sports health data.
  • Sphygmomanometers can collect blood pressure
  • blood glucose meters can collect blood sugar
  • oximeters can collect blood oxygen saturation and pulse rate
  • thermometers can collect body temperature
  • ECG recorders can collect ECG waveforms
  • body fat scales can collect body fat percentage
  • smart watches or smart bracelets Collect heart rate, respiration rate, blood oxygen, etc.
  • mobile terminals, vehicle-mounted devices, or smart door locks can collect travel data.
  • the on-board equipment can collect vehicle speed and fuel level through sensors, as well as current navigation information and driving mode, as well as road infrastructure information through Bluetooth, cellular and other communication technologies, and so on.
  • mobile terminals, home monitoring, etc. can collect data related to the user's living habits.
  • the mobile terminal can collect the user's daily work and rest, as well as the frequently used east areas, etc.
  • APPs can be installed in the electronic device, including system APPs and third-party APPs.
  • system APP refers to the APP provided or developed by the manufacturer of the electronic equipment
  • third-party APP refers to the APP provided or developed by the manufacturer of the non-electronic equipment.
  • a producer of an electronic device may include a manufacturer, supplier, supplier, operator, etc. of the electronic device.
  • the APP can collect relevant user data.
  • travel data can be collected by devices such as smartphones and tablets through corresponding APPs.
  • the order data can be collected from life services such as booking APP
  • the schedule data can be collected from the schedule APP
  • the memorandum data can be collected from the memo
  • the weather data can be collected from the weather forecast application.
  • a food delivery app can collect users' eating preferences
  • an e-commerce shopping app can collect users' shopping preferences.
  • OS is the most basic system software, which is used to manage the hardware, software and data resources of electronic equipment, control the operation of programs, improve the man-machine interface, provide support for other software, and so on.
  • OS includes but not limited to etc.
  • the OS may collect relevant user data.
  • the OS of electronic devices such as smartphones and wearable devices can collect user habit data.
  • the OS of smart phones and tablet computers can monitor and learn the behavior habits of users using smart phones, tablet computers and other electronic devices, such as the user's commonly used input methods, message modes, operation modes, etc., and generate habit data representing user behavior habits.
  • Wearable devices such as smart bracelets can collect user habit data such as hand shaking frequency, stride frequency, and sleep.
  • the OS of the electronic device can also collect device data.
  • the OS of a device such as a smartphone can obtain the list of APPs installed on the device, the model and other configuration information, the login account and password of the OS, the login account and password of each APP, the user's personal information and contact list, It is also possible to obtain information (such as type, quantity, location) and the like of other devices connected to this device according to the connection situation.
  • the user can also directly set his usual operating mode and message mode on devices such as smart phones and tablet computers, and the OS of the device can collect the user's behavior habits according to the user's settings.
  • Information input devices may include, but are not limited to, a display screen, a camera, a microphone, a mouse, a keyboard, and the like.
  • users can input sports and health data through text, voice, etc., and devices such as smartphones and tablets can receive it through display screens, microphones, etc.
  • the electronic device can also collect the user's input method information and search records through the display screen.
  • smartphones and tablet computers can also scan paper physical examination reports, CT images, drug prescriptions, exercise prescriptions, etc. through cameras, thereby obtaining information in the medical examination reports.
  • Third-party institutions may include trusted institutions that generate data, such as hospitals, functional agencies, airlines, and the like. Trusted authorities can be used to collect user data.
  • hospitals can collect users' exercise health data. After the user visits the medical institution, the diagnosis result can be uploaded to the server provided by the medical institution, and then the smart phone, tablet computer and other data on the user side can download the diagnosis result from the server.
  • government functional agencies may collect users' personal information, social relations, contact information, and so on.
  • airlines may collect users' personal information, travel data, and so on. It is not limited to the several methods of collecting data listed above, and in some embodiments, user data may also be collected in other ways, which are not limited here.
  • the validity of the user data can be checked, and invalid data such as redundant and garbled characters can be marked, and the data should be resubmitted or re-entered; on the other hand, the integrity of the data can also be checked.
  • the user data can also be preprocessed. For example, standardize the processing of various types of data and classify them according to their importance, sensitivity, timeliness or other specifics, and establish a unified data storage mode. In this way, user data obtained through different methods and platforms can be stored in a unified standard, and complete and comprehensive data can be collected to facilitate subsequent construction of complete user attributes.
  • different types of user data can have different storage standards, for example, exercise health data and travel data can be stored by different standards.
  • Processing user data can provide users with better services and meet the actual needs of users.
  • User data can be uploaded to the anonymized management platform after the user agrees to ensure that the information cannot be traced to the individual and guarantee the privacy of the user.
  • the device-cloud joint reasoning is performed, and on this basis, complete attributes are formed for users and private data is not leaked.
  • different types of user data can be uploaded to different anonymized management platforms, such as sports and health data can be uploaded to the medical management platform, travel data can be uploaded to the travel management platform and smart home management platform, etc.
  • the processing of user data can be applied to the following areas:
  • An interconnected communication system in which electronic devices in a family can be networked includes many family members, such as the head of the house, the parents of the head of the house (the elderly), the children (children) of the head of the house, and sometimes family members include, for example Housekeeping staff, tutors, home fitness trainers, and more.
  • the electronic device may divide the family activity space for the family members, that is, establish a corresponding relationship between the user's identity and the family space.
  • the electronic device can analyze the collected user information, identify the user's identity, and then open the user to use the corresponding home appliance.
  • the user's information includes: the user's facial image, fingerprint, voice, posture, operating habits and so on.
  • the electronic device can also restrict part of the user's use rights in combination with the user's identity information, the user's usual activity space in the family, the user's behavior track, and the current time.
  • the electronic device can detect whether the user breaks the use rule of the device according to the set use rules. When the electronic device detects that the use rule of the device is broken, the electronic device can instruct the user to complete the specified task according to the pre-designated task to continue. Use the electronic device normally.
  • the specified task can be completed by any one or more devices in the local electronic device and other home devices connected to the local electronic device, such as learning machines, sports bracelets, treadmills, sweeping robots, and intelligent washing machines,
  • the electronic device can analyze whether the user has completed the specified task based on the collected data about the task performed by the user. If so, the user is allowed to continue using the electronic device normally. If not, the user is restricted from using some functions of the electronic device or the electronic device is locked.
  • the electronic device will also judge the user's status based on the acquired user data and device data.
  • the electronic device will combine the event information recorded in the application program to control the home device to execute the corresponding event.
  • the above user data may include event information stored by the user in the application program, and the above device data includes data related to the connection status of the device with other family devices.
  • the event information recorded in the above applications may be travel records, weather information, to-do events and so on.
  • the process of processing or processing user data mentioned above can be performed by the electronic device on the terminal side, or by a server on the cloud side, or can also be performed in combination with the terminal and cloud.
  • a model When specifically processing user data, a model can be formulated through preset simple rules, or a model can be extracted through an artificial intelligence (AI) engine, and the user data can be processed or processed through the model. Preset rules can come from empirical knowledge or industry standards. These models can be used to construct user attributes based on user data, so as to provide users with targeted services.
  • AI artificial intelligence
  • processing user data can also make the user's home life more intelligent, convenient and safe.
  • User data can be opened to other devices across devices, to other applications across applications, to other OSs across OSes, and to other users across users. Open user data can enable electronic devices to integrate multi-party user data, thereby providing users with more intelligent and convenient services. By opening user data, massive user data no longer exist independently of each other, but can be circulated and shared.
  • User data can be intuitively displayed to users, allowing users to directly know the user data collected by electronic devices, so as to understand their own physical status, the physical status of family members, the status of household equipment in the family, and so on.
  • an electronic device can obtain information such as the operating status of other devices in a smart home and present it to the user. Based on the data related to the user's life trajectory, the electronic device can generate the user's electronic fence and present it to the user, so as to remind the user not to go beyond the protection range of the electronic fence. When the user crosses the electronic fence, the electronic device is triggered to send an alarm or send an alarm message to other household devices. In addition, the electronic device will also present prompt information showing the use rules of the electronic device to the user, and then determine whether the user breaks the use rules of the electronic device according to the data of the user's use of the electronic device, and if so, output the prompt information, The user is prompted to continue using the electronic device normally by completing the specified task.
  • the electronic device can also control the home device to perform corresponding operations according to the acquired user to-do event information, and present corresponding prompt information to the user.
  • the electronic device can also control the home device to perform corresponding operations according to the acquired user to-do event information, and present corresponding prompt information to the user.
  • User Data can also be used to build user attributes for individual users in order to provide a more personalized service to that user.
  • different types of data can be used to construct different categories of attributes for the same user, such as using sports health data to construct sports health attributes, using travel data to construct travel preference attributes, using data related to home life to construct home preference attributes, using and The data related to entertainment life constructs entertainment preference attributes and so on.
  • User attributes can be provided to users themselves, or to third-party apps or third-party platforms, so that third-party apps or third-party platforms can provide users with personalized services.
  • User data can also be provided to third-party apps or platforms, such as medical institutions, sports and health platforms, etc., and integrated to provide users with better services.
  • third-party apps or platforms such as medical institutions, sports and health platforms, etc.
  • third-party apps or platforms can develop AI medical care based on a large amount of medical data, such as medical imaging, auxiliary diagnosis, drug development, health management, gene sequencing, etc., which can promote the technological development of the medical industry.
  • medical data such as medical imaging, auxiliary diagnosis, drug development, health management, gene sequencing, etc.
  • patients can obtain previous electronic medical records and examination reports from different hospitals to assist doctors in diagnosis, that is, medical data can flow safely between different medical institutions, improving the efficiency of patients' medical treatment.
  • users can also perform daily health monitoring management or chronic disease risk analysis based on their daily uploaded physical testing data, without worrying about their data being leaked.
  • users can also sell their own user data. In this way, with the user's permission, the platform in need can obtain a large amount of effective user data, and use these user data to develop more abundant application technologies and provide better services for users. Moreover, users can also get benefits to achieve a win-win situation.
  • different applications can be installed on the user's end-side device, which respectively support the collection, processing, opening and data presentation of user data in different fields mentioned above.
  • a sports and health APP may be installed in the end-side device to support related processing of sports and health data.
  • a smart travel APP may be installed in the end-side device to support related processing of travel data.
  • a smart home app may be installed in the end-side device to support related processing of home data.
  • a smart life app may be installed in the end-side device to support related processing of life data.
  • the data bank management mechanism provided by the embodiment of this application allows users to share and open user data.
  • the data bank can be circulated as an asset to fully tap the value of user data, not only It can meet the actual needs of users, enable users to live a healthy life and travel intelligently, and can also promote the healthy and mature development of various industries.
  • Smart home is a comprehensive use of Internet of Things, cloud computing, mobile Internet and big data technologies, combined with automatic control technology, to effectively control household equipment intelligent control, family environment perception, family health perception, home safety perception, information exchange, consumer services, etc. Combined with each other to create a healthy, safe, comfortable, low-carbon and convenient personalized home life.
  • Smart home goes far beyond the scope of smart home.
  • Smart home includes smart home appliances, mobile terminals, travel equipment, etc. These devices can be collectively referred to as home devices.
  • Smart home takes intelligent control as the core of smart home, and provides platform-level support for social public service, social management, household energy efficiency and energy-saving management, and commercial application services, which greatly facilitates home life and is the foundation of future smart cities and smart societies. cornerstone.
  • users can perform linked control of home devices through mobile terminals. For example, before going to bed, users can initiate linked control information for turning on "sleep mode" to control the lights at home. , Curtains, TV sets, stereos and other equipment that affect the user's sleep quality stop working.
  • linkage control information will control all home devices. For example, one of the members of the family wants to sleep and initiates linkage control information for turning on the "sleep mode". Equipment will stop working. If at this time, other members of the family are washing, working, studying, exercising, doing housework, etc., then such a family device control method will seriously affect the lives of other family members and the relationship between family members.
  • the owner can grant others the right to use the family device by sharing the device or adding family members, but by sharing the device, each device in the family device needs to perform the sharing operation. It is cumbersome, but only granting them permission to use family devices by adding members.
  • this authorization method simplifies the authorization operation, it will make the added members have the permission to use all devices in the home, which will make the private devices of family members It will be used by other members, which will affect the security of family devices to a certain extent.
  • the home device will be locked, and the family device can only be unlocked after receiving authorization from other users.
  • the device can continue to be used normally.
  • the elders in the family will use the above method to set the usage time of the children's mobile phones, tablets, computers and other family devices.
  • the family device can only be unlocked by inputting fingerprint, face and other information into the family device, or by sending authorization information such as a verification code to the child's family device through the parent's family device.
  • parents are usually busy with work and may not be able to unlock their children in time.
  • the mobile terminal detects that the user is away from home, and can control the home device to perform linkage according to the log information in the user's memo, and execute the corresponding event in the memo.
  • the mobile terminal usually judges whether the user leaves home through the message fed back by the smart door lock. But sometimes, users just go downstairs to throw garbage or go to a convenience store to buy something, and then go home soon. The device consumes more power instead. Visible, above-mentioned method violates creating healthy, comfortable, convenient individualized household life.
  • an embodiment of the present application provides an intelligent control method for home equipment, and the intelligent control method for home equipment includes the following points:
  • a family usually includes multiple members, and these family members usually have different roles in the family relationship, and the space for frequent activities in the family environment, etc.
  • the roles of family members in the family relationship include: parents, grandparents, children, domestic service personnel, tutors, personal trainers and other family visitors.
  • parents in a family are the head of the family and are responsible for more affairs in the family; grandparents are usually older and have limited mobility; children are usually children who are receiving education.
  • the common activity space of family members in the family environment can be specifically divided into: parents live in bedroom A, grandparents live in bedroom B, children live in bedroom C, grandparents or other spaces where parents often move may also have a kitchen, and father and grandma live in bedroom B.
  • home devices deployed in different spaces in the home should be controlled by the owner of the space, and not all family members have the authority to control all home devices in the home.
  • the parents in a family as the head of the family, should have the highest authority. That is to say, in addition to having the right to control the family devices in the own space, the home owner also has the right to control the family devices in the spaces of other family members such as children, that is, has the right to control all the family devices. Only in this way can we create a harmonious family.
  • the so-called harmony means that family members have certain relative authority to control the family equipment, and the head of the family has absolute authority to control the family equipment. This kind of relative and absolute unity can just improve the quality of the family. Device security, protection of personal habits of family members or personal privacy, etc.
  • the present application provides a method for controlling home devices.
  • the mobile terminal can set the user's authority to control the home device according to the user's role in the family relationship, the user's space in the home space, and other factors.
  • the mobile terminal receives the user's operation for controlling the home device, identifies the user identity, and controls the home device to perform the corresponding function according to the authority corresponding to the user identity.
  • the user can set the use rules of the family equipment according to the education plan for the children. If the children break the rules, they must complete the specified tasks in the corresponding family equipment, so as to achieve the children's education. educate.
  • the above use rules may be that the parents set the use rules of the children's mobile terminals remotely in their own mobile terminals, or directly set the use rules in the children's mobile terminals, which is not limited in this embodiment of the present application.
  • the above tasks can be accomplished through the mobile terminal or other family devices at home that are set to use permissions.
  • parents set the use rule of the child's mobile terminal to be 4 hours a day, and set the unlocking task after breaking the rule to study for 1 hour and exercise for 1 hour.
  • the mobile terminal may lock the screen or lock some functions until the mobile terminal detects that the child uses the mobile terminal to complete the above tasks, or the mobile terminal receives the child's use of other family equipment such as a treadmill.
  • the mobile terminal will unlock the screen or unlock some functions after completing the relevant data of the 1-hour exercise task and receiving the relevant data of the child using other home devices such as the learning machine to complete the 1-hour learning task.
  • the mobile terminal can obtain the status information of the user, use the corresponding smart scene mode according to the user status, and control the home device according to the control policy set by the smart scene mode; for example, the mobile terminal detects that the user is When sleeping, the sleep mode provided in the smart home APP will be applied, and the home devices such as turning off the bedroom lights, curtains, TV, etc. will be controlled according to the control strategy set in the sleep mode.
  • the smart home APP please refer to the detailed description later, so I won’t go into details here.
  • the mobile terminal may also obtain information about events recorded in the application program, and control the home device to perform operations corresponding to the above events according to the detected event information recorded in the application program; If the user needs to participate in an online meeting, the mobile terminal can control the lights in the study room to be turned on and start the user's computer or notebook before the meeting starts.
  • the mobile terminal controls the home device to perform corresponding operations according to the detected event information.
  • the relationship between the above-mentioned specified state and event can be, for example, set according to whether the user state and event have an impact on the user's life and family environment.
  • the mobile terminal reminds the user to go out and take a good certificate according to the event, and close the window and take a rain gear and so on.
  • the above user states include: leaving home, returning home, sleeping, studying at home, working at home, exercising at home, getting off the car, and so on.
  • the above-mentioned multiple applications may be: applications for event memos, such as calendars, alarm clocks, memos, memos, etc.; or applications for life services, such as applications for making appointments or purchasing medical treatment, dining, travel, and haircut services; Or it is an application that provides public account and mini-program services, which can provide users with appointment or purchase of medical treatment, meals, travel, haircut services, etc.; or a weather forecast application, the weather forecast application
  • the program can provide users with weather forecast services; or it can be an online meeting application, which can provide users with the service of arranging meetings; The program can only allow users to book or purchase a certain course, and then conduct online learning.
  • the above-mentioned application program may be a system application program or a third-party application program. The embodiment of the present application does not limit this.
  • FIG. 1B exemplarily shows a communication system 10 provided by an embodiment of the present application.
  • the communication system 10 may include a plurality of home devices 200 and a server 300 .
  • the family device 200 includes one or more smart home devices, smart home appliances, smart travel devices, and one or more mobile terminals 100 equipped by family members.
  • the server 300 establishes a communication connection with one or more home devices 200 .
  • the mobile terminal 100 refers to a portable electronic device carried by a user, such as a smart phone, a smart watch, a tablet computer, a personal digital assistant (personal digital assistant, PDA), a smart wearable device, and the like.
  • portable electronic devices include, but are not limited to Or portable electronic devices with other operating systems.
  • the mobile terminal 100 may also be a non-portable electronic device, such as an on-board computer installed in a car, a notebook, a laptop computer with a touch-sensitive surface (such as a touch panel) (laptop), desktop computer, etc.
  • the mobile terminal 100 is installed with a smart home APP, and realizes the control of home devices through the APP. Specifically, the mobile terminal 100 may set the user's authority to control the home device according to the identity of the user and the space of the user in the home. When the mobile terminal 100 detects that the user controls the operation of the home device, it can first identify the user's identity and determine whether the user has the right to control the home device. When the device is deployed in the space to which the user belongs, the mobile terminal executes the the corresponding event. For details, refer to the detailed description below, and the embodiment of the present application will not be repeated here.
  • the user can set the usage rules of the mobile terminal 100, and set the unlock task when the rules are broken, and when the mobile terminal 100 detects that the user breaks the rules, the mobile terminal 100 will lock the screen or lock part of the Function, when it is detected that the user completes the corresponding unlocking task; or after receiving relevant data about the user performing the unlocking task sent by other home devices, and confirming that the user has completed the relevant task, the mobile terminal 100 will unlock.
  • the mobile terminal 100 can be set the usage rules of the mobile terminal 100, and set the unlock task when the rules are broken, and when the mobile terminal 100 detects that the user breaks the rules, the mobile terminal 100 will lock the screen or lock part of the Function, when it is detected that the user completes the corresponding unlocking task; or after receiving relevant data about the user performing the unlocking task sent by other home devices, and confirming that the user has completed the relevant task, the mobile terminal 100 will unlock.
  • the mobile terminal 100 when the mobile terminal 100 detects that the user is away from home, it may control the home device to perform corresponding operations according to the acquired events recorded in the application program, such as reminding the user to carry items.
  • the mobile terminal 100 can also detect the state of the user, such as leaving home, returning home, sleeping, studying at home, working at home, etc., and applying the smart scene mode provided by the smart home APP according to the user state. For details, refer to the detailed description below, and the embodiment of the present application will not be repeated here.
  • an application can be installed in the mobile terminal 100.
  • a user can install a "smart home” application in the mobile terminal 100, and the user can communicate with the server through the "smart home” application. 300, and the server 300 controls the home device 200.
  • the above-mentioned "smart home" application program may be a third-party application program installed on the electronic device, a system application program, a system service component, or a small program that can be called without installation, and this embodiment of the present application does not make any limit.
  • System applications refer to applications provided or developed by the manufacturer of the mobile terminal 100
  • third-party applications refer to applications not provided or developed by the manufacturer of the mobile terminal 100 .
  • the manufacturer of the mobile terminal 100 may include the manufacturer, supplier, provider or operator of the mobile terminal 100 .
  • a manufacturer may refer to a manufacturer that processes and manufactures electronic equipment with self-made or purchased parts and raw materials.
  • a supplier may refer to a manufacturer that provides the complete machine, raw materials or parts of the electronic device.
  • An operator may refer to a manufacturer responsible for distribution of the electronic device.
  • “smart home” is just a name that the application may use.
  • the application of “smart home” may also be called, for example, “, “smart home”, “smart life” and other nouns, their names do not constitute any restrictions on this embodiment.
  • the functions that can be realized by “smart home” have been recorded in the method embodiments below, and will not be repeated here .
  • the home device 200 refers to a home appliance formed by introducing microprocessor, sensor technology, and network communication technology into the home device. Therefore, when a home device is connected to the Internet, it also has the attributes of a social network. Therefore, home devices can also be understood as IoT home appliances.
  • the home equipment 200 may specifically include: air conditioners, televisions, projection equipment, smart speakers, smart door locks, smart lights, smart windows, smart curtains, smart body fat scales, treadmills, smart rice cookers, smart Electric kettle and so on.
  • the above-mentioned home device 200 has an automatic sensing function, and the sensing objects of the home device 200 include not only sensing time and temperature, but also sensing the user's emotion, user's action, user's behavior habits and so on. Furthermore, the status of the residential space, the status of the home appliance itself, the service status of the home appliance, and the status of family members can be obtained. Afterwards, some intelligent operations can be performed according to the obtained residential space status, home appliance status, home appliance service status, family member status, etc., that is to say, the home equipment can realize automatic control; Part of it can be connected with the mobile terminal 100 and other home appliances, homes, and facilities in the house to form a system.
  • the home device 200 can receive control instructions from the home user in the house or remotely through the mobile terminal, and perform linkage control on all the home devices 200 in the home. . It is worth noting that, in addition to automatically setting and controlling the home device 200 according to the state of the residential space and the state of the user, the user can perform personalized settings according to his own habits.
  • the home device 200 may execute corresponding events according to the control instruction sent by the mobile terminal 100 or according to the control instruction sent by the mobile terminal 100 through the server 300 .
  • the control instruction sent by the mobile terminal 100 may be executed according to the control instruction sent by the mobile terminal 100 through the server 300 .
  • the home device 200 may send relevant data about the user's execution of the unlocking task to the mobile terminal 100, so that the mobile terminal 100 can determine whether the user has completed the unlocking task.
  • the home device 200 may perform continuous identity authentication on the user. For details, refer to the detailed description below, and the embodiment of the present application will not be repeated here.
  • the home device 200 may detect the user's status, and send the detected user data to the mobile terminal 100 for the mobile terminal 100 to judge the user's status.
  • the embodiment of the present application will not be repeated here.
  • the server 300 refers to a computer that runs faster and has a higher load than ordinary computers.
  • the server 300 has high-speed CPU computing capability, long-term reliable operation, powerful I/O external data throughput capability and better scalability.
  • the server 300 can provide computing or application services for the mobile terminal 100, the home device 200, etc. in the network.
  • the server may be, but not limited to, a web server, a database server, a cloud server, and the like.
  • FIG. 2A-2B , FIG. 3 , and FIG. 4 exemplarily show the software and hardware architectures of various devices and servers involved in the communication system 10 .
  • FIG. 2A schematically shows the hardware structure of the mobile terminal 100 .
  • the mobile terminal 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2.
  • Mobile communication module 150 wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, And a subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the mobile terminal 100 .
  • the mobile terminal 100 may include more or fewer components than shown in the illustration, or combine some components, or separate some components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit, NPU
  • the controller may be the nerve center and command center of the mobile terminal 100 .
  • the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is a cache memory.
  • the memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
  • processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input and output
  • subscriber identity module subscriber identity module
  • SIM subscriber identity module
  • USB universal serial bus
  • the processor 110 may detect the identity of the user, and determine the control authority of the home device corresponding to the user according to the identity of the user. If the user has the right to control a certain home device, the processor 110 can call the mobile communication module 150 or the wireless communication module 160 to send a control command to the corresponding home device through the server 300, or the processor 110 can call the wireless communication module 160 to directly Send a control command to the corresponding home device. In addition, the processor 110 can also call the display screen 194 to display the status information of the household device. For details, refer to the related descriptions of the method embodiment and the UI embodiment later, and details are not described here.
  • the processor 110 detects whether the user breaks the usage rules according to the set usage rules of the mobile terminal 100, and if the user breaks the usage rules, the processor can control the mobile terminal 100 to lock, or control the movement The terminal 100 locks some functions.
  • the processor 110 may also invoke the display screen 194 to display prompt information for unlocking the mobile terminal 100 .
  • the processor 110 may call the "smart home" application program to obtain the user's schedule-related data recorded by Zhang Gong of the application program, and send the schedule-related data to the server 300, and the server 300 is used to obtain determine the user's schedule, and set control rules for one or more home devices according to the user's schedule.
  • the processor 110 may locally determine the user's schedule according to the acquired schedule-related data, and set control rules for one or more home devices according to the user's schedule.
  • the I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL).
  • processor 110 may include multiple sets of I2C buses.
  • the processor 110 can be respectively coupled to the touch sensor 180K, the charger, the flashlight, the camera 193 and the like through different I2C bus interfaces.
  • the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the mobile terminal 100 .
  • the I2S interface can be used for audio communication.
  • processor 110 may include multiple sets of I2S buses.
  • the processor 110 may be coupled to the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170 .
  • the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.
  • the PCM interface can also be used for audio communication, sampling, quantizing and encoding the analog signal.
  • the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface.
  • the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • a UART interface is generally used to connect the processor 110 and the wireless communication module 160 .
  • the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function.
  • the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.
  • the MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 .
  • MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc.
  • the processor 110 communicates with the camera 193 through the CSI interface to realize the shooting function of the mobile terminal 100 .
  • the processor 110 communicates with the display screen 194 through the DSI interface to realize the display function of the mobile terminal 100 .
  • the GPIO interface can be configured by software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface can be used to connect the processor 110 with the camera 193 , the display screen 194 , the wireless communication module 160 , the audio module 170 , the sensor module 180 and so on.
  • the GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc.
  • the USB interface 130 is an interface conforming to the USB standard specification, specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 130 can be used to connect a charger to charge the mobile terminal 100, and can also be used to transmit data between the mobile terminal 100 and peripheral devices. It can also be used to connect headphones and play audio through them. This interface can also be used to connect other electronic devices, such as AR devices.
  • the interface connection relationship between the modules shown in the embodiment of the present application is only a schematic illustration, and does not constitute a structural limitation of the mobile terminal 100 .
  • the mobile terminal 100 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.
  • the charging management module 140 is configured to receive a charging input from a charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 140 can receive charging input from the wired charger through the USB interface 130 .
  • the charging management module 140 can receive wireless charging input through the wireless charging coil of the mobile terminal 100 . While the charging management module 140 is charging the battery 142 , it can also supply power to the mobile terminal 100 through the power management module 141 .
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 .
  • the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 141 may also be disposed in the processor 110 .
  • the power management module 141 and the charging management module 140 may also be set in the same device.
  • the wireless communication function of the mobile terminal 100 can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in mobile terminal 100 can be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the mobile terminal 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves through the antenna 1 for radiation.
  • at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.
  • a modem processor may include a modulator and a demodulator.
  • the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is passed to the application processor after being processed by the baseband processor.
  • the application processor outputs sound signals through audio equipment (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194 .
  • the modem processor may be a stand-alone device.
  • the modem processor may be independent from the processor 110, and be set in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the mobile terminal 100 including wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110.
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the antenna 1 of the mobile terminal 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the mobile terminal 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc.
  • GSM global system for mobile communications
  • GPRS general packet radio service
  • code division multiple access code division multiple access
  • CDMA broadband Code division multiple access
  • WCDMA wideband code division multiple access
  • time division code division multiple access time-division code division multiple access
  • TD-SCDMA time-division code division multiple access
  • the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • Beidou navigation satellite system beidou navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the mobile terminal 100 can establish a communication connection with the server 300 through the mobile communication module 150 and the wireless communication module 160, and then request a service from the server 300, and the server can control the home device 200 in response to the request.
  • the mobile terminal 100 may establish a communication connection with the home device 200 through the wireless communication module 160, and control the home device 200 based on the communication connection.
  • the mobile terminal 100 realizes the display function through the GPU, the display screen 194 , and the application processor.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos and the like.
  • the display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.
  • the mobile terminal 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
  • the display screen 194 can display the service status of the home device 200 provided by the "Smart Home” application program, the information of family members, the status of the residential space, etc., for details, please refer to the following method embodiments and UI implementation Description of the example.
  • a fingerprint sensor 180H is further arranged in the display screen 194 , also known as an under-screen fingerprint. Specifically, when the electronic device turns on fingerprint identification, the fingerprint collection area in the display screen 194 will emit light through the display panel to illuminate the user's fingerprint texture, and the reflected light from the fingerprint will pass through the panel and return to the image sensor, finally forming a fingerprint image for processing. identify.
  • the display screen 194 may be used to display prompt information to prompt the user that the identity authentication is successful or that the identity authentication fails.
  • the electronic device prompts the user that the identity authentication fails, it will also prompt the user to adopt the next authentication method for identity authentication.
  • the prompt information displayed on the display screen 194 please refer to the relevant description of the UI embodiment later. I won't go into details for now.
  • the mobile terminal 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.
  • the ISP is used for processing the data fed back by the camera 193 .
  • the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be located in the camera 193 .
  • Camera 193 is used to capture still images or video.
  • the object generates an optical image through the lens and projects it to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other image signals.
  • the mobile terminal 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
  • the camera 193 may be used to collect user facial images for the mobile terminal 100 to perform face recognition.
  • the camera 193 may be used to collect images of the user's environment for the mobile terminal 100 to determine the user's status, such as driving, exercising, and doing housework.
  • the camera 193 can be used to capture the picture of the two-dimensional code, and then the "smart home" application program of the mobile terminal 100 can recognize the information corresponding to the two-dimensional code, such as the identification of the public place to which the two-dimensional code belongs, name etc.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the mobile terminal 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the mobile terminal 100 may support one or more video codecs.
  • the mobile terminal 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the mobile terminal 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • the internal memory 121 may include one or more random access memories (random access memory, RAM) and one or more non-volatile memories (non-volatile memory, NVM).
  • RAM random access memory
  • NVM non-volatile memory
  • the NVM can store the information of the area the user has visited and the time spent in the area.
  • Random access memory can include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (synchronous dynamic random access memory, SDRAM), double data rate synchronous Dynamic random access memory (double data rate synchronous dynamic random access memory, DDR SDRAM, such as the fifth generation DDR SDRAM is generally called DDR5SDRAM), etc.;
  • SRAM static random-access memory
  • DRAM dynamic random access memory
  • SDRAM synchronous dynamic random access memory
  • SDRAM synchronous dynamic random access memory
  • double data rate synchronous Dynamic random access memory double data rate synchronous dynamic random access memory
  • DDR SDRAM double data rate synchronous dynamic random access memory
  • DDR SDRAM double data rate synchronous dynamic random access memory
  • DDR5SDRAM double data rate synchronous dynamic random access memory
  • Non-volatile memory may include magnetic disk storage devices, flash memory (flash memory).
  • flash memory can include NOR FLASH, NAND FLASH, 3D NAND FLASH, etc.
  • it can include single-level storage cells (single-level cell, SLC), multi-level storage cells (multi-level cell, MLC), triple-level cell (TLC), quad-level cell (QLC), etc.
  • SLC single-level storage cells
  • MLC multi-level storage cells
  • TLC triple-level cell
  • QLC quad-level cell
  • UFS universal flash storage
  • embedded multimedia memory card embedded multi media Card
  • the random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of an operating system or other running programs, and can also be used to store data of users and application programs.
  • the non-volatile memory can also store executable programs and data of users and application programs, etc., and can be loaded into the random access memory in advance for the processor 110 to directly read and write.
  • the external memory interface 120 can be used to connect an external non-volatile memory, so as to expand the storage capacity of the mobile terminal 100 .
  • the external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and video are stored in an external non-volatile memory.
  • the above-mentioned memory is also used to store the information of the home device, such as the communication identification of the home device; the user's identity information, such as the user's "smart home” login account and password, the user's facial information, fingerprint information , voiceprint information, iris information, etc.; and associated storage of user identity information and permission information, for example: user A has permission for all home devices, and user B has permission for devices in bedroom B and study at home.
  • the above-mentioned memory is also used to store usage rules of the mobile terminal 100, and the usage rules can be set by default by the mobile terminal 100, or can be customized by the user.
  • the use rule may be, for example: specifying the total time of daily use of the mobile terminal 100, the number of daily uses, and the time of each use, or specifying the total time of daily use of a certain or a certain type of application program installed in the mobile terminal 100, The number of uses per day, the time of each use, etc.
  • the memory is further used to store user schedule-related data
  • the user schedule-related data includes at least one of the following: social records, short messages, call records, emails, electronic notes, memos, and the like.
  • the mobile terminal 100 can implement audio functions through an audio module 170 , a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor. Such as music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • the audio module 170 may also be used to encode and decode audio signals.
  • the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .
  • Speaker 170A also referred to as a "horn" is used to convert audio electrical signals into sound signals.
  • the mobile terminal 100 can listen to music through the speaker 170A, or listen to a hands-free call.
  • Receiver 170B also called “earpiece” is used to convert audio electrical signals into sound signals.
  • the receiver 170B can be placed close to the human ear to listen to the voice.
  • the microphone 170C also called “microphone” or “microphone” is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can put his mouth close to the microphone 170C to make a sound, and input the sound signal to the microphone 170C.
  • the mobile terminal 100 may be provided with at least one microphone 170C. In some other embodiments, the mobile terminal 100 may be provided with two microphones 170C, which may also implement a noise reduction function in addition to collecting sound signals. In some other embodiments, the mobile terminal 100 can also be provided with three, four or more microphones 170C, to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions, etc.
  • the earphone interface 170D is used for connecting wired earphones.
  • the earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the mobile terminal 100 can provide voiceprint authentication for the user through the above-mentioned audio module 170, such as prompting the user to input a voice signal through the speaker 170A/receiver 170B, and then collecting the voice signal input by the user through the microphone 170C for use in The processor matches the sound signal with the pre-stored sound signal, and then determines whether the voiceprint authentication is passed.
  • voiceprint authentication for the user through the above-mentioned audio module 170, such as prompting the user to input a voice signal through the speaker 170A/receiver 170B, and then collecting the voice signal input by the user through the microphone 170C for use in
  • the processor matches the sound signal with the pre-stored sound signal, and then determines whether the voiceprint authentication is passed.
  • the audio module 170 is configured to output voice information of the operating status of the bound home devices in the "smart home".
  • the audio module 170 is further configured to output prompt information for breaking the usage rules of the mobile terminal 100 . And when the user leaves home, output the voice prompt information of the to-do list and so on.
  • the pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal.
  • the pressure sensor 180A may be located on the display screen 194 .
  • pressure sensors 180A such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors.
  • a capacitive pressure sensor may be comprised of at least two parallel plates with conductive material.
  • touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view short messages is executed. When a touch operation whose intensity is greater than or equal to the first pressure threshold acts on the icon of the short message application, the instruction of creating a new short message is executed.
  • the pressure sensor 180A can be used to collect pressure data that the user acts on the keys or the display screen, and the mobile terminal 100 can perform identity authentication according to the user's past operating habits.
  • the gyro sensor 180B can be used to determine the motion posture of the mobile terminal 100 .
  • the angular velocity of the mobile terminal 100 around three axes ie, x, y and z axes
  • the gyro sensor 180B can be used for image stabilization.
  • the gyro sensor 180B detects the shaking angle of the mobile terminal 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to counteract the shaking of the mobile terminal 100 through reverse movement to achieve anti-shake.
  • the gyro sensor 180B can also be used for navigation and somatosensory game scenes.
  • the air pressure sensor 180C is used to measure air pressure.
  • the mobile terminal 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
  • the magnetic sensor 180D includes a Hall sensor.
  • the mobile terminal 100 may detect opening and closing of the flip holster using the magnetic sensor 180D.
  • the mobile terminal 100 when the mobile terminal 100 is a clamshell machine, the mobile terminal 100 can detect the opening and closing of the clamshell according to the magnetic sensor 180D.
  • features such as automatic unlocking of the flip cover are set.
  • the acceleration sensor 180E can detect the acceleration of the mobile terminal 100 in various directions (generally three axes).
  • the magnitude and direction of gravity can be detected when the mobile terminal 100 is stationary. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.
  • the distance sensor 180F is used to measure the distance.
  • the mobile terminal 100 may measure the distance through infrared or laser. In some embodiments, when shooting a scene, the mobile terminal 100 can use the distance sensor 180F for distance measurement to achieve fast focusing.
  • Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes.
  • the light emitting diodes may be infrared light emitting diodes.
  • the mobile terminal 100 emits infrared light outwards through the light emitting diode.
  • the mobile terminal 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it may be determined that there is an object near the mobile terminal 100 . When insufficient reflected light is detected, the mobile terminal 100 may determine that there is no object near the mobile terminal 100 .
  • the mobile terminal 100 can use the proximity light sensor 180G to detect that the user is holding the mobile terminal 100 close to the ear to make a call, so as to automatically turn off the screen to save power.
  • the proximity light sensor 180G can also be used in leather case mode, automatic unlock and lock screen in pocket mode.
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the mobile terminal 100 can use the collected fingerprint features to realize fingerprint unlocking, access to the application lock, take pictures with fingerprints, answer incoming calls with fingerprints, and so on.
  • the temperature sensor 180J is used to detect temperature.
  • the mobile terminal 100 uses the temperature detected by the temperature sensor 180J to implement a temperature handling strategy. For example, when the temperature reported by the temperature sensor 180J exceeds the threshold, the mobile terminal 100 may reduce the performance of the processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection.
  • the mobile terminal 100 when the temperature is lower than another threshold, the mobile terminal 100 heats the battery 142 to prevent the mobile terminal 100 from being shut down abnormally due to the low temperature.
  • the mobile terminal 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
  • the temperature sensor 180J and the humidity sensor can also detect data related to ambient temperature and ambient humidity, so that the mobile terminal 100 can automatically control household devices according to the current ambient temperature.
  • Touch sensor 180K also known as "touch panel”.
  • the touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”.
  • the touch sensor 180K is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to the touch operation can be provided through the display screen 194 .
  • the touch sensor 180K may also be disposed on the surface of the mobile terminal 100 , which is different from the position of the display screen 194 .
  • the ambient light sensor 180L is used for sensing ambient light brightness.
  • the mobile terminal 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness.
  • the ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures.
  • the ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the mobile terminal 100 is in the pocket, so as to prevent accidental touch.
  • the touch sensor 180K can be used to collect the user's touch operation on the display screen to determine the character password or pattern input by the user. password etc.
  • the bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the human pulse and receive the blood pressure beating signal. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone, combined into a bone conduction earphone.
  • the audio module 170 can analyze the voice signal based on the vibration signal of the vibrating bone mass of the vocal part acquired by the bone conduction sensor 180M, so as to realize the voice function.
  • the application processor can analyze the heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 180M, so as to realize the heart rate detection function.
  • the ECG sensor can be used to collect the user's ECG data, and then determine the user's state, such as whether it is in a state of exercise.
  • the keys 190 include a power key, a volume key and the like.
  • the key 190 may be a mechanical key. It can also be a touch button.
  • the mobile terminal 100 may receive key input and generate key signal input related to user settings and function control of the mobile terminal 100 .
  • the motor 191 can generate a vibrating reminder.
  • the motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
  • touch operations applied to different applications may correspond to different vibration feedback effects.
  • the motor 191 can also correspond to different vibration feedback effects for touch operations on different areas of the display screen 194 .
  • Different application scenarios for example: time reminder, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.
  • the SIM card interface 195 is used for connecting a SIM card.
  • the SIM card can be connected and separated from the mobile terminal 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 .
  • the mobile terminal 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards may be the same or different.
  • the SIM card interface 195 is also compatible with different types of SIM cards.
  • the SIM card interface 195 is also compatible with external memory cards.
  • the mobile terminal 100 interacts with the network through the SIM card to implement functions such as calling and data communication.
  • the mobile terminal 100 adopts an eSIM, that is, an embedded SIM card.
  • the eSIM card can be embedded in the mobile terminal 100 and cannot be separated from the mobile terminal 100 .
  • the software system of the mobile terminal 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.
  • a mobile operating system with a layered architecture is taken as an example to illustrate the software structure of the mobile terminal 100 .
  • FIG. 2B exemplarily shows a software structural block diagram of the mobile terminal 100 according to the embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces.
  • the mobile operating system is divided into four layers, which are application program layer, program framework layer/core service layer, underlying library and runtime, and kernel layer from top to bottom.
  • the application layer can consist of a series of application packages.
  • the application package may include applications such as "smart home”, camera, memo, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
  • applications such as "smart home", camera, memo, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
  • the "smart home” application program can be bound to the family member to form a family group, and can also be bound to family devices, including family members' mobile terminals and family devices. Users can manage and control home devices through the "Smart Home” application, or the "Smart Home” application can automatically control the bound home devices and display corresponding prompt information.
  • the program framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application program layer.
  • the program framework layer includes some pre-defined functions.
  • the program framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • Content providers are used to store and retrieve data and make it accessible to applications.
  • Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on.
  • the view system can be used to build applications.
  • a display interface can consist of one or more views.
  • a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide a communication function of the mobile terminal 100 .
  • the management of call status including connected, hung up, etc.).
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.
  • the notification manager is used to notify the download completion, message reminder, etc.
  • the notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window.
  • prompting text information in the status bar issuing a prompt sound, vibrating the electronic device, and flashing the indicator light, etc.
  • Runtime can refer to all the code libraries, frameworks, etc. required for the program to run.
  • the runtime includes a series of function libraries required for the operation of the C program.
  • the runtime in addition to the core library, the runtime also includes the virtual machine required for the Java program to run.
  • the above-mentioned core library may include functions that need to be called by the Java language.
  • the underlying library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • surface manager surface manager
  • media library Media Libraries
  • 3D graphics processing library eg: OpenGL ES
  • 2D graphics engine eg: SGL
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.
  • the workflow of the software and hardware of the mobile terminal 100 will be exemplarily described below in conjunction with capturing and photographing scenes.
  • a corresponding hardware interrupt is sent to the kernel layer.
  • the kernel layer processes touch operations into original input events (including touch coordinates, time stamps of touch operations, and other information). Raw input events are stored at the kernel level.
  • the application framework layer obtains the original input event from the kernel layer, and identifies the control corresponding to the input event. Take the touch operation as a touch click operation, and the control corresponding to the click operation is the control of the camera application icon as an example.
  • the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer.
  • Camera 193 captures still images or video.
  • one or more electronic devices involved in the communication system 10 such as the electronic device 101, the electronic device 102, and the electronic device 103, etc., have the same software and hardware architecture as the mobile terminal 100, and you can refer to the above Figure 2A- The detailed description of FIG. 2B is not repeated in this embodiment of the present application.
  • FIG. 3 is a block diagram of a hardware structure of a home device 200 provided by an embodiment of the present application.
  • home device 200 may include: one or more processors 201 , memory 202 , communication interface 203 , transmitter 205 , receiver 206 , coupler 207 and antenna 208 . These components can be connected through the bus 204 or in other ways, and FIG. 3 takes the connection through the bus as an example. in:
  • Processor 201 may be used to read and execute computer readable instructions. Specifically, the processor 201 can be used to call a program stored in the memory 202, such as the method for controlling the home device 200 to perform a certain operation provided by the embodiment of the present application, implement the program on the side of the home device 200, and execute the program Included directives.
  • a program stored in the memory 202 such as the method for controlling the home device 200 to perform a certain operation provided by the embodiment of the present application, implement the program on the side of the home device 200, and execute the program Included directives.
  • the memory 202 is coupled with the processor 201 for storing various software programs and/or sets of instructions.
  • the memory 202 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices or other non-volatile solid-state storage devices.
  • the memory 202 can store an operating system (hereinafter referred to as the system), such as uCOS, VxWorks, RTLinux and other embedded operating systems.
  • the memory 202 can also store a network communication program, which can be used to communicate with the server 300, the mobile terminal 100 and so on.
  • the memory 202 of the home device 200 may store user information, such as the user's operating habits, user facial information, fingerprint information, voiceprint information, and the like.
  • the information of the home device includes a communication identifier of the home device and the like.
  • the server 300 may send information to the home device according to the communication identifier. For example, sending a control command to the home device, feeding back the status of the home device to the mobile terminal, and so on.
  • the communication interface 203 can be used for the server 300 to communicate with other communication devices, such as the mobile terminal 100, the home device 200 and so on.
  • the communication interface 203 may be a 3G communication interface, a long-term evolution (LTE) (4G) communication interface, a 5G communication interface, a WLAN communication interface, a WAN communication interface, and the like.
  • LTE long-term evolution
  • the server 300 may also be configured with a wired communication interface 203 to support wired communication.
  • the transmitter 205 and receiver 206 can be regarded as a wireless modem.
  • the transmitter 205 can be used for transmitting the signal output by the processor 201 .
  • Receiver 206 may be used to receive signals.
  • Antenna 208 may be used to convert electromagnetic energy in a transmission line to electromagnetic waves in free space, or to convert electromagnetic waves in free space to electromagnetic energy in a transmission line.
  • the coupler 207 can be used to split the mobile communication signal into multiple paths and distribute them to multiple receivers 206 . Understandably, the antenna 208 of the network device may be implemented as a large-scale antenna array.
  • server 300 shown in FIG. 3 is only an implementation manner of the embodiment of the present application. In practical applications, the server 300 may include more or fewer components, which is not limited here.
  • FIG. 4 is a block diagram of a hardware structure of a server 300 provided by an embodiment of the present application.
  • the server 300 may include: one or more processors 301 , memory 302 , communication interface 303 , transmitter 305 , receiver 306 , coupler 307 and antenna 308 . These components may be connected via the bus 304 or in other ways, and FIG. 4 takes the connection via the bus as an example. in:
  • Processor 301 may be used to read and execute computer readable instructions. Specifically, the processor 301 can be used to call the program stored in the memory 302, such as the method for controlling the home device 200 to perform a certain operation provided by the embodiment of the present application, implement the program on the side of the home device 200, and execute the program Included directives.
  • the memory 302 is coupled with the processor 301 and is used for storing various software programs and/or sets of instructions.
  • the memory 302 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
  • the memory 302 can store an operating system (hereinafter referred to as the system), such as uCOS, VxWorks, RTLinux and other embedded operating systems.
  • the memory 302 can also store a network communication program, which can be used to communicate with the server 300, the mobile terminal 100 and so on.
  • the storage 302 of the server 300 may store registration information for the user to register the "smart home" application program.
  • the user's registration information includes user account number, password, and user's biological characteristics, such as fingerprint, face, voiceprint information, etc., as well as the user's private space in the family, etc.
  • the server 300 can establish a communication connection with the mobile terminal 100 through the communication interface 303, and provide application services for the mobile terminal 100 based on the communication connection.
  • the memory 302 of the server 300 may store the information of the family device 200 in the family, and the information of the family device 200 includes: the communication identification of the family device, the location information of the family device in the family space, and the like.
  • the memory 302 of the server 300 may store usage rules for home devices, and the usage rules may be the default settings of the server 300, or the default settings of the mobile terminal and uploaded to the server 300, or may be User setting, the specific user can directly write the usage rules into the server 300 , or the user can set the usage rules in the mobile terminal 100 , and the mobile terminal 100 uploads the usage rules to the server 300 .
  • the embodiment of the present application does not limit this.
  • the restriction object of the above usage rules may be any one or more home devices, and the home devices may be the mobile terminal 100 and/or the home device 200 .
  • the above usage rules may be, for example: restrictions on the total daily usage time of the mobile terminal 100-1, daily usage times, each usage duration, usage functions, and APP usage restrictions.
  • the usage function can be, for example, a payment function, the function of deleting social records such as text messages and phone calls, etc.
  • the usage APP can be, for example, a live broadcast APP, a game APP, an online gambling APP, and the like. Or you can also set the use of some functions in a certain APP or the time and times of using a certain APP. The embodiment of the present application does not limit this.
  • the memory 302 of the server 300 may also store user schedule-related data sent by the user mobile terminal 100, and the server 300 is used to determine the user's schedule according to the acquired schedule-related data, and according to the user's A schedule that sets control rules for one or more home devices.
  • the above user schedule-related data includes any one or more of the following: social records, text messages, call records, emails, electronic notes, memos, etc.
  • the “Smart Home” app is an app for controlling home devices.
  • the “smart home” application program needs to obtain the following functions in the mobile terminal 100: phone, positioning, Bluetooth; and read the following data: the user's personal information, such as Huawei account number, login password, nickname, avatar, device And network information, such as device identifier, device name, model, version, manufacturer, MAC address, IP address, device operating status, custom attributes, setting parameters, device events and usage records, for discovering and binding devices, Carry out control, management and upgrades, etc.; also use the data required for device services, including: device detection and recorded data, used to view the working status, detection data, statistical reports and historical records of the device; data required for problem location such as Application and device log information.
  • the communication interface 303 can be used for the server 300 to communicate with other communication devices, such as the mobile terminal 100, the home device 200 and so on.
  • the communication interface 303 may be a 3G communication interface, a long-term evolution (LTE) (4G) communication interface, a 5G communication interface, a WLAN communication interface, a WAN communication interface, and the like.
  • LTE long-term evolution
  • the server 300 may also be configured with a wired communication interface 303 to support wired communication.
  • the server 300 may receive the registration information sent by the mobile terminal 100 through the communication interface 303 for the user to register the "smart home” application program, as well as the control instructions for the home equipment, and the status of the home equipment fed back by the home equipment. information, status information of the family environment, status information of family members, and so on.
  • the transmitter 305 and the receiver 306 can be regarded as a wireless modem.
  • the transmitter 305 may be used to perform transmission processing on the signal output by the processor 301 .
  • Receiver 306 may be used to receive signals.
  • the number of transmitters 305 and receivers 306 can be one or more.
  • Antenna 308 may be used to convert electromagnetic energy in a transmission line to electromagnetic waves in free space, or to convert electromagnetic waves in free space to electromagnetic energy in a transmission line.
  • the coupler 307 can be used to split the mobile communication signal into multiple paths and distribute them to multiple receivers 306 . Understandably, the antenna 308 of the network device may be implemented as a large-scale antenna array.
  • server 300 shown in FIG. 4 is only an implementation manner of the embodiment of the present application. In practical applications, the server 300 may include more or fewer components, which is not limited here.
  • FIG. 5A-FIG. 5D exemplarily show schematic diagrams introducing concepts related to "family”.
  • Family members are a name for different relationships between users under the concept of being at home. In today's society, there is a relationship of organization and division of labor between users under the family. That is to say, in a family, it is necessary to distinguish the roles of each member, for example, it can be divided into four roles: family creator, administrator, common user, designated user, and family visitor. The four member roles respectively have different levels of control authority for the home device. in,
  • Family owner or creator equivalent to the head of the family, can create a family.
  • the family owner has the highest permission level, that is, the creator's permission level is the first permission level.
  • the creator can manage all family members and control all family devices, etc. Including adding and deleting family members, setting roles played by family members, device control permissions they have, and so on.
  • the administrator has the second-highest authority, that is to say, the authority level of the administrator is the second-level authority level.
  • the administrator is responsible for managing everything about the family, such as adding, deleting, and modifying rooms, members, and devices.
  • there may be multiple administrators in a family for example, parents or grandparents in the family may all be administrators of this family.
  • Ordinary users can only use home devices, and the permission level of ordinary users to use home devices is usually lower than that of family administrators.
  • Designated users users with limited behavioral abilities such as the elderly and children.
  • Designated users like ordinary users, only have the right to use family devices, but the scope of authority may be different. For example, when designated users are elderly, children and other users with limited behavioral capabilities, their scope of use authority does not include kitchen appliances with a high risk index equipment etc.
  • Family visitors can also be called temporary users, which refer to non-resident users of the family, such as housekeepers, tutors, etc., such users will only appear in the family within a certain period of time and use the devices in the home. When a home visitor is not in the home space, they do not have permission to control home devices.
  • FIG. 5A schematically shows the family members included in a family, and the roles played by the family members in the family relationship.
  • the family members specifically include Xiaozhong, Xiaohua, Huaweing, Xiaohong, Xiaoai, Xiaoyu, Xiaoxue and so on.
  • Xiao Zhong and Xiao Hua are Xiao Ai's parents respectively, Xiao Ming and Xiao Hong are Xiao Ai's grandparents respectively, Xiao Yu is a visitor of the family, Xiao Yu can be Xiao Ai's tutor, or Xiao Hua's personal trainer etc., and Xiaoxue may be a housekeeper, usually taking care of the young Xiaoai, or the daily life of the elderly Huaweing or Xiaohong, as well as family hygiene and so on.
  • each of the aforementioned family members may be equipped with one or more mobile terminals, such as mobile phones, tablets, notebooks, smart watches, and the like.
  • mobile terminals such as mobile phones, tablets, notebooks, smart watches, and the like.
  • Xiaozhong's mobile terminal 100-1 Xiaohua's mobile terminal 100-2, Huaweing's mobile terminal 100-3, Xiaohong's mobile terminal 100-4, Xiaoai's mobile terminal 100-5 and mobile terminal 100- 6.
  • These terminal devices all belong to the communication system of the small and medium-sized smart home, and each terminal device can communicate with each other.
  • FIG. 5B exemplarily shows the respective permission levels of the family members in the small.
  • the creator of Xiaozhong's home is Xiaozhong himself, and the authority level of the creator is level one.
  • the first-level authority can manage all family members and control all family devices, etc. Including adding and deleting family members, setting roles played by family members, device control permissions they have, and so on.
  • Xiaohua and Xiaohong are administrators, and the authority level of administrators is the second level authority level.
  • the scope of the secondary authority includes managing all of the family, such as adding, deleting, modifying, etc. for rooms, members, and equipment. In addition, they can only control and use the equipment in the room they own.
  • Xiao Ming and Xiao Ai are designated users, and they have three levels of authority.
  • the scope of the third-level authority includes only the authority to control the use of household equipment, but the scope of control is the equipment in the room owned by oneself, and except for kitchen appliances with a high risk index.
  • Xiaoyu and Xiaoxue are family visitors, and their permission level is level four.
  • the scope of the four-level permission includes that only the family visitor is in the family space, and has the right to control the family device.
  • the division of roles and levels of family members is only an example.
  • different designated users ie, the elderly and children, may have different authority levels, etc., which is not limited in the embodiment of the present application.
  • the above permission levels include the management of rooms, family members, and family devices. Next, based on the room owned by the family member, the permission of the family member to control the home device will be specifically introduced, so details will not be repeated here.
  • Family is not only a concept of personal relationship between users, but also a mapping of physical space. In smart home scenarios, the most common spatial concept is a room. According to the physical building, in addition to the flat rooms, there are also three-dimensional floors. However, for the vast majority of family buildings in the society, there are far more one-story family houses than villas or duplex houses. Therefore, the embodiment of the present application only introduces one-story family spaces. .
  • FIG. 5C exemplarily shows the family layout structure.
  • the layout structure of the family includes: bedroom A, bedroom B, bedroom C, living room, kitchen, study room, gymnasium, entertainment room and so on.
  • bedroom A belongs to the private space of Xiao Zhong and Xiao Hua
  • bedroom B belongs to Xiao Ming and Xiao Hua's private space
  • bedroom C belongs to Xiao Ai
  • the living room, kitchen, study room, entertainment room and gym are family members. public areas.
  • Xiao Ai is still a child, in order to protect Xiao Ai's safety, Xiao Ai is prohibited from operating household equipment in the kitchen without adult supervision.
  • the private space and the public space are customized according to the actual situation of different families, that is to say, the bedroom is not necessarily a private space, for example, if a family has a baby, the baby room is the bedroom of the baby. But for a baby, she does not yet have the ability to act independently, and she always needs to be looked after by other people in the family. Obviously, there is no privacy space. On the contrary, for children like Xiao Ai, they long for their own private space. Therefore, the private space and public space defined in the embodiments of the present application are not absolute concepts and are not limited.
  • the family space has another important role—device binding, which can also be understood as the spatial classification of devices. This is because, in a family, most devices, almost all household devices except mobile terminals are fixed in a certain room. Therefore, when a user is looking for a certain device or controlling or using a certain device, as long as he knows the room the device belongs to and remembers the room where the device is located, he can quickly find the device. In addition, although all members of a family have a very close relationship, everyone is an individual and needs their own private space. Therefore, a family is actually divided into multiple spaces, with their own private space, There is also a public space that belongs to everyone, which can not only protect the privacy of individuals, but also enhance the relationship between family members.
  • FIG. 5D exemplarily shows the layout structure of the home space, and a schematic diagram of the home equipment equipped in each space.
  • home devices 200 there are multiple home devices 200 in the family, which may include: home device 200-1, home device 200-2, home device 200-3, home device 200-4, home device 200-5, home device 200-6 and so on.
  • the above-mentioned household equipment can specifically be televisions, refrigerators, air conditioners, washing and drying machines, smoke stoves, kitchen appliances, air purifiers, fresh air fans, humidification and dehumidifiers, sweepers, cameras, door locks, electric curtains, drinking fountains, lights and other smart home appliances. equipment.
  • the above-mentioned mobile terminals, home devices, etc. all belong to the family devices in the family, and an interconnected communication system can be obtained by networking all the family devices.
  • the communication system is shown in Figure 1B above.
  • the above-mentioned series of mobile terminals all belong to the mobile terminal 100 in the above-mentioned communication system 10
  • the above-mentioned series of home devices all belong to the home device 200 in the above-mentioned communication system 10 .
  • the communication system 10 may also be called a "smart home" system.
  • the user can download and install the "smart home” application program in the mobile terminal, register and log in an account in the "smart home”, bind home devices, and so on. After that, the user can view, manage, and control home devices, electronic devices, etc. through the application.
  • the definition of the "smart home” application program can refer to the previous introduction, so I won't go into details here.
  • Figures 5A-5D only introduce the family scene, including the family space and the relationship between family members.
  • the method provided by the embodiment of the present application can also be applied to the office scene, and the office space and company employees will not be described here.
  • 6A-6V, 7A-7I exemplarily illustrate related operations for a user to create a "smart home".
  • the specific operations of creating a "smart home” can include:
  • Add home devices including binding the devices to the home and configuring the network for the home devices.
  • Device distribution refers to the process of connecting devices to the Internet, so that after the devices are powered on, they can transmit data with the "smart home" platform.
  • the family creator that is, the family owner can also manage the added family devices, including: deleting, replacing, classifying, and so on.
  • FIG. 6A uses the mobile terminal 100-1 of Dad Xiaozhong as an example to introduce the schematic diagram of the user interface provided by the "Smart Home” after the Xiaozhong logs in to the "Smart Home” account.
  • the user interface 61 displays: a family name option 611 , an add control 612 , a device navigation bar 613 , a device display area 614 , and a page navigation bar 615 .
  • the family name is the home of "**”
  • "**" is the account name of the user who is currently logged into the "Smart Family”.
  • the displayed content is the small home.
  • the add control 612 is used to add a home device, that is, to bind the home device with the home in the small business, and configure the network for the home device.
  • the device navigation bar 613 includes: all options 613A, category options 613B.
  • all option 613A is selected, all the home devices that the user has added are displayed in the device display area 614 at this time.
  • the device display area 614 does not display any home devices at this time.
  • the classification option 613B is selected, the user can classify the added home devices, such as dividing the home space of the family device in the small house, etc. For the operation of classifying the home devices, please refer to the detailed description below, which will not be discussed here. repeat.
  • the device display area 614 is used to display all or part of the family devices in the home in the small.
  • the page navigation bar 615 includes: homepage 615A, shopping mall 615B, smart 615C, and my 615D.
  • the home page 615A is used to display the user interface 610 introduced above.
  • the shopping mall 615B is used to jump to the shopping interface and purchase equipment needed by the family, etc.
  • Regarding the sub-pages provided by Smart 615C and My 615D please refer to the detailed description of the UI embodiment below, and details will not be repeated here.
  • FIG. 6B-FIG. 6K exemplarily show related operation interfaces for a user to add a home device.
  • FIG. 6B-FIG. 6E exemplarily show an operation interface of automatically adding a device.
  • the mobile terminal 100-1 displays the user interface 61 shown in FIG. 6A
  • an operation acting on the add control 612 may be detected, and in response to the operation, the mobile terminal 100-1 displays the user interface 62 shown in FIG. 6B.
  • Fig. 6B exemplarily shows a schematic diagram of a user interface of a scanning device.
  • the user interface 62 displays a schematic diagram of a user interface for automatically scanning nearby devices.
  • the mobile terminal 100-1 may automatically enable near-field communication functions such as Bluetooth and WI-FI, send detection signals to nearby devices, and search for nearby devices.
  • the nearby device receives the probe signal, it replies a probe response to the mobile terminal, and the mobile terminal 100-1 displays the user interface 62 shown in FIG. 6C .
  • Fig. 6C exemplarily shows a schematic diagram of a user interface for adding a device.
  • the user interface 62 displays a schematic diagram of the user interface of the scanned nearby devices.
  • the mobile terminals of the accessories include: smart door locks, TVs, cameras, electric curtains and so on.
  • Each scanned device is correspondingly displayed with an add control, and the user can add the scanned device to the family device by clicking the add control corresponding to any one or more devices, that is, bind it to the family.
  • the mobile terminal 100-1 When the mobile terminal 100-1 displays the user interface 62 shown in FIG. 6C, it can detect the operation of adding a control corresponding to the smart door lock, and in response to the operation, the mobile terminal 100-1 displays the user interface shown in FIG. 6D 62.
  • the add control corresponding to the smart door lock is displayed from the original "Add" to "Added".
  • the mobile terminal 100-1 displays the user interface 62 shown in FIG. 6D
  • an operation on the return control may be detected, and in response to the operation, the mobile terminal 100-1 displays the user interface 61 shown in FIG. 6E.
  • the device display area 614 at this time is changed from no device in the device display area 614 shown in FIG. 6A , to the household device that has been added to the home in Xiaozhong, that is, the smart door lock.
  • Fig. 6A-Fig. 6E only exemplarily show a way of adding devices, that is, the mobile terminal 100-1 automatically scans nearby electronic devices, if the nearby electronic devices are powered on, and any one corresponding to the mobile terminal 100-1 is turned on.
  • a probe response can be sent to the mobile terminal 100-1, so that the mobile terminal 100-1 can search for the device, add it to the home device, and configure a network for it.
  • the above enabled wireless connectivity functions include any one or more of the following: WLAN, BT, IR, ZigBee and so on. Therefore, the method of adding a device shown in Fig. 6A-6E can also be referred to as first Bluetooth distribution network, WiFi distribution network, or other ways of network distribution, etc., and bind the device.
  • the user can click the manual adding control 621 shown in FIG. 6B to add a home device.
  • FIG. 6F-FIG. 6K exemplarily show schematic diagrams of an operation interface for a user to manually add a device.
  • the mobile terminal 100-1 detects that the user has acted on the operation of manually adding the control 621, and displays a user interface 63 as shown in FIG. icon.
  • the mobile terminal 100-1 may detect the user's operation of selecting the icon of the home device to be added, and in response to the operation, the mobile terminal 100-1 displays the configuration network user interface 64 as shown in FIG. 6H .
  • the mobile terminal 100-1 detects that the user enters the password of the home Wi-Fi as shown in Figure 6I, and clicks the operation of the next control. In response to this operation, the mobile terminal 100-1 sends the home Wi-Fi password to the TV.
  • the account and password enable the TV to connect to the router through the home Wi-Fi account and password, and communicate with the server 300 in the smart home system.
  • the TV When the TV is connected to the router through the home Wi-Fi account and password, and communicates with the server 300 in the smart home system, it can send a message of successful network distribution to the mobile terminal 100-1, and the mobile terminal 100-1 will display the following: The prompt information of successful network distribution shown in FIG. 6J . It can be understood that before the mobile terminal 100-1 enters the password of the home Wi-Fi and clicks Next, it needs to ensure that the TV is powered on, and the TV can be turned on by pressing and holding the power button or the reset button of the home device. Enter the sniffer mode, which can also be called the promiscuous mode. At this time, the device does not filter data messages, and can monitor all 802.11 messages in the ring. At this time, the user can only configure the network for the home device at the mobile terminal 100-1.
  • the user can add the device by clicking the scan code adding control 622 shown in FIG. 6B , and then scanning the two-dimensional code label attached to the home device.
  • the embodiment of the present application will not be described in detail here.
  • the mobile terminal 100-1 may also configure a network for the home device in other ways, and bind it to the home.
  • the sound wave distribution network that is, the sound wave is sent out through the mobile phone, and the WiFi SSID, password and other information are transmitted to the device.
  • the device identification completes the initialization process and establishes a network connection with the smart home platform.
  • the user can configure the network for the new home device through the above-mentioned various methods, and add it to the home device.
  • FIG. 6K exemplarily shows a schematic diagram of a user interface after adding all family devices in the home to the family devices in Xiaozhong.
  • the device display area 614 on the home page displays: smart door lock, TV A, camera, electric curtain A, body fat scale, desk lamp, electric kettle, rice cooker, refrigerator, TV B, air purifier A, Air conditioner A, smart light A, TV B, electric window B, air conditioner B, etc., are not listed here.
  • the user can browse all home devices by sliding down the device display area 614 in the navigation.
  • FIG. 6L-FIG. 6V exemplarily show schematic diagrams of an operation interface for a user to classify home devices.
  • the mobile terminal 100-1 When the mobile terminal 100-1 detects that the user clicks on the classification option 613B shown in Figure 6K, the mobile terminal 100-1 switches the device display area 614 from all the home devices shown in Figure 6K to the classification shown in Figure 6L some household equipment.
  • the device display area 614 at this time does not display any icons of family devices, because the Xiaozhong has not yet classified the family devices.
  • the mobile terminal 100-1 may detect that the user clicks the category management control 616 shown in FIG. 6L , and in response to the operation, the mobile terminal 100-1 will display the category management user interface 65 shown in FIG. 6M .
  • the category management user interface 65 displays a sort control 651A, an add room control 651B, and a delete control 651C.
  • the sort control 651A is used to sort the display order of the added room types
  • the add room control 651B is used to add room types
  • the delete control 651C is used to delete the added room types.
  • the mobile terminal 100-1 may detect the user's operation of clicking the add room control 651B shown in FIG. 6N , and in response to the operation, the mobile terminal 100-1 will display the category management user interface 65 shown in FIG. 6N .
  • the management user interface 65 displays a window 652 for adding a room.
  • the user can input a custom room name such as "bedroom A”, and then click the confirmation control.
  • the mobile terminal 100-1 displays The user interface 65 is shown in FIG. 6O.
  • the management user interface 65 displays a bedroom A list item 653A, and the list item 653A displays device detail information of bedroom A, for example, 0 devices, which is used to remind the user that no family device has been added to bedroom A.
  • mobile terminal 100-1 may detect the user's operation of clicking list item 653A in FIG. 6O, and in response to the operation, mobile terminal 100-1 will display the detail interface 66 of bedroom A shown in FIG. 6P.
  • the details interface 66 of bedroom A displays an add device control 654A and a delete device control 654B.
  • the mobile terminal 100-1 may detect the user's operation of clicking the add device control 654A in FIG. 6P, and in response to the operation, the mobile terminal 100-1 will pop up the add device window 655 shown in FIG. 6Q.
  • Add Devices window 655 displays icons for all home devices that the user has added above.
  • the user can select the equipment belonging to bedroom A, such as TV A and air purifier A, and then click the OK control.
  • mobile terminal 100-1 will display the bedroom as shown in FIG. 6S The details interface 66 of A.
  • the mobile terminal 100-1 may detect that the user clicks the return control shown in FIG. 6S , and in response to the operation, the mobile terminal 100-1 will display the classification management interface 65 shown in FIG. 6T .
  • the list item 653A in the category management interface 65 is changed from the prompt information displaying 0 devices shown in FIG. 6O to the prompt information displaying 2 devices.
  • the user can repeat the above operations to add more rooms and add devices belonging to the room to each room.
  • FIG. 6U exemplarily shows the classification results displayed by the mobile terminal 100-1.
  • the user interface 65 displays a list item 653A, a list item 653B, a list item 653C, a list item 653D, a list item 653E, a list item 653F (not shown), a list item 653G (not shown), and a list Item 653H (not shown) and so on.
  • the user can browse the list items not shown by sliding the user interface 65 up and down.
  • the rooms corresponding to the above list items are bedroom A, bedroom B, bedroom C, living room, kitchen, study room, gymnasium, entertainment room and so on.
  • the mobile terminal 100-1 may detect the user's operation of clicking the return control shown in FIG. 6U, and in response to the operation, the mobile terminal 100-1 will display the user interface 61 shown in FIG. 6V.
  • the device navigation bar 613 of the user interface 61 includes: all options 613A, bedroom A options 613C, bedroom B options 613D, bedroom C options 613E, living room options 613F, kitchen options 613G (not shown), study options H (not shown), gym option I (not shown), recreation room option J, etc. (not shown).
  • the user can browse the options not shown by sliding the device navigation bar 613 area left and right.
  • the option 613C of bedroom A is selected in the device navigation bar 613 .
  • Icons of home devices included in the bedroom A are displayed in the device display area 614 .
  • the user can also click on other options in the device navigation bar 613 to make the device display area 614 display the icons of the devices contained in the room corresponding to the other options.
  • the device display area 614 not only displays the icon of the device, but also displays the working state of the device corresponding to the icon, for example, whether the device is in the on state or in the off state.
  • the series of operations of the user manually dividing the room and the device of the room shown in the embodiment of FIG. 6K-FIG. 6U above may also be referred to as the second operation.
  • the classification of the room of the home device may also be automatically divided by the mobile terminal 100-1. details as follows:
  • Some of the home devices bound in the Smart Home APP include: sweeping robots, vacuum cleaners, etc., devices that can move around the room. In the process of starting the operation, these devices can obtain the room layout information of the whole family, that is, the number of rooms contained in the family, the location of the rooms, the area of the room, etc., as well as the information of the home appliances configured in the room, etc.
  • the sweeping robot has many sensors, such as camera, laser ranging sensor, wall sensor, collision sensor, ultrasonic radar sensor, electronic compass sensor, cliff sensor, gyroscope/accelerometer, drop sensor, odometer sensors and more.
  • sensors such as camera, laser ranging sensor, wall sensor, collision sensor, ultrasonic radar sensor, electronic compass sensor, cliff sensor, gyroscope/accelerometer, drop sensor, odometer sensors and more.
  • the sweeping robot can use its various sensors to detect the surrounding environment, use the perceived room environment information to construct a map of the entire family, and then obtain the room layout information of the family.
  • the room layout information includes: the number of rooms, the location of the rooms, the area of the rooms, and so on.
  • the sweeping robot can also scan the home appliances in each room.
  • one room is equipped with kitchen appliances such as rice cookers and electric kettles; another room is equipped with smart toilets; another room is equipped with beds and wardrobes; A room is equipped with bookcases, desks, computers, and so on.
  • the sweeping robot uploads the room information detected by the sensor and the equipment information in each room to the processor, and the processor will match these data, that is, divide the room according to the type of household equipment configured in each room. type.
  • the room equipped with kitchen appliances such as rice cooker and electric kettle is divided into kitchen; the room equipped with smart toilet is divided into bathroom; the room equipped with bed and wardrobe is divided into bedroom; The room is divided into a study and more.
  • the room layout and equipment layout of the small family generated by the cleaning robot may specifically be the family structure shown in Fig. 5D above, which will not be described here.
  • the cleaning robot may send the above division result to the mobile terminal 100 through the server 300, or directly to the mobile terminal 100, which is not limited in this embodiment of the present application.
  • the sweeping robot can also send the raw data of the room layout information detected by the sensor and the corresponding equipment layout information to the mobile terminal 100, and the processor of the mobile terminal 100 can use the data of the equipment configured in each room Type to classify the type of the room.
  • the sweeping robot can also send the raw data of the room layout information detected by the sensor and the corresponding equipment layout information to the server 300, and the server 300 divides the room layout information according to the type of equipment configured in each room. The type of the room, and then send the division result to devices such as the mobile terminal 100 and the sweeper, which is not limited in this embodiment of the present application.
  • the mobile terminal 100 when the mobile terminal 100 adopts the method mentioned above to automatically divide the room and equipment, the division result may not be accurate; or after the room and equipment are automatically divided, the position of some equipment moves, resulting in the The room to which the equipment belongs changes; or the family remodels the house, such as arranging the original study room as a bedroom, etc.
  • the mobile terminal 100 can support the user to manually reset the room information and equipment information; or the mobile terminal 100 can periodically update the room and equipment information, and then prompt the user that the room and equipment have been updated and ask the user to confirm whether there is an error. If it is wrong, the user can manually change it, otherwise, the division result after the latest change is automatically adopted, and so on.
  • the room information that the mobile terminal 100 supports the user to modify includes but is not limited to: room name, equipment contained in the room; the equipment information that the mobile terminal 100 supports the user to modify includes but is not limited to: the equipment name, the room to which the equipment belongs .
  • the sweeping robot is a public device, but the location of the sweeping robot is mobile. Therefore, in the process of obtaining the location of the home device, the sweeping robot locates itself at the same time, and its location may be any room in the family. Therefore, when the sweeping robot divides the results according to the room layout information and device location information, the sweeping robot may be divided into any room in the family. When the room where the sweeping robot is divided is the private room of a certain family member, other family members cannot use the sweeping robot. In order to avoid this problem, after the mobile terminal 100 automatically divides the room and the device type, the mobile terminal 100 also supports The user manually classifies the device types.
  • the user can also move the device in any one of the private rooms to the public area, so that it can be used by all family members; it can also move the device in any public area to the private room, Only available to the owner of that private room, etc.
  • the user can re-divide the room, such as vacuum cleaners, Bluetooth speakers, massagers, microphones, weighing scales, air purifiers, electric fans, desk lamps, etc. for the convenience of users Mobile home devices and more.
  • the mobile terminal 100 can combine the above-mentioned two methods, ie manual division by the user, and automatic division by the mobile terminal 100, to divide the room and the devices in the room. In this way, for some family devices whose positions in the family may change but which are shared by family members, the following situations are avoided:
  • the mobile terminal 100 may be called a first device, and the cleaning robot may be called a third device.
  • the information sent by the cleaning robot to the mobile terminal 100 for indicating the room to which the household equipment contained in the small home belongs may also be referred to as first information, and the household equipment may also be referred to as second equipment.
  • the small home can also be called the first space, and the rooms contained in the first space can be called the first area.
  • Fig. 7A- Fig. 7H exemplarily show related operation interfaces for users to add family members.
  • Adding a family member is to establish a family group between the mobile terminal of the family member and the mobile terminal 100-1 of Xiaozhong, and each family member can log in to "Smart Family" in their own mobile terminal to realize the management and control of the family wait.
  • the mobile terminal 100-1 detects an operation on the family name option 611 in the user interface 61, and in response to the operation, the mobile terminal 100-1 displays the user interface 71 shown in FIG. 7B.
  • FIG. 7B exemplarily shows a details page of a small home.
  • the user interface 71 includes: a family name option 711 , a family member option 712 , a device management option 713 , a category management option 714 , and a wallpaper thumbnail display bar 715 .
  • the family name option 711 is also correspondingly displayed with the name of the family, such as "Xiaozhong's home", and the user can click on the family name option 711 to modify the family name.
  • the family member option 712 also corresponds to the number of family members displayed, for example, "1 member” is displayed at this time, and the user can click on the family member option 712 to add family members, set the roles of family members, rooms, etc. .
  • the device management option 713 and the category management option 714 also display the number of home devices correspondingly. For example, “16 devices" and “7 rooms” are displayed at this time.
  • the user can click the device management option 713 , category management option 714, to add or delete home devices, rooms, etc.
  • the wallpaper thumbnail display column 715 displays multiple thumbnails of the wallpaper, and the user can click on any one of the thumbnails to preview the wallpaper, and apply the wallpaper in the "smart home" APP.
  • the mobile terminal 100-1 may detect that the user clicks on the family member option 712 shown in FIG. 7B, and in response to the operation, the mobile terminal 100-1 will display the user interface 72 of the family member details page shown in FIG. 7C.
  • FIG. 7C exemplarily shows the details page of family members in the small.
  • the user interface 72 includes: a member widget option 721 and an add member control 722 .
  • the Xiaozhong option 721 also corresponds to display Xiaozhong's role in the family, such as "creator".
  • the user can hand over the identity of the family "creator” to someone else in the family by clicking on the small option 721 .
  • the mobile terminal 100-1 may detect that the user clicks the add member control 722 shown in FIG. 7C , and in response to the operation, the mobile terminal 100-1 will display the user interface 73 of the add member details page shown in FIG. 7D .
  • FIG. 7D exemplarily shows a details page for adding members.
  • the user interface 73 includes: a close icon 731A, a finish icon 731B, an option 732 to add members by scanning a code, an option 733 to add members through a Huawei account, and an option 734 to add members through social applications. Users can add members to the family in Xiaozhong by clicking any one of the above three options.
  • the mobile terminal 100-1 can detect that the user clicks the operation of adding members by scanning code 732 shown in FIG. 7D .
  • a swipe user interface 74 is shown.
  • FIG. 7E exemplarily shows a scan interface.
  • the user interface 74 includes: a code scanning area 741 .
  • the code scanning area 741 is used to display the image captured by the camera, for example, the image of Xiaohua's mobile terminal, and at this time Xiaohua's mobile terminal 100-2 displays the QR code of Xiaohua's smart home APP. After the mobile terminal 100-1 recognizes the QR code, it will jump to display Xiaohua's information as shown in FIG. 7F.
  • the user interface 73 in addition to the information shown in FIG. 7D , the user interface 73 also displays options 735 of recently scanned users, for example, member Xiaohua.
  • Mobile terminal 100-1 can detect the user's operation of clicking option 735 shown in Figure 7F, and in response to this operation, mobile terminal 100-1 selects member Xiaohua, and then mobile terminal 100-1 can detect the operation acting on icon 731B , in response to this operation, the mobile terminal 100-1 will jump to the user interface 72 displaying the family member details page as shown in FIG. 7G.
  • the user interface 72 in addition to displaying the information shown in FIG. 7C , the user interface 72 also displays the options of the added user, for example, the option 723 of member Xiaohua.
  • the user can also add members through the methods described in Figure 7A-7G above, and finally add all members of Xiaozhong's family, such as Huaweing, Xiaohong, Xiaoai, Xiaoyu, Xiaoxue, etc. mentioned above, to the For the home in Xiaozhong, see the example in FIG. 7H for details, and details will not be repeated here.
  • Xiaozhong's family such as Huawei, Xiaohong, Xiaoai, Xiaoyu, Xiaoxue, etc. mentioned above, to the For the home in Xiaozhong, see the example in FIG. 7H for details, and details will not be repeated here.
  • FIG. 7H exemplarily shows a schematic diagram of a user interface after all members of the family are added to the family in Xiaozhong. It can be seen that the details page of family members at this time shows: option 721 of member Xiaozhong, option 723 of member Xiaohua, option 724 of member Huaweing, option 725 of member Xiaohong, option 726 of member Xiaoai, option 727 of member Xiaoyu , member Xiaoxue's option 728, etc.
  • Fig. 7I- Fig. 7T exemplarily show the operation interface for setting roles and rooms of family members.
  • the mobile terminal 100-1 can detect that the user clicks on the option 723 of the member Xiaohua shown in 7H, and in response to this operation, the mobile terminal 100-1 displays the user information details page corresponding to Xiaohua as shown in Figure 7I. interface75.
  • FIG. 7I exemplarily shows the detailed page of member information corresponding to Xiaohua.
  • the user interface 75 includes: Huawei ID 751 , member name 752 , member role 753 , member room 754 , remove member control 755 and so on. It should be noted that the member role 753 defaults to common user, the member room 754 defaults to all rooms. The user can formulate Xiao Hua's role and room by clicking on the member role 753 and the member room 754 option.
  • the mobile terminal 100-1 When the mobile terminal 100-1 detects that the user clicks the operation of option 753 of the member role as shown in Figure 7I, in response to the operation, the mobile terminal 100-1 will display the user interface of the details page of the member role as shown in Figure 7J 76.
  • Fig. 7J exemplarily shows the detailed page of member information corresponding to Xiao Hua.
  • the user interface 76 includes: a creator option 761 , an administrator option 762 , an ordinary user option 763 , a child; an elderly option 764 , a close icon 765A, a finish icon 765B, and the like.
  • the options for each of the above roles also display the permissions corresponding to different roles.
  • the creator has the highest authority, which can manage all members of the family, including administrators, ordinary users, children, the elderly, etc., and can also manage and use all family devices. Administrators have permissions second only to creators, who can manage all members of the family, including administrators, ordinary users, children, the elderly, etc., as well as manage and use all family devices.
  • Mobile terminal 100-1 can detect that the user clicks the operation of option 762 shown in FIG. In response to the operation of the icon 765B, the mobile terminal 100-1 will jump to the user interface 75 displaying the detailed page of member information as shown in FIG. 7K .
  • the mobile terminal can also divide the member roles into more or less types, for example, family visitors can also be included, or children and the elderly can also be subdivided into two roles. Examples are not limited to this.
  • the member role displayed on the user interface 75 is changed from the original “common user” shown in FIG. 7I to "administrator".
  • the mobile terminal 100-1 may detect that the user clicks the option 754 shown in FIG. 7K, and in response to the operation, the mobile terminal 100-1 will display the user interface 77 of the member room details page as shown in FIG. 7L.
  • Fig. 7L exemplarily shows the member room details page corresponding to Xiaohua.
  • user interface 77 comprises: closing icon 771A, completion icon 771B list item 653A, list item 772, list item 773, list item 774, list item 775, list item 776, list item 777, list item 778 and List item 779 etc.
  • the rooms corresponding to the above list items are bedroom A, bedroom B, bedroom C, living room, kitchen, study room, gymnasium, entertainment room and so on.
  • a preset number such as 10
  • the mobile terminal 100-1 may detect that the user clicks on the list item 772, list item 775, list item 776, list item 777, list item 778, and list item 779 shown in FIG. -1
  • the selected member rooms are bedroom B, living room, kitchen, study room, gymnasium, entertainment room, etc., then mobile terminal 100-1 can detect the operation acting on icon 771B, and in response to this operation, mobile terminal 100-1 will jump Go to the user interface 75 displaying the member information details page as shown in FIG. 7M.
  • the member rooms displayed on the user interface 75 are changed from the default "all” in Fig. 7K to "bedroom B, living room, kitchen".
  • Figures 7I-7M above describe the exemplary operation of setting Xiaohua's family role. Since Xiaohua is the mother of the family, she is set as an administrator so that Xiaohua can manage family devices and family members. Next, take grandpa Xiaoming as an example. Because grandpa is old and has limited mobility, Xiaozhong wants to set the member role of grandpa Xiaoming as "child; old man”. The specific example is as follows.
  • the mobile terminal 100-1 may detect the user's operation of clicking the return control shown in FIG. 7M , and in response to the operation, the mobile terminal 100-1 jumps to the user interface 72 displaying the family member details page as shown in FIG. 7N .
  • the family member details page at this time displays: the option 721 of the member Xiao, the option 723 of the member Xiaohua, and the option 724 of the member Huaweing , option 725 for member Xiaohong, option 726 for member Xiaoai, option 727 for member Xiaoyu, option 728 for member Xiaoxue, etc.
  • option 721 in the members list corresponds to the displayed role as "creator”
  • the default roles of other newly added members are "common user”.
  • the user can set the respective roles and rooms of the family members by clicking on the options of the above-mentioned family members.
  • the mobile terminal 100-1 may detect that the user clicks on the option 724 of the member Xiao Ming shown in FIG. 7N, and in response to this operation, the mobile terminal 100-1 displays the user interface of the member information details page corresponding to Xiao Ming as shown in FIG. 7O 75.
  • FIG. 7O exemplarily shows the member information details page corresponding to Xiao Ming.
  • the user interface 75 includes: Huawei account number 751 , member name 752 , member role 753 , member room 754 , remove member control 755 and so on. It should be noted that the member role 753 defaults to common user, the member room 754 defaults to all rooms. The user can formulate Xiao Hua's role and room by clicking on the member role 753 and the member room 754 option.
  • the mobile terminal 100-1 When the mobile terminal 100-1 detects that the user clicks the operation of option 753 of the member role as shown in Figure 7O, in response to the operation, the mobile terminal 100-1 will display the user interface of the details page of the member role as shown in Figure 7P 76.
  • FIG. 7P exemplarily shows the member information details page corresponding to Xiao Ming.
  • the user interface 76 includes: a creator option 761 , an administrator option 762 , an ordinary user option 763 , a child; an elderly option 764 , a close icon 765A, a finish icon 765B, and the like.
  • the options for each of the above roles also display the permissions corresponding to different roles.
  • the creator has the highest authority, which can manage all members of the family, including administrators, ordinary users, children, the elderly, etc., and can also manage and use all family devices.
  • the authority of the administrator is second only to the creator. It can manage all members of the family, including administrators, ordinary users, children, the elderly, etc., and can also manage and use all family devices.
  • Mobile terminal 100-1 can detect that the user clicks the operation of option 764 shown in FIG. Acting on the operation of icon 765B, in response to this operation, mobile terminal 100-1 will jump to user interface 75 displaying the member information details page as shown in FIG. 7Q.
  • the member role displayed on the user interface 75 is changed from "ordinary user” as shown in FIG. 7O to "child; old man”.
  • the mobile terminal 100-1 may detect that the user clicks the option 754 shown in FIG. 7Q, and in response to the operation, the mobile terminal 100-1 will display the user interface 77 of the member room details page as shown in FIG. 7R.
  • FIG. 7R exemplarily shows the member room details page corresponding to Xiao Ming.
  • user interface 77 comprises: close icon 771A, complete icon 771B list item 653A, list item 772, list item 773, list item 774, list item 775, list item 776, list item 777, list item 778 and List item 779 etc.
  • the rooms corresponding to the above list items are bedroom A, bedroom B, bedroom C, living room, study room, gymnasium, entertainment room and so on.
  • a preset number such as 10
  • the mobile terminal 100-1 may detect that the user clicks on the list item 773, the list item 775, the list item 777, the list item 778, and the list item 779 shown in FIG. Member rooms are bedroom B, living room, kitchen, study room, gymnasium, entertainment room, etc. Then mobile terminal 100-1 can detect the operation acting on icon 771B, and in response to this operation, mobile terminal 100-1 will jump to display such as The user interface 75 of the member information details page shown in FIG. 7S.
  • the member rooms displayed on the user interface 75 are changed from the default "all” in Fig. 7Q to "bedroom B, living room, book".
  • the user can also set the roles and rooms of the members in the manner described in Figure 7I-7S above, and finally all the members of Xiaozhong's family, such as the grandmother Xiaohong mentioned above (Xiaohong's age is younger than Huaweing, and the action Convenience) role is set to "Administrator", the room is bedroom B, living room, kitchen, study, gym, entertainment room; Xiaoai (Xiaoai is still a child) role is set to "Children; Elderly", the room is bedroom C, living room , study room, gym, entertainment room; Xiaoyu, Xiaoxue, etc.
  • FIG. 7T exemplarily shows a schematic diagram of a user interface in which all members of a family are assigned roles and divided into a room. It can be seen that the details page of family members at this time shows: option 721 of member Xiaozhong, option 723 of member Xiaohua, option 724 of member Huaweing, option 725 of member Xiaohong, option 726 of member Xiaoai, option 727 of member Xiaoyu , member Xiaoxue's option 728, etc.
  • the option 721 in the member list corresponds to the role displayed as "creator”, the role of Xiaohua is “administrator”, the role of member Huaweing is “child; old man”, and the role of member Xiaohong is “ Administrator”, Xiao Ai's role is “Child; Elderly”, and Xiaoyu and Xiaoxue's roles are "Ordinary User".
  • the user can click on the options of the above-mentioned family members to reset, that is, to change the role, room, etc. of any one of the family members.
  • the electronic device After the user enters the registration information in the smart home APP described in Figure 6A- Figure 6V above, and the relevant information of family members added by the user in the smart home APP introduced in Figure 7A- Figure 7T, the electronic device will collect the user's registration information, as well as family member information and so on. That is, the collection of user data mentioned in the previous data bank system. The method of user data collection is not described here. For details, please refer to the introduction to the data bank system above.
  • the user in order to ensure that family members can only use family devices within the scope of authority, when a user uses a family device, the user needs to be authenticated to determine whether the user has the authority to use the family device. In this way, people who do not have permission to use the home device can be prevented from performing some dangerous or malicious operations. For example, in order to prevent the elderly or children from using dangerous electrical appliances, or family visitors from using private devices in the family, such as expensive insurance, etc., which will bring losses to the family.
  • 8A-8E exemplarily show a schematic diagram of an initialization operation interface for a user to set an identity authentication mode.
  • Fig. 8A exemplarily shows the home page of the smart home APP.
  • the user interface shown in FIG. 8A is similar to the user interface shown in FIG. 6K above.
  • the introduction to FIG. 6K above is applicable to the introduction to FIG. 8A , and details will not be repeated here.
  • the mobile terminal 100-1 may detect that the user clicks the My option 615D in the page navigation bar 615 in FIG. 8A, and in response to this operation, the mobile terminal 100-1 displays the user interface 81 as shown in FIG. 8B.
  • Fig. 8B exemplarily shows the "My" page provided by the smart home APP.
  • the user interface 81 displays: an option 811 , an option 812 , an option 813 , an option 814 , an option 815 , an option 816 , an option 817 , and an option 818 .
  • option 811 is used to open the details page of "I", which specifically provides users with services such as account name, password, bound mobile phone number, password-free authentication, etc.
  • option 812 is used to open my home page, which specifically Provide users with services such as adding and removing family members
  • option 813 is used to open the user interface of my main device. This page can specifically provide users with operations to change the main device.
  • the main device defaults to the device currently logged into the smart home APP , that is, this machine; option 814 is used to open my other devices page, which can specifically provide users with functions to manage other devices of the user such as tablets, notebooks, wristbands, earphones, etc.; option 815 is used to open my QR code page, which provides the user with a QR code that identifies the current smart home APP account, and other terminals can scan the QR code to add the user identified by the QR code as a family member or friend; option 816 is used to open the connection to the third-party platform.
  • User interface this page can specifically provide users with platforms provided by other home equipment manufacturers, operators, etc.
  • option 817 is used to open the setting page, which provides users with settings for common functions of the smart home APP Service; option 818 is used to open the help page, which specifically includes prompting the user to use the smart home APP method and precautions and so on.
  • the mobile terminal 100-1 may detect the user's operation of clicking option 811 in FIG. 8B, and in response to the operation, the mobile terminal 100-1 displays the user interface 82 as shown in FIG. 8C.
  • the user interface 82 displays: option 821, option 822, option 823, option 824, etc., and the above options correspond to the user's account name, bound mobile phone number, login password corresponding to the account, password-free authentication, etc. wait.
  • the mobile terminal 100-1 may detect the user's operation of clicking the option 824 in FIG. 8C, and in response to the operation, the mobile terminal 100-1 displays the user interface 83 as shown in FIG. 8D.
  • the user interface 83 displays: an option 831 , an option 832 , and an option 833 , etc., which respectively correspond to fingerprint authentication, face authentication, and voiceprint authentication. Users can click any one or more of the above options to enable the corresponding authentication method.
  • FIG. 8D only exemplarily shows three commonly used authentication methods, and in the embodiment of the present application, the mobile terminal 100-1 may provide more or less authentication methods, which is not limited in the present application.
  • the mobile terminal 100-1 When the mobile terminal 100-1 detects that the user has enabled the above-mentioned identity authentication, it can display the user interface shown in FIG. 8E , and the specific user interface 83 displays option 831, option 832, and option 833, correspondingly displaying the prompt information that has been enabled, It is used to prompt the user that the identity authentication method has been enabled.
  • the mobile terminal 100-1 may support multiple identity authentication methods, for example: password authentication based on biometric features, identity authentication based on behavioral features, and the like.
  • the biometric authentication methods may include: face authentication, fingerprint authentication, palmprint authentication, iris authentication, retina authentication, and identity authentication based on photoelectric plethysmography (PPG) signals, etc.
  • Behavior authentication methods may include: authentication based on gait, handwriting, lip movement, voice, and key press force.
  • Password authentication may further include: character password authentication, pattern password authentication, and the like.
  • the embodiment of the present application does not limit the identity authentication methods supported by the mobile terminal 100-1.
  • the mobile terminal 100-1 After detecting the operation for triggering the mobile terminal 100-1 to perform identity authentication, the mobile terminal 100-1 can preferentially enable the biometric authentication and behavioral authentication modes with authentication success rate higher than the threshold according to the surrounding environment and/or user status. Further, when there are multiple biometric authentication and behavioral authentication methods whose authentication success rate is higher than the threshold, the mobile terminal 100-1 can first enable the biometric authentication or behavioral authentication with a higher priority according to the preset priority order from high to low. authentication, when the high-priority biometric authentication or behavioral authentication fails, the mobile terminal 100-1 starts the low-priority biometrics authentication or behavioral authentication again.
  • the mobile terminal 100-1 determines that the identity authentication is successful; if all the biometric authentication methods and behavioral authentication methods fail to be authenticated, the mobile terminal 100-1 starts password authentication until When the password entered by the user matches the preset password, it is determined that the identity authentication is successful, and if it does not match, it is determined that the identity authentication fails.
  • biometric authentication and behavioral authentication priorities may be set by default by the mobile terminal 100-1, or may be customized by the user, which is not limited in this embodiment of the present application.
  • the mobile terminal 100-1 when the mobile terminal 100-1 disables biometric authentication and behavioral authentication with authentication success rate lower than the threshold according to the surrounding environment and/or user status, and turns on biometric authentication and behavioral authentication with authentication success rate higher than the threshold After completing the authentication method, the mobile terminal 100-1 can identify the user identity according to the collected user data corresponding to the enabled authentication method, or transmit the collected user data corresponding to the authentication method to the server 300, and the server 300 can identify the user. identity, and deliver the identification result to the mobile terminal 100, which is not limited in this embodiment of the present application.
  • the mobile terminal 100-1 disables the biometric authentication and behavior authentication methods whose authentication success rate is lower than the threshold value, and enables the biometric authentication and behavior authentication method whose authentication success rate is higher than the threshold value.
  • the mobile terminal 100-1 pre-associates and stores identity authentication methods corresponding to different surrounding environments and/or user states. After the mobile terminal 100-1 collects data related to the surrounding environment and/or user states, the mobile Terminal 100-1 can match the authentication mode corresponding to the data.
  • the mobile terminal 100-1 collects data related to the surrounding environment and/or user status, it sends the data to the server to request the authentication method adopted, and the server calculates the corresponding authentication method for each authentication method based on the data.
  • the authentication success rate and send the authentication mode whose success rate is higher than the threshold to the mobile terminal 100-1, and the mobile terminal 100-1 enables the authentication mode and disables other authentication modes.
  • Family members can open the smart home APP installed in the mobile terminal 100, click the icon of the home device displayed on the home page, open the corresponding home device details page, check the current status of the family device, and input the operation for controlling the family device
  • the mobile terminal recognizes the identity of the current user and determines that the user has the right to control the home device, it will control the home device to execute the corresponding function.
  • the communication distance between the location of the mobile terminal 100 and the home device may be less than a threshold, for example, the mobile terminal 100 is within the range of the home, It is also possible that the communication distance with the home device is greater than the threshold, for example, the user is away from home, in the company, or on the phone returning home from the company, and so on.
  • the mobile terminal 100 can directly control the home device 200, or The home device 200 can be controlled through the server 300 .
  • the mobile terminal 100 When family members control and use the home device through the smart home APP installed on the mobile terminal 100, and the communication distance between the location of the mobile terminal 100 and the home device 200 is greater than a threshold, the mobile terminal 100 must control the home device 200 through the server 300. That is to say, the remote control home device 200 supported by the smart home APP.
  • FIG. 8F-FIG. 8I exemplarily show a schematic diagram of an operation interface for using a family device in a family member group.
  • FIG. 8F exemplarily shows the homepage of the smart home APP installed on the mobile terminal 100-1 of the small medium.
  • the user interface 61 shown in FIG. 8F is similar to the user interface 61 shown in FIG. 6K above.
  • the introduction to FIG. 6K above is applicable to the introduction to FIG. 8F , and details are not repeated here.
  • the mobile terminal 100-1 may detect that the user clicks the device icon corresponding to the rice cooker in the device display area 614 in FIG. 8F , and in response to the operation, the mobile terminal 100-1 displays the user interface 84 as shown in FIG. 8G .
  • FIG. 8G exemplarily shows a device details page corresponding to a rice cooker.
  • the user interface 84 shown in FIG. 8G displays a series of options for controlling the rice cooker, such as switch option 841 , mode option 842 , appointment time option 843 and so on.
  • the switch option 841 corresponds to a control for turning on the rice cooker
  • the mode option 842 corresponds to a control for switching the working mode of the rice cooker
  • the appointment time option 843 corresponds to a control for setting the working time of the rice cooker.
  • Xiao Zhong Since Xiao Zhong, the user of the mobile terminal 100-1, is the creator of the family, Xiao Zhong has the highest authority of the family, that is to say, Xiao Zhong can manage and use all family devices including the rice cooker mentioned above.
  • Xiao Zhong can manage and use all family devices including the rice cooker mentioned above.
  • the mobile terminal 100-1 detects that the user input triggers the operation of the mobile terminal 100-1 to control the home device, it will Enable the authentication function to authenticate the current user. For example, the mobile terminal 100-1 may detect that the user clicks on the control for turning on the rice cooker corresponding to the option 841 shown in FIG.
  • the mobile terminal turns on the identity authentication function. And determine whether the current user's identity has the authority to use the electronic device, that is, the desk lamp, and if it has the authority, then respond normally and execute the operation input by the user; when the mobile terminal 100-1 detects that the current user's identity does not have the authority to use the rice cooker If the authority is set, the current user will be prompted not to perform control, use the rice cooker, and no longer perform the operations entered by the user.
  • the operation of triggering the mobile terminal 100-1 to enable identity authentication is not limited to the above-mentioned operation for controlling home devices, and may also be that the mobile terminal 100-1 detects that the user opens the The operation of the device details page, or the user's periodic activation of identity authentication when running the smart home APP, continuous identity authentication of the user, etc., are not limited in this embodiment of the present application.
  • the user interface 84 shown in FIG. 8H pops up a prompt message 845 for prompting the user that "the owner of the device is not recognized, and the operation fails."
  • the prompt information 845 popped up in FIG. 8H may also be referred to as first prompt information.
  • the mobile terminal 100-1 Assuming that the mobile terminal 100-1 recognizes that the current user is Xiaozhong himself, it will judge whether Xiaozhong has permission to use the rice cooker. Since Xiaozhong is the family creator and has the highest authority, that is, he can use all family devices, the mobile terminal 100-1 will pop up a prompt message as shown in Figure 8I.
  • the user interface 84 shown in FIG. 8I pops up a prompt message 846 for prompting the user "the operation is successful, and the rice cooker has been turned on for you".
  • the mobile terminal 100-1 may be called the first device; the rice cooker belongs to the second electronic device, and the second electronic device also includes various home appliances provided above such as televisions, cameras, electric curtains, desk lamps, electric appliances, etc. Kettle, refrigerator, air conditioner, air purifier, smoke stove, etc.
  • the room where the rice cooker is located is the kitchen, which may also be referred to as the first area.
  • the first operation is the operation for turning on the rice cooking function of the electric rice cooker as exemplarily shown in FIG. 8G above.
  • the rice cooking function for turning on the rice cooker may also be referred to as the first function for starting the second electronic device.
  • Xiao Zhong can also be called the first user
  • Xiao Ai can also be called the second user.
  • FIG. 8J-FIG. 8N exemplarily show a schematic diagram of an operation interface of a family member Xiao Ming using a family device.
  • Fig. 8J exemplarily shows the home page of the smart home APP installed on Xiao Ming's mobile terminal 100-3.
  • the user interface displayed by the mobile terminal 100-3 is similar to the user interface 61 displayed by the mobile terminal 100-1 shown in Figure 6K and Figure 8F above, and the introduction to Figure 6K above is applicable to the introduction to Figure 8J , which will not be described here.
  • the icons of some home devices displayed in the device display area shown in FIG. 8J are different from the icons of some home devices displayed in the device display area 614 shown in FIG. 8F .
  • the display states of the icons corresponding to the electric kettle, rice cooker, TV A, air purifier A, etc. shown in FIG. 8J are in the form of grayscale, which is used to remind the user of the home devices corresponding to these icons, and the user has no authority control. This is because Huawei's role in Xiaozhong's home is "child; old man”.
  • Xiao Ming can use these family devices after being authorized by the family creator and/or administrator, as follows:
  • the mobile terminal 100-3 can detect that the user clicks the icon corresponding to any home device in the device display area in FIG. 8J , for example, the operation of clicking the device icon corresponding to the rice cooker. In response to this operation, the mobile terminal 100-3 displays User interface shown in 8K.
  • the user interface displayed by the mobile terminal 100 - 3 is similar to the user interface 84 shown in FIG. 8G above.
  • the introduction to FIG. 8G above is applicable to the introduction to FIG. 8K , and details will not be repeated here.
  • the mobile terminal 100-3 detects that the user input is used to trigger the operation of the mobile terminal 100-3 to control the home device, for example, it detects that the user clicks on the control for turning on the rice cooker corresponding to the switch option in FIG. 8K . In response to this operation, the mobile terminal 100 -3 Display the user interface as shown in Figure 8L.
  • the user interface shown in FIG. 8L displays a prompt window, and the prompt window displays information for reminding the user that the user does not have the permission for the above operation, and asking the user whether to request permission from others.
  • the prompt information displayed in the prompt window may also be referred to as first prompt information.
  • the "OK" control shown in FIG. 8L may also be referred to as a first control.
  • Mobile terminal 100-3 detects an operation acting on the determination control as shown in FIG.
  • the permission request sent by the terminal is the first request, and the mobile terminal here includes any one or more of the following: mobile phone, bracelet, earphone, notebook, tablet computer and so on.
  • the mobile terminal 100-3 sends a permission request to the mobile terminal 100-1 configured in the small business
  • the mobile terminal 100-1 configured in the small business will display a prompt message as shown in FIG. 8M .
  • the user interface displayed by the mobile terminal 100 - 1 has a prompt window, and the prompt window displays information for prompting Xiao Zhong and Xiao Ming to request permission to operate the rice cooker.
  • the mobile terminal 100-1 detects that the input is used to authorize Xiao Ming, such as clicking the prompt window in Figure 8M to agree to the operation of the control. In response to this operation, the mobile terminal 100-1 sends an authorization message to the mobile terminal 100-3, and the mobile terminal 100-3 displays the user interface shown in FIG. 8N after receiving the authorization information. In other embodiments of the present application, after the mobile terminal 100-1 detects that the prompt window in FIG. After the authentication is passed, the user interface shown in FIG. 8N will be displayed as shown in the figure. The embodiment of this application does not limit the method of SME authorization.
  • the control for turning on the rice cooker corresponding to the switch option is switched from the off state in FIG. 8K to the on state.
  • a prompt window is also displayed, and the prompt window is used to remind Xiao Ming that Xiao Zhong has agreed to the permission request and has turned on the rice cooker for you.
  • FIG. 8J to 8N above merely show schematic diagrams of the operation interface of the family device that the family member Xiao Ming is not authorized to use.
  • FIG. 8O-FIG. 8Q a schematic diagram of the operation interface of the family device within the scope of use of the family member Xiao Ming is exemplarily shown.
  • the mobile terminal 100 - 3 detects that the user operates on the icon of the family device within the scope of authority, and in response to the operation, opens the details page corresponding to the family device. For example, the mobile terminal 100-3 detects an operation acting on the icon of the table lamp, and in response to the operation, the mobile terminal 100-3 displays the user interface as shown in FIG. 8P.
  • the details page corresponding to the desk lamp displayed by the mobile terminal 100 - 3 includes: switch options, mode options, brightness options, and the like.
  • the switch option corresponds to a control for turning on the desk lamp
  • the mode option corresponds to a control for switching the working mode of the desk lamp
  • the brightness option corresponds to a slider for adjusting brightness.
  • the mobile terminal 100-3 detects that the user input triggers the operation of the mobile terminal 100-3 to control the home device, and will enable the identity authentication function to authenticate the identity of the current user. For example, the mobile terminal 100-3 may detect that the user clicks the control for turning on the desk lamp corresponding to the switch option shown in FIG. Whether you have the authority to use the electronic device, that is, the table lamp. If you have the authority, then respond normally and execute the operation input by the user; The user cannot use the rice cooker, and no longer executes the operation entered by the user.
  • the operation of triggering the mobile terminal 100-3 to enable identity authentication is not limited to the above-mentioned operation for controlling home devices, and may also be that the mobile terminal 100-3 detects that the user opens the home.
  • the operation of the device details page, or the user's periodic activation of identity authentication when running the smart home APP, continuous identity authentication of the user, etc., are not limited in this embodiment of the present application.
  • the mobile terminal 100-3 Assuming that the mobile terminal 100-3 recognizes that the current user is Xiao Ming himself, it will judge whether Xiao Ming has the authority to use the desk lamp. Since the rooms in the small house include bedroom B, living room, study room, gym, entertainment room, etc., the desk lamp is deployed in the study room. , so Xiao Ming has the right to use the desk lamp, and the mobile terminal 100-3 will pop up a prompt message as shown in FIG. 8Q .
  • the mobile terminal 100 - 3 pops up a prompt message, which is used to prompt the user "the operation is successful, and the desk lamp has been turned on for you".
  • the communication distance between the location of the mobile terminal 100 and the home device may be less than a threshold, for example, the mobile terminal 100 is within the range of the home, It is also possible that the communication distance with the home device is greater than the threshold, for example, the user is away from home, in the company, or on the phone returning home from the company, and so on.
  • the mobile terminal 100 can directly control the home device 200, or The home device 200 can be controlled through the server 300 .
  • the mobile terminal 100 When family members control and use the home device through the smart home APP installed on the mobile terminal 100, and the communication distance between the location of the mobile terminal 100 and the home device 200 is greater than a threshold, the mobile terminal 100 must control the home device 200 through the server 300. That is to say, the remote control home device 200 supported by the smart home APP.
  • the determination of the user’s control authority over the home device based on the user’s identity information described above in Figure 8A- Figure 8Q reflects the processing of user data mentioned in the data bank system above, that is, the relationship between the user’s identity and the user’s room in the home space Information and equipment information in the room establish an association relationship, and then realize the control authority of the home equipment based on the user's identity.
  • the method of user data processing will not be described here, for details, please refer to the introduction to the data bank system above.
  • FIG. 8R-FIG. 8V a schematic diagram of an operation interface for controlling home devices according to intelligent control rules will be introduced.
  • the mobile terminal 100 will also learn a set of intelligent control rules according to the user's living habits.
  • the smart rule judges whether to continue to control the corresponding home device 200 to perform the corresponding operation. And display information for prompting the user to execute the result.
  • the mobile terminal 100 will learn a set of intelligent control rules based on the user's living habits and upload them to the server 300.
  • the server 300 receives the control instruction sent by the mobile terminal 100, it will The control rule judges whether to continue to control the corresponding home device 200 to execute the corresponding operation, and feeds back the execution result to the mobile terminal 100, so that the mobile terminal 100 displays information for prompting the user to execute the result.
  • the above-mentioned intelligent control rules may be the distance between the user who initiated the command and the family, the user's current location, the current time, the business type corresponding to the control instruction, and whether there are other members in the current family, or other members Any one or more of the multi-faceted factors such as the role played, formulate a set of intelligent and safe control rules.
  • the intelligent control rules will be described in detail with several simple examples.
  • FIG. 8R exemplarily shows a schematic diagram of a daily life route learned by the mobile terminal 100-1 to the small and medium-sized schools.
  • Figure 8R exemplarily shows the location information of Xiaozhong's home, company, and Xiaozhong's daughter Xiaoai's school, where the first route is the route that Xiaozhong must pass when commuting to and from work, and the second route is The route that the primary school must pass when picking up and dropping off Xiao Ai to and from school.
  • the life timeline of Xiaozhong is: from Monday to Friday, I send my daughter Xiaoai to school around 8:00-8:30 in the morning, and then go to work in the company. After get off work around 5:30 in the afternoon, I went to school to pick up my daughter from school, and then drove home.
  • Xiaozhong On weekends, Xiaozhong’s life timeline is not fixed. Sometimes Xiaozhong may rest at home, or go on a date with his wife Xiaohua, or take Xiaoai’s grandfather Xiaoming to the hospital for follow-up visits, etc.
  • the mobile terminal 100-1 can customize a set of intelligent control rules for the small medium.
  • the intelligent control rule is based on the living habits of the small and medium-sized enterprises, and according to the distance from the user to home, the user's current location, the current time, the business type corresponding to the control instruction, and whether there are other members in the current home, or the roles played by other members Any one or more of the multi-faceted factors can be used to formulate a set of intelligent and safe control rules.
  • the intelligent control rules will be described in detail with several simple examples.
  • Example 1 When there are no other members in the family, or other members of the family play the role of "old man, child", if the user who issued the operation instruction leaves home beyond the preset range, that is, exceeds the first value, or the user's geographical location It is not near the first route and the second route learned by the mobile terminal 100-1. For example, the user is at the first location shown in FIG. The denial controls the home device 200 to perform the corresponding operation. In this way, it can be avoided that for a long time in the future, when the user may not rush home and there is no one at home, on the one hand, it will cause extravagance and waste of home appliance resources, and on the other hand, it will bring potential safety to the family. Hidden danger.
  • Example 2 When there are no other members in the family, or the roles of other members of the family are "old man, child", if the user who issued the operation command is within the preset range from home or the user's geographic location is the mobile terminal 100- 1
  • the learned first route is near the second route. For example, the user is at the second location shown in FIG. , to control the home device 200 to perform corresponding operations.
  • Example 3 When there are other members in the family, and the roles of other members are not "old people, children", if the user who issued the operation command leaves home beyond the preset range or the user's geographical location is not learned by the mobile terminal 100-1 If the user is near the first route and the second route, for example, the user is at the first place shown in FIG. 8R , the server 300 controls the home device 200 to perform corresponding operations according to the user's control instruction.
  • Example 4 When there are no other members of the family during the daytime on any day from Monday to Friday, if the user who issued the operation command is in the company, and the business type corresponding to the command is, for example, turn on the light, turn on the air conditioner, turn on the TV, etc.
  • the server 300 refuses to control the home device 200 to perform the corresponding operation. In this way, it is possible to avoid the extravagance and waste of home appliance resources and potential safety hazards to the family due to no one at home. Implement healthy, safe, low-carbon and convenient personalized home life.
  • Example 5 During the daytime on any day from Monday to Friday, if there are no other members of the family, if the user who issued the operation command is in the company, but the business type corresponding to the command is to open/close the window, turn off the light, turn off the air conditioner, and turn off the TV
  • the server 300 controls the home device 200 to perform a corresponding operation.
  • FIG. 8S-FIG. 8V exemplarily illustrate user interface diagrams for controlling home devices according to intelligent control rules.
  • mobile terminal 100-1 detects that Xiaozhong inputs an operation to turn on the desk lamp at home, and in response to this operation, mobile terminal 100-1 can obtain Xiaozhong's current location and time information, for example At this time, Xiaozhong is at the first place shown in FIG. 8R, and the time is 12:00 noon on Friday.
  • the mobile terminal 100-1 can also request the server 300 for member information in the family, for example, it is learned from the server 300 that there is no For other members, the mobile terminal 100-1 refuses to turn on the console light of the server 300, and displays a prompt message as shown in FIG. 8U.
  • a window 854 is displayed in the user interface 85, and a prompt message is displayed in the window 845, for example, it is used to prompt the user "It is detected that there is no one at home, it is recommended not to turn on the light", if the user still wants to turn on the light, he can pass Click the control 845A in the window.
  • the mobile terminal 100-1 will turn on the console light through the server 300. If the user does not intend to turn on the light temporarily, he can click the control 845B. In response to this operation, the mobile terminal 100-1 Window 854 is closed.
  • the window 854 where the above-mentioned prompt information is located may not display the control "Got it", and the user can activate it by acting on a place other than the window 854, or when the display time of the window exceeds a preset time, for example, 30 seconds, the mobile terminal 100-1 can close the window 854.
  • the mobile terminal 100-1 can detect the operation acting on the control 845A, and in response to the operation, the mobile terminal 100-1 sends an instruction for turning on the console light to the server 300, and the server 300 according to This command turns on the desk lamp, and the server 300 also feeds back the execution result of turning on the desk lamp to the mobile terminal 100, and the mobile terminal 100 displays the prompt information as shown in FIG. 8U according to the feedback message.
  • a window 855 is displayed in the user interface 85, and the window displays a prompt message corresponding to the execution result, such as "the table lamp has been turned on for you, and since no one at home suggests that you withdraw the operation of turning on the light", and a control 855A , the control 855A is used to undo the previous operation of turning on the light, and in addition, the switch control corresponding to the option 851 is switched to the off state.
  • the mobile terminal 100-1 can detect the operation acting on the control 855A shown in FIG. 8V, and in response to the operation, the mobile terminal 100-1 turns off the console light of the server 300.
  • the user interface 85 displayed on the mobile terminal is shown in FIG. 8W
  • the switch control corresponding to option 851 is turned off.
  • the user can also act on a place other than the window 855 shown in FIG. 8V , or when the window 855 is displayed for more than a preset time such as 30 seconds, the mobile terminal 100-1 can close the window 855.
  • the form of the mobile terminal 100 outputting the prompt information of the execution result is not limited to the window 854 shown in FIG.
  • the mobile terminal 100-1 in addition to displaying the execution result information shown in Figure 8U at the mobile terminal 100-1, if the mobile terminal 100-1 knows that the user is driving, it can also control the on-board computer to output the execution result information shown in Figure 8X.
  • the prompt information of the result is convenient for the user to know the execution result in time. Or, in other scenarios, other mobile terminals such as wristbands, earphones, and tablets may also be controlled to simultaneously output prompt information of execution results.
  • the mobile terminal described above generates intelligent control rules based on the user's life trajectory, and the information related to the user's life trajectory involves the opening of user data mentioned in the data bank system mentioned above, which is specifically manifested as cross-application opening to other applications.
  • map navigation apps can open information such as the user's itinerary trajectory to smart home applications.
  • the method of opening user data will not be described here. For details, please refer to the introduction to the data bank system above.
  • the mobile terminal 100 can also combine the method of controlling household appliances according to the user identity shown in FIG. 8F-FIG. 8Q above with the method of controlling household appliances according to intelligent control rules shown in FIG.
  • the device method is combined, that is, when the mobile terminal 100 detects or the server 300 receives the control instruction sent by the user, the mobile terminal 100 or the server 300 first performs identity authentication, and when it is recognized that the user has the authority to control the home device 200 , the mobile terminal 100 or the server 300 further judges whether to execute the operation corresponding to the control instruction according to the intelligent control rule.
  • the UI interface will not be described in detail here.
  • the mobile terminal can generate an electronic fence, and when the mobile terminal detects that the user has left the electronic fence, the mobile terminal can output a second prompt message, which is used to remind the user that the user has left the safe area;
  • the terminal devices of other family members and furniture devices in the family in the same smart home account as the mobile terminal send the second information, which can then trigger the terminal devices of other family members and fixed devices in the family to initiate alarms, thereby protecting users. for the purpose of personal safety.
  • the mobile terminal can automatically generate an electronic fence according to the user's life trajectory within a second time period, for example, within a week.
  • Xiaoai's mobile terminal 100-6 may enable the electronic fence function by default, or enable the electronic fence function in response to a user operation.
  • the mobile terminal 100-6 can obtain the activity track of Xiao Ai, and generate an electronic fence according to the activity track.
  • Xiaoai’s activity track usually includes Xiaozhong’s home, Xiaoai’s school, and the round-trip time between Xiaozhong’s home and Xiaoai’s school.
  • the mobile terminal 100-6 When the mobile terminal 100-6 detects that Xiao Ai is active at home, the mobile terminal 100-6 can combine the map to set the range of the community of Xiaozhong’s home as electronic fence 1; when the mobile terminal 100-6 detects that Xiao Ai is in When moving anywhere in the school, the mobile terminal 100-6 can combine the map to set the range of Xiaoai's school as the electronic fence 2. It can be understood that the ranges of the geo-fence 1 and the geo-fence 2 shown in FIG. 8R are only examples. The mobile terminal 100-6 obtains Xiao Ai's position each time it locates, which is actually a fixed point on the map.
  • the mobile terminal 100-6 may continuously obtain the location of Xiao Ai within a preset time period, which may be the same fixed point, or multiple different but adjacent fixed points.
  • the processor of the mobile terminal 100-6 can generate an electronic fence according to the one fixed point, or the area composed of multiple fixed points, combined with its position in the map, and the boundary of Xiaoai's activity area corresponds to the electronic fence, but the electronic fence
  • the area is usually greater than or equal to the boundary of the actually obtained Little Love's activity area.
  • the embodiment of the present application does not limit the size and shape of the electronic fence.
  • the geo-fence 1 and the geo-fence 2 together form the geo-fence domain, and the routes between the geo-fences in the geo-fence domain also belong to the scope included in the geo-fence domain. Therefore, Xiao Ai's round-trip route between home and school, that is, the second route is the necessary route between Geo-Fence 1 and Geo-Fence 2, and this route belongs to Xiao Ai's Geo-Fence domain.
  • the above-mentioned electronic fence 1, electronic fence 2, and the second route between electronic fence 1 and electronic fence 2 may also be referred to as a first electronic fence.
  • the user can actively set the electronic fence area.
  • Xiaozhong, Xiaoai's father can enter the third operation for setting Xiaoai's electronic fence in Xiaoai's mobile terminal 100-6, or input and set Xiaoai's electronic fence in Xiaozhong's mobile terminal 100-1.
  • the third operation of the electronic fence is to set the electronic fence. The embodiment of the present application does not limit this.
  • the geo-fence domain is also a geo-fence, and the geo-fence domain includes multiple geo-fences and necessary lines between geo-fences.
  • the electronic fence is only a name, which should not constitute a limitation to this application.
  • the electronic fence can also be called a security range, etc., which is not limited in this embodiment of the application .
  • Xiaoai's mobile terminal may be called the fourth electronic device, that is, the fourth electronic device includes the mobile terminal 100-6.
  • the mobile terminal 100-6 can periodically locate Xiaoai. When the mobile terminal 100-6 detects that Xiaoai is located outside the electronic fence 1 and electronic fence 2 in the first electronic fence mentioned above, The mobile terminal 100-6 can directly output the second prompt message, or send the second message to the fifth device to remind parents that Xiao Ai is currently in a dangerous area, and parents are requested to contact Xiao Ai as soon as possible to ensure the safety of Xiao Ai.
  • the fifth device includes the mobile terminal of Xiao Ai's parents, other furniture devices in the family, and the on-board computer in the vehicle.
  • the mobile terminal 100-6 when the mobile terminal 100-6 detects that Xiao Ai's location exceeds the first distance and/or exceeds the first time period outside the second route in the first electronic fence, the mobile terminal 100-6 can directly output the second prompt information, or send the second information to the fifth device.
  • the mobile terminal may also generate a second electronic fence, and when the mobile terminal detects that the user has entered the second electronic fence, the mobile terminal may output third prompt information, which is used to remind the user that he has entered the dangerous area ; Or, the third information can also be sent to the terminal devices of other family members in the same smart home account as the mobile terminal and the furniture devices in the family, which in turn can trigger the terminal devices of other family members and the fixed devices in the family to initiate Alarm, so as to achieve the purpose of protecting the personal safety of users.
  • parents can equip their children, such as the second electronic fence shown in Figure 8R, when the mobile terminal When it is detected that the child enters the second electronic fence, the mobile terminal can be triggered to initiate an alarm, for example, the mobile terminal can be triggered to initiate an alarm to the terminal devices of other family members in the same smart home account and the fixed devices in the family.
  • family members in addition to controlling and using the home device through the smart home APP installed on the mobile terminal 100 , family members can also directly use or control the home device.
  • the family device when family members directly operate the family device, the family device will also turn on the identity authentication function to identify the current identity and determine whether the current user's identity has the right to use the family device; or, when the family member directly operates the family device , the home device will also enable the identity authentication function, upload the collected user information corresponding to the identity authentication method to the server 300, and the server 300 will identify the user's identity and determine whether the current user's identity is qualified to use the home device. If the authority of the user has the authority, then the result is sent to the home device. When the user has the right to use the home device, it responds normally and performs the corresponding operation; when the home device detects that the identity of the current user does not have the right to use the home device, it refuses to perform the corresponding operation.
  • the method for the home device to identify the user's identity may be any of the following:
  • the home device sends the collected information corresponding to the user's identity authentication, such as facial information, fingerprint information, voiceprint information, operating habits, etc., to the server 300, and the server 300 corresponds to the stored family members uploaded by the mobile terminal 100.
  • the information corresponding to the user's identity authentication is compared with the information corresponding to the user's identity authentication uploaded by the home device, and then the user's identity is identified, and the identification result is sent to the home device.
  • the home device pre-stores the information corresponding to the identity authentication of all family members issued by the server, and compares the above information with the collected information corresponding to the identity authentication of the user to identify the identity of the user.
  • the family device when the family device recognizes that the identity of the current user does not have the right to use the family device, the family device controls the mobile terminal corresponding to the identity to send the mobile terminal corresponding to the identity to the family creator or The administrator's mobile terminal performs instant messaging such as phone calls and videos. After being informed of the event, the family creator or administrator can authorize the user in his mobile terminal to allow him to continue to use the home appliance normally, provided that there is no danger. In this way, it is possible to avoid the occurrence of forced use by the user, or even destruction of household equipment by violent persons.
  • the mobile terminal 100 such as a mobile phone detects that the user has input a sensitive operation, it can enable identity authentication. If it is recognized that the current user is not the owner of the device, it will refuse to execute the event corresponding to the sensitive operation and prompt Prompt information for user operation failure, in addition, prompt information will be sent to other terminal devices of the owner.
  • the mobile terminal 100 may continuously perform identity authentication. That is to say, the mobile terminal 100 can perform periodic identity authentication within the preset time when sensitive operations are detected. Operate the corresponding event; if the number of times that the current user is not detected as the owner is greater than or equal to the preset number of times, then the mobile terminal 100 still refuses to execute the event corresponding to the sensitive operation, if the mobile terminal 100 detects that the user is still in the If you are using a page that performs sensitive operations or uses an APP that provides sensitive operations, the mobile terminal 100 will be locked.
  • the mobile terminal 100 will send the event to other mobile terminals equipped by the owner himself, such as wristbands, for any one time within the preset number of times, or when the preset number of times detects that someone other than the owner himself is performing a sensitive operation, In order to remind the owner that others are using the mobile terminal 100 to perform sensitive operations.
  • the above-mentioned sensitive operations may include any one or more of the following:
  • Execute payment operations including payment operations performed in social apps, streaming apps, payment apps, online banking apps, shopping apps, and live broadcast apps that provide payment functions.
  • the amount can be greater than a preset value, or any value.
  • FIG. 9A-FIG. 9G exemplarily show a series of user interface diagrams after the mobile terminal 100-1 in the small medium detects a sensitive operation.
  • FIG. 9A exemplarily shows a schematic diagram of a user interface provided by a social APP.
  • the user interface 91 is a chat interface provided by a social APP, and the user interface 91 displays a chat area 911 and a function area 912 .
  • 911 shows the chat content of Xiaozhong and Xiaojun.
  • the chat content shows that Xiaojun requires Xiaozhong to transfer a deposit of 520 yuan.
  • Xiaozhong agrees and clicks the transfer icon 912A in the function area 912.
  • the mobile terminal 100 The transfer interface as shown in FIG. 9B is displayed. It is understandable that Zhongjun and Xiaozhong here only refer to the accounts of two users in the social APP, and the user using the account at this time is not necessarily the account himself.
  • the user interface 92 is the transfer interface provided by the social APP.
  • the mobile terminal 100-1 can detect that the user has input the amount of 520 as shown in FIG. 9B, and clicks the payment control. In response to the above operation, the mobile terminal 100-1 can directly enable identity authentication, or the mobile terminal 100-1 can Firstly, the user identity authentication prompt information shown in FIG. 9C is displayed. The embodiment of the present application does not limit this.
  • the user interface 92 displays a window 921 , and the window 921 displays a prompt message such as "It is detected that you are performing a payment operation, are you the owner of the device?", as well as controls 921A and 921B.
  • the identity authentication method here may be the same or different or more or less than the identity authentication method provided by the smart home APP above, which is not limited in this embodiment of the present application.
  • the mobile terminal 100-1 may detect that the user inputs an operation on the control 921A as shown in FIG. 9C, and in response to the operation, the mobile terminal 100-1 enables identity authentication.
  • the prompt information shown in FIG. 9D is displayed.
  • user interface 92 displays window 922, and controls 922A and 922B.
  • Window 922 displays a prompt message such as "verification failed, payment operation not supported for now".
  • the control 922A is used to continue the identity authentication, and the control 922B is used to end the identity authentication and close the payment operation interface.
  • the mobile terminal 100-1 can detect that the user input acts on the operation of the control 922B as shown in Figure 9D, and in response to this operation, the mobile terminal 100-1 does not continue to perform identity authentication, and at the same time closes the page for transferring money to Xiaojun .
  • the mobile terminal 100-1 may detect that the user input acts on the operation of the control 922A as shown in FIG. 9D , and in response to the operation, the mobile terminal 100-1 continues to perform identity authentication.
  • the mobile terminal 100-1 can automatically perform identity authentication without detecting the operation on the control 922A. The embodiment of the present application does not limit this.
  • the prompt information may include the information displayed in the windows 923 and 924 shown in FIG. 9E and FIG. 9F. Prompt the user the number of times the user has failed authentication, and how many authentication opportunities are left.
  • the mobile terminal 100-1 can send a prompt message to the owner himself, that is, other mobile terminals equipped in the small center. .
  • Xiaozhong can agree to allow others to use the mobile terminal 100-1
  • the mobile terminal 100-9 can send information to the mobile terminal 100-1 to allow others to use the machine to make payment. Provide payment services.
  • FIG. 9H-FIG. 9M exemplarily show a series of user interface diagrams after the mobile terminal 100-1 in the small medium detects another sensitive operation.
  • FIG. 9H exemplarily shows a schematic diagram of a scene where Xiao Ming uses Xiaozhong's mobile phone to watch a live broadcast.
  • the user interface 93 is a live broadcast page provided by the live broadcast APP.
  • the user interface 93 displays the anchor's video area, live broadcast time, message area, controls 931 and so on.
  • the mobile terminal 100-1 may detect an operation on the control 931, and in response to the operation, the mobile terminal 100-1 expands and displays the window for rewarding gifts for the host as shown in FIG. 9I.
  • window 932 displays multiple gift options, such as lollipop, Mojito, little flower, crown, diamond, little heart, etc. Different gifts correspond to different prices. Assuming that user Xiao Ming chooses the lollipop option, And click on the gift control, and in response to this operation, the mobile terminal 100-1 displays a recharge window as shown in FIG. 9J .
  • the user interface 93 displays a recharge window 933 . It is understandable that the payment services provided by some APPs need to be recharged to convert RMB into payment methods supported by the APP, such as "Y coins”. After that, users can use the payment methods supported by the APP to perform payment operations.
  • Mobile terminal 100-1 can detect that the user enters the operation of recharging 520 as shown in Figure 9J, and in response to this operation, mobile terminal 100-1 can directly enable identity authentication, or mobile terminal 100-1 can first display User identity authentication prompt information shown in 9K.
  • the embodiment of the present application does not limit this.
  • the user interface 93 displays a window 934 , and the window 934 displays a prompt message such as "It is detected that you are performing a payment operation, are you the owner of the device?", as well as a control 934A and a control 934B.
  • the identity authentication method here may be the same or different or more or less than the identity authentication method provided by the smart home APP above, which is not limited in this embodiment of the present application.
  • the mobile terminal 100-1 may detect that the user inputs an operation on the control 934A as shown in FIG. 9K , and in response to the operation, the mobile terminal 100-1 enables identity authentication.
  • the prompt information shown in FIG. 9L is displayed.
  • user interface 93 displays window 935, and controls 935A and 935B.
  • Window 935 displays a prompt message such as "Verification failed, recharge operation not supported for now".
  • the mobile terminal 100-1 may detect that the user input acts on the operation of the control 935B as shown in FIG. 9D , and in response to the operation, the mobile terminal 100-1 does not continue identity authentication, and closes the recharge page at the same time.
  • the mobile terminal 100-1 may detect that the user input acts on the control 935A and the operation shown in FIG. 9D , and in response to the operation, the mobile terminal 100-1 continues to perform identity authentication.
  • the mobile terminal 100-1 can automatically perform identity authentication without detecting the operation on the control 922A. The embodiment of the present application does not limit this.
  • the mobile terminal 100-1 detects that the user inputs an operation on the control 935B as shown in FIG. 9L , in response to the operation, the mobile terminal 100-1 continues to display the live video as shown in FIG. 9M .
  • the sensitive operations described in this application are not limited to the examples of the two payment operations shown in Figure 9A-9G and Figure 9H-9M above, and there are other sensitive operations, such as detecting that When performing online gambling games or purchasing commodities, scanning codes for payment, etc., the mobile terminal 100 will also implement the above method to prevent the user from continuing to perform sensitive operations or conduct sensitive behaviors, etc., which will not be described in this embodiment of the application.
  • FIG. 9N-FIG. 9Q exemplarily show a series of user interface diagrams after the mobile terminal 100-1 in the small medium detects another sensitive operation.
  • FIG. 9N exemplarily shows a schematic diagram of a scene where other users use the mobile terminal of Xiaozhong to scan the code for payment.
  • the user interface 94 is a barcode scanning interface, and the interface displays an image collection area 941 that displays images collected by the mobile terminal 100 - 1 , such as Xiaojun's payment code. After the mobile terminal 100-1 successfully scans Xiaojun's payment code, the payment interface shown in FIG. 9O may be displayed.
  • the user interface 95 is a payment interface, which can support the user to pay Xiaojun.
  • the mobile terminal 100-9 can detect that the user has input 200 yuan and act on the operation of the payment control. In response to this operation, the mobile terminal 100-1 can first display the user identity authentication prompt as shown in Figure 9Q information.
  • the mobile terminal 100-1 detects the operation of the control 952A shown in FIG. 9Q , in response to the operation, the mobile terminal 100-1 enables identity authentication.
  • identity authentication is successful, that is, when the current user is the owner of the mobile terminal 100-1, Xiaojun, the mobile terminal will pay Xiaojun; and when the identity authentication fails, the user interface displayed by the mobile terminal 100-1 can refer to the above The descriptions of FIG. 9D-FIG. 9G will not be repeated here.
  • the identity authentication function when the mobile terminal 100-1 detects a payment operation, the identity authentication function will be turned on when the payment amount is greater than the preset amount, such as 100 yuan, and the identity authentication function will not be activated when the payment amount is less than or equal to the preset amount.
  • the identity authentication function will be turned on and the payment will be made directly to the other party.
  • the mobile terminal 100-1 detects a payment operation and the payment object is an unused contact, the identity authentication function is enabled; when the payment object is a frequent contact, the identity authentication is not enabled and the payment is made directly to the other party.
  • the mobile terminal 100-1 may not display the prompt information shown in FIG. 9Q in response to the payment operation shown in FIG. 9P, and may directly enable identity authentication, which is not limited in this embodiment of the present application. .
  • FIG. 9R-FIG. 9W exemplarily show a series of user interface diagrams after the mobile terminal 100-1 in the small medium detects another sensitive operation.
  • the mobile terminal When the mobile terminal detects that the user is watching live broadcasts, underage videos, or playing games, it can enable identity authentication. If it detects that the user is not the owner himself, the user is prohibited from watching live broadcasts, underage videos, and playing games. Next, take Xiao Ai to use Xiaozhong's mobile terminal 100-1 to watch the live broadcast as an example.
  • the user interface 96 displays a window 962, and the window 962 displays a prompt message such as "It is detected that you are making a payment operation, are you the owner of the device", and a control 962A and a control 962B.
  • the control 962A is used to enable the identity authentication function
  • the control 962B is used to close the window 962 and refuse to enter the live broadcast room.
  • the identity authentication method here can be the same or different or more or less than the identity authentication method provided by the smart home APP above, which is not limited in this embodiment of the application.
  • the mobile terminal 100-1 When the mobile terminal 100-1 detects the operation of the control 952A shown in FIG. 9Q , in response to the operation, the mobile terminal 100-1 enables identity authentication. After the mobile terminal turns on the identity authentication, if the authentication is successful, it will enter the live room corresponding to option 961 and display the live content; if the authentication fails, the mobile terminal will display the authentication failure prompt information as shown in Figure 9T.
  • the mobile terminal 100-1 can detect that the user input acts on the operation of the control 963B as shown in FIG. content.
  • the mobile terminal 100-1 may detect that the user input acts on the operation of the control 963A as shown in FIG. 9T, and in response to the operation, the mobile terminal 100-1 continues to perform identity authentication.
  • the mobile terminal 100-1 does not need to detect the operation on the control 963A, and when the display time of the window 963 exceeds a preset time, the mobile terminal 100-1 may automatically perform identity authentication. The embodiment of the present application does not limit this.
  • -1 can take one or more of any of:
  • the mobile terminal 100-1 may send prompt information to the owner himself, that is, other mobile terminals equipped in the small center. For example, a prompt message is sent to the mobile terminal 100-9 in the small and medium-sized bracelet or the vehicle-mounted computer.
  • the on-board computer can receive the prompt message sent by the mobile terminal 100-1, and output the prompt message.
  • the prompt information can be output in the form of voice broadcast, or can be displayed in the user interface as shown in FIG. 9W.
  • the vehicle computer displays a prompt message "others want to use your mobile terminal 100-1 to watch the live broadcast", as well as an consent control and a rejection control.
  • Xiao Zhong can enter the operation of agreeing to allow others to use the mobile terminal 100-1 to watch the live broadcast on the vehicle-mounted computer. After receiving the information, you can unlock the screen or unlock the APP that provides live broadcast, and provide the service of watching live broadcast for non-owners themselves.
  • the method for controlling family devices also includes setting rules for parents using electronic devices. details as follows:
  • the mobile terminal 100 may set the rules for the parents to use the family device, and the rules may be set by the mobile terminal 100 by default, or may be user-defined.
  • the rule for the parent to use the home device specifically refers to: when the state of the child is a specified state, the home device does not support the parent to perform the specified operation.
  • the above specified status includes any one or more of the following: the child is not sleeping, the child is studying or the child is not in the same room as the parent.
  • the embodiment of the present application does not limit the specified status of the child.
  • the above specified operations include any one or more of the following: playing games, watching TV dramas, live broadcasting, short videos, etc. This embodiment of the present application does not limit the designated operations restricted by parents.
  • the device used to detect the state of the child may be any one or more of the following in the family device 200: monitoring devices such as cameras, portable terminal devices such as mobile phones, tablets, notebooks, smart watches, sports bracelets etc.
  • monitoring devices such as cameras
  • portable terminal devices such as mobile phones, tablets, notebooks, smart watches, sports bracelets etc.
  • the embodiment of the present application does not limit this.
  • the above-mentioned device for detecting the state of a child may also be referred to as a sixth device.
  • Scenario 1 Xiaozhong stays at home to accompany and take care of Xiaoai.
  • Xiaozhong can use the mobile terminal 100-1 to set rules for using the home device 200 in order to be a good father and set a good example for Xiaoai.
  • the rule is, for example: when Xiao Ai is not sleeping, or Xiao Ai is studying, or Xiao Ai and Dad stay in the same room, Dad Xiaozhong is not allowed to use the home device 200 to play games, watch dramas, or watch live broadcasts.
  • FIG. 9X exemplarily shows a schematic diagram of an operation interface for a small middle school to use the mobile terminal 100-1 to watch a live broadcast.
  • the user interface 121 is the desktop of the mobile terminal 100-1. Icons corresponding to live broadcast applications, icons corresponding to game applications, icons corresponding to short video applications, and icons corresponding to Huawei Video are displayed on the desktop.
  • the mobile terminal 100-1 acquires the status of Xiao Ai includes any one or more of the following methods.
  • the mobile terminal 100-1 responds to the detected operation on the icon of the live application program, and in response to the operation, the mobile terminal 100-1 is triggered to control other home devices 200 to detect the status of Xiao Ai.
  • control home monitoring devices such as cameras to obtain the status of Xiao Ai
  • control home devices 200 such as smart watches, bracelets, and mobile phones of Xiao Ai to obtain the status of Xiao Ai.
  • the mobile terminal 100-1 can periodically receive the status of Xiao Ai detected by other home devices 200, and store the data related to the status of Xiao Ai. In response to the operation of the icon of the program, the mobile terminal 100-1 retrieves the relevant data about the status of receiving Xiao Ai last time to determine whether Xiao Zhong can watch the live broadcast.
  • the mobile terminal 100-1 acquires the status of the child according to the user inputting an operation related to the status of the child.
  • the mobile terminal 100-1 will output prompt information prohibiting the user from watching the live broadcast.
  • the prompt information can be output in the form of language broadcast, or the prompt information shown in FIG. 9Y can also be displayed. The embodiment of the present application does not limit this.
  • the mobile terminal 100 - 1 displays a prompt message such as "It is detected that Xiao Ai is not asleep yet, you cannot watch the live broadcast yet", and refuses to run the live broadcast application.
  • the mobile terminal 100-1 shown in FIGS. 9X-9Y performs specified operations according to Xiaozhong, and when Xiaoai is in the specified state, the schematic diagram of the user interface is only an example and should not be construed as a limitation to this application.
  • the specified operation detected by the mobile terminal 100-1 also includes an operation for opening a game application program or a short video application program, and the operation is not limited to an operation acting on an icon of the application program.
  • the application program can be opened in the form of inputting a voice command or the like.
  • the mobile terminal 100-1 detects that the user is in the specified state, besides not sleeping, for example, studying or sharing the same room with parents and so on.
  • the prompt information output by the mobile terminal may also be in the form of a text message reminder, or a window reminder, or displayed in a module for receiving messages in the smart home APP, or a voice reminder, etc., the present application The embodiment does not limit this either.
  • the mobile terminal 100 may set rules for the children to use the family device, and the rules may be set by the mobile terminal 100 by default, or may be user-defined.
  • the rule for the parent to use the family device specifically refers to: when the state of the parent is a designated state, the family device does not support the parent to perform a designated operation.
  • the above specified status includes any one or more of the following: parents away from home, parents sleeping, etc.
  • the embodiment of the present application does not limit the designation status of the parents.
  • the above specified operation can be called the eighth operation, and the eighth operation is used to enable the third function of the mobile terminal 100, that is, your first device.
  • the third function includes any one or more of the following: unlocking the screen, enabling playing games, Watch TV and so on. This embodiment of the present application does not limit the designated operations restricted by parents.
  • the device used to detect the status of the parents may be any one or more of the following in the family device 200: monitoring devices such as cameras, portable terminal devices such as mobile phones, tablets, smart watches, sports bracelets, etc. .
  • monitoring devices such as cameras
  • portable terminal devices such as mobile phones, tablets, smart watches, sports bracelets, etc.
  • the embodiment of the present application does not limit this.
  • the device used to restrict the child from performing specified operations may be any one or more of the following in the family device 200: mobile phone, tablet, notebook, TV, projection device, game console and so on.
  • the embodiment of the present application does not limit this.
  • the above-mentioned device for detecting the state of the parents may also be referred to as a sixth device.
  • the mobile terminal 100-6 can lock the screen or lock some functions until the mobile terminal 100-6 detects that Xiaoai uses the mobile terminal 100-6 to complete the above tasks; or the mobile terminal 100-6 receives The mobile terminal 100-6 will not wait until Xiaoai uses other home equipment such as a treadmill to complete the 1-hour exercise task data, and receives the relevant data that Xiaoai uses other home equipment such as a learning machine to complete the 1-hour learning task. Unlock, or unlock some functions.
  • FIG. 10A-FIG. 10H exemplarily show a series of operation interface diagrams for setting the usage rules and related tasks of the device in the mobile terminal 100-1.
  • the user interface displayed by the mobile terminal 100-1 is similar to the user interface 81 shown in FIG. 6K, FIG. 8F, and FIG. I won't go into details here.
  • the mobile terminal 100-1 can detect that the user clicks on the option 814 in Figure 10B.
  • the option 814 is used to open the My Other Devices page.
  • This page can specifically provide the user with management of other devices such as tablets, notebooks, wristbands, and earphones. and other functions, therefore, in response to the above operations, the mobile terminal 100-1 displays the user interface 101 as shown in FIG. 10C .
  • the user interface 101 displays options 1011 , 1012 , 1013 , etc. corresponding to already bound electronic devices, and a control 1014 for binding more devices.
  • option 1011 corresponds to the mobile terminal 100-9 equipped in Xiaozhong
  • option 1012 corresponds to Xiaoai's mobile terminal 100-5 such as a smart watch
  • option 1013 corresponds to Xiaoai's mobile terminal 100-6 such as a tablet computer. Users can click the above options to set the usage rules of the corresponding device, as follows:
  • the mobile terminal 100-1 may detect an operation on any device option in FIG. 10C , and in response to the operation, display the usage rule setting page corresponding to the device. For example, the mobile terminal 100-1 may detect that the user clicks the option 1013 in FIG. 10C , and in response to the operation, the mobile terminal 100-1 displays the usage rule setting page of the mobile terminal 100-6 as shown in FIG. 10D .
  • the user can set the learning duration, exercise time period, password for unlocking, etc. by clicking the default options provided by the mobile terminal 100-1.
  • the allowed application included in the first rule may also be referred to as the first application.
  • the time period allowed to continuously use the first application program is the third time period.
  • the mobile terminal 100-1 may detect operations for setting usage rules and unlocking tasks of the mobile terminal 100-1.
  • the user sets the options given above by default to use the mobile terminal 100-6 for a day that does not exceed the first duration, such as 4 hours, and that the duration of continuous use does not exceed the second duration, such as 1 hour, and the usage period is the third time.
  • the restricted APPs are live broadcast A and reading A, etc.
  • the user sets the above-mentioned default options for unlocking to require 1 hour of active time, 1 hour of learning time, or enable the unlock password.
  • the mobile terminal 100-6 when the mobile terminal 100-1 detects that the user is operating on the control 1028B, and the mobile terminal 100-6 detects that the user breaks any one or more rules, the mobile terminal 100-6 will lock or restrict Some functions, if the user wants to unlock the mobile terminal 100-6, or release some of the restricted functions in the mobile terminal 100-6, he needs to complete the set unlocking task. Specifically, when the mobile terminal 100-6 detects the above The mobile terminal 100-6 can be unlocked, or the restricted functions of the mobile terminal 100-6 can only be unlocked after any one or more of the unlocking tasks meet the conditions.
  • a custom usage rule 1031 and a control 1032 for adding a usage rule are displayed in the user interface 103 .
  • the custom usage rules 1031 are as follows: set the type of APP to be used as a game APP, set the total time of using the game APP to 3 hours a day, set the total time of using the APP to 1 hour, and set the total duration of using the APP to 1 hour. The time period is 8:30-12:00 in the morning and 14:00-18:00 in the afternoon.
  • the customized unlocking task 1 is specifically: study for 1 hour, and run for 1 hour;
  • the customized unlocking task 2 is specifically: Xiaozhong's fingerprint, Xiaohua's fingerprint, etc.
  • FIG. 10H only exemplarily shows a schematic diagram of a custom page, in other embodiments of the present application.
  • the relevant content of usage rules that users can customize can also include, for example: the total duration of using a certain APP or a certain type of APP in a day, the duration of each use of a certain APP or a certain type of APP, or the duration of using a certain or a certain type of APP.
  • the duration of the specified function or prohibit the use of a certain or a certain type of APP, or prohibit the use of a certain or a certain type of specified function in an APP, etc.
  • the option of the above-mentioned use time period is not limited to setting a specific time, and the use time period can also be set by date. For example, for children, they need to go to school from Monday to Friday, and Saturday and Sunday are rest days. Therefore, the use time period can also be personalized according to the date. For example, Xiaoai is not allowed to play with electronic devices from Monday to Friday, or can only play for a while at 18:00-19:00 in the evening, while on Saturdays and Sundays, you can Playing with electronic devices without affecting rest can be set, for example, to 8:30-12:00 am and 14:00-18:00 pm every Saturday and Sunday. The embodiment of the present application does not limit the setting of use time .
  • the relevant content of the unlocking task that can be customized by the user may include, for example: any one or more users among multiple specified users input instructions for unlocking to the mobile terminal 100-6, such as inputting a password, or a fingerprint, or a face, etc. Information, or the way of sending a verification code to the mobile terminal 100-6; or you can also set the tasks necessary for Xiao Ai, these tasks can be sports, learning, or doing housework, and the completion of these tasks
  • the platform can be completed in Xiaoai's local mobile terminal 100-6, or it can be completed in other devices in the family device.
  • Xiao Ai can complete the task of studying left for one hour on the mobile terminal 100-6, or Xiao Ai can complete the task of running for one hour on the treadmill, or Xiao Ai can use household cleaning equipment such as a vacuum cleaner to clean the whole house tasks and so on.
  • the embodiment of the present application does not limit the setting of usage rules and unlocking tasks.
  • the use rule of the mobile terminal 100-6 exemplarily shown in FIG. 10F and FIG. 10H above may be called the first rule, and the unlocking task exemplarily shown in FIG. 10F and FIG. 10H above may be called for the first task.
  • the operation for setting the first rule shown in FIGS. 10C-10H can be called the fourth operation, and the user can set the mobile terminal 100-6, which is the first rule, by inputting the fourth operation in the mobile terminal 100-1, which is the first device. four-device first rule, then the mobile terminal 100-1 may send the first rule to the mobile terminal 100-6.
  • the mobile terminal 100-6 may directly receive a fourth operation input by the user to set its own first rule.
  • Fig. 11A-Fig. 11R exemplarily show a series of operation interfaces when the mobile terminal 100-6 is used by Xiaoai based on the usage rules and unlocking tasks set by Xiaozhong in the mobile terminal 100-1 schematic diagram.
  • Fig. 11A exemplarily shows a schematic interface diagram of a series of application programs installed on the mobile terminal 100-6.
  • the mobile terminal 100-6 can detect the operation for opening the game, for example, the operation acting on the application icon 1111 of the game A shown in FIG.
  • One of the set rules of use "The time period for using game apps is 8:30-12:00 and 14:00-18:00", refuses to run Game A.
  • the mobile terminal 100-6 may also display prompt information as shown in FIG. 11B .
  • the user interface 111 displays a window 1112 .
  • Window 1112 displays information for prompting the user to play the rules of the game, for example, the prompt message "Now is not the game time, you can play the game between 8:30-12:00 and 14:00-18:00".
  • the window 1112 also displays a control 1112A and a control 1112B, wherein the control 1112A is used to unlock the game and obtain permission to play the game; the control 1112B is used to close the window 1112 .
  • Xiao Ai can unlock the game by clicking any of the above options and using the corresponding unlocking method.
  • the unlocking task will not be described in detail here, and will be introduced in detail in Figure 11M- Figure 11R below.
  • the prompt information for performing the unlocking task exemplarily shown in FIG. 11B-FIG. 11C may also be referred to as fourth prompt information.
  • the time displayed on the mobile terminal 100-6 is 8:30, which belongs to the game playing time set in the small box. Therefore, at this time, the mobile terminal 100-6 can detect the operation on the icon 1111, and in response to the operation, the mobile terminal 100-6 will display the schematic diagram of the user interface provided by the game A as shown in FIG. 11G.
  • the user interface 112 is the home page provided by game A.
  • Xiao Ai can click to start the game and experience the game.
  • the mobile terminal 100-6 can record the time of playing the game from the detection of the operation acting on the control to start the game, and can also start recording the time of playing the game from the detection of the operation for opening the game A application. Without going into details, the following embodiments will start to record the time when Xiao Ai plays games at 8:30 as an example.
  • user interface 113 provides game A with a game interface.
  • the mobile terminal 100-6 detects that the game A is running for more than a certain period of time, it will display prompt information, which is used to prompt the user how long the game has been played and how long the remaining game time is. For example, if the mobile terminal detects that Xiao Ai plays the game from 8:30 until 9:10, the mobile terminal 100-6 will display a prompt message 1131 .
  • the prompt message 1131 shows the prompt message "It has been detected that your game time has reached 40 minutes, and after playing for another 20 minutes, your current game time will be full".
  • the user interface 114 is the game halftime interface after the end of a game.
  • the time is 9:20 at this time, and there are 10 minutes left in the game time according to regulations. If the mobile terminal 100-6 detects a small For the operation of the controls for starting the next game as shown in FIG. 11I , the mobile terminal 100-6 can display the prompt information as shown in FIG. 11J .
  • the user interface 114 displays a window 1141, which displays a prompt message "It has been detected that your game time is only 10 minutes left. Now start a new game, and the game may be interrupted", and also displays a control 1141A and controls 1141B. Among them, the control 1141A is used to continue to open a new game, and the control 1141B is used to exit the game. Assuming that Xiao Ai wants to continue a new round of the game, the mobile terminal 100-6 can detect an operation acting on 1141A, and in response to the operation, the mobile terminal 100-6 will start a new round of the game.
  • the mobile terminal 100-6 When the mobile terminal 100-6 detects that Xiao Ai is playing a new game, and the game time reaches 1 hour, that is to say, when the mobile terminal 100-6 detects that the time is 9:30, the mobile terminal 100-6 6 will prompt the user that the game time is full, and forcibly quit the game; or, the mobile terminal 100-6 will prompt the user that the game time is full, but does not forcibly quit the game, and the mobile terminal 100-6 will quit the game after the end of the game , that is, stop running the game APP.
  • the embodiment of the present application does not limit this.
  • the mobile terminal 100-6 displays a prompt message that the game time is over and the game is forcibly exited, to show a schematic diagram of the user interface displayed by the mobile terminal 100-6.
  • Figure 11L exemplarily shows that the mobile terminal 100-6 detects that the game time is full, exits the game being played and displays the home page provided by game A.
  • the home page displays a window 1121
  • the window 1121 displays "This game has been played for 1 hour. If you want to continue the game, you need to unlock the game.”
  • the window 1121 also displays a control 1121A and a control 1121B. Among them, the control 1121A is used to unlock the game, and the control 1121B is used to exit the game.
  • the mobile terminal 100-6 displays the user interface shown in FIG. 11L
  • Xiao Ai does not want to play the game
  • the mobile terminal 100-6 6 will stop running the game APP and display the desktop.
  • the mobile terminal will keep the state of locking the game application program in the preset time such as the same day, that is to say, the user cannot continue to play the game on the same day, and has to wait until the specified time of the next day to reopen the game.
  • FIG. 11M-FIG. 11R exemplarily show a series of user interface schematic diagrams for Xiaoai to use the mobile terminal 100-6 to complete the unlocking task 1.
  • user interface 112 displays window 1122 .
  • Window 1122 displays a method for prompting the user to select the method of unlocking the game, and options corresponding to unlocking task 1 such as option 1122A and option 1122B.
  • option 1122A and option 1122B are specifically: mobile terminal 100-6, according to the unlocking task 1 of mobile terminal 100-6 set in mobile terminal 100-1 shown in FIG.
  • the option 1122A corresponding to the 1-hour task
  • the option 1122B corresponding to displaying, for example, Xiaozhong's fingerprint and Xiaohua's fingerprint.
  • the prompt information for performing the unlocking task exemplarily shown in FIGS. 11L-11M may also be referred to as fourth prompt information.
  • the mobile terminal 100-6 will provide the user with a learning task
  • the mobile terminal detects the operation acting on the option 1122A shown in Figure 11M, and in response to the operation, displays the The user interface provided by the learning APP.
  • FIG. 11N exemplarily shows a schematic diagram of a user interface provided by the Learning A application.
  • the user interface 116 displays options for learning courses, such as word topics, grammar topics, long and difficult sentence topics, and composition topics, etc., wherein each option corresponds to displaying the learning progress of the course, such as courses that have been studied A label such as completed will be displayed, and a label such as unstarted will be displayed corresponding to the courses to be learned.
  • learning courses such as word topics, grammar topics, long and difficult sentence topics, and composition topics, etc.
  • the mobile terminal 100-6 can automatically open unstarted courses for the user to study, or can open the corresponding course for the user to study according to the user's selection. For example, the mobile terminal 100-6 may detect the user's operation on the topic option of long and difficult sentences, and in response to the operation, the mobile terminal 100-6 displays the above user interface as shown in FIG. 110 .
  • FIG. 11O exemplarily shows the details page corresponding to the long and difficult sentence special courses provided by the learning A application program.
  • the mobile terminal 100-6 determines that the user's learning time is full for 1 hour, therefore, the mobile terminal 100-6 may display the prompt information as shown in Fig. 11P.
  • the user interface 117 displays another part of the course corresponding to long and difficult sentences, for example, it may include: example sentence 9, translation 9, analysis 9 and so on.
  • a window 1171 is also displayed on the user interface 117, and the window 1171 displays a prompt message for prompting the user such as "Congratulations, the learning time is 1 hour, and the learning task has been completed", as well as options 1171A and 1171B.
  • option 1171A is used to close the current window 1171, and continue to display the user interface provided by learning A shown in FIG. 11P; option 1171B is used to end the learning task and jump to the exercise task.
  • the mobile terminal 100-6 when the mobile terminal 100-6 displays the above Figures 11O to 11P, that is, during the user learning process, the mobile terminal 100-6 can periodically authenticate the current user to ensure that the current user is Xiao Ai herself, not others to study on behalf of Xiao Ai.
  • the mobile terminal 100-6 In a practicable manner, assuming that the mobile terminal 100-6 will provide the user with sports tasks, the mobile terminal 100-6 detects that the user acts on the control of 1171B in the user interface shown in FIG. 11P , and responds to the operation , displaying the user interface provided by the AI fitness APP as shown in FIG. 11Q .
  • FIG. 11Q exemplarily shows a schematic diagram of a user interface provided by an AI fitness APP.
  • the user interface 118 displays sports content.
  • the left area of the user interface 118 displays an image of a coach
  • the right area displays an image of the user Xiaoai.
  • the coach Owen displayed in the left area can demonstrate movements.
  • Normal mode: Xiaoai can guide learning exercises according to the coach's picture, and the 100-6 camera of the mobile terminal records Xiaoai's fitness movements in real time, that is, collects Xiaoai to follow the coach Exercise images, and display Xiao Ai's fitness status in real time on the right side of the user interface.
  • Xiao Ai can check whether her movements are standard according to the images fed back from the right area.
  • the mobile terminal 100-6 can also judge whether Xiao Ai's learning action is the same as that of the coach, to judge whether Xiao Ai's action is standard, and remind in time, and guide Xiao Ai how to standardize the action, etc., so that the user can learn scientifically at home. sports.
  • the mobile terminal 100-6 when the mobile terminal 100-6 detects an operation acting on the control 1171B shown in FIG. By selecting the options provided on the home page such as recommendation, fitness area, shoulder and neck relaxation, yoga area, square dance area, etc., you can enter the corresponding exercise course and learn from the coach; or the mobile terminal 100-6 can automatically block the learned exercise, Jump directly to the last untaught lesson shown in Figure 11Q above.
  • the embodiment of the present application does not limit the times.
  • the mobile terminal 100-6 may display the prompt information as shown in FIG. 11R.
  • the user interface 118 displays an image of Xiao Ai exercising following the coach's guidance screen, and a window 1181 is also displayed on the user interface 118, and a window 1181 is displayed in the window 1181 to prompt the user such as "Congratulations, the time for this exercise is over.” After 1 hour, the learning task has been completed! The game unlocked successfully" prompt message, as well as option 1181A and option 1181B.
  • option 1181A is used to close the current window 1181, and continue to display the user interface 118 provided by AI fitness shown in FIG. 11R; option 1181B is used to end the exercise task and jump to the user interface provided by game A.
  • Fig. 11N-Fig. 11R only exemplarily show how Xiaoai uses the mobile terminal 100-6 to complete the unlocking task 1.
  • Xiao Ai can also use other home devices to complete the unlocking task 1.
  • Other home devices can send relevant data about Xiao Ai's completion of the shackle task to the mobile terminal 100-6, and judge whether the user has completed the unlocking task 1 according to the received data. details as follows:
  • Fig. 11S- Fig. 11V exemplarily show a series of schematic diagrams of the mobile terminal 100-6 when Xiao Ai completes the unlocking task 1 with other home devices.
  • Fig. 11S- Fig. 11V exemplarily show a series of schematic diagrams of the mobile terminal 100-6 when Xiaoai uses a notebook to complete the learning tasks.
  • Xiao Ai can unlock the game by clicking any option shown in Figure 11S through the corresponding unlocking method.
  • the mobile terminal 100-6 may detect an operation on the option 1122A shown in FIG. 11S , and in response to the operation, the mobile terminal 100-6 will display a prompt message as shown in FIG. 11T .
  • Fig. 11T only exemplarily shows two types of prompt information for unlocking task 1.
  • the terminal 100-6 can also display, use the smart screen, the bracelet exercise prompt information, etc., Xiao Ai can open the smart screen such as AI fitness applications, and exercise with the coach; or Xiao Ai can wear the bracelet to exercise, etc. , which is not shown in the embodiment of this application.
  • Xiao Ai can open the corresponding home device by clicking the control shown in Figure 11T to complete the corresponding unlocking task 1, or Xiao Ai can also directly operate the corresponding home device according to the prompt given in window 1123 The home device has completed the corresponding unlocking task 1. details as follows:
  • Fig. 11U exemplarily shows a schematic diagram of an application scenario where Xiaoai uses a notebook to study.
  • the notebook can send data related to Xiao Ai's learning, such as the start time and end time of learning, or information about the continuous learning time, to the mobile terminal 100-6, so that the mobile terminal 100-6 can judge whether Xiao Ai has completed unlocking task 1. Assuming that Xiao Ai studies from 9:31 to 10:31, after mobile terminal 100-6 receives a message indicating that Xiao Ai's learning time has reached 1 hour, mobile terminal 100-6 will display the user interface as shown in Figure 11V.
  • the label displayed in the control 1123A displayed on the user interface 112 is changed from “to learn” as shown in FIG. 11T to “Completed”, thus prompting the user that the task of learning for one hour has been completed.
  • Fig. 11W-Fig. 11X exemplarily show a series of schematic diagrams of mobile terminal 100-6 when Xiaoai uses a treadmill to complete exercise tasks.
  • Xiao Ai can start the treadmill by clicking the control 1123B shown in Figure 11V, and has completed the running task, or Xiao Ai can also directly operate the treadmill to complete the corresponding task according to the prompt given in window 1123.
  • Fig. 11W exemplarily shows a schematic diagram of an application scenario in which Xiaoai uses a treadmill to run.
  • the label displayed in the control 1123B displayed in the user interface 112 is changed from “go to exercise” as shown in FIG. 11V to “completed”, thus prompting the user that the task of exercising for one hour has been completed.
  • a prompt message such as "Congratulations, the unlocking task 1 has been completed” is also displayed.
  • the information sent by the notebook and the treadmill to the mobile terminal 100-6 after Xiaoai completes the unlocking task shown above can also be called fourth information.
  • the aforementioned devices such as notebooks and treadmills belong to the second device.
  • the mobile terminal 100-6 in the process of Xiaoai performing the unlocking task 1, if Xiaoai uses the local electronic device, that is, the mobile terminal 100-6 to perform the task, the mobile terminal 100-6 will , periodically perform identity authentication to ensure that the user who performs the unlocking task is Xiaoai herself.
  • the identity authentication method includes any one or more of the following: password authentication, face authentication, fingerprint authentication, voiceprint authentication, iris authentication, and operating habit authentication, etc., which are not limited in this embodiment of the present application.
  • Xiaozhong can decide whether to approve the unlock request for Xiaoai according to the quality of Xiaoai's completed tasks.
  • the mobile terminal 100-6 receives the message indicating that the review is passed by the mobile terminal 100-1, the mobile terminal 100-6 will unlock the screen or unlock some functions; otherwise, the mobile terminal 100-6 will keep the screen locked or locked.
  • the result of the user's unlocking task sent by the mobile terminal 100-6 or other devices such as notebooks and treadmills to the mobile terminal 100-1 can also be referred to as fourth information, and the mobile terminal 100-6 receives the mobile
  • the message indicating that the approval is passed sent by the terminal 100-1 may also be referred to as a fifth message.
  • the method for completing the unlocking task in the mobile terminal 100-6 described above in FIG. 11M-FIG. 11R can be combined with the method for completing the unlocking task in other home devices described in FIG. 11S-FIG. 11X, that is In other words, Xiao Ai can complete some tasks in unlocking task 1 such as learning tasks on the mobile terminal 100-6, and then complete another part of tasks in unlocking task 1 such as learning tasks on a home device such as a treadmill. In this way, the mobile terminal On page 100-6, it can be determined that Xiao Ai has completed the unlocking task 1 and then unlocked the mobile terminal 100-6.
  • Xiaoai unlocks the mobile terminal 100-6 by completing the unlocking task 1.
  • Xiaoai can choose to unlock the mobile terminal 100-6 by completing the unlocking task 2. . details as follows:
  • FIG. 11Y-FIG. 11Z-5 exemplarily show a series of schematic diagrams of user interfaces for Xiao Ai to use the mobile terminal 100-6 to complete the unlocking task 2.
  • a window 1124 is displayed in the user interface 112 , and the prompt information corresponding to the unlocking task 2 and a fingerprint collection area 1125 are displayed in the window 1124 .
  • the prompt information is the unlock task 2 of the mobile terminal 100-6 set by the mobile terminal 100-6 in the mobile terminal 100-1 shown in FIG. unlock".
  • Xiaoai can request her father Xiaozhong and mother Xiaohua to input their fingerprint information into the mobile terminal 100-6, as follows:
  • Daddy Xiaozhong inputs fingerprint information into the fingerprint collection area 1125, and after mobile terminal 100-6 detects Daddy Xiaozhong's fingerprint, it displays the user interface as shown in Fig. 11Z-3.
  • a window 1124 is displayed on the user interface 112, and the prompt information displayed in the window 1124 is changed from the prompt information shown in Figure 11Z-1 above to, for example, "Xiaozhong's fingerprint has been successfully identified, please Continue to enter Xiaohua's fingerprint to unlock" prompt message.
  • the user interface 112 displays a window 1124, and the prompt information displayed in the window 1124 is changed from the prompt information shown in Figure 11Z-3 above to, for example, "Xiaozhong's fingerprint has been identified, and Xiaohua's Fingerprint, unlocked successfully" prompt message.
  • the order in which father Xiaozhong and mother Xiaohua input fingerprint information to the mobile terminal 100-6 is not displayed. That is to say, when Xiaoai chooses to unlock task 2 to unlock the mobile terminal 100-6, as mentioned above, she can first ask her father Xiaozhong to input the fingerprint information, and then ask her mother Xiaohua to input the fingerprint information. Enter the fingerprint information in Find Mom Xiaohua, and enter fingerprint information in Find Dad Xiaohua, which is not limited in the embodiment of this application.
  • the mobile terminal 100-6 presents the prompt information of the usage rule and the prompt information after the usage rule is broken, which reflects the above data bank system.
  • the presentation of the value of the data presented is specifically manifested in the fact that the smart home application program collects the data of the usage rules of the user using the mobile terminal 100-6 and combines the generated usage rules to output corresponding prompt information.
  • this application provides a control method for home devices.
  • the mobile terminal obtains the user's status information and the information status and/or event information recorded in the application, and control home devices to perform operations corresponding to the above events, and then realize intelligent management, control, and use of home devices without user operations, thereby creating a healthy, safe, comfortable, low-cost Carbon, convenient and personalized home life.
  • the above user states include: leaving home, returning home, sleeping, studying at home, working at home, exercising at home, getting off the car, and so on.
  • the above-mentioned multiple applications may be: applications for event memos, such as calendars, alarm clocks, memos, memos, etc.; or applications for life services, such as applications for making appointments or purchasing medical treatment, dining, travel, and haircut services; Or it is an application that provides public account and mini-program services, which can provide users with appointment or purchase of medical treatment, meals, travel, haircut services, etc.; or a weather forecast application, the weather forecast application
  • the program can provide users with weather forecast services; or it can be an online meeting application, which can provide users with the service of arranging meetings; The program can only allow users to book or purchase a certain course, and then conduct online learning.
  • the above-mentioned application program may be a system application program or a third-party application program. The embodiment of the present application does not limit this.
  • the method for the mobile terminal to obtain the user status includes the following two methods:
  • the mobile terminal actively detects the user status. details as follows:
  • the communication connection with home devices includes: a Wi-Fi connection with a home wireless router, or a Bluetooth connection with, for example, a home audio system, a sweeping robot, etc.;
  • a Wi-Fi connection with a home wireless router or a Bluetooth connection with, for example, a home audio system, a sweeping robot, etc.
  • the type of the connected object that is, the home device.
  • Mode 2 The mobile terminal determines the user status according to the acquired event information recorded in the local application program. Specifically, according to the sleep time and wake-up time recorded in the alarm clock application program, it is judged that the user is in a suitable sleep state; The user is away from home, etc.; or it is judged that the user is suitable for working from home based on the meeting time recorded by the online meeting application. For details, reference may be made to the detailed description of the UI embodiments later, and details are not repeated here.
  • the mobile terminal can combine any two or three of the above three methods to determine the user status. state.
  • the mobile terminal needs to combine the detection results of mode 1 and mode 2 to determine the user status. Then take the state of leaving home as an example.
  • the mobile terminal detects that the mobile terminal is disconnected from the home device according to method 1, it cannot directly determine that the user’s state is leaving home.
  • the mobile terminal also needs to detect the status recorded in the application. In the event information, there is an event indicating that the user will leave home, and the time difference between the time when the user leaves home and the time when the communication connection with the mobile terminal is disconnected is less than the threshold value, at this time, the mobile terminal can determine that the user is in the state of leaving home .
  • the mobile terminal needs to combine the detection results of mode 1 and mode 3 to determine the user status. Still taking the state of leaving home as an example, when the mobile terminal detects that the mobile terminal is disconnected from the home device according to method 1, it cannot directly determine that the user’s state is away from home, and the mobile terminal needs to detect the feedback from other home devices.
  • the information includes information indicating that the user is away from home, and the time difference between the time when the user leaves home and the time when the communication connection with the mobile terminal is disconnected is less than the threshold value, at this time, the mobile terminal can determine that the user's status is away from home.
  • mode 1 When the mobile terminal needs to combine the detection results of mode 1, mode 2 and mode 3 to determine the user status.
  • the mobile terminal detects that the mobile terminal is disconnected from the home device according to method 1, it cannot directly determine that the user's state is away from home.
  • the mobile terminal also needs to detect that the event information recorded in the application program contains an event indicating that the user will leave home, and the time difference between the time when the user leaves home and the disconnection of the communication connection with the mobile terminal is less than the threshold.
  • the mobile terminal also needs to detect that the information fed back by other home devices includes information indicating that the user has left home, and the time difference between the time when the user leaves home and the time when the communication connection with the mobile terminal is disconnected is less than the threshold value. The terminal can determine that the user's status is away from home.
  • the user inputs the user status to the mobile terminal. Details as follows:
  • the mobile terminal can judge the user status according to these operations. For details, please refer to the detailed description of the UI embodiment below. repeat.
  • Ways for the mobile terminal to acquire information about events in multiple application programs may include the following two methods:
  • the mobile terminal acquires information about events in the multiple application programs after receiving the user's operation of inputting information in the multiple application programs.
  • This operation can be an operation where the user adds event information by inputting event information in event memo application programs such as calendar and memo, or it can be an operation in which the user pre-orders an event as mentioned above in application programs such as life service and online learning. operation of the service, etc.
  • the types of events mentioned above include: travel, medical treatment, meals, haircuts, home study, home office, home fitness, and severe weather, etc.
  • control method of the above-mentioned family device will be introduced in combination with the UI embodiment.
  • FIG. 12A-FIG. 12V exemplarily show a series of user interface schematic diagrams for the mobile terminal to actively detect user status.
  • FIG. 12A exemplarily shows a desktop displayed by the mobile terminal 100-1.
  • the user interface 121 is not only a desktop displayed by the mobile terminal 100-1, but also a main interface for displaying application program menus.
  • the user interface 121 may include: a status bar 1211, a calendar indicator and a weather indicator, a page indicator, a tray with frequently used application icons, and other application icons. in:
  • Status column 1211 may include: one or more signal strength indicators 1211A for mobile communication signals (also referred to as cellular signals), one or more signal strength indicators 1211B for wireless high-fidelity (Wi-Fi) signals , battery status indicator 1211C, time indicator 1211D.
  • signal strength indicators 1211A for mobile communication signals (also referred to as cellular signals)
  • signal strength indicators 1211B for wireless high-fidelity (Wi-Fi) signals
  • battery status indicator 1211C battery status indicator 1211C
  • time indicator 1211D time indicator
  • the page indicator can be used to indicate the application icon on which page the user is currently viewing.
  • application program icons can be distributed on multiple pages, and the user can swipe left and right to browse application program icons on different pages.
  • a tray 314 with frequently used application icons may display: a phone icon 314A, a text message icon 314B, a browser icon 314C, and a camera icon 314D.
  • the user interface 121 shown in FIG. 12A is not only the desktop of the mobile terminal 100-1 but also a home screen. It can be understood that FIG. 12A only exemplarily shows a user interface of the mobile terminal 100-1, and should not be construed as limiting the embodiment of the present application.
  • the mobile terminal 100-1 when the communication distance between the mobile terminal 100-1 and the home router exceeds the threshold, the mobile terminal 100-1 will disconnect the Wi-Fi connection with the home wireless router. At this time, the mobile terminal 100-1 can determine that The status in the owner's chat has been switched to leaving home.
  • FIG. 12B exemplarily shows a schematic diagram of a user interface when the mobile terminal 100-1 detects that it is disconnected from the home wireless router.
  • the time indicator 1211D in the status bar 1211 displayed in the user interface 121 specifically displays the time of 8:30, and does not include the Wi-Fi signal strength indicator 1211B shown in FIG. 12A above, Instead, icons for Internet access such as 5G, 4G, 3G, 2G.
  • a prompt window 1212 is also displayed in the user interface 121 .
  • the prompt window 1212 displays a prompt message such as "WiFi connection has been disconnected, may I ask if you have left home", as well as a control 1212A and a control 1212B.
  • the control 1212A is used to determine that the user has left home, and the control 1212B is used to deny that the user has left home.
  • the mobile terminal 100-1 may default that the user has left home .
  • FIG. 12B only exemplarily shows a form of prompt information, and the above-mentioned window 1212 may not only be displayed on the desktop shown in FIG. 12B , but may also be displayed on other user interfaces such as interfaces provided by smart home APPs.
  • the embodiment of the present application does not limit this.
  • the above prompt information can also be displayed in a pull-down notification bar, or displayed in a negative screen, which is not limited in this embodiment of the present application.
  • FIG. 12A-12B merely show that the mobile terminal 100-1 is disconnected from the home wireless router to determine that the user is away from home.
  • the mobile terminal 100-1 can also Detect whether the user is disconnected from the Bluetooth connection with the home device, such as home smart audio, etc., to determine whether the user is away from home. details as follows:
  • the user interface 121 is not only a desktop displayed by the mobile terminal 100-1, but also a main interface for displaying application program menus.
  • the user interface 121 shown in Figure 12C is similar to the user interface 121 shown in Figure 12A above, therefore, the description about Figure 12A is also applicable to the description of Figure 12C, however, Figure 12C and Figure 12A above also have the following Difference: the status bar 1211 includes one or more signal strength indicators 1211A, 1211E, battery status indicator 1211C, and time indicator 1211D of mobile communication signals (also called cellular signals).
  • the specific time of the time indicator 1211D displayed in the user interface 121 shown in FIG. 12C is 8:00, and the Bluetooth indicator 1211F represents that the mobile terminal 100-1 starts the Bluetooth function or establishes a Bluetooth connection with other devices at this time. . Assuming that the mobile terminal 100-1 establishes a Bluetooth connection with a home device such as a home smart speaker at this time, the mobile terminal 100-1 can determine that Xiaozhong is at home at this time.
  • the mobile terminal 100-1 when the communication distance between the mobile terminal 100-1 and the home smart speaker exceeds the threshold, the mobile terminal 100-1 will disconnect the Bluetooth connection with the home smart speaker, and at this time the mobile terminal 100-1 can It is directly determined that the status of the owner of the phone has been switched to leaving home.
  • the mobile terminal 100-1 when the mobile terminal 100-1 detects that the Bluetooth connection with the home smart speaker is established and the Bluetooth connection is disconnected, the mobile terminal 100-1 will not directly determine that the user is away from home, and the mobile terminal 100-1 may The prompt information shown in Figure 12D is displayed.
  • the time indicator 1211D in the status bar 1211 displayed on the user interface 121 specifically displays a time of 8:30, and does not include the Bluetooth indicator 1211F shown in FIG. 12C above.
  • a prompt window 1213 is also displayed in the user interface 121 .
  • the prompt window 1213 displays a prompt message such as "The Bluetooth connection with the smart audio has been disconnected, may I ask if you have left home", as well as a control 1213A and a control 1213B.
  • the control 1213A is used to determine that the user has left home, and the control 1213B is used to deny that the user has left home.
  • the mobile terminal 100-1 may assume that the user has left home .
  • FIG. 12D only exemplarily shows a form of prompt information
  • the above-mentioned window 1213 may not only be displayed on the desktop shown in FIG. 12D , but may also be displayed on other user interfaces such as interfaces provided by smart home APPs.
  • the embodiment of the present application does not limit this.
  • the above prompt information may also be displayed in a pull-down notification bar, or displayed in a negative screen, which is not limited in this embodiment of the present application.
  • 12E-12I exemplarily show a group of schematic diagrams of user interfaces when the mobile terminal 100-1 adopts method 2 to determine the user status.
  • Fig. 12F exemplarily shows a schematic diagram of a user interface provided by a life service application program in the mobile terminal 100-1.
  • the user interface 122 may include a search bar 1221 , a tab 1222 , and a page navigation bar 1223
  • the page navigation bar 1223 may include controls corresponding to subpages such as home page, order, and my.
  • the option tab 1222 specifically includes the options: hotel, air ticket, travel, taxi, food, movie, medical treatment, beauty treatment, travel and so on. Users can book or purchase corresponding services by clicking on the above options.
  • the mobile terminal 100-1 may detect the user's operation of clicking on the taxi-hailing option in the user interface 122, and in response to the operation, the mobile terminal 100-1 may display a detailed page corresponding to the taxi-hailing service as shown in FIG. 12G .
  • the user interface 123 displays: a map 1231 including the user's current location, an option 1232 , an input box 1233 , a common address option 1234 , and a control 1235 .
  • the option 1232 is the starting point commonly used by the user when taking a taxi, and the user can click on this option to re-edit the starting point.
  • the input box 1233 is used for inputting a destination.
  • the common address option 1234 is, for example, Xiaoai's school.
  • the control 1235 is used to add more options corresponding to common addresses.
  • Xiao Zhong wants to take a taxi from home to Xiao Ai's school, Xiao Zhong can click on the option corresponding to the usual address corresponding to Xiao Ai's school as shown in Figure 12G.
  • the mobile terminal 100-1 displays the following The user interface shown in Figure 12H.
  • the user interface 123 displays: a map 1236 containing a route from the departure point to the destination, an estimated price 1237, and a control 1238 for calling a car immediately.
  • the life service application program When the mobile terminal 100-1 detects an operation on the control 1238 shown in FIG. 12H , in response to the operation, the life service application program will record the taxi-hailing event. And the event is sent to the smart home APP, and the smart home APP obtains the time when the user leaves home according to the event, that is, determines when the user is in the state of leaving home.
  • the mobile terminal 100-1 after the mobile terminal 100-1 detects that the user enters the operation for hailing a taxi as shown in Figure 12E- Figure 12H above, the mobile terminal 100-1 will not directly determine that the user's status is leaving home state.
  • the mobile terminal 100-1 may first display the prompt information as shown in FIG. 12I.
  • FIG. 12I exemplarily shows a user interface diagram of the prompt information displayed by the mobile terminal 100-1 according to the event that the user purchases the travel service.
  • a prompt window 1239 is displayed on the user interface 123 .
  • the prompt window 1239 displays a prompt message such as "It is detected that you take a taxi from home to Xiao Ai's school, may I ask if you want to leave home", as well as controls 1239A and 1239B.
  • the control 1239A is used to determine that the user has left home, and the control 1239B is used to deny that the user has left home.
  • the mobile terminal 100-1 can detect this operation by clicking on the control 1239A in FIG.
  • the mobile terminal 100-1 may assume that the user has left home .
  • FIG. 12I only exemplarily shows a form of prompt information, and the above-mentioned window 1239 can be displayed not only on the desktop shown in FIG. 12I, but also on other user interfaces such as interfaces provided by smart home APPs.
  • the embodiment of the present application does not limit this.
  • the mobile terminal 100-1 when the mobile terminal 100-1 records the event information that the user will carry Xiaoai's schoolbag to Xiaoai's school at 8:30-9:00, and the mobile terminal 100-1 detects When the user leaves home between 8:30-9:00, the mobile terminal 100-1 will also output prompt information for prompting the user to carry Xiaoai's schoolbag.
  • the above-mentioned 8:30-9:00 can also be called the fourth time period
  • the above-mentioned Xiaoai’s schoolbag can also be called the first item
  • the above-mentioned prompt information for carrying the schoolbag can also be called the sixth prompt information
  • the above-mentioned mobile terminal The information in 100-1 that records the event that the user will carry Xiao Ai's schoolbag to Xiao Ai's study at 8:30-9:00 can also be called sixth information.
  • the mobile terminal 100-1 when the mobile terminal 100-1 records the event information of extreme weather such as rain and typhoon at 13:20-14:00, and the mobile terminal 100-1 detects that the user is at 13:00 When leaving home at 20-14:00, the mobile terminal 100-1 will also output prompt information for prompting the user to bring protective equipment such as umbrellas and raincoats.
  • the above-mentioned 13:20-14:00 can also be called the fifth time period, and the above-mentioned reminder information for carrying protective articles such as umbrellas and raincoats can also be called the seventh reminder information.
  • 12J-12N exemplarily show another group of user interface diagrams when the mobile terminal 100-1 adopts method 2 to judge the user status.
  • FIG. 12J when the mobile terminal 100-1 detects in the user interface 121 shown in FIG.
  • the user interface 124 provided by the calendar is shown in FIG. 12K.
  • the user interface 121 shown in FIG. 12J is the same as the user interface 121 shown in FIG. 12A above, and the text description of the user interface 121 in FIG. 12A is also applicable to the user interface 121 shown in FIG. 12J .
  • FIG. 12K exemplarily shows a schematic diagram of a user interface provided by a calendar in the mobile terminal 100-1.
  • the user interface 124 displays a calendar 1241, a window 1242, and a new schedule icon 1243 is displayed in the window 1242, and subscription items recommended by the mobile terminal 100-1, such as almanac, etc.
  • the mobile terminal 100-1 detects in the user interface 124 that the user selects a certain day in the calendar 1241, for example, September 26, and acts on the operation of creating a new schedule icon 1243, in response to this operation, the mobile terminal 100-1 displays the date shown in FIG. 12L
  • the user interface 125 is shown.
  • FIG. 12L exemplarily shows the user interface 125 displayed by the mobile terminal 100-1.
  • the user interface 125 is a page to be edited for creating a new schedule
  • the user interface 125 may include a cancel icon 1251, a confirm icon 1252, a page title such as a new schedule, a title input box, a location input box, and a time input box etc.
  • the cancel icon 1251 can be used to close the page to be edited
  • the confirm icon 1252 can be used to confirm the edited to-do event.
  • the title input box can be used to receive the title of the to-do event input by the user
  • the location input box can be used to receive the occurrence location of the to-do event input by the user
  • the time input box can be used to receive the start and end time of the to-do event input by the user.
  • the mobile terminal 100-1 can detect that the user edits the to-do event in the user interface 125.
  • the user can input the name of the to-do event as an online meeting, the meeting place is Xiaozhong's home, and the meeting The time is 14:30-15:30 on September 26.
  • the mobile terminal 100-1 can also detect the user's operation on the confirmation icon 1252.
  • the calendar of the mobile terminal 100-1 receives To the to-do events edited by the user, that is, events added by the user in the calendar.
  • the smart home APP obtains the time when the user works from home according to the meeting event, that is, determines when the user is working from home.
  • the mobile terminal 100-1 after the mobile terminal 100-1 detects that the user has input a series of operations shown in FIG. 12J-FIG. 12M above, the mobile terminal 100-1 will not directly determine that the user's status is the home status.
  • the mobile terminal 100-1 may first display the prompt information as shown in FIG. 12N.
  • FIG. 12N exemplarily shows a user interface diagram of the prompt information displayed by the mobile terminal 100 - 1 according to the pending conference events.
  • a prompt window 1214 is displayed on the user interface 121 .
  • the prompt window 1214 displays a prompt message such as "It is detected that you have an online meeting at 14:30, please enable the home office mode", as well as a control 1214A and a control 1214B.
  • the control 1214A is used to determine that Xiaozhong will be in the state of working from home at 14:30
  • the control 1214B is used to deny that Xiaozhong will be in the state of working from home at 14:30.
  • the time for the mobile terminal 100-1 to display the prompt information shown in FIG. 12N can be displayed immediately after the addition of the to-do event is detected, or it can be displayed at any time before the start event of the to-do event, for example, the meeting starts
  • the time is 14:30, and the mobile terminal 100-1 may display the above prompt information at 14:20 ten minutes before the start time of the meeting, which is not limited in this embodiment of the present application.
  • the mobile terminal 100-1 can detect this operation by clicking on the control 1214A in Figure 12N, and in response to this operation, determine Xiao Zhong's status at 14:30 The status of working from home.
  • the mobile terminal 100-1 may default to the The status at 14:30 is the status of working from home.
  • FIG. 12O-FIG. 12P exemplarily show a series of schematic diagrams in which the mobile terminal 100-1 detects that the user determines the state of the user leaving home through the operation of remotely starting the vehicle.
  • Fig. 12O exemplarily shows a schematic diagram of a scene where Xiaozhong remotely controls the ignition of a vehicle through the mobile terminal 100-1.
  • Xiaozhong can use the mobile terminal 100 - 1 to remotely start the vehicle, such as an APP for remote control of the vehicle or a smart home APP.
  • the vehicle such as an APP for remote control of the vehicle or a smart home APP.
  • the schematic diagram of the user interface for remotely starting the vehicle is not described in detail here.
  • the mobile terminal 100-1 when the mobile terminal 100-1 detects that the user inputs an operation to start the vehicle, the mobile terminal 100-1 may directly determine that the user's status is leaving home.
  • the mobile terminal 100-1 when the mobile terminal 100-1 detects that the user inputs an operation to start the vehicle, the mobile terminal 100-1 will not directly determine that the user's status is leaving home, but will first display the displayed prompt information.
  • FIG. 12P exemplarily shows a schematic diagram of a user interface of the prompt information for leaving home displayed when the mobile terminal 100-1 detects that the user inputs an operation of remotely starting the vehicle.
  • the user interface 121 displays a prompt window 1215 .
  • the prompt window 1215 displays a prompt message such as "It is detected that you remotely start the vehicle, may I ask if you are leaving home", as well as a control 1215A and a control 1215B.
  • the control 1215A is used to determine that Xiaozhong has left home
  • the control 1215B is used to deny that Xiaozhong has left home.
  • Xiaozhong determines that he has left home, he can click the control 1215B in FIG. 12D , and the mobile terminal 100-1 detects this operation, and in response to this operation, determines that Xiaozhong is in the state of leaving home at this time.
  • the mobile terminal 100-1 may assume that the user has left home .
  • the mobile terminal 100-1 may assume that the user has left home .
  • FIG. 12P only exemplarily shows a form of prompt information, and the above-mentioned window 1215 can be displayed not only on the desktop shown in FIG. 12P but also on other user interfaces, such as interfaces provided by application programs.
  • the embodiment of the present application does not limit this.
  • the above prompt information may also be displayed in a pull-down notification bar, or displayed in a negative screen, which is not limited in this embodiment of the present application.
  • FIG. 12Q-FIG. 12R exemplarily show a series of schematic diagrams in which the mobile terminal 100-1 determines the state of the user leaving home according to the user's car riding operation.
  • FIG. 12Q exemplarily shows a schematic diagram of a barcode displayed on the mobile terminal 100 - 1 for taking a subway, bus, or other vehicle.
  • the mobile terminal 100-1 will display a schematic diagram of the user interface as shown in FIG. 12R.
  • the mobile terminal 100-1 displays a prompt message that the ride is successful.
  • the way for the user to take the bus or subway through the mobile terminal is not limited to scanning the barcode provided by the ride-hailing app shown above, but also by swiping the NFC card, which is not limited in this embodiment of the present application.
  • the mobile terminal 100-1 when the mobile terminal 100-1 detects the user's riding behavior, it can directly determine that the user's state is away from home.
  • the information of the events recorded in the application program obtained by the mobile terminal 100-1 using method 2 not only includes the user's purchase of a certain service in the application program as exemplarily shown in Figure 12E- Figure 12R above
  • the event information corresponding to the to-do event can be added, and the information generated by the application itself can also be obtained, for example, the event information related to the weather event generated by the weather forecast application itself. Therefore, the embodiment of the present application does not limit the acquisition of event information of the application program by the mobile terminal.
  • 12S-12V exemplarily show another group of user interface schematic diagrams when the mobile terminal 100-1 adopts mode 3 to determine the user status.
  • the smart door lock can send information about the user's going out event to the mobile terminal. After receiving the information, the mobile terminal will display a schematic diagram of a user interface as shown in FIG. 12S.
  • FIG. 12S exemplarily shows a schematic diagram of a user interface in which the mobile terminal 100-1 receives information sent by other home devices.
  • the user interface 121 displays prompt information 1216 .
  • the prompt information 1216 displays prompt information such as "the smart home has received a message". It can be understood that the above prompt information 1251 may be displayed on the user interface 121 shown in FIG. 20 , that is, the desktop, or may be displayed on other user interfaces of the mobile terminal 100-1, which is not limited in this embodiment of the present application.
  • the user can jump to the message details page provided by the smart home APP by clicking the prompt information 1216 shown in FIG. 12S .
  • the mobile terminal 100-1 will not only display the prompt information as shown in FIG. 12S, but also display the received message in the smart home APP. details as follows:
  • FIG. 12T exemplarily shows a schematic diagram of the user interface of the smart home APP when a new message is received.
  • the user interface 81 is the same as the user interface 81 shown in FIG. 10B above, and the above text description about the user interface 81 in FIG. 10B is also applicable to the user interface 81 shown in FIG. 12T. I won't go into details.
  • the difference between the user interface 81 shown in FIG. 12T and the user interface shown in FIG. 10B above is that the icon 819 displayed in the user interface shown in FIG. 12T has an icon of the number of unread messages displayed. For example "1" bar. The user can click on the icon 819 to open the received message details page and read the received messages of the smart home APP.
  • the mobile terminal 100-1 When the mobile terminal 100-1 detects an operation acting on the prompt message 1216 in FIG. 12S, or detects an operation acting on the icon 819 shown in FIG. 12T, in response to the operation, the mobile terminal 100-1 will respond as follows A schematic diagram of the user interface shown in Fig. 12U.
  • the user interface 126 displays a message sent by the smart door lock, for example, "The smart door lock detected that you left home at 16:00".
  • mobile terminal 100-1 after mobile terminal 100-1 receives the prompt information shown in FIG. It will directly determine Xiaozhong's status as away from home.
  • the mobile terminal 100-1 may first display the prompt information as shown in FIG. 12V.
  • the information sent by the smart door lock to the mobile terminal 100-1 may also be referred to as seventh information.
  • FIG. 12V exemplarily shows a user interface diagram of the prompt information displayed by the mobile terminal 100 - 1 according to the information sent by other home devices.
  • a prompt window 1217 is displayed on the user interface 121 .
  • the prompt window 1217 displays prompt information such as "the smart door lock detects that you have just gone out, may I ask if you have left home", as well as a control 1217A and a control 1217B.
  • the control 1217A is used to determine that the small middle school is in the state of leaving home at 16:00
  • the control 1217B is used to deny that the small middle school will be in the state of leaving home at 16:00.
  • the mobile terminal 100-1 can detect this operation by clicking on the control 1217A in FIG. state.
  • the mobile terminal 100-1 may default to the At 16:00, the status is away from home.
  • FIG. 12V only exemplarily shows a form of prompt information
  • the above-mentioned window 1217 can be displayed not only on the desktop shown in FIG. 12V, but also on other user interfaces such as interfaces provided by smart home APPs. , which is not limited in this embodiment of the present application.
  • the mobile terminal when the mobile terminal detects that the distance between itself and the home device exceeds a third value such as 20 meters, it may also confirm that the user's status is away from home.
  • the smart door lock when the smart door lock detects that the user opens the door, it can detect whether the user has a mobile phone. If the user does not have a mobile phone, the smart door lock can refuse to close the door or broadcast a voice prompt to remind the user to bring the mobile phone. details as follows:
  • the smart door lock can establish a communication connection with the mobile terminal 100-1, such as a Bluetooth connection or a WiFi connection. , using Bluetooth ranging or WiFi ranging to detect the distance between the small and medium mobile terminal 100-1 and the smart door lock.
  • the smart door lock outputs fifth prompt information for prompting the user to carry the mobile terminal 100-1, or triggers the mobile terminal 100-1 and/or other household devices to output the fifth prompt information for prompting the user to carry the mobile terminal 100-1.
  • the smart door lock detects that the ninth operation opens the door lock, and when the smart door lock detects that the distance between it and the mobile terminal 100-1 is gradually increasing, the smart door lock can determine that Xiaozhong does not carry the mobile terminal 100 -1, the smart door lock can perform any one or more of the following operations: refuse to lock the door, or output the fifth prompt message for prompting the user to carry the mobile terminal 100-1, or trigger the mobile terminal 100-1 and Or other home devices output fifth prompt information for prompting the user to carry the mobile terminal 100-1.
  • whether the user carries the mobile terminal 100-1 may also be detected through a home device such as a camera.
  • the smart door lock may not close the door when it is determined that Xiaozhong is not wearing a mobile phone when going out, so as to achieve the purpose of reminding Xiaozhong that he is not wearing the mobile terminal 100-1.
  • the smart door lock when the smart door lock determines that Xiaozhong is not wearing a mobile phone when going out, it may output a prompt sound to remind Xiaozhong to carry the mobile terminal 100-1.
  • the smart door lock when the smart door lock detects that Xiaozhong is approaching and the distance from the smart door lock is less than a second value, for example, 1 meter, the smart door lock can output a fifth prompt message in advance, prompting the user to carry a mobile phone , a certificate, a car key, etc., or trigger the mobile terminal 100-1 and/or other household devices to output fifth prompt information for prompting the user to carry the mobile terminal 100-1.
  • a second value for example, 1 meter
  • the door of the vehicle is opened.
  • the door can detect the distance from the mobile terminal 100-1, and the distance between the door and the mobile terminal 100-1 is detected.
  • the vehicle can determine that Xiaozhong does not carry the mobile terminal 100-1, and the vehicle can perform any one or more of the following operations: refuse to lock the door, or output a message for prompting the user to carry the mobile terminal 100-1 1, or trigger the mobile terminal 100-1 and or other home devices to output the eighth prompt information for prompting the user to carry the mobile terminal 100-1.
  • the eighth prompt message can be output in advance, reminding the user to bring their personal belongings such as the mobile terminal 100-1 and the elderly and children.
  • 12W-12Z exemplarily show a series of user interface diagrams displayed by the mobile terminal 100-1 when the user actively inputs the user status to the mobile terminal.
  • the user interface 61 displayed by the mobile terminal 100-1 is similar to the user interface 61 shown in Figure 6K, Figure 8F, and Figure 8J above, and the description of Figure 6K above is also applicable to the description of Figure 12W, I won't go into details here.
  • the mobile terminal 100-1 detects the user's operation of clicking the control 615C, and in response to the operation, the mobile terminal 100-1 displays the user interface 126 as shown in FIG. 12X.
  • the user interface 126 is a smart scene page, specifically including: a control 1261A and a control 1261B.
  • the control 1261A and the control 1261B are subpage navigation controls of the smart scene page, and the user can switch between the "recommended” subpage and the "my” subpage in the smart scene page by operating on the control 1261A and the control 1261B.
  • the user interface 126 defaults to display the corresponding "recommended" subpage of the control 1261A.
  • This subpage displays the options corresponding to one or more intelligent scenarios included in the one-click execution module.
  • the above options are options corresponding to smart scenarios such as leaving home safely, returning home warmly, and cleaning and purification provided by default by the smart home APP.
  • the user can click any one of the above options to make the mobile terminal 100-1 execute the smart scenario with one click. Specifically execute the linkage control operation of the home device.
  • the mobile terminal 100-1 detects the user's operation on the option 1262 shown in Figure 12X above, and in response to the operation, the mobile terminal 100-1 can determine that the user's state is away from home .
  • the mobile terminal 100-1 will also apply the smart scene mode of leaving home with peace of mind, that is, to control the home devices to perform corresponding operations.
  • the mobile terminal 100-1 can control the TV, air conditioner, smoke stove, kitchen appliances, Air purifiers, fresh air fans, humidifiers and dehumidifiers, sweepers, door locks, electric curtains, lights, etc. are turned off.
  • the mobile terminal 100-1 may detect an operation for enabling the leaving home scene on the My subpage, and determine that the user's status is the leaving home status. details as follows:
  • the user interface 126 displayed by the mobile terminal 100 - 1 is similar to the user interface 126 shown in FIG. 12X above.
  • the description of FIG. 12X above is also applicable to the description of FIG. 12X , which will not be repeated here.
  • the mobile terminal 100-1 can detect the user's operation on the control 1261B shown in Figure 12Y, and in response to the operation, the mobile terminal 100-1 can switch the subpage in the smart scene page from the recommended subpage to the one shown in Figure 12Z The "My" subpage of the .
  • the user interface 126 displays a "My" subpage
  • the "My" subpage includes options corresponding to one or more smart scenarios included in the user-defined one-key execution module, such as option 1265, Option 1266 and option 1267, the above-mentioned options are options corresponding to smart scenarios such as user-defined home office, a dream, and long-term business trip
  • My" sub-page also includes one or more user-defined smart arrangement modules Options corresponding to smart scenarios, such as option 1268 and option 1269, the above options are user-defined options corresponding to smart scenarios such as closing the door lock when leaving home and turning on the air conditioner when the temperature is high
  • the "My” subpage also includes options for adding a Control 1261C for Smart Context under the Key Execution or Smart Orchestration module.
  • mobile terminal 100-1 detects the user's operation on option 1267 shown in FIG. 12Z , and in response to the operation, mobile terminal 100-1 may determine that the user's state is away from home. In addition, the mobile terminal 100-1 will also apply the smart scene mode for long-term business trips, that is, to control the home devices to perform corresponding operations. , Air purifiers, fresh air fans, humidification and dehumidifiers, sweepers, door locks, electric curtains, lights, etc. are turned off, and monitoring devices such as cameras in smart door locks are turned on, as well as the operation of my cameras in the house.
  • Air purifiers, fresh air fans, humidification and dehumidifiers, sweepers, door locks, electric curtains, lights, etc. are turned off, and monitoring devices such as cameras in smart door locks are turned on, as well as the operation of my cameras in the house.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Telephonic Communication Services (AREA)

Abstract

A smart home appliance (200) control method, which is based on a data banking system. The data banking system comprises: data collection, data processing, data opening, and data value presentation. The control method comprises: a mobile terminal (100) can collect relevant data such as a role that a user plays in a family relationship, and a space where the user is located, and set, according to the data, the permission of the user to control the home appliance (200), and then the mobile terminal (100) receives a user operation, identifies the user identity, and controls, according to the permission corresponding to the user identity, the home appliance (200) to execute a corresponding function. In addition, the rule of the use of the mobile terminal (100) by children and parents is also set. When the rule is broken, the formulated tasks can be executed and completed in cooperation with other home appliances (200), and thus the mobile terminal (100) can continue to be used. In addition, upon detecting that the user is away from home, the mobile terminal (100) can also control, according to the collected schedule data of the user, the home appliance (200) to execute an operation corresponding to the schedule.

Description

家庭设备控制方法、相关装置及系统Home appliance control method, related device and system
本申请要求于2021年09月27日提交中国专利局、申请号为202111137777.9、申请名称为“家庭设备控制方法、相关装置及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202111137777.9 and the application name "home appliance control method, related device and system" submitted to the China Patent Office on September 27, 2021, the entire contents of which are incorporated herein by reference. Applying.
技术领域technical field
本申请涉及通信技术领域，尤其涉及家庭设备控制方法、相关装置及系统。The present application relates to the field of communication technologies, and in particular to a method for controlling home equipment, related devices and systems.
背景技术Background technique
随着信息化技术的逐步发展、网络技术的日益完善、可应用网络载体的日益丰富，越来越多的家庭设备逐渐走入家家户户，越来越多的家庭开始追求智慧生活。彼时，智慧家庭这一理念便被提出，智慧家庭又可称为智慧家庭服务平台，是指以家庭成员之间的亲情为纽带，结合物联网、云计算、移动互联网和大数据等新一代信息技术，结合自动控制技术，将家庭设备智能控制、家庭环境感知、家人健康感知、家居安全感知以及信息交流、消费服务等家居生活有效地结合起来，创造出健康、安全、舒适、低碳、便捷的个性化家居生活。With the gradual development of information technology, the improvement of network technology, and the increasing abundance of applicable network carriers, more and more home devices have gradually entered every household, and more and more families have begun to pursue smart life. At that time, the concept of smart home was put forward. Smart home can also be called a smart home service platform. Information technology, combined with automatic control technology, effectively combines home life such as intelligent control of home equipment, home environment awareness, family health awareness, home safety awareness, information exchange, and consumer services to create a healthy, safe, comfortable, low-carbon, Convenient personalized home life.
如何实现家庭设备的控制，为用户创造智慧生活则是亟待解决的问题。How to realize the control of home devices and create a smart life for users is an urgent problem to be solved.
发明内容Contents of the invention
本申请提供了家庭设备控制方法、相关装置及系统。可以根据用户与家庭空间的关联关系来控制家庭设备。此外，当用户打破家庭设备的使用规则后，还需要协同其他家庭设备完成指定任务。此外，移动终端检测到用户离家，还可以来控制家庭设备执行移动终端中存储事件对应的操作。从而打造出更加便捷、健康、低碳、和谐的智慧家庭。The present application provides a method for controlling household equipment, a related device and a system. Home devices can be controlled according to the user's association with the home space. In addition, when the user breaks the usage rules of the home device, he also needs to cooperate with other home devices to complete specified tasks. In addition, when the mobile terminal detects that the user is away from home, it can also control the home device to perform an operation corresponding to the event stored in the mobile terminal. So as to create a more convenient, healthy, low-carbon and harmonious smart home.
第一方面，本申请提供了一种设备的控制方法，该方法应用于包含第一设备和第二设备的通信系统；该第二设备位于第一空间中的第一区域；该方法包括：该第一设备接收到第一操作；该第一设备识别输入该第一操作的用户的身份为第一用户；该第一设备触发该第二设备启动第一功能；该第一设备再次接收到该第一操作；该第一设备识别输入该第一操作的用户的身份为第二用户；该第一设备拒绝触发该第二设备启动该第一功能。In a first aspect, the present application provides a device control method, the method is applied to a communication system including a first device and a second device; the second device is located in a first area in a first space; the method includes: the The first device receives the first operation; the first device identifies the identity of the user inputting the first operation as the first user; the first device triggers the second device to start the first function; the first device receives the first function again A first operation; the first device identifies the identity of the user inputting the first operation as a second user; the first device refuses to trigger the second device to start the first function.
第二方面，本申请提供了一种设备的控制方法，该方法应用于第一设备和第二设备的通信系统；该第二设备位于第一空间中的第一区域；该方法包括：该第一设备接收到第一操作，该第一操作用于触发该第二设备启动第一功能；该第一设备识别输入该第一操作的用户的身份；在该用户有权限控制该第一区域中设备的情况下，该第一设备触发该第二设备启动该第一功能；在该用户没有权限控制该第一区域中设备的情况下，则该第一设备拒绝触发该第二设备启动该第一功能。In a second aspect, the present application provides a device control method, the method is applied to a communication system between a first device and a second device; the second device is located in a first area in a first space; the method includes: the first device A device receives a first operation, and the first operation is used to trigger the second device to start a first function; the first device identifies the identity of the user who inputs the first operation; the user has permission to control the first area In the case of a device, the first device triggers the second device to start the first function; if the user has no authority to control the device in the first area, the first device refuses to trigger the second device to start the a function.
实施第一方面或第二方面提供的方法，第一设备可以根据用户与家庭空间中的关系来设置用户对家庭设备的控制权限，进而确保家庭成员仅可以使用权限范围内的家庭设备。还可以避免不具备家庭设备使用权限的人，执行一些危险操作，或者是恶意操作等。例如为了避免老人或者儿童使用危险电器，或者是家庭访客等使用家庭中的隐私设备，例如保险贵等，给家庭带来损失。Implementing the method provided in the first aspect or the second aspect, the first device can set the user's control authority to the family device according to the relationship between the user and the family space, so as to ensure that family members can only use the family device within the scope of authority. It can also prevent people who do not have permission to use home devices from performing some dangerous operations or malicious operations. For example, in order to prevent the elderly or children from using dangerous electrical appliances, or family visitors from using private devices in the family, such as expensive insurance, etc., which will bring losses to the family.
结合第一方面或第二方面提供的方法，在一种实施方式中，上述通信系统还包括第三设备；该第一设备接收到第一操作之前，该方法还包括：该第一设备接收到第二操作后确定该第二设备位于该第一空间中的该第一区域；或者，该第一设备接收到该第三设备发送的第一信息，该第一信息指示该第二设备位于该第一空间中的该第一区域。With reference to the method provided in the first aspect or the second aspect, in an implementation manner, the above-mentioned communication system further includes a third device; before the first device receives the first operation, the method further includes: the first device receives After the second operation, it is determined that the second device is located in the first area in the first space; or, the first device receives first information sent by the third device, and the first information indicates that the second device is located in the first area. The first region in the first space.
这样，移动终端可以根据用户操作来划分房间与家庭成员的关联关系，以及房间与家庭设备的关联关系，或者移动终端可以根据其他家庭设备检测到的房间与家庭成员的关联关系，以及房间与家庭设备的关联关系来自动生成家庭成员控制家庭设备的权限。当其他家庭设备检测的结果有误，导致移动终端最终生成的房间、设备的关联关系有误时，移动终端还可以根据用户的手动操作重新更改房间与设备的对应关系。这样，移动终端可以通过多种方式来实现，增加本方案的可实施性，则增加了权限设置的准确性。In this way, the mobile terminal can classify the association relationship between rooms and family members and the association relationship between rooms and home devices according to user operations, or the mobile terminal can classify the association relationship between rooms and family members and the relationship between rooms and family devices detected by other home devices. The device association relationship automatically generates family members' permissions to control family devices. When the detection results of other home devices are wrong, resulting in wrong associations between rooms and devices finally generated by the mobile terminal, the mobile terminal can also re-change the corresponding relationship between rooms and devices according to the user's manual operation. In this way, the mobile terminal can be implemented in a variety of ways, increasing the practicability of this solution, and increasing the accuracy of permission setting.
结合第一方面或第二方面提供的方法，该第一信息还指示了该第一区域的类型；该类型包括：卧室、厨房、书房、客厅、卫生间、健身房、娱乐室。In combination with the method provided in the first aspect or the second aspect, the first information also indicates the type of the first area; the type includes: bedroom, kitchen, study room, living room, bathroom, gym, and entertainment room.
这样，移动终端可以将家庭空间中包含的房间进行细致的划分，方便用户针对性的管理某个房间中的设备。In this way, the mobile terminal can finely divide the rooms included in the home space, so that the user can manage the devices in a certain room in a targeted manner.
结合第二方面提供的方法，该第一区域的类型由该第三设备根据识别到的该第二设备的类型而确定。In combination with the method provided in the second aspect, the type of the first area is determined by the third device according to the recognized type of the second device.
这样，扫地机器人在打扫房屋卫生的时候可以获取到家庭设备，根据家庭设备的类型判断包含这些设备的房间的类型。In this way, the sweeping robot can obtain household equipment when cleaning the house, and judge the type of room containing these equipment according to the type of household equipment.
结合第二方面提供的方法，该第二设备包括该第三设备。In combination with the method provided in the second aspect, the second device includes the third device.
结合第二方面提供的方法，该第二设备为家居设备；该第三设备为扫地机器人。In combination with the method provided in the second aspect, the second device is a household device; the third device is a cleaning robot.
结合第二方面提供的方法，在该用户没有权限控制该第一区域中设备的情况下，该第一设备输出第一提示信息，该第一提示信息用于提示用户没有控制该第二设备启动该第一功能的权限。In combination with the method provided in the second aspect, when the user has no authority to control the devices in the first area, the first device outputs first prompt information, and the first prompt information is used to remind the user that the second device does not control the startup Permissions for this first function.
这样，移动终端可以告知用户无法控制权限范围外的家庭设备，避免用户重复输入控制操作。In this way, the mobile terminal can inform the user that it is impossible to control the home device outside the authorized range, so as to avoid the user from repeatedly inputting control operations.
结合第二方面提供的方法，该通信系统还包括第四设备；在该用户没有权限控制该第一区域中设备的情况下，该第一设备显示第一控件；该第一设备检测到作用于该第一控件的操作；该第一设备向该第四设备发送第一请求，该第一请求用于请求该用户获取到控制该第二设备的该第一功能的权限；该第一设备接收到该第四设备发送的授权消息，触发该第二设备启动该第一功能。In combination with the method provided in the second aspect, the communication system further includes a fourth device; when the user has no authority to control devices in the first area, the first device displays a first control; the first device detects that the The operation of the first control; the first device sends a first request to the fourth device, and the first request is used to request the user to obtain permission to control the first function of the second device; the first device receives The authorization message sent by the fourth device triggers the second device to start the first function.
这样，当某个家庭成员例如小孩没有控制某个设备的权限时，该成员可以向其他家庭成员例如家长的发送授权请求，在家长确保小孩将要执行的操作安全时，可以为小孩授权。这样既可以保障家庭成员的安全也不影响家庭设备的使用。In this way, when a family member such as a child does not have the authority to control a certain device, the member can send an authorization request to other family members such as the parent, and the parent can authorize the child when the parent ensures that the operation the child will perform is safe. In this way, the safety of family members can be guaranteed without affecting the use of family equipment.
结合第二方面提供的方法，该第一设备拒绝触发该第二设备启动该第一功能之后，该方法还包括：该第一设备再次识别输入该第一操作的用户的身份；在该用户有权限控制该第一区域中设备的情况下，该第一设备触发该第二设备启动该第一功能；在该用户没有权限控制该第一区域中设备的情况下，则该第一设备拒绝触发该第二设备启动该第一功能。In combination with the method provided in the second aspect, after the first device refuses to trigger the second device to start the first function, the method further includes: the first device identifies again the identity of the user who input the first operation; When the authority controls the equipment in the first area, the first equipment triggers the second equipment to start the first function; when the user does not have the authority to control the equipment in the first area, the first equipment refuses to trigger The second device activates the first function.
这样，当第一设备第一次识别到当前用户的身份不具有控制该设备的权限时，第一设备可以持续认证用户的身份，在这一过程中，假设当前用户有其他家庭成员例如家长在旁边陪伴，则可以请求家长输入家长的身份信息，这样，便可以继续正常控制该家庭设备了。In this way, when the first device recognizes that the identity of the current user does not have the right to control the device for the first time, the first device can continue to authenticate the identity of the user. In this process, it is assumed that the current user has other family members such as parents. If you are accompanied by the side, you can request the parents to enter the identity information of the parents, so that you can continue to control the family device normally.
结合第二方面提供的方法，在该第一设备触发该第二设备启动该第一功能之前，该方法 还包括以下一项或多项：该第一设备确定该第一空间中有其他用户；或者，该第一设备确定该用户与该第一空间的距离小于第一值；或者，该第一设备确定接收该第一操作的时间为该用户的非工作时间；或者，该第一设备确定该第一功能用于减少家庭耗电。In combination with the method provided in the second aspect, before the first device triggers the second device to start the first function, the method further includes one or more of the following: the first device determines that there are other users in the first space; Or, the first device determines that the distance between the user and the first space is smaller than the first value; or, the first device determines that the time for receiving the first operation is the user's non-working time; or, the first device determines that This first function serves to reduce household electricity consumption.
这样，移动终端可以结合更多因素来控制家庭设备，在低碳、健康的基础下，全方位保证家庭生活的质量。In this way, the mobile terminal can combine more factors to control the family equipment, and ensure the quality of family life in an all-round way on the basis of low carbon and health.
结合第二方面提供的方法，该第一设备接收到第一操作之前，该方法还包括：该第一设备中存储有多个用户针对该第一空间中各个区域中设备的控制权限。With reference to the method provided in the second aspect, before the first device receives the first operation, the method further includes: storing in the first device the control permissions of multiple users for devices in various areas in the first space.
结合第二方面提供的方法，该第一空间包括：家庭空间、办公空间。In combination with the method provided in the second aspect, the first space includes: family space and office space.
这样，无论是家庭场景还是办公场景或者其他场景中都可以使用本申请提供的设备的控制方法。In this way, the device control method provided by the present application can be used in a home scene, an office scene, or other scenes.
第三方面，本申请提供了一种设备的控制方法，该方法应用于第四设备和第五设备的通信系统；该方法包括：该第四设备检测到该第四设备位于第一电子围栏外；该第四设备输出第二提示信息，或者，该第四设备向第五设备发送第二信息，该第二信息用于指示该第四设备位于该第一电子围栏外；该第一电子围栏包括多个封闭区域以及该多个封闭区域之间的路线。In a third aspect, the present application provides a device control method, the method is applied to the communication system of the fourth device and the fifth device; the method includes: the fourth device detects that the fourth device is located outside the first electronic fence ; The fourth device outputs second prompt information, or the fourth device sends second information to the fifth device, and the second information is used to indicate that the fourth device is located outside the first electronic fence; the first electronic fence It includes multiple closed areas and routes between the multiple closed areas.
这样，当用户例如儿童，或者家庭宠物，或者贵重物品等丢失，离开安全区域时，可以告知家庭成员，保护家庭成员、家庭宠物以及贵重物品的安全。In this way, when a user such as a child, or family pets, or valuables is lost and leaves the safe area, family members can be notified to protect the safety of family members, family pets and valuables.
结合第三方面提供的方法，该第四设备检测到该第四设备位于第二电子围栏内；该第四设备输出第三提示信息，或者，该第四设备向该第五设备发送第三信息，该第三信息用于指示该第四设备位于该第二电子围栏内。In combination with the method provided in the third aspect, the fourth device detects that the fourth device is located in the second electronic fence; the fourth device outputs third prompt information, or the fourth device sends third information to the fifth device , the third information is used to indicate that the fourth device is located within the second geo-fence.
这样，当用户例如儿童，或者家庭宠物，进入到危险场所时，可以告知家庭成员，保护家庭成员、家庭宠物的安全。In this way, when a user such as a child or a family pet enters a dangerous place, the family members can be notified to protect the safety of the family members and the family pet.
结合第三方面提供的方法，该第四设备检测到该第四设备位于第一电子围栏外，具体包括：该第四设备检测到该第四设备位于该第一电子围栏中的该多个封闭区域外；或者，该第四设备检测到该第四设备位于该第一电子围栏中的该路线外超过第一距离和/或位于该第一电子围栏中的该路线外的时间超过第一时间段。In combination with the method provided in the third aspect, the detecting by the fourth device that the fourth device is outside the first geo-fence specifically includes: the fourth device detecting that the fourth device is located in the plurality of enclosures within the first geo-fence; or, the fourth device detects that the fourth device is located outside the route in the first electronic fence for more than a first distance and/or is located outside the route in the first electronic fence for longer than a first time part.
这样，第一设备可以根据用户的操作来设置电子围栏也可以根据用户日常活动轨迹来生成电子围栏。In this way, the first device can set an electronic fence according to the user's operation, and can also generate an electronic fence according to the user's daily activity track.
结合第三方面提供的方法，该第四设备检测到该第四设备位于第一电子围栏外，之前，该方法还包括：该第四设备根据用户输入的第三操作设置该第一电子围栏；或者，该第四设备根据第二时间段内的移动轨迹生成该第一电子围栏，该第一电子围栏包括该移动轨迹。In combination with the method provided in the third aspect, the fourth device detects that the fourth device is located outside the first electronic fence. Before that, the method further includes: the fourth device sets the first electronic fence according to a third operation input by the user; Alternatively, the fourth device generates the first e-fence according to the movement track within the second time period, and the first e-fence includes the movement track.
这样，第一设备可以根据用户的操作来设置电子围栏也可以根据用户日常活动轨迹来生成电子围栏。In this way, the first device can set an electronic fence according to the user's operation, and can also generate an electronic fence according to the user's daily activity track.
结合第三方面提供的方法，该第一电子围栏的边界对应该移动轨迹对应的区域的边界，该第一电子围栏所围成的面积大于等于该移动轨迹对应的区域。In combination with the method provided in the third aspect, the boundary of the first electronic fence corresponds to the boundary of the area corresponding to the movement track, and the area enclosed by the first electronic fence is greater than or equal to the area corresponding to the movement track.
结合第三方面提供的方法，该第五设备包括以下任意一项或多项：手机、平板、智能手表、手环、家居设备或者车载电脑。In combination with the method provided in the third aspect, the fifth device includes any one or more of the following: a mobile phone, a tablet, a smart watch, a bracelet, a home device, or a vehicle-mounted computer.
这样，当用户离开安全区域或者进入危险区域时，可以出发家中的设备、用户随身携带的设备以及车辆等都发出警报，保证其他家庭成员尽快尽可能收到提示信息。In this way, when the user leaves the safe area or enters the dangerous area, the equipment at home, the equipment carried by the user, and the vehicle can all send out alarms, so as to ensure that other family members receive the prompt information as soon as possible.
第四方面，本申请提供了一种设备的控制方法，该方法应用于第一设备、第二设备和第四设备的通信系统；该方法包括：第四设备检测到该第四设备的使用情况不符合第一规则； 该第四设备停止提供该第四设备的部分功能或全部功能；该第四设备接收到该第二设备发送的第四信息，该第四信息指示用户完成了第一任务；响应于接收到第四信息，该第四设备继续提供该第四设备的部分或全部功能；或者，该第四设备接收到该第一设备发送的第五信息，该第五信息用于指示该第四设备继续提供该第四设备的部分或全部功能；响应于接收到第五信息，该第四设备继续提供该第四设备的部分或全部功能。In a fourth aspect, the present application provides a device control method, the method is applied to the communication system of the first device, the second device, and the fourth device; the method includes: the fourth device detects the usage of the fourth device The first rule is not met; the fourth device stops providing some or all functions of the fourth device; the fourth device receives the fourth information sent by the second device, and the fourth information indicates that the user has completed the first task ; In response to receiving the fourth information, the fourth device continues to provide some or all of the functions of the fourth device; or, the fourth device receives fifth information sent by the first device, and the fifth information is used to indicate The fourth device continues to provide part or all of the functions of the fourth device; in response to receiving the fifth information, the fourth device continues to provide part or all of the functions of the fourth device.
实施第四方面提供的方法，当用户打破使用电子设备的规则后，需要协同其他设备来完成响应的解锁任务，才能继续正常使用该电子设备。Implementing the method provided in the fourth aspect, when the user breaks the rules for using the electronic device, he needs to cooperate with other devices to complete the corresponding unlocking task before continuing to use the electronic device normally.
结合第四方面提供的方法，该第四设备停止提供该第四设备的部分功能或全部功能之前，或之后，该方法还包括：该第四设备输出第四提示信息，该第四提示信息用于指示用户执行该第一任务。In combination with the method provided in the fourth aspect, before or after the fourth device stops providing some or all functions of the fourth device, the method further includes: the fourth device outputs fourth prompt information, and the fourth prompt information uses to instruct the user to perform the first task.
这样，在设备检测到用户打破规则之后，会锁定部分功能或者全部功能之前或者之后，可以提示用户执行对应的解锁任务，来解锁功能。In this way, after the device detects that the user breaks the rules, before or after locking some or all functions, the user may be prompted to perform a corresponding unlocking task to unlock the functions.
结合第四方面提供的方法，第四设备检测到该第四设备的使用情况不符合第一规则之前，该方法还包括：该第四设备根据用户输入的第四操作，设置该第一规则；该第四设备接收该第一设备发送的该第一规则。In combination with the method provided in the fourth aspect, before the fourth device detects that the use of the fourth device does not comply with the first rule, the method further includes: the fourth device sets the first rule according to a fourth operation input by the user; The fourth device receives the first rule sent by the first device.
这样，用户使用某个设备的使用规则可以在本端设备中设置，也可以在其他设备中远程设置。In this way, the user's usage rules for using a certain device can be set in the local device or remotely in other devices.
结合第四方面提供的方法，该第四设备接收到该第二设备发送的第四信息之前或者之后，并且该第四设备继续提供该第四设备的部分或全部功能之前；该方法还包括：该第二设备将该第四信息发送至该第一设备；该第一设备检测到第五操作；该第一设备向该第四设备发送该第五信息，该第五信息用于指示该第四设备继续提供该第四设备的部分或全部功能。In combination with the method provided in the fourth aspect, before or after the fourth device receives the fourth information sent by the second device, and before the fourth device continues to provide some or all functions of the fourth device; the method further includes: The second device sends the fourth information to the first device; the first device detects a fifth operation; the first device sends the fifth information to the fourth device, and the fifth information is used to indicate that the first The fourth device continues to provide some or all of the functions of the fourth device.
这样，其他其他设备检测到用户完成解锁任务后，可以将执行解锁任务的信息发送至家长侧，经过家长侧审核通过后，用户才能解锁当前设备。In this way, after other devices detect that the user has completed the unlocking task, they can send information about performing the unlocking task to the parent side, and the user can unlock the current device only after the parent side reviews and approves it.
结合第四方面提供的方法，在该第四设备接收到第二设备发送的第四信息之后，并且该第四设备继续提供该第四设备的部分或全部功能之前；该方法还包括：该第四设备将该第三信息发送至该第一设备；该第一设备检测到第五操作，该第一设备向该第四设备发送该第五信息，该第五信息用于指示该第四设备继续提供该第四设备的部分或全部功能。In combination with the method provided in the fourth aspect, after the fourth device receives the fourth information sent by the second device and before the fourth device continues to provide some or all functions of the fourth device; the method further includes: the first The fourth device sends the third information to the first device; the first device detects the fifth operation, the first device sends the fifth information to the fourth device, and the fifth information is used to indicate that the fourth device Continue to provide some or all functions of the fourth device.
这样，其他其他设备检测到用户完成解锁任务后，将执行解锁任务的信息发送至打破规则的设备侧，该设备可以将执行解锁任务的信息发送家长侧，经过家长侧审核通过后，用户才能解锁当前设备。In this way, after other devices detect that the user has completed the unlocking task, they will send the information of performing the unlocking task to the device that breaks the rules, and the device can send the information of performing the unlocking task to the parent side, and the user can unlock it only after the parent side approves current device.
结合第四方面提供的方法，该第一规则包括以下任意一项或多项：该第四设备每天处于解锁状态的时长小于第一时长；该第四设备持续处于解锁状态的时长小于第二时长；该第四设备在第三时间段以外的其他时间处于锁屏状态；该第四设备拒绝运行第一应用程序以外的应用程序；该第四设备持续运行第一应用程序的时长小于第三时长。In combination with the method provided in the fourth aspect, the first rule includes any one or more of the following: the duration of the fourth device being in the unlocked state every day is less than the first duration; the duration of the fourth device being in the unlocked state is shorter than the second duration ; The fourth device is in a locked screen state at other times than the third time period; the fourth device refuses to run applications other than the first application; the fourth device continues to run the first application for less than the third duration .
这样，可以设置多种使用规则，达到对用户使用规则的全方位管理。In this way, multiple usage rules can be set to achieve comprehensive management of user usage rules.
结合第四方面提供的方法，该第一应用程序包括：即时通讯类应用程序、教育学习类应用程序、运动健康类应用程序、事件备忘类应用程序。In combination with the method provided in the fourth aspect, the first application program includes: an instant messaging application program, an education and learning application program, a sports and health application program, and an event reminder application program.
结合第四方面提供的方法，该第一应用程序为第三方应用程序和、或系统应用程序。With reference to the method provided in the fourth aspect, the first application program is a third-party application program and/or a system application program.
结合第四方面提供的方法，该第一任务包括以下任意一项或多项：学习、运动、休息或者做家务。In combination with the method provided in the fourth aspect, the first task includes any one or more of the following: study, exercise, rest or housework.
这样，当用户打破电子设备的使用规则后，可以休息、运动、学习做家务，这样劳逸结 合的生活可以保证用户的身心健康。In this way, when the user breaks the rules of using electronic equipment, he can rest, exercise, and learn to do housework, so that the life combining work and rest can ensure the physical and mental health of the user.
结合第四方面提供的方法，第四设备检测到该第四设备的使用情况不符合第一规则之前，该方法还包括：该第四设备输出用于提示用户使用该第四设备的该第一规则。In combination with the method provided in the fourth aspect, before the fourth device detects that the use of the fourth device does not comply with the first rule, the method further includes: the fourth device outputs the first message for prompting the user to use the fourth device. rule.
这样，可以提前提醒用户使用规则，避免用户打破该使用规则。In this way, the user can be reminded of the use rule in advance to prevent the user from breaking the use rule.
结合第四方面提供的方法，该第四设备接收到第二设备发送的第四信息，具体包括：该第二设备认证该用户的身份，并在该用户的身份为第二用户的情况下，向该第四设备发送第三信息。In combination with the method provided in the fourth aspect, the fourth device receives the fourth information sent by the second device, specifically including: the second device authenticates the identity of the user, and when the identity of the user is the second user, Send third information to the fourth device.
这样，可以保证用户在执行解锁任务时，是本人完成的该解锁任务，而非其他人员代替。In this way, it can be ensured that when the user performs the unlocking task, the unlocking task is completed by himself, rather than replaced by other personnel.
结合第四方面提供的方法，上述第二用户为儿童。In combination with the method provided in the fourth aspect, the above-mentioned second user is a child.
这样可以达到对儿童使用设备的管理，避免儿童沉迷电子设备，或者使用不当等。In this way, the management of children's use of equipment can be achieved, and children can be prevented from being addicted to electronic equipment or using it improperly.
结合第四方面提供的方法，该第一设备为该第二用户的家长的手机、平板或者笔记本；该第四设备为该第二用户的智能手表、手环、手机、平板或者笔记本；该第二设备为提供运动服务或者学习服务的设备。In combination with the method provided in the fourth aspect, the first device is the mobile phone, tablet or notebook of the parent of the second user; the fourth device is the smart watch, bracelet, mobile phone, tablet or notebook of the second user; The second device is the device that provides sports services or learning services.
第五方面，本申请提供了一种设备的控制方法，该方法应用于第一设备、第二设备、第四设备第六设备的通信系统；该方法包括：第一设备检测到第六操作，该第六操作用于启动第二功能；该第一设备根据用户输入的第七操作获取第二用户的状态，或者通过该第二设备或该第四设备第六设备获取该第二用户的状态；在该第二用户的状态为以下一项或多项的情况下：未睡觉、学习，该第二用户与第一用户的距离小于第二距离与预设距离，或者该第二用户与该第一用户处于一个房间内；该第一设备拒绝启动该第二功能。In the fifth aspect, the present application provides a device control method, the method is applied to the communication system of the first device, the second device, the fourth device and the sixth device; the method includes: the first device detects the sixth operation, The sixth operation is used to start the second function; the first device obtains the status of the second user according to the seventh operation input by the user, or obtains the status of the second user through the second device or the fourth device or the sixth device ; When the state of the second user is one or more of the following: not sleeping, studying, the distance between the second user and the first user is less than the second distance and the preset distance, or the distance between the second user and the The first user is in a room; the first device refuses to activate the second function.
实施第五方面提供的方法，可以设置家长使用电子设备的规则，从而使得家长可以高效陪伴孩子成长，并为孩子树立良好的形象。Implementing the method provided in the fifth aspect can set rules for parents to use electronic devices, so that parents can efficiently accompany their children to grow up and establish a good image for their children.
第六方面，本申请提供了一种设备的控制方法，该方法应用于第一设备和第六设备的通信系统；该方法包括：该第一设备检测到该第二用户输入的第八操作，该第八操作用于启动第三功能；该第一设备获取该第一用户的状态；在该第一用户的状态为以下一项或多项的情况下：睡觉、离家、工作；该第一设备拒绝启动该第三功能。In a sixth aspect, the present application provides a device control method, which is applied to a communication system between a first device and a sixth device; the method includes: the first device detects an eighth operation input by the second user, The eighth operation is used to start the third function; the first device acquires the status of the first user; when the status of the first user is one or more of the following: sleeping, leaving home, working; the second A device refuses to activate the third function.
实施第六方面提供的方法，可以设置孩子使用家长的电子设备的规则，从而使得孩子可以在家长的陪伴下正确使用电子设备，进而不作违规操作。By implementing the method provided in the sixth aspect, it is possible to set rules for children to use parents' electronic devices, so that children can correctly use electronic devices accompanied by parents, and then do not violate regulations.
结合第五方面或者第六方面提供的方法该第一用户的状态由该第一设备根据该第一用户输入的操作设置；或者，该第一用户的状态由该第一设备或该第六设备检测到后发送给该第一设备。In combination with the method provided in the fifth aspect or the sixth aspect, the status of the first user is set by the first device according to the operation input by the first user; or, the status of the first user is set by the first device or the sixth device After being detected, it is sent to the first device.
这样，家长可以通过自己设置自己的状态，进而约束自己按规定使用电子设备，从而主动来要求自己高质量陪伴孩子，为孩子树立良好的形象。也可以是电子设备检测到家中的状态，来约束家长按规定使用电子设备。In this way, parents can set their own status, and then restrict themselves to use electronic devices according to regulations, so as to actively ask themselves to accompany their children with high quality and establish a good image for their children. It can also be that the electronic equipment detects the status at home to restrict the parents to use the electronic equipment according to regulations.
结合第五方面或者第六方面提供的方法，该第二用户为儿童；该第一用户为该第二用户的家长。In combination with the method provided in the fifth aspect or the sixth aspect, the second user is a child; the first user is a parent of the second user.
结合第五方面或者第六方面提供的方法，其特征在于第一设备为该第一用户的手机、平板或者笔记本；该第六设备包括以下任意一项或多项：该第一用户的家庭监控设备，该第二用户的智能手表、手环、手机、平板或者笔记本。The method provided in conjunction with the fifth aspect or the sixth aspect is characterized in that the first device is the first user's mobile phone, tablet or notebook; the sixth device includes any one or more of the following: the first user's home monitoring The device is the smart watch, bracelet, mobile phone, tablet or notebook of the second user.
这样，用于检测用户状态的设备可以包含多种，进而提高本方案的可实施性。In this way, there may be multiple types of devices for detecting user status, thereby improving the practicability of this solution.
第七方面，本申请提供了一种设备的控制方法，该方法应用于包含智能门锁、第一设备和第二设备的通信系统；该方法包括：该智能门锁检测到第九操作，该智能门锁开门；在该 智能门锁和该第一设备之间的距离逐渐变大时，该智能门锁执行以下一项或多项：拒绝关门，输出用于提示用户携带该第一设备的第五提示信息，或，触发该第一设备和/或该第二设备输出用于提示用户携带该第一设备的第五提示信息。In a seventh aspect, the present application provides a device control method, the method is applied to a communication system including a smart door lock, a first device, and a second device; the method includes: the smart door lock detects a ninth operation, the The smart door lock opens the door; when the distance between the smart door lock and the first device gradually increases, the smart door lock performs one or more of the following: refuse to close the door, and output a signal for prompting the user to carry the first device The fifth prompt information, or, trigger the first device and/or the second device to output fifth prompt information for prompting the user to carry the first device.
实施第七方面提供的方法后，当用户离家且没带电子设备的时候，可以提醒用户携带电子设备，避免用户离家又回家浪费时间，耽误行程。After implementing the method provided in the seventh aspect, when the user leaves home without an electronic device, the user can be reminded to carry the electronic device, so as to avoid wasting time and delaying the schedule when the user leaves home and returns home.
结合第七方面提供的方法，该智能门锁检测到第九操作之前，该方法还包括：该智能门锁确定用户和该智能门锁之间的距离小于第二值；该智能门锁输出用于提示用户携带该第一设备的第五提示信息，或，触发该第一设备和/或该第二设备输出用于提示用户携带该第一设备的第五提示信息。In combination with the method provided in the seventh aspect, before the smart door lock detects the ninth operation, the method further includes: the smart door lock determines that the distance between the user and the smart door lock is less than the second value; The fifth prompt information for prompting the user to carry the first device, or triggering the first device and/or the second device to output fifth prompt information for prompting the user to carry the first device.
这样，当用户靠近家门，具备离家动机时，可以提前提醒用户携带电子设备，避免用户离家又回家浪费时间，耽误行程。In this way, when the user is close to home and has the motivation to leave home, the user can be reminded in advance to bring the electronic device, so as to avoid wasting time and delaying the trip when the user leaves home and returns home.
结合第七方面提供的方法，该智能门锁、第一设备和第二设备位于第一空间；该方法还包括：在第四时间段，该第一设备确定用户离开该第一空间，用户在该第四时间段将携带第一物品出行；该第一设备输出第六提示信息，该第六提示信息用于提示用户携带该第一物品。In combination with the method provided in the seventh aspect, the smart door lock, the first device, and the second device are located in the first space; the method further includes: in the fourth time period, the first device determines that the user leaves the first space, and the user leaves the first space; The fourth time period will carry the first item for travel; the first device outputs sixth prompt information, and the sixth prompt information is used to prompt the user to carry the first item.
这样，当电子设备检测到用户出行需要携带必要物品例如身份证、笔记本等，可以在用户出门时提醒用户带好相关物件，避免用户离家又回家浪费时间，耽误行程。In this way, when the electronic device detects that the user needs to carry necessary items such as an ID card and a notebook when traveling, the electronic device can remind the user to bring the relevant items when going out, so as to avoid wasting time and delaying the itinerary when the user leaves home and returns home.
结合第七方面提供的方法，该第一设备中存储有第六信息，该第六信息指示该用户在该第四时间段携带该第一物品出行的事件。In combination with the method provided in the seventh aspect, the first device stores sixth information, and the sixth information indicates that the user travels with the first item during the fourth time period.
这样，电子设备可以预先获取到用户的出行事件相关的信息。In this way, the electronic device can obtain information related to the travel event of the user in advance.
结合第七方面提供的方法，该智能门锁、第一设备和第二设备位于第一空间，该方法还包括：在第五时间段，该第一设备确定用户离开该第一空间；在该第五时间段内出现极端天气；该第一设备输出第七提示信息，该第七提示信息用于提示用户携带防护用品。In combination with the method provided in the seventh aspect, the smart door lock, the first device, and the second device are located in a first space, and the method further includes: during a fifth time period, the first device determines that the user leaves the first space; Extreme weather occurs within the fifth time period; the first device outputs seventh prompt information, and the seventh prompt information is used to remind the user to bring protective equipment.
这样，当电子设备检测到用户出行，可以根据当前天气情况，提醒用户携带对应的防护用品，避免用户离家又回家浪费时间，耽误行程，提高出行效率。In this way, when the electronic device detects that the user is traveling, it can remind the user to carry the corresponding protective equipment according to the current weather conditions, so as to prevent the user from wasting time when leaving home and returning home, delaying the itinerary, and improving travel efficiency.
结合第七方面提供的方法，该第一设备确定用户离开该第一空间，具体包括：该第一设备接收到智能门锁发送的第七信息，该第七信息指示用户离开该第一空间，或者，该第一设备检测到用户离开该第一空间。In combination with the method provided in the seventh aspect, the first device determining that the user leaves the first space specifically includes: the first device receiving seventh information sent by the smart door lock, the seventh information instructing the user to leave the first space, Alternatively, the first device detects that the user leaves the first space.
这样，电子设备可以接收到其他设备发送的用户离家的消息，或者自己检测到用户离家来确定用户的离家状态。In this way, the electronic device may receive a message from other devices that the user leaves home, or detect the user leaving home by itself to determine the user's leaving home state.
结合第七方面提供的方法，该第一设备检测到用户离开该第一空间，具体包括：该第一设备检测到与该家庭中的路由器断开通信连接；或者，该第一设备检测到与该第二设备断开通信连接；或者，该第一设备获取到该第一设备中记录的出行事件；或者，该第一设备检测到用户通过使用NFC功能或者扫描条码乘车；或者，该第一设备检测到用户距离该第一空间的距离超过第三值。With reference to the method provided in the seventh aspect, the first device detecting that the user leaves the first space specifically includes: the first device detecting that the communication connection with the router in the home is disconnected; The second device disconnects the communication connection; or, the first device acquires the travel event recorded in the first device; or, the first device detects that the user takes a car by using the NFC function or scanning a barcode; or, the first device A device detects that the distance between the user and the first space exceeds a third value.
这样，电子设备可以通过多种方式检测到用户离家，进而提高本方案的可实施性。In this way, the electronic device can detect that the user leaves home in various ways, thereby improving the implementability of the solution.
结合第七方面提供的方法，该通信系统还包括车辆；该方法还包括：该车辆检测到第十操作，该车辆的车门打开；在该第车门和该第一设备之间的距离逐渐变大时，该车辆执行以下一项或多项：拒绝关闭车门，输出用于提示用户携带该第一设备的第八提示信息，或，触发该第一设备和/或该第二设备输出用于提示用户携带该第一设备的第八提示信息。In combination with the method provided in the seventh aspect, the communication system further includes a vehicle; the method further includes: the vehicle detects a tenth operation, the door of the vehicle is opened; the distance between the first door and the first device gradually increases , the vehicle performs one or more of the following: refuse to close the door, output an eighth prompt message for prompting the user to carry the first device, or trigger the first device and/or the second device to output a prompt The eighth prompt information of the first device carried by the user.
这样，当用户下车且没带电子设备的时候，可以提醒用户携带电子设备，避免用户浪费 时间，耽误行程。In this way, when the user gets off the car and does not bring the electronic device, the user can be reminded to carry the electronic device, so as to avoid the user from wasting time and delaying the trip.
结合第七方面提供的方法，该通信系统还包括车辆；该方法还包括：该车辆确定用户和该车门之间的距离小于第四值；该车辆输出用于提示用户携带该第一设备的第八提示信息，或，触发所第一设备和/或该第二设备输出用于提示用户携带该第一设备的第八提示信息。In combination with the method provided in the seventh aspect, the communication system further includes a vehicle; the method further includes: the vehicle determines that the distance between the user and the vehicle door is less than a fourth value; the vehicle outputs a first value for prompting the user to carry the first device Eighth prompt information, or trigger the first device and/or the second device to output eighth prompt information for prompting the user to carry the first device.
这样，当用户靠近车门，具备下车动机时，可以提前提醒用户携带电子设备，避免用户浪费时间，耽误行程。In this way, when the user is close to the car door and has the motivation to get off the car, the user can be reminded in advance to carry the electronic device, so as to avoid the user from wasting time and delaying the trip.
结合第七方面提供的方法，该通信系统还包括车辆；该方法还包括：该车辆检测到第十一操作，该车辆锁门及锁窗；该车辆检测到该车辆内有用户，该车辆执行以下一项或多项：开窗、开门，输出用于提示该车辆内还有用户的第九提示信息，或，触发该第一设备和/或该第二设备输出用于提示该车辆内还有用户的第九提示信息。In combination with the method provided in the seventh aspect, the communication system further includes a vehicle; the method further includes: the vehicle detects the eleventh operation, the vehicle locks the doors and windows; the vehicle detects that there is a user in the vehicle, and the vehicle executes One or more of the following: open the window, open the door, output the ninth prompt information for prompting that there is still a user in the vehicle, or trigger the first device and/or the second device to output a prompt for prompting that there is still a user in the vehicle There is a ninth prompt message for the user.
这样，可以提醒用户还有儿童或老人被遗留在车内，比自动控制车窗车门打开，避免儿童或老人在车内出现安全事故。In this way, the user can be reminded that there are still children or old people left in the car, and the windows and doors are automatically controlled to open, so as to avoid safety accidents in the car for children or old people.
结合第七方面提供的方法，该车辆开窗或开门后，向该第一设备发送第八信息，该第八信息指示该车辆已经开窗或开门；该第一设备显示第二控件，第一设备检测到作用于该第二控件的操作，该第一设备触发该车辆锁窗及锁门。In combination with the method provided in the seventh aspect, after the vehicle opens the window or the door, it sends eighth information to the first device, and the eighth information indicates that the vehicle has opened the window or door; the first device displays the second control, and the first The device detects the operation acting on the second control, and the first device triggers the locking of windows and doors of the vehicle.
这样，当用户指示短暂下车，或者车内的儿童或者老人已经下车，为了保证车内贵重物品的安全，用户可以远程控制车辆锁窗及锁门。In this way, when the user instructs to get off the car briefly, or the child or the elderly in the car has already got off the car, in order to ensure the safety of the valuables in the car, the user can remotely control the vehicle to lock the windows and doors.
第八方面，本申请提供了一种设备的控制方法，该方法应用于包含第一设备、第二设备、车辆的通信系统；该方法包括：在第六时间段，该第一设备执行第十二操作；用户在该第六时间段将执行第一事件；该第十二操作包括以下任意一下或多项：该第一设备触发该第三设备启动第五功能，该第五功能支持用户执行该第一事件；或者，该第一设备触发该车辆启动，车辆启动支持用户执行该第一事件。In an eighth aspect, the present application provides a device control method, the method is applied to a communication system including a first device, a second device, and a vehicle; the method includes: during the sixth time period, the first device executes the tenth Two operations; the user will execute the first event in the sixth time period; the twelfth operation includes any one or more of the following: the first device triggers the third device to start the fifth function, and the fifth function supports the user to perform The first event; or, the first device triggers the vehicle to start, and the vehicle starts to support the user to execute the first event.
实施第八方面提供的方法，电子设备可以根据电子设备中记录的事件的信息，控制家庭设备执行对应的操作，减少用户操作，减轻用户的记忆负担。By implementing the method provided in the eighth aspect, the electronic device can control the home device to perform corresponding operations according to the event information recorded in the electronic device, reducing user operations and reducing the user's memory burden.
结合第八方面提供的方法，该第一设备触发该第三设备执行第五功能，之前；或者，该第一设备触发该车辆启动，之前，该方法还包括：该第一设备输出第十提示信息；该第十提示信息用于提示用户该该第三设备即将执行第五功能，或者，该车辆即将启动。In combination with the method provided in the eighth aspect, before the first device triggers the third device to execute the fifth function; or, before the first device triggers the vehicle to start, the method further includes: the first device outputs a tenth prompt Information; the tenth prompt information is used to remind the user that the third device is about to perform the fifth function, or that the vehicle is about to start.
这样，电子设备可以提前通知用户将要控制其他设备执行对应操作，保证用户知情权。In this way, the electronic device can notify the user in advance that it will control other devices to perform corresponding operations, ensuring the user's right to know.
结合第八方面提供的方法，该第一设备执行第十二操作之后，该方法还包括：该第一设备显示第三控件，第一设备检测到作用于该第三控件的操作，该第一设备撤回该第十二操作。With reference to the method provided in the eighth aspect, after the first device performs the twelfth operation, the method further includes: the first device displays a third control, the first device detects an operation acting on the third control, and the first The device undoes the twelfth operation.
这样，电子设备可以在自动控制其他设备执行对应事件后，还可以显示相应的控件，用于用户撤回上述控制操作。In this way, after the electronic device automatically controls other devices to execute corresponding events, it can also display a corresponding control for the user to withdraw the above-mentioned control operation.
第九方面，本申请提供了一种设备的控制方法，该方法应用于第四设备；该方法包括：该第四设备检测到该第四设备位于第一电子围栏外；该第四设备输出第二提示信息，或者，该第四设备向第五设备发送第二信息，该第二信息用于指示该第四设备位于该第一电子围栏外；该第一电子围栏包括多个封闭区域以及该多个封闭区域之间的路线。In a ninth aspect, the present application provides a device control method, the method is applied to a fourth device; the method includes: the fourth device detects that the fourth device is located outside the first electronic fence; the fourth device outputs the Two reminder information, or, the fourth device sends second information to the fifth device, the second information is used to indicate that the fourth device is located outside the first electronic fence; the first electronic fence includes multiple closed areas and the Routes between multiple enclosed areas.
结合第九方面提供的方法，该第四设备检测到该第四设备位于第二电子围栏内；该第四设备输出第三提示信息，或者，该第四设备向该第五设备发送第三信息，该第三信息用于指示该第四设备位于该第二电子围栏内。In combination with the method provided in the ninth aspect, the fourth device detects that the fourth device is located in the second electronic fence; the fourth device outputs third prompt information, or the fourth device sends third information to the fifth device , the third information is used to indicate that the fourth device is located within the second geo-fence.
结合第九方面提供的方法，该第四设备检测到该第四设备位于第一电子围栏外，具体包括：该第四设备检测到该第四设备位于该第一电子围栏中的该多个封闭区域外；或者，该第 四设备检测到该第四设备位于该第一电子围栏中的该路线外超过第一距离和/或位于该第一电子围栏中的该路线外的时间超过第一时间段。In combination with the method provided in the ninth aspect, the fourth device detecting that the fourth device is located outside the first electronic fence specifically includes: the fourth device detecting that the fourth device is located in the plurality of enclosures within the first electronic fence or, the fourth device detects that the fourth device is located outside the route in the first electronic fence for more than a first distance and/or is located outside the route in the first electronic fence for longer than a first time part.
结合第九方面提供的方法，该第四设备检测到该第四设备位于第一电子围栏外，之前，该方法还包括：该第四设备根据用户输入的第三操作设置该第一电子围栏；或者，该第四设备根据第二时间段内的移动轨迹生成该第一电子围栏，该第一电子围栏包括该移动轨迹。In combination with the method provided in the ninth aspect, the fourth device detects that the fourth device is located outside the first electronic fence. Before that, the method further includes: the fourth device sets the first electronic fence according to a third operation input by the user; Alternatively, the fourth device generates the first e-fence according to the movement track within the second time period, and the first e-fence includes the movement track.
结合第九方面提供的方法，该第一电子围栏的边界对应该移动轨迹对应的区域的边界，该第一电子围栏所围成的面积大于等于该移动轨迹对应的区域。In combination with the method provided in the ninth aspect, the boundary of the first electronic fence corresponds to the boundary of the area corresponding to the movement track, and the area enclosed by the first electronic fence is greater than or equal to the area corresponding to the movement track.
结合第九方面提供的方法，该第五设备包括以下任意一项或多项：手机、平板、智能手表、手环或者家居设备。In combination with the method provided in the ninth aspect, the fifth device includes any one or more of the following: a mobile phone, a tablet, a smart watch, a bracelet, or a household device.
第十方面，本申请提供例了一种设备的控制方法，该方法应用于第四设备，该方法包括：第四设备检测到该第四设备的使用情况不符合第一规则；该第四设备停止提供该第四设备的部分功能或全部功能；该第四设备接收到第二设备发送的第四信息，该第四信息指示用户完成了第一任务；响应于接收到第四信息，该第四设备继续提供该第四设备的部分或全部功能；或者，该第四设备接收到第一设备发送的第五信息，该第五信息用于指示该第四设备继续提供该第四设备的部分或全部功能；响应于接收到第五信息，该第四设备继续提供该第四设备的部分或全部功能。In a tenth aspect, the present application provides an example of a device control method, the method is applied to a fourth device, and the method includes: the fourth device detects that the use of the fourth device does not comply with the first rule; the fourth device stop providing some or all of the functions of the fourth device; the fourth device receives fourth information sent by the second device, the fourth information indicating that the user has completed the first task; in response to receiving the fourth information, the fourth The fourth device continues to provide part or all of the functions of the fourth device; or, the fourth device receives fifth information sent by the first device, and the fifth information is used to instruct the fourth device to continue to provide part of the fourth device or all functions; in response to receiving the fifth information, the fourth device continues to provide some or all functions of the fourth device.
结合第十方面提供的方法，该第四设备停止提供该第四设备的部分功能或全部功能之前，或之后，该方法还包括：该第四设备输出第四提示信息，该第四提示信息用于指示用户执行该第一任务。In combination with the method provided in the tenth aspect, before or after the fourth device stops providing some or all functions of the fourth device, the method further includes: the fourth device outputs fourth prompt information, and the fourth prompt information uses to instruct the user to perform the first task.
结合第十方面提供的方法，第四设备检测到该第四设备的使用情况不符合第一规则之前，该方法还包括：该第四设备根据用户输入的第四操作，设置该第一规则；该第四设备接收该第一设备发送的该第一规则。In combination with the method provided in the tenth aspect, before the fourth device detects that the use of the fourth device does not comply with the first rule, the method further includes: the fourth device sets the first rule according to a fourth operation input by the user; The fourth device receives the first rule sent by the first device.
结合第十方面提供的方法，在该第四设备接收到第二设备发送的第四信息之后，并且该第四设备继续提供该第四设备的部分或全部功能之前；该方法还包括：该第四设备将该第三信息发送至该第一设备；该第四设备接收该第一设备检测到第五操作后发送的该第五信息，该第五信息用于指示该第四设备继续提供该第四设备的部分或全部功能。In combination with the method provided in the tenth aspect, after the fourth device receives the fourth information sent by the second device and before the fourth device continues to provide some or all functions of the fourth device; the method further includes: the first The fourth device sends the third information to the first device; the fourth device receives the fifth information sent after the first device detects the fifth operation, and the fifth information is used to instruct the fourth device to continue to provide the Some or all of the functions of the fourth device.
结合第十方面提供的方法，该第一规则包括以下任意一项或多项：该第四设备每天处于解锁状态的时长小于第一时长；该第四设备持续处于解锁状态的时长小于第二时长；该第四设备在第三时间段以外的其他时间处于锁屏状态；该第四设备拒绝运行第一应用程序以外的应用程序；该第四设备持续运行第一应用程序的时长小于第三时长。In combination with the method provided in the tenth aspect, the first rule includes any one or more of the following: the duration of the fourth device being in the unlocked state every day is less than the first duration; the duration of the fourth device being in the unlocked state is shorter than the second duration ; The fourth device is in a locked screen state at other times than the third time period; the fourth device refuses to run applications other than the first application; the fourth device continues to run the first application for less than the third duration .
结合第十方面提供的方法，该第一应用程序包括：即时通讯类应用程序、教育学习类应用程序、运动健康类应用程序、事件备忘类应用程序。In combination with the method provided in the tenth aspect, the first application program includes: an instant messaging application program, an education and learning application program, a sports and health application program, and an event reminder application program.
结合第十方面提供的方法，该第一应用程序为第三方应用程序和/或系统应用程序。With reference to the method provided in the tenth aspect, the first application program is a third-party application program and/or a system application program.
结合第十方面提供的方法，该第一任务包括以下任意一项或多项：学习、运动、休息或者做家务。In combination with the method provided in the tenth aspect, the first task includes any one or more of the following: study, exercise, rest or housework.
结合第十方面提供的方法，第四设备检测到该第四设备的使用情况不符合第一规则之前，该方法还包括：该第四设备输出用于提示用户使用该第四设备的该第一规则。In combination with the method provided in the tenth aspect, before the fourth device detects that the use of the fourth device does not comply with the first rule, the method further includes: the fourth device outputs the first message for prompting the user to use the fourth device. rule.
结合第十方面提供的方法，该第四设备接收到第二设备发送的第四信息，具体包括：该第四设备接收该第二设备在认证该用户的身份为第二用户的情况下，发送的第三信息。In combination with the method provided in the tenth aspect, the fourth device receiving the fourth information sent by the second device specifically includes: the fourth device receiving the information sent by the second device under the condition that the user is authenticated as the second user. the third information.
结合第十方面提供的方法，该第二用户为儿童。In combination with the method provided in the tenth aspect, the second user is a child.
结合第十方面提供的方法，该第一设备为该第二用户的家长的手机、平板或者笔记本；该第四设备为该第二用户的智能手表、手环、手机、平板或者笔记本；该第二设备为提供运动服务或者学习服务的设备。In combination with the method provided in the tenth aspect, the first device is the mobile phone, tablet or notebook of the parent of the second user; the fourth device is the smart watch, bracelet, mobile phone, tablet or notebook of the second user; The second device is the device that provides sports services or learning services.
第十一方面，本申请提供了一种设备的控制方法，该方法应用于第一设备；该方法包括：第一设备检测到第六操作，该第六操作用于启动第二功能；该第一设备根据用户输入的第七操作获取第二用户的状态，或者通过第六设备获取该第二用户的状态；在该第二用户的状态为以下一项或多项的情况下：未睡觉、学习，该第二用户与第一用户的距离小于第二距离与预设距离，或者该第二用户与该第一用户处于一个房间内；该第一设备拒绝启动该第二功能。In an eleventh aspect, the present application provides a device control method, which is applied to a first device; the method includes: the first device detects a sixth operation, and the sixth operation is used to start a second function; A device acquires the status of the second user according to the seventh operation input by the user, or acquires the status of the second user through the sixth device; when the status of the second user is one or more of the following: not sleeping, Learning, the distance between the second user and the first user is less than the second distance and the preset distance, or the second user and the first user are in the same room; the first device refuses to activate the second function.
第十二方面，本申请提供了一种设备的控制方法，该方法应用于第一设备；该方法包括：该第一设备检测到该第二用户输入的第八操作，该第八操作用于启动第三功能；该第一设备获取该第一用户的状态；在该第一用户的状态为以下一项或多项的情况下：睡觉、离家、工作；该第一设备拒绝启动该第三功能。In a twelfth aspect, the present application provides a device control method, the method is applied to a first device; the method includes: the first device detects an eighth operation input by the second user, and the eighth operation is used for Start the third function; the first device acquires the status of the first user; when the status of the first user is one or more of the following: sleeping, leaving home, and working; the first device refuses to start the second Three functions.
结合第十一方面或第十二方面提供的方法，该第一用户的状态由该第一设备根据该第一用户输入的操作设置；或者，该第一用户的状态由该第一设备或该第六设备检测到后发送给该第一设备。In combination with the method provided in the eleventh aspect or the twelfth aspect, the status of the first user is set by the first device according to the operation input by the first user; or, the status of the first user is set by the first device or the After the sixth device detects it, it sends it to the first device.
结合第十一方面或第十二方面提供的方法，该第二用户为儿童；该第一用户为该第二用户的家长。In combination with the method provided in the eleventh aspect or the twelfth aspect, the second user is a child; the first user is a parent of the second user.
结合第十一方面或第十二方面提供的方法，其特征在于第一设备为该第一用户的手机、平板或者笔记本；该第六设备包括以下任意一项或多项：该第一用户的家庭监控设备，该第二用户的智能手表、手环、手机、平板或者笔记本。The method provided in conjunction with the eleventh aspect or the twelfth aspect is characterized in that the first device is the first user's mobile phone, tablet or notebook; the sixth device includes any one or more of the following: the first user's Home monitoring equipment, the second user's smart watch, bracelet, mobile phone, tablet or notebook.
第十三方面，本申请提供了一种电子设备，该电子设备包括一个或多个处理器和一个或多个存储器；其中，该一个或多个存储器与该一个或多个处理器耦合，该一个或多个存储器用于存储计算机程序代码，该计算机程序代码包括计算机指令，当该一个或多个处理器执行该计算机指令时，使得该电子设备执行如第八方面，第九方面，第十方面以及第十一方面中任一方面所述的方法。第十三方面，本申请提供了一种包含指令的计算机程序产品，当该计算机程序产品在电子设备上运行时，使得该电子设备执行如第八方面，第九方面，第十方面以及第十一方面中任一方面所述的方法。In a thirteenth aspect, the present application provides an electronic device, which includes one or more processors and one or more memories; wherein, the one or more memories are coupled with the one or more processors, the One or more memories are used to store computer program codes, and the computer program codes include computer instructions. When the one or more processors execute the computer instructions, the electronic device executes the eighth aspect, the ninth aspect, and the tenth aspect. aspect and the method described in any one of the eleventh aspect. In a thirteenth aspect, the present application provides a computer program product containing instructions. When the computer program product runs on an electronic device, the electronic device executes the eighth aspect, the ninth aspect, the tenth aspect and the tenth aspect. The method of any one of the aspects.
第十四方面，本申请提供了一种计算机可读存储介质，包括指令，当该指令在电子设备上运行时，使得该电子设备执行如第八方面，第九方面，第十方面以及第十一方面中任一方面所述的方法。In a fourteenth aspect, the present application provides a computer-readable storage medium, including instructions. When the instructions are run on an electronic device, the electronic device executes the eighth aspect, the ninth aspect, the tenth aspect and the tenth aspect. The method of any one of the aspects.
第十五方面，本申请提供了一种通信系统，该通信系统包括第一电子设备、第二电子设备，该第一电子设备用于执行如第八方面，第九方面，第十方面以及第十一方面中任一方面所述的方法。In a fifteenth aspect, the present application provides a communication system, the communication system includes a first electronic device and a second electronic device, and the first electronic device is used to implement the eighth aspect, the ninth aspect, the tenth aspect and the first electronic device The method described in any one of eleven aspects.
附图说明Description of drawings
图1A为本申请实施例提供的针对数据银行中用户数据的管理过程；Figure 1A is the management process for user data in the data bank provided by the embodiment of the present application;
图1B为本申请实施例提供的通信系统示意图；FIG. 1B is a schematic diagram of a communication system provided by an embodiment of the present application;
图2A-图2B分别为本申请实施例提供的移动终端的软硬件架构图；FIG. 2A-FIG. 2B are respectively the software and hardware architecture diagrams of the mobile terminal provided by the embodiment of the present application;
图3为本申请实施例提供的家庭设备的硬件架构图；FIG. 3 is a hardware architecture diagram of a home device provided by an embodiment of the present application;
图4为本申请实施例提供的家庭设备的硬件架构图；FIG. 4 is a hardware architecture diagram of a home device provided by an embodiment of the present application;
图5A为本申请实施例提供的家庭成员关系示意图；Fig. 5A is a schematic diagram of the family member relationship provided by the embodiment of the present application;
图5B为本申请实施例提供的家庭成员分别拥有的权限等级示意图；FIG. 5B is a schematic diagram of authority levels owned by family members provided by the embodiment of the present application;
图5C为本申请实施例提供的家庭平面布局结构示意图；FIG. 5C is a schematic diagram of the family plane layout structure provided by the embodiment of the present application;
图5D为本申请实施例提供的家庭空间布局结构示意图；FIG. 5D is a schematic diagram of the family space layout structure provided by the embodiment of the present application;
图6A-图6V示例性示出用户创建“智慧家庭”的一系列操作界面示意图；6A-6V exemplarily show a series of operation interface diagrams for users to create a "smart home";
图7A-图7T示例性示出用户设置家庭成员的控制权限一系列操作界面示意图；Fig. 7A-Fig. 7T exemplarily show a series of operation interface diagrams of the user setting the control rights of family members;
图8A-图8E示例性示出用户设置身份认证方式的初始化操作界面示意图；8A-8E exemplarily show a schematic diagram of an initialization operation interface for a user to set an identity authentication mode;
图8F-图8X示例性示出家庭成员通过智慧家庭APP控制家庭设备的用户界面；Fig. 8F-Fig. 8X exemplarily show the user interface of family members controlling the family devices through the smart home APP;
图9A-图9G示例性示出移动终端检测到一种敏感操作后的一系列用户界面示意图；9A-9G exemplarily show a series of user interface diagrams after the mobile terminal detects a sensitive operation;
图9H-图9M示例性示出移动终端检测到另一种敏感操作后的一系列用户界面示意图；FIG. 9H-FIG. 9M exemplarily show a series of user interface diagrams after the mobile terminal detects another sensitive operation;
图9N-图9Q示例性示出移动终端检测到另一种敏感操作后的一系列用户界面示意图；FIG. 9N-FIG. 9Q exemplarily show a series of user interface diagrams after the mobile terminal detects another sensitive operation;
图9R-图9W示例性示出移动终端检测到另一种敏感操作后的一系列用户界面示意图；9R-9W exemplarily show a series of user interface diagrams after the mobile terminal detects another sensitive operation;
图9X-图9Y示例性示出移动终端检测到另一种敏感操作后的一系列用户界面示意图；9X-9Y exemplarily show a series of user interface diagrams after the mobile terminal detects another sensitive operation;
图10A-图10H示例性示出设置使用规则以及相关任务的一系列操作界面示意图；10A-10H exemplarily show a series of operation interface diagrams for setting usage rules and related tasks;
图11A-图11R示例性示出打破使用规则时的一系列操作界面示意图；Fig. 11A-Fig. 11R exemplarily show a series of schematic diagrams of the operation interface when the rules of use are broken;
图11S-图11X示例性示出用户执行一种解锁任务时的一系列操作界面示意图；FIG. 11S-FIG. 11X exemplarily show a series of schematic diagrams of the operation interface when the user performs an unlocking task;
图11Y-图11Z-5示例性示出用户执行另一种解锁任务时的一系列操作界面示意图；Fig. 11Y-Fig. 11Z-5 exemplarily show a series of schematic diagrams of the operation interface when the user performs another unlocking task;
图12A-图12V示例性示出移动终端主动检测用户状态的一系列用户界面示意图；FIG. 12A-FIG. 12V exemplarily show a series of schematic diagrams of user interfaces in which the mobile terminal actively detects the user status;
图12W-图12Z示例性示出用户向移动终端输入用户状态时的一系列操作界面示意图；12W-12Z exemplarily show a series of schematic diagrams of the operation interface when the user inputs the user status to the mobile terminal;
图13A-图13C示例性示出移动终端根据用户状态控制家庭设备的用户界面示意图；13A-13C exemplarily show a schematic diagram of a user interface for a mobile terminal to control a home device according to a user status;
图13D-图13J示例性示出移动终端根据用户状态和获取到的事件信息来控制家庭设备的用户界面示意图；FIG. 13D-FIG. 13J exemplarily show a schematic diagram of a user interface in which a mobile terminal controls a home device according to user status and acquired event information;
图13K-图13L示例性示出移动终端仅根据获取到的事件来控制家庭设备的用户界面示意图。FIG. 13K-FIG. 13L exemplarily show user interface diagrams in which a mobile terminal controls a home device only according to acquired events.
具体实施方式Detailed ways
下面将结合附图对本申请实施例中的技术方案进行清楚、详尽地描述。其中，在本申请实施例的描述中，除非另有说明，“/”表示或的意思，例如，A/B可以表示A或B；文本中的“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况，另外，在本申请实施例的描述中，“多个”是指两个或多于两个。The technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the accompanying drawings. Among them, in the description of the embodiments of this application, unless otherwise specified, "/" means or means, for example, A/B can mean A or B; "and/or" in the text is only a description of associated objects The association relationship indicates that there may be three kinds of relationships, for example, A and/or B, which may indicate: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiment of the present application , "plurality" means two or more than two.
以下，术语“第一”、“第二”仅用于描述目的，而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征，在本申请实施例的描述中，除非另有说明，“多个”的含义是两个或两个以上。Hereinafter, the terms "first" and "second" are used for descriptive purposes only, and cannot be understood as implying or implying relative importance or implicitly specifying the quantity of indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of these features. In the description of the embodiments of the present application, unless otherwise specified, the "multiple" The meaning is two or more.
在本申请中提及“实施例”意味着，结合实施例描述的特定特征、结构或特性可以包含在本申请的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例，也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是，本申请所描述的实施例可以与其它实施例相结合。Reference in this application to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The occurrences of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is understood explicitly and implicitly by those skilled in the art that the embodiments described in this application can be combined with other embodiments.
本申请以下实施例中的术语“用户界面(user interface，UI)”，是应用程序或操作系统与 用户之间进行交互和信息交换的介质接口，它实现信息的内部形式与用户可以接受形式之间的转换。用户界面是通过java、可扩展标记语言(extensible markup language，XML)等特定计算机语言编写的源代码，界面源代码在电子设备上经过解析，渲染，最终呈现为用户可以识别的内容。用户界面常用的表现形式是图形用户界面(graphic user interface，GUI)，是指采用图形方式显示的与计算机操作相关的用户界面。它可以是在电子设备的显示屏中显示的文本、图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、Widget等可视的界面元素。The term "user interface (UI)" in the following embodiments of this application is a medium interface for interaction and information exchange between an application program or an operating system and a user, and it realizes the difference between the internal form of information and the form acceptable to the user. conversion between. The user interface is the source code written in a specific computer language such as java and extensible markup language (XML). The source code of the interface is parsed and rendered on the electronic device, and finally presented as content that can be recognized by the user. The commonly used form of user interface is the graphical user interface (graphic user interface, GUI), which refers to the user interface related to computer operation displayed in a graphical way. It may be text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, and other visible interface elements displayed on the display screen of the electronic device.
随着通信手段的日益丰富和物理世界数字化的加速发展，用户享受到的数字化服务越来越多，用户在生活及工作中产生的数据也越来越多。用户数据规模大，结构多样且增长迅速。此外，用户数据具备巨大的价值，例如可用于构建用户属性、提升用户体验以及研发新的应用技术等等。用户属性也可以称为用户画像。With the increasingly abundant means of communication and the accelerated development of the digitalization of the physical world, users enjoy more and more digital services, and users generate more and more data in their lives and work. User data is large in scale, diverse in structure and growing rapidly. In addition, user data has great value, for example, it can be used to build user attributes, improve user experience, and develop new application technologies, etc. User attributes may also be referred to as user portraits.
共享和开放用户数据，能够将各类信息有效地连接起来，挖掘出用户数据包含的价值，为用户生活带来更加便捷的服务。但是，共享和开放用户数据，同样存在泄露用户隐私信息的风险，导致用户对于个人数据安全性的担忧。在实际应用中，出于对隐私的保护，用户通常不放心开放自身的用户数据，这对挖掘用户数据的价值带来了障碍。Sharing and opening user data can effectively connect all kinds of information, dig out the value contained in user data, and bring more convenient services to users' lives. However, sharing and opening user data also has the risk of leaking user privacy information, causing users to worry about the security of personal data. In practical applications, due to the protection of privacy, users are usually worried about opening their own user data, which brings obstacles to mining the value of user data.
如何在合理合规的前提下共享和开放用户数据，将用户数据的价值最大化，充分挖掘数据价值，并且，保障用户隐私不被泄露，是当前及未来研究的方向，也是用户所关注的问题。How to share and open user data under the premise of reasonable compliance, maximize the value of user data, fully tap the value of data, and protect user privacy from being leaked is the direction of current and future research, and it is also a concern of users .
本申请实施例提供一种数据银行(data bank)的管理机制，可以在共享和开放用户数据的同时，保障用户隐私不被泄露。数据银行(data bank)具有全生命周期治理管控，数据防泄漏和防篡改，参与方身份鉴别与访问控制，价值分享的特性。具体的，数据银行保障数字世界的数据，在生命周期内有序、可控的存储、分享、应用和销毁，并且保障数据提供者、数据加工者、数据交易平台和数据消费者等所有参与方都能获取收益。数据银行促进数据成为数字经济繁荣的底座，满足数据成为市场经济生产要素的诉求。数据银行通过对数据全生命周期进行标记，对数字经济参与各方进行身份鉴别与权限控制，对数据流转进行全程追踪和记录，防止数据生命周期内信息泄漏及篡改，提供技术保障。The embodiment of the present application provides a data bank management mechanism, which can protect user privacy from being leaked while sharing and opening user data. The data bank has the characteristics of full life cycle governance control, data leakage prevention and tamper resistance, participant identity authentication and access control, and value sharing. Specifically, the data bank guarantees the orderly and controllable storage, sharing, application and destruction of data in the digital world within the life cycle, and guarantees all participants such as data providers, data processors, data trading platforms and data consumers. can obtain income. The data bank promotes data as the base for the prosperity of the digital economy and meets the demand for data to become a factor of production in the market economy. By marking the entire life cycle of data, the data bank conducts identity identification and authority control for all parties involved in the digital economy, tracks and records the entire process of data transfer, prevents information leakage and tampering within the data life cycle, and provides technical support.
数据银行(data bank)是管理用户数据的可信机构，负责用户数据的存储、分享、分发、撤回、追溯、使用等等，还可用于管理用户数据的生命周期，即有效期。数据银行(data bank)可以在用户授权的情况下，管理用户数据，并为用户数据的拥有用户付费。A data bank is a trusted organization that manages user data. It is responsible for the storage, sharing, distribution, withdrawal, traceability, use, etc. of user data. It can also be used to manage the life cycle of user data, that is, the validity period. The data bank can manage user data under the authorization of the user, and pay for the user who owns the user data.
数据银行(data bank)利用设备之间的互联互通以及各设备对其他设备能力的了解，将产生的数据分门别类地有序存储。存储数据时，为该数据打上相关标签(tag)，例如时间、地点、任务、事件，然后通过类似关系型数据库等方式存储，便于后续查找或使用这些数据。用户数据可以以个人、家庭、公司或其他团体为单位进行存储。存储数据时，还可以根据数据的重要性和敏感程度来分类分级，由用户设置各类数据的访问权限，这样可以在数据的生命周期内保证其不备泄露或滥用。The data bank uses the interconnection between devices and the understanding of each device's capabilities to other devices to store the generated data in an orderly manner. When storing data, put relevant tags on the data, such as time, place, task, event, and then store it in a similar relational database to facilitate subsequent search or use of the data. User data can be stored on an individual, family, company or other group basis. When storing data, it can also be classified and graded according to the importance and sensitivity of the data, and the user can set the access rights of various types of data, so as to ensure that it will not be leaked or misused during the life cycle of the data.
用户将数据存储至数据银行(data bank)中时，可以对数据进行加密并设置访问策略，其他用户只有在满足该访问策略时，才有权限查看数据银行(data bank)中存储的该数据。加密技术包括但不限于基于属性的加密(attribute-based encryption，ABE)算法等。When users store data in the data bank, they can encrypt the data and set access policies. Only when the access policies are met, other users have permission to view the data stored in the data bank. Encryption techniques include but are not limited to attribute-based encryption (ABE) algorithms and the like.
用户数据还可以经过脱敏处理后存储至数据银行。例如，用户数据中和用户隐私强相关的数据包括用户的姓名、住址、联系方式等可以被删除后再存储至数据银行。User data can also be desensitized and stored in the data bank. For example, data that is strongly related to user privacy in user data, including the user's name, address, contact information, etc., can be deleted and then stored in the data bank.
本申请实施例还提供一种可能的基于中间服务器实现的脱敏处理方案。中间服务器可以获取到用户通过端侧设备上传的用户数据，并为基于用户数据的服务提供方(例如提供医疗 健康服务的服务器、提供交通事故分析的服务器、提供广告推荐的服务器等等)提供脱敏或模糊化后的用户数据，不直接将全部的用户数据公布给该服务提供方，以保证用户数据不被泄露或滥用，保障用户隐私。例如，用户通过端侧设备将用户数据上传至中间服务器后，中间服务器将该用户的真实身份信息(例如姓名、联系方式、住址等)和该用户数据绑定，在有基于用户数据的服务提供方来请求该用户数据时，中间服务器可以将该用户数据和该用户的虚拟化身份信息绑定后发送给该服务提供方，并且自己存储该虚拟化身份信息和真实身份信息的关联关系。这样，服务提供方不会获知用户数据和真实用户身份之间的关系，也就避免了用户敏感数据及隐私的泄露。其中，该中间服务器也可以被称为中间代理、代理服务器、中继服务器等其他名称。The embodiment of the present application also provides a possible desensitization solution based on an intermediate server. The intermediate server can obtain the user data uploaded by the user through the end-side device, and provide off-the-shelf services for service providers based on user data (such as servers providing medical and health services, servers providing traffic accident analysis, servers providing advertising recommendations, etc.) Sensitized or blurred user data, and not directly publish all user data to the service provider, so as to ensure that user data is not leaked or abused, and protect user privacy. For example, after the user uploads the user data to the intermediate server through the end-side device, the intermediate server binds the user's real identity information (such as name, contact information, address, etc.) When a party requests the user data, the intermediate server can bind the user data with the user's virtualized identity information and send it to the service provider, and store the relationship between the virtualized identity information and the real identity information. In this way, the service provider will not know the relationship between the user data and the real user identity, thus avoiding the disclosure of the user's sensitive data and privacy. Wherein, the intermediate server may also be called an intermediate agent, a proxy server, a relay server and other names.
数据银行(data bank)可以获取到海量的用户数据，并在用户同意的情况下将海量的、各行各业的、各类用户数据联合起来，利用这些用户数据来执行更多的操作，挖掘这些用户数据的经济价值和社会价值，推动各行业的发展。如果之后用户停止授权，则数据银行(data bank)则会停止对应的操作，例如用户停止授权后，数据银行(data bank)可以清理对应的数据，不会备份或拷贝该数据。这样可以确保用户数据被合理、有序地使用，还可以保护用户的隐私。The data bank can obtain massive user data, and combine massive user data from various industries and various types with the consent of the user, and use these user data to perform more operations and mine these user data. The economic value and social value of user data promote the development of various industries. If the user stops the authorization later, the data bank will stop the corresponding operations. For example, after the user stops the authorization, the data bank can clean up the corresponding data and will not back up or copy the data. This ensures that user data is used reasonably and orderly, and also protects user privacy.
数据银行(data bank)将数据的加密体系、密钥管理、访问控制策略通过数据标签的形式集成到数据本身，可以让数据跨物理节点流动时仍然可以获得一致性保护。The data bank integrates the data encryption system, key management, and access control policies into the data itself in the form of data tags, so that data can still obtain consistent protection when flowing across physical nodes.
数据银行(data bank)本身也可以实现为多层级或多类别的结构，不同层级的数据银行(data bank)具备的权限不同。例如数据银行(data bank)可以包括总数据银行和分数据银行等。又例如，数据银行(data bank)可包括管理运动健康数据的数据银行、管理出行数据的数据银行等等。The data bank itself can also be implemented as a multi-level or multi-category structure, and different levels of data banks have different permissions. For example, a data bank (data bank) may include a total data bank and a sub-data bank. For another example, a data bank (data bank) may include a data bank for managing exercise and health data, a data bank for managing travel data, and the like.
可见，用户数据就像货币，数据银行(data bank)就像货币银行，数据银行(data bank)对用户数据的管理，和，货币银行对货币的管理类似。It can be seen that user data is like currency, and a data bank is like a currency bank. The management of user data by a data bank is similar to the management of currency by a currency bank.
数据银行(data bank)只是本申请实施例所使用的一个名词，其代表的含义在本实施例中已经记载，其名称并不能对本实施例构成任何限制。在其他一些实施例中，“数据银行(data bank)”也可以被称为例如“数据钱庄”等其他名词。Data bank (data bank) is just a noun used in the embodiment of this application, and its representative meaning has been recorded in this embodiment, and its name does not constitute any limitation to this embodiment. In some other embodiments, "data bank (data bank)" may also be called other terms such as "data bank".
下面结合图1A介绍本申请实施例提供的数据银行。The following describes the data bank provided by the embodiment of the present application with reference to FIG. 1A.
参考图1A，图1A示例性示出了本申请实施例提供的针对数据银行中用户数据的管理过程。Referring to FIG. 1A , FIG. 1A schematically shows a management process for user data in a data bank provided by an embodiment of the present application.
如图1A所示，图1A中示出的匿名化智慧服务数据应用平台即上文提及的中间服务器，图1A中示出的各类机构即为上述提及的基于用户数据的服务提供方，例如提供医疗健康服务的机构、提供交通事故分析的机构、提供广告推荐的机构等等。As shown in Figure 1A, the anonymized smart service data application platform shown in Figure 1A is the intermediate server mentioned above, and the various organizations shown in Figure 1A are the above-mentioned service providers based on user data , such as organizations that provide medical and health services, organizations that provide traffic accident analysis, organizations that provide advertising recommendations, and so on.
用户数据可包括但不限于以下几种类型：运动健康数据、出行数据、习惯数据、设备数据等等。User data may include but not limited to the following types: exercise health data, travel data, habit data, equipment data, etc.
运动健康数据，用于表征用户的身体状态。运动健康数据可包括年龄、性别、身高、体重、血压、血糖、血氧、呼吸率、心率、心电波形、体脂率、体温等生理数据。Sports health data, used to characterize the user's physical state. Sports health data can include physiological data such as age, gender, height, weight, blood pressure, blood sugar, blood oxygen, respiration rate, heart rate, ECG waveform, body fat percentage, body temperature, etc.
出行数据表征用户已执行或待执行的出行计划，以及，实际出行情况。出行数据可包括：订单(如机票、车票、酒店、外卖订单等)数据、日程数据、备忘录数据等。出行数据还可包括：车辆信息(如车速、油量、导航信息、驾驶模式等)、路况、道路基础设施信息(如红绿灯信号)、历史出行记录等等。The travel data represents the user's executed or to-be-executed travel plan, as well as the actual travel situation. Travel data may include: order (such as air tickets, train tickets, hotels, takeaway orders, etc.) data, schedule data, memorandum data, etc. Travel data can also include: vehicle information (such as vehicle speed, fuel level, navigation information, driving mode, etc.), road conditions, road infrastructure information (such as traffic light signals), historical travel records, etc.
习惯数据：是指与用户生活习惯相关的数据，包括睡眠数据、活动区域相关数据。Habit data: Refers to data related to the user's living habits, including sleep data and activity area related data.
设备数据表征用户所使用的电子设备的配置情况，以及，该电子设备和其他设备的连接情况。设备数据例如可包括：电子设备中的应用程序(application，APP)安装列表、设备型号及配置、操作系统(operating system，OS)的登录账号及密码、各个APP的登录账号及密码、电子设备连接的其他设备(例如智能家居设备)的类型、数量及其他信息、等等。The device data represents the configuration of the electronic device used by the user, and the connection between the electronic device and other devices. The device data may include, for example: the list of application programs (application, APP) installed in the electronic device, the device model and configuration, the login account and password of the operating system (operating system, OS), the login account and password of each APP, and the electronic device connection. The type, quantity and other information of other devices (such as smart home devices), etc.
不限于上述列出的几种用户数据，用户数据还可包括更多的内容，例如还可包括银行数据、理财数据、个人身份信息、社会关系、学历、联系人信息等等。Not limited to the several types of user data listed above, user data may also include more content, such as bank data, wealth management data, personal identity information, social relations, education background, contact information, etc.
用户数据的表现形式可以包括符号、文字、数字、语音、图像、视频等等。用户数据可以是数字信息，也可以是纸质信息。The form of user data may include symbols, text, numbers, voice, images, videos, and so on. User data can be digital information or paper information.
基于图1A所示的数据银行(data bank)管理机制，用户数据的处理过程主要以下几个步骤：Based on the data bank management mechanism shown in Figure 1A, the user data processing process mainly follows the following steps:
1.用户数据的收集1. Collection of user data
收集用户数据的方式可包括多种，这里不做具体限定。There are many ways to collect user data, which are not specifically limited here.
收集用户数据的方式可包括但不限于以下几种：Methods of collecting user data may include, but are not limited to, the following:
(1)各类设备收集用户数据(1) Various devices collect user data
用户数据可以通过各类设备来收集。这些设备可以互联互通并组成生态链，也可以相互独立且不联通。User data can be collected through various devices. These devices can be interconnected and form an ecological chain, or they can be independent of each other and not connected.
例如，医疗器械或可穿戴设备或者运动设备来可以采集运动健康数据。血压计可采集血压，血糖仪采集血糖，血氧计采集血氧饱和度和脉率，体温计采集体温，心电记录仪采集心电波形，体脂称采集体脂率，智能手表或智能手环采集心率、呼吸率、血氧等。For example, medical devices or wearable devices or sports equipment can collect sports health data. Sphygmomanometers can collect blood pressure, blood glucose meters can collect blood sugar, oximeters can collect blood oxygen saturation and pulse rate, thermometers can collect body temperature, ECG recorders can collect ECG waveforms, body fat scales can collect body fat percentage, smart watches or smart bracelets Collect heart rate, respiration rate, blood oxygen, etc.
又例如，移动终端、车载设备或者智能门锁等可以采集出行数据。车载设备可通过传感器采集车速、油量，还可以获知当前的导航信息、驾驶模式，还可以通过蓝牙、蜂窝等通信技术获取到道路基础设施信息，等等。For another example, mobile terminals, vehicle-mounted devices, or smart door locks can collect travel data. The on-board equipment can collect vehicle speed and fuel level through sensors, as well as current navigation information and driving mode, as well as road infrastructure information through Bluetooth, cellular and other communication technologies, and so on.
又例如：移动终端、家庭监控等可以采集到用户的生活习惯相关的数据。移动终端可以采集用户日常作息、以及常用河东区域等。Another example: mobile terminals, home monitoring, etc. can collect data related to the user's living habits. The mobile terminal can collect the user's daily work and rest, as well as the frequently used east areas, etc.
(2)应用(application，APP)收集用户数据(2) Application (application, APP) collects user data
电子设备中可以安装各类APP，可包括系统APP，也可包括第三方APP。其中，系统APP是指电子设备的生产商所提供或研发的APP，第三方APP是指非电子设备的生产商所提供或研发的APP。电子设备的生产商可以包括该电子设备的制造商、供应商、提供商或运营商等。Various APPs can be installed in the electronic device, including system APPs and third-party APPs. Among them, the system APP refers to the APP provided or developed by the manufacturer of the electronic equipment, and the third-party APP refers to the APP provided or developed by the manufacturer of the non-electronic equipment. A producer of an electronic device may include a manufacturer, supplier, supplier, operator, etc. of the electronic device.
电子设备运行APP为用户提供服务时，该APP可以收集到相关的用户数据。例如，出行数据可以由智能手机、平板电脑等设备通过对应的APP采集到。其中，订单数据可以从生活服务类例如订票类APP中采集，日程数据可以从日程表APP中采集，备忘录数据可以从备忘录中采集，天气数据可以从天气预报类应用程序中采集。又例如外卖类APP可以收集用户的饮食偏好，电商购物类APP可以收集用户的购物偏好。When an electronic device runs an APP to provide services to users, the APP can collect relevant user data. For example, travel data can be collected by devices such as smartphones and tablets through corresponding APPs. Among them, the order data can be collected from life services such as booking APP, the schedule data can be collected from the schedule APP, the memorandum data can be collected from the memo, and the weather data can be collected from the weather forecast application. Another example is that a food delivery app can collect users' eating preferences, and an e-commerce shopping app can collect users' shopping preferences.
(3)电子设备的OS收集用户数据(3) The OS of the electronic device collects user data
OS是最基本的系统软件，用于管理电子设备的硬件、软件及数据资源，控制程序运行，改善人机界面，为其它软件提供支持等等。OS包括但不限于
Figure PCTCN2022119115-appb-000001
Figure PCTCN2022119115-appb-000002
等等。 OS is the most basic system software, which is used to manage the hardware, software and data resources of electronic equipment, control the operation of programs, improve the man-machine interface, provide support for other software, and so on. OS includes but not limited to
Figure PCTCN2022119115-appb-000001
Figure PCTCN2022119115-appb-000002
etc.
电子设备运行OS为用户提供服务时，该OS可以收集到相关的用户数据。When an electronic device runs an OS to provide services to users, the OS may collect relevant user data.
例如，电子设备如智能手机、可穿戴设备的OS可以采集用户的习惯数据。智能手机、 平板电脑的OS可以监控并学习用户使用智能手机、平板电脑等电子设备的行为习惯，例如用户常用的输入法、消息模式、操作模式等等，并生成表征用户行为习惯的习惯数据。可穿戴设备如智能手环等可采集用户的手部抖动频率、步频、睡眠等习惯数据。For example, the OS of electronic devices such as smartphones and wearable devices can collect user habit data. The OS of smart phones and tablet computers can monitor and learn the behavior habits of users using smart phones, tablet computers and other electronic devices, such as the user's commonly used input methods, message modes, operation modes, etc., and generate habit data representing user behavior habits. Wearable devices such as smart bracelets can collect user habit data such as hand shaking frequency, stride frequency, and sleep.
电子设备的OS还可以采集设备数据。The OS of the electronic device can also collect device data.
例如，智能手机等设备的OS可以获取到本设备上安装的APP列表、机型以及其他配置信息、OS的登录账号及密码、各个APP的登录账号及密码、用户的个人信息及联系人列表，还可以根据连接情况获知本设备连接的其他设备的信息(例如类型、数量、所在位置)等等。For example, the OS of a device such as a smartphone can obtain the list of APPs installed on the device, the model and other configuration information, the login account and password of the OS, the login account and password of each APP, the user's personal information and contact list, It is also possible to obtain information (such as type, quantity, location) and the like of other devices connected to this device according to the connection situation.
又例如，用户还可以在智能手机、平板电脑等设备上直接设置自己常用的操作模式、消息模式，该设备的OS可以根据用户的设置来采集该用户的行为习惯。For another example, the user can also directly set his usual operating mode and message mode on devices such as smart phones and tablet computers, and the OS of the device can collect the user's behavior habits according to the user's settings.
(4)电子设备的信息输入器件收集用户数据(4) Information input devices of electronic equipment collect user data
信息输入器件可包括但不限于显示屏、摄像头、麦克风、鼠标、键盘等等。Information input devices may include, but are not limited to, a display screen, a camera, a microphone, a mouse, a keyboard, and the like.
例如，用户可以通过文本、语音等形式输入运动健康数据，并由智能手机、平板电脑等设备通过显示屏、麦克风等接收。又例如，电子设备还可通过显示屏采集用户的输入法信息及搜索记录。又例如，智能手机、平板电脑还可以通过摄像头扫描纸质的体检报告、CT图像、药物处方、运动处方等，从而获取到体检报告中的信息。For example, users can input sports and health data through text, voice, etc., and devices such as smartphones and tablets can receive it through display screens, microphones, etc. For another example, the electronic device can also collect the user's input method information and search records through the display screen. For another example, smartphones and tablet computers can also scan paper physical examination reports, CT images, drug prescriptions, exercise prescriptions, etc. through cameras, thereby obtaining information in the medical examination reports.
(5)第三方机构收集用户数据(5) Third-party organization collects user data
第三方机构可包括产生数据的可信机构，例如医院、职能机构、航空公司等等。可信机构可用于收集用户数据。Third-party institutions may include trusted institutions that generate data, such as hospitals, functional agencies, airlines, and the like. Trusted authorities can be used to collect user data.
例如，医院可以搜集用户的运动健康数据。用户在医疗机构就诊后，诊断结果可上传至医疗机构提供的服务器，然后用户侧的智能手机、平板电脑等数据可以从服务器中下载该诊断结果。For example, hospitals can collect users' exercise health data. After the user visits the medical institution, the diagnosis result can be uploaded to the server provided by the medical institution, and then the smart phone, tablet computer and other data on the user side can download the diagnosis result from the server.
又例如，政府职能机构可以收集用户的个人信息、社会关系、联系人信息等等。For another example, government functional agencies may collect users' personal information, social relations, contact information, and so on.
又例如，航空公司可以收集用户的个人信息、出行数据等等。不限于上述列举的几种采集数据的方式，在一些实施例中，还可以通过其他方式来采集用户数据，这里不做限定。For another example, airlines may collect users' personal information, travel data, and so on. It is not limited to the several methods of collecting data listed above, and in some embodiments, user data may also be collected in other ways, which are not limited here.
收集用户数据时，一方面可以检验用户数据的有效性，对重复冗余、错误乱码等无效数据进行标记，要求重新提交数据或重新输入数据，另一方面还可以检验数据的完整性。When collecting user data, on the one hand, the validity of the user data can be checked, and invalid data such as redundant and garbled characters can be marked, and the data should be resubmitted or re-entered; on the other hand, the integrity of the data can also be checked.
收集到用户数据后，还可以对用户数据做预处理。例如，对各类数据进行标准化处理，并根据数据的重要程度、敏感程度、时效性或其他特定等进行分类，建立统一的数据存储模式。这样，通过不同方式、不同平台获取到的用户数据可以以统一的标准存储，并能够收集到完善全面的数据，便于后续构建完整的用户属性。这里，不同类型的用户数据可以有不同的存储标准，例如运动健康数据和出行数据可以通过不同的标准存储。After the user data is collected, the user data can also be preprocessed. For example, standardize the processing of various types of data and classify them according to their importance, sensitivity, timeliness or other specifics, and establish a unified data storage mode. In this way, user data obtained through different methods and platforms can be stored in a unified standard, and complete and comprehensive data can be collected to facilitate subsequent construction of complete user attributes. Here, different types of user data can have different storage standards, for example, exercise health data and travel data can be stored by different standards.
2.用户数据的加工2. Processing of user data
加工用户数据，可以为用户更好地提供服务，满足用户的实际需求。Processing user data can provide users with better services and meet the actual needs of users.
用户数据在用户同意后，可以上传至匿名化管理平台，确保信息无法追踪至个人，保证用户隐私。同时，基于多种加密技术，如密态计算、机密计算等进行端云联合推理，在此基础上对用户形成完整属性并保护隐私数据不泄露。当然，不同类别的用户数据可以上传至不同的匿名化管理平台，如运动健康数据可上传至医疗管理平台，出行数据可上传至出行管理平台以及智慧家庭管理平台等。User data can be uploaded to the anonymized management platform after the user agrees to ensure that the information cannot be traced to the individual and guarantee the privacy of the user. At the same time, based on a variety of encryption technologies, such as secret computing, confidential computing, etc., the device-cloud joint reasoning is performed, and on this basis, complete attributes are formed for users and private data is not leaked. Of course, different types of user data can be uploaded to different anonymized management platforms, such as sports and health data can be uploaded to the medical management platform, travel data can be uploaded to the travel management platform and smart home management platform, etc.
用户数据的加工可应用到以下几个领域：The processing of user data can be applied to the following areas:
智慧家庭smart family
一个家庭中的电子设备可以组网得到的一个互联互通的通信系统，并且一个家庭中包含 许多家庭成员，例如家主、家主的父母(老人)、家主的子女(儿童)，有时家庭成员还包括例如家政服务人员、家庭教师、家庭健身教练等等。电子设备可以为上述家庭成员划分家庭活动空间，即将用户的身份与家庭空间建立对应关系。当不同身份的用户使用家庭中的某个电子设备时，该电子设备可以根据收集到的使用者的信息进行分析，识别使用者的身份，进而为使用者开放对应的家电设备的使用权限。其中，使用者的信息包括：用户的面部图像、指纹、声音、姿态、操作习惯等等。此外，电子设备还可以结合用户的身份信息、以及用户在家庭中的常用活动空间、用户的行为轨迹、当前时间等信息限制该用户的部分使用权限。An interconnected communication system in which electronic devices in a family can be networked, and a family includes many family members, such as the head of the house, the parents of the head of the house (the elderly), the children (children) of the head of the house, and sometimes family members include, for example Housekeeping staff, tutors, home fitness trainers, and more. The electronic device may divide the family activity space for the family members, that is, establish a corresponding relationship between the user's identity and the family space. When users with different identities use a certain electronic device in the home, the electronic device can analyze the collected user information, identify the user's identity, and then open the user to use the corresponding home appliance. Wherein, the user's information includes: the user's facial image, fingerprint, voice, posture, operating habits and so on. In addition, the electronic device can also restrict part of the user's use rights in combination with the user's identity information, the user's usual activity space in the family, the user's behavior track, and the current time.
电子设备可以根据设置的使用规则，检测用户是否打破本设备的使用规则，当电子设备检测到该设备的使用规则被打破后，电子设备可以根据预先指定的任务指示用户通过完成指定任务，以继续正常使用该电子设备。该指定的任务，可以通过在本端电子设备和本端电子设备连接的其他家庭设备例如，学习机、运动手环、跑步机、扫地机器人、智能洗衣机中的任意一个或多个设备中完成，电子设备可以根据收集到的用户执行任务的相关数据，分析用户是否完成指定任务，若是则允许用户继续正常使用该电子设备，若不是则限制用户使用该电子设备的部分功能或锁定该电子设备。电子设备还会根据获取到的用户数据、设备数据判断用户的状态，当用户状态处于离家时，电子设备会结合应用程序中记录的事件信息，控制家庭设备执行对应的事件。上述用户数据可以包括用户在应用程序中存入的事件的信息，上述设备数据包括设备与其他家庭设备的连接状态相关的数据。上述应用程序中记录的事件信息可以是出行记录、天气信息，待办事件等等。上述提及的加工或处理用户数据的过程，可以由电子设备在端侧执行，也可以由云侧的服务器执行，还可以端云结合执行。具体处理用户数据时，可以通过预设的简单规则制定模型，也可以通过人工智能(artificial intelligence，AI)引擎来抽取模型，并通过该模型来处理或加工用户数据。预设的规则可以来自经验知识或业界标准。这些模型可用于根据用户数据来构建用户属性，从而为用户提供针对性地服务。The electronic device can detect whether the user breaks the use rule of the device according to the set use rules. When the electronic device detects that the use rule of the device is broken, the electronic device can instruct the user to complete the specified task according to the pre-designated task to continue. Use the electronic device normally. The specified task can be completed by any one or more devices in the local electronic device and other home devices connected to the local electronic device, such as learning machines, sports bracelets, treadmills, sweeping robots, and intelligent washing machines, The electronic device can analyze whether the user has completed the specified task based on the collected data about the task performed by the user. If so, the user is allowed to continue using the electronic device normally. If not, the user is restricted from using some functions of the electronic device or the electronic device is locked. The electronic device will also judge the user's status based on the acquired user data and device data. When the user is away from home, the electronic device will combine the event information recorded in the application program to control the home device to execute the corresponding event. The above user data may include event information stored by the user in the application program, and the above device data includes data related to the connection status of the device with other family devices. The event information recorded in the above applications may be travel records, weather information, to-do events and so on. The process of processing or processing user data mentioned above can be performed by the electronic device on the terminal side, or by a server on the cloud side, or can also be performed in combination with the terminal and cloud. When specifically processing user data, a model can be formulated through preset simple rules, or a model can be extracted through an artificial intelligence (AI) engine, and the user data can be processed or processed through the model. Preset rules can come from empirical knowledge or industry standards. These models can be used to construct user attributes based on user data, so as to provide users with targeted services.
可见，加工用户数据也可以让用户的家庭生活更加智能、方便、安全。It can be seen that processing user data can also make the user's home life more intelligent, convenient and safe.
3.用户数据的开放3. Opening of user data
用户数据可以跨设备开放给其他设备、跨应用开放给其他应用、跨OS开放给其他OS、跨用户开放给其他用户。开放用户数据，可以使得电子设备能够融合多方用户数据，从而为用户提供更加智能、方便的服务。通过开放用户数据，使得海量的用户数据不再相互独立存在，而可以流通起来进行共享。User data can be opened to other devices across devices, to other applications across applications, to other OSs across OSes, and to other users across users. Open user data can enable electronic devices to integrate multi-party user data, thereby providing users with more intelligent and convenient services. By opening user data, massive user data no longer exist independently of each other, but can be circulated and shared.
在开放用户数据时，可以制定相应的使用用户数据的权限控制策略，基于加密算法做到严格的权限管理和访问控制，确保数据只有在接收方满足访问策略时，才开放数据，并且还可控制数据的转发、截屏、打印等系统权限。这样既可以通过开放用户数据来提供更加优良的服务，又可以保证用户数据的安全，避免数据泄露。例如，在医疗领域，就可以保证医疗数据的有序分享、受控分发、可控撤回、事后追溯等需求。When opening user data, you can formulate corresponding permission control strategies for using user data, and implement strict permission management and access control based on encryption algorithms to ensure that the data is only opened when the recipient meets the access policy, and can also be controlled System permissions such as data forwarding, screen capture, and printing. In this way, better services can be provided by opening user data, and the security of user data can be guaranteed to avoid data leakage. For example, in the medical field, the orderly sharing, controlled distribution, controllable withdrawal, and subsequent traceability of medical data can be guaranteed.
4.用户数据的价值呈现4. The value presentation of user data
用户数据可以直观地展示给用户，让用户直接获知电子设备所采集到的用户数据，从而了解自身的身体状态、家庭成员的身体状态、家庭中的家居设备状态等等。User data can be intuitively displayed to users, allowing users to directly know the user data collected by electronic devices, so as to understand their own physical status, the physical status of family members, the status of household equipment in the family, and so on.
例如，电子设备可以获取智慧家庭中其他设备的运行状态等信息，并呈现给用户。电子设备可以基于用户的生活轨迹相关数据，生成用户的电子围栏并呈现给用户，以提醒用户切勿超出电子围栏的保护范围。当用户越过该电子围栏时，触发电子设备发出警报或者向其他家庭设备发出警报信息。此外，电子设备还会为用户呈现显示该电子设备的使用规则的提示信息，然后可以根据用户的使用该电子设备的数据、确定用户是否打破该电子设备的使用规 则，若是，则输出提示信息，提示用户通过完成制定的任务，以继续正常使用该电子设备。最后，电子设备还可以根据获取的用户待办事件信息，根据该待办事件控制家庭设备执行对应的操作，并为用户呈现对应的提示信息。关于用户数据的价值呈现可以具体参考下文的UI实施例的相关描述，在此暂不赘述。For example, an electronic device can obtain information such as the operating status of other devices in a smart home and present it to the user. Based on the data related to the user's life trajectory, the electronic device can generate the user's electronic fence and present it to the user, so as to remind the user not to go beyond the protection range of the electronic fence. When the user crosses the electronic fence, the electronic device is triggered to send an alarm or send an alarm message to other household devices. In addition, the electronic device will also present prompt information showing the use rules of the electronic device to the user, and then determine whether the user breaks the use rules of the electronic device according to the data of the user's use of the electronic device, and if so, output the prompt information, The user is prompted to continue using the electronic device normally by completing the specified task. Finally, the electronic device can also control the home device to perform corresponding operations according to the acquired user to-do event information, and present corresponding prompt information to the user. Regarding the value presentation of user data, you can refer to the relevant description of the UI embodiment below, and details will not be repeated here.
用户数据还可用于为各个用户构建用户属性，以便为该用户提供更个性化的服务。这里，可以使用不同类型的数据来为同一用户构建不同类别的属性，例如使用运动健康数据构建运动健康属性，使用出行数据构建出行偏好属性，使用和家居生活相关的数据构建家居偏好属性，使用和娱乐生活相关的数据构建娱乐偏好属性等等。用户属性可以提供给用户自己看，也可以提供给第三方APP或第三方平台，以便第三方APP或第三方平台为用户提供个性化的服务。User Data can also be used to build user attributes for individual users in order to provide a more personalized service to that user. Here, different types of data can be used to construct different categories of attributes for the same user, such as using sports health data to construct sports health attributes, using travel data to construct travel preference attributes, using data related to home life to construct home preference attributes, using and The data related to entertainment life constructs entertainment preference attributes and so on. User attributes can be provided to users themselves, or to third-party apps or third-party platforms, so that third-party apps or third-party platforms can provide users with personalized services.
用户数据还可以提供给第三方APP或平台，如医疗机构、运动健康平台等，并融合起来为用户提供更好的服务。User data can also be provided to third-party apps or platforms, such as medical institutions, sports and health platforms, etc., and integrated to provide users with better services.
例如，第三方APP或平台可以基于大量的医疗数据发展AI医疗，如医学影像、辅助诊断、药物研发、健康管理、基因测序等，可以促进医疗行业的技术发展。又例如，患者可以从不同医院拿到之前的电子病历和检查报告，辅助医生诊断，即医疗数据可以在不同医疗机构之间安全流动，提升患者的看病效率。又例如，用户也可根据自己每日上传的各项身体检测数据，进行日常健康监测管理或者慢病风险分析等，且不用担心自己的数据被泄露。For example, third-party apps or platforms can develop AI medical care based on a large amount of medical data, such as medical imaging, auxiliary diagnosis, drug development, health management, gene sequencing, etc., which can promote the technological development of the medical industry. For another example, patients can obtain previous electronic medical records and examination reports from different hospitals to assist doctors in diagnosis, that is, medical data can flow safely between different medical institutions, improving the efficiency of patients' medical treatment. For another example, users can also perform daily health monitoring management or chronic disease risk analysis based on their daily uploaded physical testing data, without worrying about their data being leaked.
此外，用户还可以将自身的用户数据出售。这样在用户许可的情况下，有需求的平台可以获取到大量有效的用户数据，并使用这些用户数据来研发更加丰富的应用技术，更好地为用户提供服务。并且，用户也能得到收益，实现双赢。In addition, users can also sell their own user data. In this way, with the user's permission, the platform in need can obtain a large amount of effective user data, and use these user data to develop more abundant application technologies and provide better services for users. Moreover, users can also get benefits to achieve a win-win situation.
在一些实施例中，用户的端侧设备上可以安装有不同的应用，分别支持上述提及的不同领域的用户数据的采集、加工、开放及数据呈现。例如，端侧设备中可以安装有运动健康类APP，用于支持针对运动健康类数据的相关处理。例如，端侧设备中可以安装有智能出行类APP，用于支持针对出行类数据的相关处理。例如，端侧设备中可以安装有智能家居类APP，用于支持针对家居类数据的相关处理。例如，端侧设备中可以安装有智能生活类APP，用于支持针对生活类数据的相关处理。In some embodiments, different applications can be installed on the user's end-side device, which respectively support the collection, processing, opening and data presentation of user data in different fields mentioned above. For example, a sports and health APP may be installed in the end-side device to support related processing of sports and health data. For example, a smart travel APP may be installed in the end-side device to support related processing of travel data. For example, a smart home app may be installed in the end-side device to support related processing of home data. For example, a smart life app may be installed in the end-side device to support related processing of life data.
本申请实施例提供的数据银行(data bank)的管理机制，用户共享和开放用户数据，可以在保障用户隐私安全的前提下，将数据银行作为资产一样流通起来，充分挖掘用户数据的价值，不仅可以满足用户的实际需求，让用户健康生活、智能出行，还可以促进各行业的健康繁荣发展。The data bank management mechanism provided by the embodiment of this application allows users to share and open user data. On the premise of ensuring user privacy and security, the data bank can be circulated as an asset to fully tap the value of user data, not only It can meet the actual needs of users, enable users to live a healthy life and travel intelligently, and can also promote the healthy and prosperous development of various industries.
随着智慧家庭这一概念的提出，家庭智慧化应用也在快速发展。智慧家庭是综合运用物联网、云计算、移动互联网和大数据技术，结合自动控制技术，将家庭设备智能控制、家庭环境感知、家人健康感知、家居安全感知以及信息交流、消费服务等家居生活有效地结合起来，创造出健康、安全、舒适、低碳、便捷的个性化家居生活。如今，智慧家庭远远超越了智能家居的范畴，智慧家庭包括智能家电、移动终端、出行设备等等，可以将上述设备统称为家庭设备。智慧家庭以智能控制作为智慧家庭的核心，为社会公共事业服务、社会管理、家庭能效与节能管理、商业应用服务提供了平台级的支撑，极大地便利居家生活，是未来智慧城市、智能社会的基石。With the introduction of the concept of smart home, smart home applications are also developing rapidly. Smart home is a comprehensive use of Internet of Things, cloud computing, mobile Internet and big data technologies, combined with automatic control technology, to effectively control household equipment intelligent control, family environment perception, family health perception, home safety perception, information exchange, consumer services, etc. Combined with each other to create a healthy, safe, comfortable, low-carbon and convenient personalized home life. Nowadays, smart home goes far beyond the scope of smart home. Smart home includes smart home appliances, mobile terminals, travel equipment, etc. These devices can be collectively referred to as home devices. Smart home takes intelligent control as the core of smart home, and provides platform-level support for social public service, social management, household energy efficiency and energy-saving management, and commercial application services, which greatly facilitates home life and is the foundation of future smart cities and smart societies. cornerstone.
在一些智慧家庭的应用场景中，一方面，用户可以通过移动终端对家庭设备进行联动控 制，例如，用户在睡觉前，可以发起用于开启“睡觉模式”的联动控制信息，进而控制家中的电灯、窗帘、电视机、音响等等影响用户睡眠质量的设备停止工作。通常联动控制信息会控制所有家庭设备，例如家庭中的其中一位成员想要睡觉，并发起用于开启“睡觉模式”的联动控制信息，则家中所有房间的电灯、窗帘、电视机、音响等等设备都会停止工作。若此时，家中还有其他成员正在洗漱、工作、学习、运动、做家务等，那么这样一种家庭设备控制方式会严重影响到其他家庭成员的生活，以及家庭成员之间的关系。另一方面，家主可以通过分享设备或者添加家庭成员的方式为其他人授予使用家庭设备的权限，但是通过分享设备的方式需要将家庭设备中的每个设备都执行分享操作，这样的授权方式过于繁琐，而仅仅通过添加成员的方式为他们授予使用家庭设备的权限，这样的授权方式虽然简化的授权操作，但是会使得添加的成员拥有使用家中所有设备的权限，这样会使得家庭成员的私有设备会被其他成员使用，进而在一定程度上影响家庭设备的安全性。In some smart home application scenarios, on the one hand, users can perform linked control of home devices through mobile terminals. For example, before going to bed, users can initiate linked control information for turning on "sleep mode" to control the lights at home. , Curtains, TV sets, stereos and other equipment that affect the user's sleep quality stop working. Usually linkage control information will control all home devices. For example, one of the members of the family wants to sleep and initiates linkage control information for turning on the "sleep mode". Equipment will stop working. If at this time, other members of the family are washing, working, studying, exercising, doing housework, etc., then such a family device control method will seriously affect the lives of other family members and the relationship between family members. On the other hand, the owner can grant others the right to use the family device by sharing the device or adding family members, but by sharing the device, each device in the family device needs to perform the sharing operation. It is cumbersome, but only granting them permission to use family devices by adding members. Although this authorization method simplifies the authorization operation, it will make the added members have the permission to use all devices in the home, which will make the private devices of family members It will be used by other members, which will affect the security of family devices to a certain extent.
在另一些智慧家庭的应用场景中，可以设置用户使用的某个家庭设备的规则，当用户打破该家庭设备的使用规则时，家庭设备会锁定，直至收到其他用户的授权后方可解锁该家庭设备以继续正常使用。例如，家中的长辈为了教育孩子，会采用上述方法来设置子女的手机、平板、电脑等家庭设备的使用时间，当子女打破该家庭设备的使用规则时，家庭设备会立即锁定，必须通过家长的向该家庭设备输入指纹、面部等信息，或者是家长通过其家庭设备向子女的家庭设备发送例如验证码等的授权信息才能解锁该家庭设备。然而，家长通常忙碌于工作可能无法及时为子女进行解锁，此时子女可能有其他必要情况使用手机；或者家长在为子女解锁的时，也会影响家长的工作进度等，进而影响家庭关系的和谐。可见，上述方法违背了创造出健康、舒适、便捷的个性化家居生活。In other smart home application scenarios, you can set the rules of a certain home device used by the user. When the user breaks the usage rules of the home device, the home device will be locked, and the family device can only be unlocked after receiving authorization from other users. The device can continue to be used normally. For example, in order to educate the children, the elders in the family will use the above method to set the usage time of the children's mobile phones, tablets, computers and other family devices. The family device can only be unlocked by inputting fingerprint, face and other information into the family device, or by sending authorization information such as a verification code to the child's family device through the parent's family device. However, parents are usually busy with work and may not be able to unlock their children in time. At this time, children may use mobile phones for other necessary situations; or when parents unlock their children, it will also affect the parents' work progress, etc., which will affect the harmony of family relationships. . Visible, above-mentioned method violates creating healthy, comfortable, convenient individualized household life.
在另一些智慧家庭的应用场景中，移动终端检测到用户离家，可以根据用户的备忘录中的日志信息，控制家庭设备进行联动，执行备忘录中对应的事件。然而，移动终端通常通过智能门锁反馈的消息，来判断用户是否离家。但有时候，用户仅仅是下楼扔个垃圾或者去便利店买个东西，很快便回家，这种情况下，若家中空调、净化器、或者厨房电器等自动断电，这样反复开关家庭设备反而更耗电。可见，上述方法违背了创造出健康、舒适、便捷的个性化家居生活。In other smart home application scenarios, the mobile terminal detects that the user is away from home, and can control the home device to perform linkage according to the log information in the user's memo, and execute the corresponding event in the memo. However, the mobile terminal usually judges whether the user leaves home through the message fed back by the smart door lock. But sometimes, users just go downstairs to throw garbage or go to a convenience store to buy something, and then go home soon. The device consumes more power instead. Visible, above-mentioned method violates creating healthy, comfortable, convenient individualized household life.
为了解决上述方法存在的技术问题，本申请实施例提供了一种家庭设备的智能控制方法，该家庭设备的智能控制方法包括以下几点：In order to solve the technical problems existing in the above method, an embodiment of the present application provides an intelligent control method for home equipment, and the intelligent control method for home equipment includes the following points:
1、家庭成员对家庭设备的控制权限。1. Family members' control authority over family devices.
一个家庭中通常包含多位成员，这些家庭成员在家庭关系中担任的角色、以及在家庭环境中经常活动的空间等等通常不同。具体的，家庭成员在家庭关系中的角色包括：爸爸妈妈、爷爷奶奶、儿女、家政服务人员、家庭教师、私人教练等家庭访客等等。通常一个家庭中的爸爸妈妈为一家之主，负责家庭中较多的事务；爷爷奶奶通常年龄较大、行动不便；儿女通常是处于正在接受教育的孩童。家庭成员在家庭环境中常活动空间具体可以分为：爸爸妈妈住在卧室A，爷爷奶奶住在卧室B，儿女住在卧室C，爷爷奶奶或者爸爸妈妈经常活动的其他空间还可能有厨房，而爸爸妈妈和儿女经常活动的空间还可能有书房，而其他公共空间，例如客厅、餐厅、卫生间(非卧室内的卫生间)、娱乐室、健身房等可能是全部成员常活动的空间。A family usually includes multiple members, and these family members usually have different roles in the family relationship, and the space for frequent activities in the family environment, etc. Specifically, the roles of family members in the family relationship include: parents, grandparents, children, domestic service personnel, tutors, personal trainers and other family visitors. Usually the parents in a family are the head of the family and are responsible for more affairs in the family; grandparents are usually older and have limited mobility; children are usually children who are receiving education. The common activity space of family members in the family environment can be specifically divided into: parents live in bedroom A, grandparents live in bedroom B, children live in bedroom C, grandparents or other spaces where parents often move may also have a kitchen, and father and grandma live in bedroom B. There may also be a study room in the frequent activity space of mothers and children, and other public spaces, such as living room, dining room, bathroom (not the bathroom in the bedroom), entertainment room, gymnasium, etc., may be the space where all members often move.
相应的，部署在家庭中不同空间的家庭设备应该受该空间的主人来控制，并非所有家庭成员都有权限去控制家中所有家庭设备的。然而，在一些家庭成员对家庭设备的控制权限设置方式中，一个家庭中的爸爸妈妈作为一家之主，应该具有最高权限。也就是说，家主除了有权控制属于本人空间中的家庭设备以外，还有权控制其他家庭成员例如属于儿女的空间中的家庭设备，即有权控制所有家庭设备。这样才能创造出和谐的家庭，所谓和谐是指家庭成员都有一定相对的权限来控制家庭设备，而一家之主又具有绝对的权限来控制家庭设备，这种相对和绝对的统一恰恰能提高家庭设备的安全性、保护家庭成员的个人习惯或者是个人隐私等。Correspondingly, home devices deployed in different spaces in the home should be controlled by the owner of the space, and not all family members have the authority to control all home devices in the home. However, in some family members' control authority settings for family equipment, the parents in a family, as the head of the family, should have the highest authority. That is to say, in addition to having the right to control the family devices in the own space, the home owner also has the right to control the family devices in the spaces of other family members such as children, that is, has the right to control all the family devices. Only in this way can we create a harmonious family. The so-called harmony means that family members have certain relative authority to control the family equipment, and the head of the family has absolute authority to control the family equipment. This kind of relative and absolute unity can just improve the quality of the family. Device security, protection of personal habits of family members or personal privacy, etc.
因此，本申请提供了一种家庭设备的控制方法，在该方法中，移动终端可以根据用户在家庭关系中担任的角色、用户在家庭空间中的空间等因素，设置用户控制家庭设备的权限。之后，移动终端接收到用户用于控制家庭设备的操作，识别用户身份并根据用户身份所对应的权限，控制家庭设备执行对应的功能。Therefore, the present application provides a method for controlling home devices. In this method, the mobile terminal can set the user's authority to control the home device according to the user's role in the family relationship, the user's space in the home space, and other factors. Afterwards, the mobile terminal receives the user's operation for controlling the home device, identifies the user identity, and controls the home device to perform the corresponding function according to the authority corresponding to the user identity.
2、家庭成员对其他成员使用家庭设备规则的控制方法。2. A method for controlling family members' use of family device rules by other members.
在该家庭设备的控制方法，用户可以根据对子女的教育计划来设置家庭设备的使用规则，若子女打破该规则，则必须在对应的家庭设备中完成制定的任务，以此来达到对子女的教育。In the control method of the family equipment, the user can set the use rules of the family equipment according to the education plan for the children. If the children break the rules, they must complete the specified tasks in the corresponding family equipment, so as to achieve the children's education. educate.
上述使用规则可以是父母在自己的移动终端中远程设置子女的移动终端的使用规则，也可以在子女的移动终端中直接设置使用规则，本申请实施例对此不作限制。The above use rules may be that the parents set the use rules of the children's mobile terminals remotely in their own mobile terminals, or directly set the use rules in the children's mobile terminals, which is not limited in this embodiment of the present application.
上述任务可以通过被设置使用权限的移动终端或者家中的其他家庭设备来完成。例如，父母将孩子的移动终端的使用规则设置为每天使用时长为4小时，设置打破规则后的解锁任务为学习1小时并且运动1小时。当移动终端检测到小孩打破上述规则后，移动终端的可能会锁屏或者锁定部分功能，直至移动终端检测到孩子使用该移动终端完成上述任务，或者移动终端接收到孩子使用其他家庭设备例如跑步机完成1小时的运动任务的相关数据，以及接收到孩子使用其他家庭设备例如学习机完成1小时的学习任务的相关数据后，移动终端才会解除屏幕锁定，或者解除部分功能的锁定。具体可以参考后文的详细描述，在此暂不赘述。The above tasks can be accomplished through the mobile terminal or other family devices at home that are set to use permissions. For example, parents set the use rule of the child's mobile terminal to be 4 hours a day, and set the unlocking task after breaking the rule to study for 1 hour and exercise for 1 hour. When the mobile terminal detects that the child breaks the above rules, the mobile terminal may lock the screen or lock some functions until the mobile terminal detects that the child uses the mobile terminal to complete the above tasks, or the mobile terminal receives the child's use of other family equipment such as a treadmill. The mobile terminal will unlock the screen or unlock some functions after completing the relevant data of the 1-hour exercise task and receiving the relevant data of the child using other home devices such as the learning machine to complete the 1-hour learning task. For details, reference may be made to the detailed description below, and details are not repeated here.
3、根据家庭成员的状态和/或终端设备记录的事件对家庭设备的进行控制。3. Control the family device according to the status of family members and/or events recorded by the terminal device.
在该家庭设备的控制方法中，移动终端可以获取用户的状态信息，根据用户状态已用对应的智能情景模式，根据该智能情景模式设置的控制策略来控制家庭设备；例如移动终端检测到用户正在睡觉，则会应用智慧家庭APP中提供的睡觉模式，根据睡觉模式设置的控制策略来控制家庭设备例如关闭卧室电灯、窗帘、电视机等等。其中关于智慧家庭APP的介绍可以参考后文的详细描述，在此暂不赘述。In the control method of the home device, the mobile terminal can obtain the status information of the user, use the corresponding smart scene mode according to the user status, and control the home device according to the control policy set by the smart scene mode; for example, the mobile terminal detects that the user is When sleeping, the sleep mode provided in the smart home APP will be applied, and the home devices such as turning off the bedroom lights, curtains, TV, etc. will be controlled according to the control strategy set in the sleep mode. For the introduction of smart home APP, please refer to the detailed description later, so I won’t go into details here.
在该家庭设备的控制方法中，移动终端还可以获取应用程序中记录的事件的信息，根据检测到的应用程序中记录的事件的信息，来控制家庭设备执行上述事件对应的操作；例如检测到用户需要参加线上会议，则移动终端可以在会议开始之前控制书房电灯打开，并启动用户的计算机或者笔记本等等。In the method for controlling a home device, the mobile terminal may also obtain information about events recorded in the application program, and control the home device to perform operations corresponding to the above events according to the detected event information recorded in the application program; If the user needs to participate in an online meeting, the mobile terminal can control the lights in the study room to be turned on and start the user's computer or notebook before the meeting starts.
在该家庭设备的控制方法中，移动终端还可以在检测到用户状态和事件信息后，若该状态为指定状态，则移动终端根据检测到的事件信息控制家庭设备执行对应操作。上述指定状态和事件的关系例如可以是，根据用户状态和事件是否对用户的生活、家庭的环境的影响而设定的，例如指定状态为离家，则检测到的事件例如为备忘录中记载的携带证件，或者天气预报中记载有恶劣天气等事件时，则移动终端根据该事件提醒用户出门带好证件，以及关闭 窗户带好雨具等等。In the control method of the home device, after the mobile terminal detects the user state and event information, if the state is a specified state, the mobile terminal controls the home device to perform corresponding operations according to the detected event information. The relationship between the above-mentioned specified state and event can be, for example, set according to whether the user state and event have an impact on the user's life and family environment. When carrying certificates, or events such as bad weather are recorded in the weather forecast, the mobile terminal reminds the user to go out and take a good certificate according to the event, and close the window and take a rain gear and so on.
这样，无需用户操作便能实现智能管理、控制、使用家庭设备，从而打造出健康、安全、舒适、低碳、便捷的个性化家居生活。In this way, intelligent management, control, and use of home equipment can be realized without user operation, thereby creating a healthy, safe, comfortable, low-carbon, and convenient personalized home life.
上述用户状态包括：离家、回家、睡眠、居家学习、居家办公、居家运动、下车等等。The above user states include: leaving home, returning home, sleeping, studying at home, working at home, exercising at home, getting off the car, and so on.
上述多个应用程序可以是：事件备忘类的应用程序例如日历、闹钟、便签、备忘录等等；或者是生活服务类应用程序例如，预约或购买就医、用餐、出行、理发服务的应用程序；或者是提供公众号、小程序服务的应用程序，该公众号和小程序可以为用户提供预约或购买就医、用餐、出行、理发服务等等；或者是天气预报类应用程序，该天气预报类应用程序可以为用户提供天气预报的服务；或者是线上会议类应用程序，该线上会议类应用程序可以为用户提供安排会议的服务；或者是网课学习类应用程序，该网课学习类应用程序可以只会用户预定或者购买某项课程，然后进行线上学习。上述应用程序可以是系统应用程序，也可以是第三方应用程序。本申请实施例对此不作限制。The above-mentioned multiple applications may be: applications for event memos, such as calendars, alarm clocks, memos, memos, etc.; or applications for life services, such as applications for making appointments or purchasing medical treatment, dining, travel, and haircut services; Or it is an application that provides public account and mini-program services, which can provide users with appointment or purchase of medical treatment, meals, travel, haircut services, etc.; or a weather forecast application, the weather forecast application The program can provide users with weather forecast services; or it can be an online meeting application, which can provide users with the service of arranging meetings; The program can only allow users to book or purchase a certain course, and then conduct online learning. The above-mentioned application program may be a system application program or a third-party application program. The embodiment of the present application does not limit this.
为了更加清楚、详细地介绍本申请实施例提供的提示方法，下面先介绍本申请实施例提供的通信系统。In order to introduce the prompting method provided in the embodiment of the present application more clearly and in detail, the communication system provided in the embodiment of the present application is firstly introduced below.
图1B示例性示出示了本申请实施例提供的通信系统10。FIG. 1B exemplarily shows a communication system 10 provided by an embodiment of the present application.
如图1B所示，该通信系统10可以包括多个家庭设备200，和服务器300。其中家庭设备200中包括一个或多个智能家居设备、智能家电设备、智能出行设备、以及家庭成员配备的一个或多个移动终端100。服务器300与一个或多个家庭设备200均建立通信连接。As shown in FIG. 1B , the communication system 10 may include a plurality of home devices 200 and a server 300 . The family device 200 includes one or more smart home devices, smart home appliances, smart travel devices, and one or more mobile terminals 100 equipped by family members. The server 300 establishes a communication connection with one or more home devices 200 .
移动终端100是指，用户随身携带的便携式电子设备，例如智能手机、智能手表、平板电脑、个人数字助理(personal digital assistant，PDA)、智能穿戴设备等。便携式电子设备的示例性实施例包括但不限于搭载
Figure PCTCN2022119115-appb-000003
或者其他操作系统的便携式电子设备。还应当理解的是，在本申请其他一些实施例中，移动终端100也可以是非便携式电子设备，例如汽车中安装的车载电脑、笔记本、具有触敏表面(例如触控面板)的膝上型计算机(laptop)、台式计算机等等。 The mobile terminal 100 refers to a portable electronic device carried by a user, such as a smart phone, a smart watch, a tablet computer, a personal digital assistant (personal digital assistant, PDA), a smart wearable device, and the like. Exemplary embodiments of portable electronic devices include, but are not limited to
Figure PCTCN2022119115-appb-000003
Or portable electronic devices with other operating systems. It should also be understood that, in some other embodiments of the present application, the mobile terminal 100 may also be a non-portable electronic device, such as an on-board computer installed in a car, a notebook, a laptop computer with a touch-sensitive surface (such as a touch panel) (laptop), desktop computer, etc.
在本申请一些实施例中，移动终端100安装有智慧家庭APP，并通过该APP实现对家庭设备的控制。具体的，移动终端100可以根据用户的身份以及用户在家庭中的所述空间来设置用户控制家庭设备的权限。当移动终端100检测到用户控制家庭设备的操作后，可以先识别到用户身份，判断该用户是否拥有控制该家庭设备的权限，当该设备部署在用户所属空间时，移动终端则根据用户操作执行对应的事件。具体参考后方的详细描述，本申请实施例在此不赘述。In some embodiments of the present application, the mobile terminal 100 is installed with a smart home APP, and realizes the control of home devices through the APP. Specifically, the mobile terminal 100 may set the user's authority to control the home device according to the identity of the user and the space of the user in the home. When the mobile terminal 100 detects that the user controls the operation of the home device, it can first identify the user's identity and determine whether the user has the right to control the home device. When the device is deployed in the space to which the user belongs, the mobile terminal executes the the corresponding event. For details, refer to the detailed description below, and the embodiment of the present application will not be repeated here.
在本申请另一些实施例中，用户可以设置移动终端100的使用规则，以及设置打破该规则时的解锁任务，当移动终端100检测到用户打破该规则后，移动终端100会锁定屏幕或锁定部分功能，当检测到用户完成对应解锁任务；或者接收到其他家庭设备发送的用户执行解锁任务的相关数据，并确定用户完成相关任务后，移动终端100会解除锁定。具体参考后方的详细描述，本申请实施例在此不赘述。In other embodiments of the present application, the user can set the usage rules of the mobile terminal 100, and set the unlock task when the rules are broken, and when the mobile terminal 100 detects that the user breaks the rules, the mobile terminal 100 will lock the screen or lock part of the Function, when it is detected that the user completes the corresponding unlocking task; or after receiving relevant data about the user performing the unlocking task sent by other home devices, and confirming that the user has completed the relevant task, the mobile terminal 100 will unlock. For details, refer to the detailed description below, and the embodiment of the present application will not be repeated here.
在本申请另一些实施例中，移动终端100检测到用户离家时，可以根据获取到的应用程序中记录的事件控制家庭设备执行对应操作，例如提醒用户携带物品等。此外移动终端100还可以检测用户的状态例如离家、回家、睡觉、居家学习、居家办公等，根据用户状态应用功能智慧家庭APP提供的智能情景模式。具体参考后方的详细描述，本申请实施例在此不赘述。In other embodiments of the present application, when the mobile terminal 100 detects that the user is away from home, it may control the home device to perform corresponding operations according to the acquired events recorded in the application program, such as reminding the user to carry items. In addition, the mobile terminal 100 can also detect the state of the user, such as leaving home, returning home, sleeping, studying at home, working at home, etc., and applying the smart scene mode provided by the smart home APP according to the user state. For details, refer to the detailed description below, and the embodiment of the present application will not be repeated here.
在本申请实施例中，移动终端100中可以安装应用程序(Application，App)，例如，用户可以在移动终端100中可以安装“智慧家庭”应用程序，用户可以通过“智慧家庭”应用程序与服务器300交互，以及通过服务器300对家庭设备200进行控制。In the embodiment of the present application, an application (Application, App) can be installed in the mobile terminal 100. For example, a user can install a "smart home" application in the mobile terminal 100, and the user can communicate with the server through the "smart home" application. 300, and the server 300 controls the home device 200.
可以理解的是，上述“智慧家庭”应用程序可以是电子设备安装的第三方应用程序、系统应用程序、系统服务组件，或者是无需安装便可调用的小程序等，本申请实施例对此不作限制。系统应用是指移动终端100的生产商所提供或研发的应用，第三方应用是指非该移动终端100的生产商所提供或研发的应用。移动终端100的生产商可以包括该移动终端100的制造商、供应商、提供商或运营商等。制造商可以是指以自制或采购的零件及原料来加工制造电子设备的生产厂商。供应商可以是指提供该电子设备的整机、原料或零件的厂商。运营商可以是指负责该电子设备的经销的厂商。It can be understood that the above-mentioned "smart home" application program may be a third-party application program installed on the electronic device, a system application program, a system service component, or a small program that can be called without installation, and this embodiment of the present application does not make any limit. System applications refer to applications provided or developed by the manufacturer of the mobile terminal 100 , and third-party applications refer to applications not provided or developed by the manufacturer of the mobile terminal 100 . The manufacturer of the mobile terminal 100 may include the manufacturer, supplier, provider or operator of the mobile terminal 100 . A manufacturer may refer to a manufacturer that processes and manufactures electronic equipment with self-made or purchased parts and raw materials. A supplier may refer to a manufacturer that provides the complete machine, raw materials or parts of the electronic device. An operator may refer to a manufacturer responsible for distribution of the electronic device.
此外，在本申请一些实施例中，“智慧家庭”仅仅是该应用程序可能使用的一个名称，在本申请其他一些实施例中，“智慧家庭””应用程序也可以被称为例如“智慧家居”、“智能家居”、“智慧生活”等其他名词，其名称并不能对本实施例构成任何限制。有关“智慧家庭”能够实现的功能，在下文方法实施例中已经记载，在此暂不赘述。In addition, in some embodiments of the present application, "smart home" is just a name that the application may use. In other embodiments of the present application, the application of "smart home" may also be called, for example, ", "smart home", "smart life" and other nouns, their names do not constitute any restrictions on this embodiment. The functions that can be realized by "smart home" have been recorded in the method embodiments below, and will not be repeated here .
家庭设备200是指，将微处理器、传感器技术、网络通信技术引入家庭设备后形成的家电产品。所以，当家庭设备与互联网连接后，其也就具备了社交网络的属性。所以，家庭设备还可理解为物联网家电。在本申请实施例中，家庭设备200具体可以包括：空调、电视机、投影设备、智能音响、智能门锁、智能电灯、智能窗户、智能窗帘、智能体脂称、跑步机、智能电饭煲、智能电水壶等等。The home device 200 refers to a home appliance formed by introducing microprocessor, sensor technology, and network communication technology into the home device. Therefore, when a home device is connected to the Internet, it also has the attributes of a social network. Therefore, home devices can also be understood as IoT home appliances. In this embodiment of the application, the home equipment 200 may specifically include: air conditioners, televisions, projection equipment, smart speakers, smart door locks, smart lights, smart windows, smart curtains, smart body fat scales, treadmills, smart rice cookers, smart Electric kettle and so on.
在本申请实施例中，上述家庭设备200具有自动感知功能，家庭设备200感知对象不仅包括：感知时间、温度、还能够感知用户的情感，用户的动作，用户的行为习惯等等。进而可以获取住宅空间状态和家电自身状态、家电服务状态、家庭成员状态等。之后可以根据获取到的住宅空间状态和家电自身状态、家电服务状态、家庭成员状态等执行一些智能化的操作，也就是说家庭设备设备能够实现自动控制；同时，家庭设备200作为智慧家庭的组成部分，能够与移动终端100，以及住宅内其它家电和家居、设施互联组成系统，因此家庭设备200可以接收家庭用户在住宅内或远程的通过移动终端控制指令，对家中所有家庭设备200进行联动控制。值得注意的是，家庭设备200除了根据住宅空间状态和用户状态自动设置和控制，用户可以根据自身的习惯进行个性化设置。In the embodiment of the present application, the above-mentioned home device 200 has an automatic sensing function, and the sensing objects of the home device 200 include not only sensing time and temperature, but also sensing the user's emotion, user's action, user's behavior habits and so on. Furthermore, the status of the residential space, the status of the home appliance itself, the service status of the home appliance, and the status of family members can be obtained. Afterwards, some intelligent operations can be performed according to the obtained residential space status, home appliance status, home appliance service status, family member status, etc., that is to say, the home equipment can realize automatic control; Part of it can be connected with the mobile terminal 100 and other home appliances, homes, and facilities in the house to form a system. Therefore, the home device 200 can receive control instructions from the home user in the house or remotely through the mobile terminal, and perform linkage control on all the home devices 200 in the home. . It is worth noting that, in addition to automatically setting and controlling the home device 200 according to the state of the residential space and the state of the user, the user can perform personalized settings according to his own habits.
在本申请一些实施例中，家庭设备200可以根据移动终端100发送的控制指令或者根据移动终端100通过服务器300发送的控制指令来执行对应的事件。具体参考后方的详细描述，本申请实施例在此不赘述。In some embodiments of the present application, the home device 200 may execute corresponding events according to the control instruction sent by the mobile terminal 100 or according to the control instruction sent by the mobile terminal 100 through the server 300 . For details, refer to the detailed description below, and the embodiment of the present application will not be repeated here.
在本申请另一些实施例中，家庭设备200可以将用户执行解锁任务的相关数据发送至移动终端100，以供移动终端100判断用户是否完成解锁任务。在用户采用家庭设备200执行解锁任务的过程中，家庭设备200可以对该用户进行持续性身份认证。具体参考后方的详细描述，本申请实施例在此不赘述。In some other embodiments of the present application, the home device 200 may send relevant data about the user's execution of the unlocking task to the mobile terminal 100, so that the mobile terminal 100 can determine whether the user has completed the unlocking task. When the user uses the home device 200 to perform the unlocking task, the home device 200 may perform continuous identity authentication on the user. For details, refer to the detailed description below, and the embodiment of the present application will not be repeated here.
在本申请另一些实施例中，家庭设备200可以检测用户的状态，并将检测到的用户数据发送至移动终端100，以供移动终端100判断该用户的状态。具体参考后方的详细描述，本申请实施例在此不赘述。In some other embodiments of the present application, the home device 200 may detect the user's status, and send the detected user data to the mobile terminal 100 for the mobile terminal 100 to judge the user's status. For details, refer to the detailed description below, and the embodiment of the present application will not be repeated here.
服务器300是指，比普通计算机运行更快、负载更高的计算机。服务器300具有高速的CPU运算能力、长时间的可靠运行、强大的I/O外部数据吞吐能力以及更好的扩展性。服务 器300在网络中可以为移动终端100、家庭设备200等提供计算或者应用服务。在本申请实施例中，服务器可以是但不限于，网络服务器、数据库服务器、云端服务器等。The server 300 refers to a computer that runs faster and has a higher load than ordinary computers. The server 300 has high-speed CPU computing capability, long-term reliable operation, powerful I/O external data throughput capability and better scalability. The server 300 can provide computing or application services for the mobile terminal 100, the home device 200, etc. in the network. In this embodiment of the application, the server may be, but not limited to, a web server, a database server, a cloud server, and the like.
图2A-图2B，图3，图4分别示例性示出示了通信系统10中涉及的各个设备及服务器的软硬件架构。2A-2B , FIG. 3 , and FIG. 4 exemplarily show the software and hardware architectures of various devices and servers involved in the communication system 10 .
参考图2A，图2A示例性示出了移动终端100的硬件结构。Referring to FIG. 2A , FIG. 2A schematically shows the hardware structure of the mobile terminal 100 .
移动终端100可以包括：处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A，陀螺仪传感器180B，气压传感器180C，磁传感器180D，加速度传感器180E，距离传感器180F，接近光传感器180G，指纹传感器180H，温度传感器180J，触摸传感器180K，环境光传感器180L，骨传导传感器180M等。The mobile terminal 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2. Mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, And a subscriber identification module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.
可以理解的是，本申请实施例示意的结构并不构成对移动终端100的具体限定。在本申请另一些实施例中，移动终端100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the mobile terminal 100 . In other embodiments of the present application, the mobile terminal 100 may include more or fewer components than shown in the illustration, or combine some components, or separate some components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
其中，控制器可以是移动终端100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。Wherein, the controller may be the nerve center and command center of the mobile terminal 100 . The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了系统的效率。A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
在一些实施例中，处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口等。In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.
在本申请一些实施例中，处理器110可以检测用户身份，根据用户身份确定该用户所对应的家庭设备的控制权限。若该用户拥有控制某个家庭设备的权限，则处理器110可以调用移动通信模块150或无线通信模块160通过服务器300向对应的家庭设备发送控制指令，或者处理器110可以调用无线通信模块160直接向对应的家庭设备发送控制指令。此外，处理 器110还可以调用显示显示屏194来显示该家庭设备的状态信息。具体可参见后文的方法实施例及UI实施例的相关描述，在此暂不赘述。In some embodiments of the present application, the processor 110 may detect the identity of the user, and determine the control authority of the home device corresponding to the user according to the identity of the user. If the user has the right to control a certain home device, the processor 110 can call the mobile communication module 150 or the wireless communication module 160 to send a control command to the corresponding home device through the server 300, or the processor 110 can call the wireless communication module 160 to directly Send a control command to the corresponding home device. In addition, the processor 110 can also call the display screen 194 to display the status information of the household device. For details, refer to the related descriptions of the method embodiment and the UI embodiment later, and details are not described here.
在本申请另一些实施例中，处理器110根据设置的移动终端100的使用规则，检测用户是否打破该使用规则，若用户打破该使用规则，则处理器可以控制移动终端100锁定，或者控制移动终端100锁定部分功能。此外，处理器110还可以调用显示显示屏194来显示解锁该移动终端100的提示信息。具体可参见后文的方法实施例及UI实施例的相关描述，在此暂不赘述。In other embodiments of the present application, the processor 110 detects whether the user breaks the usage rules according to the set usage rules of the mobile terminal 100, and if the user breaks the usage rules, the processor can control the mobile terminal 100 to lock, or control the movement The terminal 100 locks some functions. In addition, the processor 110 may also invoke the display screen 194 to display prompt information for unlocking the mobile terminal 100 . For details, refer to the related descriptions of the method embodiment and the UI embodiment later, and details are not described here.
在本申请另一些实施例中，处理器110可以调用“智慧家庭”应用程序获取应用程序张工记录的用户日程相关数据，并将日程相关数据发送至服务器300，服务器300用于根据所述获取的日程相关数据确定用户的日程安排，并根据用户的日程安排设定一个或多个家庭设备的控制规则。或者处理器110可以根据所述获取的日程相关数据在本端确定用户的日程安排，并根据用户的日程安排设定一个或多个家庭设备的控制规则。In some other embodiments of the present application, the processor 110 may call the "smart home" application program to obtain the user's schedule-related data recorded by Zhang Gong of the application program, and send the schedule-related data to the server 300, and the server 300 is used to obtain determine the user's schedule, and set control rules for one or more home devices according to the user's schedule. Or the processor 110 may locally determine the user's schedule according to the acquired schedule-related data, and set control rules for one or more home devices according to the user's schedule.
I2C接口是一种双向同步串行总线，包括一根串行数据线(serial data line，SDA)和一根串行时钟线(derail clock line，SCL)。在一些实施例中，处理器110可以包含多组I2C总线。处理器110可以通过不同的I2C总线接口分别耦合触摸传感器180K，充电器，闪光灯，摄像头193等。例如：处理器110可以通过I2C接口耦合触摸传感器180K，使处理器110与触摸传感器180K通过I2C总线接口通信，实现移动终端100的触摸功能。The I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 can be respectively coupled to the touch sensor 180K, the charger, the flashlight, the camera 193 and the like through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the mobile terminal 100 .
I2S接口可以用于音频通信。在一些实施例中，处理器110可以包含多组I2S总线。处理器110可以通过I2S总线与音频模块170耦合，实现处理器110与音频模块170之间的通信。在一些实施例中，音频模块170可以通过I2S接口向无线通信模块160传递音频信号，实现通过蓝牙耳机接听电话的功能。The I2S interface can be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170 . In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.
PCM接口也可以用于音频通信，将模拟信号抽样，量化和编码。在一些实施例中，音频模块170与无线通信模块160可以通过PCM总线接口耦合。在一些实施例中，音频模块170也可以通过PCM接口向无线通信模块160传递音频信号，实现通过蓝牙耳机接听电话的功能。所述I2S接口和所述PCM接口都可以用于音频通信。The PCM interface can also be used for audio communication, sampling, quantizing and encoding the analog signal. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
UART接口是一种通用串行数据总线，用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中，UART接口通常被用于连接处理器110与无线通信模块160。例如：处理器110通过UART接口与无线通信模块160中的蓝牙模块通信，实现蓝牙功能。在一些实施例中，音频模块170可以通过UART接口向无线通信模块160传递音频信号，实现通过蓝牙耳机播放音乐的功能。The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 and the wireless communication module 160 . For example: the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.
MIPI接口可以被用于连接处理器110与显示屏194，摄像头193等外围器件。MIPI接口包括摄像头串行接口(camera serial interface，CSI)，显示屏串行接口(display serial interface，DSI)等。在一些实施例中，处理器110和摄像头193通过CSI接口通信，实现移动终端100的拍摄功能。处理器110和显示屏194通过DSI接口通信，实现移动终端100的显示功能。The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 . MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc. In some embodiments, the processor 110 communicates with the camera 193 through the CSI interface to realize the shooting function of the mobile terminal 100 . The processor 110 communicates with the display screen 194 through the DSI interface to realize the display function of the mobile terminal 100 .
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号，也可被配置为数据信号。在一些实施例中，GPIO接口可以用于连接处理器110与摄像头193，显示屏194，无线通信模块160，音频模块170，传感器模块180等。GPIO接口还可以被配置为I2C接口，I2S接口，UART接口，MIPI接口等。The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193 , the display screen 194 , the wireless communication module 160 , the audio module 170 , the sensor module 180 and so on. The GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc.
USB接口130是符合USB标准规范的接口，具体可以是Mini USB接口，Micro USB接口，USB Type C接口等。USB接口130可以用于连接充电器为移动终端100充电，也可以用 于移动终端100与外围设备之间传输数据。也可以用于连接耳机，通过耳机播放音频。该接口还可以用于连接其他电子设备，例如AR设备等。The USB interface 130 is an interface conforming to the USB standard specification, specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the mobile terminal 100, and can also be used to transmit data between the mobile terminal 100 and peripheral devices. It can also be used to connect headphones and play audio through them. This interface can also be used to connect other electronic devices, such as AR devices.
可以理解的是，本申请实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对移动终端100的结构限定。在本申请另一些实施例中，移动终端100也可以采用上述实施例中不同的接口连接方式，或多种接口连接方式的组合。It can be understood that the interface connection relationship between the modules shown in the embodiment of the present application is only a schematic illustration, and does not constitute a structural limitation of the mobile terminal 100 . In some other embodiments of the present application, the mobile terminal 100 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.
充电管理模块140用于从充电器接收充电输入。其中，充电器可以是无线充电器，也可以是有线充电器。在一些有线充电的实施例中，充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中，充电管理模块140可以通过移动终端100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时，还可以通过电源管理模块141为移动终端100供电。The charging management module 140 is configured to receive a charging input from a charger. Wherein, the charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger through the USB interface 130 . In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through the wireless charging coil of the mobile terminal 100 . While the charging management module 140 is charging the battery 142 , it can also supply power to the mobile terminal 100 through the power management module 141 .
电源管理模块141用于连接电池142，充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入，为处理器110，内部存储器121，外部存储器，显示屏194，摄像头193，和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量，电池循环次数，电池健康状态(漏电，阻抗)等参数。在其他一些实施例中，电源管理模块141也可以设置于处理器110中。在另一些实施例中，电源管理模块141和充电管理模块140也可以设置于同一个器件中。The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 . The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 may also be disposed in the processor 110 . In some other embodiments, the power management module 141 and the charging management module 140 may also be set in the same device.
移动终端100的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。The wireless communication function of the mobile terminal 100 can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
天线1和天线2用于发射和接收电磁波信号。移动终端100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。 Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in mobile terminal 100 can be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
移动通信模块150可以提供应用在移动终端100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块150可以由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大，经天线1转为电磁波辐射出去。在一些实施例中，移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中，移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the mobile terminal 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.
调制解调处理器可以包括调制器和解调器。其中，调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后，被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A，受话器170B等)输出声音信号，或通过显示屏194显示图像或视频。在一些实施例中，调制解调处理器可以是独立的器件。在另一些实施例中，调制解调处理器可以独立于处理器110，与移动通信模块150或其他功能模块设置在同一个器件中。A modem processor may include a modulator and a demodulator. Wherein, the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is passed to the application processor after being processed by the baseband processor. The application processor outputs sound signals through audio equipment (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194 . In some embodiments, the modem processor may be a stand-alone device. In some other embodiments, the modem processor may be independent from the processor 110, and be set in the same device as the mobile communication module 150 or other functional modules.
无线通信模块160可以提供应用在移动终端100上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波，将电磁波信号解调以及滤波处理，将处理后的信号发送到处 理器110。无线通信模块160还可以从处理器110接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。The wireless communication module 160 can provide applications on the mobile terminal 100 including wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
在一些实施例中，移动终端100的天线1和移动通信模块150耦合，天线2和无线通信模块160耦合，使得移动终端100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications，GSM)，通用分组无线服务(general packet radio service，GPRS)，码分多址接入(code division multiple access，CDMA)，宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)，BT，GNSS，WLAN，NFC，FM，和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system，GPS)，全球导航卫星系统(global navigation satellite system，GLONASS)，北斗卫星导航系统(beidou navigation satellite system，BDS)，准天顶卫星系统(quasi-zenith satellite system，QZSS)和/或星基增强系统(satellite based augmentation systems，SBAS)。In some embodiments, the antenna 1 of the mobile terminal 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the mobile terminal 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc. The GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
在本申请一些实施例中，移动终端100可以通过移动通信模块150、无线通信模块160，与服务器300建立通信连接，进而向服务器300请求服务，服务器响应于该请求，可以控制家庭设备200。在本申请另一些实施例中移动终端100可以通过无线通信模块160与家庭设备200建立通信连接，基于该通信连接来控制家庭设备200。In some embodiments of the present application, the mobile terminal 100 can establish a communication connection with the server 300 through the mobile communication module 150 and the wireless communication module 160, and then request a service from the server 300, and the server can control the home device 200 in response to the request. In other embodiments of the present application, the mobile terminal 100 may establish a communication connection with the home device 200 through the wireless communication module 160, and control the home device 200 based on the communication connection.
移动终端100通过GPU，显示屏194，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏194和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器110可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。The mobile terminal 100 realizes the display function through the GPU, the display screen 194 , and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
显示屏194用于显示图像，视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，移动终端100可以包括1个或N个显示屏194，N为大于1的正整数。The display screen 194 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments, the mobile terminal 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
在本申请实施例中，显示屏194可以显示有“智慧家庭”应用程序提供的家庭设备200的服务状态、家庭成员的信息、住宅空间状态等等，具体可参见后文方法实施例及UI实施例的相关描述。In the embodiment of the present application, the display screen 194 can display the service status of the home device 200 provided by the "Smart Home" application program, the information of family members, the status of the residential space, etc., for details, please refer to the following method embodiments and UI implementation Description of the example.
在本申请一些实施例中，显示屏194中还安置有指纹传感器180H，又称屏下指纹。具体的，当电子设备开启指纹识别后，显示屏194中指纹采集区域会发射光线穿透显示面板，照亮用户的指纹纹理，指纹反射光线穿透面板返回图像传感器中，最终形成指纹图像来进行识别。In some embodiments of the present application, a fingerprint sensor 180H is further arranged in the display screen 194 , also known as an under-screen fingerprint. Specifically, when the electronic device turns on fingerprint identification, the fingerprint collection area in the display screen 194 will emit light through the display panel to illuminate the user's fingerprint texture, and the reflected light from the fingerprint will pass through the panel and return to the image sensor, finally forming a fingerprint image for processing. identify.
在本申请另一些实施例中，显示屏194可用于显示提示信息，用以提示用户身份认证成功、身份认证失败等。可选的，当电子设备提示用户身份认证失败之后，还会提示用户采用下一种认证方式进行身份认证，关于显示屏194显示的提示信息具体可以参考后文UI实施例的相关描述，在此暂不赘述。In some other embodiments of the present application, the display screen 194 may be used to display prompt information to prompt the user that the identity authentication is successful or that the identity authentication fails. Optionally, after the electronic device prompts the user that the identity authentication fails, it will also prompt the user to adopt the next authentication method for identity authentication. For the prompt information displayed on the display screen 194, please refer to the relevant description of the UI embodiment later. I won't go into details for now.
移动终端100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。The mobile terminal 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.
ISP用于处理摄像头193反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将所述电信号传递给ISP处理， 转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头193中。The ISP is used for processing the data fed back by the camera 193 . For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be located in the camera 193 .
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。在一些实施例中，移动终端100可以包括1个或N个摄像头193，N为大于1的正整数。Camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other image signals. In some embodiments, the mobile terminal 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
在本申请一些实施例中，摄像头193可用于采集用户脸部图像，以供移动终端100进行人脸识别。In some embodiments of the present application, the camera 193 may be used to collect user facial images for the mobile terminal 100 to perform face recognition.
在本申请一些实施例中，摄像头193可用于采集用户所处环境图像，以供移动终端100判断用户状态，例如正在驾驶、运动以及做家务等等。In some embodiments of the present application, the camera 193 may be used to collect images of the user's environment for the mobile terminal 100 to determine the user's status, such as driving, exercising, and doing housework.
在本申请实施例中，摄像头193可以用于捕获二维码图片，之后移动终端100的”智慧家庭”应用程序可以识别该二维码对应的信息，例如该二维码所属公共场所的标识、名称等。In this embodiment of the application, the camera 193 can be used to capture the picture of the two-dimensional code, and then the "smart home" application program of the mobile terminal 100 can recognize the information corresponding to the two-dimensional code, such as the identification of the public place to which the two-dimensional code belongs, name etc.
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。例如，当移动终端100在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the mobile terminal 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
视频编解码器用于对数字视频压缩或解压缩。移动终端100可以支持一种或多种视频编解码器。这样，移动终端100可以播放或录制多种编码格式的视频，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。Video codecs are used to compress or decompress digital video. The mobile terminal 100 may support one or more video codecs. In this way, the mobile terminal 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
NPU为神经网络(neural-network，NN)计算处理器，通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现移动终端100的智能认知等应用，例如：图像识别，人脸识别，语音识别，文本理解等。The NPU is a neural-network (NN) computing processor. By referring to the structure of biological neural networks, such as the transfer mode between neurons in the human brain, it can quickly process input information and continuously learn by itself. Applications such as intelligent cognition of the mobile terminal 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
内部存储器121可以包括一个或多个随机存取存储器(random access memory，RAM)和一个或多个非易失性存储器(non-volatile memory，NVM)。在本申请实施例中，NVM可以存储用户到达过的区域的信息和在该区域的滞留时间。The internal memory 121 may include one or more random access memories (random access memory, RAM) and one or more non-volatile memories (non-volatile memory, NVM). In the embodiment of the present application, the NVM can store the information of the area the user has visited and the time spent in the area.
随机存取存储器可以包括静态随机存储器(static random-access memory，SRAM)、动态随机存储器(dynamic random access memory，DRAM)、同步动态随机存储器(synchronous dynamic random access memory,SDRAM)、双倍资料率同步动态随机存取存储器(double data rate synchronous dynamic random access memory,DDR SDRAM，例如第五代DDR SDRAM一般称为DDR5SDRAM)等；Random access memory can include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (synchronous dynamic random access memory, SDRAM), double data rate synchronous Dynamic random access memory (double data rate synchronous dynamic random access memory, DDR SDRAM, such as the fifth generation DDR SDRAM is generally called DDR5SDRAM), etc.;
非易失性存储器可以包括磁盘存储器件、快闪存储器(flash memory)。Non-volatile memory may include magnetic disk storage devices, flash memory (flash memory).
快闪存储器按照运作原理划分可以包括NOR FLASH、NAND FLASH、3D NAND FLASH等，按照存储单元电位阶数划分可以包括单阶存储单元(single-level cell,SLC)、多阶存储单元(multi-level cell,MLC)、三阶储存单元(triple-level cell,TLC)、四阶储存单元(quad-level cell,QLC)等，按照存储规范划分可以包括通用闪存存储(英文：universal flash storage，UFS)、嵌入式多媒体存储卡(embedded multi media Card，eMMC)等。According to the operating principle, flash memory can include NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. According to the potential order of storage cells, it can include single-level storage cells (single-level cell, SLC), multi-level storage cells (multi-level cell, MLC), triple-level cell (TLC), quad-level cell (QLC), etc., can include universal flash storage (English: universal flash storage, UFS) according to storage specifications , embedded multimedia memory card (embedded multi media Card, eMMC), etc.
随机存取存储器可以由处理器110直接进行读写，可以用于存储操作系统或其他正在运行中的程序的可执行程序(例如机器指令)，还可以用于存储用户及应用程序的数据等。The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of an operating system or other running programs, and can also be used to store data of users and application programs.
非易失性存储器也可以存储可执行程序和存储用户及应用程序的数据等，可以提前加载到随机存取存储器中，用于处理器110直接进行读写。The non-volatile memory can also store executable programs and data of users and application programs, etc., and can be loaded into the random access memory in advance for the processor 110 to directly read and write.
外部存储器接口120可以用于连接外部的非易失性存储器，实现扩展移动终端100的存储能力。外部的非易失性存储器通过外部存储器接口120与处理器110通信，实现数据存储功能。例如将音乐，视频等文件保存在外部的非易失性存储器中。The external memory interface 120 can be used to connect an external non-volatile memory, so as to expand the storage capacity of the mobile terminal 100 . The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and video are stored in an external non-volatile memory.
在本申请一些实施例中，上述存储器还用于存储家庭设备的信息，例如家庭设备的通信标识；用户的身份信息，例如用户的“智慧家庭”登陆账号及密码、用户的面部信息、指纹信息、声纹信息、虹膜信息等等；以及关联存储用户的身份信息与权限信息，例如：用户A拥有的权限为所有家庭设备、用户B拥有的权限为家中卧室B和书房中的设备。In some embodiments of the present application, the above-mentioned memory is also used to store the information of the home device, such as the communication identification of the home device; the user's identity information, such as the user's "smart home" login account and password, the user's facial information, fingerprint information , voiceprint information, iris information, etc.; and associated storage of user identity information and permission information, for example: user A has permission for all home devices, and user B has permission for devices in bedroom B and study at home.
在本申请另一些实施例中，上述存储器还用于存储移动终端100的使用规则，该使用规则可以由移动终端100默认设置，也可以由用户自定义。该使用规则例如可以是：规定每天使用该移动终端100的总时长、每天使用次数、每次使用时间，或者是规定每天使用该移动终端100中安装的某个或者某类应用程序的总时长、每天使用次数、每次使用时间等等。In some other embodiments of the present application, the above-mentioned memory is also used to store usage rules of the mobile terminal 100, and the usage rules can be set by default by the mobile terminal 100, or can be customized by the user. The use rule may be, for example: specifying the total time of daily use of the mobile terminal 100, the number of daily uses, and the time of each use, or specifying the total time of daily use of a certain or a certain type of application program installed in the mobile terminal 100, The number of uses per day, the time of each use, etc.
在本申请另一些实施例中，上述存储器还用于存储用户日程相关数据，所述用户日程相关数据至少包括以下之一：社交记录、短信、通话记录、邮件、电子便签、备忘录等等。In some other embodiments of the present application, the memory is further used to store user schedule-related data, and the user schedule-related data includes at least one of the following: social records, short messages, call records, emails, electronic notes, memos, and the like.
移动终端100可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。The mobile terminal 100 can implement audio functions through an audio module 170 , a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor. Such as music playback, recording, etc.
音频模块170用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中，音频模块170可以设置于处理器110中，或将音频模块170的部分功能模块设置于处理器110中。The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .
扬声器170A，也称“喇叭”，用于将音频电信号转换为声音信号。移动终端100可以通过扬声器170A收听音乐，或收听免提通话。Speaker 170A, also referred to as a "horn", is used to convert audio electrical signals into sound signals. The mobile terminal 100 can listen to music through the speaker 170A, or listen to a hands-free call.
受话器170B，也称“听筒”，用于将音频电信号转换成声音信号。当移动终端100接听电话或语音信息时，可以通过将受话器170B靠近人耳接听语音。 Receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the mobile terminal 100 receives a call or a voice message, the receiver 170B can be placed close to the human ear to listen to the voice.
麦克风170C，也称“话筒”，“传声器”，用于将声音信号转换为电信号。当拨打电话或发送语音信息时，用户可以通过人嘴靠近麦克风170C发声，将声音信号输入到麦克风170C。移动终端100可以设置至少一个麦克风170C。在另一些实施例中，移动终端100可以设置两个麦克风170C，除了采集声音信号，还可以实现降噪功能。在另一些实施例中，移动终端100还可以设置三个，四个或更多麦克风170C，实现采集声音信号，降噪，还可以识别声音来源，实现定向录音功能等。The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can put his mouth close to the microphone 170C to make a sound, and input the sound signal to the microphone 170C. The mobile terminal 100 may be provided with at least one microphone 170C. In some other embodiments, the mobile terminal 100 may be provided with two microphones 170C, which may also implement a noise reduction function in addition to collecting sound signals. In some other embodiments, the mobile terminal 100 can also be provided with three, four or more microphones 170C, to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions, etc.
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130，也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform，OMTP)标准接口，美国蜂窝电信工业协会(cellular telecommunications industry association of the USA，CTIA)标准接口。The earphone interface 170D is used for connecting wired earphones. The earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
在本申请一些实施例中，移动终端100可以通过上述音频模块170为用户提供声纹认证，例如通过扬声器170A/受话器170B提示用户输入声音信号，然后通过麦克风170C采集用户输入的声音信号，用于处理器根据该声音信号与预先存储的声音信号进行匹配，进而确定声纹认证是否通过。In some embodiments of the present application, the mobile terminal 100 can provide voiceprint authentication for the user through the above-mentioned audio module 170, such as prompting the user to input a voice signal through the speaker 170A/receiver 170B, and then collecting the voice signal input by the user through the microphone 170C for use in The processor matches the sound signal with the pre-stored sound signal, and then determines whether the voiceprint authentication is passed.
在本申请另一些实施例中，音频模块170用于输出“智慧家庭”中绑定的家庭设备的运行状态的语音信息。In some other embodiments of the present application, the audio module 170 is configured to output voice information of the operating status of the bound home devices in the "smart home".
在本申请另一些实施例中，音频模块170还用于输出打破移动终端100使用规则的提示信息。以及当用户离家时，输出待办事项的语音提示信息等等。In some other embodiments of the present application, the audio module 170 is further configured to output prompt information for breaking the usage rules of the mobile terminal 100 . And when the user leaves home, output the voice prompt information of the to-do list and so on.
压力传感器180A用于感受压力信号，可以将压力信号转换成电信号。在一些实施例中， 压力传感器180A可以设置于显示屏194。压力传感器180A的种类很多，如电阻式压力传感器，电感式压力传感器，电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器180A，电极之间的电容改变。移动终端100根据电容的变化确定压力的强度。当有触摸操作作用于显示屏194，移动终端100根据压力传感器180A检测所述触摸操作强度。移动终端100也可以根据压力传感器180A的检测信号计算触摸的位置。在一些实施例中，作用于相同触摸位置，但不同触摸操作强度的触摸操作，可以对应不同的操作指令。例如：当有触摸操作强度小于第一压力阈值的触摸操作作用于短消息应用图标时，执行查看短消息的指令。当有触摸操作强度大于或等于第一压力阈值的触摸操作作用于短消息应用图标时，执行新建短消息的指令。The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be located on the display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may be comprised of at least two parallel plates with conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The mobile terminal 100 determines the intensity of pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the mobile terminal 100 detects the intensity of the touch operation according to the pressure sensor 180A. The mobile terminal 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view short messages is executed. When a touch operation whose intensity is greater than or equal to the first pressure threshold acts on the icon of the short message application, the instruction of creating a new short message is executed.
在本申请实施例中，压力传感器180A可用于采集用户作用于按键或者显示屏中的压力数据，移动终端100可以根据用户以往的操作习惯进行身份认证。In the embodiment of the present application, the pressure sensor 180A can be used to collect pressure data that the user acts on the keys or the display screen, and the mobile terminal 100 can perform identity authentication according to the user's past operating habits.
陀螺仪传感器180B可以用于确定移动终端100的运动姿态。在一些实施例中，可以通过陀螺仪传感器180B确定移动终端100围绕三个轴(即，x，y和z轴)的角速度。陀螺仪传感器180B可以用于拍摄防抖。示例性的，当按下快门，陀螺仪传感器180B检测移动终端100抖动的角度，根据角度计算出镜头模组需要补偿的距离，让镜头通过反向运动抵消移动终端100的抖动，实现防抖。陀螺仪传感器180B还可以用于导航，体感游戏场景。The gyro sensor 180B can be used to determine the motion posture of the mobile terminal 100 . In some embodiments, the angular velocity of the mobile terminal 100 around three axes (ie, x, y and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 180B detects the shaking angle of the mobile terminal 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to counteract the shaking of the mobile terminal 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.
气压传感器180C用于测量气压。在一些实施例中，移动终端100通过气压传感器180C测得的气压值计算海拔高度，辅助定位和导航。The air pressure sensor 180C is used to measure air pressure. In some embodiments, the mobile terminal 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
磁传感器180D包括霍尔传感器。移动终端100可以利用磁传感器180D检测翻盖皮套的开合。在一些实施例中，当移动终端100是翻盖机时，移动终端100可以根据磁传感器180D检测翻盖的开合。进而根据检测到的皮套的开合状态或翻盖的开合状态，设置翻盖自动解锁等特性。The magnetic sensor 180D includes a Hall sensor. The mobile terminal 100 may detect opening and closing of the flip holster using the magnetic sensor 180D. In some embodiments, when the mobile terminal 100 is a clamshell machine, the mobile terminal 100 can detect the opening and closing of the clamshell according to the magnetic sensor 180D. Furthermore, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, features such as automatic unlocking of the flip cover are set.
加速度传感器180E可检测移动终端100在各个方向上(一般为三轴)加速度的大小。当移动终端100静止时可检测出重力的大小及方向。还可以用于识别电子设备姿态，应用于横竖屏切换，计步器等应用。The acceleration sensor 180E can detect the acceleration of the mobile terminal 100 in various directions (generally three axes). The magnitude and direction of gravity can be detected when the mobile terminal 100 is stationary. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.
距离传感器180F，用于测量距离。移动终端100可以通过红外或激光测量距离。在一些实施例中，拍摄场景，移动终端100可以利用距离传感器180F测距以实现快速对焦。The distance sensor 180F is used to measure the distance. The mobile terminal 100 may measure the distance through infrared or laser. In some embodiments, when shooting a scene, the mobile terminal 100 can use the distance sensor 180F for distance measurement to achieve fast focusing.
接近光传感器180G可以包括例如发光二极管(LED)和光检测器，例如光电二极管。发光二极管可以是红外发光二极管。移动终端100通过发光二极管向外发射红外光。移动终端100使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时，可以确定移动终端100附近有物体。当检测到不充分的反射光时，移动终端100可以确定移动终端100附近没有物体。移动终端100可以利用接近光传感器180G检测用户手持移动终端100贴近耳朵通话，以便自动熄灭屏幕达到省电的目的。接近光传感器180G也可用于皮套模式，口袋模式自动解锁与锁屏。Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The light emitting diodes may be infrared light emitting diodes. The mobile terminal 100 emits infrared light outwards through the light emitting diode. The mobile terminal 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it may be determined that there is an object near the mobile terminal 100 . When insufficient reflected light is detected, the mobile terminal 100 may determine that there is no object near the mobile terminal 100 . The mobile terminal 100 can use the proximity light sensor 180G to detect that the user is holding the mobile terminal 100 close to the ear to make a call, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode, automatic unlock and lock screen in pocket mode.
指纹传感器180H用于采集指纹。移动终端100可以利用采集的指纹特性实现指纹解锁，访问应用锁，指纹拍照，指纹接听来电等。The fingerprint sensor 180H is used to collect fingerprints. The mobile terminal 100 can use the collected fingerprint features to realize fingerprint unlocking, access to the application lock, take pictures with fingerprints, answer incoming calls with fingerprints, and so on.
温度传感器180J用于检测温度。在一些实施例中，移动终端100利用温度传感器180J检测的温度，执行温度处理策略。例如，当温度传感器180J上报的温度超过阈值，移动终端100执行降低位于温度传感器180J附近的处理器的性能，以便降低功耗实施热保护。在另一些实施例中，当温度低于另一阈值时，移动终端100对电池142加热，以避免低温导致移动终端100异常关机。在其他一些实施例中，当温度低于又一阈值时，移动终端100对电池142 的输出电压执行升压，以避免低温导致的异常关机。The temperature sensor 180J is used to detect temperature. In some embodiments, the mobile terminal 100 uses the temperature detected by the temperature sensor 180J to implement a temperature handling strategy. For example, when the temperature reported by the temperature sensor 180J exceeds the threshold, the mobile terminal 100 may reduce the performance of the processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the mobile terminal 100 heats the battery 142 to prevent the mobile terminal 100 from being shut down abnormally due to the low temperature. In some other embodiments, when the temperature is lower than another threshold, the mobile terminal 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
在本申请实施例中，温度传感器180J和湿度传感器还可以检测到环境温度以及环境湿度的相关数据，以供移动终端100根据当前环境温度自动控制家庭设备。In the embodiment of the present application, the temperature sensor 180J and the humidity sensor can also detect data related to ambient temperature and ambient humidity, so that the mobile terminal 100 can automatically control household devices according to the current ambient temperature.
触摸传感器180K，也称“触控面板”。触摸传感器180K可以设置于显示屏194，由触摸传感器180K与显示屏194组成触摸屏，也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器，以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中，触摸传感器180K也可以设置于移动终端100的表面，与显示屏194所处的位置不同。Touch sensor 180K, also known as "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194 . In some other embodiments, the touch sensor 180K may also be disposed on the surface of the mobile terminal 100 , which is different from the position of the display screen 194 .
环境光传感器180L用于感知环境光亮度。移动终端100可以根据感知的环境光亮度自适应调节显示屏194亮度。环境光传感器180L也可用于拍照时自动调节白平衡。环境光传感器180L还可以与接近光传感器180G配合，检测移动终端100是否在口袋里，以防误触。The ambient light sensor 180L is used for sensing ambient light brightness. The mobile terminal 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the mobile terminal 100 is in the pocket, so as to prevent accidental touch.
在本申请实施例中，在移动终端100通过密码认证，例如字符密码认证或者图案密码认证过程中，触摸传感器180K可用于采集用户作用于显示屏中的触摸操作，确定用户输入的字符密码或者图案密码等。In the embodiment of the present application, when the mobile terminal 100 passes password authentication, such as character password authentication or pattern password authentication, the touch sensor 180K can be used to collect the user's touch operation on the display screen to determine the character password or pattern input by the user. password etc.
骨传导传感器180M可以获取振动信号。在一些实施例中，骨传导传感器180M可以获取人体声部振动骨块的振动信号。骨传导传感器180M也可以接触人体脉搏，接收血压跳动信号。在一些实施例中，骨传导传感器180M也可以设置于耳机中，结合成骨传导耳机。音频模块170可以基于所述骨传导传感器180M获取的声部振动骨块的振动信号，解析出语音信号，实现语音功能。应用处理器可以基于所述骨传导传感器180M获取的血压跳动信号解析心率信息，实现心率检测功能。The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the human pulse and receive the blood pressure beating signal. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone, combined into a bone conduction earphone. The audio module 170 can analyze the voice signal based on the vibration signal of the vibrating bone mass of the vocal part acquired by the bone conduction sensor 180M, so as to realize the voice function. The application processor can analyze the heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 180M, so as to realize the heart rate detection function.
心电传感器可用于采集用户的心电数据，进而判断用户状态，例如是否处于运动状态。The ECG sensor can be used to collect the user's ECG data, and then determine the user's state, such as whether it is in a state of exercise.
按键190包括开机键，音量键等。按键190可以是机械按键。也可以是触摸式按键。移动终端100可以接收按键输入，产生与移动终端100的用户设置以及功能控制有关的键信号输入。The keys 190 include a power key, a volume key and the like. The key 190 may be a mechanical key. It can also be a touch button. The mobile terminal 100 may receive key input and generate key signal input related to user settings and function control of the mobile terminal 100 .
马达191可以产生振动提示。马达191可以用于来电振动提示，也可以用于触摸振动反馈。例如，作用于不同应用(例如拍照，音频播放等)的触摸操作，可以对应不同的振动反馈效果。作用于显示屏194不同地区的触摸操作，马达191也可对应不同的振动反馈效果。不同的应用场景(例如：时间提醒，接收信息，闹钟，游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。The motor 191 can generate a vibrating reminder. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) may correspond to different vibration feedback effects. The motor 191 can also correspond to different vibration feedback effects for touch operations on different areas of the display screen 194 . Different application scenarios (for example: time reminder, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
指示器192可以是指示灯，可以用于指示充电状态，电量变化，也可以用于指示消息，未接来电，通知等。The indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195，或从SIM卡接口195拔出，实现和移动终端100的接触和分离。移动终端100可以支持1个或N个SIM卡接口，N为大于1的正整数。SIM卡接口195可以支持Nano SIM卡，Micro SIM卡，SIM卡等。同一个SIM卡接口195可以同时插入多张卡。所述多张卡的类型可以相同，也可以不同。SIM卡接口195也可以兼容不同类型的SIM卡。SIM卡接口195也可以兼容外部存储卡。移动终端100通过SIM卡和网络交互，实现通话以及数据通信等功能。在一些实施例中，移动终端100采用eSIM，即：嵌入式SIM卡。eSIM卡可以嵌在移动终端100中，不能和移动终端100分离。The SIM card interface 195 is used for connecting a SIM card. The SIM card can be connected and separated from the mobile terminal 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 . The mobile terminal 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards may be the same or different. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The mobile terminal 100 interacts with the network through the SIM card to implement functions such as calling and data communication. In some embodiments, the mobile terminal 100 adopts an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the mobile terminal 100 and cannot be separated from the mobile terminal 100 .
移动终端100的软件系统可以采用分层架构，事件驱动架构，微核架构，微服务架构， 或云架构。本申请实施例以分层架构的移动操作系统为例，示例性说明移动终端100的软件结构。The software system of the mobile terminal 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In this embodiment of the present application, a mobile operating system with a layered architecture is taken as an example to illustrate the software structure of the mobile terminal 100 .
参考图2B，图2B示例性示出本申请实施例的移动终端100的软件结构框图。Referring to FIG. 2B , FIG. 2B exemplarily shows a software structural block diagram of the mobile terminal 100 according to the embodiment of the present application.
分层架构将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将移动操作系统分为四层，从上至下分别为应用程序层，程序框架层/核心服务层，底层库和运行时，以及内核层。The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces. In some embodiments, the mobile operating system is divided into four layers, which are application program layer, program framework layer/core service layer, underlying library and runtime, and kernel layer from top to bottom.
应用程序层可以包括一系列应用程序包。The application layer can consist of a series of application packages.
如图2B所示，应用程序包可以包括”智慧家庭”应用程序，相机，备忘录，日历，通话，地图，导航，WLAN，蓝牙，音乐，视频，短信息等应用程序。As shown in FIG. 2B , the application package may include applications such as "smart home", camera, memo, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
在本申请实施例中，“智慧家庭”应用程序可以绑定该家庭成员，组件家庭群组，同时还可以绑定家庭设备，包括家庭成员的移动终端以及家庭设备等。用户可以通过“智慧家庭”应用程序管理并控制家庭设备，或者“智慧家庭”应用程序可以自动控制已绑定的家庭设备，并显示对应的提示信息。In the embodiment of the present application, the "smart home" application program can be bound to the family member to form a family group, and can also be bound to family devices, including family members' mobile terminals and family devices. Users can manage and control home devices through the "Smart Home" application, or the "Smart Home" application can automatically control the bound home devices and display corresponding prompt information.
程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。程序框架层包括一些预先定义的函数。The program framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application program layer. The program framework layer includes some pre-defined functions.
如图2B所示，程序框架层可以包括窗口管理器，内容提供器，视图系统，电话管理器，资源管理器，通知管理器等。As shown in FIG. 2B, the program framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。A window manager is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。Content providers are used to store and retrieve data and make it accessible to applications. Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.
视图系统包括可视控件，例如显示文字的控件，显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如，包括短信通知图标的显示界面，可以包括显示文字的视图以及显示图片的视图。The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. The view system can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
电话管理器用于提供移动终端100的通信功能。例如通话状态的管理(包括接通，挂断等)。The phone manager is used to provide a communication function of the mobile terminal 100 . For example, the management of call status (including connected, hung up, etc.).
资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
通知管理器使应用程序可以在状态栏中显示通知信息，可以用于传达告知类型的消息，可以短暂停留后自动消失，无需用户交互。比如通知管理器被用于告知下载完成，消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息，发出提示音，电子设备振动，指示灯闪烁等。The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the download completion, message reminder, etc. The notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, issuing a prompt sound, vibrating the electronic device, and flashing the indicator light, etc.
运行时可以指程序运行时所需的一切代码库、框架等。例如，对于C语言来说，运行时包括一系列C程序运行所需的函数库。对于Java语言来说，除了核心库之外，运行时还包括Java程序运行所需的虚拟机等。上述核心库可包括Java语言需要调用的功能函数。Runtime can refer to all the code libraries, frameworks, etc. required for the program to run. For example, for the C language, the runtime includes a series of function libraries required for the operation of the C program. For the Java language, in addition to the core library, the runtime also includes the virtual machine required for the Java program to run. The above-mentioned core library may include functions that need to be called by the Java language.
底层库可以包括多个功能模块。例如：表面管理器(surface manager)，媒体库(Media Libraries)，三维图形处理库(例如：OpenGL ES)，2D图形引擎(例如：SGL)等。The underlying library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
表面管理器用于对显示子系统进行管理，并且为多个应用程序提供了2D和3D图层的融合。The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
媒体库支持多种常用的音频，视频格式回放和录制，以及静态图像文件等。媒体库可以支持多种音视频编码格式，例如:MPEG4，H.264，MP3，AAC，AMR，JPG，PNG等。The media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
三维图形处理库用于实现三维图形绘图，图像渲染，合成，和图层处理等。The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
2D图形引擎是2D绘图的绘图引擎。2D graphics engine is a drawing engine for 2D drawing.
内核层是硬件和软件之间的层。内核层至少包含显示驱动，摄像头驱动，音频驱动，传感器驱动。The kernel layer is the layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.
下面结合捕获拍照场景，示例性说明移动终端100软件以及硬件的工作流程。The workflow of the software and hardware of the mobile terminal 100 will be exemplarily described below in conjunction with capturing and photographing scenes.
当触摸传感器180K接收到触摸操作，相应的硬件中断被发给内核层。内核层将触摸操作加工成原始输入事件(包括触摸坐标，触摸操作的时间戳等信息)。原始输入事件被存储在内核层。应用程序框架层从内核层获取原始输入事件，识别该输入事件所对应的控件。以该触摸操作是触摸单击操作，该单击操作所对应的控件为相机应用图标的控件为例，相机应用调用应用框架层的接口，启动相机应用，进而通过调用内核层启动摄像头驱动，通过摄像头193捕获静态图像或视频。When the touch sensor 180K receives a touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes touch operations into original input events (including touch coordinates, time stamps of touch operations, and other information). Raw input events are stored at the kernel level. The application framework layer obtains the original input event from the kernel layer, and identifies the control corresponding to the input event. Take the touch operation as a touch click operation, and the control corresponding to the click operation is the control of the camera application icon as an example. The camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer. Camera 193 captures still images or video.
在本申请实施例中，通信系统10涉及的一个或多个电子设备，例如电子设备101、电子设备102和电子设备103等，其软硬件架构与移动终端100相同，可以参考上文图2A-图2B的详细描述，本申请实施例对此不作赘述。In this embodiment of the application, one or more electronic devices involved in the communication system 10, such as the electronic device 101, the electronic device 102, and the electronic device 103, etc., have the same software and hardware architecture as the mobile terminal 100, and you can refer to the above Figure 2A- The detailed description of FIG. 2B is not repeated in this embodiment of the present application.
图3为本申请实施例提供的家庭设备200的硬件结构框图。FIG. 3 is a block diagram of a hardware structure of a home device 200 provided by an embodiment of the present application.
如图3所示，家庭设备200可包括：一个或多个处理器201、存储器202、通信接口203、发射器205、接收器206、耦合器207和天线208。这些部件可通过总线204或者其他方式连接，图3以通过总线连接为例。其中：As shown in FIG. 3 , home device 200 may include: one or more processors 201 , memory 202 , communication interface 203 , transmitter 205 , receiver 206 , coupler 207 and antenna 208 . These components can be connected through the bus 204 or in other ways, and FIG. 3 takes the connection through the bus as an example. in:
处理器201可用于读取和执行计算机可读指令。具体的，处理器201可用于调用存储于存储器202中的程序，例如本申请的实施例提供的，控制家庭设备200执行某个操作的方法，在家庭设备200侧的实现程序，并执行该程序包含的指令。 Processor 201 may be used to read and execute computer readable instructions. Specifically, the processor 201 can be used to call a program stored in the memory 202, such as the method for controlling the home device 200 to perform a certain operation provided by the embodiment of the present application, implement the program on the side of the home device 200, and execute the program Included directives.
存储器202与处理器201耦合，用于存储各种软件程序和/或多组指令。具体的，存储器202可包括高速随机存取的存储器，并且也可包括非易失性存储器，例如一个或多个磁盘存储设备、闪存设备或其他非易失性固态存储设备。The memory 202 is coupled with the processor 201 for storing various software programs and/or sets of instructions. Specifically, the memory 202 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices or other non-volatile solid-state storage devices.
存储器202可以存储操作系统(下述简称系统)，例如uCOS、VxWorks、RTLinux等嵌入式操作系统。存储器202还可以存储网络通信程序，该网络通信程序可用于与服务器300，移动终端100等进行通信。The memory 202 can store an operating system (hereinafter referred to as the system), such as uCOS, VxWorks, RTLinux and other embedded operating systems. The memory 202 can also store a network communication program, which can be used to communicate with the server 300, the mobile terminal 100 and so on.
在本申请实施例中，家庭设备200的存储器202可以存储用户的信息，例如用户的操作习惯、用户的面部信息、指纹信息、声纹信息等等。该家庭设备的信息包括家庭设备的通信标识等。之后服务器300可以根据家庭设备的通信标识，向其发送信息。例如向家庭设备发送控制指令，向移动终端反馈家庭设备的状态等等。In this embodiment of the application, the memory 202 of the home device 200 may store user information, such as the user's operating habits, user facial information, fingerprint information, voiceprint information, and the like. The information of the home device includes a communication identifier of the home device and the like. Afterwards, the server 300 may send information to the home device according to the communication identifier. For example, sending a control command to the home device, feeding back the status of the home device to the mobile terminal, and so on.
通信接口203可用于服务器300与其他通信设备，例如移动终端100、家庭设备200等进行通信。具体的，通信接口203可以是3G通信接口、长期演进(LTE)(4G)通信接口、5G通信接口、WLAN通信接口、WAN通信接口等等。不限于无线通信接口，服务器300还可以配置有有线的通信接口203来支持有线通信。The communication interface 203 can be used for the server 300 to communicate with other communication devices, such as the mobile terminal 100, the home device 200 and so on. Specifically, the communication interface 203 may be a 3G communication interface, a long-term evolution (LTE) (4G) communication interface, a 5G communication interface, a WLAN communication interface, a WAN communication interface, and the like. Not limited to the wireless communication interface, the server 300 may also be configured with a wired communication interface 203 to support wired communication.
在本申请的一些实施例中，发射器205和接收器206可看作一个无线调制解调器。发射器205可用于对处理器201输出的信号进行发射处理。接收器206可用于接收信号。在服务器300中，发射器205和接收器206的数量均可以是一个或者多个。天线208可用于将传输线中的电磁能转换成自由空间中的电磁波，或者将自由空间中的电磁波转换成传输线中的电磁能。耦合器207可用于将移动通信号分成多路，分配给多个的接收器206。可理解的，网 络设备的天线208可以实现为大规模天线阵列。In some embodiments of the present application, the transmitter 205 and receiver 206 can be regarded as a wireless modem. The transmitter 205 can be used for transmitting the signal output by the processor 201 . Receiver 206 may be used to receive signals. In the server 300, there may be one or more transmitters 205 and one or more receivers 206 . Antenna 208 may be used to convert electromagnetic energy in a transmission line to electromagnetic waves in free space, or to convert electromagnetic waves in free space to electromagnetic energy in a transmission line. The coupler 207 can be used to split the mobile communication signal into multiple paths and distribute them to multiple receivers 206 . Understandably, the antenna 208 of the network device may be implemented as a large-scale antenna array.
需要说明的，图3所示的服务器300仅仅是本申请实施例的一种实现方式，实际应用中，服务器300还可以包括更多或更少的部件，这里不作限制。It should be noted that the server 300 shown in FIG. 3 is only an implementation manner of the embodiment of the present application. In practical applications, the server 300 may include more or fewer components, which is not limited here.
图4为本申请实施例提供的服务器300的硬件结构框图。FIG. 4 is a block diagram of a hardware structure of a server 300 provided by an embodiment of the present application.
如图4所示，服务器300可包括：一个或多个处理器301、存储器302、通信接口303、发射器305、接收器306、耦合器307和天线308。这些部件可通过总线304或者其他方式连接，图4以通过总线连接为例。其中：As shown in FIG. 4 , the server 300 may include: one or more processors 301 , memory 302 , communication interface 303 , transmitter 305 , receiver 306 , coupler 307 and antenna 308 . These components may be connected via the bus 304 or in other ways, and FIG. 4 takes the connection via the bus as an example. in:
处理器301可用于读取和执行计算机可读指令。具体的，处理器301可用于调用存储于存储器302中的程序，例如本申请的实施例提供的，控制家庭设备200执行某个操作的方法，在家庭设备200侧的实现程序，并执行该程序包含的指令。 Processor 301 may be used to read and execute computer readable instructions. Specifically, the processor 301 can be used to call the program stored in the memory 302, such as the method for controlling the home device 200 to perform a certain operation provided by the embodiment of the present application, implement the program on the side of the home device 200, and execute the program Included directives.
存储器302与处理器301耦合，用于存储各种软件程序和/或多组指令。具体的，存储器302可包括高速随机存取的存储器，并且也可包括非易失性存储器，例如一个或多个磁盘存储设备、闪存设备或其他非易失性固态存储设备。The memory 302 is coupled with the processor 301 and is used for storing various software programs and/or sets of instructions. Specifically, the memory 302 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
存储器302可以存储操作系统(下述简称系统)，例如uCOS、VxWorks、RTLinux等嵌入式操作系统。存储器302还可以存储网络通信程序，该网络通信程序可用于与服务器300，移动终端100等进行通信。The memory 302 can store an operating system (hereinafter referred to as the system), such as uCOS, VxWorks, RTLinux and other embedded operating systems. The memory 302 can also store a network communication program, which can be used to communicate with the server 300, the mobile terminal 100 and so on.
在本申请一些实施例中，服务器300的存储器302中可以存储用户注册“智慧家庭”应用程序的注册信息。用户的注册信息包括用户账号、密码，以及用户的生物特征，例如指纹、面部、声纹信息等，以及用户在该家庭中的私人空间等等。当用户使用用户账号在移动终端100中登陆“智慧家庭”应用程序时，服务器300可以通过通信接口303与移动终端100建立通信连接，并基于该通信连接为移动终端100提供应用服务。服务器300的存储器302中可以存储家庭中家庭设备200的信息，该家庭设备200的信息包括：家庭设备的通信标识、家庭设备在该家庭空间中的位置信息等等。In some embodiments of the present application, the storage 302 of the server 300 may store registration information for the user to register the "smart home" application program. The user's registration information includes user account number, password, and user's biological characteristics, such as fingerprint, face, voiceprint information, etc., as well as the user's private space in the family, etc. When a user logs in the "smart home" application in the mobile terminal 100 using a user account, the server 300 can establish a communication connection with the mobile terminal 100 through the communication interface 303, and provide application services for the mobile terminal 100 based on the communication connection. The memory 302 of the server 300 may store the information of the family device 200 in the family, and the information of the family device 200 includes: the communication identification of the family device, the location information of the family device in the family space, and the like.
在本申请另一些实施例中，服务器300的存储器302中可以存储家庭设备的使用规则，该使用规则可以是服务器300默认设置，也可以是移动终端默认设置并上传至服务器300，或者还可以是用户设置，具体的用户可以直接将该使用规则写入至服务器300中，也可以是用户在移动终端100中设置，移动终端100将该使用规则上传至服务器300。本申请实施例对此不作限制。In other embodiments of the present application, the memory 302 of the server 300 may store usage rules for home devices, and the usage rules may be the default settings of the server 300, or the default settings of the mobile terminal and uploaded to the server 300, or may be User setting, the specific user can directly write the usage rules into the server 300 , or the user can set the usage rules in the mobile terminal 100 , and the mobile terminal 100 uploads the usage rules to the server 300 . The embodiment of the present application does not limit this.
上述使用规则的约束对象为可以是任意一个或多个家庭设备，该家庭设备可以是移动终端100和/或家庭设备200。具体的，上述使用规则例如可以是：对移动终端100-1每天使用总时长、每天使用次数、每次使用时长、使用功能、使用APP等的限制等等。使用功能例如可以是支付功能、删除短信、电话等社交记录的功能等，使用APP例如可以是直播类APP、游戏类APP、网络赌博类APP等等。或者还可以设置使用某个APP中的部分功能或者使用某个APP的时间、次数等等。本申请实施例对此不作限制。The restriction object of the above usage rules may be any one or more home devices, and the home devices may be the mobile terminal 100 and/or the home device 200 . Specifically, the above usage rules may be, for example: restrictions on the total daily usage time of the mobile terminal 100-1, daily usage times, each usage duration, usage functions, and APP usage restrictions. The usage function can be, for example, a payment function, the function of deleting social records such as text messages and phone calls, etc., and the usage APP can be, for example, a live broadcast APP, a game APP, an online gambling APP, and the like. Or you can also set the use of some functions in a certain APP or the time and times of using a certain APP. The embodiment of the present application does not limit this.
在本申请另一些实施例中，服务器300的存储器302中还可以存储用户移动终端100发送的用户日程相关数据，服务器300用于根据所述获取的日程相关数据确定用户的日程安排，并根据用户的日程安排设定一个或多个家庭设备的控制规则。In other embodiments of the present application, the memory 302 of the server 300 may also store user schedule-related data sent by the user mobile terminal 100, and the server 300 is used to determine the user's schedule according to the acquired schedule-related data, and according to the user's A schedule that sets control rules for one or more home devices.
上述用户日程相关数据包括以下任意一项或多项：社交记录、短信、通话记录、邮件、电子便签、备忘录等等。The above user schedule-related data includes any one or more of the following: social records, text messages, call records, emails, electronic notes, memos, etc.
“智慧家庭”应用程序是用于对家庭设备进行控制的应用程序。为实现控制功能，“智慧家 庭”应用程序需要获取移动终端100中的以下功能：电话、定位、蓝牙；并读取以下数据：用户的个人信息，例如华为账号、登录密码、昵称、头像，设备及网络信息，例如设备标识符、设备名称、型号、版本、生产厂家、MAC地址、IP地址、设备运行状态、自定义属性、设置参数、设备事件和使用记录，用于发现和绑定设备，随身进行控制、管理和升级等；还会使用设备服务所需的数据包括：设备检测和记录的数据，用于查看设备的工作状态、检测数据、统计报表和历史记录；问题定位所需数据如应用和设备日志信息。The "Smart Home" app is an app for controlling home devices. In order to realize the control function, the "smart home" application program needs to obtain the following functions in the mobile terminal 100: phone, positioning, Bluetooth; and read the following data: the user's personal information, such as Huawei account number, login password, nickname, avatar, device And network information, such as device identifier, device name, model, version, manufacturer, MAC address, IP address, device operating status, custom attributes, setting parameters, device events and usage records, for discovering and binding devices, Carry out control, management and upgrades, etc.; also use the data required for device services, including: device detection and recorded data, used to view the working status, detection data, statistical reports and historical records of the device; data required for problem location such as Application and device log information.
通信接口303可用于服务器300与其他通信设备，例如移动终端100、家庭设备200等进行通信。具体的，通信接口303可以是3G通信接口、长期演进(LTE)(4G)通信接口、5G通信接口、WLAN通信接口、WAN通信接口等等。不限于无线通信接口，服务器300还可以配置有有线的通信接口303来支持有线通信。The communication interface 303 can be used for the server 300 to communicate with other communication devices, such as the mobile terminal 100, the home device 200 and so on. Specifically, the communication interface 303 may be a 3G communication interface, a long-term evolution (LTE) (4G) communication interface, a 5G communication interface, a WLAN communication interface, a WAN communication interface, and the like. Not limited to the wireless communication interface, the server 300 may also be configured with a wired communication interface 303 to support wired communication.
在本申请实施例中，服务器300可以通过通信接口303接收到移动终端100发送的用户注册“智慧家庭”应用程序的注册信息，以及对家庭设备的控制指令，以及家庭设备反馈的家庭设备的状态信息、家庭环境的状态信息、家庭成员的状态信息等等。In the embodiment of the present application, the server 300 may receive the registration information sent by the mobile terminal 100 through the communication interface 303 for the user to register the "smart home" application program, as well as the control instructions for the home equipment, and the status of the home equipment fed back by the home equipment. information, status information of the family environment, status information of family members, and so on.
在本申请的一些实施例中，发射器305和接收器306可看作一个无线调制解调器。发射器305可用于对处理器301输出的信号进行发射处理。接收器306可用于接收信号。在服务器300中，发射器305和接收器306的数量均可以是一个或者多个。天线308可用于将传输线中的电磁能转换成自由空间中的电磁波，或者将自由空间中的电磁波转换成传输线中的电磁能。耦合器307可用于将移动通信号分成多路，分配给多个的接收器306。可理解的，网络设备的天线308可以实现为大规模天线阵列。In some embodiments of the present application, the transmitter 305 and the receiver 306 can be regarded as a wireless modem. The transmitter 305 may be used to perform transmission processing on the signal output by the processor 301 . Receiver 306 may be used to receive signals. In the server 300, the number of transmitters 305 and receivers 306 can be one or more. Antenna 308 may be used to convert electromagnetic energy in a transmission line to electromagnetic waves in free space, or to convert electromagnetic waves in free space to electromagnetic energy in a transmission line. The coupler 307 can be used to split the mobile communication signal into multiple paths and distribute them to multiple receivers 306 . Understandably, the antenna 308 of the network device may be implemented as a large-scale antenna array.
需要说明的，图4所示的服务器300仅仅是本申请实施例的一种实现方式，实际应用中，服务器300还可以包括更多或更少的部件，这里不作限制。It should be noted that the server 300 shown in FIG. 4 is only an implementation manner of the embodiment of the present application. In practical applications, the server 300 may include more or fewer components, which is not limited here.
接下来结合UI实施例来介绍本申请提供的一种家庭设备的控制方法。Next, a method for controlling a home device provided by the present application is introduced in combination with the UI embodiment.
图5A-图5D示例性示出介绍“家庭”相关概念的示意图。FIG. 5A-FIG. 5D exemplarily show schematic diagrams introducing concepts related to "family".
家庭成员是在围绕在家这个概念下用户与用户之间不同关系的一种叫法。在当今社会中，家庭下的用户与用户之间，存在组织和分工的关系。也就是说，在家庭中，需要区分各个成员的角色，例如可以分为家庭创建者、管理员、普通用户、指定用户、家庭访客等4种角色。这四种成员角色分别拥有不同等级的家庭设备的控制权限。其中，Family members are a name for different relationships between users under the concept of being at home. In today's society, there is a relationship of organization and division of labor between users under the family. That is to say, in a family, it is necessary to distinguish the roles of each member, for example, it can be divided into four roles: family creator, administrator, common user, designated user, and family visitor. The four member roles respectively have different levels of control authority for the home device. in,
家庭拥有者又称创建者：相当于一家之主，可以创建家庭。家庭拥有者拥有最高权限，也就是说，创建者的权限等级为一级权限等级。创建者可以管理所有家庭成员和控制所有家庭设备等。包括增加、删除家庭成员、设置家庭成员担任的角色、拥有的设备控制权限等等。Family owner or creator: equivalent to the head of the family, can create a family. The family owner has the highest permission level, that is, the creator's permission level is the first permission level. The creator can manage all family members and control all family devices, etc. Including adding and deleting family members, setting roles played by family members, device control permissions they have, and so on.
管理员：管理员拥有次高权限，也就是说，管理员的权限等级为二级权限等级。管理员负责管理该家庭的所有，比如针对房间、成员、设备的增加、删除、修改等等。此外，一个家庭也会存在多个管理员，例如家里的爸爸妈妈或爷爷奶奶可以都是这个家的管理员。Administrator: The administrator has the second-highest authority, that is to say, the authority level of the administrator is the second-level authority level. The administrator is responsible for managing everything about the family, such as adding, deleting, and modifying rooms, members, and devices. In addition, there may be multiple administrators in a family, for example, parents or grandparents in the family may all be administrators of this family.
普通用户：普通用户仅可以使用家庭设备，普通用户使用家庭设备的权限等级通常低于家庭管理员的权限等级。Ordinary users: Ordinary users can only use home devices, and the permission level of ordinary users to use home devices is usually lower than that of family administrators.
指定用户：例如老人、儿童等行为能力受限的用户。指定用户与普通用户一样仅拥有使用家庭设备的权限，但权限范围可能不同，例如指定用户为老人、儿童等行为能力受限的用户时，他们的使用权限范围不包括危险指数较高的厨电设备等。Designated users: users with limited behavioral abilities such as the elderly and children. Designated users, like ordinary users, only have the right to use family devices, but the scope of authority may be different. For example, when designated users are elderly, children and other users with limited behavioral capabilities, their scope of use authority does not include kitchen appliances with a high risk index equipment etc.
家庭访客：家庭访客还可以称为临时用户，是指不是该家庭的常住用户，例如家政人员、 家庭教师等等，这类用户只会在某个时间段内出现在该家庭中，并使用该家庭中的设备。当家庭访客不在该家庭空间中，则没有控制家庭设备的权限。Family visitors: Family visitors can also be called temporary users, which refer to non-resident users of the family, such as housekeepers, tutors, etc., such users will only appear in the family within a certain period of time and use the devices in the home. When a home visitor is not in the home space, they do not have permission to control home devices.
可以理解的是，上述指定用户、临时用户等不是每个智慧家庭中都会设置的，家庭成员的所担任的角色设置可以由家庭拥有者根据家庭的实际情况进行设置、更改等。本申请实施例对此不作限制。It can be understood that the above designated users and temporary users are not set in every smart home, and the role settings of family members can be set and changed by the family owner according to the actual situation of the family. The embodiment of the present application does not limit this.
参考图5A，图5A示例性示出一个家庭包含的家庭成员，以及家庭成员在家庭关系中所担任的角色。Referring to FIG. 5A , FIG. 5A schematically shows the family members included in a family, and the roles played by the family members in the family relationship.
如图5A所示，该家庭成员具体包括小中、小华、小明、小红、小爱、小雨以及小雪等等。其中，小中和小华分别是小爱的爸爸妈妈，而小明和小红分别是小爱的爷爷奶奶，小雨是该家庭的访客，小雨可以是小爱的家庭教师、或者小华的私人教练等、而小雪则有可能是家政人员，通常照顾年幼的小爱，或者年迈的小明或小红的生活起居、以及家庭的卫生等等。在本申请实施例中，上述每位家庭成员可以配有一个或多个移动终端，例如手机、平板、笔记本、智能手表等等。具体包括小中的移动终端100-1，小华的移动终端100-2，小明的移动终端100-3，小红的移动终端100-4，小爱的移动终端100-5和移动终端100-6，小雨的移动终端100-7以及小雪的移动终端100-8等等。这些终端设备都属于小中的智慧家庭这一通信系统中，各个终端设备之间可以互联互通。As shown in FIG. 5A , the family members specifically include Xiaozhong, Xiaohua, Xiaoming, Xiaohong, Xiaoai, Xiaoyu, Xiaoxue and so on. Among them, Xiao Zhong and Xiao Hua are Xiao Ai's parents respectively, Xiao Ming and Xiao Hong are Xiao Ai's grandparents respectively, Xiao Yu is a visitor of the family, Xiao Yu can be Xiao Ai's tutor, or Xiao Hua's personal trainer etc., and Xiaoxue may be a housekeeper, usually taking care of the young Xiaoai, or the daily life of the elderly Xiaoming or Xiaohong, as well as family hygiene and so on. In the embodiment of the present application, each of the aforementioned family members may be equipped with one or more mobile terminals, such as mobile phones, tablets, notebooks, smart watches, and the like. Specifically including Xiaozhong's mobile terminal 100-1, Xiaohua's mobile terminal 100-2, Xiaoming's mobile terminal 100-3, Xiaohong's mobile terminal 100-4, Xiaoai's mobile terminal 100-5 and mobile terminal 100- 6. Xiaoyu's mobile terminal 100-7 and Xiaoxue's mobile terminal 100-8, etc. These terminal devices all belong to the communication system of the small and medium-sized smart home, and each terminal device can communicate with each other.
参考图5B，图5B示例性示出小中的家庭成员分别拥有的权限等级。Referring to FIG. 5B , FIG. 5B exemplarily shows the respective permission levels of the family members in the small.
如图5B所示，小中的家的创建者为小中本人，创建者拥有的权限等级为一级。一级权限可以管理所有家庭成员和控制所有家庭设备等。包括增加、删除家庭成员、设置家庭成员担任的角色、拥有的设备控制权限等等。As shown in FIG. 5B , the creator of Xiaozhong's home is Xiaozhong himself, and the authority level of the creator is level one. The first-level authority can manage all family members and control all family devices, etc. Including adding and deleting family members, setting roles played by family members, device control permissions they have, and so on.
其中，小华和小红为管理员，管理员的权限等级为二级权限等级。二级权限的范围包括管理该家庭的所有，比如针对房间、成员、设备的增加、删除、修改等等，此外仅能控制使用他们拥有的房间中的设备。Among them, Xiaohua and Xiaohong are administrators, and the authority level of administrators is the second level authority level. The scope of the secondary authority includes managing all of the family, such as adding, deleting, modifying, etc. for rooms, members, and equipment. In addition, they can only control and use the equipment in the room they own.
其中，小明和小爱为指定用户，他(她)们拥有的权限等级为三级。三级权限的范围包括仅拥有控制使用家庭设备的权限，但控制范围为自己拥有的房间内的设备，并且除了危险指数较高的厨电设备等。Among them, Xiao Ming and Xiao Ai are designated users, and they have three levels of authority. The scope of the third-level authority includes only the authority to control the use of household equipment, but the scope of control is the equipment in the room owned by oneself, and except for kitchen appliances with a high risk index.
其中，小雨和小雪为家庭访客，他们拥有的权限等级为四级。四级权限的范围包括只有家庭访客处于该家庭空间中，才有控制家庭设备的权限。Among them, Xiaoyu and Xiaoxue are family visitors, and their permission level is level four. The scope of the four-level permission includes that only the family visitor is in the family space, and has the right to control the family device.
上述权限等级由一级权限到四级权限的等级依次降低、权限范围也依次缩小。The above-mentioned permission levels are successively lowered from the first-level authority to the fourth-level authority, and the scope of authority is also successively narrowed.
在本申请实施例中，关于家庭成员角色的划分以及等级的划分仅为示例，例如不同的指定用户即老人和儿童拥有的权限等级还可以不同等等，本申请实施例对此不作限制。In the embodiment of the present application, the division of roles and levels of family members is only an example. For example, different designated users, ie, the elderly and children, may have different authority levels, etc., which is not limited in the embodiment of the present application.
上文简单介绍了不同家庭成员的权限等级，上述权限等级包括对房间、家庭成员、家庭设备的管。接下来，将以基于家庭成员所拥有的房间来具体介绍家庭成员控制家庭设备的权限，在此暂不赘述。The above briefly introduces the permission levels of different family members. The above permission levels include the management of rooms, family members, and family devices. Next, based on the room owned by the family member, the permission of the family member to control the home device will be specifically introduced, so details will not be repeated here.
家庭不仅是指用户和用户之间组成的一个人员关系上的概念，家庭还是对实体空间的映射。在智慧家庭场景中，最常见的空间概念是房间。根据实体建筑来说，除了平面的房间外，还有立体的楼层。但是，以社会中绝大多数的家庭建筑来说，一层式的家庭住房远远多于别墅或者复式型的就爱听住房，因此，本申请实施例仅以一层式的家庭空间进行介绍。Family is not only a concept of personal relationship between users, but also a mapping of physical space. In smart home scenarios, the most common spatial concept is a room. According to the physical building, in addition to the flat rooms, there are also three-dimensional floors. However, for the vast majority of family buildings in the society, there are far more one-story family houses than villas or duplex houses. Therefore, the embodiment of the present application only introduces one-story family spaces. .
参考图5C，图5C示例性示出该家庭平面布局结构。Referring to FIG. 5C , FIG. 5C exemplarily shows the family layout structure.
如图5C所示，该家庭的布局结构包括：卧室A、卧室B、卧室C、客厅、厨房、书房、 健身房、娱乐室等等。其中，卧室A是属于小中和小华的私人空间，卧室B是属于小明和小华的私人空间，卧室C则是属于小爱的，客厅、厨房、书房、娱乐室、健身房则是家庭成员的公共区域。但是由于小爱还是孩童儿，为了保护小爱的安全，在没有成人的监护下，禁止小爱操作厨房中的家庭设备。在本申请实施例中，私人空间和公共空间是根据不同家庭的实际情况而自定义的，也就是说，卧室不一定是私人空间，例如一个家庭有个婴儿，婴儿房是属于婴儿的卧室，但对于婴儿来说，她还没有自主行动的能力，时时需要家中其他人的照看，这显然是不存在隐私空间的。反而对于小爱这样的孩童儿来说，是渴望有自己的私人空间的。因此，本申请实施例定义的私人空间和公共空间不是绝对概念不作限制。As shown in FIG. 5C , the layout structure of the family includes: bedroom A, bedroom B, bedroom C, living room, kitchen, study room, gymnasium, entertainment room and so on. Among them, bedroom A belongs to the private space of Xiao Zhong and Xiao Hua, bedroom B belongs to Xiao Ming and Xiao Hua's private space, bedroom C belongs to Xiao Ai, and the living room, kitchen, study room, entertainment room and gym are family members. public areas. However, since Xiao Ai is still a child, in order to protect Xiao Ai's safety, Xiao Ai is prohibited from operating household equipment in the kitchen without adult supervision. In the embodiment of this application, the private space and the public space are customized according to the actual situation of different families, that is to say, the bedroom is not necessarily a private space, for example, if a family has a baby, the baby room is the bedroom of the baby. But for a baby, she does not yet have the ability to act independently, and she always needs to be looked after by other people in the family. Obviously, there is no privacy space. On the contrary, for children like Xiao Ai, they long for their own private space. Therefore, the private space and public space defined in the embodiments of the present application are not absolute concepts and are not limited.
家庭除了与实体空间映射外，家庭空间还有另外一个重要的作用—设备绑定，也可以理解为设备的空间分类。这是因为，在一个家庭中，大部分设备，除了移动终端以外的几乎所有家庭设备都是固定在某个房间中。因此，在用户寻找某个设备或者控制、使用某个设备时，只要清楚这个设备所属房间，记住这个设备所在的房间就可以快速找到设备。此外，一个家庭中的所有成员虽然拥有非常亲密的关系，但是每个人都是个体，都需要的属于自己的私人空间，因此一个家庭实际是被划分多个空间的，有属于自己的私人空间、也有属于大家的公共空间，这样既可以保护个人的隐私安全，也可以增进家庭成员之间的关系。In addition to the mapping between the family and the physical space, the family space has another important role—device binding, which can also be understood as the spatial classification of devices. This is because, in a family, most devices, almost all household devices except mobile terminals are fixed in a certain room. Therefore, when a user is looking for a certain device or controlling or using a certain device, as long as he knows the room the device belongs to and remembers the room where the device is located, he can quickly find the device. In addition, although all members of a family have a very close relationship, everyone is an individual and needs their own private space. Therefore, a family is actually divided into multiple spaces, with their own private space, There is also a public space that belongs to everyone, which can not only protect the privacy of individuals, but also enhance the relationship between family members.
参考图5D，图5D示例性示出该家庭空间布局结构，以及各个空间中配有的家庭设备示意图。Referring to FIG. 5D , FIG. 5D exemplarily shows the layout structure of the home space, and a schematic diagram of the home equipment equipped in each space.
如图5D所示，家庭中配有多个家庭设备200可以包括：家庭设备200-1、家庭设备200-2、家庭设备200-3、家庭设备200-4、家庭设备200-5、家庭设备200-6等等。上述家庭设备具体可以是电视、冰箱、空调、洗烘机、烟灶、厨房电器、空气净化器、新风机、加湿除湿器、扫地机、摄像头、门锁、窗帘电动、饮水机、灯等智能设备。As shown in FIG. 5D , there are multiple home devices 200 in the family, which may include: home device 200-1, home device 200-2, home device 200-3, home device 200-4, home device 200-5, home device 200-6 and so on. The above-mentioned household equipment can specifically be televisions, refrigerators, air conditioners, washing and drying machines, smoke stoves, kitchen appliances, air purifiers, fresh air fans, humidification and dehumidifiers, sweepers, cameras, door locks, electric curtains, drinking fountains, lights and other smart home appliances. equipment.
在本申请实施例中，上述移动终端、家庭设备等都属于该家庭中的家庭设备，将所有家庭设备进行组网可以得到的一个互联互通的通信系统，该通信系统即上文图1B示出的通信系统10，上述一系列移动终端都属于前文通信系统10中的移动终端100，上述一系列家庭设备都属于前文通信系统10中的家庭设备200。在本申请另一些实施例中，通信系统10也可以称其为“智慧家庭”系统。In the embodiment of this application, the above-mentioned mobile terminals, home devices, etc. all belong to the family devices in the family, and an interconnected communication system can be obtained by networking all the family devices. The communication system is shown in Figure 1B above. The above-mentioned series of mobile terminals all belong to the mobile terminal 100 in the above-mentioned communication system 10 , and the above-mentioned series of home devices all belong to the home device 200 in the above-mentioned communication system 10 . In other embodiments of the present application, the communication system 10 may also be called a "smart home" system.
在上述通信系统10中，用户可以在移动终端中下载安装“智慧家庭”应用程序，在“智慧家庭”中注册并登陆账户，绑定家庭设备等等。之后，用户通过该应用程序查看、管理、控制家庭设备电子设备等。其中，关于“智慧家庭”应用程序的定义可以参考前方介绍，在此暂不赘述。接下来仅以“智慧家庭”应用程序的功能以及UI做出示例性介绍，具体如下：In the above-mentioned communication system 10, the user can download and install the "smart home" application program in the mobile terminal, register and log in an account in the "smart home", bind home devices, and so on. After that, the user can view, manage, and control home devices, electronic devices, etc. through the application. Among them, the definition of the "smart home" application program can refer to the previous introduction, so I won't go into details here. Next, we only use the functions and UI of the "Smart Home" application to make an exemplary introduction, as follows:
图5A-图5D仅仅介绍了家庭场景，包括家庭空间、家庭成员的关系，本申请实施例提供的方法还可以应用于办公场景中，在此不对办公空间、公司员工进行一一赘述。Figures 5A-5D only introduce the family scene, including the family space and the relationship between family members. The method provided by the embodiment of the present application can also be applied to the office scene, and the office space and company employees will not be described here.
图6A-图6V、图7A-图7I示例性示出用户创建“智慧家庭”的相关操作。创建“智慧家庭”的操作具体可以包括：6A-6V, 7A-7I exemplarily illustrate related operations for a user to create a "smart home". The specific operations of creating a "smart home" can include:
1.注册登陆“智慧家庭”账号，在移动终端中生成一个虚拟的家庭空间，方便集中控制、管理家庭。1. Register and log in to the "Smart Home" account, and generate a virtual family space in the mobile terminal, which is convenient for centralized control and management of the family.
2.添加家庭设备，包括将设备绑定至该家庭并为家庭设备进行配网。设备配网是指将设备连接到互联网的过程，以便设备通电后，可以与“智慧家庭”平台之间进行传输数据。家庭 创建者，即家庭拥有者还可以对添加后的家庭设备进行管理，包括：删除、更换、分类等等。2. Add home devices, including binding the devices to the home and configuring the network for the home devices. Device distribution refers to the process of connecting devices to the Internet, so that after the devices are powered on, they can transmit data with the "smart home" platform. The family creator, that is, the family owner can also manage the added family devices, including: deleting, replacing, classifying, and so on.
3.添加家庭成员，包括添加管理员、普通用户、家庭访客等等。家庭拥有者(家庭)、家庭管理员还可以管理家庭成员、家庭设备，包括添加、删除、更改、控制家庭设备，以及添加、删除、更改家庭成员等等。而普通用户只能控制、使用家庭设备，家庭访客只能在特定时间例如处于该家庭空间中时，才能控制权限范围内的家庭设备。首先，图6A以爸爸小中的移动终端100-1为例，来介绍小中登陆“智慧家庭”账户后，“智慧家庭”提供的用户界面示意图。3. Add family members, including adding administrators, ordinary users, family visitors, etc. The family owner (family) and the family administrator can also manage family members and family devices, including adding, deleting, changing, controlling family devices, and adding, deleting, changing family members, and so on. Ordinary users can only control and use family devices, and family visitors can only control family devices within the scope of authority only when they are in the family space at a specific time. First of all, FIG. 6A uses the mobile terminal 100-1 of Dad Xiaozhong as an example to introduce the schematic diagram of the user interface provided by the "Smart Home" after the Xiaozhong logs in to the "Smart Home" account.
如图6A所示，用户界面61显示有：家庭名称选项611、添加控件612、设备导航栏613、设备显示区614、页面导航栏615。As shown in FIG. 6A , the user interface 61 displays: a family name option 611 , an add control 612 , a device navigation bar 613 , a device display area 614 , and a page navigation bar 615 .
其中，家庭名称即“**”的家，“**”即当前登录“智慧家庭”用户的账户名，此时移动终端100-1上登录的是小中的账号，此时家庭名称选项611的显示内容即小中的家。Among them, the family name is the home of "**", and "**" is the account name of the user who is currently logged into the "Smart Family". The displayed content is the small home.
其中，添加控件612用于添加家庭设备，也就是说，将家庭设备与小中的家进行绑定，为家庭设备进行配网。Wherein, the add control 612 is used to add a home device, that is, to bind the home device with the home in the small business, and configure the network for the home device.
其中，设备导航栏613包括：全部选项613A、分类选项613B。当全部选项613A被选中时，此时设备显示区614中显示用户已经添加的所有家庭设备。当用户还未添加设备时，此时设备显示区614不显示任何家庭设备。当分类选项613B被选中后，用户可以对已经添加的家庭设备进行分类，例如划分家庭设备在小中的家中所属空间等等，关于分类家庭设备的操作可以参考后文具体描述，在此暂不赘述。Wherein, the device navigation bar 613 includes: all options 613A, category options 613B. When the all option 613A is selected, all the home devices that the user has added are displayed in the device display area 614 at this time. When the user has not added a device, the device display area 614 does not display any home devices at this time. When the classification option 613B is selected, the user can classify the added home devices, such as dividing the home space of the family device in the small house, etc. For the operation of classifying the home devices, please refer to the detailed description below, which will not be discussed here. repeat.
其中，设备显示区614用于显示小中的家中的全部或部分家庭设备。Wherein, the device display area 614 is used to display all or part of the family devices in the home in the small.
其中，页面导航栏615包括：首页615A、商城615B、智能615C、我的615D。其中首页615A即用于显示上文介绍的用户界面610。商城615B，用于跳转至购物界面，购买家庭所需的设备等等。关于智能615C、我的615D提供的子页面具体可以参考后文UI实施例的详细描述，在此暂不赘述。Wherein, the page navigation bar 615 includes: homepage 615A, shopping mall 615B, smart 615C, and my 615D. The home page 615A is used to display the user interface 610 introduced above. The shopping mall 615B is used to jump to the shopping interface and purchase equipment needed by the family, etc. Regarding the sub-pages provided by Smart 615C and My 615D, please refer to the detailed description of the UI embodiment below, and details will not be repeated here.
接下来图6B-图6K示例性示出用户添加家庭设备的相关操作界面。Next, FIG. 6B-FIG. 6K exemplarily show related operation interfaces for a user to add a home device.
其中，图6B-图6E示例性示出自动添加设备的操作界面。Wherein, FIG. 6B-FIG. 6E exemplarily show an operation interface of automatically adding a device.
当移动终端100-1显示图6A所示的用户界面61时，可以检测到作用于添加控件612的操作，响应于该操作，移动终端100-1显示图6B所示的用户界面62。When the mobile terminal 100-1 displays the user interface 61 shown in FIG. 6A, an operation acting on the add control 612 may be detected, and in response to the operation, the mobile terminal 100-1 displays the user interface 62 shown in FIG. 6B.
图6B示例性示出扫描设备的用户界面示意图。Fig. 6B exemplarily shows a schematic diagram of a user interface of a scanning device.
如图6B所示，用户界面62显示自动扫描附近设备的用户界面示意图。此时移动终端100-1可能自动开启例如蓝牙、WI-FI等近场通信功能功能，向附近设备发送探测信号，搜索附近的设备。当附近的设备接收到探测信号后，向移动终端回复探测响应，则移动终端100-1显示图6C所示的用户界面62。As shown in FIG. 6B , the user interface 62 displays a schematic diagram of a user interface for automatically scanning nearby devices. At this time, the mobile terminal 100-1 may automatically enable near-field communication functions such as Bluetooth and WI-FI, send detection signals to nearby devices, and search for nearby devices. When the nearby device receives the probe signal, it replies a probe response to the mobile terminal, and the mobile terminal 100-1 displays the user interface 62 shown in FIG. 6C .
图6C示例性示出添加设备的用户界面示意图。Fig. 6C exemplarily shows a schematic diagram of a user interface for adding a device.
如图6C所示，用户界面62显示已经扫描到的附近设备的用户界面示意图。例如，附件的移动终端包括：智能门锁、电视机、摄像头、电动窗帘等等。每个扫描到的设备对应显示有添加控件，用户可以通过点击任意一个或多个设备分别对应的添加控件，将扫描到的该设备添加到家庭设备中，即与该家庭绑定。As shown in FIG. 6C , the user interface 62 displays a schematic diagram of the user interface of the scanned nearby devices. For example, the mobile terminals of the accessories include: smart door locks, TVs, cameras, electric curtains and so on. Each scanned device is correspondingly displayed with an add control, and the user can add the scanned device to the family device by clicking the add control corresponding to any one or more devices, that is, bind it to the family.
当移动终端100-1显示图6C所示的用户界面62时，可以检测到作用于智能门锁对应的添加控件的操作，响应于该操作，移动终端100-1显示图6D所示的用户界面62。When the mobile terminal 100-1 displays the user interface 62 shown in FIG. 6C, it can detect the operation of adding a control corresponding to the smart door lock, and in response to the operation, the mobile terminal 100-1 displays the user interface shown in FIG. 6D 62.
如图6D所示，智能门锁对应的添加控件由原来的“添加”变为“已添加”进行显示。As shown in FIG. 6D , the add control corresponding to the smart door lock is displayed from the original "Add" to "Added".
当移动终端100-1显示图6D所示的用户界面62时，可以检测到作用于返回控件的操作，响应于该操作，移动终端100-1显示图6E所示的用户界面61。When the mobile terminal 100-1 displays the user interface 62 shown in FIG. 6D, an operation on the return control may be detected, and in response to the operation, the mobile terminal 100-1 displays the user interface 61 shown in FIG. 6E.
如图6E所示，此时的设备显示区614由原来图6A所示设备显示区614中的没有任何设备变为，已添加到小中的家中的家庭设备即智能门锁。As shown in FIG. 6E , the device display area 614 at this time is changed from no device in the device display area 614 shown in FIG. 6A , to the household device that has been added to the home in Xiaozhong, that is, the smart door lock.
上述图6A-图6E仅仅示例性示出一种添加设备的方式，即移动终端100-1自动扫描附近的电子设备，若，附近电子设备通电、并且开启与移动终端100-1对应的任意一种无线通信功能时，即可以向移动终端100-1发送探测响应，使得移动终端100-1搜索到该设备，将其添加至家庭设备中，为其配网。上述开启的无线通性功能包括以下任意一项或多项：WLAN、BT、IR、ZigBee等等。因此图6A-图6E所示的添加设备的方法也可以称为先蓝牙配网、WiFi配网，或者其他方式配网等，并绑定设备。The above-mentioned Fig. 6A-Fig. 6E only exemplarily show a way of adding devices, that is, the mobile terminal 100-1 automatically scans nearby electronic devices, if the nearby electronic devices are powered on, and any one corresponding to the mobile terminal 100-1 is turned on. When using this wireless communication function, a probe response can be sent to the mobile terminal 100-1, so that the mobile terminal 100-1 can search for the device, add it to the home device, and configure a network for it. The above enabled wireless connectivity functions include any one or more of the following: WLAN, BT, IR, ZigBee and so on. Therefore, the method of adding a device shown in Fig. 6A-6E can also be referred to as first Bluetooth distribution network, WiFi distribution network, or other ways of network distribution, etc., and bind the device.
然而在本申请实施例中，添加设备的方式有多种，例如用户可以通过点击图6B所示的手动添加控件621来添加家庭设备。However, in the embodiment of the present application, there are multiple ways to add devices. For example, the user can click the manual adding control 621 shown in FIG. 6B to add a home device.
其中，图6F-图6K示例性示出用户手动添加设备的操作界面示意图。Wherein, FIG. 6F-FIG. 6K exemplarily show schematic diagrams of an operation interface for a user to manually add a device.
如图6F所示，移动终端100-1检测到用户作用于手动添加控件621的操作，显示如图6G所示用户界面63，该界面包括：预先存储的一系列不同类型、型号的家庭设备的图标。如图6G所示，移动终端100-1可以检测到用户选择待添加的家庭设备的图标的操作，响应于该操作，移动终端100-1显示如图6H所示的配网用户界面64。之后，移动终端100-1检测到如图6I所示的用户输入家庭Wi-Fi的密码，并点击下一步控件的操作，响应于该操作，移动终端100-1向电视机发送家庭Wi-Fi账号和密码，使得电视机通过家庭Wi-Fi账号和密码，连接路由器，并与智慧家庭系统中的服务器300进行通信。当电视机通过家庭Wi-Fi账号和密码，连接路由器，并与智慧家庭系统中的服务器300进行通信后，可以向移动终端100-1发送配网成功的消息，移动终端100-1会显示如图6J所示的配网成功的提示信息。可以理解的是，在移动终端100-1输入家庭Wi-Fi的密码并点击下一步之前，需要确保电视机通电，并且通过长按家庭设备的电源键或者重置按钮等，使该电视机打进入sniffer模式，也可以称为混杂模式，此时设备不过滤数据报文，可以监听环所有的802.11报文，此时用户可以在移动终端100-1才能为该家庭设备进行配网。As shown in FIG. 6F, the mobile terminal 100-1 detects that the user has acted on the operation of manually adding the control 621, and displays a user interface 63 as shown in FIG. icon. As shown in FIG. 6G , the mobile terminal 100-1 may detect the user's operation of selecting the icon of the home device to be added, and in response to the operation, the mobile terminal 100-1 displays the configuration network user interface 64 as shown in FIG. 6H . After that, the mobile terminal 100-1 detects that the user enters the password of the home Wi-Fi as shown in Figure 6I, and clicks the operation of the next control. In response to this operation, the mobile terminal 100-1 sends the home Wi-Fi password to the TV. The account and password enable the TV to connect to the router through the home Wi-Fi account and password, and communicate with the server 300 in the smart home system. When the TV is connected to the router through the home Wi-Fi account and password, and communicates with the server 300 in the smart home system, it can send a message of successful network distribution to the mobile terminal 100-1, and the mobile terminal 100-1 will display the following: The prompt information of successful network distribution shown in FIG. 6J . It can be understood that before the mobile terminal 100-1 enters the password of the home Wi-Fi and clicks Next, it needs to ensure that the TV is powered on, and the TV can be turned on by pressing and holding the power button or the reset button of the home device. Enter the sniffer mode, which can also be called the promiscuous mode. At this time, the device does not filter data messages, and can monitor all 802.11 messages in the ring. At this time, the user can only configure the network for the home device at the mobile terminal 100-1.
除了上述自动添加、手动添加这两种方式进行蓝牙配网、WiFi配网之外，还可以通过NFC配网，例如碰一碰、扫描二维码等方式添加设备。In addition to the above two methods of automatic addition and manual addition for Bluetooth and WiFi distribution, you can also add devices through NFC distribution, such as touch and scan QR codes.
具体的，用户可以通过点击图6B所示的扫码添加控件622，然后扫描家庭设备贴有的二维码标签，来添加该设备。本申请实施例在此不做过多赘述。Specifically, the user can add the device by clicking the scan code adding control 622 shown in FIG. 6B , and then scanning the two-dimensional code label attached to the home device. The embodiment of the present application will not be described in detail here.
在本申请另一些实施例中，移动终端100-1还可以通过其他方式为就家庭设备配网，将其绑定到该家庭中。例如声波配网，即通过手机发出声波，将WiFi的SSID、password等信息传给设备，设备识别完成初始化流程，并与智慧家庭平台建立网络连接。In some other embodiments of the present application, the mobile terminal 100-1 may also configure a network for the home device in other ways, and bind it to the home. For example, the sound wave distribution network, that is, the sound wave is sent out through the mobile phone, and the WiFi SSID, password and other information are transmitted to the device. The device identification completes the initialization process and establishes a network connection with the smart home platform.
之后，每当家庭中有新增的智能加电后，用户都可以通过上文所述的多种方式来为新增的家庭设备进行配网，并将其添加至家庭设备中。After that, whenever there is a new smart power supply in the home, the user can configure the network for the new home device through the above-mentioned various methods, and add it to the home device.
如图6K所示，图6K示例性示出小中将家中所有家庭设备添加至家庭设备后的用户界面示意图。可见，此时首页中的设备显示区614显示有：智能门锁、电视机A、摄像头、电动 窗帘A、体脂称、台灯、电水壶、电饭煲、冰箱、电视机B、空气净化器A、空调A、智能电灯A、电视机B、电动窗户B以及空调B等等，在此不一一举例。用户可以通过导航下滑动设备显示区614，浏览所有家庭设备。As shown in FIG. 6K , FIG. 6K exemplarily shows a schematic diagram of a user interface after adding all family devices in the home to the family devices in Xiaozhong. It can be seen that the device display area 614 on the home page displays: smart door lock, TV A, camera, electric curtain A, body fat scale, desk lamp, electric kettle, rice cooker, refrigerator, TV B, air purifier A, Air conditioner A, smart light A, TV B, electric window B, air conditioner B, etc., are not listed here. The user can browse all home devices by sliding down the device display area 614 in the navigation.
接下来图6L-图6V示例性示出用户对家庭设备进行分类的操作界面示意图。Next, FIG. 6L-FIG. 6V exemplarily show schematic diagrams of an operation interface for a user to classify home devices.
当移动终端100-1检测到用户点击图6K所示的分类选项613B的操作，移动终端100-1将设备显示区614由图6K所显示的全部家庭设备，切换为图6L所示的分类后的部分家庭设备。When the mobile terminal 100-1 detects that the user clicks on the classification option 613B shown in Figure 6K, the mobile terminal 100-1 switches the device display area 614 from all the home devices shown in Figure 6K to the classification shown in Figure 6L some household equipment.
如图6L所示，在分类被选中的情况下，此时的设备显示区614不显示任何家庭设备的图标，这是因为小中还没有对家庭设备进行分类。此时，移动终端100-1可以检测到用户点击图6L所示的分类管理控件616的操作，响应于该操作，移动终端100-1将设备显示图6M所示的分类管理用户界面65。As shown in FIG. 6L , when the classification is selected, the device display area 614 at this time does not display any icons of family devices, because the Xiaozhong has not yet classified the family devices. At this time, the mobile terminal 100-1 may detect that the user clicks the category management control 616 shown in FIG. 6L , and in response to the operation, the mobile terminal 100-1 will display the category management user interface 65 shown in FIG. 6M .
如图6M所示，分类管理用户界面65显示排序控件651A、添加房间控件651B、删除控件651C。排序控件651A用于对已经添加的房间类型的显示顺序进行排序，添加房间控件651B用于添加房间类型，删除控件651C用于删除已经添加的房间类型。此时，移动终端100-1可以检测到用户点击图6N示的添加房间控件651B的操作，响应于该操作，移动终端100-1将设备显示图6N所示的分类管理用户界面65。As shown in FIG. 6M , the category management user interface 65 displays a sort control 651A, an add room control 651B, and a delete control 651C. The sort control 651A is used to sort the display order of the added room types, the add room control 651B is used to add room types, and the delete control 651C is used to delete the added room types. At this point, the mobile terminal 100-1 may detect the user's operation of clicking the add room control 651B shown in FIG. 6N , and in response to the operation, the mobile terminal 100-1 will display the category management user interface 65 shown in FIG. 6N .
如图6N所示，管理用户界面65显示有用于添加房间的窗口652，用户可以输入的自定义房间名称例如“卧室A”，然后点击确认控件，响应于该户操作，移动终端100-1显示如图6O所示的用户界面65。As shown in FIG. 6N, the management user interface 65 displays a window 652 for adding a room. The user can input a custom room name such as "bedroom A", and then click the confirmation control. In response to the user operation, the mobile terminal 100-1 displays The user interface 65 is shown in FIG. 6O.
如图6O所示，管理用户界面65显示有卧室A列表项653A，该列表项653A显示有卧室A的设备详情信息，例如0个设备，用于提示用户卧室A中还没有添加家庭设备。此时，移动终端100-1可以检测到用户点击图6O的列表项653A的操作，响应于该操作，移动终端100-1将设备显示图6P所示的卧室A的详情界面66。As shown in FIG. 6O , the management user interface 65 displays a bedroom A list item 653A, and the list item 653A displays device detail information of bedroom A, for example, 0 devices, which is used to remind the user that no family device has been added to bedroom A. At this point, mobile terminal 100-1 may detect the user's operation of clicking list item 653A in FIG. 6O, and in response to the operation, mobile terminal 100-1 will display the detail interface 66 of bedroom A shown in FIG. 6P.
如图6P所示，卧室A的详情界面66显示有添加设备控件654A、删除设备控件654B。此时，移动终端100-1可以检测到用户点击图6P的添加设备控件654A的操作，响应于该操作，移动终端100-1将弹出图6Q所示的添加设备窗口655。As shown in FIG. 6P , the details interface 66 of bedroom A displays an add device control 654A and a delete device control 654B. At this point, the mobile terminal 100-1 may detect the user's operation of clicking the add device control 654A in FIG. 6P, and in response to the operation, the mobile terminal 100-1 will pop up the add device window 655 shown in FIG. 6Q.
如图6Q所示，卧室A的详情界面66显示有添加设备窗口655。添加设备窗口655显示上文用户已经添加的全部家庭设备的图标。As shown in FIG. 6Q , the details interface 66 of bedroom A displays an add device window 655 . Add Devices window 655 displays icons for all home devices that the user has added above.
如图6R所示，用户可以选择其中属于卧室A中的设备，例如电视机A和空气净化器A，然后点击确定控件，响应于上述操作，移动终端100-1将显示图6S所示的卧室A的详情界面66。此时，移动终端100-1可以检测到用户点击图6S所示的返回控件的操作，响应于该操作，移动终端100-1将设备显示图6T所示的分类管理界面65。As shown in FIG. 6R, the user can select the equipment belonging to bedroom A, such as TV A and air purifier A, and then click the OK control. In response to the above operation, mobile terminal 100-1 will display the bedroom as shown in FIG. 6S The details interface 66 of A. At this time, the mobile terminal 100-1 may detect that the user clicks the return control shown in FIG. 6S , and in response to the operation, the mobile terminal 100-1 will display the classification management interface 65 shown in FIG. 6T .
如图6T所示，分类管理界面65中列表项653A由原来图6O所示的显示0个设备的提示信息，变为显示有2个设备的提示信息。As shown in FIG. 6T , the list item 653A in the category management interface 65 is changed from the prompt information displaying 0 devices shown in FIG. 6O to the prompt information displaying 2 devices.
基于上文6K-6T介绍的对家庭设备的分类操作，用户可以重复上述操作，添加更多的房间，并为每个房间添加属于该房间的设备。Based on the classification of home devices described in 6K-6T above, the user can repeat the above operations to add more rooms and add devices belonging to the room to each room.
参考图6U，图6U示例性示出移动终端100-1显示的分类结果。Referring to FIG. 6U, FIG. 6U exemplarily shows the classification results displayed by the mobile terminal 100-1.
如图6U所示，用户界面65显示有列表项653A、列表项653B、列表项653C、列表项653D、列表项653E、列表项653F(未示出)、列表项653G(未示出)以及列表项653H(未 示出)等。用户可以通过上下滑动用户界面65以浏览未示出的列表项，上述列表项所对应的房间分别为卧室A、卧室B、卧室C、客厅、厨房、书房、健身房、娱乐室等。此时，移动终端100-1可以检测到用户点击图6U所示的返回控件的操作，响应于该操作，移动终端100-1将设备显示图6V所示的用户界面61。6U, the user interface 65 displays a list item 653A, a list item 653B, a list item 653C, a list item 653D, a list item 653E, a list item 653F (not shown), a list item 653G (not shown), and a list Item 653H (not shown) and so on. The user can browse the list items not shown by sliding the user interface 65 up and down. The rooms corresponding to the above list items are bedroom A, bedroom B, bedroom C, living room, kitchen, study room, gymnasium, entertainment room and so on. At this point, the mobile terminal 100-1 may detect the user's operation of clicking the return control shown in FIG. 6U, and in response to the operation, the mobile terminal 100-1 will display the user interface 61 shown in FIG. 6V.
如图6V所示，用户界面61的设备导航栏613包括：全部选项613A、卧室A选项613C、卧室B选项613D、卧室C选项613E、客厅选项613F、厨房选项613G(未示出)、书房选项H(未示出)、健身房选项I(未示出)、娱乐室选项J等(未示出)。用户可以通过左右滑动设备导航栏613区域以浏览未示出的选项。As shown in Figure 6V, the device navigation bar 613 of the user interface 61 includes: all options 613A, bedroom A options 613C, bedroom B options 613D, bedroom C options 613E, living room options 613F, kitchen options 613G (not shown), study options H (not shown), gym option I (not shown), recreation room option J, etc. (not shown). The user can browse the options not shown by sliding the device navigation bar 613 area left and right.
如图6V所示，此时设备导航栏613选中卧室A选项613C。设备显示区614中显示卧室A中包含的家庭设备的图标。用户还可以通过点击设备导航栏613中的其他选项，使得设备显示区614显示其他选项所对应的房间中包含的设备的图标。在本申请实施例中，设备显示区614不仅显示设备的图标，还显示该图标对应的设备的工作状态，例如该设备处于开启状态还是关闭状态。As shown in FIG. 6V , at this time, the option 613C of bedroom A is selected in the device navigation bar 613 . Icons of home devices included in the bedroom A are displayed in the device display area 614 . The user can also click on other options in the device navigation bar 613 to make the device display area 614 display the icons of the devices contained in the room corresponding to the other options. In the embodiment of the present application, the device display area 614 not only displays the icon of the device, but also displays the working state of the device corresponding to the icon, for example, whether the device is in the on state or in the off state.
值得注意的是，用户可以通过点击设备显示区614中设备的图标，进入设备详情页实现随该设备的控制，具体参考后文的详细介绍在此暂不赘述。It is worth noting that the user can click the icon of the device in the device display area 614 to enter the device details page to realize the control of the device. For details, please refer to the detailed introduction later and will not go into details here.
在本申请实施例中，上文图6K-图6U实施例性示出的用户手动划分房间以及房间的设备的一系列操作亦可以称为第二操作。In the embodiment of the present application, the series of operations of the user manually dividing the room and the device of the room shown in the embodiment of FIG. 6K-FIG. 6U above may also be referred to as the second operation.
可以理解的是，对家庭设备所述房间的分类除了通过上文图6L-图6V示例性示出用户主动划分以外，还可以由移动终端100-1自动划分。具体如下：It can be understood that, in addition to the active division by the user as shown in Fig. 6L-6V above, the classification of the room of the home device may also be automatically divided by the mobile terminal 100-1. details as follows:
智慧家庭APP中绑定的部分家庭设备包括：扫地机器人、吸尘器等等，可以在房间中移动的设备。这些设备在开启作业的过程中，能够通过获取整个家庭的房间布局信息，即该家庭中包含的房间个数、房间位置、房间面积等等，以及房间中配置的家居家电设备的信息等等。Some of the home devices bound in the Smart Home APP include: sweeping robots, vacuum cleaners, etc., devices that can move around the room. In the process of starting the operation, these devices can obtain the room layout information of the whole family, that is, the number of rooms contained in the family, the location of the rooms, the area of the room, etc., as well as the information of the home appliances configured in the room, etc.
以扫地机器人为例，其具有众多的传感器，例如，摄像头、激光测距传感器、沿墙传感器、碰撞传感器、超声雷达传感器、电子罗盘传感器、悬崖传感器、陀螺仪/加速度计、跌落传感器、里程计传感器等等。Taking the sweeping robot as an example, it has many sensors, such as camera, laser ranging sensor, wall sensor, collision sensor, ultrasonic radar sensor, electronic compass sensor, cliff sensor, gyroscope/accelerometer, drop sensor, odometer sensors and more.
首先，扫地机器人能够利用自身的各种传感器探测周围环境，利用感知到的房间环境信息对整个家庭进行地图构造，进而获取该家庭的房间布局信息。该房间布局信息包括：房间的个数、房间的位置、房间面积等等。First of all, the sweeping robot can use its various sensors to detect the surrounding environment, use the perceived room environment information to construct a map of the entire family, and then obtain the room layout information of the family. The room layout information includes: the number of rooms, the location of the rooms, the area of the rooms, and so on.
此外，扫地机器人还可以扫描到各个房间配置的家居家电设备等，例如，其中一个房间设置有电饭煲、电水壶等厨房家电；另一个房间配置有智能马桶；另一个房间配置有床、衣柜；另一个房间配置有书柜、书桌、计算机等等。In addition, the sweeping robot can also scan the home appliances in each room. For example, one room is equipped with kitchen appliances such as rice cookers and electric kettles; another room is equipped with smart toilets; another room is equipped with beds and wardrobes; A room is equipped with bookcases, desks, computers, and so on.
之后，扫地机器人将传感器检测到的房间信息和各个房间中的设备信息上传至处理器，处理器则会对这些数据进行匹配，即根据各个房间中配置的家庭设备的类型，来划分该房间的类型。例如，将设置有电饭煲、电水壶等厨房家电的房间划分为厨房；将配置有智能马桶的房间划分为卫生间；将配置有床、衣柜的房间划分为卧室；将配置有书柜、书桌、计算机的房间划分为书房等等。在本申请实施例中，假设扫地机器人生成的小中的家庭的房间布局和设备布局具体可以可以是上文图5D示例性示出的家庭结构，在此暂不一一赘述。After that, the sweeping robot uploads the room information detected by the sensor and the equipment information in each room to the processor, and the processor will match these data, that is, divide the room according to the type of household equipment configured in each room. type. For example, the room equipped with kitchen appliances such as rice cooker and electric kettle is divided into kitchen; the room equipped with smart toilet is divided into bathroom; the room equipped with bed and wardrobe is divided into bedroom; The room is divided into a study and more. In the embodiment of the present application, it is assumed that the room layout and equipment layout of the small family generated by the cleaning robot may specifically be the family structure shown in Fig. 5D above, which will not be described here.
最后，扫地机器人可以将上述划分结果通过服务器300发送至移动终端100，或者直接发送至移动终端100，本申请实施例对此不作限制。Finally, the cleaning robot may send the above division result to the mobile terminal 100 through the server 300, or directly to the mobile terminal 100, which is not limited in this embodiment of the present application.
在本申请一些实施例中，扫地机器人也可以将传感器检测到的房间布局信息和对应的设 备布局信息的原始数据发送至移动终端100，由移动终端100的处理器根据各个房间中配置的设备的类型来划分该房间的类型。在本申请另一些实施例中，扫地机器人也可以将传感器检测到的房间布局信息和对应的设备布局信息的原始数据发送至服务器300，由服务器300根据各个房间中配置的设备的类型来划分该房间的类型，然后将该划分结果下发至移动终端100以及扫地机人等设备中，本申请实施例对此不作限制。In some embodiments of the present application, the sweeping robot can also send the raw data of the room layout information detected by the sensor and the corresponding equipment layout information to the mobile terminal 100, and the processor of the mobile terminal 100 can use the data of the equipment configured in each room Type to classify the type of the room. In other embodiments of the present application, the sweeping robot can also send the raw data of the room layout information detected by the sensor and the corresponding equipment layout information to the server 300, and the server 300 divides the room layout information according to the type of equipment configured in each room. The type of the room, and then send the division result to devices such as the mobile terminal 100 and the sweeper, which is not limited in this embodiment of the present application.
在本申请一些实施例中，在移动终端100中采用上文提及的方法来自动划的房间及设备时，划分结果可能不准确；或者自动划分房间及设备后，部分设备位置移动，导致该设备所属房间变化；或者该家庭重新改造房屋，例如将原来的书房布置为卧室等等。此时，移动终端100可以支持用户手动重新设置房间的信息以及设备的信息；或者移动终端100可以定期更新房间及设备信息，然后提示用户已更新房间及设备并请用户确认是否有误，若有误则可以支持用户手动更改，否则，自动采用最新一次更改后的划分结果等等。在本申请实施例中，移动终端100支持用户更改的房间信息包括但不限于：房间名称、房间中包含的设备；移动终端100支持用户更改的设备信息包括但不限于：设备名称、设备所属房间。In some embodiments of the present application, when the mobile terminal 100 adopts the method mentioned above to automatically divide the room and equipment, the division result may not be accurate; or after the room and equipment are automatically divided, the position of some equipment moves, resulting in the The room to which the equipment belongs changes; or the family remodels the house, such as arranging the original study room as a bedroom, etc. At this time, the mobile terminal 100 can support the user to manually reset the room information and equipment information; or the mobile terminal 100 can periodically update the room and equipment information, and then prompt the user that the room and equipment have been updated and ask the user to confirm whether there is an error. If it is wrong, the user can manually change it, otherwise, the division result after the latest change is automatically adopted, and so on. In this embodiment of the application, the room information that the mobile terminal 100 supports the user to modify includes but is not limited to: room name, equipment contained in the room; the equipment information that the mobile terminal 100 supports the user to modify includes but is not limited to: the equipment name, the room to which the equipment belongs .
值得注意的是，扫地机器人为公共设备，但扫地机器人的位置是移动的，因此在扫地机器人获取家庭设备位置的过程中，同时定位自己，自己所属位置可能是家庭中任意一个房间。因此，在扫地机器人根据房间布局信息和设备位置信息划分结果时，扫地机器人可能被划分在家庭中的任意一个房间。当扫地机器人被划分的房间为某一个家庭成员的私人房间时，其他家庭成员则不能使用该扫地机器人，为了避免这一问题，在移动终端100自动划分房间以及设备类型后，移动终端100还支持用户手动划分设备类型。也就是说，用户在自动划分结果的基础上，还可以将其中任意一个私人房间中的设备移动至公共区域，从而供所有家庭成员使用；也可以将任意一个公共区域的设备移动至私人房间，仅供该私人房间的主人使用等等。It is worth noting that the sweeping robot is a public device, but the location of the sweeping robot is mobile. Therefore, in the process of obtaining the location of the home device, the sweeping robot locates itself at the same time, and its location may be any room in the family. Therefore, when the sweeping robot divides the results according to the room layout information and device location information, the sweeping robot may be divided into any room in the family. When the room where the sweeping robot is divided is the private room of a certain family member, other family members cannot use the sweeping robot. In order to avoid this problem, after the mobile terminal 100 automatically divides the room and the device type, the mobile terminal 100 also supports The user manually classifies the device types. That is to say, on the basis of the automatic division results, the user can also move the device in any one of the private rooms to the public area, so that it can be used by all family members; it can also move the device in any public area to the private room, Only available to the owner of that private room, etc.
在本身实施例中，用户可以重新划分房间的设备除了上文所述的扫地机器人，还有例如吸尘器、蓝牙音箱、按摩仪、麦克风、体重秤、空气净化器、电风扇、台灯等等方便用户移动的家庭设备等等。In its own embodiment, besides the sweeping robot mentioned above, the user can re-divide the room, such as vacuum cleaners, Bluetooth speakers, massagers, microphones, weighing scales, air purifiers, electric fans, desk lamps, etc. for the convenience of users Mobile home devices and more.
可见，在本申请实施例中，移动终端100可以结合上文所述的两种方法即用户手动划分，和移动终端100自动划分，来划分房间以及房间中的设备的方法。这样一来，针对一些，在家庭中的位置会变化，但又属于家庭成员公用的家庭设备而言，避免了下述情况的发生：It can be seen that, in the embodiment of the present application, the mobile terminal 100 can combine the above-mentioned two methods, ie manual division by the user, and automatic division by the mobile terminal 100, to divide the room and the devices in the room. In this way, for some family devices whose positions in the family may change but which are shared by family members, the following situations are avoided:
仅采用自动划分房间以及设备的方法时，当扫地机器人采集家庭房间信息和设备信息时，由于部分公用的家庭设备可能会出现在某个家庭成员的私人空间例如卧室中，这会导致最终的划分结果有误，使得其他家庭成员不能使用该公共的家庭设备。When only the method of automatically dividing rooms and equipment is used, when the sweeping robot collects family room information and equipment information, some public household equipment may appear in a family member’s private space such as a bedroom, which will lead to the final division The result is wrong, making other family members unable to use the common family device.
仅采用手动划分房间以及设备的方法时，由于家庭设备多达几十个，这会给用户带来较大的操作负担和记忆负担。When only the method of manually dividing rooms and devices is adopted, since there are as many as dozens of household devices, this will bring a large burden of operation and memory to the user.
在本申请实施例中，移动终端100可以称为第一设备，扫地机器人可以称为第三设备。其中，扫地机器人发送至移动终端100的用于指示小中的家中包含的家居设备所属房间的信息还可以称为第一信息，其中家居设备还可以称为第二设备。此外，小中的家还可以称为第一空间，该第一空间包含的房间的可以称为第一区域。接下来介绍图7A-图7H示例性示出用户添加家庭成员的相关操作界面。In the embodiment of the present application, the mobile terminal 100 may be called a first device, and the cleaning robot may be called a third device. Wherein, the information sent by the cleaning robot to the mobile terminal 100 for indicating the room to which the household equipment contained in the small home belongs may also be referred to as first information, and the household equipment may also be referred to as second equipment. In addition, the small home can also be called the first space, and the rooms contained in the first space can be called the first area. Next, Fig. 7A- Fig. 7H exemplarily show related operation interfaces for users to add family members.
添加家庭成员也就是将家庭成员的移动终端与小中的移动终端100-1建立成一个家庭群组，家庭成员分别可以在自己的移动终端中登陆“智慧家庭”，实现对家庭的管理、控制等。Adding a family member is to establish a family group between the mobile terminal of the family member and the mobile terminal 100-1 of Xiaozhong, and each family member can log in to "Smart Family" in their own mobile terminal to realize the management and control of the family wait.
如图7A所示，移动终端100-1检测到作用于用户界面61中的家庭名称选项611的操作，响应于该操作，移动终端100-1显示图7B所示的用户界面71。As shown in FIG. 7A, the mobile terminal 100-1 detects an operation on the family name option 611 in the user interface 61, and in response to the operation, the mobile terminal 100-1 displays the user interface 71 shown in FIG. 7B.
图7B示例性示出小中的家的详情页。FIG. 7B exemplarily shows a details page of a small home.
如图7B所示，用户界面71包括：家庭名称选项711、家庭成员选项712、设备管理选项713、分类管理选项714、壁纸缩略图显示栏715。其中，家庭名称选项711还对应显示有家庭的名称，例如“小中的家”，用户可以通过点击该家庭名称选项711，修改家庭名称。其中，家庭成员选项712还对应显示有家庭成员的人数，例如此时显示有“1名成员”，用户可以通过点击该家庭成员选项712，添加家庭成员、设置家庭成员的角色、房间等等操作。其中，设备管理选项713、分类管理选项714，还分别对应显示有家庭设备的个数，例如此时显示有“16个设备”，“7个房间”，用户可以通过分别点击该设备管理选项713、分类管理选项714，进行添加、删除家庭设备、房间等。其中，壁纸缩略图显示栏715显示有多个壁纸的缩略图，用户可以通过点击其中任意一个缩略图预览该壁纸，以及将该壁纸应用在“智慧家庭”APP中。As shown in FIG. 7B , the user interface 71 includes: a family name option 711 , a family member option 712 , a device management option 713 , a category management option 714 , and a wallpaper thumbnail display bar 715 . Wherein, the family name option 711 is also correspondingly displayed with the name of the family, such as "Xiaozhong's home", and the user can click on the family name option 711 to modify the family name. Among them, the family member option 712 also corresponds to the number of family members displayed, for example, "1 member" is displayed at this time, and the user can click on the family member option 712 to add family members, set the roles of family members, rooms, etc. . Among them, the device management option 713 and the category management option 714 also display the number of home devices correspondingly. For example, "16 devices" and "7 rooms" are displayed at this time. The user can click the device management option 713 , category management option 714, to add or delete home devices, rooms, etc. Among them, the wallpaper thumbnail display column 715 displays multiple thumbnails of the wallpaper, and the user can click on any one of the thumbnails to preview the wallpaper, and apply the wallpaper in the "smart home" APP.
移动终端100-1可以检测到用户点击图7B所示的家庭成员选项712的操作，响应于该操作，移动终端100-1将设备显示图7C所示的家庭成员详情页的用户界面72。The mobile terminal 100-1 may detect that the user clicks on the family member option 712 shown in FIG. 7B, and in response to the operation, the mobile terminal 100-1 will display the user interface 72 of the family member details page shown in FIG. 7C.
图7C示例性示出小中的家庭成员的详情页。FIG. 7C exemplarily shows the details page of family members in the small.
如图7C所示，用户界面72包括：成员小中选项721，添加成员控件722。其小中选项721还对应显示小中在该家庭中担任的角色例如“创建者”，关于创建者的定义具体可以参考前文对家庭涉及的相关概念的描述吗，在此暂不赘述。用户可以通过点击小中选项721来将家庭“创建者”的身份移交给家庭成员的中的其他人。As shown in FIG. 7C , the user interface 72 includes: a member widget option 721 and an add member control 722 . The Xiaozhong option 721 also corresponds to display Xiaozhong's role in the family, such as "creator". For the definition of the creator, please refer to the previous description of the related concepts involved in the family, so I won't go into details here. The user can hand over the identity of the family "creator" to someone else in the family by clicking on the small option 721 .
移动终端100-1可以检测到用户点击图7C所示的添加成员控件722的操作，响应于该操作，移动终端100-1将设备显示图7D所示的添加成员详情页的用户界面73。The mobile terminal 100-1 may detect that the user clicks the add member control 722 shown in FIG. 7C , and in response to the operation, the mobile terminal 100-1 will display the user interface 73 of the add member details page shown in FIG. 7D .
图7D示例性示出添加成员的详情页。FIG. 7D exemplarily shows a details page for adding members.
如图7D所示，用户界面73包括：关闭图标731A、完成图标731B、扫码添加成员选项732、通过华为账号添加成员选项733以及社交应用添加成员选项734等等。用户可以通过点击上述三个选项中的任意一个选项添加成员至小中的家庭中。As shown in FIG. 7D , the user interface 73 includes: a close icon 731A, a finish icon 731B, an option 732 to add members by scanning a code, an option 733 to add members through a Huawei account, and an option 734 to add members through social applications. Users can add members to the family in Xiaozhong by clicking any one of the above three options.
以第一种添加成员的方式为例，移动终端100-1可以检测到用户点击图7D所示的扫码添加成员选项732的操作，响应于该操作，移动终端100-1将设备显示图7E所示的扫一扫用户界面74。Taking the first way of adding members as an example, the mobile terminal 100-1 can detect that the user clicks the operation of adding members by scanning code 732 shown in FIG. 7D . A swipe user interface 74 is shown.
图7E示例性示出扫一扫界面。FIG. 7E exemplarily shows a scan interface.
如图7E所示，用户界面74包括：扫码区域741。扫码区域741用于显示摄像头获取到的图像，例如小华的移动终端的图像，并且此时小华的移动终端100-2显示小华的智慧家庭APP的二维码。当移动终端100-1识别给二维码后，会跳转至显示如图7F所示的小华的信息。As shown in FIG. 7E , the user interface 74 includes: a code scanning area 741 . The code scanning area 741 is used to display the image captured by the camera, for example, the image of Xiaohua's mobile terminal, and at this time Xiaohua's mobile terminal 100-2 displays the QR code of Xiaohua's smart home APP. After the mobile terminal 100-1 recognizes the QR code, it will jump to display Xiaohua's information as shown in FIG. 7F.
如图7F所示，用户界面73除了显示有图7D所示的信息外，还显示有最近扫描的用户，例如：成员小华的选项735。As shown in FIG. 7F , in addition to the information shown in FIG. 7D , the user interface 73 also displays options 735 of recently scanned users, for example, member Xiaohua.
移动终端100-1可以检测到用户点击图7F所示的选项735的操作，响应于该操作，移动终端100-1选中成员小华，然后移动终端100-1可以检测到作用于图标731B的操作，响应于该操作，移动终端100-1会跳转至显示如图7G所示的家庭成员详情页的用户界面72。Mobile terminal 100-1 can detect the user's operation of clicking option 735 shown in Figure 7F, and in response to this operation, mobile terminal 100-1 selects member Xiaohua, and then mobile terminal 100-1 can detect the operation acting on icon 731B , in response to this operation, the mobile terminal 100-1 will jump to the user interface 72 displaying the family member details page as shown in FIG. 7G.
如图7G所示，用户界面72除了显示有图7C所示的信息外，还显示有已经添加的用户的选项，例如：成员小华的选项723。As shown in FIG. 7G , in addition to displaying the information shown in FIG. 7C , the user interface 72 also displays the options of the added user, for example, the option 723 of member Xiaohua.
之后，用户还可以通过上文图7A-图7G所述的方式来添加成员，最终将小中家中的所有 成员例如上文提到的小明、小红、小爱、小雨、小雪等都添加至小中的家中，详见图7H的示例，在此不再重复赘述。Afterwards, the user can also add members through the methods described in Figure 7A-7G above, and finally add all members of Xiaozhong's family, such as Xiaoming, Xiaohong, Xiaoai, Xiaoyu, Xiaoxue, etc. mentioned above, to the For the home in Xiaozhong, see the example in FIG. 7H for details, and details will not be repeated here.
如图7H所示，图7H示例性示出小中将家中所有成员添加至家庭后的用户界面示意图。可见，此时家庭成员详情页显示有：成员小中的选项721、成员小华的选项723、成员小明的选项724、成员小红的选项725、成员小爱的选项726、成员小雨的选项727、成员小雪的选项728等。值得注意的是，除了成员小中的选项721对应显示的角色为“创建者”外，其余新添加的成员的角色均默认为“普通用户”。关于“普通用户”的定义具体可以参考前文对家庭涉及的相关概念的描述吗，在此暂不赘述。用户可以通过点击上述家庭成员的选项来设置家庭成员分别担任的角色、以及房间等。As shown in FIG. 7H , FIG. 7H exemplarily shows a schematic diagram of a user interface after all members of the family are added to the family in Xiaozhong. It can be seen that the details page of family members at this time shows: option 721 of member Xiaozhong, option 723 of member Xiaohua, option 724 of member Xiaoming, option 725 of member Xiaohong, option 726 of member Xiaoai, option 727 of member Xiaoyu , member Xiaoxue's option 728, etc. It is worth noting that, except that option 721 in the members list corresponds to the displayed role as "creator", the default roles of other newly added members are "common user". For the definition of "ordinary user", can you refer to the previous description of the related concepts involved in the family, so I won't go into details here. The user can set the respective roles and rooms of the family members by clicking on the options of the above-mentioned family members.
图7I-图7T示例性示出设置家庭成员的角色、房间的操作界面。Fig. 7I- Fig. 7T exemplarily show the operation interface for setting roles and rooms of family members.
移动终端100-1可以检测到用户点击7H所示的成员小华的选项723的操作，响应于该操作，移动终端100-1显示如图7I所示的小华对应的成员信息详情页的用户界面75。The mobile terminal 100-1 can detect that the user clicks on the option 723 of the member Xiaohua shown in 7H, and in response to this operation, the mobile terminal 100-1 displays the user information details page corresponding to Xiaohua as shown in Figure 7I. interface75.
图7I示例性示出小华对应的成员信息详情页。FIG. 7I exemplarily shows the detailed page of member information corresponding to Xiaohua.
如图7I所示，用户界面75包括：华为账号751、成员名752、成员角色753、成员房间754、移除成员控件755等等。值得注意的是，成员角色753默认为普通用户、成员房间754、默认为全部房间。用户可以通过点击成员角色753、成员房间754选项来制定小华的角色、以及房间。As shown in FIG. 7I , the user interface 75 includes: Huawei ID 751 , member name 752 , member role 753 , member room 754 , remove member control 755 and so on. It should be noted that the member role 753 defaults to common user, the member room 754 defaults to all rooms. The user can formulate Xiao Hua's role and room by clicking on the member role 753 and the member room 754 option.
当移动终端100-1检测到用户点击如图7I所示的成员角色的753选项的操作，响应于该操作，移动终端100-1会显示如图7J所示的成员角色的详情页的用户界面76。When the mobile terminal 100-1 detects that the user clicks the operation of option 753 of the member role as shown in Figure 7I, in response to the operation, the mobile terminal 100-1 will display the user interface of the details page of the member role as shown in Figure 7J 76.
图7J示例性示出小华对应的成员信息详情页。Fig. 7J exemplarily shows the detailed page of member information corresponding to Xiao Hua.
如图7J所示，用户界面76包括：创建者选项761、管理员选项762、普通用户选项763、儿童；老人选项764、关闭图标765A以及完成图标765B等等。此外，上述各个角色的选项还对应显示有不同角色所对应的权限。例如，创建者的拥有最高权限，其可以管理家庭所有成员，包括管理员、普通用户、儿童、老人等，还可以管理并使用所有家庭设备。管理员拥有的权限仅次于创建者，其可以管理家庭所有成员，包括管理员、普通用户、儿童、老人等，还可以管理并使用所有家庭设备。As shown in FIG. 7J , the user interface 76 includes: a creator option 761 , an administrator option 762 , an ordinary user option 763 , a child; an elderly option 764 , a close icon 765A, a finish icon 765B, and the like. In addition, the options for each of the above roles also display the permissions corresponding to different roles. For example, the creator has the highest authority, which can manage all members of the family, including administrators, ordinary users, children, the elderly, etc., and can also manage and use all family devices. Administrators have permissions second only to creators, who can manage all members of the family, including administrators, ordinary users, children, the elderly, etc., as well as manage and use all family devices.
移动终端100-1可以检测到用户点击图7J所示的选项762的操作，响应于该操作，移动终端100-1选中的成员角色为“管理员”，然后移动终端100-1可以检测到作用于图标765B的操作，响应于该操作，移动终端100-1会跳转至显示如图7K所示的成员信息详情页的用户界面75。Mobile terminal 100-1 can detect that the user clicks the operation of option 762 shown in FIG. In response to the operation of the icon 765B, the mobile terminal 100-1 will jump to the user interface 75 displaying the detailed page of member information as shown in FIG. 7K .
可以理解的是，图7J示出的成员角色的分类仅为一种示例，不应构成对本身实施例的限制。在本申请另一些实施例中，移动终端还可以将成员角色划分为更多或者更少的类型，例如还可以包含家庭访客，或者还可以将儿童和老人细分为两种角色，本申请实施例对此不作限制。It can be understood that the classification of member roles shown in FIG. 7J is only an example, and should not be construed as a limitation to the embodiment itself. In some other embodiments of the present application, the mobile terminal can also divide the member roles into more or less types, for example, family visitors can also be included, or children and the elderly can also be subdivided into two roles. Examples are not limited to this.
如图7K所示，用户界面75显示的成员角色由原来图7I所示的“普通用户”变为“管理员”。As shown in FIG. 7K, the member role displayed on the user interface 75 is changed from the original "common user" shown in FIG. 7I to "administrator".
移动终端100-1可以检测到用户点击图7K所示的选项754的操作，响应于该操作，移动终端100-1会显示如图7L所示的成员房间详情页的用户界面77。The mobile terminal 100-1 may detect that the user clicks the option 754 shown in FIG. 7K, and in response to the operation, the mobile terminal 100-1 will display the user interface 77 of the member room details page as shown in FIG. 7L.
图7L示例性示出小华对应的成员房间详情页。Fig. 7L exemplarily shows the member room details page corresponding to Xiaohua.
如图7L所示，用户界面77包括：关闭图标771A、完成图标771B列表项653A、列表项772、列表项773、列表项774、列表项775、列表项776、列表项777、列表项778以及列表项779等。上述列表项所对应的房间分别为卧室A、卧室B、卧室C、客厅、厨房、书房、健身房、娱乐室等。当列表项的数量超过预设数量例如10时，用户可以通过上下滑动用户界面77以浏览未示出的列表项。As shown in Figure 7L, user interface 77 comprises: closing icon 771A, completion icon 771B list item 653A, list item 772, list item 773, list item 774, list item 775, list item 776, list item 777, list item 778 and List item 779 etc. The rooms corresponding to the above list items are bedroom A, bedroom B, bedroom C, living room, kitchen, study room, gymnasium, entertainment room and so on. When the number of list items exceeds a preset number such as 10, the user can browse the list items not shown by sliding the user interface 77 up and down.
移动终端100-1可以检测到用户点击图7L所示的列表项772、列表项775、列表项776、列表项777、列表项778以及列表项779等的操作，响应于该操作，移动终端100-1选中的成员房间为卧室B、客厅、厨房、书房、健身房、娱乐室等，然后移动终端100-1可以检测到作用于图标771B的操作，响应于该操作，移动终端100-1会跳转至显示如图7M所示的成员信息详情页的用户界面75。The mobile terminal 100-1 may detect that the user clicks on the list item 772, list item 775, list item 776, list item 777, list item 778, and list item 779 shown in FIG. -1 The selected member rooms are bedroom B, living room, kitchen, study room, gymnasium, entertainment room, etc., then mobile terminal 100-1 can detect the operation acting on icon 771B, and in response to this operation, mobile terminal 100-1 will jump Go to the user interface 75 displaying the member information details page as shown in FIG. 7M.
如图7M所示，用户界面75显示的成员房间由原来图7K默认的“全部”变为“卧室B、客厅、厨…”。As shown in FIG. 7M , the member rooms displayed on the user interface 75 are changed from the default "all" in Fig. 7K to "bedroom B, living room, kitchen...".
上文图7I-图7M介绍了设置小华的家庭角色的示例性操作，由于小华为该家庭的妈妈，所以将其设置为管理员，以便小华管理家庭设备以及家庭成员。接下来以爷爷小明为例，由于爷爷年迈，行动不便，因此小中欲将爷爷小明的成员角色设为“儿童；老人”，具体示例如下。Figures 7I-7M above describe the exemplary operation of setting Xiaohua's family role. Since Xiaohua is the mother of the family, she is set as an administrator so that Xiaohua can manage family devices and family members. Next, take grandpa Xiaoming as an example. Because grandpa is old and has limited mobility, Xiaozhong wants to set the member role of grandpa Xiaoming as "child; old man". The specific example is as follows.
移动终端100-1可以检测到用户点击图7M所示的返回控件的操作，响应于该操作，移动终端100-1跳转至显示如图7N所示的家庭成员详情页的用户界面72。The mobile terminal 100-1 may detect the user's operation of clicking the return control shown in FIG. 7M , and in response to the operation, the mobile terminal 100-1 jumps to the user interface 72 displaying the family member details page as shown in FIG. 7N .
关于图7N所示内容的描述可以参考上文对图7H的介绍，具体的，此时的家庭成员详情页显示有：成员小中的选项721、成员小华的选项723、成员小明的选项724、成员小红的选项725、成员小爱的选项726、成员小雨的选项727、成员小雪的选项728等。值得注意的是，除了成员小中的选项721对应显示的角色为“创建者”外，其余新添加的成员的角色均默认为“普通用户”。关于“普通用户”的定义具体可以参考前文对家庭涉及的相关概念的描述吗，在此暂不赘述。用户可以通过点击上述家庭成员的选项来设置家庭成员分别担任的角色、以及房间等。For the description of the content shown in Figure 7N, please refer to the introduction to Figure 7H above. Specifically, the family member details page at this time displays: the option 721 of the member Xiao, the option 723 of the member Xiaohua, and the option 724 of the member Xiaoming , option 725 for member Xiaohong, option 726 for member Xiaoai, option 727 for member Xiaoyu, option 728 for member Xiaoxue, etc. It is worth noting that, except that option 721 in the members list corresponds to the displayed role as "creator", the default roles of other newly added members are "common user". For the definition of "ordinary user", can you refer to the previous description of the related concepts involved in the family, so I won't go into details here. The user can set the respective roles and rooms of the family members by clicking on the options of the above-mentioned family members.
移动终端100-1可以检测到用户点击图7N所示的成员小明的选项724的操作，响应于该操作，移动终端100-1显示如图7O所示的小明对应的成员信息详情页的用户界面75。The mobile terminal 100-1 may detect that the user clicks on the option 724 of the member Xiao Ming shown in FIG. 7N, and in response to this operation, the mobile terminal 100-1 displays the user interface of the member information details page corresponding to Xiao Ming as shown in FIG. 7O 75.
图7O示例性示出小明对应的成员信息详情页。FIG. 7O exemplarily shows the member information details page corresponding to Xiao Ming.
如图7O所示，用户界面75包括：华为账号751、成员名752、成员角色753、成员房间754、移除成员控件755等等。值得注意的是，成员角色753默认为普通用户、成员房间754、默认为全部房间。用户可以通过点击成员角色753、成员房间754选项来制定小华的角色、以及房间。As shown in FIG. 70 , the user interface 75 includes: Huawei account number 751 , member name 752 , member role 753 , member room 754 , remove member control 755 and so on. It should be noted that the member role 753 defaults to common user, the member room 754 defaults to all rooms. The user can formulate Xiao Hua's role and room by clicking on the member role 753 and the member room 754 option.
当移动终端100-1检测到用户点击如图7O所示的成员角色的753选项的操作，响应于该操作，移动终端100-1会显示如图7P所示的成员角色的详情页的用户界面76。When the mobile terminal 100-1 detects that the user clicks the operation of option 753 of the member role as shown in Figure 7O, in response to the operation, the mobile terminal 100-1 will display the user interface of the details page of the member role as shown in Figure 7P 76.
图7P示例性示出小明对应的成员信息详情页。FIG. 7P exemplarily shows the member information details page corresponding to Xiao Ming.
如图7P所示，用户界面76包括：创建者选项761、管理员选项762、普通用户选项763、儿童；老人选项764、关闭图标765A以及完成图标765B等等。此外，上述各个角色的选项还对应显示有不同角色所对应的权限。例如，创建者的拥有最高权限，其可以管理家庭所有成员，包括管理员、普通用户、儿童、老人等，还可以管理并使用所有家庭设备。管理员拥 有的权限仅次于创建者，其可以管理家庭所有成员，包括管理员、普通用户、儿童、老人等，还可以管理并使用所有家庭设备。As shown in FIG. 7P , the user interface 76 includes: a creator option 761 , an administrator option 762 , an ordinary user option 763 , a child; an elderly option 764 , a close icon 765A, a finish icon 765B, and the like. In addition, the options for each of the above roles also display the permissions corresponding to different roles. For example, the creator has the highest authority, which can manage all members of the family, including administrators, ordinary users, children, the elderly, etc., and can also manage and use all family devices. The authority of the administrator is second only to the creator. It can manage all members of the family, including administrators, ordinary users, children, the elderly, etc., and can also manage and use all family devices.
移动终端100-1可以检测到用户点击图7P所示的选项764的操作，响应于该操作，移动终端100-1选中的成员角色为“儿童；老人”，然后移动终端100-1可以检测到作用于图标765B的操作，响应于该操作，移动终端100-1会跳转至显示如图7Q所示的成员信息详情页的用户界面75。Mobile terminal 100-1 can detect that the user clicks the operation of option 764 shown in FIG. Acting on the operation of icon 765B, in response to this operation, mobile terminal 100-1 will jump to user interface 75 displaying the member information details page as shown in FIG. 7Q.
如图7Q所示，用户界面75显示的成员角色由原来图7O所示的“普通用户”变为“儿童；老人”。As shown in FIG. 7Q , the member role displayed on the user interface 75 is changed from "ordinary user" as shown in FIG. 7O to "child; old man".
移动终端100-1可以检测到用户点击图7Q所示的选项754的操作，响应于该操作，移动终端100-1会显示如图7R所示的成员房间详情页的用户界面77。The mobile terminal 100-1 may detect that the user clicks the option 754 shown in FIG. 7Q, and in response to the operation, the mobile terminal 100-1 will display the user interface 77 of the member room details page as shown in FIG. 7R.
图7R示例性示出小明对应的成员房间详情页。FIG. 7R exemplarily shows the member room details page corresponding to Xiao Ming.
如图7R所示，用户界面77包括：关闭图标771A、完成图标771B列表项653A、列表项772、列表项773、列表项774、列表项775、列表项776、列表项777、列表项778以及列表项779等。上述列表项所对应的房间分别为卧室A、卧室B、卧室C、客厅、书房、健身房、娱乐室等。当列表项的数量超过预设数量例如10时，用户可以通过上下滑动用户界面65以浏览未示出的列表项。As shown in Figure 7R, user interface 77 comprises: close icon 771A, complete icon 771B list item 653A, list item 772, list item 773, list item 774, list item 775, list item 776, list item 777, list item 778 and List item 779 etc. The rooms corresponding to the above list items are bedroom A, bedroom B, bedroom C, living room, study room, gymnasium, entertainment room and so on. When the number of list items exceeds a preset number such as 10, the user can browse the list items not shown by sliding the user interface 65 up and down.
值得注意的是，由于上文图7P所示的，小明的成员角色被设置为“儿童；老人”，儿童、老人是相对于青少年、中年人来说，行为不便，所以一些存在危险的行为例如使用厨房中的电器等需要被禁止。因此，图7R所示的选项776即厨房选项默认不能被选择。It is worth noting that, as shown in Figure 7P above, Xiao Ming’s member roles are set as “children; elderly people”. Compared with teenagers and middle-aged people, children and elderly people have inconvenient behaviors, so some dangerous behaviors For example, the use of electrical appliances in the kitchen needs to be prohibited. Therefore, the option 776 shown in FIG. 7R, the kitchen option, cannot be selected by default.
移动终端100-1可以检测到用户点击图7R所示的列表项773、列表项775、列表项777、列表项778以及列表项779等的操作，响应于该操作，移动终端100-1选中的成员房间为卧室B、客厅、厨房、书房、健身房、娱乐室等，然后移动终端100-1可以检测到作用于图标771B的操作，响应于该操作，移动终端100-1会跳转至显示如图7S所示的成员信息详情页的用户界面75。The mobile terminal 100-1 may detect that the user clicks on the list item 773, the list item 775, the list item 777, the list item 778, and the list item 779 shown in FIG. Member rooms are bedroom B, living room, kitchen, study room, gymnasium, entertainment room, etc. Then mobile terminal 100-1 can detect the operation acting on icon 771B, and in response to this operation, mobile terminal 100-1 will jump to display such as The user interface 75 of the member information details page shown in FIG. 7S.
如图7S所示，用户界面75显示的成员房间由原来图7Q默认的“全部”变为“卧室B、客厅、书…”。As shown in FIG. 7S , the member rooms displayed on the user interface 75 are changed from the default "all" in Fig. 7Q to "bedroom B, living room, book...".
之后，用户还可以通过上文图7I-图7S所述的方式来设置成员的角色、房间，最终将小中家中的所有成员例如上文提到的奶奶小红(小红年龄小于小明，行动方便)的角色设置为“管理员”，房间为卧室B、客厅、厨房、书房、健身房、娱乐室；小爱(小爱还是儿童)的角色设置“儿童；老人”，房间为卧室C、客厅、书房、健身房、娱乐室；小雨、小雪等因为是临时家庭成员，所以将他们的角色设置为“普通用户”，房间仅为家中的公共区域例如客厅、厨房、健身房、娱乐室。由于书房通常放置家主的贵重文件，所以不对临时用户及家政人员或者家庭教师开放。Afterwards, the user can also set the roles and rooms of the members in the manner described in Figure 7I-7S above, and finally all the members of Xiaozhong's family, such as the grandmother Xiaohong mentioned above (Xiaohong's age is younger than Xiaoming, and the action Convenience) role is set to "Administrator", the room is bedroom B, living room, kitchen, study, gym, entertainment room; Xiaoai (Xiaoai is still a child) role is set to "Children; Elderly", the room is bedroom C, living room , study room, gym, entertainment room; Xiaoyu, Xiaoxue, etc. are temporary family members, so their roles are set as "ordinary users", and the rooms are only public areas in the home such as living room, kitchen, gym, and entertainment room. Since the study room usually houses the valuable documents of the owner, it is not open to temporary users, housekeepers or tutors.
如图7T所示，图7T示例性示出小中将家中所有成员进行角色设置一家房间划分的用户界面示意图。可见，此时家庭成员详情页显示有：成员小中的选项721、成员小华的选项723、成员小明的选项724、成员小红的选项725、成员小爱的选项726、成员小雨的选项727、成员小雪的选项728等。值得注意的是，成员小中的选项721对应显示的角色为“创建者”，其小华的角色为“管理员”，成员小明的角色为“儿童；老人”，成员小红的角色为“管理员”，小爱的角色为“儿童；老人”，小雨和小雪的角色为“普通用户”。用户可以通过点击上述家庭成员的选项来重新设置即更改其中任意一个家庭成员担任的角色、以及房间等。As shown in FIG. 7T , FIG. 7T exemplarily shows a schematic diagram of a user interface in which all members of a family are assigned roles and divided into a room. It can be seen that the details page of family members at this time shows: option 721 of member Xiaozhong, option 723 of member Xiaohua, option 724 of member Xiaoming, option 725 of member Xiaohong, option 726 of member Xiaoai, option 727 of member Xiaoyu , member Xiaoxue's option 728, etc. It is worth noting that the option 721 in the member list corresponds to the role displayed as "creator", the role of Xiaohua is "administrator", the role of member Xiaoming is "child; old man", and the role of member Xiaohong is " Administrator", Xiao Ai's role is "Child; Elderly", and Xiaoyu and Xiaoxue's roles are "Ordinary User". The user can click on the options of the above-mentioned family members to reset, that is, to change the role, room, etc. of any one of the family members.
可以理解的是，对家庭设备的使用权限设置除了通过上文图7I-图7T示例性通过划分房间的方式使得不同角色的成员仅使用属于该角色的一个或多个房间中的设备以外，还可以设置家庭成员使用一个或多个房间中任意一个或多个设备的权限。也就是说，家庭设备的权限不只是以一个房间的所有设备为单位来划分，也可以具体以房间的某个设备或者某类设备为单元进行划分，本申请实施例对设备使用权限的划分此不作限制。It can be understood that, in addition to setting the use authority of the family device through the way of dividing the room as an example in Fig. 7I-Fig. You can set permissions for family members to use any one or more devices in one or more rooms. That is to say, the permissions of home devices are not only divided by all the devices in a room, but also can be divided by a certain device or a certain type of device in the room. The division of device use rights in this embodiment of the present application is No limit.
上文图6A-图6V介绍的用户在智慧家庭APP中输入的注册信息后，以及图7A-图7T介绍的用户在智慧家庭APP中添加的家庭成员的相关信息后，电子设备则会收集用户的注册信息，以及家庭成员信息等等。即前文数据银行系统提及的用户数据的收集，关于用户数据收集的方法在此暂不赘述，具体可以参考前文对数据银行系统的介绍。After the user enters the registration information in the smart home APP described in Figure 6A-Figure 6V above, and the relevant information of family members added by the user in the smart home APP introduced in Figure 7A-Figure 7T, the electronic device will collect the user's registration information, as well as family member information and so on. That is, the collection of user data mentioned in the previous data bank system. The method of user data collection is not described here. For details, please refer to the introduction to the data bank system above.
基于上文图6A-图6V示例性示出的为小中的家添加家庭设备，并设置家庭设备所属房间的操作界面，以及上文图7A-图7T示例性示出的为小中的家添加家庭成员，并设置家庭成员担任的角色以及家庭成员的房间等的操作界面。接下来介绍用户使用家庭设备的UI实施例。Based on the above-mentioned Figure 6A-Figure 6V exemplarily shown to add a home device for a small home, and set the operation interface of the room to which the home device belongs, and the above-mentioned Figure 7A-Figure 7T exemplarily shown for a small home Add family members, and set the roles of family members and the operation interface of family members' rooms. Next, the UI embodiment of the user using the home device will be introduced.
在本申请实施例中，为了确保家庭成员仅可以使用权限范围内的家庭设备，在用户使用家庭设备时，需要对使用者进行身份认证，判断使用者是否具备使用该家庭设备的权限。这样，可以避免不具备家庭设备使用权限的人，执行一些危险操作，或者是恶意操作等。例如为了避免老人或者儿童使用危险电器，或者是家庭访客等使用家庭中的隐私设备，例如保险贵等，给家庭带来损失。In the embodiment of the present application, in order to ensure that family members can only use family devices within the scope of authority, when a user uses a family device, the user needs to be authenticated to determine whether the user has the authority to use the family device. In this way, people who do not have permission to use the home device can be prevented from performing some dangerous or malicious operations. For example, in order to prevent the elderly or children from using dangerous electrical appliances, or family visitors from using private devices in the family, such as expensive insurance, etc., which will bring losses to the family.
接下来先以小中和小中的移动终端100-1为例，结合图8A-图8E介绍用户设置身份认证方式的初始化操作。Next, taking the small medium and the mobile terminal 100-1 of the small medium as an example, the initialization operation of setting the identity authentication mode for the user will be introduced with reference to FIGS. 8A-8E .
图8A-图8E示例性示出用户设置身份认证方式的初始化操作界面示意图。8A-8E exemplarily show a schematic diagram of an initialization operation interface for a user to set an identity authentication mode.
图8A示例性示出智慧家庭APP的首页。Fig. 8A exemplarily shows the home page of the smart home APP.
如图8A所示，图8A示出的用户界面与前文图6K示出的用户界面类似，前文对图6K的介绍适用于对图8A的介绍，在此暂不赘述。As shown in FIG. 8A , the user interface shown in FIG. 8A is similar to the user interface shown in FIG. 6K above. The introduction to FIG. 6K above is applicable to the introduction to FIG. 8A , and details will not be repeated here.
移动终端100-1可以检测到用户点击图8A中页面导航栏615中的我的选项615D，响应于该操作，移动终端100-1显示如图8B所示的用户界面81。The mobile terminal 100-1 may detect that the user clicks the My option 615D in the page navigation bar 615 in FIG. 8A, and in response to this operation, the mobile terminal 100-1 displays the user interface 81 as shown in FIG. 8B.
图8B示例性示出智慧家庭APP提供的“我的”页面。Fig. 8B exemplarily shows the "My" page provided by the smart home APP.
如图8B所示，用户界面81显示有：选项811、选项812、选项813、选项814、选项815、选项816、选项817以及选项818等。其中选项选项811用于打开“我”的详情页，该页面具体为用户提供账号名称、密码、绑定手机号码、免密认证等的服务；选项812用于打开我的家庭页面，该页面具体为用户提供添加、移除家庭成员等服务；选项813用于打开我的主设备的用户界面，该页面具体可以为用户提供更改主设备的操作，一般主设备默认是当前登录智慧家庭APP的设备，即本机；选项814用于打开我的其他设备页面，该页面具体可以为用户提供管理用户的其他设备例如平板、笔记本、手环、耳机等功能；选项815用于打开我的二维码页面，该页面为用户提供标识当前智慧家庭APP账号的二维码，其他终端通过扫描该二维码可以将二维码标识的用户添加为家庭成员或者好友；选项816用于打开连接三方平台的用户界面，该页面具体可以为用户提供与智慧家庭APP合作的其他家庭设备制造商、运营商等提供的平台；选项817用于打开设置页面，该页面为用户提供设置智慧家庭APP的常用功能的服务；选项818用于打开帮助页面，该页面具体包括提示用户使用智慧家庭APP的方法以及注意事项等等。As shown in FIG. 8B , the user interface 81 displays: an option 811 , an option 812 , an option 813 , an option 814 , an option 815 , an option 816 , an option 817 , and an option 818 . Among them, option 811 is used to open the details page of "I", which specifically provides users with services such as account name, password, bound mobile phone number, password-free authentication, etc.; option 812 is used to open my home page, which specifically Provide users with services such as adding and removing family members; option 813 is used to open the user interface of my main device. This page can specifically provide users with operations to change the main device. Generally, the main device defaults to the device currently logged into the smart home APP , that is, this machine; option 814 is used to open my other devices page, which can specifically provide users with functions to manage other devices of the user such as tablets, notebooks, wristbands, earphones, etc.; option 815 is used to open my QR code page, which provides the user with a QR code that identifies the current smart home APP account, and other terminals can scan the QR code to add the user identified by the QR code as a family member or friend; option 816 is used to open the connection to the third-party platform. User interface, this page can specifically provide users with platforms provided by other home equipment manufacturers, operators, etc. that cooperate with the smart home APP; option 817 is used to open the setting page, which provides users with settings for common functions of the smart home APP Service; option 818 is used to open the help page, which specifically includes prompting the user to use the smart home APP method and precautions and so on.
移动终端100-1可以检测到用户点击图8B中选项811的操作，响应于该操作，移动终端100-1显示如图8C所示的用户界面82。The mobile terminal 100-1 may detect the user's operation of clicking option 811 in FIG. 8B, and in response to the operation, the mobile terminal 100-1 displays the user interface 82 as shown in FIG. 8C.
如图8C所示，用户界面82显示有：选项821、选项822、选项823以及选项824等，上述选项分别对应用户的账户名、绑定的手机号码、账户对应的登录密码、免密认证等等。As shown in FIG. 8C , the user interface 82 displays: option 821, option 822, option 823, option 824, etc., and the above options correspond to the user's account name, bound mobile phone number, login password corresponding to the account, password-free authentication, etc. wait.
移动终端100-1可以检测到用户点击图8C中选项824的操作，响应于该操作，移动终端100-1显示如图8D所示的用户界面83。The mobile terminal 100-1 may detect the user's operation of clicking the option 824 in FIG. 8C, and in response to the operation, the mobile terminal 100-1 displays the user interface 83 as shown in FIG. 8D.
如图8D所示，用户界面83显示有：选项831、选项832以及选项833等，上述选项分别对应指纹认证、人脸认证以及声纹认证等等。用户可以通过点击上述任意一个或多个选项，开启对应的认证方式。值得注意的是，图8D仅仅示例性示出3种常用的认证方式，在本申请实施例中移动终端100-1可以提供更多或者更少的认证方式，本申请对此不作限制。As shown in FIG. 8D , the user interface 83 displays: an option 831 , an option 832 , and an option 833 , etc., which respectively correspond to fingerprint authentication, face authentication, and voiceprint authentication. Users can click any one or more of the above options to enable the corresponding authentication method. It should be noted that FIG. 8D only exemplarily shows three commonly used authentication methods, and in the embodiment of the present application, the mobile terminal 100-1 may provide more or less authentication methods, which is not limited in the present application.
当移动终端100-1检测到用户开启上述身份认证后，可以显示图8E所示的用户界面，具体的用户界面83显示的选项831、选项832以及选项833，分别对应显示已开启的提示信息，用于提示用户该身份认证方式已经开启。When the mobile terminal 100-1 detects that the user has enabled the above-mentioned identity authentication, it can display the user interface shown in FIG. 8E , and the specific user interface 83 displays option 831, option 832, and option 833, correspondingly displaying the prompt information that has been enabled, It is used to prompt the user that the identity authentication method has been enabled.
在本申请实施例中，移动终端100-1可以支持多种身份认证的方式，例如：密码认证基于生物特征、行为特征的身份认证等。其中，生物认证方式可以包括：人脸认证、指纹认证、掌纹认证、虹膜认证、视网膜认证、以及基于光电容积脉搏波(photoelectric plethysmography，PPG)信号进行身份认证等。行为认证方式可以包括：基于步态、笔迹、唇动、声音，以及按键力度等的认证。密码认证又可以包括：字符密码认证、图案密码认证等。本申请实施例对移动终端100-1所支持的身份认证方式不作限制。In the embodiment of the present application, the mobile terminal 100-1 may support multiple identity authentication methods, for example: password authentication based on biometric features, identity authentication based on behavioral features, and the like. Among them, the biometric authentication methods may include: face authentication, fingerprint authentication, palmprint authentication, iris authentication, retina authentication, and identity authentication based on photoelectric plethysmography (PPG) signals, etc. Behavior authentication methods may include: authentication based on gait, handwriting, lip movement, voice, and key press force. Password authentication may further include: character password authentication, pattern password authentication, and the like. The embodiment of the present application does not limit the identity authentication methods supported by the mobile terminal 100-1.
当检测到用于触发移动终端100-1进行身份认证的操作后，移动终端100-1可以根据周围环境和/或用户状态，优先开启认证成功率高于阈值的生物认证和行为认证方式。进一步的，当认证成功率高于阈值的生物认证和行为认证方式包含多种时，移动终端100-1可以根据预设优先级由高到底的顺序，先开启其中高优先级的生物认证或行为认证，当高优先级生物认证或行为认证失败，则移动终端100-1再开启低优先级的生物认证或行为认证。若其中任意一种生物认证或行为认证方式认证成功，则移动终端100-1确定身份认证成功，若其中所有生物认证方式和行为认证方式都认证失败，则移动终端100-1开启密码认证，直至用户输入的密码与预置密码匹配时，则确定身份认证成功，若不匹配则确定身份认证失败。After detecting the operation for triggering the mobile terminal 100-1 to perform identity authentication, the mobile terminal 100-1 can preferentially enable the biometric authentication and behavioral authentication modes with authentication success rate higher than the threshold according to the surrounding environment and/or user status. Further, when there are multiple biometric authentication and behavioral authentication methods whose authentication success rate is higher than the threshold, the mobile terminal 100-1 can first enable the biometric authentication or behavioral authentication with a higher priority according to the preset priority order from high to low. authentication, when the high-priority biometric authentication or behavioral authentication fails, the mobile terminal 100-1 starts the low-priority biometrics authentication or behavioral authentication again. If any one of the biometric authentication or behavioral authentication methods is successfully authenticated, the mobile terminal 100-1 determines that the identity authentication is successful; if all the biometric authentication methods and behavioral authentication methods fail to be authenticated, the mobile terminal 100-1 starts password authentication until When the password entered by the user matches the preset password, it is determined that the identity authentication is successful, and if it does not match, it is determined that the identity authentication fails.
上述生物认证和行为认证优先级，可以是移动终端100-1默认设置的，也可以由用户自定义，本申请实施例对此不作限制。The above biometric authentication and behavioral authentication priorities may be set by default by the mobile terminal 100-1, or may be customized by the user, which is not limited in this embodiment of the present application.
在本申请实施例中，当移动终端100-1根据周围环境和/或用户状态，关闭认证成功率低于阈值的生物认证和行为认证方式，开启认证成功率高于阈值的生物认证和行为认证方式后，移动终端100-1可以根据采集到开启的认证方式所对应的用户数据来识别用户身份，或者将采集到的该认证方式对应的用户数据传输至服务器300处，由服务器300来识别用户身份，并将识别结果下发至移动终端100，本申请实施例对此不作限制。In this embodiment of the application, when the mobile terminal 100-1 disables biometric authentication and behavioral authentication with authentication success rate lower than the threshold according to the surrounding environment and/or user status, and turns on biometric authentication and behavioral authentication with authentication success rate higher than the threshold After completing the authentication method, the mobile terminal 100-1 can identify the user identity according to the collected user data corresponding to the enabled authentication method, or transmit the collected user data corresponding to the authentication method to the server 300, and the server 300 can identify the user. identity, and deliver the identification result to the mobile terminal 100, which is not limited in this embodiment of the present application.
此外，移动终端100-1根据周围环境和/或用户状态，关闭认证成功率低于阈值的生物认证和行为认证方式，开启认证成功率高于阈值的生物认证和行为认证方式具体可以采用以下两种方式：In addition, according to the surrounding environment and/or user status, the mobile terminal 100-1 disables the biometric authentication and behavior authentication methods whose authentication success rate is lower than the threshold value, and enables the biometric authentication and behavior authentication method whose authentication success rate is higher than the threshold value. ways:
在一种实现方式中，移动终端100-1预先关联存储不同周围环境和/或用户状态对应的身份认证方式，当移动终端100-1采集到周围环境和/或用户状态相关的数据后，移动终端100-1 端可以匹配与该数据对应的认证方式。In one implementation, the mobile terminal 100-1 pre-associates and stores identity authentication methods corresponding to different surrounding environments and/or user states. After the mobile terminal 100-1 collects data related to the surrounding environment and/or user states, the mobile Terminal 100-1 can match the authentication mode corresponding to the data.
在另一种实现方式中，移动终端100-1采集到周围环境和/或用户状态相关的数据后，将该数据发送至服务器以请求采用的认证方式，服务器根据该数据计算各个认证方式对应的认证成功率，并将成功率高于阈值的认证方式发送至移动终端100-1，移动终端100-1开启该认证方式，关闭其他认证方式。In another implementation, after the mobile terminal 100-1 collects data related to the surrounding environment and/or user status, it sends the data to the server to request the authentication method adopted, and the server calculates the corresponding authentication method for each authentication method based on the data. The authentication success rate, and send the authentication mode whose success rate is higher than the threshold to the mobile terminal 100-1, and the mobile terminal 100-1 enables the authentication mode and disables other authentication modes.
接下来以成员小中、小中的移动终端100-1、成员小明、小明的移动终端100-3为例，结合图8F-图8N示例性示出家庭成员通过智慧家庭APP控制家庭设备的用户界面。Next, taking the mobile terminals 100-1 of members Xiaozhong and Xiaozhong, and the mobile terminals 100-3 of members Xiaoming and Xiaoming as examples, and referring to Fig. 8F-Fig. interface.
家庭成员可以打开移动终端100中安装的智慧家庭APP，通过点击在首页中显示的家庭设备的图标，打开对应的家庭设备详情页，查看家庭设备的当前状态，以及输入用于控制家庭设备的操作，在移动终端识别到当前用户的身份，并确定该用户具有控制该家庭设备的权限时，才会控制家庭设备的执行对应的功能。Family members can open the smart home APP installed in the mobile terminal 100, click the icon of the home device displayed on the home page, open the corresponding home device details page, check the current status of the family device, and input the operation for controlling the family device When the mobile terminal recognizes the identity of the current user and determines that the user has the right to control the home device, it will control the home device to execute the corresponding function.
值得注意的是，家庭成员通过在移动终端100安装的智慧家庭APP中控制、使用家庭设备时，移动终端100所处位置可能与家庭设备的通信距离小于阈值，例如移动终端100在家庭范围内，也可能与家庭设备的通信距离大于阈值，例如用户离家，在公司，或者在从公司回家的上等等。当家庭成员通过在移动终端100安装的智慧家庭APP中控制、使用家庭设备时，移动终端100所处位置与家庭设备200的通信距离小于阈值时，移动终端100可以直接控制家庭设备200，或者也可以通过服务器300控制家庭设备200。当家庭成员通过在移动终端100安装的智慧家庭APP中控制、使用家庭设备时，移动终端100所处位置与家庭设备200的通信距离大于阈值时，移动终端100必须通过服务器300控制家庭设备200。也就是说，智慧家庭APP支持的远程控制家庭设备200。It is worth noting that when family members control and use the home device through the smart home APP installed on the mobile terminal 100, the communication distance between the location of the mobile terminal 100 and the home device may be less than a threshold, for example, the mobile terminal 100 is within the range of the home, It is also possible that the communication distance with the home device is greater than the threshold, for example, the user is away from home, in the company, or on the phone returning home from the company, and so on. When family members control and use the home device through the smart home APP installed on the mobile terminal 100, and the communication distance between the location of the mobile terminal 100 and the home device 200 is less than a threshold, the mobile terminal 100 can directly control the home device 200, or The home device 200 can be controlled through the server 300 . When family members control and use the home device through the smart home APP installed on the mobile terminal 100, and the communication distance between the location of the mobile terminal 100 and the home device 200 is greater than a threshold, the mobile terminal 100 must control the home device 200 through the server 300. That is to say, the remote control home device 200 supported by the smart home APP.
首先，图8F-图8I示例性示出家庭成员小中使用家庭设备的操作界面示意图。First, FIG. 8F-FIG. 8I exemplarily show a schematic diagram of an operation interface for using a family device in a family member group.
图8F示例性示出小中的移动终端100-1安装的智慧家庭APP的首页。FIG. 8F exemplarily shows the homepage of the smart home APP installed on the mobile terminal 100-1 of the small medium.
如图8F所示，图8F示出的用户界面61与前文图6K示出的用户界面61类似，前文对图6K的介绍适用于对图8F的介绍，在此暂不赘述。As shown in FIG. 8F , the user interface 61 shown in FIG. 8F is similar to the user interface 61 shown in FIG. 6K above. The introduction to FIG. 6K above is applicable to the introduction to FIG. 8F , and details are not repeated here.
移动终端100-1可以检测到用户点击图8F中设备显示区614中电饭煲对应的设备图标的操作，响应于该操作，移动终端100-1显示如图8G所示的用户界面84。The mobile terminal 100-1 may detect that the user clicks the device icon corresponding to the rice cooker in the device display area 614 in FIG. 8F , and in response to the operation, the mobile terminal 100-1 displays the user interface 84 as shown in FIG. 8G .
图8G示例性示出电饭煲对应的设备详情页。FIG. 8G exemplarily shows a device details page corresponding to a rice cooker.
如图8G所示，图8G示出的用户界面84显示一系列用于控制电饭煲的选项，例如开关选项841、模式选项842、预约时间选项843等。其中，开关选项841对应用于开启电饭煲有控件，模式选项842对应显示有用于切换电饭煲的工作模式的控件，以及预约时间选项843对应显示有用于设置电饭煲的工作时间的控件等。As shown in FIG. 8G , the user interface 84 shown in FIG. 8G displays a series of options for controlling the rice cooker, such as switch option 841 , mode option 842 , appointment time option 843 and so on. Among them, the switch option 841 corresponds to a control for turning on the rice cooker, the mode option 842 corresponds to a control for switching the working mode of the rice cooker, and the appointment time option 843 corresponds to a control for setting the working time of the rice cooker.
由于移动终端100-1的用户小中是该家庭的创建者，小中拥有该家庭的最高权限，也就是说小中可以管理、使用所有家庭设备包括上文所述的电饭煲。但是，为了避免非小中本人的其他用户使用小中的移动终端100-1来控制家中电子设备，移动终端100-1在检测到使用者输入触发移动终端100-1控制家庭设备的操作，会开启身份认证功能对当前使用者的进行身份认证。例如，移动终端100-1可以检测到用户点击图8G所示的选项841对应的开启电饭煲的控件的操作，响应于该操作，移动终端开启身份认证功能。并确定当前使用者所属身份是否具备使用该电子设备即台灯的权限，若具备权限，则正常响应并执行使用者输入的操作；当移动终端100-1检测到当前使用者的身份不具备使用电饭煲的权限，则提示当前使用者不可执行控制、使用电饭煲，并不再执行使用者输入的操作。Since Xiao Zhong, the user of the mobile terminal 100-1, is the creator of the family, Xiao Zhong has the highest authority of the family, that is to say, Xiao Zhong can manage and use all family devices including the rice cooker mentioned above. However, in order to prevent other users who are not Xiaozhong himself from using Xiaozhong's mobile terminal 100-1 to control home electronic devices, when the mobile terminal 100-1 detects that the user input triggers the operation of the mobile terminal 100-1 to control the home device, it will Enable the authentication function to authenticate the current user. For example, the mobile terminal 100-1 may detect that the user clicks on the control for turning on the rice cooker corresponding to the option 841 shown in FIG. 8G , and in response to the operation, the mobile terminal turns on the identity authentication function. And determine whether the current user's identity has the authority to use the electronic device, that is, the desk lamp, and if it has the authority, then respond normally and execute the operation input by the user; when the mobile terminal 100-1 detects that the current user's identity does not have the authority to use the rice cooker If the authority is set, the current user will be prompted not to perform control, use the rice cooker, and no longer perform the operations entered by the user.
在本申请实施例另一些实施例中，触发移动终端100-1开启身份认证的操作，不限于上述用于控制家庭设备的操作，还可以是移动终端100-1检测到用户打开用于显示家庭设备详情页的操作，或者是用户在运行智慧家庭APP时，周期性的开启身份认证，持续对使用者进行身份认证等等，本申请实施例对此不作限制。In other embodiments of the present application, the operation of triggering the mobile terminal 100-1 to enable identity authentication is not limited to the above-mentioned operation for controlling home devices, and may also be that the mobile terminal 100-1 detects that the user opens the The operation of the device details page, or the user's periodic activation of identity authentication when running the smart home APP, continuous identity authentication of the user, etc., are not limited in this embodiment of the present application.
假设移动终端100-1识别到当前使用者不是小中时，则会弹出如图8H所示的提示信息。Assuming that the mobile terminal 100-1 recognizes that the current user is not Xiaozhong, a prompt message as shown in FIG. 8H will pop up.
如图8H所示，图8H示出的用户界面84弹出提示信息845，用于提示用户“未识别到机主本人，操作失败”。在本申请实施例中，图8H中弹出的提示信息845也可以称为第一提示信息。As shown in FIG. 8H , the user interface 84 shown in FIG. 8H pops up a prompt message 845 for prompting the user that "the owner of the device is not recognized, and the operation fails." In this embodiment of the present application, the prompt information 845 popped up in FIG. 8H may also be referred to as first prompt information.
假设移动终端100-1识别到当前使用者是小中本人时，则会判断小中是否有权限使用电饭煲，由于小中是家庭创建者，拥有最高权限，即可以使用所有家庭设备，则移动终端100-1会弹出如图8I所示的提示信息。Assuming that the mobile terminal 100-1 recognizes that the current user is Xiaozhong himself, it will judge whether Xiaozhong has permission to use the rice cooker. Since Xiaozhong is the family creator and has the highest authority, that is, he can use all family devices, the mobile terminal 100-1 will pop up a prompt message as shown in Figure 8I.
如图8I所示，图8I示出的用户界面84弹出提示信息846，用于提示用户“操作成功，已经为您开启电饭煲”。As shown in FIG. 8I , the user interface 84 shown in FIG. 8I pops up a prompt message 846 for prompting the user "the operation is successful, and the rice cooker has been turned on for you".
在本申请实施例中，移动终端100-1可以称为第一设备；电饭煲属于第二电子设备，第二电子设备还包括上文提供各个家电设备例如电视机、摄像头、电动窗帘、台灯、电水壶、冰箱、空调、空气净化器、烟灶等等。In the embodiment of the present application, the mobile terminal 100-1 may be called the first device; the rice cooker belongs to the second electronic device, and the second electronic device also includes various home appliances provided above such as televisions, cameras, electric curtains, desk lamps, electric appliances, etc. Kettle, refrigerator, air conditioner, air purifier, smoke stove, etc.
在本申请实施例中，电饭煲所在房间为厨房，该厨房也可以称为第一区域。In the embodiment of the present application, the room where the rice cooker is located is the kitchen, which may also be referred to as the first area.
在本申请实施例中，第一操作即上文图8G示例性示出的用于开启电饭煲煮饭功能的操作。In the embodiment of the present application, the first operation is the operation for turning on the rice cooking function of the electric rice cooker as exemplarily shown in FIG. 8G above.
在本申请实施例中用于开启电饭煲的煮饭功能也可以称为用于启动第二电子设备的第一功能。在本申请实施例中，小中还可以称为第一用户，小爱还可以称为第二用户。In the embodiment of the present application, the rice cooking function for turning on the rice cooker may also be referred to as the first function for starting the second electronic device. In this embodiment of the application, Xiao Zhong can also be called the first user, and Xiao Ai can also be called the second user.
其中，图8J-图8N示例性示出家庭成员小明使用家庭设备的操作界面示意图。Wherein, FIG. 8J-FIG. 8N exemplarily show a schematic diagram of an operation interface of a family member Xiao Ming using a family device.
图8J示例性示出小明的移动终端100-3安装的智慧家庭APP的首页。Fig. 8J exemplarily shows the home page of the smart home APP installed on Xiao Ming's mobile terminal 100-3.
如图8J所示，移动终端100-3显示的用户界面与前文图6K、图8F示出的移动终端100-1显示的用户界面61类似，前文对图6K的介绍适用于对图8J的介绍，在此暂不赘述。As shown in Figure 8J, the user interface displayed by the mobile terminal 100-3 is similar to the user interface 61 displayed by the mobile terminal 100-1 shown in Figure 6K and Figure 8F above, and the introduction to Figure 6K above is applicable to the introduction to Figure 8J , which will not be described here.
值得注意的是，图8J所示的设备显示区中显示的部分家庭设备的图标与图8F所示的设备显示区614中显示的部分家庭设备的图标不尽相同。具体的图8J中显示的电水壶、电饭煲、电视机A、空气净化器A等对应的图标的显示状态为灰度的形式，用于提示用户这些图标对应的家庭设备，用户没有权限控制。这是因为小明在小中的家中担任的角色为“儿童；老人”因此，小明没有权限使用厨房中具有危险性的家庭设备；此外，因为小明的房间划分中，可用房间不包括小中和小华的卧室A，以及小爱的卧室C，所以卧室A、卧室C中的设备例如电视机A、空气净化器A等，小明也没有权限使用。但是小明可以在家庭创建者和/或管理员授权后，使用这些家庭设备，具体如下:It should be noted that the icons of some home devices displayed in the device display area shown in FIG. 8J are different from the icons of some home devices displayed in the device display area 614 shown in FIG. 8F . Specifically, the display states of the icons corresponding to the electric kettle, rice cooker, TV A, air purifier A, etc. shown in FIG. 8J are in the form of grayscale, which is used to remind the user of the home devices corresponding to these icons, and the user has no authority control. This is because Xiaoming's role in Xiaozhong's home is "child; old man". Therefore, Xiaoming does not have the right to use dangerous household equipment in the kitchen; in addition, because Xiaoming's room division, the available rooms do not include Xiaozhong and Xiaozhong. Hua's bedroom A, and Xiao Ai's bedroom C, so Xiao Ming has no permission to use the equipment in bedroom A and bedroom C, such as TV A, air purifier A, etc. However, Xiao Ming can use these family devices after being authorized by the family creator and/or administrator, as follows:
移动终端100-3可以检测到用户点击图8J中设备显示区中任意一个家庭设备对应的图标的操作，例如点击电饭煲对应的设备图标的操作，响应于该操作，移动终端100-3显示如图8K所示的用户界面。The mobile terminal 100-3 can detect that the user clicks the icon corresponding to any home device in the device display area in FIG. 8J , for example, the operation of clicking the device icon corresponding to the rice cooker. In response to this operation, the mobile terminal 100-3 displays User interface shown in 8K.
如图8K所示，移动终端100-3显示的用户界面与前文图8G示出的用户界面84类似，前文对图8G的介绍适用于对图8K的介绍，在此暂不赘述。As shown in FIG. 8K , the user interface displayed by the mobile terminal 100 - 3 is similar to the user interface 84 shown in FIG. 8G above. The introduction to FIG. 8G above is applicable to the introduction to FIG. 8K , and details will not be repeated here.
移动终端100-3检测到用户输入用于触发移动终端100-3控制家庭设备的操作，例如检测到用户点击图8K中开关选项对应的开启电饭煲的控件的操作，响应于该操作，移动终端 100-3显示如图8L所示的用户界面。The mobile terminal 100-3 detects that the user input is used to trigger the operation of the mobile terminal 100-3 to control the home device, for example, it detects that the user clicks on the control for turning on the rice cooker corresponding to the switch option in FIG. 8K . In response to this operation, the mobile terminal 100 -3 Display the user interface as shown in Figure 8L.
如图8L所示，图8L示出的用户界面显示有提示窗口，提示窗口中显示有用于提示用户没有上述操作的权限，并询问用户是否向他人请求权限的信息。该提示窗口显示的提示信息也可以称为第一提示信息。图8L所示的“确定”控件还可以称为第一控件。As shown in FIG. 8L , the user interface shown in FIG. 8L displays a prompt window, and the prompt window displays information for reminding the user that the user does not have the permission for the above operation, and asking the user whether to request permission from others. The prompt information displayed in the prompt window may also be referred to as first prompt information. The "OK" control shown in FIG. 8L may also be referred to as a first control.
移动终端100-3检测到如图8L所示的作用于确定控件的操作，响应于该操作，移动终端100-3可以向家庭创建者和/或家庭管理员分别配有的一个或多个移动终端发送权限请求即第一请求，这里的移动终端包括以下任意一项或多项：手机、手环、耳机、笔记本、平板电脑等等。例如，移动终端100-3向小中配有的移动终端100-1发送权限请求，则小中配有的移动终端100-1会显示如图8M的提示信息。Mobile terminal 100-3 detects an operation acting on the determination control as shown in FIG. The permission request sent by the terminal is the first request, and the mobile terminal here includes any one or more of the following: mobile phone, bracelet, earphone, notebook, tablet computer and so on. For example, when the mobile terminal 100-3 sends a permission request to the mobile terminal 100-1 configured in the small business, the mobile terminal 100-1 configured in the small business will display a prompt message as shown in FIG. 8M .
如图8M所示，移动终端100-1显示的用户界面有提示窗口，该提示窗口中显示有用于提示小中，小明请求操作电饭煲的权限的信息。As shown in FIG. 8M , the user interface displayed by the mobile terminal 100 - 1 has a prompt window, and the prompt window displays information for prompting Xiao Zhong and Xiao Ming to request permission to operate the rice cooker.
移动终端100-1检测到输入用于为小明授权的操作，例如点击图8M中提示窗口同意控件的操作，响应于该操作，移动终端100-1向移动终端100-3发送授权消息，移动终端100-3接收到授权信息后，显示如图8N所示的用户界面。在本申请另一些实施例中，移动终端100-1检测到点击图8M中提示窗口同意控件的操作后，还需要对用户进行身份认证，例如在检测到小中的面部、指纹、或者声纹认证通过后，才会显示如图，显示如图8N所示的用户界面。本申请实施例对小中授权的方法不作限制。The mobile terminal 100-1 detects that the input is used to authorize Xiao Ming, such as clicking the prompt window in Figure 8M to agree to the operation of the control. In response to this operation, the mobile terminal 100-1 sends an authorization message to the mobile terminal 100-3, and the mobile terminal 100-3 displays the user interface shown in FIG. 8N after receiving the authorization information. In other embodiments of the present application, after the mobile terminal 100-1 detects that the prompt window in FIG. After the authentication is passed, the user interface shown in FIG. 8N will be displayed as shown in the figure. The embodiment of this application does not limit the method of SME authorization.
如图8N所示，移动终端100-3显示的用户界面中，开关选项对应的开启电饭煲的控件由图8K中关闭状态切换为开启状态。此外，还显示有提示窗口，提示窗口中用于提示小明，小中已经同意权限请求，已经为您开启电饭煲的信息。As shown in FIG. 8N , in the user interface displayed by the mobile terminal 100 - 3 , the control for turning on the rice cooker corresponding to the switch option is switched from the off state in FIG. 8K to the on state. In addition, a prompt window is also displayed, and the prompt window is used to remind Xiao Ming that Xiao Zhong has agreed to the permission request and has turned on the rice cooker for you.
上文图8J-图8N仅仅示例性示出家庭成员小明使用权限范围外的家庭设备的操作界面示意图。接下来结合图8O-图8Q示例性示出家庭成员小明使用权限范围内的家庭设备的操作界面示意图。Figures 8J to 8N above merely show schematic diagrams of the operation interface of the family device that the family member Xiao Ming is not authorized to use. Next, with reference to FIG. 8O-FIG. 8Q, a schematic diagram of the operation interface of the family device within the scope of use of the family member Xiao Ming is exemplarily shown.
如图8O所示，移动终端100-3检测到用户作用于权限范围内的家庭设备的图标的操作，响应于该操作，打开该家庭设备对应的详情页。例如，移动终端100-3检测到作用于台灯的图标的操作，响应于该操作，移动终端100-3显示如图8P所示的用户界面。As shown in FIG. 80 , the mobile terminal 100 - 3 detects that the user operates on the icon of the family device within the scope of authority, and in response to the operation, opens the details page corresponding to the family device. For example, the mobile terminal 100-3 detects an operation acting on the icon of the table lamp, and in response to the operation, the mobile terminal 100-3 displays the user interface as shown in FIG. 8P.
如图8P所示，移动终端100-3显示的台灯对应的详情页中包括：开关选项、模式选项、亮度选项等。其中，开关选项对应用有开启台灯的控件，模式选项对应显示有用于切换台灯的工作模式的控件，以及亮度选项对应显示有用于调节亮度的滑动条等。As shown in FIG. 8P , the details page corresponding to the desk lamp displayed by the mobile terminal 100 - 3 includes: switch options, mode options, brightness options, and the like. Among them, the switch option corresponds to a control for turning on the desk lamp, the mode option corresponds to a control for switching the working mode of the desk lamp, and the brightness option corresponds to a slider for adjusting brightness.
移动终端100-3检测到使用者输入触发移动终端100-3控制家庭设备的操作，会开启身份认证功能对当前使用者的进行身份认证。例如，移动终端100-3可以检测到用户点击图8P所示的开关选项对应的开启台灯的控件的操作，响应于该操作，移动终端100-3开启身份认证功能，并确定当前使用者所属身份是否具备使用该电子设备即台灯的权限，若具备权限，则正常响应并执行使用者输入的操作；当移动终端100-3检测到当前使用者的身份不具备使用电饭煲的权限，则提示当前使用者不可使用电饭煲，并不再执行使用者输入的操作。The mobile terminal 100-3 detects that the user input triggers the operation of the mobile terminal 100-3 to control the home device, and will enable the identity authentication function to authenticate the identity of the current user. For example, the mobile terminal 100-3 may detect that the user clicks the control for turning on the desk lamp corresponding to the switch option shown in FIG. Whether you have the authority to use the electronic device, that is, the table lamp. If you have the authority, then respond normally and execute the operation input by the user; The user cannot use the rice cooker, and no longer executes the operation entered by the user.
在本申请实施例另一些实施例中，触发移动终端100-3开启身份认证的操作，不限于上述用于控制家庭设备的操作，还可以是移动终端100-3检测到用户打开用于显示家庭设备详情页的操作，或者是用户在运行智慧家庭APP时，周期性的开启身份认证，持续对使用者进行身份认证等等，本申请实施例对此不作限制。In other embodiments of the present application, the operation of triggering the mobile terminal 100-3 to enable identity authentication is not limited to the above-mentioned operation for controlling home devices, and may also be that the mobile terminal 100-3 detects that the user opens the home The operation of the device details page, or the user's periodic activation of identity authentication when running the smart home APP, continuous identity authentication of the user, etc., are not limited in this embodiment of the present application.
假设移动终端100-3识别到当前使用者是小明本人时，则会判断小明是否有权限使用台 灯，由于小中的房间包括卧室B、客厅、书房、健身房、娱乐室等，台灯部署在书房中，所以小明有权使用台灯，则移动终端100-3会弹出如图8Q所示的提示信息。Assuming that the mobile terminal 100-3 recognizes that the current user is Xiao Ming himself, it will judge whether Xiao Ming has the authority to use the desk lamp. Since the rooms in the small house include bedroom B, living room, study room, gym, entertainment room, etc., the desk lamp is deployed in the study room. , so Xiao Ming has the right to use the desk lamp, and the mobile terminal 100-3 will pop up a prompt message as shown in FIG. 8Q .
如图8Q所示，移动终端100-3弹出提示信息，用于提示用户“操作成功，已经为您开启台灯”。As shown in FIG. 8Q , the mobile terminal 100 - 3 pops up a prompt message, which is used to prompt the user "the operation is successful, and the desk lamp has been turned on for you".
值得注意的是，家庭成员通过在移动终端100安装的智慧家庭APP中控制、使用家庭设备时，移动终端100所处位置可能与家庭设备的通信距离小于阈值，例如移动终端100在家庭范围内，也可能与家庭设备的通信距离大于阈值，例如用户离家，在公司，或者在从公司回家的上等等。当家庭成员通过在移动终端100安装的智慧家庭APP中控制、使用家庭设备时，移动终端100所处位置与家庭设备200的通信距离小于阈值时，移动终端100可以直接控制家庭设备200，或者也可以通过服务器300控制家庭设备200。当家庭成员通过在移动终端100安装的智慧家庭APP中控制、使用家庭设备时，移动终端100所处位置与家庭设备200的通信距离大于阈值时，移动终端100必须通过服务器300控制家庭设备200。也就是说，智慧家庭APP支持的远程控制家庭设备200。It is worth noting that when family members control and use the home device through the smart home APP installed on the mobile terminal 100, the communication distance between the location of the mobile terminal 100 and the home device may be less than a threshold, for example, the mobile terminal 100 is within the range of the home, It is also possible that the communication distance with the home device is greater than the threshold, for example, the user is away from home, in the company, or on the phone returning home from the company, and so on. When family members control and use the home device through the smart home APP installed on the mobile terminal 100, and the communication distance between the location of the mobile terminal 100 and the home device 200 is less than a threshold, the mobile terminal 100 can directly control the home device 200, or The home device 200 can be controlled through the server 300 . When family members control and use the home device through the smart home APP installed on the mobile terminal 100, and the communication distance between the location of the mobile terminal 100 and the home device 200 is greater than a threshold, the mobile terminal 100 must control the home device 200 through the server 300. That is to say, the remote control home device 200 supported by the smart home APP.
上文图8A-图8Q介绍的根据用户身份信息确定用户的对家庭设备的控制权限，即体现出上文数据银行系统提及的用户数据的加工，即将用户身份与用户在家庭空间中的房间信息、以及房间中的设备信息建立关联关系，进而实现根据用户的身份确定其对家庭设备的控制权限。关于用户数据加工的方法在此暂不赘述，具体可以参考前文对数据银行系统的介绍。The determination of the user’s control authority over the home device based on the user’s identity information described above in Figure 8A-Figure 8Q reflects the processing of user data mentioned in the data bank system above, that is, the relationship between the user’s identity and the user’s room in the home space Information and equipment information in the room establish an association relationship, and then realize the control authority of the home equipment based on the user's identity. The method of user data processing will not be described here, for details, please refer to the introduction to the data bank system above.
接下来结合图8R-图8V，介绍根据智能控制规则控制家庭设备操作界面示意图。Next, with reference to FIG. 8R-FIG. 8V , a schematic diagram of an operation interface for controlling home devices according to intelligent control rules will be introduced.
在本申请一些实施例中，移动终端100还会根据用户的生活习惯学习出一套智能控制规则，当移动终端100检测到用户输入控制指令操作某个家庭设备200时，移动终端100会根据该智能规则判断是否继续控制对应的家庭设备200执行对应的操作。并显示用于提示用户执行结果的信息。In some embodiments of the present application, the mobile terminal 100 will also learn a set of intelligent control rules according to the user's living habits. The smart rule judges whether to continue to control the corresponding home device 200 to perform the corresponding operation. And display information for prompting the user to execute the result.
在本申请另一些实施例中，移动终端100会把根据用户的生活习惯学习出一套智能控制规则，上传至服务器300，当服务器300接收到移动终端100发送的控制指令后，会根据上述智能控制规则判断是否继续控制对应的家庭设备200执行对应的操作，并将执行结果反馈至移动终端100，使得移动终端100显示用于提示用户执行结果的信息。In other embodiments of the present application, the mobile terminal 100 will learn a set of intelligent control rules based on the user's living habits and upload them to the server 300. When the server 300 receives the control instruction sent by the mobile terminal 100, it will The control rule judges whether to continue to control the corresponding home device 200 to execute the corresponding operation, and feeds back the execution result to the mobile terminal 100, so that the mobile terminal 100 displays information for prompting the user to execute the result.
在本申请实施例中，上述智能控制规则可以是发起命令的用户与家庭之间的距离、用户当前位置、当前时间、控制指令对应的业务类型，以及当前家中是否还有其他成员、或者其他成员所担任的角色等等多方位的因素中的任意一个或多个，制定一套智能、安全的控制规则。接下来以几个简单的示例对该智能控制规则进行详细的说明。In this embodiment of the application, the above-mentioned intelligent control rules may be the distance between the user who initiated the command and the family, the user's current location, the current time, the business type corresponding to the control instruction, and whether there are other members in the current family, or other members Any one or more of the multi-faceted factors such as the role played, formulate a set of intelligent and safe control rules. Next, the intelligent control rules will be described in detail with several simple examples.
参考图8R，图8R示例性示出移动终端100-1学习到小中日常生活路线示意图。Referring to FIG. 8R , FIG. 8R exemplarily shows a schematic diagram of a daily life route learned by the mobile terminal 100-1 to the small and medium-sized schools.
如图8R所示，图8R示例性示出小中的家、公司、以及小中的女儿小爱的学校的位置信息，其中第一线路为小中上下班时必经路线，第二路线为小中接送小爱上下学时的必经路线。小中的生活时间线为：周一到周五期间，早上8:00-8:30左右送女儿小爱去学校，紧接着去公司上班。下午5:30左右下班后，先去学校接女儿放学，然后驱车回家。周末，小中的生活时间线并不固定，有时候小中可能会在家休息，也可能会和老婆小华去约会，也有可能带着小爱的爷爷小明去医院复诊等等。As shown in Figure 8R, Figure 8R exemplarily shows the location information of Xiaozhong's home, company, and Xiaozhong's daughter Xiaoai's school, where the first route is the route that Xiaozhong must pass when commuting to and from work, and the second route is The route that the primary school must pass when picking up and dropping off Xiao Ai to and from school. The life timeline of Xiaozhong is: from Monday to Friday, I send my daughter Xiaoai to school around 8:00-8:30 in the morning, and then go to work in the company. After get off work around 5:30 in the afternoon, I went to school to pick up my daughter from school, and then drove home. On weekends, Xiaozhong’s life timeline is not fixed. Sometimes Xiaozhong may rest at home, or go on a date with his wife Xiaohua, or take Xiaoai’s grandfather Xiaoming to the hospital for follow-up visits, etc.
基于上述学习到的小中的生活习惯，移动终端100-1可以为小中个性化定制一套智能控制规则。该智能控制规则，是结合小中的生活习惯，并根据用户到家的距离、用户当前位置、当前时间、控制指令对应的业务类型，以及当前家中是否还有其他成员、或者其他成员所担 任的角色等等多方位的因素中的任意一个或多个，制定一套智能、安全的控制规则。接下来以几个简单的示例对该智能控制规则进行详细的说明。Based on the learned living habits of the small medium, the mobile terminal 100-1 can customize a set of intelligent control rules for the small medium. The intelligent control rule is based on the living habits of the small and medium-sized enterprises, and according to the distance from the user to home, the user's current location, the current time, the business type corresponding to the control instruction, and whether there are other members in the current home, or the roles played by other members Any one or more of the multi-faceted factors can be used to formulate a set of intelligent and safe control rules. Next, the intelligent control rules will be described in detail with several simple examples.
示例1：当家中没有其他成员，或者家中的其他成员所担任的角色为“老人、小孩”时，若发出操作指令的用户离家超出预设范围即超过第一值时或者用户所处地理位置不是移动终端100-1学习到的上述第一路线第二路线附近，例如用户在如图8R所示的第一地点，由于第一地点距离小中的家的距离超出第一值，则服务器300拒绝控制家庭设备200执行对应的操作。这样，可以避免在未来很长一段时间内，用户可能没有赶回家，而家中一直没有人的情况下，一方面会造成家电资源的铺张浪费，另一方面还会给家庭带来潜在的安全隐患。Example 1: When there are no other members in the family, or other members of the family play the role of "old man, child", if the user who issued the operation instruction leaves home beyond the preset range, that is, exceeds the first value, or the user's geographical location It is not near the first route and the second route learned by the mobile terminal 100-1. For example, the user is at the first location shown in FIG. The denial controls the home device 200 to perform the corresponding operation. In this way, it can be avoided that for a long time in the future, when the user may not rush home and there is no one at home, on the one hand, it will cause extravagance and waste of home appliance resources, and on the other hand, it will bring potential safety to the family. Hidden danger.
示例2：当家中没有其他成员，或者家中的其他成员所担任的角色为“老人、小孩”时，若发出操作指令的用户在离家预设范围内或者用户所处地理位置是移动终端100-1学习到的上述第一路线第二路线附近，例如用户在如图8R所示的第二地点，由于第二地点距离小中的家的距离小于第一值，则服务器300根据用户的控制指令，控制家庭设备200执行对应的操作。Example 2: When there are no other members in the family, or the roles of other members of the family are "old man, child", if the user who issued the operation command is within the preset range from home or the user's geographic location is the mobile terminal 100- 1 The learned first route is near the second route. For example, the user is at the second location shown in FIG. , to control the home device 200 to perform corresponding operations.
示例3：当家中有其他成员，并且其他成员所担任的角色不是“老人、小孩”时，若发出操作指令的用户离家超出预设范围或者用户所处地理位置不是移动终端100-1学习到的上述第一路线第二路线附近，例如用户在如图8R所示的第一地点，则服务器300根据用户的控制指令，控制家庭设备200执行对应的操作。Example 3: When there are other members in the family, and the roles of other members are not "old people, children", if the user who issued the operation command leaves home beyond the preset range or the user's geographical location is not learned by the mobile terminal 100-1 If the user is near the first route and the second route, for example, the user is at the first place shown in FIG. 8R , the server 300 controls the home device 200 to perform corresponding operations according to the user's control instruction.
示例4：当在周一到周五的任意一天的白天，家中没有其他成员，若发出操作指令的用户在公司，并且该指令对应的业务类型例如是开启电灯、开启空调、开启电视机等等耗电的家庭设备200时，则服务器300拒绝控制家庭设备200执行对应的操作。这样，可以避免因家中无人，而造成家电资源的铺张浪费，以及给家庭带来潜在的安全隐患的情况。贯彻落实健康、安全、低碳、便捷的个性化家居生活。Example 4: When there are no other members of the family during the daytime on any day from Monday to Friday, if the user who issued the operation command is in the company, and the business type corresponding to the command is, for example, turn on the light, turn on the air conditioner, turn on the TV, etc. When the home device 200 is switched off, the server 300 refuses to control the home device 200 to perform the corresponding operation. In this way, it is possible to avoid the extravagance and waste of home appliance resources and potential safety hazards to the family due to no one at home. Implement healthy, safe, low-carbon and convenient personalized home life.
示例5：当在周一到周五的任意一天的白天，家中没有其他成员，若发出操作指令的用户在公司，但是该指令对应的业务类型是打开/关闭窗户，关闭电灯、关闭空调、关闭电视机等等耗电的家庭设备200时，则服务器300控制家庭设备200执行对应的操作。Example 5: During the daytime on any day from Monday to Friday, if there are no other members of the family, if the user who issued the operation command is in the company, but the business type corresponding to the command is to open/close the window, turn off the light, turn off the air conditioner, and turn off the TV When there is a home device 200 that consumes power such as a computer, the server 300 controls the home device 200 to perform a corresponding operation.
参考图8S-图8V，图8S-图8V示例性示出根据智能控制规则控制家庭设备的用户界面示意图。Referring to FIG. 8S-FIG. 8V, FIG. 8S-FIG. 8V exemplarily illustrate user interface diagrams for controlling home devices according to intelligent control rules.
如图8S-图8T所示，移动终端100-1检测到小中输入用于打开家中的台灯的操作，响应于该操作，移动终端100-1可以获取小中当前位置，以及时间信息，例如小中此时小中在图8R所示的第一地点，且时间为星期五中午12：00，此外移动终端100-1还可以向服务器300请求家中的成员信息，例如从服务器300处获悉家中没有其他成员，那么移动终端100-1则拒绝通过服务器300控制台灯开启，并显示如图8U的所示的提示信息。As shown in FIG. 8S-FIG. 8T, mobile terminal 100-1 detects that Xiaozhong inputs an operation to turn on the desk lamp at home, and in response to this operation, mobile terminal 100-1 can obtain Xiaozhong's current location and time information, for example At this time, Xiaozhong is at the first place shown in FIG. 8R, and the time is 12:00 noon on Friday. In addition, the mobile terminal 100-1 can also request the server 300 for member information in the family, for example, it is learned from the server 300 that there is no For other members, the mobile terminal 100-1 refuses to turn on the console light of the server 300, and displays a prompt message as shown in FIG. 8U.
如图8U所示，用户界面85中显示有窗口854，窗口845中显示有提示信息，例如用于提示用户“检测到家中没有人，建议不开灯”，若用户仍想要开灯可以通过点击窗口中的控件845A，响应于该操作，移动终端100-1再通过服务器300控制台灯开启，若用户暂时不打算开灯，可以通过点击控件控件845B，响应于该操作，移动终端100-1关闭窗口854。在本申请另一些实施例中，上述提示信息所在的窗口854可以不显示控件“知道了”，用户可以通过作用于该窗口854以外的地方，或者是当该窗口显示时间超过预设时间例如30秒，移动终端100-1可以关闭该窗口854。As shown in Figure 8U, a window 854 is displayed in the user interface 85, and a prompt message is displayed in the window 845, for example, it is used to prompt the user "It is detected that there is no one at home, it is recommended not to turn on the light", if the user still wants to turn on the light, he can pass Click the control 845A in the window. In response to this operation, the mobile terminal 100-1 will turn on the console light through the server 300. If the user does not intend to turn on the light temporarily, he can click the control 845B. In response to this operation, the mobile terminal 100-1 Window 854 is closed. In some other embodiments of the present application, the window 854 where the above-mentioned prompt information is located may not display the control "Got it", and the user can activate it by acting on a place other than the window 854, or when the display time of the window exceeds a preset time, for example, 30 seconds, the mobile terminal 100-1 can close the window 854.
假设用户此时仍要继续开灯，则移动终端100-1可以检测作用于控件845A的操作，响应 于该操作，移动终端100-1向服务器300发送用于控制台灯开启的指令，服务器300根据该指令控制台灯打开，服务器300还会将开启台灯这一执行结果反馈至移动终端100，移动终端100根据该反馈消息显示如图8U所示的提示信息。Assuming that the user still wants to continue to turn on the light at this time, the mobile terminal 100-1 can detect the operation acting on the control 845A, and in response to the operation, the mobile terminal 100-1 sends an instruction for turning on the console light to the server 300, and the server 300 according to This command turns on the desk lamp, and the server 300 also feeds back the execution result of turning on the desk lamp to the mobile terminal 100, and the mobile terminal 100 displays the prompt information as shown in FIG. 8U according to the feedback message.
如图8V所示的用户界面85中显示有窗口855，该窗口显示有执行结果对应的提示信息，例如“已经为您开启台灯，鉴于家中无人建议您撤回开灯的操作”，以及控件855A，控件855A用于撤回前文开灯的操作，此外，选项851对应的开关控件切换为关闭状态。As shown in FIG. 8V, a window 855 is displayed in the user interface 85, and the window displays a prompt message corresponding to the execution result, such as "the table lamp has been turned on for you, and since no one at home suggests that you withdraw the operation of turning on the light", and a control 855A , the control 855A is used to undo the previous operation of turning on the light, and in addition, the switch control corresponding to the option 851 is switched to the off state.
假设用户因为误触图8U所示的控件854A，导致台灯开启，或者用户开启台灯后悔开灯，则用户还可以撤回上述操作。即移动终端100-1可以检测到作用于图8V所示的控件855A的操作，响应于该操作，移动终端100-1通过服务器300控制台灯关闭，此时移动终端显示的用户界面85如图8W所示，选项851对应的开关控件切换为关闭状态。Assuming that the user accidentally touches the control 854A shown in FIG. 8U and the desk lamp is turned on, or the user regrets turning on the desk lamp after turning on the desk lamp, the user can also withdraw the above operation. That is, the mobile terminal 100-1 can detect the operation acting on the control 855A shown in FIG. 8V, and in response to the operation, the mobile terminal 100-1 turns off the console light of the server 300. At this time, the user interface 85 displayed on the mobile terminal is shown in FIG. 8W As shown, the switch control corresponding to option 851 is turned off.
或者，用户还可以通过作用于图8V所示的窗口855以外的地方，或者是当该窗口855显示时间超过预设时间例如30秒，移动终端100-1可以关闭该窗口855。Alternatively, the user can also act on a place other than the window 855 shown in FIG. 8V , or when the window 855 is displayed for more than a preset time such as 30 seconds, the mobile terminal 100-1 can close the window 855.
可以理解的是移动终端100输出执行结果的提示信息的形式不限于图8U所示窗口854，还可以通过语音播报的方式输出执行结果的提示信息等。It can be understood that the form of the mobile terminal 100 outputting the prompt information of the execution result is not limited to the window 854 shown in FIG.
值得注意的是，除了在移动终端100-1处显示如图8U所示的执行结果的信息，若移动终端100-1获知用户正在开车，则还可以控制车载电脑输出如图8X所示的执行结果的提示信息，方便用户及时获知执行结果。或者，在其他场景下，还可以控制其他移动终端例如手环、耳机以及平板等同时输出执行结果的提示信息。It is worth noting that, in addition to displaying the execution result information shown in Figure 8U at the mobile terminal 100-1, if the mobile terminal 100-1 knows that the user is driving, it can also control the on-board computer to output the execution result information shown in Figure 8X. The prompt information of the result is convenient for the user to know the execution result in time. Or, in other scenarios, other mobile terminals such as wristbands, earphones, and tablets may also be controlled to simultaneously output prompt information of execution results.
上文介绍的移动终端根据用户的生活轨迹生成智能控制规则，其中用户的生活轨迹相关信息便涉及前文数据银行系统提及的用户数据的开放，具体表现为跨应用程序开放给其他应用程序。例如地图导航类APP可以将用户的行程轨迹等信息开放给智慧家庭应用程序。关于用户数据开放的方法在此暂不赘述，具体可以参考前文对数据银行系统的介绍。The mobile terminal described above generates intelligent control rules based on the user's life trajectory, and the information related to the user's life trajectory involves the opening of user data mentioned in the data bank system mentioned above, which is specifically manifested as cross-application opening to other applications. For example, map navigation apps can open information such as the user's itinerary trajectory to smart home applications. The method of opening user data will not be described here. For details, please refer to the introduction to the data bank system above.
在本申请另一些实施例中，移动终端100还可以将上文图8F-图8Q示出的根据用户身份控制家电设备的方法与上文图8R-图8X示出的根据智能控制规则控制家电设备的方法结合，也就是说，当移动终端100检测到或者服务器300接收到用户发送控制指令后，在移动终端100或者服务器300先进行身份认证，当识别到用户具有控制家庭设备200的权限后，移动终端100或服务器300再根据智能控制规则进一步判断是否执行控制指令对应的操作。这里不再以UI界面进行详细赘述。In other embodiments of the present application, the mobile terminal 100 can also combine the method of controlling household appliances according to the user identity shown in FIG. 8F-FIG. 8Q above with the method of controlling household appliances according to intelligent control rules shown in FIG. The device method is combined, that is, when the mobile terminal 100 detects or the server 300 receives the control instruction sent by the user, the mobile terminal 100 or the server 300 first performs identity authentication, and when it is recognized that the user has the authority to control the home device 200 , the mobile terminal 100 or the server 300 further judges whether to execute the operation corresponding to the control instruction according to the intelligent control rule. The UI interface will not be described in detail here.
在本申请一些实施例中，移动终端可以生成电子围栏，当移动终端检测到用户离开该电子围栏时，移动终端可以输出第二提示信息，用于提示用户已经离开安全区域；或者，也可以向与该移动终端处于同一智慧家庭账号中的其他家庭成员的终端设备和家庭中的家具设备发送第二信息，进而可以触发其他家庭成员的终端设备和家庭中的固定设备发起警报，从而达到保护用户的人身安全的目的。接下来，以父母为孩子设置电子围栏为例，展开介绍电子围栏的设置方法，以及根据电子围栏触发警报的机制。In some embodiments of the present application, the mobile terminal can generate an electronic fence, and when the mobile terminal detects that the user has left the electronic fence, the mobile terminal can output a second prompt message, which is used to remind the user that the user has left the safe area; The terminal devices of other family members and furniture devices in the family in the same smart home account as the mobile terminal send the second information, which can then trigger the terminal devices of other family members and fixed devices in the family to initiate alarms, thereby protecting users. for the purpose of personal safety. Next, take parents setting up an electronic fence for their children as an example to introduce the setting method of the electronic fence and the mechanism of triggering the alarm according to the electronic fence.
在一种可实现的方式中，移动终端可以根据用户的在第二时间段内例如一周内的生活轨迹，自动生成电子围栏。具体的，小爱的移动终端100-6可以默认开启电子围栏功能，或者响应于用户操作开启电子围栏功能。之后，移动终端100-6可以获取小爱的活动轨迹，根据该活动轨迹生成电子围栏。结合上文介绍的图8R来看，小爱的活动轨迹通常包括小中的家、小爱的学校，以及小中的家至小爱的学校之间的往返线路时。当移动终端100-6检测到小爱 在家中活动时，移动终端100-6可以结合地图，将小中的家所属小区的范围设置为电子围栏1；当移动终端100-6检测到小爱在学校中任意一个地方活动时，移动终端100-6可以结合地图，将小爱的学校的范围设置为电子围栏2。可以理解的是，图8R示出的电子围栏1以及电子围栏2的范围仅为示例。移动终端100-6每次定位得到小爱的位置，其实为地图中的一个定点。移动终端100-6在预设时间内连续获得小爱的位置可能为同一个定点，也可能为多个不同但邻近的多个定点。移动终端100-6的处理器可以根据该一个定点，或者多个定点组成的区域，结合其在地图中的位置，生成电子围栏，小爱的活动区域的边界对应该电子围栏，但电子围栏的区域通常大于等于实际获取到的小爱的活动区域的边界。本申请实施例对电子围栏的大小及形状不作限制。电子围栏1和电子围栏2共同组成电子围栏域，电子围栏域中各个电子围栏之间的路线也属于该电子围栏域所包含的范围。所以，小爱在家与学校之间的往返线路即第二线路为电子围栏1和电子围栏2之间的必经线路，该线路属于小爱的电子围栏域。In a practicable manner, the mobile terminal can automatically generate an electronic fence according to the user's life trajectory within a second time period, for example, within a week. Specifically, Xiaoai's mobile terminal 100-6 may enable the electronic fence function by default, or enable the electronic fence function in response to a user operation. Afterwards, the mobile terminal 100-6 can obtain the activity track of Xiao Ai, and generate an electronic fence according to the activity track. Combining with Figure 8R introduced above, Xiaoai’s activity track usually includes Xiaozhong’s home, Xiaoai’s school, and the round-trip time between Xiaozhong’s home and Xiaoai’s school. When the mobile terminal 100-6 detects that Xiao Ai is active at home, the mobile terminal 100-6 can combine the map to set the range of the community of Xiaozhong’s home as electronic fence 1; when the mobile terminal 100-6 detects that Xiao Ai is in When moving anywhere in the school, the mobile terminal 100-6 can combine the map to set the range of Xiaoai's school as the electronic fence 2. It can be understood that the ranges of the geo-fence 1 and the geo-fence 2 shown in FIG. 8R are only examples. The mobile terminal 100-6 obtains Xiao Ai's position each time it locates, which is actually a fixed point on the map. The mobile terminal 100-6 may continuously obtain the location of Xiao Ai within a preset time period, which may be the same fixed point, or multiple different but adjacent fixed points. The processor of the mobile terminal 100-6 can generate an electronic fence according to the one fixed point, or the area composed of multiple fixed points, combined with its position in the map, and the boundary of Xiaoai's activity area corresponds to the electronic fence, but the electronic fence The area is usually greater than or equal to the boundary of the actually obtained Little Love's activity area. The embodiment of the present application does not limit the size and shape of the electronic fence. The geo-fence 1 and the geo-fence 2 together form the geo-fence domain, and the routes between the geo-fences in the geo-fence domain also belong to the scope included in the geo-fence domain. Therefore, Xiao Ai's round-trip route between home and school, that is, the second route is the necessary route between Geo-Fence 1 and Geo-Fence 2, and this route belongs to Xiao Ai's Geo-Fence domain.
在本申请实施例中，上述电子围栏1、电子围栏2以及电子围栏1和电子围栏2之间的第二路线还可以称为第一电子围栏。In the embodiment of the present application, the above-mentioned electronic fence 1, electronic fence 2, and the second route between electronic fence 1 and electronic fence 2 may also be referred to as a first electronic fence.
在另一种可实现的方式中，用户可以主动设置电子围栏域。具体的，小爱的爸爸小中可以在小爱的移动终端100-6中输入用于设置小爱的电子围栏的第三操作，也可以在小中的移动终端100-1中输入设置小爱的电子围栏的第三操作，来设置电子围栏。本申请实施例对此不作限制。In another practicable manner, the user can actively set the electronic fence area. Specifically, Xiaozhong, Xiaoai's father, can enter the third operation for setting Xiaoai's electronic fence in Xiaoai's mobile terminal 100-6, or input and set Xiaoai's electronic fence in Xiaozhong's mobile terminal 100-1. The third operation of the electronic fence is to set the electronic fence. The embodiment of the present application does not limit this.
可以理解的是，电子围栏域也是电子围栏，电子围栏域包括多个电子围栏，以及电子围栏之间的必经线路。在本申请实施例中，电子围栏仅仅为一个名称，不应构成对本申请的限制，在本申请其他一些实施例中，电子围栏还可以称为安全范围等等，本申请实施例对此不作限制。It can be understood that the geo-fence domain is also a geo-fence, and the geo-fence domain includes multiple geo-fences and necessary lines between geo-fences. In the embodiment of this application, the electronic fence is only a name, which should not constitute a limitation to this application. In some other embodiments of the application, the electronic fence can also be called a security range, etc., which is not limited in this embodiment of the application .
在本申请实施例中，小爱的移动终端可以称为第四电子设备，即第四电子设备包括移动终端100-6。In this embodiment of the present application, Xiaoai's mobile terminal may be called the fourth electronic device, that is, the fourth electronic device includes the mobile terminal 100-6.
移动终端100-6可以周期性的对小爱进行定位，当移动终端100-6检测到小爱所处位置在上文所述的第一电子围栏中的电子围栏1和电子围栏2外时，移动终端100-6可以直接输出第二提示信息，或者向第五设备发送第二信息，以提醒家长，小爱目前所处位置在危险区域，请家长尽快联系小爱，确保小爱的安全。该第五设备包括小爱的家长的移动终端以及家庭中的其他家具设备以及车辆中的车载电脑等。或者，当移动终端100-6检测到小爱所处位置在第一电子围栏中第二路线外超出第一距离和/或超出第一时间段时，移动终端100-6可以直接输出第二提示信息，或者向第五设备发送第二信息。The mobile terminal 100-6 can periodically locate Xiaoai. When the mobile terminal 100-6 detects that Xiaoai is located outside the electronic fence 1 and electronic fence 2 in the first electronic fence mentioned above, The mobile terminal 100-6 can directly output the second prompt message, or send the second message to the fifth device to remind parents that Xiao Ai is currently in a dangerous area, and parents are requested to contact Xiao Ai as soon as possible to ensure the safety of Xiao Ai. The fifth device includes the mobile terminal of Xiao Ai's parents, other furniture devices in the family, and the on-board computer in the vehicle. Alternatively, when the mobile terminal 100-6 detects that Xiao Ai's location exceeds the first distance and/or exceeds the first time period outside the second route in the first electronic fence, the mobile terminal 100-6 can directly output the second prompt information, or send the second information to the fifth device.
在本申请另一些实施例中，移动终端还可以生成第二电子围栏，当移动终端检测到用户进入该第二电子围栏时，移动终端可以输出第三提示信息，用于提示用户已经进入危险区域；或者，也可以向与该移动终端处于同一智慧家庭账号中的其他家庭成员的终端设备和家庭中的家具设备发送第三信息，进而可以触发其他家庭成员的终端设备和家庭中的固定设备发起警报，从而达到保护用户的人身安全的目的。In some other embodiments of the present application, the mobile terminal may also generate a second electronic fence, and when the mobile terminal detects that the user has entered the second electronic fence, the mobile terminal may output third prompt information, which is used to remind the user that he has entered the dangerous area ; Or, the third information can also be sent to the terminal devices of other family members in the same smart home account as the mobile terminal and the furniture devices in the family, which in turn can trigger the terminal devices of other family members and the fixed devices in the family to initiate Alarm, so as to achieve the purpose of protecting the personal safety of users.
接下来，以父母为孩子设置电子围栏为例，假设父母为了避免孩子去危险地方例如网吧、河边等等地方，父母可以为孩子设备，例如图8R所示的第二电子围栏，当移动终端检测到孩子进入该第二电子围栏时，可以触发移动终端发起警报例如触发移动终端向与其处于同一智慧家庭账号中的其他家庭成员的终端设备和家庭中的固定设备发起警报。Next, take parents setting up an electronic fence for their children as an example. Suppose parents want to prevent their children from going to dangerous places such as Internet cafes, riversides, etc., parents can equip their children, such as the second electronic fence shown in Figure 8R, when the mobile terminal When it is detected that the child enters the second electronic fence, the mobile terminal can be triggered to initiate an alarm, for example, the mobile terminal can be triggered to initiate an alarm to the terminal devices of other family members in the same smart home account and the fixed devices in the family.
在本申请一些实施例中，家庭成员除了通过在移动终端100安装的智慧家庭APP中控制、使用家庭设备以外，还可以直接使用或控制家庭设备。并且，在家庭成员直接操作家庭设备时，家庭设备也会开启身份认证功能，识别当前使用的身份，并确定当前用户所属身份是否具备使用该家庭设备的权限；或者，在家庭成员直接操作家庭设备时，家庭设备也会开启身份认证功能，将采集到的该身份认证方式对应的用户的信息上传至服务器300，由服务器300识别该用户的身份，并确定当前用户所属身份是否具备使用该家庭设备的权限若具备权限，然后将结果发送至该家庭设备。当该用户具有是应该家庭设备的权限时，则正常响应并执行对应的操作；当家庭设备检测到当前用户的身份不具备使用该家庭设备的权限，则拒绝执行对应的操作。In some embodiments of the present application, in addition to controlling and using the home device through the smart home APP installed on the mobile terminal 100 , family members can also directly use or control the home device. In addition, when family members directly operate the family device, the family device will also turn on the identity authentication function to identify the current identity and determine whether the current user's identity has the right to use the family device; or, when the family member directly operates the family device , the home device will also enable the identity authentication function, upload the collected user information corresponding to the identity authentication method to the server 300, and the server 300 will identify the user's identity and determine whether the current user's identity is qualified to use the home device. If the authority of the user has the authority, then the result is sent to the home device. When the user has the right to use the home device, it responds normally and performs the corresponding operation; when the home device detects that the identity of the current user does not have the right to use the home device, it refuses to perform the corresponding operation.
具体的，家庭设备识别使用者身份的方法可以是以下任意一种：Specifically, the method for the home device to identify the user's identity may be any of the following:
1、家庭设备将采集到的使用者的身份认证对应的信息，例如面部信息、指纹信息、声纹信息、操作习惯等发送至服务器300，服务器300根据存储的移动终端100上传的家庭成员分别对应的身份认证对应的信息，与家庭设备上传的使用者的身份认证对应的信息进行比对，进而识别使用者的身份，并将识别结果发送至家庭设备。1. The home device sends the collected information corresponding to the user's identity authentication, such as facial information, fingerprint information, voiceprint information, operating habits, etc., to the server 300, and the server 300 corresponds to the stored family members uploaded by the mobile terminal 100. The information corresponding to the user's identity authentication is compared with the information corresponding to the user's identity authentication uploaded by the home device, and then the user's identity is identified, and the identification result is sent to the home device.
2、家庭设备预先存储服务器下发的所有家庭成员分别对应的身份认证对应的信息，根据上述信息，与采集到的使用者的身份认证对应的信息进行对比，进而识别使用者的身份。2. The home device pre-stores the information corresponding to the identity authentication of all family members issued by the server, and compares the above information with the collected information corresponding to the identity authentication of the user to identify the identity of the user.
在本申请另一些实施例中，当家庭设备识别到当前使用者的身份不具备使用该家庭设备的权限时，该家庭设备根据当前使用者的身份控制该身份对应的移动终端向家庭创建者或者管理员的移动终端进行电话、视频等即时通讯。家庭创建者或者管理员在获悉该事件后，在确保没有危险的情况下，可以通过在自己的移动终端中为用户授权，允许其继续正常使用家电设备。这样，可以避免使用者强制使用，甚至是暴力者破坏家庭设备等的情况发生。In some other embodiments of the present application, when the family device recognizes that the identity of the current user does not have the right to use the family device, the family device controls the mobile terminal corresponding to the identity to send the mobile terminal corresponding to the identity to the family creator or The administrator's mobile terminal performs instant messaging such as phone calls and videos. After being informed of the event, the family creator or administrator can authorize the user in his mobile terminal to allow him to continue to use the home appliance normally, provided that there is no danger. In this way, it is possible to avoid the occurrence of forced use by the user, or even destruction of household equipment by violent persons.
上文仅仅介绍了通过移动终端对家庭设备的控制方法，以及直接控制家电设备的方法。但是，在智慧家庭中，不仅存控制、使用家庭设备的应用场景，无时无刻都存在使用移动终端的应用场景。特别的，针对非机主本人使用移动终端的情况，例如家中小孩使用家长的手机、平板等现象，常常会给机主本人带来或多或少的金钱损失，以及家长手机中的网络环境也会给小孩带来不利的成长条件。为了避免这种情况的发生，接下来介绍移动终端的使用方法。The above only introduces the method of controlling the household equipment through the mobile terminal, and the method of directly controlling the household electrical equipment. However, in a smart home, there are not only application scenarios for controlling and using home devices, but also application scenarios for using mobile terminals all the time. In particular, the use of mobile terminals by non-owners, such as children at home using their parents’ mobile phones and tablets, often brings more or less money losses to the owner himself, and the network environment in the parents’ mobile phones is also It will bring unfavorable growth conditions for children. In order to avoid this situation from happening, the usage method of the mobile terminal is introduced next.
在本申请实施例中，移动终端100例如手机检测到使用者输入敏感操作时，可以开启身份认证，若识别到当前使用者为非机主本人，则拒绝执行该敏感操作对应的事件，并提示用户操作失败的提示信息，此外还会向机主的其他终端设备发送提示信息。In this embodiment of the application, when the mobile terminal 100 such as a mobile phone detects that the user has input a sensitive operation, it can enable identity authentication. If it is recognized that the current user is not the owner of the device, it will refuse to execute the event corresponding to the sensitive operation and prompt Prompt information for user operation failure, in addition, prompt information will be sent to other terminal devices of the owner.
具体的，在上述过程中，移动终端100可以持续进行身份认证。也就是说，移动终端100在检测到敏感操作的预设时间内可以进行周期性的身份认证，若在预设次数内任意一次检测到当前使用者为机主本人，则移动终端100执行该敏感操作对应的事件；若检测到当前使用者为非机主本人的次数大于等于预设次数，则移动终端100仍然拒绝执行该敏感操作对应的事件，若移动终端100检测到使用者还驻留在执行敏感操作的页面或者使用提供敏感操作的APP中，则移动终端100会锁定。Specifically, during the above process, the mobile terminal 100 may continuously perform identity authentication. That is to say, the mobile terminal 100 can perform periodic identity authentication within the preset time when sensitive operations are detected. Operate the corresponding event; if the number of times that the current user is not detected as the owner is greater than or equal to the preset number of times, then the mobile terminal 100 still refuses to execute the event corresponding to the sensitive operation, if the mobile terminal 100 detects that the user is still in the If you are using a page that performs sensitive operations or uses an APP that provides sensitive operations, the mobile terminal 100 will be locked.
此外，移动终端100在上述预设次数内任意一次，或者在预设次数检测到非机主本人在执行敏感操作时，会将该事件发送至机主本人配备的其他移动终端例如手环等，以提醒机主本人他人正在使用移动终端100执行敏感操作。In addition, the mobile terminal 100 will send the event to other mobile terminals equipped by the owner himself, such as wristbands, for any one time within the preset number of times, or when the preset number of times detects that someone other than the owner himself is performing a sensitive operation, In order to remind the owner that others are using the mobile terminal 100 to perform sensitive operations.
上述敏感操作可以包括以下任意一项或多项：The above-mentioned sensitive operations may include any one or more of the following:
1、执行支付操作，包括在社交类APP、流媒体APP、支付类APP、网上银行类APP、购物类APP以及直播类APP等等提供支付功能的APP中执行的支付操作，该支付操作对应的数额可以是大于预设数值的，也可以是任意数值。1. Execute payment operations, including payment operations performed in social apps, streaming apps, payment apps, online banking apps, shopping apps, and live broadcast apps that provide payment functions. The amount can be greater than a preset value, or any value.
2、观看游戏类直播、未成年视频，使用游戏类APP。2. Watch game live broadcasts, videos of minors, and use game apps.
3、删除文件、短信、电话记录、社交类APP中的聊天记录以及APP等。3. Delete files, text messages, phone records, chat records in social apps and apps, etc.
接下来通过具体的UI实施例来介绍上述方法。Next, the above method is introduced through a specific UI embodiment.
参考图9A-图9G，图9A-图9G示例性示出小中的移动终端100-1检测到一种敏感操作后的一系列用户界面示意图。Referring to FIG. 9A-FIG. 9G, FIG. 9A-FIG. 9G exemplarily show a series of user interface diagrams after the mobile terminal 100-1 in the small medium detects a sensitive operation.
图9A示例性示出社交类APP提供的一个用户界面示意图。FIG. 9A exemplarily shows a schematic diagram of a user interface provided by a social APP.
如图9A所示，用户界面91即社交类APP提供的一个聊天界面，用户界面91显示聊天区911和功能区912。其中911显示有小中和小军的聊天内容，聊天内容显示小军要求小中转账520元的定金，小中表示同意，并点击功能区912中转账图标912A，响应于该操作，移动终端100显示如图9B所示的转账界面。可以理解的是，这里的中军、小中仅仅指示的是该社交类APP中两个用户的账号，而此时使用该账号的用户不一定是该账号本人。As shown in FIG. 9A , the user interface 91 is a chat interface provided by a social APP, and the user interface 91 displays a chat area 911 and a function area 912 . Among them, 911 shows the chat content of Xiaozhong and Xiaojun. The chat content shows that Xiaojun requires Xiaozhong to transfer a deposit of 520 yuan. Xiaozhong agrees and clicks the transfer icon 912A in the function area 912. In response to this operation, the mobile terminal 100 The transfer interface as shown in FIG. 9B is displayed. It is understandable that Zhongjun and Xiaozhong here only refer to the accounts of two users in the social APP, and the user using the account at this time is not necessarily the account himself.
如图9B所示，用户界面92即该社交类APP提供的转账界面。As shown in FIG. 9B , the user interface 92 is the transfer interface provided by the social APP.
移动终端100-1可以检测到用户输入如图9B所示的数值为520的金额，并点击付款控件，响应于上述操作，移动终端100-1可以直接开启身份认证，或者移动终端100-1可以先显示如图9C所示的用户身份认证提示信息。本申请实施例对此不作限制。The mobile terminal 100-1 can detect that the user has input the amount of 520 as shown in FIG. 9B, and clicks the payment control. In response to the above operation, the mobile terminal 100-1 can directly enable identity authentication, or the mobile terminal 100-1 can Firstly, the user identity authentication prompt information shown in FIG. 9C is displayed. The embodiment of the present application does not limit this.
如图9C所示，用户界面92显示有窗口921，窗口921显示有例如“检测到您在进行支付操作，您是否为机主本人”的提示信息，以及控件921A和控件921B。这里的身份认证方式可以与上文智慧家庭APP提供的身份认证的方式相同或者不同或者更多更少，本申请实施例对此不作限制。As shown in FIG. 9C , the user interface 92 displays a window 921 , and the window 921 displays a prompt message such as "It is detected that you are performing a payment operation, are you the owner of the device?", as well as controls 921A and 921B. The identity authentication method here may be the same or different or more or less than the identity authentication method provided by the smart home APP above, which is not limited in this embodiment of the present application.
移动终端100-1可以检测到用户输入如图9C所示的控件921A的操作，响应于该操作，移动终端100-1则开启身份认证。The mobile terminal 100-1 may detect that the user inputs an operation on the control 921A as shown in FIG. 9C, and in response to the operation, the mobile terminal 100-1 enables identity authentication.
当移动终端100-1检测到当前使用者为非机主本人时，则显示如图9D所示的提示信息。When the mobile terminal 100-1 detects that the current user is not the owner, the prompt information shown in FIG. 9D is displayed.
如图9D所示，用户界面92显示有窗口922，以及控件922A和控件922B。窗口922显示有例如“验证失败，暂不支持支付操作”的提示信息。控件922A用于继续进行身份认证，控件922B用于结束身份认证，并关闭支付操作界面。As shown in Figure 9D, user interface 92 displays window 922, and controls 922A and 922B. Window 922 displays a prompt message such as "verification failed, payment operation not supported for now". The control 922A is used to continue the identity authentication, and the control 922B is used to end the identity authentication and close the payment operation interface.
之后，移动终端100-1可以检测到用户输入作用于如图9D所示的控件922B的操作，响应于该操作，移动终端100-1不再继续进行身份认证，同时关闭向小军转账的页面。Afterwards, the mobile terminal 100-1 can detect that the user input acts on the operation of the control 922B as shown in Figure 9D, and in response to this operation, the mobile terminal 100-1 does not continue to perform identity authentication, and at the same time closes the page for transferring money to Xiaojun .
或者，移动终端100-1可以检测到用户输入作用于如图9D所示的控件922A的操作，响应于该操作，移动终端100-1则继续进行身份认证。或者移动终端100-1无需检测到作用于控件922A的操作，可以自动进行身份认证。本申请实施例对此不作限制。Alternatively, the mobile terminal 100-1 may detect that the user input acts on the operation of the control 922A as shown in FIG. 9D , and in response to the operation, the mobile terminal 100-1 continues to perform identity authentication. Alternatively, the mobile terminal 100-1 can automatically perform identity authentication without detecting the operation on the control 922A. The embodiment of the present application does not limit this.
可选的，当移动终端100-1继续进行身份认证，若验证失败，则再次显示提示信息，具体的该提示信息可以包括如图9E和图9F所示的窗口923和924中显示的用于提示用户已经验证失败的次数，以及还有几次验证机会等等。Optionally, when the mobile terminal 100-1 continues to perform identity authentication, if the verification fails, the prompt information will be displayed again. Specifically, the prompt information may include the information displayed in the windows 923 and 924 shown in FIG. 9E and FIG. 9F. Prompt the user the number of times the user has failed authentication, and how many authentication opportunities are left.
可选的，当移动终端100-1继续进行身份认证，若验证失败，且失败次数超过预设次数时，移动终端100-1可以向机主本人即小中配备的其他移动终端例如发送提示信息。例如向小中的移动终端100-9即手环发送如图9G所示的提示信息，小中在接收到该消息后，可以通过在移动终端100-9侧输入同意他人使用移动终端100-1的操作，移动终端100-9响应于该操 作，可以向移动终端100-1发送同意他人使用本机进行支付的信息，移动终端100-1接收到该信息后，可以解锁并为非机主本人提供支付服务。Optionally, when the mobile terminal 100-1 continues to perform identity authentication, if the verification fails, and the number of failures exceeds the preset number of times, the mobile terminal 100-1 can send a prompt message to the owner himself, that is, other mobile terminals equipped in the small center. . For example, send the prompt message shown in Figure 9G to the mobile terminal 100-9 of Xiaozhong, that is, the bracelet. After receiving the message, Xiaozhong can agree to allow others to use the mobile terminal 100-1 In response to this operation, the mobile terminal 100-9 can send information to the mobile terminal 100-1 to allow others to use the machine to make payment. Provide payment services.
可以理解的是，上文图9A-图9G仅示例性示出在社交软件中向他人转账这一种支付操作，支付操作还可以包括在社交软件中向他人发红包，或者是在直播间打赏主播，购买商品，或者是扫描收付款码向他人付款等等，本申请实施例对此不作限制。It can be understood that the above Figures 9A-9G only exemplify the payment operation of transferring money to others in social software, and the payment operation can also include sending red envelopes to others in social software, or playing Rewarding anchors, purchasing goods, or scanning payment codes to pay others, etc., are not limited in this embodiment of the application.
参考图9H-图9M，图9H-图9M示例性示出小中的移动终端100-1检测到另一种敏感操作后的一系列用户界面示意图。Referring to FIG. 9H-FIG. 9M, FIG. 9H-FIG. 9M exemplarily show a series of user interface diagrams after the mobile terminal 100-1 in the small medium detects another sensitive operation.
图9H示例性示出小明使用小中的手机观看直播的场景示意图。FIG. 9H exemplarily shows a schematic diagram of a scene where Xiao Ming uses Xiaozhong's mobile phone to watch a live broadcast.
如图9H所示，用户界面93即直播类APP提供的一个直播页面，用户界面93显示有主播的视频区、直播时间、留言区以及控件931等等。移动终端100-1可以检测到作用于控件931的操作，响应于该操作，移动终端100-1展开显示如图9I所示的为主播打赏礼物的窗口。As shown in FIG. 9H , the user interface 93 is a live broadcast page provided by the live broadcast APP. The user interface 93 displays the anchor's video area, live broadcast time, message area, controls 931 and so on. The mobile terminal 100-1 may detect an operation on the control 931, and in response to the operation, the mobile terminal 100-1 expands and displays the window for rewarding gifts for the host as shown in FIG. 9I.
如图9I所示，窗口932显示有多个礼物选项，例如棒棒糖、Mojito、小花花、王冠、钻石、小心心等，不同的礼物对应不同的价钱，假设用户小明选择棒棒糖选项，并点击赠送控件，响应于该操作，移动终端100-1显示如图9J所示的充值窗口。As shown in Figure 9I, window 932 displays multiple gift options, such as lollipop, Mojito, little flower, crown, diamond, little heart, etc. Different gifts correspond to different prices. Assuming that user Xiao Ming chooses the lollipop option, And click on the gift control, and in response to this operation, the mobile terminal 100-1 displays a recharge window as shown in FIG. 9J .
如图9J所示，用户界面93显示有充值窗口933。可以理解的是，部分APP提供的支付服务，需要进行充值，将人民币转换为该APP支持的支付方式例如“Y币”，之后，用户草啊可以使用该APP支持的支付方式进行支付操作。As shown in FIG. 9J , the user interface 93 displays a recharge window 933 . It is understandable that the payment services provided by some APPs need to be recharged to convert RMB into payment methods supported by the APP, such as "Y coins". After that, users can use the payment methods supported by the APP to perform payment operations.
移动终端100-1可以检测到用户输入如图9J所示的充值数值为520的操作，响应于该操作，移动终端100-1可以直接开启身份认证，或者移动终端100-1可以先显示如图9K所示的用户身份认证提示信息。本申请实施例对此不作限制。Mobile terminal 100-1 can detect that the user enters the operation of recharging 520 as shown in Figure 9J, and in response to this operation, mobile terminal 100-1 can directly enable identity authentication, or mobile terminal 100-1 can first display User identity authentication prompt information shown in 9K. The embodiment of the present application does not limit this.
如图9K所示，用户界面93显示有窗口934，窗口934显示有例如“检测到您在进行支付操作，您是否为机主本人”的提示信息，以及控件934A和控件934B。这里的身份认证方式可以与上文智慧家庭APP提供的身份认证的方式相同或者不同或者更多更少，本申请实施例对此不作限制。As shown in FIG. 9K , the user interface 93 displays a window 934 , and the window 934 displays a prompt message such as "It is detected that you are performing a payment operation, are you the owner of the device?", as well as a control 934A and a control 934B. The identity authentication method here may be the same or different or more or less than the identity authentication method provided by the smart home APP above, which is not limited in this embodiment of the present application.
移动终端100-1可以检测到用户输入如图9K所示的作用于控件934A的操作，响应于该操作，移动终端100-1则开启身份认证。The mobile terminal 100-1 may detect that the user inputs an operation on the control 934A as shown in FIG. 9K , and in response to the operation, the mobile terminal 100-1 enables identity authentication.
当移动终端100-1检测到当前使用者为非机主本人时，则显示如图9L所示的提示信息。When the mobile terminal 100-1 detects that the current user is not the owner, the prompt information shown in FIG. 9L is displayed.
如图9L所示，用户界面93显示有窗口935，以及控件935A和控件935B。窗口935显示有例如“验证失败，暂不支持充值操作”的提示信息。之后，移动终端100-1可以检测到用户输入作用于如图9D所示的控件935B的操作，响应于该操作，移动终端100-1不再继续进行身份认证，同时关闭充值的页面。或者，移动终端100-1可以检测到用户输入作用于如图9D所示的控件935A和操作，响应于该操作，移动终端100-1则继续进行身份认证。或者移动终端100-1无需检测到作用于控件922A的操作，可以自动进行身份认证。本申请实施例对此不作限制。As shown in FIG. 9L, user interface 93 displays window 935, and controls 935A and 935B. Window 935 displays a prompt message such as "Verification failed, recharge operation not supported for now". Afterwards, the mobile terminal 100-1 may detect that the user input acts on the operation of the control 935B as shown in FIG. 9D , and in response to the operation, the mobile terminal 100-1 does not continue identity authentication, and closes the recharge page at the same time. Alternatively, the mobile terminal 100-1 may detect that the user input acts on the control 935A and the operation shown in FIG. 9D , and in response to the operation, the mobile terminal 100-1 continues to perform identity authentication. Alternatively, the mobile terminal 100-1 can automatically perform identity authentication without detecting the operation on the control 922A. The embodiment of the present application does not limit this.
当移动终端100-1检测到用户输入如图9L所示的作用于控件935B的操作，响应于该操作，移动终端100-1继续显示如图9M所示的直播画面。When the mobile terminal 100-1 detects that the user inputs an operation on the control 935B as shown in FIG. 9L , in response to the operation, the mobile terminal 100-1 continues to display the live video as shown in FIG. 9M .
可以理解的是，本申请所述的敏感操作不限于上文图9A-图9G、以及图9H-图9M所示的两个支付操作的示例，还有其他敏感操作，例如检测到用户在玩网上赌博类游戏或者购买商品、扫码付款等等操作时，移动终端100同样会实施上述方法，制止用户继续执行敏感操作或者实施敏感行为等，本申请实施例对此不再赘述。It can be understood that the sensitive operations described in this application are not limited to the examples of the two payment operations shown in Figure 9A-9G and Figure 9H-9M above, and there are other sensitive operations, such as detecting that When performing online gambling games or purchasing commodities, scanning codes for payment, etc., the mobile terminal 100 will also implement the above method to prevent the user from continuing to perform sensitive operations or conduct sensitive behaviors, etc., which will not be described in this embodiment of the application.
接下来，参考图9N-图9Q，图9N-图9Q示例性示出小中的移动终端100-1检测到另一种敏感操作后的一系列用户界面示意图。Next, referring to FIG. 9N-FIG. 9Q, FIG. 9N-FIG. 9Q exemplarily show a series of user interface diagrams after the mobile terminal 100-1 in the small medium detects another sensitive operation.
图9N示例性示出其他用户使用小中的移动终端进行扫码付款的场景示意图。FIG. 9N exemplarily shows a schematic diagram of a scene where other users use the mobile terminal of Xiaozhong to scan the code for payment.
如图9N所示，用户界面94为条码扫描界面，该界面显示有图像采集区域941，图像采集区域显示移动终端100-1采集的图像，例如小军的收款码。当移动终端100-1成功扫描小军的付款码后，可以显示图9O所示付款界面。As shown in FIG. 9N , the user interface 94 is a barcode scanning interface, and the interface displays an image collection area 941 that displays images collected by the mobile terminal 100 - 1 , such as Xiaojun's payment code. After the mobile terminal 100-1 successfully scans Xiaojun's payment code, the payment interface shown in FIG. 9O may be displayed.
如图9O所示，用户界面95为付款界面，该界面可以支持用户向小军付款。As shown in FIG. 90 , the user interface 95 is a payment interface, which can support the user to pay Xiaojun.
如图9P所示，移动终端100-9可以检测到用户输入200元，并作用于付款控件的操作，响应于该操作，移动终端100-1可以先显示如图9Q所示的用户身份认证提示信息。As shown in Figure 9P, the mobile terminal 100-9 can detect that the user has input 200 yuan and act on the operation of the payment control. In response to this operation, the mobile terminal 100-1 can first display the user identity authentication prompt as shown in Figure 9Q information.
如图9Q所示，用户界面95显示有窗口952，窗口952显示有例如“检测到您在进行支付操作，您是否为机主本人”的提示信息，以及控件952A和控件952B。其中，控件952A用于开启身份认证功能、控件952B用于关闭窗口952，并拒绝向小军付款200元。这里的身份认证方式可以与上文智慧家庭APP提供的身份认证的方式相同或者不同或者更多更少，本申请实施例对此不作限制。As shown in FIG. 9Q, the user interface 95 displays a window 952, and the window 952 displays a prompt message such as "It is detected that you are making a payment operation, are you the owner of the device?", as well as a control 952A and a control 952B. Among them, the control 952A is used to enable the identity authentication function, and the control 952B is used to close the window 952, and refuse to pay 200 yuan to Xiaojun. The identity authentication method here may be the same or different or more or less than the identity authentication method provided by the smart home APP above, which is not limited in this embodiment of the present application.
当移动终端100-1检测到如图9Q所示的控件952A的操作，响应于该操作，移动终端100-1开启身份认证。当身份认证成功时，即当前用户为移动终端100-1的机主小中时，移动终端会向小军付款；而当身份认证失败时，移动终端100-1显示的用户界面可以参考上文对图9D-图9G的描述，这里不再一一赘述。When the mobile terminal 100-1 detects the operation of the control 952A shown in FIG. 9Q , in response to the operation, the mobile terminal 100-1 enables identity authentication. When the identity authentication is successful, that is, when the current user is the owner of the mobile terminal 100-1, Xiaojun, the mobile terminal will pay Xiaojun; and when the identity authentication fails, the user interface displayed by the mobile terminal 100-1 can refer to the above The descriptions of FIG. 9D-FIG. 9G will not be repeated here.
在本申请另一些实施例中，当移动终端100-1检测到支付操作时，支付金额大于预设金额例如100元时则会开启身份认证功能，当支付金额小于等于预设金额时，则不会开启身份认证功能，并直接向对方付款。或者，当移动终端100-1检测到支付操作时，该支付对象为非常用联系人时，则开启身份认证功能，当支付对象为常用联系人时，则不开启身份认证，并直接对方付款。In other embodiments of the present application, when the mobile terminal 100-1 detects a payment operation, the identity authentication function will be turned on when the payment amount is greater than the preset amount, such as 100 yuan, and the identity authentication function will not be activated when the payment amount is less than or equal to the preset amount. The identity authentication function will be turned on and the payment will be made directly to the other party. Alternatively, when the mobile terminal 100-1 detects a payment operation and the payment object is an unused contact, the identity authentication function is enabled; when the payment object is a frequent contact, the identity authentication is not enabled and the payment is made directly to the other party.
在本申请另一些实施例中，移动终端100-1响应于图9P所示的付款的操作，可以不显示图9Q所示的提示信息，可以直接开启身份认证，本申请实施例对此不作限制。In other embodiments of the present application, the mobile terminal 100-1 may not display the prompt information shown in FIG. 9Q in response to the payment operation shown in FIG. 9P, and may directly enable identity authentication, which is not limited in this embodiment of the present application. .
参考图9R-图9W，图9R-图9W示例性示出小中的移动终端100-1检测到另一种敏感操作后的一系列用户界面示意图。Referring to FIG. 9R-FIG. 9W, FIG. 9R-FIG. 9W exemplarily show a series of user interface diagrams after the mobile terminal 100-1 in the small medium detects another sensitive operation.
移动终端检测到用户观看直播、未成年视频，以及打游戏时，可以开启身份认证，若检测到非机主本人，则禁止用户观看直播、未成年视频，以及打游戏等等。接下来以小爱使用小中的移动终端100-1观看直播为例进行介绍。When the mobile terminal detects that the user is watching live broadcasts, underage videos, or playing games, it can enable identity authentication. If it detects that the user is not the owner himself, the user is prohibited from watching live broadcasts, underage videos, and playing games. Next, take Xiao Ai to use Xiaozhong's mobile terminal 100-1 to watch the live broadcast as an example.
如图9R所示，用户界面96中显示有多个直播间对应的选项，用户可以通过点击其中任意一个选项，进入对应的直播间观看直播。As shown in FIG. 9R , the user interface 96 displays multiple options corresponding to the live broadcast room, and the user can click on any one of the options to enter the corresponding live broadcast room to watch the live broadcast.
当移动终端100-1检测到作用于选项961的操作，响应于该操作，移动终端100-1会直接开启身份认证，或者会先显示如图9S所示的开启身份认证提示信息。本申请实施例对此不作限制。When the mobile terminal 100-1 detects an operation on option 961, in response to the operation, the mobile terminal 100-1 will directly enable identity authentication, or first display a prompt message for enabling identity authentication as shown in FIG. 9S . The embodiment of the present application does not limit this.
如图9S所示，用户界面96显示有窗口962，窗口962显示有例如“检测到您在进行支付操作，您是否为机主本人”的提示信息，以及控件962A和控件962B。其中，控件962A用于开启身份认证功能、控件962B用于关闭窗口962，并拒绝进入直播间。这里的身份认证方式可以与上文智慧家庭APP提供的身份认证的方式相同或者不同或者更多更少，本申请实 施例对此不作限制。As shown in FIG. 9S , the user interface 96 displays a window 962, and the window 962 displays a prompt message such as "It is detected that you are making a payment operation, are you the owner of the device", and a control 962A and a control 962B. Among them, the control 962A is used to enable the identity authentication function, and the control 962B is used to close the window 962 and refuse to enter the live broadcast room. The identity authentication method here can be the same or different or more or less than the identity authentication method provided by the smart home APP above, which is not limited in this embodiment of the application.
当移动终端100-1检测到如图9Q所示的控件952A的操作，响应于该操作，移动终端100-1开启身份认证。当移动终端开启身份认证后，若认证成功，则进入选项961对应的直播间并显示直播内容；若认证失败，则移动终端会显示如图9T所示的认证失败提示信息。When the mobile terminal 100-1 detects the operation of the control 952A shown in FIG. 9Q , in response to the operation, the mobile terminal 100-1 enables identity authentication. After the mobile terminal turns on the identity authentication, if the authentication is successful, it will enter the live room corresponding to option 961 and display the live content; if the authentication fails, the mobile terminal will display the authentication failure prompt information as shown in Figure 9T.
如图9T所示，用户界面96显示有窗口963，窗口963显示有例如“验证失败，暂不支持观看直播”的提示信息，以及控件963A和控件963B。控件963A用于继续进行身份认证，控件963B用于结束身份认证。在本申请一些实施例中，窗口963中可能不显示控件963A。As shown in FIG. 9T , the user interface 96 displays a window 963 , and the window 963 displays a prompt message such as "Verification failed, watching live broadcast is not supported for now", and a control 963A and a control 963B. Control 963A is used to continue identity authentication, and control 963B is used to end identity authentication. In some embodiments of the present application, the control 963A may not be displayed in the window 963 .
之后，移动终端100-1可以检测到用户输入作用于如图9T所示的控件963B的操作，响应于该操作，移动终端100-1不再继续进行身份认证，同时拒绝用户进入直播间显示直播内容。Afterwards, the mobile terminal 100-1 can detect that the user input acts on the operation of the control 963B as shown in FIG. content.
或者，移动终端100-1可以检测到用户输入作用于如图9T所示的控件963A的操作，响应于该操作，移动终端100-1则继续进行身份认证。或者移动终端100-1无需检测到作用于控件963A的操作，当窗口963的显示时间超过预设时间时，移动终端100-1可以自动进行身份认证。本申请实施例对此不作限制。Alternatively, the mobile terminal 100-1 may detect that the user input acts on the operation of the control 963A as shown in FIG. 9T, and in response to the operation, the mobile terminal 100-1 continues to perform identity authentication. Alternatively, the mobile terminal 100-1 does not need to detect the operation on the control 963A, and when the display time of the window 963 exceeds a preset time, the mobile terminal 100-1 may automatically perform identity authentication. The embodiment of the present application does not limit this.
可选的，当移动终端100-1继续进行身份认证，若验证失败，则再次显示如图9T所示的提示信息；若验证失败，且失败次数超过预设次数例如3次时，移动终端100-1可以采取一项任意一项或多项措施：Optionally, when the mobile terminal 100-1 continues to perform identity authentication, if the verification fails, the prompt message shown in FIG. 9T will be displayed again; -1 can take one or more of any of:
移动终端100-1显示如图9U所示的提示信息，之后会锁屏即显示如图9V所示的锁屏界面；或者移动终端仅停止运行提供直播的APP。The mobile terminal 100-1 displays the prompt information as shown in FIG. 9U , and then locks the screen and then displays the lock screen interface as shown in FIG. 9V ; or the mobile terminal just stops running the APP that provides live broadcast.
或者移动终端100-1可以向机主本人即小中配备的其他移动终端发送提示信息。例如向小中的移动终端100-9即手环或者车载电脑发送提示消息。Alternatively, the mobile terminal 100-1 may send prompt information to the owner himself, that is, other mobile terminals equipped in the small center. For example, a prompt message is sent to the mobile terminal 100-9 in the small and medium-sized bracelet or the vehicle-mounted computer.
当小中正在驾驶车辆时，车载电脑可以接收到移动终端100-1发送的提示消息，并输出该提示信息。该提示信息可以通过语音播报的方式输出，也可以显示在如图9W所示的用户界面中。When Xiao Zhong is driving the vehicle, the on-board computer can receive the prompt message sent by the mobile terminal 100-1, and output the prompt message. The prompt information can be output in the form of voice broadcast, or can be displayed in the user interface as shown in FIG. 9W.
如图9W所示，车载电脑中显示有“他人想要使用您的移动终端100-1观看直播”的提示信息，以及同意控件和拒绝控件。小中可以通过在车载电脑端输入同意他人使用移动终端100-1观看直播的操作，响应于该操作，车载电脑可以向移动终端100-1发送同意他人使用本机观看直播，移动终端100-1接收到该信息后，可以解锁屏幕或者解除对提供直播的APP的锁定，并为非机主本人提供观看直播的服务。As shown in FIG. 9W , the vehicle computer displays a prompt message "others want to use your mobile terminal 100-1 to watch the live broadcast", as well as an consent control and a rejection control. Xiao Zhong can enter the operation of agreeing to allow others to use the mobile terminal 100-1 to watch the live broadcast on the vehicle-mounted computer. After receiving the information, you can unlock the screen or unlock the APP that provides live broadcast, and provide the service of watching live broadcast for non-owners themselves.
下文仅仅介绍了家长通过设置孩子使用电子设备的规则来达到对孩子的教育目的。然而，在家庭教育中，不仅需要通过管教孩子的学习、生活习惯来达到教育的目的，教育还需要家长的言传身教和以身作则，因为家长才是孩子最好的启蒙老师。The following only describes how parents can achieve educational purposes for their children by setting rules for their children's use of electronic devices. However, in family education, it is not only necessary to achieve the purpose of education by disciplining children's study and living habits, education also requires parents to teach by example and lead by example, because parents are the best enlightenment teachers for children.
因此，为了达到对孩子进行全方位的教育，以及达到家长高质量陪伴孩子的目的，本申请提供的家庭设备的控制方法，还包括对家长使用电子设备的规则的设置。具体如下：Therefore, in order to achieve all-round education for children and the goal of parents accompanying children with high quality, the method for controlling family devices provided by this application also includes setting rules for parents using electronic devices. details as follows:
在本申请实施例中，移动终端100可以设置家长使用家庭设备的规则，该规则可以是移动终端100默认设置的，也可以是用户自定义的。该家长使用家庭设备的规则具体是指：当小孩的状态为指定状态时，家庭设备则不支持家长执行指定操作。上述指定状态包括以下任意一项或多项：小孩未睡觉，小孩在学习或者小孩未和家长共处一室。本申请实施例对小孩的指定状态不作限制。上述指定操作包括以下任意一项或多项：打游戏、看电视剧、直播、短视频等等。本申请实施例对家长被限制的指定操作不作限制。In the embodiment of the present application, the mobile terminal 100 may set the rules for the parents to use the family device, and the rules may be set by the mobile terminal 100 by default, or may be user-defined. The rule for the parent to use the home device specifically refers to: when the state of the child is a specified state, the home device does not support the parent to perform the specified operation. The above specified status includes any one or more of the following: the child is not sleeping, the child is studying or the child is not in the same room as the parent. The embodiment of the present application does not limit the specified status of the child. The above specified operations include any one or more of the following: playing games, watching TV dramas, live broadcasting, short videos, etc. This embodiment of the present application does not limit the designated operations restricted by parents.
在本申请实施例中，用于检测小孩状态的设备可以是家庭设备200中的以下任意一项或多项：摄像头等监控设备，便携式终端设备例如手机、平板、笔记本、智能手表、运动手环等等。本申请实施例对此不作限制。上述用于检测小孩的状态的设备还可以称为第六设备。In this embodiment of the application, the device used to detect the state of the child may be any one or more of the following in the family device 200: monitoring devices such as cameras, portable terminal devices such as mobile phones, tablets, notebooks, smart watches, sports bracelets etc. The embodiment of the present application does not limit this. The above-mentioned device for detecting the state of a child may also be referred to as a sixth device.
在本申请实施例中，用于限制家长执行指定操作的设备可以是家庭设备200中的以下任意一项或多项：手机、平板、笔记本、电视机、投影设备、游戏机等等。本申请实施例对此不作限制。In this embodiment of the application, the device used to restrict parents from performing specified operations may be any one or more of the following family devices 200: mobile phone, tablet, notebook, TV, projection device, game console and so on. The embodiment of the present application does not limit this.
接下来仍然以孩子小爱，爸爸小中这对父女来介绍家庭设备的控制方法。Next, we will still introduce the control method of home devices with the father and daughter of the child, Xiaoai, and the father, Xiaozhong.
场景1：小中在家陪伴照顾小爱，在这之前，小中为了做一位好爸爸，为小爱树立好的榜样，可以使用移动终端100-1设置自己使用家庭设备200的规则。该规则例如为：小爱在没有睡觉，或者小爱在学习，或者小爱和爸爸待在一个房间时，则不允许爸爸小中使用家庭设备200打游戏、看剧、看直播。Scenario 1: Xiaozhong stays at home to accompany and take care of Xiaoai. Before this, Xiaozhong can use the mobile terminal 100-1 to set rules for using the home device 200 in order to be a good father and set a good example for Xiaoai. The rule is, for example: when Xiao Ai is not sleeping, or Xiao Ai is studying, or Xiao Ai and Dad stay in the same room, Dad Xiaozhong is not allowed to use the home device 200 to play games, watch dramas, or watch live broadcasts.
图9X示例示出小中使用移动终端100-1看直播的操作界面示意图。FIG. 9X exemplarily shows a schematic diagram of an operation interface for a small middle school to use the mobile terminal 100-1 to watch a live broadcast.
如图9X所示，用户界面121为移动终端100-1的桌面。该桌面上显示有直播类应用程序对应的图标、游戏类应用程序对应的图标以及短视频类应用程序对应的图标，以及华为视频对应的图标等等。As shown in FIG. 9X, the user interface 121 is the desktop of the mobile terminal 100-1. Icons corresponding to live broadcast applications, icons corresponding to game applications, icons corresponding to short video applications, and icons corresponding to Huawei Video are displayed on the desktop.
假设小中此时想要打开直播类应用程序观看直播，移动终端100-1可以检测到作用于图9X所示的直播类应用程序图标的操作，响应于该操作，移动终端100-1根据获取到的小爱的状态来判断小中是否可以看直播。Assuming that Xiaozhong wants to open the live broadcast application program to watch the live broadcast at this time, the mobile terminal 100-1 can detect the operation acting on the live broadcast application program icon shown in FIG. You can judge whether Xiao Zhong can watch the live broadcast by checking the status of Xiao Ai.
其中，移动终端100-1获取小爱的状态包括以下任意一种方法或多种。Wherein, the mobile terminal 100-1 acquires the status of Xiao Ai includes any one or more of the following methods.
第一种，移动终端100-1响应于检测到的作用于直播类应用程序的图标的操作，响应于该操作，触发移动终端100-1控制其他家庭设备200检测小爱的状态。例如，控制家庭监控设备例如摄像头获取小的状态，或者控制家庭设备200例如小爱的智能手表、手环、手机获取小爱的状态。In the first way, the mobile terminal 100-1 responds to the detected operation on the icon of the live application program, and in response to the operation, the mobile terminal 100-1 is triggered to control other home devices 200 to detect the status of Xiao Ai. For example, control home monitoring devices such as cameras to obtain the status of Xiao Ai, or control home devices 200 such as smart watches, bracelets, and mobile phones of Xiao Ai to obtain the status of Xiao Ai.
第二种，移动终端100-1可以周期性接收其他家庭设备200检测到的小爱的状态，并存储小爱的状态相关的数据，移动终端100-1响应于检测到的作用于直播类应用程序的图标的操作，响应于该操作，移动终端100-1调取最近一次接收小爱的状态的相关数据，来判断小中是否可以看直播。Second, the mobile terminal 100-1 can periodically receive the status of Xiao Ai detected by other home devices 200, and store the data related to the status of Xiao Ai. In response to the operation of the icon of the program, the mobile terminal 100-1 retrieves the relevant data about the status of receiving Xiao Ai last time to determine whether Xiao Zhong can watch the live broadcast.
第三种，移动终端100-1根据用户输入小孩的状态相关的操作，来获取小孩的状态。In the third way, the mobile terminal 100-1 acquires the status of the child according to the user inputting an operation related to the status of the child.
在本申请实施例中，上述作用于直播类应用程序的图标的操作还可以称为第七操作，该第七操作用于打开移动终端100-1的直播应用程序即开启第一设备的第二功能。In this embodiment of the application, the above-mentioned operation on the icon of the live application program can also be referred to as the seventh operation, and the seventh operation is used to open the live application program of the mobile terminal 100-1, that is, open the second Function.
假设移动终端100-1获取到的小爱的状态为还未睡觉的状态。此时移动终端100-1会输出禁止用户观看直播的提示信息。该提示信息可以是以语言播报的方式输出，也可以是显示如图9Y所示的提示信息。本申请实施例对此不作限制。Assume that the state of Xiao Ai acquired by the mobile terminal 100-1 is not sleeping yet. At this time, the mobile terminal 100-1 will output prompt information prohibiting the user from watching the live broadcast. The prompt information can be output in the form of language broadcast, or the prompt information shown in FIG. 9Y can also be displayed. The embodiment of the present application does not limit this.
如图9Y所示，移动终端100-1显示例如“检测到小爱还没有睡觉，您还不能看直播哦”的提示信息，并拒绝运行直播类应用程序。As shown in FIG. 9Y , the mobile terminal 100 - 1 displays a prompt message such as "It is detected that Xiao Ai is not asleep yet, you cannot watch the live broadcast yet", and refuses to run the live broadcast application.
可以理解的是图9X-图9Y示出的移动终端100-1根据小中执行指定操作，小爱处于指定状态时，的用户界面示意图仅为一种示例，不应构成对本申请的限制。在其他一些实施例中， 移动终端100-1检测的指定操作，还包括用于打开游戏类应用程序或者短视频类应用程序的操作，并且该操作不限于作用于应用程序的图标的操作，还可以是输入语音指令的形式打开该应用程序等等。在其他一些实施例中，移动终端100-1检测到用户处于指定状态除了还未睡觉以外，还包括例如学习或者是和父母共处一室等等。在其他一些实施例中，移动终端输出的提示信息的形式也可以是短信提醒，或者窗口提醒，或者是显示在智慧家庭APP中用于接收消息的模块中，或者是语音提醒等等，本申请实施例对此也不作限制。It can be understood that the mobile terminal 100-1 shown in FIGS. 9X-9Y performs specified operations according to Xiaozhong, and when Xiaoai is in the specified state, the schematic diagram of the user interface is only an example and should not be construed as a limitation to this application. In some other embodiments, the specified operation detected by the mobile terminal 100-1 also includes an operation for opening a game application program or a short video application program, and the operation is not limited to an operation acting on an icon of the application program. The application program can be opened in the form of inputting a voice command or the like. In some other embodiments, the mobile terminal 100-1 detects that the user is in the specified state, besides not sleeping, for example, studying or sharing the same room with parents and so on. In some other embodiments, the prompt information output by the mobile terminal may also be in the form of a text message reminder, or a window reminder, or displayed in a module for receiving messages in the smart home APP, or a voice reminder, etc., the present application The embodiment does not limit this either.
在本申请另一些实施例中，当检测到父母的状态为睡觉或者离家时，小孩使用父母的电子设备时，会禁止小爱使用父母的电子设备，或者禁止小爱使用父母的电子设备中的部分功能等。具体如下：In other embodiments of the present application, when it is detected that the parent is sleeping or away from home, and the child uses the parent's electronic device, Xiao Ai will be prohibited from using the parent's electronic device, or Xiao Ai will be prohibited from using the parent's electronic device. some of the functions, etc. details as follows:
在本申请实施例中，移动终端100可以设置孩子使用家庭设备的规则，该规则可以是移动终端100默认设置的，也可以是用户自定义的。该父母使用家庭设备的规则具体是指：当父母的状态为指定状态时，家庭设备则不支持父母执行指定操作。上述指定状态包括以下任意一项或多项：父母离家，父母睡觉等。本申请实施例对父母的指定状态不作限制。上述指定操作可以称为第八操作，该第八操作用于开启移动终端100即你第一设备的第三功能，该第三功能包括以下任意一项或多项：解锁屏幕、开启打游戏、看电视剧等等。本申请实施例对家长被限制的指定操作不作限制。In the embodiment of the present application, the mobile terminal 100 may set rules for the children to use the family device, and the rules may be set by the mobile terminal 100 by default, or may be user-defined. The rule for the parent to use the family device specifically refers to: when the state of the parent is a designated state, the family device does not support the parent to perform a designated operation. The above specified status includes any one or more of the following: parents away from home, parents sleeping, etc. The embodiment of the present application does not limit the designation status of the parents. The above specified operation can be called the eighth operation, and the eighth operation is used to enable the third function of the mobile terminal 100, that is, your first device. The third function includes any one or more of the following: unlocking the screen, enabling playing games, Watch TV and so on. This embodiment of the present application does not limit the designated operations restricted by parents.
在本申请实施例中，用于检测父母状态的设备可以是家庭设备200中的以下任意一项或多项：摄像头等监控设备，便携式终端设备例如手机、平板、智能手表、运动手环等等。本申请实施例对此不作限制。In this embodiment of the application, the device used to detect the status of the parents may be any one or more of the following in the family device 200: monitoring devices such as cameras, portable terminal devices such as mobile phones, tablets, smart watches, sports bracelets, etc. . The embodiment of the present application does not limit this.
在本申请实施例中，用于限制小孩执行指定操作的设备可以是家庭设备200中的以下任意一项或多项：手机、平板、笔记本、电视机、投影设备、游戏机等等。本申请实施例对此不作限制。上述用于检测父母的状态的设备还可以称为第六设备。In the embodiment of the present application, the device used to restrict the child from performing specified operations may be any one or more of the following in the family device 200: mobile phone, tablet, notebook, TV, projection device, game console and so on. The embodiment of the present application does not limit this. The above-mentioned device for detecting the state of the parents may also be referred to as a sixth device.
接下来仍然以孩子小爱，爸爸小中这对父女来介绍家庭设备的控制方法。Next, we will still introduce the control method of home devices with the father and daughter of the child, Xiaoai, and the father, Xiaozhong.
当移动终端100-1检测到用户使用电子设备时，可以识别用户身份，例如识别到当前用户为小爱时，则移动终端100-1可以获取小爱的父母即小中和/或小华的状态，例如获取到的状态为离家或者为睡觉的状态，则移动终端100-1根据用户预先自定义的使用规则或者移动终端100-1默认设置的规则，来判断是否允许小爱使用移动终端100-1或者，允许小爱使用的移动终端的部分功能等。关于小中处于指定状态时，小爱使用小中的移动终端100-1执行指定操作的用户界面示意图与上文小中在小爱处于指定状态时，执行指定操作的用户界面示意图类似，在此暂不赘述。When the mobile terminal 100-1 detects that the user is using an electronic device, it can identify the user identity, for example, when it recognizes that the current user is Xiaoai, then the mobile terminal 100-1 can obtain the ID of Xiaoai's parents, namely Xiaozhong and/or Xiaohua. state, for example, the obtained state is leaving home or sleeping state, then the mobile terminal 100-1 judges whether Xiao Ai is allowed to use the mobile terminal according to the usage rules defined in advance by the user or the rules set by the mobile terminal 100-1 by default. 100-1 Or, allow some functions of the mobile terminal used by Xiaoai. When Xiaozhong is in the specified state, the schematic diagram of the user interface of Xiaoai using the mobile terminal 100-1 of Xiaozhong to perform the specified operation is similar to the schematic diagram of the user interface of the above Xiaozhong when Xiaoai is in the specified state. Here I won't go into details for now.
在智慧家庭中，家庭设备除了厨房家电、清洁家电、运动设备以外，还包含许多用于教育学习的电子设备，这些家庭设备都是用于都是打造智慧家庭的重要元素。在家庭生活中，不可或缺的，家长需要对子女进行家庭教育，这样才能将孩子培养出良好的生活习惯、学习习惯等等。而在家庭教育过程中，教育离不开学习规则、生活习惯，但家长通常不能时刻监督子女的学习、生活。In a smart home, in addition to kitchen appliances, cleaning appliances, and sports equipment, home devices also include many electronic devices for education and learning. These home devices are all important elements for building a smart home. In family life, it is indispensable. Parents need to educate their children at home, so that they can cultivate good living habits, study habits and so on. In the process of family education, education is inseparable from learning rules and living habits, but parents usually cannot always supervise their children's learning and life.
为了节省父母的时间，不耽误对子女的教育，利用家庭设备实现智慧家庭教育，本申请 提供了一种家庭设备的控制方法，用户可以根据对子女的教育计划来设置家庭设备的使用规则，若子女打破该规则，则必须在对应的家庭设备中完成制定的任务，以此来达到对子女的教育。这便是指，在智慧家庭中打造出智慧家教这理念。In order to save parents' time, not delay the education of their children, and use home equipment to realize smart home education, this application provides a control method for home equipment. Users can set the use rules of home equipment according to their children's education plans. If children break this rule, they must complete the assigned tasks in the corresponding home devices, so as to achieve the education of children. This refers to creating the concept of smart tutoring in smart families.
接下来仍然以爸爸小中、女儿小爱两个主人公，以及他(她)们配有的移动终端为例，结合UI实施例来介绍上述家庭设备的控制方法。Next, taking the two protagonists, father Xiaozhong and daughter Xiaoai, and their mobile terminals as examples, the control method of the above-mentioned home devices will be introduced in combination with the UI embodiment.
在本申请实施例中，爸爸小中可以使用自己的手机例如移动终端100-1来设置女儿小爱使用家庭设备的规则，也可以直接在对应的家庭设备中设置被小爱使用时的规则，本申请实施例对此不作限制。然而，考虑到爸爸小中作为家庭创建者，家庭设备的管理、设置、控制集中在爸爸小中的移动终端100-1中进行处理更加合理、便捷，因此下文UI实施例仅以在移动终端100-1中设置使用规则为例，进行介绍。In the embodiment of this application, Dad Xiaozhong can use his own mobile phone, such as mobile terminal 100-1, to set the rules for daughter Xiaoai to use home devices, or directly set the rules for being used by Xiaoai in the corresponding home devices. The embodiment of the present application does not limit this. However, considering that Daddy Xiaozhong is the family creator, it is more reasonable and convenient to centralize the management, setting, and control of family equipment in the mobile terminal 100-1 of Daddy Xiaozhong, so the following UI embodiments are only based on mobile terminal 100 The usage rules set in -1 are taken as an example for introduction.
此外，上述使用规则的设置对象家庭设备，具体可以是女儿小爱的平板例如移动终端100-6，还可以是家中其他设备，例如计算机、智慧屏、投影仪等等。本申请实施例对此不作限制。然而，考虑到女儿小爱使用家庭设备的频率，移动终端100-6作为学习、娱乐、通信等等为一体的智能终端，其被使用频率是所有家庭设备中最高的一款设备，因此下文UI实施例仅以移动终端100-6作为使用规则的设置对象为例，进行介绍。In addition, the above-mentioned home devices for setting the usage rules may specifically be the tablet of the daughter Xiaoai such as the mobile terminal 100-6, or other devices in the home such as computers, smart screens, projectors and so on. The embodiment of the present application does not limit this. However, considering how frequently her daughter Xiaoai uses home devices, the mobile terminal 100-6, as an intelligent terminal integrating learning, entertainment, communication, etc., is the most frequently used device among all home devices, so the following UI In this embodiment, the mobile terminal 100-6 is used as an example for setting the usage rules, and the introduction is made.
此外，上述任务具体可以包括以下任意一项或多项：女儿小爱在使用规则的设置对象即移动终端100-6张工完成的例如学习、运动等的任务；使用其他家庭设备例如运动设备跑步机、手环完成例如跑步、健身等任务；使用其他家庭设备例如学习设备计算机、学习机等完成做题、阅读、上课等任务；或者是使用其他家庭设备例如家具清洁设备吸尘器等中完成打扫房间的任务，本申请实施例对此不作限制。In addition, the above-mentioned tasks may specifically include any one or more of the following: tasks such as learning and sports completed by the daughter Xiaoai when using the set object of the rules, that is, the mobile terminal 100-6; using other home equipment such as sports equipment to run Computers and wristbands to complete tasks such as running and fitness; use other home equipment such as learning equipment computers, learning machines, etc. to complete tasks such as doing questions, reading, and attending classes; or use other household equipment such as furniture cleaning equipment vacuum cleaners to complete house cleaning The task of this application is not limited in this embodiment.
在一种具体的实现方式中，小中可以通过在移动终端100-1中绑定小爱的移动终端100-6，根据对小爱的教育计划设置移动终端100-6的使用规则。此外，小中还需制定打破上述使用规则后，采取的教育措施，该教育措施即制定一个或多个任务，这些任务可以通过小爱的移动终端100-6或者家中的其他家庭设备来完成。例如，小中设置的使用规则为每天使用移动终端100-6的时长为4小时，打破规则后需要完成的任务例如是学习1小时并且运动1小时。当小爱使用时间超过4小时，移动终端100-6可以锁屏或者锁定部分功能，直至移动终端100-6检测到小爱使用移动终端100-6完成上述任务后；或者移动终端100-6接收到小爱使用其他家庭设备例如跑步机完成1小时的运动任务的相关数据，以及接收到小爱使用其他家庭设备例如学习机完成1小时的学习任务的相关数据后，移动终端100-6才会解锁，或者解除部分功能的锁定。In a specific implementation manner, the Xiaozhong can set the usage rules of the mobile terminal 100-6 according to the education plan for Xiaoai by binding the mobile terminal 100-6 of Xiaoai to the mobile terminal 100-1. In addition, Xiaozhong also needs to formulate educational measures to be taken after breaking the above usage rules. The educational measures are to formulate one or more tasks, and these tasks can be completed through Xiaoai's mobile terminal 100-6 or other family devices at home. For example, the usage rule set in the small center is that the mobile terminal 100-6 is used for 4 hours a day, and the tasks to be completed after breaking the rule are, for example, 1 hour of study and 1 hour of exercise. When Xiaoai has been used for more than 4 hours, the mobile terminal 100-6 can lock the screen or lock some functions until the mobile terminal 100-6 detects that Xiaoai uses the mobile terminal 100-6 to complete the above tasks; or the mobile terminal 100-6 receives The mobile terminal 100-6 will not wait until Xiaoai uses other home equipment such as a treadmill to complete the 1-hour exercise task data, and receives the relevant data that Xiaoai uses other home equipment such as a learning machine to complete the 1-hour learning task. Unlock, or unlock some functions.
参考图10A-图10H，图10A-图10H示例性示出小中在移动终端100-1中设置该设备的使用规则以及相关任务，的一系列操作界面示意图。Referring to FIG. 10A-FIG. 10H, FIG. 10A-FIG. 10H exemplarily show a series of operation interface diagrams for setting the usage rules and related tasks of the device in the mobile terminal 100-1.
如图10A所示，移动终端100-1显示的用户界面与前文图6K、图8F、图8J示出的用户界面61类似，前文中对图6K的描述也适用于对图10A的描述，在此暂不赘述。As shown in FIG. 10A, the user interface displayed by the mobile terminal 100-1 is similar to the user interface 61 shown in FIG. 6K, FIG. 8F, and FIG. I won't go into details here.
移动终端100-1检测到用户点击控件615D的操作，响应于该操作，移动终端100-1显示如图10B所示的用户界面81。The mobile terminal 100-1 detects the user's operation of clicking the control 615D, and in response to the operation, the mobile terminal 100-1 displays the user interface 81 as shown in FIG. 10B .
如图10B所示，移动终端100-1显示的用户界面与前文图6K、图8F、图8J示出的用户界面81类似，前文中对图6K的描述也适用于对图10A的描述，在此暂不赘述。As shown in FIG. 10B, the user interface displayed by the mobile terminal 100-1 is similar to the user interface 81 shown in FIG. 6K, FIG. 8F, and FIG. I won't go into details here.
移动终端100-1可以检测到用户点击图10B中选项814的操作，选项814用于打开我的 其他设备页面，该页面具体可以为用户提供管理用户的其他设备例如平板、笔记本、手环、耳机等功能，因此，响应于上述操作，移动终端100-1显示如图10C所示的用户界面101。The mobile terminal 100-1 can detect that the user clicks on the option 814 in Figure 10B. The option 814 is used to open the My Other Devices page. This page can specifically provide the user with management of other devices such as tablets, notebooks, wristbands, and earphones. and other functions, therefore, in response to the above operations, the mobile terminal 100-1 displays the user interface 101 as shown in FIG. 10C .
如图10C所示，用户界面101显示有已经绑定的电子设备所对应的选项1011、选项1012、选项1013等等，以及用于绑定更多设备的控件1014。其中选项1011对应小中配有的移动终端100-9，选项1012对应小爱的移动终端100-5例如智能手表，选项1013对应小爱的移动终端100-6例如平板电脑。用户可以通过点击上述选项，设置对应设备的使用规则等，具体如下：As shown in FIG. 10C , the user interface 101 displays options 1011 , 1012 , 1013 , etc. corresponding to already bound electronic devices, and a control 1014 for binding more devices. Among them, option 1011 corresponds to the mobile terminal 100-9 equipped in Xiaozhong, option 1012 corresponds to Xiaoai's mobile terminal 100-5 such as a smart watch, and option 1013 corresponds to Xiaoai's mobile terminal 100-6 such as a tablet computer. Users can click the above options to set the usage rules of the corresponding device, as follows:
移动终端100-1可以检测到作用于图10C中任意一个设备选项的操作，响应于该操作，显示该设备对应该的使用规则设置页面。例如，移动终端100-1可以检测到用户点击图10C中选项1013的操作，响应于该操作，移动终端100-1显示如图10D所示的移动终端100-6的使用规则的设置页面。The mobile terminal 100-1 may detect an operation on any device option in FIG. 10C , and in response to the operation, display the usage rule setting page corresponding to the device. For example, the mobile terminal 100-1 may detect that the user clicks the option 1013 in FIG. 10C , and in response to the operation, the mobile terminal 100-1 displays the usage rule setting page of the mobile terminal 100-6 as shown in FIG. 10D .
如图10D所示，用户界面102即用于设置移动终端100-6使用规则的页面。用户界面102中显示有一系列默认的规则选项，例如用于设置移动终端100-6一天使用时长的选项1021，用于设置移动终端100-6一次使用时长的选项1022，用于设置移动终端100-6使用时间段的选项1023，用于设置禁止使用的APP的选项1024等等。用户可以通过点击上述选项来设置使用时长、使用时间段以及禁止使用的APP等等。As shown in FIG. 10D , the user interface 102 is a page for setting usage rules of the mobile terminal 100-6. A series of default rule options are displayed in the user interface 102, for example, the option 1021 for setting the usage time of the mobile terminal 100-6 in one day, the option 1022 for setting the usage time of the mobile terminal 100-6 once, and the option 1022 for setting the usage time of the mobile terminal 100-6. 6 The option 1023 of the use time period, the option 1024 for setting the prohibited APP, and so on. Users can click on the above options to set the duration of use, time period of use, apps that are prohibited to use, and so on.
用户界面102中还显示有打破上述使用规则后，用于解锁移动终端100-6的默认选项，例如用于设置运动时间的选项1025，用于设置学习时间的选项1026，以及用于设置密码认证的选项1027等等。用户可以通过点击上述移动终端100-1默认给出的选项来设置学习时长、运动时间段以及用于解锁的密码等等。Also displayed in the user interface 102 are the default options for unlocking the mobile terminal 100-6 after breaking the above usage rules, such as option 1025 for setting exercise time, option 1026 for setting study time, and option 1026 for setting password authentication. option 1027 and so on. The user can set the learning duration, exercise time period, password for unlocking, etc. by clicking the default options provided by the mobile terminal 100-1.
用户界面102中除了显示上述默认的设置选项以外，还显示有控件1028A和控件1028B，其中控件1028A用于用户去重新自定义使用规则以及解锁任务，而控件1028B则用于应用上述已经设置好的默认选项。也就是说，用户可以选择对移动终端100-6默认给出的使用规则以及解锁任务的选项进行设置，然后点击控件1028B应用已经设置好的使用规则以及限制方法。或者用户可以通过点击控件1028A去自定义对移动终端100-6的使用规则以及解锁任务。In addition to displaying the above-mentioned default setting options, the user interface 102 also displays a control 1028A and a control 1028B, wherein the control 1028A is used for the user to re-customize the usage rules and unlock tasks, and the control 1028B is used for applying the above-mentioned settings. Default option. That is to say, the user can choose to set the default usage rules and unlocking task options provided by the mobile terminal 100-6, and then click the control 1028B to apply the already set usage rules and restriction methods. Or the user can customize the usage rules and unlocking tasks for the mobile terminal 100-6 by clicking the control 1028A.
可以理解的是，图10D示出的使用规则仅仅为一种示例，在本申请另一些实施例中，移动终端100-1显示的使用规则所包含的选项可以比图10D示出的更多或者更少，例如还可以包含允许使用的APP的选项而非限制使用的APP的选项，以及允许持续使用该应用程序的时长的选项等等。用户可以点击该选项来设置允许使用的APP，例如教育学习类APP和短信、电话等通讯类APP。当移动终端100-1检测到用户想要使用允许使用的APP范围以外的其他APP例如游戏类视频或者视频类APP时，移动终端100-1可以直接拒绝运行该APP，或者移动终端100-1可以提示用户需要完成指定的解锁任务才能使用该APP，当移动终端检测到用户完成指定的解锁任务时，允许用户使用该APP。It can be understood that the usage rules shown in FIG. 10D are only an example. In other embodiments of the present application, the usage rules displayed by the mobile terminal 100-1 may include more options than those shown in FIG. 10D or Less, for example, it may also include the option of the APP that is allowed to be used instead of the option of the APP that is restricted to be used, and the option of the duration of the application that is allowed to be used continuously. Users can click this option to set the allowed apps, such as educational and learning apps and communication apps such as SMS and phone calls. When the mobile terminal 100-1 detects that the user wants to use other APPs other than the allowed APP range, such as game video or video APP, the mobile terminal 100-1 can directly refuse to run the APP, or the mobile terminal 100-1 can Prompt the user to complete the specified unlocking task before using the APP, and when the mobile terminal detects that the user has completed the specified unlocking task, the user is allowed to use the APP.
在本申请实施例中，第一规则中包含的允许使用的应用程序还可以称为第一应用程序。允许持续使用第一应用程序的时长为第三时长。In this embodiment of the present application, the allowed application included in the first rule may also be referred to as the first application. The time period allowed to continuously use the first application program is the third time period.
在本申请另一些实施例中，使用规则中不仅可以设置允许使用的APP，还可以进一步设置仅允许使用APP中的指定功能、指定业务、指定服务等等。以视频类APP为例，可以设置视频类APP只能播放教育学习类视频，而除教育学习类以外的例如游戏、娱乐类视频则被禁止播放。当移动终端100-1检测到用户打破使用规则例如观看华为视频中非学习类APP，响应于该操作，移动终端100-1可以默认跳转至华为视频提供的教育学习类APP，当用户完成观看学习该教育学习类视频时，才能继续观看非教育学习类的视频。或者，当移动终端100-1 跳转至华为视频APP提供的教育学习类视频后，用户可以退出该页面，通过完成其他解锁任务来观看非教育学习类视频。In other embodiments of the present application, not only allowed APPs can be set in the usage rules, but also only specified functions, specified services, specified services, etc. in the APP can be further set. Taking video apps as an example, video apps can be set to only play educational and learning videos, while other than educational and learning videos, such as games and entertainment videos, are prohibited from playing. When the mobile terminal 100-1 detects that the user breaks the rules of use, such as watching a non-learning APP in Huawei Video, in response to this operation, the mobile terminal 100-1 can jump to the education and learning APP provided by Huawei Video by default. When the user finishes watching You can continue to watch non-educational learning videos only when you are studying the educational learning videos. Alternatively, after the mobile terminal 100-1 jumps to the educational learning video provided by the Huawei Video APP, the user can exit the page and complete other unlocking tasks to watch the non-educational learning video.
如图10E所示，移动终端100-1可以检测到用于设置移动终端100-1的使用规则以及解锁任务的操作。例如，用户将上述默认给出的选项分别设置为一天使用移动终端100-6时长不超过第一时长例如4小时，一次持续使用时长不超过第二时长例如1小时，使用时间段为第三时间段例如早上8:30-12:00和下午14:00-18:00等，限制使用的APP为直播A和阅读A等。例如，用户将上述默认给出的用于解锁的选项分别设置为动时间需达到1小时，学习时间需达到1小时，或者是开启解锁密码等。As shown in FIG. 10E , the mobile terminal 100-1 may detect operations for setting usage rules and unlocking tasks of the mobile terminal 100-1. For example, the user sets the options given above by default to use the mobile terminal 100-6 for a day that does not exceed the first duration, such as 4 hours, and that the duration of continuous use does not exceed the second duration, such as 1 hour, and the usage period is the third time. For example, 8:30-12:00 in the morning and 14:00-18:00 in the afternoon, etc., the restricted APPs are live broadcast A and reading A, etc. For example, the user sets the above-mentioned default options for unlocking to require 1 hour of active time, 1 hour of learning time, or enable the unlock password.
如图10F所示，当移动终端100-1检测当作用于控件1028B的操作后，移动终端100-6检测到用户打破其中任意一项或者多项规则后，移动终端100-6会锁定或者限制部分功能，用户想要解锁移动终端100-6，或者是解除移动终端100-6中被限制的部分功能，则需要完成设定好的解锁任务，具体的，当移动终端100-6检测到上述解锁任务中任意一个或多个满足条件后，才可以解锁移动终端100-6，或者解除移动终端100-6中被限制的功能。As shown in FIG. 10F, when the mobile terminal 100-1 detects that the user is operating on the control 1028B, and the mobile terminal 100-6 detects that the user breaks any one or more rules, the mobile terminal 100-6 will lock or restrict Some functions, if the user wants to unlock the mobile terminal 100-6, or release some of the restricted functions in the mobile terminal 100-6, he needs to complete the set unlocking task. Specifically, when the mobile terminal 100-6 detects the above The mobile terminal 100-6 can be unlocked, or the restricted functions of the mobile terminal 100-6 can only be unlocked after any one or more of the unlocking tasks meet the conditions.
在本申请另一些实施例中，移动终端100-1还可以检测到用户输入用于自定义移动终端100-1的使用规则以及解锁任务的操作。例如，用户可以点击如图10G所示的控件1028A，响应于该操作，移动终端100-6显示图10H所示的自定义页面。In some other embodiments of the present application, the mobile terminal 100-1 may also detect an operation input by the user for customizing the usage rules and unlocking tasks of the mobile terminal 100-1. For example, the user may click the control 1028A as shown in FIG. 10G, and in response to this operation, the mobile terminal 100-6 displays the customized page as shown in FIG. 10H.
图10H示例性示出一种自定义使用规则以及解锁任务的用户界面示意图。FIG. 10H exemplarily shows a schematic diagram of a user interface for customizing usage rules and unlocking tasks.
如图10H所示，用户界面103中显示有已经自定义的一个使用规则1031，和用于添加使用规则的控件1032。以及自定义的两种解锁任务1033和1034，和用于添加解锁任务的控件1035。其中，自定义的使用规则1031具体为：设置使用的APP类型为游戏类APP，设置一天使用游戏类APP的总时长为3小时，设置一次使用APP的总时长为1小时，设置使用游戏类APP的时间段为早上8:30-12:00和下午14:00-18:00等。其中，自定义的解锁任务1具体为：学习1小时，并且跑步1小时；自定义的解锁任务2具体为：小中的指纹，小华的指纹等。As shown in FIG. 10H , a custom usage rule 1031 and a control 1032 for adding a usage rule are displayed in the user interface 103 . As well as two customized unlocking tasks 1033 and 1034, and a control 1035 for adding an unlocking task. Among them, the custom usage rules 1031 are as follows: set the type of APP to be used as a game APP, set the total time of using the game APP to 3 hours a day, set the total time of using the APP to 1 hour, and set the total duration of using the APP to 1 hour. The time period is 8:30-12:00 in the morning and 14:00-18:00 in the afternoon. Among them, the customized unlocking task 1 is specifically: study for 1 hour, and run for 1 hour; the customized unlocking task 2 is specifically: Xiaozhong's fingerprint, Xiaohua's fingerprint, etc.
可以理解的是，图10H仅仅示例性示出一种自定义页面的示意图，在本申请其他实施例中。用户可以自定义的使用规则的相关内容例如还可以有：一天使用某个APP或者某类APP总时长，每次使用某个APP或者某类APP的时长，或者是使用某个或者某类APP中的指定功能的时长，或者禁止使用某个或者某类APP，或者是禁止使用某个或者某类APP中的指定功能等等。此外，在本申请另一些实施例中，上述使用时间段的选项不止设置具体的时间，还可以分日期来设置使用时间段。例如，针对儿童来说，周一到周五需要上学，周六周天为休息日。因此，使用时间段还可以根据日期来个性化设置，例如周一到周五不允许小爱玩电子设备，或者只能在晚上18：00-19:00玩一会，而周六周天，可以在不影响休息的情况下玩电子设备例如可以设置为每周六和周天的早上8:30-12:00以及下午14:00-18:00，本申请实施例对使用时间的设置不作限制。用户可以自定义的解锁任务的相关内容例如可以有：多个指定用户中任意一个或多个用户向移动终端100-6输入用于解锁的指令，例如输入密码，或者是指纹，或者面部等的信息，或者是向移动终端100-6发送验证码的方式；或者还可以设置小爱必须的任务，这些任务可以是运动类的、学习类的、或者是做家务类的，并且完成这些任务的平台可以是在小爱的本机移动终端100-6中完成，也可以是在家庭设备中的其他设备中完成。例如小爱可以在移动终端100-6中完成左学习1小时的任务，或者是小爱可以在跑步机中完成跑步1小时的任务，或者是小爱使用家庭清洁设备例如吸尘器将全屋打扫干净的 任务等等。本申请实施例对于使用规则以及解锁任务的设置不作限制。It can be understood that FIG. 10H only exemplarily shows a schematic diagram of a custom page, in other embodiments of the present application. The relevant content of usage rules that users can customize can also include, for example: the total duration of using a certain APP or a certain type of APP in a day, the duration of each use of a certain APP or a certain type of APP, or the duration of using a certain or a certain type of APP. The duration of the specified function, or prohibit the use of a certain or a certain type of APP, or prohibit the use of a certain or a certain type of specified function in an APP, etc. In addition, in some other embodiments of the present application, the option of the above-mentioned use time period is not limited to setting a specific time, and the use time period can also be set by date. For example, for children, they need to go to school from Monday to Friday, and Saturday and Sunday are rest days. Therefore, the use time period can also be personalized according to the date. For example, Xiaoai is not allowed to play with electronic devices from Monday to Friday, or can only play for a while at 18:00-19:00 in the evening, while on Saturdays and Sundays, you can Playing with electronic devices without affecting rest can be set, for example, to 8:30-12:00 am and 14:00-18:00 pm every Saturday and Sunday. The embodiment of the present application does not limit the setting of use time . The relevant content of the unlocking task that can be customized by the user may include, for example: any one or more users among multiple specified users input instructions for unlocking to the mobile terminal 100-6, such as inputting a password, or a fingerprint, or a face, etc. Information, or the way of sending a verification code to the mobile terminal 100-6; or you can also set the tasks necessary for Xiao Ai, these tasks can be sports, learning, or doing housework, and the completion of these tasks The platform can be completed in Xiaoai's local mobile terminal 100-6, or it can be completed in other devices in the family device. For example, Xiao Ai can complete the task of studying left for one hour on the mobile terminal 100-6, or Xiao Ai can complete the task of running for one hour on the treadmill, or Xiao Ai can use household cleaning equipment such as a vacuum cleaner to clean the whole house tasks and so on. The embodiment of the present application does not limit the setting of usage rules and unlocking tasks.
在本申请实施例中，上文图10F和图10H示例性示出的移动终端100-6的使用规则可以称为第一规则，上文图10F和图10H示例性示出的解锁任务可以称为第一任务。图10C-图10H示出的用于设置第一规则的操作可以称为第四操作，用户可以通过在移动终端100-1即第一设备中输入第四操作来设置移动终端100-6即第四设备的第一规则，然后移动终端100-1可以将该第一规则发送至移动终端100-6。或者，移动终端100-6可以直接接收用户输入的第四操作来设置自己的第一规则。In this embodiment of the present application, the use rule of the mobile terminal 100-6 exemplarily shown in FIG. 10F and FIG. 10H above may be called the first rule, and the unlocking task exemplarily shown in FIG. 10F and FIG. 10H above may be called for the first task. The operation for setting the first rule shown in FIGS. 10C-10H can be called the fourth operation, and the user can set the mobile terminal 100-6, which is the first rule, by inputting the fourth operation in the mobile terminal 100-1, which is the first device. four-device first rule, then the mobile terminal 100-1 may send the first rule to the mobile terminal 100-6. Alternatively, the mobile terminal 100-6 may directly receive a fourth operation input by the user to set its own first rule.
假设移动终端100-1应用上文图10G-图10H示出的自定义的使用规则以及解锁任务，那么接下来介绍移动终端100-6的根据小中在移动终端100-1中设置的使用规则以及解锁任务被使用时的操作界面示意图。Assuming that mobile terminal 100-1 applies the self-defined usage rules and unlocking tasks shown in Fig. 10G-Fig. And a schematic diagram of the operation interface when the unlock task is used.
参考图11A-图11R，图11A-图11R示例性示出，移动终端100-6基于小中在移动终端100-1中设置的使用规则以及解锁任务，被小爱使用时的一系列操作界面示意图。Referring to Fig. 11A-Fig. 11R, Fig. 11A-Fig. 11R exemplarily show a series of operation interfaces when the mobile terminal 100-6 is used by Xiaoai based on the usage rules and unlocking tasks set by Xiaozhong in the mobile terminal 100-1 schematic diagram.
首先，图11A-图11E示例性示出，移动终端100-6检测到小爱违反其中一条使用规则时的一系列用户界面示意图。First, Fig. 11A- Fig. 11E exemplarily show a series of user interface diagrams when the mobile terminal 100-6 detects that Xiaoai violates one of the usage rules.
图11A示例性示出移动终端100-6安装的一系列应用程序的界面示意图。Fig. 11A exemplarily shows a schematic interface diagram of a series of application programs installed on the mobile terminal 100-6.
如图11A所示，用户界面111即桌面，显示有多个应用程序的图标，包括游戏A的应用程序图标1111。As shown in FIG. 11A , the user interface 111 is the desktop, which displays icons of a plurality of application programs, including an application program icon 1111 of game A.
移动终端100-6可以检测到用于打开游戏的操作，例如作用于图11A所示的游戏A的应用程序图标1111的操作，响应于该操作，移动终端100-6会根据上文图10H中设定的使用规则中其中一项规则“使用游戏类APP的时间段为8:30-12:00和14:00-18:00”，拒绝运行游戏A。在一种实现方式中，移动终端100-6还可以显示如图11B所示的提示信息。The mobile terminal 100-6 can detect the operation for opening the game, for example, the operation acting on the application icon 1111 of the game A shown in FIG. One of the set rules of use, "The time period for using game apps is 8:30-12:00 and 14:00-18:00", refuses to run Game A. In an implementation manner, the mobile terminal 100-6 may also display prompt information as shown in FIG. 11B .
如图11B所示，用户界面111显示有窗口1112。窗口1112中显示有用于提示用户玩游戏的规则的信息，例如“现在不是游戏时间，您可以在8:30-12:00和14:00-18:00时间段内玩游戏”的提示信息。窗口1112中还显示有控件1112A和控件1112B，其中控件1112A用于解锁游戏，获取玩游戏的权限；控件1112B用于关闭窗口1112。As shown in FIG. 11B , the user interface 111 displays a window 1112 . Window 1112 displays information for prompting the user to play the rules of the game, for example, the prompt message "Now is not the game time, you can play the game between 8:30-12:00 and 14:00-18:00". The window 1112 also displays a control 1112A and a control 1112B, wherein the control 1112A is used to unlock the game and obtain permission to play the game; the control 1112B is used to close the window 1112 .
在一种可能的情况下，当移动终端100-6显示图11B所示的用户界面时，小爱若想继续玩游戏，则可以通过点击控件1112A的操作，响应于该操作，移动终端100-6会显示如图11C所示解锁任务提示信息。In a possible situation, when the mobile terminal 100-6 displays the user interface shown in FIG. 11B , if Xiao Ai wants to continue playing the game, she can click the control 1112A. In response to this operation, the mobile terminal 100-6 6. The unlocking task prompt information shown in FIG. 11C will be displayed.
如图11C所示，用户界面111显示有窗口1113。窗口1113中显示有用于提示用户选择解锁游戏的方法，以及解锁任务对应的选项例如选项1113A和选项1113B。其中选项1113A和选项1113B具体为：移动终端100-6根据上文图10H示出的小中在移动终端100-1中设置的移动终端100-6的解锁任务，显示例如学习1小时、跑步1小时的任务对应的选项1113A，和显示例如小中指纹、小华指纹对应的选项1113B。As shown in FIG. 11C , the user interface 111 displays a window 1113 . Window 1113 displays a method for prompting the user to select the method of unlocking the game, and options corresponding to the unlocking task, such as option 1113A and option 1113B. Among them, option 1113A and option 1113B are specifically: mobile terminal 100-6 displays, for example, learning for 1 hour, running for 1 The option 1113A corresponding to the task of the hour, and the option 1113B corresponding to displaying, for example, Xiaozhong's fingerprint and Xiaohua's fingerprint.
此时，小爱可以通过点击上述任意一个选项，通过对应的解锁方式来解锁游戏。在此暂不具体赘述解锁任务，下文图11M-图11R会详细介绍。At this time, Xiao Ai can unlock the game by clicking any of the above options and using the corresponding unlocking method. The unlocking task will not be described in detail here, and will be introduced in detail in Figure 11M-Figure 11R below.
在另一种可能的情况下，当移动终端100-6显示图11D(图11B)所示的用户界面时，小爱若不想玩游戏，则可以通过点击控件1112B的操作，响应于该操作，移动终端100-6会如图11E所示的停止显示窗口1112。之后，小爱可以等到8：30以后再打开游戏。In another possible situation, when the mobile terminal 100-6 displays the user interface shown in FIG. 11D (FIG. 11B), if Xiao Ai does not want to play the game, she can click the control 1112B to respond to the operation, The mobile terminal 100-6 stops displaying the window 1112 as shown in FIG. 11E. After that, Xiao Ai can wait until after 8:30 to open the game.
在本申请实施例中，图11B-图11C示例性示出的用于执行解锁任务的提示信息还可以称为第四提示信息。In the embodiment of the present application, the prompt information for performing the unlocking task exemplarily shown in FIG. 11B-FIG. 11C may also be referred to as fourth prompt information.
接下来，图11F-图11L示例性示出，移动终端100-6检测到小爱违反另一条使用规则时的一系列用户界面示意图。Next, FIG. 11F-FIG. 11L exemplarily show a series of user interface diagrams when the mobile terminal 100-6 detects that Xiaoai violates another usage rule.
如图11F所示，移动终端100-6显示的时间为8:30，该时间属于小中设置的玩游戏的时间。所以，此时移动终端100-6可以检测到作用于图标1111的操作，响应于该操作，移动终端100-6会显示图11G所示的游戏A提供的用户界面示意图。As shown in FIG. 11F , the time displayed on the mobile terminal 100-6 is 8:30, which belongs to the game playing time set in the small box. Therefore, at this time, the mobile terminal 100-6 can detect the operation on the icon 1111, and in response to the operation, the mobile terminal 100-6 will display the schematic diagram of the user interface provided by the game A as shown in FIG. 11G.
如图11G所示，用户界面112为游戏A提供的首页。小爱可以点击开始游戏，体验游戏。移动终端100-6可以从检测到作用于开始游戏控件的操作开始记录玩游戏的时间，也可以从检测到用于打开游戏A应用程序的操作开始记录玩游戏的时间，本申请实施例对此不作赘述，以下实施例将以8:30这一时刻开始记录小爱玩游戏的时间为例进行介绍。As shown in FIG. 11G , the user interface 112 is the home page provided by game A. Xiao Ai can click to start the game and experience the game. The mobile terminal 100-6 can record the time of playing the game from the detection of the operation acting on the control to start the game, and can also start recording the time of playing the game from the detection of the operation for opening the game A application. Without going into details, the following embodiments will start to record the time when Xiao Ai plays games at 8:30 as an example.
如图11H所示，用户界面113为游戏A提供游戏界面。当移动终端100-6检测到运行游戏A超过一定则时间会显示提示信息，用于提示用户已经玩了多长时间的游戏，以及剩余的游戏时间为多久。例如，移动终端检测到小爱从8：30开始玩该游戏直到9:10，则移动终端100-6会显示提示信息1131。提示信息1131显示有“检测到您的游戏时间已经达到40分钟，再玩20分钟您的本次游戏时间将满”的提示信息。As shown in FIG. 11H , user interface 113 provides game A with a game interface. When the mobile terminal 100-6 detects that the game A is running for more than a certain period of time, it will display prompt information, which is used to prompt the user how long the game has been played and how long the remaining game time is. For example, if the mobile terminal detects that Xiao Ai plays the game from 8:30 until 9:10, the mobile terminal 100-6 will display a prompt message 1131 . The prompt message 1131 shows the prompt message "It has been detected that your game time has reached 40 minutes, and after playing for another 20 minutes, your current game time will be full".
当移动终端100-6显示如图11H的提示信息之后，小爱可以选择停止游戏，退出游戏，也可以选择继续玩游戏。假设小爱继续游戏，当小爱结束本局游戏后，移动终端100-6会显示如图11I所示的用户界面。After the mobile terminal 100-6 displays the prompt information as shown in Figure 11H, Xiao Ai can choose to stop the game, quit the game, or choose to continue playing the game. Assuming that Xiao Ai continues the game, when Xiao Ai ends the current game, the mobile terminal 100-6 will display the user interface as shown in Figure 11I.
如图11I所示，用户界面114为结束一局游戏后的游戏中场界面，此时时间为9:20，据规定的游戏时间还剩10分钟，若此时移动终端100-6检测到小爱作用于图11I所示的用于开启下一局游戏的控件的操作，移动终端100-6可以显示如图11J所示的提示信息。As shown in Figure 11I, the user interface 114 is the game halftime interface after the end of a game. The time is 9:20 at this time, and there are 10 minutes left in the game time according to regulations. If the mobile terminal 100-6 detects a small For the operation of the controls for starting the next game as shown in FIG. 11I , the mobile terminal 100-6 can display the prompt information as shown in FIG. 11J .
如图11J所示，用户界面114显示有窗口1141，该窗口显示有提示信息“检测到您的游戏时间仅剩10分钟，现在开始新一局游戏，可能会中断游戏”，同时还显示有控件1141A和控件1141B。其中，控件1141A用于继续开启新一局游戏，控件1141B用于退出游戏。假设小爱想要继续新一局的游戏，则移动终端100-6可以检测到作用于1141A的操作，响应于该操作，移动终端100-6会开启新一局的游戏。As shown in FIG. 11J , the user interface 114 displays a window 1141, which displays a prompt message "It has been detected that your game time is only 10 minutes left. Now start a new game, and the game may be interrupted", and also displays a control 1141A and controls 1141B. Among them, the control 1141A is used to continue to open a new game, and the control 1141B is used to exit the game. Assuming that Xiao Ai wants to continue a new round of the game, the mobile terminal 100-6 can detect an operation acting on 1141A, and in response to the operation, the mobile terminal 100-6 will start a new round of the game.
当移动终端100-6检测到小爱在玩新一局游戏的过程中，游戏时间以达到1小时，也就是说移动终端100-6检测到此时时间为9:30时，移动终端100-6会提示用户游戏时间已满，并强制退出游戏；或者，移动终端100-6会提示用户游戏时间已满，但不强制退出游戏，直至结束该局游戏后，移动终端100-6再退出游戏，即停止运行游戏APP。本申请实施例对此不作限制。When the mobile terminal 100-6 detects that Xiao Ai is playing a new game, and the game time reaches 1 hour, that is to say, when the mobile terminal 100-6 detects that the time is 9:30, the mobile terminal 100-6 6 will prompt the user that the game time is full, and forcibly quit the game; or, the mobile terminal 100-6 will prompt the user that the game time is full, but does not forcibly quit the game, and the mobile terminal 100-6 will quit the game after the end of the game , that is, stop running the game APP. The embodiment of the present application does not limit this.
接下来以第一种可能，即移动终端100-6显示游戏时间已满的提示信息，并强制退出游戏，来示出移动终端100-6显示的用户界面示意图。Next, the first possibility is used, that is, the mobile terminal 100-6 displays a prompt message that the game time is over and the game is forcibly exited, to show a schematic diagram of the user interface displayed by the mobile terminal 100-6.
如图11K所示，用户界面115为游戏A提供游戏界面。当移动终端100-6检测到运行游戏A已经达到规定时间，会显示用于提示用户游戏时间已满，即将退出游戏的提示信息。例如，移动终端检测到小爱从8：30开始玩该游戏直到9:30，则移动终端100-6会显示提示信息1151。提示信息1151显示有“检测到您的游戏时间已经达到1小时游戏时间已用完，即将退出游戏”的提示信息。As shown in FIG. 11K , user interface 115 provides game A with a game interface. When the mobile terminal 100-6 detects that the running game A has reached the specified time, it will display a prompt message for prompting the user that the game time is over and the game is about to be exited. For example, if the mobile terminal detects that Xiao Ai plays the game from 8:30 until 9:30, the mobile terminal 100-6 will display a prompt message 1151 . The prompt message 1151 displays the prompt message "It has been detected that your game time has reached 1 hour and the game time has run out, and you are about to exit the game".
之后，移动终端100-6会退出正在玩的游戏，显示游戏A提供的首页，或者是停止运行游戏A显示桌面。本申请实施例对此不作限制。Afterwards, the mobile terminal 100-6 will exit the game being played, display the home page provided by game A, or stop running game A and display the desktop. The embodiment of the present application does not limit this.
如图11L所示，图11L示例性示出移动终端100-6检测到游戏时间已满，退出正在玩的 游戏并显示游戏A提供的首页。此时，首页显示有窗口1121，窗口1121中显示有“本次有游戏时间已满1小时，若您想继续游戏，则需解锁游戏”，此外窗口1121还显示有控件1121A和控件1121B。其中，控件1121A用于解锁游戏，而控件1121B用于退出游戏。As shown in Figure 11L, Figure 11L exemplarily shows that the mobile terminal 100-6 detects that the game time is full, exits the game being played and displays the home page provided by game A. At this time, the home page displays a window 1121, and the window 1121 displays "This game has been played for 1 hour. If you want to continue the game, you need to unlock the game." In addition, the window 1121 also displays a control 1121A and a control 1121B. Among them, the control 1121A is used to unlock the game, and the control 1121B is used to exit the game.
在一种可能的情况下，当移动终端100-6显示图11L所示的用户界面时，小爱若想继续玩游戏，则可以通过点击控件1121A的操作，响应于该操作，移动终端100-6会显示如图11M所示解锁任务提示信息。In a possible situation, when the mobile terminal 100-6 displays the user interface shown in FIG. 11L, if Xiao Ai wants to continue playing the game, she can click the control 1121A. In response to this operation, the mobile terminal 100-6 6. The unlocking task prompt information shown in FIG. 11M will be displayed.
在另一种可能的情况下，当移动终端100-6显示图11L所示的用户界面时，小爱若不想玩游戏，则可以通过点击控件1121B的操作，响应于该操作，移动终端100-6会停止运行游戏APP，显示桌面。并且移动终端会在预设时间例如当天内保持锁定游戏类应用程序的状态，也就是说，用户在当天不能继续玩游戏，只有等到第二天的规定时间才能重新打开游戏。In another possible situation, when the mobile terminal 100-6 displays the user interface shown in FIG. 11L, if Xiao Ai does not want to play the game, she can click the control 1121B. In response to this operation, the mobile terminal 100-6 6 will stop running the game APP and display the desktop. And the mobile terminal will keep the state of locking the game application program in the preset time such as the same day, that is to say, the user cannot continue to play the game on the same day, and has to wait until the specified time of the next day to reopen the game.
在本申请另一些实施例中，当移动终端100-6检测到用户打破规则，例如一次玩游戏超过1个小时，移动终端100-6除了如图11L所示的限制玩游戏并给出退出游戏或者解锁游戏这两个选择外；移动终端100-6还可以限制包括玩游戏、观看视频、阅读小说等等中的任意一项或多项功能，或者移动终端100-6还可以直接锁屏移动终端100-6，也就是说不仅仅限制用户玩游戏，还限制用户使用其他功能(除了紧急通话以外)，若用户想要继续使用移动终端100-6，则必须完成解锁任务，若用户未完成解锁任务，则移动终端100-6会在规定时间后才能自动解锁，该规定时间例如24小时后，或者是第二天凌晨0:00，本申请实施例对此不作限制。In other embodiments of the present application, when the mobile terminal 100-6 detects that the user breaks the rules, for example, playing the game for more than 1 hour at a time, the mobile terminal 100-6 will play the game except for the restrictions shown in FIG. Or unlock the two options of the game; the mobile terminal 100-6 can also restrict any one or more functions including playing games, watching videos, reading novels, etc., or the mobile terminal 100-6 can also directly lock the screen to move Terminal 100-6, that is to say, not only restricts the user to play games, but also restricts the user to use other functions (except emergency calls). If the user wants to continue using the mobile terminal 100-6, he must complete the unlocking task. To unlock the task, the mobile terminal 100-6 will be automatically unlocked after a specified time, such as 24 hours later, or 0:00 am the next day, which is not limited in this embodiment of the present application.
接下来，图11M-图11R示例性示出，小爱使用移动终端100-6完成解锁任务1的一系列用户界面示意图。Next, FIG. 11M-FIG. 11R exemplarily show a series of user interface schematic diagrams for Xiaoai to use the mobile terminal 100-6 to complete the unlocking task 1.
如图11M所示，用户界面112显示有窗口1122。窗口1122中显示有用于提示用户选择解锁游戏的方法，以及解锁任务1对应的选项例如选项1122A和选项1122B。其中选项1122A和选项1122B具体为：移动终端100-6根据上文图10H示出的小中在移动终端100-1中设置的移动终端100-6的解锁任务1，显示例如学习1小时、跑步1小时的任务对应的选项1122A，和显示例如小中指纹、小华指纹对应的选项1122B。As shown in FIG. 11M , user interface 112 displays window 1122 . Window 1122 displays a method for prompting the user to select the method of unlocking the game, and options corresponding to unlocking task 1 such as option 1122A and option 1122B. Among them, option 1122A and option 1122B are specifically: mobile terminal 100-6, according to the unlocking task 1 of mobile terminal 100-6 set in mobile terminal 100-1 shown in FIG. The option 1122A corresponding to the 1-hour task, and the option 1122B corresponding to displaying, for example, Xiaozhong's fingerprint and Xiaohua's fingerprint.
此时，小爱可以通过点击上述任意一个选项，通过对应的解锁方式来解锁游戏。例如，移动终端100-6可以检测到作用于图11M所示的选项1122A的操作，响应于该操作，移动终端100-6会为用户提供学习任务或者运动任务，以检测用户是否完成任务；或者移动终端会检测用户是否在家庭中的其他运动设备或者学习设备中完成上述用于解锁游戏的任务。At this time, Xiao Ai can unlock the game by clicking any of the above options and using the corresponding unlocking method. For example, the mobile terminal 100-6 may detect an operation acting on the option 1122A shown in FIG. 11M , and in response to the operation, the mobile terminal 100-6 will provide the user with a learning task or an exercise task to detect whether the user has completed the task; or The mobile terminal will detect whether the user completes the above task for unlocking the game in other sports equipment or learning equipment in the family.
在本申请实施例中，图11L-图11M示例性示出的用于执行解锁任务的提示信息还可以称为第四提示信息。In the embodiment of the present application, the prompt information for performing the unlocking task exemplarily shown in FIGS. 11L-11M may also be referred to as fourth prompt information.
在一种可以实现的方式中，假设移动终端100-6会为用户提供学习任务，则移动终端检测到作用于图11M所示的选项1122A的操作，响应于该操作，显示如图11N所示的学习APP提供的用户界面。In a possible way, assuming that the mobile terminal 100-6 will provide the user with a learning task, the mobile terminal detects the operation acting on the option 1122A shown in Figure 11M, and in response to the operation, displays the The user interface provided by the learning APP.
图11N示例性示出学习A应用程序提供的用户界面示意图。FIG. 11N exemplarily shows a schematic diagram of a user interface provided by the Learning A application.
如图11N所示，用户界面116显示有学习课程的选项，例如单词专题、语法专题、长难句专题以及作文专题等，其中各个选项对应显示有该课程的学习进度，例如已经学习过的课程则会显示例如已完成的标签，待学习的课程对应显示有例如未开始的标签。As shown in Figure 11N, the user interface 116 displays options for learning courses, such as word topics, grammar topics, long and difficult sentence topics, and composition topics, etc., wherein each option corresponds to displaying the learning progress of the course, such as courses that have been studied A label such as completed will be displayed, and a label such as unstarted will be displayed corresponding to the courses to be learned.
移动终端100-6可以自动打开未开始的课程以供用户学习，或者也可以根据用户的选择 打开对应的课程供用户学习。例如，移动终端100-6可以检测到用户作用于长难句专题选项的操作，响应于该操作，移动终端100-6显示如图11O所示的上文用户界面。The mobile terminal 100-6 can automatically open unstarted courses for the user to study, or can open the corresponding course for the user to study according to the user's selection. For example, the mobile terminal 100-6 may detect the user's operation on the topic option of long and difficult sentences, and in response to the operation, the mobile terminal 100-6 displays the above user interface as shown in FIG. 110 .
图11O示例性示出学习A应用程序提供的长难句专题课程对应的详情页。FIG. 11O exemplarily shows the details page corresponding to the long and difficult sentence special courses provided by the learning A application program.
如图11O所示，用户界面117显示有长难句对应的课程的一部分内容，例如可以包括：例句1、翻译1、解析1等等。在本申请一些实施例中，移动终端100-6可以根据检测到显示对应课程详情页的时候确定用户开始学习。例如，移动终端100-6可以检测到显示图11O所示的用户界面117时，确定用户开始学习，并记录显示图11O的时间，将其作为用户的学习时间。As shown in FIG. 110 , the user interface 117 displays part of the content of the course corresponding to long and difficult sentences, for example, it may include: example sentence 1, translation 1, analysis 1 and so on. In some embodiments of the present application, the mobile terminal 100-6 may determine that the user starts learning according to the detected time when the corresponding course detail page is displayed. For example, the mobile terminal 100-6 may detect that the user interface 117 shown in FIG. 110 is displayed, determine that the user starts learning, and record the time when FIG. 110 is displayed as the user's learning time.
假设用户小爱，从图11O所示的时间为9:31学习到如图11P所示的时间为10:31，则移动终端100-6确定用户的学习时间已满1小时，因此，移动终端100-6可以显示如图11P所示的提示信息。Assuming that the user, Xiaoai, learns from the time shown in Figure 11O as 9:31 to the time shown in Figure 11P as 10:31, then the mobile terminal 100-6 determines that the user's learning time is full for 1 hour, therefore, the mobile terminal 100-6 may display the prompt information as shown in Fig. 11P.
如图11P所示，用户界面117显示有长难句对应的课程的另一部分内容，例如可以包括：例句9、翻译9、解析9等等。用户界面117上还显示有窗口1171，窗口1171中显示有用于提示用户例如“恭喜您，本次学习时间已满1小时，学习任务已完成”的提示信息，以及选项1171A和选项1171B。其中，选项1171A用于关闭当前窗口1171,并继续显示图11P所示的学习A提供的用户界面；选项1171B用于结束学习任务，跳转至运动任务。As shown in FIG. 11P , the user interface 117 displays another part of the course corresponding to long and difficult sentences, for example, it may include: example sentence 9, translation 9, analysis 9 and so on. A window 1171 is also displayed on the user interface 117, and the window 1171 displays a prompt message for prompting the user such as "Congratulations, the learning time is 1 hour, and the learning task has been completed", as well as options 1171A and 1171B. Among them, option 1171A is used to close the current window 1171, and continue to display the user interface provided by learning A shown in FIG. 11P; option 1171B is used to end the learning task and jump to the exercise task.
可以理解的是，在移动终端100-6显示上文图11O至图11P的过程中，即用户学习的过程中，移动终端100-6可以周期性的对当前用户进行身份认证，确保当前用户为小爱本人，而非他人代替小爱学习。It can be understood that, when the mobile terminal 100-6 displays the above Figures 11O to 11P, that is, during the user learning process, the mobile terminal 100-6 can periodically authenticate the current user to ensure that the current user is Xiao Ai herself, not others to study on behalf of Xiao Ai.
在一种可以实现的方式中，假设移动终端100-6会为用户提供运动任务，则移动终端100-6检测到用户作用于图11P所示的用户界面中的1171B的控件，响应于该操作，显示如图11Q所示的AI健身APP提供的用户界面。In a practicable manner, assuming that the mobile terminal 100-6 will provide the user with sports tasks, the mobile terminal 100-6 detects that the user acts on the control of 1171B in the user interface shown in FIG. 11P , and responds to the operation , displaying the user interface provided by the AI fitness APP as shown in FIG. 11Q .
图11Q示例性示出AI健身APP提供的用户界面示意图。FIG. 11Q exemplarily shows a schematic diagram of a user interface provided by an AI fitness APP.
如图11Q所示，用户界面118显示有运动内容，例如用户界面118左侧区域显示有教练的图像，右侧区域显示有用户小爱的图像。具体的，左侧区域中显示的教练欧文可以示范动作，普通模式：小爱可以根据教练的画面指导学习运动，移动终端100-6摄像头实时记录小爱的健身动作，即采集小爱跟着教练做运动的图像，并在用户界面的右侧实时显示小爱的健身情况，小爱可以根据右侧区域反馈的图像纠察自己的动作是否标准。同时，移动终端100-6也可以判断小爱的学习动作是否与教练一样，来判断小爱的动作是否标准，并及时提醒，指导小爱如何规范动作等等，以此使得用户在家也能科学运动。As shown in FIG. 11Q , the user interface 118 displays sports content. For example, the left area of the user interface 118 displays an image of a coach, and the right area displays an image of the user Xiaoai. Specifically, the coach Owen displayed in the left area can demonstrate movements. Normal mode: Xiaoai can guide learning exercises according to the coach's picture, and the 100-6 camera of the mobile terminal records Xiaoai's fitness movements in real time, that is, collects Xiaoai to follow the coach Exercise images, and display Xiao Ai's fitness status in real time on the right side of the user interface. Xiao Ai can check whether her movements are standard according to the images fed back from the right area. At the same time, the mobile terminal 100-6 can also judge whether Xiao Ai's learning action is the same as that of the coach, to judge whether Xiao Ai's action is standard, and remind in time, and guide Xiao Ai how to standardize the action, etc., so that the user can learn scientifically at home. sports.
在本申请另一些实施例中，当移动终端100-6检测到作用于图11P所示的控件1171B的操作，响应于该操作，移动终端100-6可以先显示AI健身APP的首页，用户可以通过选择首页提供的例如推荐、健身专区、肩颈放松、瑜伽专区、广场舞专区等等选项，进入对应的运动课程，跟着教练学习；或者移动终端100-6可以自动屏蔽已学习过的运动，直接跳转至上文图11Q所示的最近一个未学习的课程。本申请实施例对次不作限制。In other embodiments of the present application, when the mobile terminal 100-6 detects an operation acting on the control 1171B shown in FIG. By selecting the options provided on the home page such as recommendation, fitness area, shoulder and neck relaxation, yoga area, square dance area, etc., you can enter the corresponding exercise course and learn from the coach; or the mobile terminal 100-6 can automatically block the learned exercise, Jump directly to the last untaught lesson shown in Figure 11Q above. The embodiment of the present application does not limit the times.
假设用户小爱，从图11Q所示的时间为10:31运动到如图11R所示的时间为11:31，则移动终端100-6确定用户的运动时间已满1小时，因此，移动终端100-6可以显示如图11R所示的提示信息。Assuming that the user, Xiao Ai, moves from the time shown in Figure 11Q at 10:31 to the time shown in Figure 11R at 11:31, then the mobile terminal 100-6 determines that the user's exercise time has been full for 1 hour, therefore, the mobile terminal 100-6 may display the prompt information as shown in FIG. 11R.
如图11R所示，用户界面118显示有小爱跟着教练指导画面做运动的图像，用户界面118上还显示有窗口1181，窗口1181中显示有用于提示用户例如“恭喜您，本次运动时间已满1 小时，学习任务已完成！游戏解锁成功的”的提示信息，以及选项1181A和选项1181B。其中，选项1181A用于关闭当前窗口1181,并继续显示图11R所示的AI健身提供的用户界面118；选项1181B用于结束运动任务，跳转至游戏A提供的用户界面。As shown in Figure 11R, the user interface 118 displays an image of Xiao Ai exercising following the coach's guidance screen, and a window 1181 is also displayed on the user interface 118, and a window 1181 is displayed in the window 1181 to prompt the user such as "Congratulations, the time for this exercise is over." After 1 hour, the learning task has been completed! The game unlocked successfully" prompt message, as well as option 1181A and option 1181B. Among them, option 1181A is used to close the current window 1181, and continue to display the user interface 118 provided by AI fitness shown in FIG. 11R; option 1181B is used to end the exercise task and jump to the user interface provided by game A.
值得注意的是，上文图11N-图11R仅仅示例性示出小爱使用移动终端100-6完成解锁任务1的方法。而在本申请实施例中，小爱除了使用移动终端100-6来完成解锁任务1外，还可以使用其他家庭设备完成解锁任务1。其他家庭设备可以将小爱完成枷锁任务的相关数据发送至移动终端100-6，根据接收到的这些数据判断用户是否完成解锁任务1。具体如下：It should be noted that the above Fig. 11N-Fig. 11R only exemplarily show how Xiaoai uses the mobile terminal 100-6 to complete the unlocking task 1. In this embodiment of the present application, besides using the mobile terminal 100-6 to complete the unlocking task 1, Xiao Ai can also use other home devices to complete the unlocking task 1. Other home devices can send relevant data about Xiao Ai's completion of the shackle task to the mobile terminal 100-6, and judge whether the user has completed the unlocking task 1 according to the received data. details as follows:
接下来，图11S-图11V示例性示出，小爱使用其他家庭设备完成解锁任务1时，移动终端100-6的一系列示意图。Next, Fig. 11S- Fig. 11V exemplarily show a series of schematic diagrams of the mobile terminal 100-6 when Xiao Ai completes the unlocking task 1 with other home devices.
首先，图11S-图11V示例性示出小爱使用笔记本完成学习任务时，移动终端100-6的一系列示意图。First, Fig. 11S- Fig. 11V exemplarily show a series of schematic diagrams of the mobile terminal 100-6 when Xiaoai uses a notebook to complete the learning tasks.
如图11S所示，用户界面112与上文图11M所示的内容一样，关于对图11M的介绍也适用于对图11S的介绍，在此暂不赘述。As shown in FIG. 11S , the content of the user interface 112 is the same as that shown in FIG. 11M above, and the introduction to FIG. 11M is also applicable to the introduction to FIG. 11S , so details will not be repeated here.
此时，小爱可以通过点击图11S所示的任意一个选项，通过对应的解锁方式来解锁游戏。例如，移动终端100-6可以检测到作用于图11S所示的选项1122A的操作，响应于该操作，移动终端100-6会显示如图11T的提示信息。At this point, Xiao Ai can unlock the game by clicking any option shown in Figure 11S through the corresponding unlocking method. For example, the mobile terminal 100-6 may detect an operation on the option 1122A shown in FIG. 11S , and in response to the operation, the mobile terminal 100-6 will display a prompt message as shown in FIG. 11T .
如图11T所示，用户界面112上显示有窗口1123，窗口1123中显示有用于提示用户如何完成解锁任务1的提示信息，以及对应的控件。例如控件1123A和控件1123B，其中控件1123A用于控制笔记本开启，进而为小爱提供学习服务；控件1123B用于开启跑步机，进而为小爱提供运动服务。As shown in FIG. 11T , a window 1123 is displayed on the user interface 112 , and the window 1123 displays prompt information for prompting the user how to complete the unlocking task 1 and corresponding controls. For example, the control 1123A and the control 1123B, wherein the control 1123A is used to control the opening of the notebook, and then provide learning services for Xiaoai; the control 1123B is used to turn on the treadmill, and then provide exercise services for Xiaoai.
可以理解的是，图11T仅仅示例性示出两种解锁任务1的提示信息，在本申请另一些实施例中，当小中的家中家庭设备还有例如智慧屏、手环等设备时，移动终端100-6还可以显示，使用智慧屏、手环运动的提示信息等等，小爱可以打开智慧屏中例如AI健身的应用，跟着教练一起运动；或者小爱可以佩戴手环去运动等等，本申请实施例对此不作显示。It can be understood that Fig. 11T only exemplarily shows two types of prompt information for unlocking task 1. The terminal 100-6 can also display, use the smart screen, the bracelet exercise prompt information, etc., Xiao Ai can open the smart screen such as AI fitness applications, and exercise with the coach; or Xiao Ai can wear the bracelet to exercise, etc. , which is not shown in the embodiment of this application.
在本申请一些实施例中，小爱可以通过点击图11T所示的控件开启对应的家庭设备以完成对应的解锁任务1，或者小爱也可以根据窗口1123给出的提示，直接操作对应该的家庭设备已完成对应的解锁任务1。具体如下：In some embodiments of this application, Xiao Ai can open the corresponding home device by clicking the control shown in Figure 11T to complete the corresponding unlocking task 1, or Xiao Ai can also directly operate the corresponding home device according to the prompt given in window 1123 The home device has completed the corresponding unlocking task 1. details as follows:
参考图11U，图11U示例性示出小爱使用笔记本学习的应用场景示意图。Referring to Fig. 11U, Fig. 11U exemplarily shows a schematic diagram of an application scenario where Xiaoai uses a notebook to study.
笔记本可以将小爱学习的相关数据，例如开始学习时间和结束学习时间，或者是持续学习时间的信息发送至移动终端100-6，以供移动终端100-6判断小爱是否完成解锁任务1。假设小爱从9:31学习到10:31，移动终端100-6接收到用于指示小爱学习时间达到1小时的消息后，移动终端100-6会显示如图11V所述的用户界面。The notebook can send data related to Xiao Ai's learning, such as the start time and end time of learning, or information about the continuous learning time, to the mobile terminal 100-6, so that the mobile terminal 100-6 can judge whether Xiao Ai has completed unlocking task 1. Assuming that Xiao Ai studies from 9:31 to 10:31, after mobile terminal 100-6 receives a message indicating that Xiao Ai's learning time has reached 1 hour, mobile terminal 100-6 will display the user interface as shown in Figure 11V.
如图11V所示，用户界面112中显示的控件1123A中显示的标签由图11T所示的“去学习”变为“已完成”，从而提示用户学习1小时的任务已经完成。As shown in FIG. 11V , the label displayed in the control 1123A displayed on the user interface 112 is changed from “to learn” as shown in FIG. 11T to “Completed”, thus prompting the user that the task of learning for one hour has been completed.
接下来，图11W-图11X示例性示出小爱使用跑步机完成运动任务时，移动终端100-6的一系列示意图。Next, Fig. 11W-Fig. 11X exemplarily show a series of schematic diagrams of mobile terminal 100-6 when Xiaoai uses a treadmill to complete exercise tasks.
在本申请一些实施例中，小爱可以通过点击图11V所示的控件1123B，开启跑步机，已完成跑步任务，或者小爱也可以根据窗口1123给出的提示，直接操作跑步机以完成对应的解 锁任务1。具体如下：In some embodiments of this application, Xiao Ai can start the treadmill by clicking the control 1123B shown in Figure 11V, and has completed the running task, or Xiao Ai can also directly operate the treadmill to complete the corresponding task according to the prompt given in window 1123. Unlock mission 1. details as follows:
参考图11W，图11W示例性示出小爱使用跑步机跑步的应用场景示意图。Referring to Fig. 11W, Fig. 11W exemplarily shows a schematic diagram of an application scenario in which Xiaoai uses a treadmill to run.
跑步机可以将小爱运动的相关数据，例如开始运动时间和结束运动时间，或者是持续运动时间的信息发送至移动终端100-6，以供移动终端100-6判断小爱是否完成解锁任务1。假设小爱从9:31运动到10:31，移动终端100-6接收到用于指示小爱运动时间达到1小时的消息后，移动终端100-6会显示如图11X所述的用户界面。The treadmill can send data related to Xiaoai's exercise, such as the start time and end time of exercise, or the information of the continuous exercise time, to the mobile terminal 100-6, so that the mobile terminal 100-6 can judge whether Xiaoai has completed the unlocking task 1 . Assuming that Xiao Ai moves from 9:31 to 10:31, after mobile terminal 100-6 receives a message indicating that Xiao Ai's exercise time reaches 1 hour, mobile terminal 100-6 will display the user interface as shown in Figure 11X.
如图11X所示，用户界面112中显示的控件1123B中显示的标签由图11V所示的“去运动”变为“已完成”，从而提示用户运动1小时的任务已经完成。此外还显示例如“恭喜您，已完成解锁任务1”的提示信息。As shown in FIG. 11X , the label displayed in the control 1123B displayed in the user interface 112 is changed from “go to exercise” as shown in FIG. 11V to “completed”, thus prompting the user that the task of exercising for one hour has been completed. In addition, a prompt message such as "Congratulations, the unlocking task 1 has been completed" is also displayed.
在本申请实施例中，上文示出的笔记本、跑步机在小爱完成解锁任务后发送至移动终端100-6的信息还可以称为第四信息。上述笔记本、跑步机等设备属于第二设备。In the embodiment of the present application, the information sent by the notebook and the treadmill to the mobile terminal 100-6 after Xiaoai completes the unlocking task shown above can also be called fourth information. The aforementioned devices such as notebooks and treadmills belong to the second device.
在本申请一些实施例中，在小爱执行解锁任务1的过程中，若小爱采用本端电子设备即移动终端100-6执行任务时，移动终端100-6在小爱执行任务的过程中，周期性进行身份认证，以确保执行解锁任务的用户为小爱本人。该身份认证方式包括以下任意一项或多项：密码认证、面部认证、指纹认证、声纹认证、虹膜认证以及操作习惯认证等等，本申请实施例对此不作限制。若小爱协同其他家庭设备200执行解锁任务，则在执行解锁任务的过程中，其他家庭设备也可以周期性的采集用于身份认证的用户数据，在本端进行身份认证并将认证结果发送至移动终端100-6；或者将采集到的数据连同执行任务的相关数据都发送至移动终端100-6，以供其判断执行解锁任务的用户是否为小爱本人。具体的，当小爱使用笔记本执行学习任务时，笔记本可以调用摄像头采集用户的面部信息，或者调用指纹传感器采集用户的指纹信息，或者调用麦克风采集用户的声音等等，根据采集到的信息来验证用户的身份。只有身份认证通过并且解锁任务完成后，移动终端100-6才会解锁，或者解除锁定的功能。In some embodiments of the present application, in the process of Xiaoai performing the unlocking task 1, if Xiaoai uses the local electronic device, that is, the mobile terminal 100-6 to perform the task, the mobile terminal 100-6 will , periodically perform identity authentication to ensure that the user who performs the unlocking task is Xiaoai herself. The identity authentication method includes any one or more of the following: password authentication, face authentication, fingerprint authentication, voiceprint authentication, iris authentication, and operating habit authentication, etc., which are not limited in this embodiment of the present application. If Xiaoai cooperates with other home devices 200 to perform the unlocking task, during the process of performing the unlocking task, other home devices can also periodically collect user data for identity authentication, perform identity authentication locally and send the authentication results to The mobile terminal 100-6; or send the collected data together with the relevant data of performing the task to the mobile terminal 100-6, so that it can judge whether the user performing the unlocking task is Xiaoai himself. Specifically, when Xiao Ai uses a notebook to perform learning tasks, the notebook can call the camera to collect the user's facial information, or call the fingerprint sensor to collect the user's fingerprint information, or call the microphone to collect the user's voice, etc., and verify it based on the collected information. the identity of the user. Only after the identity authentication is passed and the unlocking task is completed, the mobile terminal 100-6 will be unlocked, or the locked function will be released.
可选的，当移动终端100-6检测到用户完成解锁任务1，并且身份认证通过后，移动终端100-6或者其他设备例如笔记本、跑步机还需将用户执行解锁任务的结果发送至父母的移动终端中例如移动终端100-1，经过父母的审核，并且审核通过后才能为小爱解锁移动终端100-6。例如，移动终端100-6可以将小爱学习的结果例如做题的答案或者做题的准确率，以及小爱跟着健身教练学习的成果例如动作标准度、完成率等发送至移动终端100-1，之后小中可以根据小爱的完成任务的质量来决定是否为小爱通过解锁请求。当移动终端100-6接收到移动终端100-1发送的指示审核通过的消息后，移动终端100-6才会解锁屏幕或者解除部分功能的锁定；否则，移动终端100-6保持锁定屏幕或者锁定部分功能。Optionally, when the mobile terminal 100-6 detects that the user has completed the unlocking task 1, and the identity authentication is passed, the mobile terminal 100-6 or other devices such as notebooks and treadmills also need to send the results of the user's execution of the unlocking task to the parent's Among mobile terminals, for example, mobile terminal 100-1, mobile terminal 100-6 can only be unlocked for Xiao Ai after parent's review, and the review is passed. For example, the mobile terminal 100-6 can send the results of Xiaoai's learning, such as the answers to the questions or the accuracy of the questions, and the results of Xiaoai's learning with the fitness coach, such as the standard of movement and completion rate, etc., to the mobile terminal 100-1. , and then Xiaozhong can decide whether to approve the unlock request for Xiaoai according to the quality of Xiaoai's completed tasks. When the mobile terminal 100-6 receives the message indicating that the review is passed by the mobile terminal 100-1, the mobile terminal 100-6 will unlock the screen or unlock some functions; otherwise, the mobile terminal 100-6 will keep the screen locked or locked. Some functions.
在本申请实施例中，移动终端100-6或者其他设备例如笔记本、跑步机向移动终端100-1发送的用户执行解锁任务的结果还可以称为第四信息，移动终端100-6接收到移动终端100-1发送的指示审核通过的消息还可以称为第五消息。In this embodiment of the application, the result of the user's unlocking task sent by the mobile terminal 100-6 or other devices such as notebooks and treadmills to the mobile terminal 100-1 can also be referred to as fourth information, and the mobile terminal 100-6 receives the mobile The message indicating that the approval is passed sent by the terminal 100-1 may also be referred to as a fifth message.
可以理解的是，上文图11M-图11R介绍的在移动终端100-6中完成解锁任务的方法可以和图11S-图11X介绍的在其他家庭设备中完成解锁任务的方法结合起来，也就是说，小爱可以通过在移动终端100-6中完成解锁任务1中的部分任务例如学习任务，然后在家庭设备例如跑步机中完成解锁任务1中的另一部分任务例如学习任务，如此，移动终端100-6页可以确定小爱已经完成解锁任务1进而解锁移动终端100-6。It can be understood that, the method for completing the unlocking task in the mobile terminal 100-6 described above in FIG. 11M-FIG. 11R can be combined with the method for completing the unlocking task in other home devices described in FIG. 11S-FIG. 11X, that is In other words, Xiao Ai can complete some tasks in unlocking task 1 such as learning tasks on the mobile terminal 100-6, and then complete another part of tasks in unlocking task 1 such as learning tasks on a home device such as a treadmill. In this way, the mobile terminal On page 100-6, it can be determined that Xiao Ai has completed the unlocking task 1 and then unlocked the mobile terminal 100-6.
上文仅仅介绍了小爱通过完成解锁任务1来解锁移动终端100-6的UI实施例，在另一种可能实现的方式中，小爱可以选择通过完成解锁任务2来解锁移动终端100-6。具体如下：The above only introduces the UI embodiment in which Xiaoai unlocks the mobile terminal 100-6 by completing the unlocking task 1. In another possible implementation, Xiaoai can choose to unlock the mobile terminal 100-6 by completing the unlocking task 2. . details as follows:
接下来，图11Y-图11Z-5示例性示出，小爱使用移动终端100-6完成解锁任务2的一系列用户界面示意图。Next, FIG. 11Y-FIG. 11Z-5 exemplarily show a series of schematic diagrams of user interfaces for Xiao Ai to use the mobile terminal 100-6 to complete the unlocking task 2.
如图11Y所示，用户界面112与上文图11M所示的内容一样，关于对图11M的介绍也适用于对图11Y的介绍，在此暂不赘述。As shown in FIG. 11Y , the content of the user interface 112 is the same as that shown in FIG. 11M above, and the introduction to FIG. 11M is also applicable to the introduction to FIG. 11Y , so details will not be repeated here.
此时，小爱可以通过点击上述任意一个选项，通过对应的解锁方式来解锁游戏。例如，移动终端100-6可以检测到作用于图11Y所示的选项1122B的操作，响应于该操作，移动终端100-6会开启指纹识别功能，具体如图11Z-1所示。At this time, Xiao Ai can unlock the game by clicking any of the above options and using the corresponding unlocking method. For example, the mobile terminal 100-6 may detect an operation on the option 1122B shown in FIG. 11Y, and in response to the operation, the mobile terminal 100-6 will enable the fingerprint recognition function, as shown in FIG. 11Z-1.
如图11Z-1所示，用户界面112中显示有窗口1124，窗口1124中显示有解锁任务2对应的提示信息，以及指纹采集区域1125。该提示信息为移动终端100-6根据上文图10H示出的小中在移动终端100-1中设置的移动终端100-6的解锁任务2，例如“请输入小中指纹和小华指纹进行解锁”。As shown in FIG. 11Z-1 , a window 1124 is displayed in the user interface 112 , and the prompt information corresponding to the unlocking task 2 and a fingerprint collection area 1125 are displayed in the window 1124 . The prompt information is the unlock task 2 of the mobile terminal 100-6 set by the mobile terminal 100-6 in the mobile terminal 100-1 shown in FIG. unlock".
此时，小爱可以请求爸爸小中以及妈妈小华，向移动终端100-6输入他们的指纹信息，具体如下：At this time, Xiaoai can request her father Xiaozhong and mother Xiaohua to input their fingerprint information into the mobile terminal 100-6, as follows:
如图11Z-2所示，爸爸小中向指纹采集区域1125输入指纹信息，移动终端100-6检测到到爸爸小中的指纹后，显示如图11Z-3所示的用户界面。As shown in Fig. 11Z-2, Daddy Xiaozhong inputs fingerprint information into the fingerprint collection area 1125, and after mobile terminal 100-6 detects Daddy Xiaozhong's fingerprint, it displays the user interface as shown in Fig. 11Z-3.
如图11Z-3所示，用户界面112中显示有窗口1124，窗口1124中显示的提示信息由上文图11Z-1所示的提示信息变为例如“已经成功识别到小中的指纹，请继续输入小华的指纹，进行解锁”的提示信息。As shown in Figure 11Z-3, a window 1124 is displayed on the user interface 112, and the prompt information displayed in the window 1124 is changed from the prompt information shown in Figure 11Z-1 above to, for example, "Xiaozhong's fingerprint has been successfully identified, please Continue to enter Xiaohua's fingerprint to unlock" prompt message.
如图11Z-4所示，妈妈小华向指纹采集区域1125输入指纹信息，移动终端100-6检测到到妈妈小华的指纹后，显示如图11Z-5所示的用户界面。As shown in Figure 11Z-4, mother Xiaohua inputs fingerprint information into the fingerprint collection area 1125, and after mobile terminal 100-6 detects mother Xiaohua's fingerprint, a user interface as shown in Figure 11Z-5 is displayed.
如图11Z-5所示，用户界面112显示有窗口1124，窗口1124中显示的提示信息由上文图11Z-3所示的提示信息变为例如“已识别小中的指纹，和小华的指纹，解锁成功”的提示信息。As shown in Figure 11Z-5, the user interface 112 displays a window 1124, and the prompt information displayed in the window 1124 is changed from the prompt information shown in Figure 11Z-3 above to, for example, "Xiaozhong's fingerprint has been identified, and Xiaohua's Fingerprint, unlocked successfully" prompt message.
可以理解的是，本申请实施例对爸爸小中和妈妈小华向移动终端100-6输入指纹信息的先后顺序不作显示。也就是说，在小爱选择解锁任务2来解锁移动终端100-6时，可以先如上文所述的先找爸爸小中输入指纹信息，然后再找妈妈小华输入指纹信息外，还可以先找妈妈小华输入指纹信息，在找爸爸小中输入指纹信息，本申请实施例对此不作限制。It can be understood that, in this embodiment of the present application, the order in which father Xiaozhong and mother Xiaohua input fingerprint information to the mobile terminal 100-6 is not displayed. That is to say, when Xiaoai chooses to unlock task 2 to unlock the mobile terminal 100-6, as mentioned above, she can first ask her father Xiaozhong to input the fingerprint information, and then ask her mother Xiaohua to input the fingerprint information. Enter the fingerprint information in Find Mom Xiaohua, and enter fingerprint information in Find Dad Xiaohua, which is not limited in the embodiment of this application.
在本申请另一些实施例中，小爱还可以远程向小中请求为其解锁，即移动终端100-1还可以通过接收到小中输入的第五操作，向移动终端100-6发送的授权指令即第五信息，来指示小爱可以继续使用移动终端100-6的部分功能或者全部功能等。In other embodiments of this application, Xiao Ai can also remotely request Xiaozhong to unlock it, that is, the mobile terminal 100-1 can also send the authorization to mobile terminal 100-6 by receiving the fifth operation input by Xiaozhong. The instruction is the fifth information to indicate that Xiao Ai can continue to use some or all functions of the mobile terminal 100-6.
上文图10A-图10H介绍的在移动终端100-1中设置移动终端100-6的使用规则的操作后，移动终端100-1会根据用户输入的操作收集用户数据，即前文数据银行系统中介绍应用程序收集数据，具体表现为智慧家庭应用程序收集移动终端100-6的使用规则的数据。然后移动终端100-1将使用规则跨设备开放给移动终端100-6。After the operation of setting the usage rules of the mobile terminal 100-6 in the mobile terminal 100-1 described above in Fig. 10A-Fig. 10H, the mobile terminal 100-1 will collect user data according to the operation input by the user, that is, the aforementioned data bank system The data collected by the application program is introduced, specifically, the smart home application program collects the data of usage rules of the mobile terminal 100-6. Then the mobile terminal 100-1 opens the usage rules to the mobile terminal 100-6 across devices.
上文图11A-图11K介绍的用户使用移动终端100-6的过程中，移动终端100-6呈现使用规则的提示信息以及打破该使用规则后的提示信息，这便体现出前文数据银行系统中介绍的数据价值呈现，具体表现为智慧家庭应用程序收集用户使用移动终端100-6的使用规则的数据结合制好得使用规则来输出对应的提示信息。During the process of using the mobile terminal 100-6 by the user introduced in Fig. 11A-11K above, the mobile terminal 100-6 presents the prompt information of the usage rule and the prompt information after the usage rule is broken, which reflects the above data bank system. The presentation of the value of the data presented is specifically manifested in the fact that the smart home application program collects the data of the usage rules of the user using the mobile terminal 100-6 and combines the generated usage rules to output corresponding prompt information.
上文图11L-图11Z-5介绍的用户打破使用移动终端的规则后，执行解锁任务并完成解锁 的过程中，涉及到前文数据银行系统中介绍的用户数据的收集、加工、开放、价值呈现等等。具体表现为家庭设备收集用户执行解锁任务的数据，将执行解锁任务的相关数据加工为是否完成解锁任务的指示信息，并将该加工后的数据开放给移动终端，并在移动终端上呈现出用户是否完成解锁任务的提示信息等。In the process described in Figure 11L-Figure 11Z-5 above, after the user breaks the rules of using the mobile terminal, performs the unlocking task and completes the unlocking process, it involves the collection, processing, opening, and value presentation of user data described in the previous data bank system etc. The specific performance is that the home device collects the data of the user performing the unlocking task, processes the relevant data of performing the unlocking task into indication information whether to complete the unlocking task, and releases the processed data to the mobile terminal, and presents the user's information on the mobile terminal. Whether to complete the prompt information of the unlocking task, etc.
关于用户数据的收集、加工、开放、价值呈现等的方法在此暂不赘述，具体可以参考前文对数据银行系统的介绍。The methods of collecting, processing, opening, and value presentation of user data will not be described here. For details, please refer to the introduction to the data banking system above.
在家庭生活中，家庭设备的管理、控制、使用离不开用户操作。因此，为了打理好家庭，用户需要花很多精力去管理、控制、使用家庭设备。特别是在用户离家的时候，家庭设备无人管理，容易造成设备的损坏、水电资源的浪费、家庭卫生环境受到恶劣天气的迫害，以及家庭安全受到他人的威胁等等。In family life, the management, control, and use of home devices are inseparable from user operations. Therefore, in order to take good care of the family, the user needs to spend a lot of energy to manage, control and use the family equipment. Especially when the user is away from home, there is no one to manage the home equipment, which is likely to cause equipment damage, waste of water and electricity resources, family sanitation environment persecuted by bad weather, and family safety threatened by others, etc.
为了减轻用户打理家庭的压力，节省用户时间，本申请提供了一种家庭设备的控制方法，移动终端获取用户的状态信息，以及移动终端中多个应用程序记录的事件的信息，并根据用户的状态和/或应用程序中记录的事件的信息，控制家庭设备执行上述事件对应的操作，进而无需用户操作便能实现智能管理、控制、使用家庭设备，从而打造出健康、安全、舒适、低碳、便捷的个性化家居生活。In order to reduce the pressure on the user to take care of the family and save the user's time, this application provides a control method for home devices. The mobile terminal obtains the user's status information and the information status and/or event information recorded in the application, and control home devices to perform operations corresponding to the above events, and then realize intelligent management, control, and use of home devices without user operations, thereby creating a healthy, safe, comfortable, low-cost Carbon, convenient and personalized home life.
上述用户状态包括：离家、回家、睡眠、居家学习、居家办公、居家运动、下车等等。The above user states include: leaving home, returning home, sleeping, studying at home, working at home, exercising at home, getting off the car, and so on.
上述多个应用程序可以是：事件备忘类的应用程序例如日历、闹钟、便签、备忘录等等；或者是生活服务类应用程序例如，预约或购买就医、用餐、出行、理发服务的应用程序；或者是提供公众号、小程序服务的应用程序，该公众号和小程序可以为用户提供预约或购买就医、用餐、出行、理发服务等等；或者是天气预报类应用程序，该天气预报类应用程序可以为用户提供天气预报的服务；或者是线上会议类应用程序，该线上会议类应用程序可以为用户提供安排会议的服务；或者是网课学习类应用程序，该网课学习类应用程序可以只会用户预定或者购买某项课程，然后进行线上学习。上述应用程序可以是系统应用程序，也可以是第三方应用程序。本申请实施例对此不作限制。The above-mentioned multiple applications may be: applications for event memos, such as calendars, alarm clocks, memos, memos, etc.; or applications for life services, such as applications for making appointments or purchasing medical treatment, dining, travel, and haircut services; Or it is an application that provides public account and mini-program services, which can provide users with appointment or purchase of medical treatment, meals, travel, haircut services, etc.; or a weather forecast application, the weather forecast application The program can provide users with weather forecast services; or it can be an online meeting application, which can provide users with the service of arranging meetings; The program can only allow users to book or purchase a certain course, and then conduct online learning. The above-mentioned application program may be a system application program or a third-party application program. The embodiment of the present application does not limit this.
移动终端获取用户状态的方法包括以下两种方法：The method for the mobile terminal to obtain the user status includes the following two methods:
一、移动终端主动检测用户状态。具体如下：1. The mobile terminal actively detects the user status. details as follows:
方式1：检测到移动终端自动断开与家庭设备之间的通信连接，确定用户状态为离家状态。其中，与家庭设备之间的通信连接包括：与家庭无线路由器之间的Wi-Fi连接，或者是与例如家庭音响、扫地机器人等等之间的蓝牙连接；本申请实施例对通信连接所采用的技术不作限制，对连接对象即家庭设备的类型不作限制。具体可参考后文UI实施例的详细描述，在此暂不赘述。Mode 1: It is detected that the mobile terminal automatically disconnects the communication connection with the home device, and it is determined that the user status is away from home. Among them, the communication connection with home devices includes: a Wi-Fi connection with a home wireless router, or a Bluetooth connection with, for example, a home audio system, a sweeping robot, etc.; There are no restrictions on the technology of the device, and there is no restriction on the type of the connected object, that is, the home device. For details, reference may be made to the detailed description of the UI embodiments later, and details are not repeated here.
值得注意的是，上述自动断开连接是指，非用户输入触发断开连接的操作，而是检测到移动终端与家庭设备之间的通信距离超过范围，自动断开通信连接。然而，由于部分用户有良好的设备使用习惯，为了减少功耗，在离家前会主动断开与家庭设备之间的通信连接，因此，在本申请另一些实施例中，移动终端根据检测到的用户操作，断开与家庭设备之间的通信连接后，也可以确定用户处于离家状态。It is worth noting that the above-mentioned automatic disconnection refers to an operation of not triggering the disconnection by user input, but detecting that the communication distance between the mobile terminal and the home device exceeds the range, and the communication connection is automatically disconnected. However, because some users have good device usage habits, in order to reduce power consumption, they will actively disconnect the communication connection with the home device before leaving home. Therefore, in other embodiments of the application, the mobile terminal detects After disconnecting the communication connection with the home device, it can also be determined that the user is away from home.
方式2：移动终端根据获取到本端应用程序中记录的事件的信息，确定用户状态。具体的，根据闹钟应用程序中记录的睡眠时间、起床时间等判断用户合适处于睡眠状态；或者是根据生活服务类应用程序中记录的用户预约用餐的时间信息、地点信息等等，判断用户和时 处于离家状态等等；或者是根据线上会议类应用程序记录的会议时间来判断用户合适处于居家办公状态等的。具体可参考后文UI实施例的详细描述，在此暂不赘述。Mode 2: The mobile terminal determines the user status according to the acquired event information recorded in the local application program. Specifically, according to the sleep time and wake-up time recorded in the alarm clock application program, it is judged that the user is in a suitable sleep state; The user is away from home, etc.; or it is judged that the user is suitable for working from home based on the meeting time recorded by the online meeting application. For details, reference may be made to the detailed description of the UI embodiments later, and details are not repeated here.
方式3：移动终端根据接收到的其他家庭设备发送的消息，确定用户的状态。例如，移动终端接收到智能门锁发送的用户离家的消息，确定用户处于离家状态；或者移动终端接收到家庭监控设备发送的数据、判断用户处于离家、回家、睡觉、学习、运动等等状态；或者移动终端接收到车载电脑发送的锁定车辆的信息判断用户已经下车。具体可参考后文UI实施例的详细描述，在此暂不赘述。Mode 3: The mobile terminal determines the status of the user according to the received messages sent by other home devices. For example, the mobile terminal receives the message that the user is away from home sent by the smart door lock, and determines that the user is away from home; and so on; or the mobile terminal receives the message of locking the vehicle sent by the on-board computer and judges that the user has got off the vehicle. For details, reference may be made to the detailed description of the UI embodiments later, and details are not repeated here.
可以理解是，上文示例性示出移动终端主动检测用户状态的3种具体实现方式，在本申请实施例中，移动终端可以结合上述3种方式中任意两种或三种实现方式来判断用户状态。It can be understood that the above exemplifies three specific implementation methods for the mobile terminal to actively detect the user status. In the embodiment of the present application, the mobile terminal can combine any two or three of the above three methods to determine the user status. state.
当移动终端需要结合方式1和方式2的检测结果来判断用户状态。那么以离家状态为例，当移动终端根据方式1所述的检测到移动终端与家庭设备断开通信连接后，不能直接确定用户的状态为离家，移动终端还需要检测到应用程序中记录的事件信息中，包含指示用户会离家的事件，并且用户离家的时间，与移动终端断开通信连接的时间差值少于阈值，此时，移动终端才能确定用户的状态为离家状态。When the mobile terminal needs to combine the detection results of mode 1 and mode 2 to determine the user status. Then take the state of leaving home as an example. When the mobile terminal detects that the mobile terminal is disconnected from the home device according to method 1, it cannot directly determine that the user’s state is leaving home. The mobile terminal also needs to detect the status recorded in the application. In the event information, there is an event indicating that the user will leave home, and the time difference between the time when the user leaves home and the time when the communication connection with the mobile terminal is disconnected is less than the threshold value, at this time, the mobile terminal can determine that the user is in the state of leaving home .
当移动终端需要结合方式1和方式3的检测结果来判断用户状态。仍然以离家状态为例，当移动终端根据方式1所述的检测到移动终端与家庭设备断开通信连接后，不能直接确定用户的状态为离家，移动终端还需要检测到其他家庭设备反馈的信息中，包含指示用户离家的信息，并且用户离家的时间，与移动终端断开通信连接的时间差值少于阈值，此时，移动终端才能确定用户的状态为离家状态。When the mobile terminal needs to combine the detection results of mode 1 and mode 3 to determine the user status. Still taking the state of leaving home as an example, when the mobile terminal detects that the mobile terminal is disconnected from the home device according to method 1, it cannot directly determine that the user’s state is away from home, and the mobile terminal needs to detect the feedback from other home devices. The information includes information indicating that the user is away from home, and the time difference between the time when the user leaves home and the time when the communication connection with the mobile terminal is disconnected is less than the threshold value, at this time, the mobile terminal can determine that the user's status is away from home.
当移动终端需要结合方式2和方式3的检测结果来判断用户状态。以睡眠状态为例，当移动终端根据方式2所述的检测到应用程序中记录的事件信息中，包含指示用户睡眠的事件后，不能直接确定用户在对应事件的状态为睡眠，移动终端还需要检测到其他家庭设备反馈的信息中，包含指示用户睡眠的信息后，并且该信息中睡眠时间与应用程序中记录的睡眠时间的差值少于阈值，此时，移动终端才能确定用户的状态为离家状态。When the mobile terminal needs to combine the detection results of mode 2 and mode 3 to determine the user status. Taking the sleep state as an example, when the mobile terminal detects that the event information recorded in the application program contains an event indicating that the user is sleeping according to method 2, it cannot directly determine that the user is in the state of the corresponding event. The mobile terminal also needs to After detecting that the information fed back by other home devices contains information indicating that the user is sleeping, and the difference between the sleeping time in the information and the sleeping time recorded in the application is less than the threshold, the mobile terminal can determine that the user's status is away from home state.
当移动终端需要结合方式1、方式2和方式3的检测结果来判断用户状态。再以离家状态为例，当移动终端根据方式1所述的检测到移动终端与家庭设备断开通信连接后，不能直接确定用户的状态为离家。移动终端还需要检测到应用程序中记录的事件信息中，包含指示用户会离家的事件，并且用户离家的时间，与移动终端断开通信连接的时间差值少于阈值。此外，移动终端还需要检测到其他家庭设备反馈的信息中，包含指示用户离家的信息，并且用户离家的时间，与移动终端断开通信连接的时间差值少于阈值，此时，移动终端才能确定用户的状态为离家状态。When the mobile terminal needs to combine the detection results of mode 1, mode 2 and mode 3 to determine the user status. Taking the away-from-home state as an example again, when the mobile terminal detects that the mobile terminal is disconnected from the home device according to method 1, it cannot directly determine that the user's state is away from home. The mobile terminal also needs to detect that the event information recorded in the application program contains an event indicating that the user will leave home, and the time difference between the time when the user leaves home and the disconnection of the communication connection with the mobile terminal is less than the threshold. In addition, the mobile terminal also needs to detect that the information fed back by other home devices includes information indicating that the user has left home, and the time difference between the time when the user leaves home and the time when the communication connection with the mobile terminal is disconnected is less than the threshold value. The terminal can determine that the user's status is away from home.
二、用户向移动终端输入用户状态。具体如下：2. The user inputs the user status to the mobile terminal. details as follows:
移动终端根据接收到的用户输入的指示用户状态的操作，确定用户的状态。The mobile terminal determines the status of the user according to the operation indicating the status of the user input by the received user.
例如，用户在智慧家庭APP中选择例如离家、回家、学习、运动等情景的操作，移动终端可以根据这些操作判断用户状态，具体可参考后文UI实施例的详细描述，在此暂不赘述。For example, if the user selects operations such as leaving home, returning home, studying, exercising, etc. in the smart home APP, the mobile terminal can judge the user status according to these operations. For details, please refer to the detailed description of the UI embodiment below. repeat.
移动终端获取多个应用程序中的各个事件的信息的方式可以包括以下两种：Ways for the mobile terminal to acquire information about events in multiple application programs may include the following two methods:
1、移动终端接收到用户在多个应用程序中输入信息的操作后，获取该多个应用程序中的事件的信息。该操作可以是用户在日历和备忘录等事件备忘类应用程序中通过输入事件信息 来添加事件的操作，又或者是用户在生活服务类、网课学习类应用程序中预定上文所述的某项服务的操作等。具体可参考后文方法实施例的详细描述，在此暂不赘述。1. The mobile terminal acquires information about events in the multiple application programs after receiving the user's operation of inputting information in the multiple application programs. This operation can be an operation where the user adds event information by inputting event information in event memo application programs such as calendar and memo, or it can be an operation in which the user pre-orders an event as mentioned above in application programs such as life service and online learning. operation of the service, etc. For details, reference may be made to the detailed description of the method embodiments below, and details are not repeated here.
2、移动终端无需接收用户操作，直接获取应用程序中的事件的信息。例如移动终端可以直接获取天气预报类应用程序提供事件的信息，例如某时某地或发生恶劣天气的信息。2. The mobile terminal directly obtains information about events in the application program without receiving user operations. For example, a mobile terminal can directly obtain event information provided by a weather forecast application program, such as information about a certain time and place or occurrence of severe weather.
上述事件包括的类型有：出行、就医、用餐、理发、居家学习、居家办公、居家健身以及出现恶劣天气等等。The types of events mentioned above include: travel, medical treatment, meals, haircuts, home study, home office, home fitness, and severe weather, etc.
上述事件的信息包括：事件的名称、发生时间及地点。The information on the above events includes: the name of the event, time and place of occurrence.
接下来仍然以小中的家庭为例，结合UI实施例来介绍上述家庭设备的控制方法。Next, still taking a small and medium-sized family as an example, the control method of the above-mentioned family device will be introduced in combination with the UI embodiment.
首先，参考图12A-图12V，图12A-图12V示例性示出移动终端主动检测用户状态的一系列用户界面示意图。First, refer to FIG. 12A-FIG. 12V , which exemplarily show a series of user interface schematic diagrams for the mobile terminal to actively detect user status.
图12A-图12B示例性示出移动终端100-1采用方式1判断用户状态时的一组用户界面示意图。12A-12B exemplarily show a group of user interface schematic diagrams when the mobile terminal 100-1 adopts method 1 to judge the user status.
参考图12A，图12A示例性示出移动终端100-1显示的桌面。Referring to FIG. 12A, FIG. 12A exemplarily shows a desktop displayed by the mobile terminal 100-1.
如图12A所示，用户界面121既是移动终端100-1显示的桌面，也是用于显示应用程序菜单的主界面。As shown in FIG. 12A, the user interface 121 is not only a desktop displayed by the mobile terminal 100-1, but also a main interface for displaying application program menus.
用户界面121可包括：状态栏1211，日历指示符和天气指示符，页面指示符，具有常用应用程序图标的托盘，以及其他应用程序图标。其中：The user interface 121 may include: a status bar 1211, a calendar indicator and a weather indicator, a page indicator, a tray with frequently used application icons, and other application icons. in:
状态栏1211可包括：移动通信信号(又可称为蜂窝信号)的一个或多个信号强度指示符1211A、无线高保真(wireless fidelity，Wi-Fi)信号的一个或多个信号强度指示符1211B，电池状态指示符1211C、时间指示符1211D。 Status column 1211 may include: one or more signal strength indicators 1211A for mobile communication signals (also referred to as cellular signals), one or more signal strength indicators 1211B for wireless high-fidelity (Wi-Fi) signals , battery status indicator 1211C, time indicator 1211D.
日历指示符和天气指示符可用于指示当前时间，例如日期、星期几、时分信息等，和可用于指示天气类型，例如多云转晴、小雨等，还可以用于指示气温等信息。The calendar indicator and the weather indicator can be used to indicate the current time, such as date, day of the week, time and division information, etc., and can be used to indicate the type of weather, such as cloudy to sunny, light rain, etc., and can also be used to indicate information such as temperature.
页面指示符可用于指示用户当前浏览的是哪一个页面中的应用程图标。在本申请实施例，应用程序图标可分布在多个页面，用户可以左右滑动，来浏览不同页面中的应用程序图标。The page indicator can be used to indicate the application icon on which page the user is currently viewing. In the embodiment of the present application, application program icons can be distributed on multiple pages, and the user can swipe left and right to browse application program icons on different pages.
具有常用应用程序图标的托盘314可展示：电话图标314A、短信图标314B、浏览器图标314C和相机图标314D。A tray 314 with frequently used application icons may display: a phone icon 314A, a text message icon 314B, a browser icon 314C, and a camera icon 314D.
其他应用程序图标可例如：天气的图标、华为商店的图标、智慧家庭的图标、运动健康的图标、备忘录的图标、日历的图标、生活服务类应用程序的图标，线上会议类应用程序的图标。Other application icons can be, for example: weather icons, Huawei store icons, smart home icons, sports and health icons, memo icons, calendar icons, icons for life service applications, and icons for online meeting applications .
在一些实施例中，图12A所示的用户界面121既是移动终端100-1的桌面也可以为主屏幕界面(home screen)。可以理解的是，图12A仅仅示例性示出了移动终端100-1的一个用户界面，不应构成对本申请实施例的限定。In some embodiments, the user interface 121 shown in FIG. 12A is not only the desktop of the mobile terminal 100-1 but also a home screen. It can be understood that FIG. 12A only exemplarily shows a user interface of the mobile terminal 100-1, and should not be construed as limiting the embodiment of the present application.
值得注意的是，图12A所示的用户界面121中显示的时间指示符1211D的具体时间为8:00，Wi-Fi信号强度指示符1211B代表此时移动终端100-1连接有无线路由器，或者其他设备开启的热点。假设此时移动终端100-1与家庭中的路由器建立Wi-Fi连接，那么移动终端100-1可以判定小中此时的状态处于在家的状态。It is worth noting that the specific time of the time indicator 1211D displayed in the user interface 121 shown in FIG. 12A is 8:00, and the Wi-Fi signal strength indicator 1211B represents that the mobile terminal 100-1 is connected to a wireless router at this time, or Hotspots turned on by other devices. Assuming that the mobile terminal 100-1 establishes a Wi-Fi connection with the router at home at this time, then the mobile terminal 100-1 can determine that Xiaozhong is at home at this time.
在本申请一些实施例中，当移动终端100-1与家庭路由器的通信距离超过阈值，则移动终端100-1会与家庭无线路由器断开Wi-Fi连接，此时移动终端100-1可以判定机主小中的状态已经切换为离家。In some embodiments of the present application, when the communication distance between the mobile terminal 100-1 and the home router exceeds the threshold, the mobile terminal 100-1 will disconnect the Wi-Fi connection with the home wireless router. At this time, the mobile terminal 100-1 can determine that The status in the owner's chat has been switched to leaving home.
在本申请另一些实施例中，当移动终端100-1检测到与家庭无线路由器断开Wi-Fi连接，移动终端100-1不会直接判定用户处于离家状态，移动终端100-1可能会显示如图12B所示的提示信息。In other embodiments of the present application, when the mobile terminal 100-1 detects that the Wi-Fi connection with the home wireless router is disconnected, the mobile terminal 100-1 will not directly determine that the user is away from home, and the mobile terminal 100-1 may The prompt information shown in FIG. 12B is displayed.
参考图12B，图12B示例性示出移动终端100-1检测到与家庭无线路由器断开连接时时的用户界面示意图。Referring to FIG. 12B , FIG. 12B exemplarily shows a schematic diagram of a user interface when the mobile terminal 100-1 detects that it is disconnected from the home wireless router.
如图12B所示，用户界面121中显示的状态栏1211中的时间指示符1211D具体显示的时间为8:30，并且不再包含上文图12A示出的Wi-Fi信号强度指示符1211B，取而代之的是例如5G、4G、3G、2G的上网图标。此外用户界面121中还显示有提示窗口1212。该提示窗口1212显示有例如“WiFi连接已断开，请问您是否已经离家”的提示信息，以及控件1212A和控件1212B。其中控件1212A用于确定小中已经离家，控件1212B用于否定用户已经离家。As shown in FIG. 12B, the time indicator 1211D in the status bar 1211 displayed in the user interface 121 specifically displays the time of 8:30, and does not include the Wi-Fi signal strength indicator 1211B shown in FIG. 12A above, Instead, icons for Internet access such as 5G, 4G, 3G, 2G. In addition, a prompt window 1212 is also displayed in the user interface 121 . The prompt window 1212 displays a prompt message such as "WiFi connection has been disconnected, may I ask if you have left home", as well as a control 1212A and a control 1212B. The control 1212A is used to determine that the user has left home, and the control 1212B is used to deny that the user has left home.
此时，若小中确定已经离家，则可以通过点击图12B中的控件1212A，移动终端100-1检测到该操作，响应于该操作，确定小中此时的状态为离家状态。At this time, if Xiaozhong determines that he has left home, he can click on the control 1212A in FIG. 12B, and the mobile terminal 100-1 detects this operation.
可以理解的是，当移动终端100-1没有检测到作用于控件1212B的操作，并且在预设时间内也没有检测到作用于控件1212A的操作，则移动终端100-1可以默认用户已经离家。It can be understood that, when the mobile terminal 100-1 does not detect an operation on the control 1212B and does not detect an operation on the control 1212A within a preset time, the mobile terminal 100-1 may default that the user has left home .
可以理解的是，图12B仅仅示例性示出提示信息的一种形式，上述窗口1212可以在图12B所示的桌面中显示以外，还可以在其他用户界面例如智慧家庭APP提供的界面中显示，本申请实施例对此不作限制。It can be understood that FIG. 12B only exemplarily shows a form of prompt information, and the above-mentioned window 1212 may not only be displayed on the desktop shown in FIG. 12B , but may also be displayed on other user interfaces such as interfaces provided by smart home APPs. The embodiment of the present application does not limit this.
可以理解的是，上述提示信息除了以窗口1212的形式显示外，还可以显示在下拉通通知栏中，或者在负一屏中显示，本申请实施例对此不作限制。It can be understood that, in addition to being displayed in the form of window 1212, the above prompt information can also be displayed in a pull-down notification bar, or displayed in a negative screen, which is not limited in this embodiment of the present application.
可以理解的是，上文图12A-图12B仅仅示例性示出移动终端100-1与家庭无线路由器断开连接来判断用户处于离家状态，除了上述方式以外，移动终端100-1还可以通过检测是否与其家庭设备、例如家庭智能音响等断开蓝牙连接的方式，来判断用户是否处于离家状态。具体如下：It can be understood that the above Figures 12A-12B merely show that the mobile terminal 100-1 is disconnected from the home wireless router to determine that the user is away from home. In addition to the above methods, the mobile terminal 100-1 can also Detect whether the user is disconnected from the Bluetooth connection with the home device, such as home smart audio, etc., to determine whether the user is away from home. details as follows:
图12C-图12D示例性示出移动终端100-1采用方式1判断用户状态时的另一组用户界面示意图。FIG. 12C-FIG. 12D exemplarily show another group of user interface diagrams when the mobile terminal 100-1 adopts method 1 to judge the user status.
如图12C所示，用户界面121既是移动终端100-1显示的桌面，也是用于显示应用程序菜单的主界面。图12C示出的用户界面121与上文图12A所示的用户界面121类似，因此，关于对图12A的描述也适用于对图12C的描述，但是，图12C与上文图12A还存在以下区别：状态栏1211包括移动通信信号(又可称为蜂窝信号)的一个或多个信号强度指示符1211A、，蓝牙指示符1211E，电池状态指示符1211C、时间指示符1211D。As shown in FIG. 12C , the user interface 121 is not only a desktop displayed by the mobile terminal 100-1, but also a main interface for displaying application program menus. The user interface 121 shown in Figure 12C is similar to the user interface 121 shown in Figure 12A above, therefore, the description about Figure 12A is also applicable to the description of Figure 12C, however, Figure 12C and Figure 12A above also have the following Difference: the status bar 1211 includes one or more signal strength indicators 1211A, 1211E, battery status indicator 1211C, and time indicator 1211D of mobile communication signals (also called cellular signals).
值得注意的是，图12C所示的用户界面121中显示的时间指示符1211D的具体时间为8:00，蓝牙指示符1211F代表此时移动终端100-1开启蓝牙功能或者与其他设备建立蓝牙连接。假设此时移动终端100-1与家庭设备例如家庭智能音响建立蓝牙连接，那么移动终端100-1可以判定小中此时的状态处于在家的状态。It should be noted that the specific time of the time indicator 1211D displayed in the user interface 121 shown in FIG. 12C is 8:00, and the Bluetooth indicator 1211F represents that the mobile terminal 100-1 starts the Bluetooth function or establishes a Bluetooth connection with other devices at this time. . Assuming that the mobile terminal 100-1 establishes a Bluetooth connection with a home device such as a home smart speaker at this time, the mobile terminal 100-1 can determine that Xiaozhong is at home at this time.
在本申请一些实施例中，当移动终端100-1与家庭智能音响之间的通信距离超过阈值，则移动终端100-1会与家庭智能音响断开蓝牙连接，此时移动终端100-1可以直接判定机主小中的状态已经切换为离家。In some embodiments of the present application, when the communication distance between the mobile terminal 100-1 and the home smart speaker exceeds the threshold, the mobile terminal 100-1 will disconnect the Bluetooth connection with the home smart speaker, and at this time the mobile terminal 100-1 can It is directly determined that the status of the owner of the phone has been switched to leaving home.
在本申请另一些实施例中，当移动终端100-1检测到与家庭智能音响建立蓝牙断开蓝牙连接，移动终端100-1不会直接判定用户处于离家状态，移动终端100-1可能会显示如图12D 所示的提示信息。In other embodiments of the present application, when the mobile terminal 100-1 detects that the Bluetooth connection with the home smart speaker is established and the Bluetooth connection is disconnected, the mobile terminal 100-1 will not directly determine that the user is away from home, and the mobile terminal 100-1 may The prompt information shown in Figure 12D is displayed.
参考图12D，图12D示例性示出移动终端100-1检测到与家庭智能音响断开蓝牙连接时的用户界面示意图。Referring to FIG. 12D , FIG. 12D exemplarily shows a schematic diagram of a user interface when the mobile terminal 100-1 detects that the Bluetooth connection with the home smart audio is disconnected.
如图12D所示，用户界面121中显示的状态栏1211中的时间指示符1211D具体显示的时间为8:30，并且不再包含上文图12C示出的蓝牙指示符1211F。此外用户界面121中还显示有提示窗口1213。该提示窗口1213显示有例如“与智能音响的蓝牙连接已断开，请问您是否已经离家”的提示信息，以及控件1213A和控件1213B。其中控件1213A用于确定小中已经离家，控件1213B用于否定用户已经离家。As shown in FIG. 12D , the time indicator 1211D in the status bar 1211 displayed on the user interface 121 specifically displays a time of 8:30, and does not include the Bluetooth indicator 1211F shown in FIG. 12C above. In addition, a prompt window 1213 is also displayed in the user interface 121 . The prompt window 1213 displays a prompt message such as "The Bluetooth connection with the smart audio has been disconnected, may I ask if you have left home", as well as a control 1213A and a control 1213B. The control 1213A is used to determine that the user has left home, and the control 1213B is used to deny that the user has left home.
此时，若小中确定已经离家，则可以通过点击图12D中的控件1213A，移动终端100-1检测到该操作，响应于该操作，确定小中此时的状态为离家状态。At this time, if Xiaozhong determines that he has left home, he can click the control 1213A in FIG. 12D , and the mobile terminal 100-1 detects this operation.
可以理解的是，当移动终端100-1没有检测到作用于控件1213B的操作，并且在预设时间内也没有检测到作用于控件1213A的操作，则移动终端100-1可以默认用户已经离家。It can be understood that, when the mobile terminal 100-1 does not detect an operation on the control 1213B and does not detect an operation on the control 1213A within a preset time, the mobile terminal 100-1 may assume that the user has left home .
可以理解的是，图12D仅仅示例性示出提示信息的一种形式，上述窗口1213可以在图12D所示的桌面中显示以外，还可以在其他用户界面例如智慧家庭APP提供的界面中显示，本申请实施例对此不作限制。It can be understood that FIG. 12D only exemplarily shows a form of prompt information, and the above-mentioned window 1213 may not only be displayed on the desktop shown in FIG. 12D , but may also be displayed on other user interfaces such as interfaces provided by smart home APPs. The embodiment of the present application does not limit this.
可以理解的是，上述提示信息除了以窗口1213的形式显示外，还可以显示在下拉通通知栏中，或者在负一屏中显示，本申请实施例对此不作限制。It can be understood that, in addition to being displayed in the form of window 1213, the above prompt information may also be displayed in a pull-down notification bar, or displayed in a negative screen, which is not limited in this embodiment of the present application.
图12E-图12I示例性示出移动终端100-1采用方式2判断用户状态时的一组用户界面示意图。12E-12I exemplarily show a group of schematic diagrams of user interfaces when the mobile terminal 100-1 adopts method 2 to determine the user status.
图12E-图12H示例性示出用户在生活服务类应用程序中预定出行服务的操作界面示意图。12E-12H exemplarily show the schematic diagrams of the operation interface for the user to book the travel service in the life service application program.
如图12E所示，当移动终端100-1在如图12E所示的用户界面121中检测到用户作用于生活服务类应用程序图标的操作，响应于该操作，移动终端100-1显示图12F所示的生活服务类应用程序提供的用户界面122。其中，图12E所示的用户界面121与上文图12A所示的用户界面121相同，图12A中的用户界面121的文字说明也适用于图12E所示的用户界面121。As shown in FIG. 12E, when the mobile terminal 100-1 detects the user’s operation on the icon of a life service application in the user interface 121 shown in FIG. The user interface 122 provided by the life service application program is shown. Wherein, the user interface 121 shown in FIG. 12E is the same as the user interface 121 shown in FIG. 12A above, and the text description of the user interface 121 in FIG. 12A is also applicable to the user interface 121 shown in FIG. 12E .
图12F示例性示出了移动终端100-1中生活服务类应用程序提供的用户界面示意图。Fig. 12F exemplarily shows a schematic diagram of a user interface provided by a life service application program in the mobile terminal 100-1.
如图12F所示，用户界面122可以包括搜索栏1221，选项卡1222，页面导航1223，页面导航栏1223可以包括例如首页、订单、我的等子页面对应的控件。As shown in FIG. 12F , the user interface 122 may include a search bar 1221 , a tab 1222 , and a page navigation bar 1223 , and the page navigation bar 1223 may include controls corresponding to subpages such as home page, order, and my.
其中，选项卡1222具体包括的选项有：酒店、机票、旅游、打车、美食、电影、医疗、美容和旅游等等。用户可以通过点击上述选项，预定或者购买对应的服务。例如，移动终端100-1在用户界面122中可以检测到用户点击打车选项的操作，响应于该操作，移动终端100-1可以显示如图12G所示打车服务对应的详情页。Wherein, the option tab 1222 specifically includes the options: hotel, air ticket, travel, taxi, food, movie, medical treatment, beauty treatment, travel and so on. Users can book or purchase corresponding services by clicking on the above options. For example, the mobile terminal 100-1 may detect the user's operation of clicking on the taxi-hailing option in the user interface 122, and in response to the operation, the mobile terminal 100-1 may display a detailed page corresponding to the taxi-hailing service as shown in FIG. 12G .
如图12G所示，用户界面123显示：包含用户当前所处位置的地图1231，选项1232，输入框1233，常用地址选项1234，和控件1235。As shown in FIG. 12G , the user interface 123 displays: a map 1231 including the user's current location, an option 1232 , an input box 1233 , a common address option 1234 , and a control 1235 .
其中，选项1232为用户打车时常用的出发地点，用户可以通过点击该选项重新编辑出发地点。其中，输入框1233，用于输入目的地。其中，常用地址选项1234例如为小爱的学校。其中控件1235用于添加更多的常用地址对应的选项。Among them, the option 1232 is the starting point commonly used by the user when taking a taxi, and the user can click on this option to re-edit the starting point. Among them, the input box 1233 is used for inputting a destination. Among them, the common address option 1234 is, for example, Xiaoai's school. The control 1235 is used to add more options corresponding to common addresses.
当小中想要打车从家出发到小爱的学校，那么小中可以通过点击图12G所示的小爱的学校对应的常用地址对应的选项，响应于该操作，移动终端100-1显示如图12H所示的用户界面。When Xiao Zhong wants to take a taxi from home to Xiao Ai's school, Xiao Zhong can click on the option corresponding to the usual address corresponding to Xiao Ai's school as shown in Figure 12G. In response to this operation, the mobile terminal 100-1 displays the following The user interface shown in Figure 12H.
如图12H所示，用户界面123显示：包含出发地到目的地的路线的地图1236，预估价格 1237，用于立即叫车的控件1238。As shown in Figure 12H, the user interface 123 displays: a map 1236 containing a route from the departure point to the destination, an estimated price 1237, and a control 1238 for calling a car immediately.
当移动终端100-1检测到作用于图12H所示的控件1238的操作，响应于该操作，该生活服务类应用程序会记录该打车事件。并将该事件发送至智慧家庭APP，智慧家庭APP根据该事件获取到用户离家的时间，即确定用户何时处于离家状态。When the mobile terminal 100-1 detects an operation on the control 1238 shown in FIG. 12H , in response to the operation, the life service application program will record the taxi-hailing event. And the event is sent to the smart home APP, and the smart home APP obtains the time when the user leaves home according to the event, that is, determines when the user is in the state of leaving home.
在本申请另一些实施例中，移动终端100-1检测到用户输入上文图12E-图12H所示的用于打车的操作后，移动终端100-1不会直接判定用户的状态为离家状态。移动终端100-1可能会先显示如图12I所示的提示信息。In other embodiments of the present application, after the mobile terminal 100-1 detects that the user enters the operation for hailing a taxi as shown in Figure 12E-Figure 12H above, the mobile terminal 100-1 will not directly determine that the user's status is leaving home state. The mobile terminal 100-1 may first display the prompt information as shown in FIG. 12I.
参考图12I，图12I示例性示出移动终端100-1根据用户购买出行服务的事件显示的提示信息的用户界面示意图。Referring to FIG. 12I , FIG. 12I exemplarily shows a user interface diagram of the prompt information displayed by the mobile terminal 100-1 according to the event that the user purchases the travel service.
如图12I所示，用户界面123中显示提示窗口1239。该提示窗口1239显示有例如“检测到您打车从家前往小爱的学校请问你是否要离家”的提示信息，以及控件1239A和控件1239B。其中控件1239A用于确定小中已经离家，控件1239B用于否定用户已经离家。As shown in FIG. 12I , a prompt window 1239 is displayed on the user interface 123 . The prompt window 1239 displays a prompt message such as "It is detected that you take a taxi from home to Xiao Ai's school, may I ask if you want to leave home", as well as controls 1239A and 1239B. The control 1239A is used to determine that the user has left home, and the control 1239B is used to deny that the user has left home.
此时，若小中确定要离家，则可以通过点击图12I中的控件1239A，移动终端100-1检测到该操作，响应于该操作，确定小中此时的状态为离家状态。At this time, if Xiao Zhong decides to leave home, the mobile terminal 100-1 can detect this operation by clicking on the control 1239A in FIG.
可以理解的是，当移动终端100-1没有检测到作用于控件1239B的操作，并且在预设时间内也没有检测到作用于控件1239A的操作，则移动终端100-1可以默认用户已经离家。It can be understood that, when the mobile terminal 100-1 does not detect an operation on the control 1239B and does not detect an operation on the control 1239A within a preset time, the mobile terminal 100-1 may assume that the user has left home .
可以理解的是，图12I仅仅示例性示出提示信息的一种形式，上述窗口1239可以在图12I所示的桌面中显示以外，还可以在其他用户界面例如智慧家庭APP提供的界面中显示，本申请实施例对此不作限制。It can be understood that FIG. 12I only exemplarily shows a form of prompt information, and the above-mentioned window 1239 can be displayed not only on the desktop shown in FIG. 12I, but also on other user interfaces such as interfaces provided by smart home APPs. The embodiment of the present application does not limit this.
在本申请另一些实施例中，当移动终端100-1中记录有用户将在8:30-9:00携带小爱的书包去小爱的学校的事件信息时，并且移动终端100-1检测到用户在8:30-9:00离家，则移动终端100-1还会输出用于提示用户携带小爱的书包的提示信息。In other embodiments of the present application, when the mobile terminal 100-1 records the event information that the user will carry Xiaoai's schoolbag to Xiaoai's school at 8:30-9:00, and the mobile terminal 100-1 detects When the user leaves home between 8:30-9:00, the mobile terminal 100-1 will also output prompt information for prompting the user to carry Xiaoai's schoolbag.
上述8:30-9:00还可以称为第四时间段，上述小爱的书包还可以称为第一物品，上述用于携带书包的提示信息也可以称为第六提示信息，上述移动终端100-1中中记录有用户将在8:30-9:00携带小爱的书包去小爱的学习的事件的信息还可以称为第六信息。The above-mentioned 8:30-9:00 can also be called the fourth time period, the above-mentioned Xiaoai’s schoolbag can also be called the first item, the above-mentioned prompt information for carrying the schoolbag can also be called the sixth prompt information, and the above-mentioned mobile terminal The information in 100-1 that records the event that the user will carry Xiao Ai's schoolbag to Xiao Ai's study at 8:30-9:00 can also be called sixth information.
在本申请另一些实施例中，当移动终端100-1中记录将在13:20-14:00出现降雨以及台风等极端天气的事件信息时，并且移动终端100-1检测到用户在13:20-14:00离家，则移动终端100-1还会输出用于提示用户携带防护用品例如雨伞、雨衣的提示信息。In other embodiments of the present application, when the mobile terminal 100-1 records the event information of extreme weather such as rain and typhoon at 13:20-14:00, and the mobile terminal 100-1 detects that the user is at 13:00 When leaving home at 20-14:00, the mobile terminal 100-1 will also output prompt information for prompting the user to bring protective equipment such as umbrellas and raincoats.
上述13:20-14:00还可以称为第五时间段，上述用于携带防护用品例如雨伞、雨衣的提示信息也可以称为第七提示信息。The above-mentioned 13:20-14:00 can also be called the fifth time period, and the above-mentioned reminder information for carrying protective articles such as umbrellas and raincoats can also be called the seventh reminder information.
图12J-图12N示例性示出移动终端100-1采用方式2判断用户状态时的另一组用户界面示意图。12J-12N exemplarily show another group of user interface diagrams when the mobile terminal 100-1 adopts method 2 to judge the user status.
图12J-图12N示例性示出用户在备忘类应用程序中添加待办事件的操作界面示意图。12J-12N exemplarily show schematic diagrams of an operation interface for a user to add a to-do event in a note-type application program.
如图12J所示，当移动终端100-1在如图12J所示的用户界面121中检测到用户作用于备忘录类应用程序例如日历的图标的操作，响应于该操作，移动终端100-1显示图12K所示的日历提供的用户界面124。其中，图12J所示的用户界面121与上文图12A所示的用户界面121相同，图12A中的用户界面121的文字说明也适用于图12J所示的用户界面121。As shown in FIG. 12J, when the mobile terminal 100-1 detects in the user interface 121 shown in FIG. The user interface 124 provided by the calendar is shown in FIG. 12K. Wherein, the user interface 121 shown in FIG. 12J is the same as the user interface 121 shown in FIG. 12A above, and the text description of the user interface 121 in FIG. 12A is also applicable to the user interface 121 shown in FIG. 12J .
图12K示例性示出了移动终端100-1中日历提供的用户界面示意图。FIG. 12K exemplarily shows a schematic diagram of a user interface provided by a calendar in the mobile terminal 100-1.
如图12K所示，用户界面124显示有日历1241，窗口1242，窗口1242中显示有新建日 程图标1243，和移动终端100-1推荐的订阅项例如黄历等。当移动终端100-1在用户界面124中检测到用户选中日历1241中的某一天例如9月26日，并作用于新建日程图标1243的操作，响应于该操作，移动终端100-1显示图12L所示的用户界面125。As shown in Figure 12K, the user interface 124 displays a calendar 1241, a window 1242, and a new schedule icon 1243 is displayed in the window 1242, and subscription items recommended by the mobile terminal 100-1, such as almanac, etc. When the mobile terminal 100-1 detects in the user interface 124 that the user selects a certain day in the calendar 1241, for example, September 26, and acts on the operation of creating a new schedule icon 1243, in response to this operation, the mobile terminal 100-1 displays the date shown in FIG. 12L The user interface 125 is shown.
图12L示例性示出了移动终端100-1显示的用户界面125。FIG. 12L exemplarily shows the user interface 125 displayed by the mobile terminal 100-1.
如图12L所示，用户界面125即用于新建日程的待编辑页面，该用户界面125可以包括取消图标1251，确定图标1252，页面标题例如新建日程，标题输入框，地点输入框，时间输入框等等。其中，取消图标1251可用于关闭该待编辑页面，确定图标1252可以用于确定已编辑好的待办事件。标题输入框可用于接收用户输入待办事件的标题，地点输入框可用于接收用户输入的该待办事件的发生地点，时间输入框可用于接收用户输入该待办事件发生的起止时间。As shown in Figure 12L, the user interface 125 is a page to be edited for creating a new schedule, and the user interface 125 may include a cancel icon 1251, a confirm icon 1252, a page title such as a new schedule, a title input box, a location input box, and a time input box etc. Wherein, the cancel icon 1251 can be used to close the page to be edited, and the confirm icon 1252 can be used to confirm the edited to-do event. The title input box can be used to receive the title of the to-do event input by the user, the location input box can be used to receive the occurrence location of the to-do event input by the user, and the time input box can be used to receive the start and end time of the to-do event input by the user.
如图12M所示，移动终端100-1可以在用户界面125中检测到用户编辑待办事件，例如，用户可以输入该待办事件的名称为线上会议，会议地点为小中的家，会议时间为9月26日14:30-15:30，编辑完成后，移动终端100-1还可以检测到用户作用于确定图标1252的操作，响应于该操作，移动终端100-1的日历中接收到用户已编辑的待办事件，即用户在日历中添加的事件。As shown in FIG. 12M, the mobile terminal 100-1 can detect that the user edits the to-do event in the user interface 125. For example, the user can input the name of the to-do event as an online meeting, the meeting place is Xiaozhong's home, and the meeting The time is 14:30-15:30 on September 26. After the editing is completed, the mobile terminal 100-1 can also detect the user's operation on the confirmation icon 1252. In response to this operation, the calendar of the mobile terminal 100-1 receives To the to-do events edited by the user, that is, events added by the user in the calendar.
在本申请实施例中，响应于当移动终端100-1检测到作用于图12M所示的控件1252的操作，移动终端不仅会在预定时间提醒用户完成会议事件，还会将该会议事件发送至智慧家庭APP，智慧家庭APP根据该会议事件获取到用户居家办公的时间，即确定用户何时处于居家办公状态。In this embodiment of the application, when the mobile terminal 100-1 detects an operation on the control 1252 shown in FIG. The smart home APP, the smart home APP obtains the time when the user works from home according to the meeting event, that is, determines when the user is working from home.
在本申请另一些实施例中，移动终端100-1检测到用户输入上文图12J-图12M所示的一系列操作后，移动终端100-1不会直接判定用户的状态为居家状态。移动终端100-1可能会先显示如图12N所示的提示信息。In other embodiments of the present application, after the mobile terminal 100-1 detects that the user has input a series of operations shown in FIG. 12J-FIG. 12M above, the mobile terminal 100-1 will not directly determine that the user's status is the home status. The mobile terminal 100-1 may first display the prompt information as shown in FIG. 12N.
参考图12N，图12N示例性示出移动终端100-1根据待办的会议事件，显示的提示信息的用户界面示意图。Referring to FIG. 12N , FIG. 12N exemplarily shows a user interface diagram of the prompt information displayed by the mobile terminal 100 - 1 according to the pending conference events.
如图12N所示，用户界面121中显示提示窗口1214。该提示窗口1214显示有例如“检测到14：30您有一个线上会议，请问是否开启居家办公模式”的提示信息，以及控件1214A和控件1214B。其中控件1214A用于确定小中将在14：30处于居家办公状态，控件1214B用于否定小中将在14：30处于居家办公状态。As shown in FIG. 12N , a prompt window 1214 is displayed on the user interface 121 . The prompt window 1214 displays a prompt message such as "It is detected that you have an online meeting at 14:30, please enable the home office mode", as well as a control 1214A and a control 1214B. Among them, the control 1214A is used to determine that Xiaozhong will be in the state of working from home at 14:30, and the control 1214B is used to deny that Xiaozhong will be in the state of working from home at 14:30.
值得注意的是，移动终端100-1显示图12N所示的提示信息的时间可以为检测到添加待办事件后立刻显示，也可以是在待办事件的开始事件之前任意时刻显示，例如会议开始时间为14：30，而移动终端100-1可以在会议开始时间的前十分钟即14：20时显示上述提示信息，本申请实施例对此不作限制。It is worth noting that the time for the mobile terminal 100-1 to display the prompt information shown in FIG. 12N can be displayed immediately after the addition of the to-do event is detected, or it can be displayed at any time before the start event of the to-do event, for example, the meeting starts The time is 14:30, and the mobile terminal 100-1 may display the above prompt information at 14:20 ten minutes before the start time of the meeting, which is not limited in this embodiment of the present application.
此时，若小中确定将要居家线上开会，则可以通过点击图12N中的控件1214A，移动终端100-1检测到该操作，响应于该操作，确定小中的在14：30时的状态为居家办公的状态。At this time, if Xiao Zhong decides to hold an online meeting at home, the mobile terminal 100-1 can detect this operation by clicking on the control 1214A in Figure 12N, and in response to this operation, determine Xiao Zhong's status at 14:30 The status of working from home.
可以理解的是，当移动终端100-1没有检测到作用于控件1214B的操作，并且在预设时间内也没有检测到作用于控件1214A的操作，则移动终端100-1可以默认小中的在14：30时的状态为居家办公的状态。It can be understood that when the mobile terminal 100-1 does not detect any operation on the control 1214B, and does not detect any operation on the control 1214A within a preset time, the mobile terminal 100-1 may default to the The status at 14:30 is the status of working from home.
可以理解的是，图12N仅仅示例性示出提示信息的一种形式，上述窗口1214可以在图12N所示的桌面中显示以外，还可以在其他用户界面例如智慧家庭APP提供的界面中显示，本申请实施例对此不作限制。It can be understood that FIG. 12N only exemplarily shows a form of prompt information, and the above-mentioned window 1214 can be displayed not only on the desktop shown in FIG. 12N , but also on other user interfaces such as interfaces provided by smart home APPs. The embodiment of the present application does not limit this.
图12O-图12P示例性示出移动终端100-1检测到用户通过远程开启车辆的操作确定用户离家状态的一系列示意图。FIG. 12O-FIG. 12P exemplarily show a series of schematic diagrams in which the mobile terminal 100-1 detects that the user determines the state of the user leaving home through the operation of remotely starting the vehicle.
图12O示例性示出，小中通过移动终端100-1远程控制车辆点火的场景示意图。Fig. 12O exemplarily shows a schematic diagram of a scene where Xiaozhong remotely controls the ignition of a vehicle through the mobile terminal 100-1.
如图12O所示，小中可以使用移动终端100-1中的例如远程控制车辆的APP或者是智慧家庭APP，远程启动车辆。这里暂不详细介绍远程启动车辆的用户界面示意图。As shown in FIG. 12O , Xiaozhong can use the mobile terminal 100 - 1 to remotely start the vehicle, such as an APP for remote control of the vehicle or a smart home APP. The schematic diagram of the user interface for remotely starting the vehicle is not described in detail here.
在一种可能实现的方式中，当移动终端100-1检测到用户输入用于开启车辆的操作，移动终端100-1可以直接确定用户的状态为离家。In a possible implementation manner, when the mobile terminal 100-1 detects that the user inputs an operation to start the vehicle, the mobile terminal 100-1 may directly determine that the user's status is leaving home.
在另一种可能实现的方式中，当移动终端100-1检测到用户输入用于开启车辆的操作，移动终端100-1不会直接确定用户的状态为离家，而是先显示如图12P所示的提示信息。In another possible implementation, when the mobile terminal 100-1 detects that the user inputs an operation to start the vehicle, the mobile terminal 100-1 will not directly determine that the user's status is leaving home, but will first display the displayed prompt information.
图12P示例性示出移动终端100-1检测到用户输入远程开启车辆的操作时，显示的离家提示信息的用户界面示意图。FIG. 12P exemplarily shows a schematic diagram of a user interface of the prompt information for leaving home displayed when the mobile terminal 100-1 detects that the user inputs an operation of remotely starting the vehicle.
如图12P所示，用户界面121显示有提示窗口1215。该提示窗口1215显示有例如“检测到您远程开启车辆，请问您是否将要离家”的提示信息，以及控件1215A和控件1215B。其中控件1215A用于确定小中已经离家，控件1215B用于否定小中已经离家。As shown in FIG. 12P , the user interface 121 displays a prompt window 1215 . The prompt window 1215 displays a prompt message such as "It is detected that you remotely start the vehicle, may I ask if you are leaving home", as well as a control 1215A and a control 1215B. Among them, the control 1215A is used to determine that Xiaozhong has left home, and the control 1215B is used to deny that Xiaozhong has left home.
此时，若小中确定已经离家，则可以通过点击图12D中的控件1215B，移动终端100-1检测到该操作，响应于该操作，确定小中此时的状态为离家状态。At this time, if Xiaozhong determines that he has left home, he can click the control 1215B in FIG. 12D , and the mobile terminal 100-1 detects this operation, and in response to this operation, determines that Xiaozhong is in the state of leaving home at this time.
可以理解的是，当移动终端100-1没有检测到作用于控件1215A的操作，并且在预设时间内也没有检测到作用于控件1215B的操作，则移动终端100-1可以默认用户已经离家。It can be understood that, when the mobile terminal 100-1 does not detect an operation on the control 1215A, and does not detect an operation on the control 1215B within a preset time, the mobile terminal 100-1 may assume that the user has left home .
可以理解的是，当移动终端100-1没有检测到作用于控件1215B的操作，并且在预设时间内也没有检测到作用于控件1215A的操作，则移动终端100-1可以默认用户已经离家。It can be understood that when the mobile terminal 100-1 does not detect any operation on the control 1215B, and does not detect any operation on the control 1215A within a preset time, then the mobile terminal 100-1 may assume that the user has left home .
可以理解的是，图12P仅仅示例性示出提示信息的一种形式，上述窗口1215可以在图12P所示的桌面中显示以外，还可以在其他用户界面，例如应用程序提供的界面中显示，本申请实施例对此不作限制。It can be understood that FIG. 12P only exemplarily shows a form of prompt information, and the above-mentioned window 1215 can be displayed not only on the desktop shown in FIG. 12P but also on other user interfaces, such as interfaces provided by application programs. The embodiment of the present application does not limit this.
可以理解的是，上述提示信息除了以窗口1215的形式显示外，还可以显示在下拉通通知栏中，或者在负一屏中显示，本申请实施例对此不作限制。It can be understood that, in addition to being displayed in the form of window 1215, the above prompt information may also be displayed in a pull-down notification bar, or displayed in a negative screen, which is not limited in this embodiment of the present application.
图12Q-图12R示例性示出移动终端100-1根据用户乘车操作确定用户离家状态的一系列示意图。FIG. 12Q-FIG. 12R exemplarily show a series of schematic diagrams in which the mobile terminal 100-1 determines the state of the user leaving home according to the user's car riding operation.
如图12Q所示，图12Q示例性示出移动终端100-1显示的用于乘坐地铁公交等乘车条码示意图。当移动终端100-1显示的乘车条码被扫描成功后，移动终端100-1会显示如图12R所示的用户界面示意图。As shown in FIG. 12Q , FIG. 12Q exemplarily shows a schematic diagram of a barcode displayed on the mobile terminal 100 - 1 for taking a subway, bus, or other vehicle. When the barcode displayed by the mobile terminal 100-1 is successfully scanned, the mobile terminal 100-1 will display a schematic diagram of the user interface as shown in FIG. 12R.
如图12R所示，移动终端100-1显示有乘车成功的提示信息。As shown in FIG. 12R , the mobile terminal 100-1 displays a prompt message that the ride is successful.
可以理解的时，用户通过移动终端乘坐公交或者地铁等的方式不止上文所示的扫描乘车APP提供的条码，还可以通过NFC刷卡的方式乘车，本申请实施例对此不做限制。It can be understood that the way for the user to take the bus or subway through the mobile terminal is not limited to scanning the barcode provided by the ride-hailing app shown above, but also by swiping the NFC card, which is not limited in this embodiment of the present application.
在本申请实施例中，当移终端100-1检测到用户乘车行为时，可以直接判断用户的状态处于离家状态。In the embodiment of the present application, when the mobile terminal 100-1 detects the user's riding behavior, it can directly determine that the user's state is away from home.
在本申请另一些实施例中，移动终端100-1采用方式2获取的应用程序中记录的事件的信息不仅包括上文图12E-图12R示例性示出的用户在应用程序中购买某项服务或者添加待办事件所对应的事件的信息，还可以获取应用程序自己生成的信息，例如天气预报类应用程序自己生成的天气事件相关的事件信息。因此，本申请实施例对移动终端获取应用程序的事件 的信息不作限制。In some other embodiments of the present application, the information of the events recorded in the application program obtained by the mobile terminal 100-1 using method 2 not only includes the user's purchase of a certain service in the application program as exemplarily shown in Figure 12E-Figure 12R above Alternatively, the event information corresponding to the to-do event can be added, and the information generated by the application itself can also be obtained, for example, the event information related to the weather event generated by the weather forecast application itself. Therefore, the embodiment of the present application does not limit the acquisition of event information of the application program by the mobile terminal.
图12S-图12V示例性示出移动终端100-1采用方式3判断用户状态时的另一组用户界面示意图。12S-12V exemplarily show another group of user interface schematic diagrams when the mobile terminal 100-1 adopts mode 3 to determine the user status.
当家庭设备例如智能门锁监测到用户出门行为后，智能门锁可以向移动终端发送该用户出门事件的信息。移动终端接收到该信息后，会显示如图12S所示的用户界面示意图。When a home device such as a smart door lock detects a user's going out behavior, the smart door lock can send information about the user's going out event to the mobile terminal. After receiving the information, the mobile terminal will display a schematic diagram of a user interface as shown in FIG. 12S.
图12S示例性示出移动终端100-1接收到其他用家庭设备发送的信息的用户界面示意图。FIG. 12S exemplarily shows a schematic diagram of a user interface in which the mobile terminal 100-1 receives information sent by other home devices.
如图12S所示，用户界面121显示显示提示信息1216。该提示信息1216显示有例如“智慧家庭收到一条消息”的提示信息。可以理解的是，上述提示信息1251可以显示在图2O所示的用户界面121即桌面中也可以显示在移动终端100-1的其他用户界面中，本申请实施例对此不做限制。As shown in FIG. 12S , the user interface 121 displays prompt information 1216 . The prompt information 1216 displays prompt information such as "the smart home has received a message". It can be understood that the above prompt information 1251 may be displayed on the user interface 121 shown in FIG. 20 , that is, the desktop, or may be displayed on other user interfaces of the mobile terminal 100-1, which is not limited in this embodiment of the present application.
在本申请实施例中，用户可以通过点击图12S所示的提示信息1216跳转到智慧家庭APP提供的消息详情页。In this embodiment of the application, the user can jump to the message details page provided by the smart home APP by clicking the prompt information 1216 shown in FIG. 12S .
可以理解的是，移动终端100-1在接收到其他家家庭设备发送的消息后，不仅会显示如图12S所示的提示信息，还会在智慧家庭APP中显示接受到的消息。具体如下：It can be understood that, after receiving the message sent by other home devices, the mobile terminal 100-1 will not only display the prompt information as shown in FIG. 12S, but also display the received message in the smart home APP. details as follows:
参考图12T，图12T示例性示出智慧家庭APP接收到新消息是的用户界面示意图。Referring to FIG. 12T , FIG. 12T exemplarily shows a schematic diagram of the user interface of the smart home APP when a new message is received.
如图12T所示，用户界面81与上文图10B所示的用户界面81相同，上文关于图10B中的用户界面81的文字说明也适用于图12T所示的用户界面81，在此暂不赘述。As shown in FIG. 12T, the user interface 81 is the same as the user interface 81 shown in FIG. 10B above, and the above text description about the user interface 81 in FIG. 10B is also applicable to the user interface 81 shown in FIG. 12T. I won't go into details.
图12T所示的用户界面81与上文图10B示出的用户界面的不同之处在于，图12T所示的用户界面中显示的图标819上显示有未读消息的条数图标。例如“1”条。用户可以通过点击图标819，打开接收到的消息详情页，阅读智慧家庭APP收到的消息。The difference between the user interface 81 shown in FIG. 12T and the user interface shown in FIG. 10B above is that the icon 819 displayed in the user interface shown in FIG. 12T has an icon of the number of unread messages displayed. For example "1" bar. The user can click on the icon 819 to open the received message details page and read the received messages of the smart home APP.
当移动终端100-1检测到作用于图12S中的提示信息1216的操作，或者检测到作用于图12T所示的图标819的操作，响应于该操作，移动终端100-1会希纳是如图12U所示的用户界面示意图。When the mobile terminal 100-1 detects an operation acting on the prompt message 1216 in FIG. 12S, or detects an operation acting on the icon 819 shown in FIG. 12T, in response to the operation, the mobile terminal 100-1 will respond as follows A schematic diagram of the user interface shown in Fig. 12U.
如图12U所示，用户界面126显示有智能门锁发送的消息，例如“智能门锁监测到您于16：00离家”。As shown in FIG. 12U , the user interface 126 displays a message sent by the smart door lock, for example, "The smart door lock detected that you left home at 16:00".
在本申请另一些实施例中，移动终端100-1接收到图12U所示的提示信息后，移动终端100-1可能会直接判定小中的状态处于离家状态，或者移动终端100-1不会直接判定小中的状态为离家状态。移动终端100-1可能会先显示如图12V所示的提示信息。In other embodiments of the present application, after mobile terminal 100-1 receives the prompt information shown in FIG. It will directly determine Xiaozhong's status as away from home. The mobile terminal 100-1 may first display the prompt information as shown in FIG. 12V.
在本申请实施例中，智能门锁向移动终端100-1发送的信息还可以称为第七信息。In this embodiment of the present application, the information sent by the smart door lock to the mobile terminal 100-1 may also be referred to as seventh information.
参考图12V，图12V示例性示出移动终端100-1根据其他家庭设备发送的信息，显示的提示信息的用户界面示意图。Referring to FIG. 12V , FIG. 12V exemplarily shows a user interface diagram of the prompt information displayed by the mobile terminal 100 - 1 according to the information sent by other home devices.
如图12V所示，用户界面121中显示提示窗口1217。该提示窗口1217显示有例如“智能门锁监测到您刚刚出门，请问你是否已经离家”的提示信息，以及控件1217A和控件1217B。其中控件1217A用于确定小中于16：00处于离家状态，控件1217B用于否定小中将于16：00处于离家状态。As shown in FIG. 12V , a prompt window 1217 is displayed on the user interface 121 . The prompt window 1217 displays prompt information such as "the smart door lock detects that you have just gone out, may I ask if you have left home", as well as a control 1217A and a control 1217B. Among them, the control 1217A is used to determine that the small middle school is in the state of leaving home at 16:00, and the control 1217B is used to deny that the small middle school will be in the state of leaving home at 16:00.
此时，若小中确定离家，则可以通过点击图12V中的控件1217A，移动终端100-1检测到该操作，响应于该操作，确定小中的在16：00时的状态为离家状态。At this time, if Xiaozhong decides to leave home, the mobile terminal 100-1 can detect this operation by clicking on the control 1217A in FIG. state.
可以理解的是，当移动终端100-1没有检测到作用于控件1217B的操作，并且在预设时 间内也没有检测到作用于控件1217A的操作，则移动终端100-1可以默认小中的在16：00时的状态为离家状态。It can be understood that when the mobile terminal 100-1 does not detect any operation on the control 1217B, and does not detect any operation on the control 1217A within the preset time, the mobile terminal 100-1 may default to the At 16:00, the status is away from home.
可以理解的是，图12V仅仅示例性示出提示信息的一种形式，上述窗口1217除了可以在图12V所示的桌面中显示以外，还可以在其他用户界面例如智慧家庭APP提供的界面中显示，本申请实施例对此不作限制。It can be understood that FIG. 12V only exemplarily shows a form of prompt information, and the above-mentioned window 1217 can be displayed not only on the desktop shown in FIG. 12V, but also on other user interfaces such as interfaces provided by smart home APPs. , which is not limited in this embodiment of the present application.
在本申请另一些实施例中，当移动终端检测到自己与家庭设备之间的距离超过第三值例如20米时，也可以确认用户的状态为离家状态。In other embodiments of the present application, when the mobile terminal detects that the distance between itself and the home device exceeds a third value such as 20 meters, it may also confirm that the user's status is away from home.
在本申请实施例中，当智能门锁检测到用户开门时，可以检测用户是否带上手机，若用户没有带手机，智能门锁可以拒绝关门或者语音播报提示用户带好手机的提示信息。具体如下：In this embodiment of the application, when the smart door lock detects that the user opens the door, it can detect whether the user has a mobile phone. If the user does not have a mobile phone, the smart door lock can refuse to close the door or broadcast a voice prompt to remind the user to bring the mobile phone. details as follows:
当智能门锁中的传感器例如摄像头或者近光传感器或者红外设备等检测到小中走进大门准备开门时，智能门锁可以通过与移动终端100-1建立的通信连接例如蓝牙连接或者WiFi连接等，采用蓝牙测距或者WiFi测距等检测小中的移动终端100-1距离智能门锁的距离，在智能门锁检测到小中关门之前，若智能门锁与移动终端100-1之间的距离小于第二值例如1米时，智能门锁输出用于提示用户携带移动终端100-1的第五提示信息，或，触发移动终端100-1和/或其他家庭设备输出用于提示用户携带移动终端100-1的第五提示信息。在智能门锁检测到第九操作打开门锁时，智能门锁检测到其与该移动终端100-1之间的距离逐渐变大时，则智能门锁可以确定小中没有带上移动终端100-1，则智能门锁可以执行以下任意一项或多项操作：拒绝关锁门，或者输出用于提示用户携带移动终端100-1的第五提示信息，或，触发移动终端100-1和或其他家庭设备输出用于提示用户携带移动终端100-1的第五提示信息。When a sensor in the smart door lock, such as a camera or a low-beam sensor or an infrared device, detects that Xiao Zhong enters the door and is about to open the door, the smart door lock can establish a communication connection with the mobile terminal 100-1, such as a Bluetooth connection or a WiFi connection. , using Bluetooth ranging or WiFi ranging to detect the distance between the small and medium mobile terminal 100-1 and the smart door lock. When the distance is less than the second value, for example, 1 meter, the smart door lock outputs fifth prompt information for prompting the user to carry the mobile terminal 100-1, or triggers the mobile terminal 100-1 and/or other household devices to output the fifth prompt information for prompting the user to carry the mobile terminal 100-1. Fifth prompt information of the mobile terminal 100-1. When the smart door lock detects that the ninth operation opens the door lock, and when the smart door lock detects that the distance between it and the mobile terminal 100-1 is gradually increasing, the smart door lock can determine that Xiaozhong does not carry the mobile terminal 100 -1, the smart door lock can perform any one or more of the following operations: refuse to lock the door, or output the fifth prompt message for prompting the user to carry the mobile terminal 100-1, or trigger the mobile terminal 100-1 and Or other home devices output fifth prompt information for prompting the user to carry the mobile terminal 100-1.
在本申请另一些实施例中，还可以通过家庭设备例如摄像头检测用户是否携带移动终端100-1。In some other embodiments of the present application, whether the user carries the mobile terminal 100-1 may also be detected through a home device such as a camera.
在一种可能实现的方式中，智能门锁确定小中出门没有佩戴手机时，可以不关门，进而达到提示小中没有佩戴移动终端100-1的目的。In a possible implementation, the smart door lock may not close the door when it is determined that Xiaozhong is not wearing a mobile phone when going out, so as to achieve the purpose of reminding Xiaozhong that he is not wearing the mobile terminal 100-1.
在另一种可能实现的方式中，智能门锁确定小中出门没有佩戴手机时，可以输出提示音，提示小中携带移动终端100-1。In another possible implementation manner, when the smart door lock determines that Xiaozhong is not wearing a mobile phone when going out, it may output a prompt sound to remind Xiaozhong to carry the mobile terminal 100-1.
在本申请另一些实施例中，在智能门锁检测到小中走近并且与智能门锁的距离小于第二值例如1米时，智能门锁可以提前输出第五提示信息，提示用户携带手机、证件、车钥匙等等，或者触发移动终端100-1和或其他家庭设备输出用于提示用户携带移动终端100-1的第五提示信息。In other embodiments of the present application, when the smart door lock detects that Xiaozhong is approaching and the distance from the smart door lock is less than a second value, for example, 1 meter, the smart door lock can output a fifth prompt message in advance, prompting the user to carry a mobile phone , a certificate, a car key, etc., or trigger the mobile terminal 100-1 and/or other household devices to output fifth prompt information for prompting the user to carry the mobile terminal 100-1.
与离家类似，当车辆接收到用户输入的第十操作，车辆的车门打开，此时车门可以检测到与移动终端100-1的距离，在车门检测到其与该移动终端100-1之间的距离逐渐变大时，则车辆可以确定小中没有带上移动终端100-1，则车辆可以执行以下任意一项或多项操作：拒绝锁车门，或者输出用于提示用户携带移动终端100-1的第八提示信息，或，触发移动终端100-1和或其他家庭设备输出用于提示用户携带移动终端100-1的第八提示信息。Similar to leaving home, when the vehicle receives the tenth operation input by the user, the door of the vehicle is opened. At this time, the door can detect the distance from the mobile terminal 100-1, and the distance between the door and the mobile terminal 100-1 is detected. When the distance gradually increases, the vehicle can determine that Xiaozhong does not carry the mobile terminal 100-1, and the vehicle can perform any one or more of the following operations: refuse to lock the door, or output a message for prompting the user to carry the mobile terminal 100-1 1, or trigger the mobile terminal 100-1 and or other home devices to output the eighth prompt information for prompting the user to carry the mobile terminal 100-1.
当车辆确定移动终端100-1和车门之间的距离小于第四值时，可以预先输出第八提示信息，提示用户带好随身物品例如移动终端100-1以及老人儿童等等。When the vehicle determines that the distance between the mobile terminal 100-1 and the vehicle door is less than the fourth value, the eighth prompt message can be output in advance, reminding the user to bring their personal belongings such as the mobile terminal 100-1 and the elderly and children.
图12W-图12Z示例性示出用户主动向移动终端输入用户状态时移动终端100-1显示的一系列用户界面示意图。12W-12Z exemplarily show a series of user interface diagrams displayed by the mobile terminal 100-1 when the user actively inputs the user status to the mobile terminal.
如图12W所示，移动终端100-1显示的用户界面61与前文图6K、图8F、图8J示出的 用户界面61类似，前文中对图6K的描述也适用于对图12W的描述，在此暂不赘述。As shown in Figure 12W, the user interface 61 displayed by the mobile terminal 100-1 is similar to the user interface 61 shown in Figure 6K, Figure 8F, and Figure 8J above, and the description of Figure 6K above is also applicable to the description of Figure 12W, I won't go into details here.
移动终端100-1检测到用户点击控件615C的操作，响应于该操作，移动终端100-1显示如图12X所示的用户界面126。The mobile terminal 100-1 detects the user's operation of clicking the control 615C, and in response to the operation, the mobile terminal 100-1 displays the user interface 126 as shown in FIG. 12X.
如图12X所示，用户界面126为智能情景页面，具体包含有：控件1261A、控件1261B。其中控件1261A和控件1261B为智能情景页面的子页面导航控件，用户可以通过作用于控件1261A和控件1261B的操作，分别切换智能情景页面中的“推荐”子页面和“我的”子页面。As shown in FIG. 12X , the user interface 126 is a smart scene page, specifically including: a control 1261A and a control 1261B. The control 1261A and the control 1261B are subpage navigation controls of the smart scene page, and the user can switch between the "recommended" subpage and the "my" subpage in the smart scene page by operating on the control 1261A and the control 1261B.
可以理解的是，此时用户界面126默认显示控件1261A的对应的“推荐”子页面。该子页面显示有一键执行模块包含的一个或多个智能情景对应的选项。例如选项1262、选项1263以及选项1264等。上述选项分别为智慧家庭APP默认提供的安心离家、温馨回家、清洁净化等智能情景对应的选项，用户可以通过点击上述选项中的任意一个使得移动终端100-1一键执行该智能情景，具体执行联动控制家庭设备的操作。It can be understood that at this time, the user interface 126 defaults to display the corresponding "recommended" subpage of the control 1261A. This subpage displays the options corresponding to one or more intelligent scenarios included in the one-click execution module. For example, option 1262, option 1263, option 1264, etc. The above options are options corresponding to smart scenarios such as leaving home safely, returning home warmly, and cleaning and purification provided by default by the smart home APP. The user can click any one of the above options to make the mobile terminal 100-1 execute the smart scenario with one click. Specifically execute the linkage control operation of the home device.
在一种可能实现的方式中，移动终端100-1检测到用户作用于上文图12X所示的选项1262的操作，响应于该操作，移动终端100-1可以判定用户的状态为离家状态。此外，移动终端100-1还会应用安心离家的智能情景模式，即联动控制家庭设备执行对应的操作，例如移动终端100-1可以控制家庭设备中的电视、空调、烟灶、厨房电器、空气净化器、新风机、加湿除湿器、扫地机、门锁、窗帘电动、电灯等等关机。In a possible implementation manner, the mobile terminal 100-1 detects the user's operation on the option 1262 shown in Figure 12X above, and in response to the operation, the mobile terminal 100-1 can determine that the user's state is away from home . In addition, the mobile terminal 100-1 will also apply the smart scene mode of leaving home with peace of mind, that is, to control the home devices to perform corresponding operations. For example, the mobile terminal 100-1 can control the TV, air conditioner, smoke stove, kitchen appliances, Air purifiers, fresh air fans, humidifiers and dehumidifiers, sweepers, door locks, electric curtains, lights, etc. are turned off.
在另一种可能实现的方式中，移动终端100-1可以检测到作用于我的子页面中用于开启离家情景的操作，判定用户的状态为离家的状态。具体如下：In another possible implementation manner, the mobile terminal 100-1 may detect an operation for enabling the leaving home scene on the My subpage, and determine that the user's status is the leaving home status. details as follows:
如图12Y所示，移动终端100-1显示的用户界面126与前文图12X示出的用户界面126类似，前文中对图12X的描述也适用于对图12X的描述，在此暂不赘述。As shown in FIG. 12Y , the user interface 126 displayed by the mobile terminal 100 - 1 is similar to the user interface 126 shown in FIG. 12X above. The description of FIG. 12X above is also applicable to the description of FIG. 12X , which will not be repeated here.
移动终端100-1可以检测到用户作用于图12Y所示的控件1261B的操作，响应于该操作，移动终端100-1可以将智能情景页面中的子页面由推荐子页面切换为图12Z所示的“我的”子页面。The mobile terminal 100-1 can detect the user's operation on the control 1261B shown in Figure 12Y, and in response to the operation, the mobile terminal 100-1 can switch the subpage in the smart scene page from the recommended subpage to the one shown in Figure 12Z The "My" subpage of the .
如图12Z所示，用户界面126显示有“我的”子页面，“我的”子页面包括，用户自定义的一键执行模块包含的一个或多个智能情景对应的选项，例如选项1265、选项1266、选项1267，上述选项分别为用户自定义的居家办公、一梦天亮、长期出差等智能情景对应的选项；我的”子页面还包括用户自定义的智能编排模块对应的一个或多个智能情景对应的选项，例如选项1268、选项1269，上述选项分别为用户自定义的离家时关闭门锁、高温时开启空调等智能情景对应的选项；我的”子页面还包括用于添加一键执行或智能编排模块下的智能情景的控件1261C。As shown in FIG. 12Z , the user interface 126 displays a "My" subpage, and the "My" subpage includes options corresponding to one or more smart scenarios included in the user-defined one-key execution module, such as option 1265, Option 1266 and option 1267, the above-mentioned options are options corresponding to smart scenarios such as user-defined home office, a dream, and long-term business trip; My" sub-page also includes one or more user-defined smart arrangement modules Options corresponding to smart scenarios, such as option 1268 and option 1269, the above options are user-defined options corresponding to smart scenarios such as closing the door lock when leaving home and turning on the air conditioner when the temperature is high; the "My" subpage also includes options for adding a Control 1261C for Smart Context under the Key Execution or Smart Orchestration module.
此时，移动终端100-1检测到用户作用于图12Z所示的选项1267的操作，响应于该操作，移动终端100-1可以判定用户的状态为离家状态。此外，移动终端100-1还会应用长期出差的智能情景模式，即联动控制家庭设备执行对应的操作，例如移动终端100-1可以控制家庭设备中的电视、冰箱、空调、烟灶、厨房电器、空气净化器、新风机、加湿除湿器、扫地机、门锁、窗帘电动、电灯等等关机，开启监控设备例如智能门锁中的摄像头、以及房屋内是我摄像头的操作。At this time, mobile terminal 100-1 detects the user's operation on option 1267 shown in FIG. 12Z , and in response to the operation, mobile terminal 100-1 may determine that the user's state is away from home. In addition, the mobile terminal 100-1 will also apply the smart scene mode for long-term business trips, that is, to control the home devices to perform corresponding operations. , Air purifiers, fresh air fans, humidification and dehumidifiers, sweepers, door locks, electric curtains, lights, etc. are turned off, and monitoring devices such as cameras in smart door locks are turned on, as well as the operation of my cameras in the house.
基于上文图12A-图12Z对移动终端检测用户状态的方法相关的用户界面的介绍，接下来介绍，移动终端根据用户状态，和/或，获取到应用程序中的事件信息，自动控制家庭设备的用户界面示意图。Based on the introduction of the user interface related to the method of detecting the user status of the mobile terminal in Figure 12A-Figure 12Z above, the following introduces that the mobile terminal automatically controls the home device according to the user status and/or, the event information obtained in the application program A schematic diagram of the user interface.
在本申请实施例中，移动终端控制家庭设备执行对应操作的依据包括以下三种：In this embodiment of the application, the basis for the mobile terminal to control the home device to perform corresponding operations includes the following three types:
一、移动终端可以仅根据用户状态来控制家庭设备执行对应事件。1. The mobile terminal can control the home device to execute the corresponding event only according to the user status.
二、移动终端根据用户状态，并结合应用程序中记录的事件的信息执行对应的事件。2. The mobile terminal executes the corresponding event according to the user status and combined with the event information recorded in the application program.
三、移动终端仅根据应用程序中记录的事件的信息控制家庭设备执行对应功能。3. The mobile terminal only controls the home device to execute the corresponding function according to the event information recorded in the application program.
首先介绍移动终端仅根据用户状态来控制家庭设备执行对应事件的方法，具体如下：First, the method for the mobile terminal to control the home device to execute the corresponding event according to the user status is introduced, as follows:
移动终端中预先存储有用户状态与智能情景对应的关系，当用户忘记主动开启对应的智能情景时，移动终端可以根据用户的状态，应用对应的智能情景模式，避免因用户忘记，而导致家庭设备疏于管理的情况。The mobile terminal pre-stores the corresponding relationship between the user state and the smart scene. When the user forgets to actively open the corresponding smart scene, the mobile terminal can apply the corresponding smart scene mode according to the user's state, so as to avoid the failure of the home device due to the user's forgetting. Situations of neglect.
用户的状态于智能情景的对应关系例如可以是：当用户的状态为离家，则智慧家庭app会应用对应的智能情景例如安心离家的模式；当用户的状态由离家切换为回家时，则智慧家庭APP会应用安心离家这一模式；当用户的状态为居家办公时，则智慧家庭APP会应用居家办公模式；当用户状态为离家，且为长期离家(例如离家超过一周)，则智慧家庭APP会应用长期出差模式；当用户状态为睡眠模式，则智慧家庭app应用一梦天亮模式。本申请实施例对用户的状态的类型，和智能情景的类型不作限制，在此不进行一一赘述。The corresponding relationship between the user's state and the smart scene can be, for example: when the user's state is away from home, the smart home app will apply the corresponding smart scene, such as the mode of leaving home with peace of mind; when the user's state is switched from away from home to home , the smart home APP will apply the mode of leaving home with peace of mind; when the user's status is home office, the smart home APP will apply the home office mode; One week), the smart home app will use the long-term business trip mode; when the user status is sleep mode, the smart home app will use the dream mode. The embodiment of the present application does not limit the type of the user's state and the type of the smart scene, and details will not be described here.
上述，智能情景可以是智慧家庭app默认提供的，例如上文图12X示例性示出的例如“安心离家”、“温馨回家”、“清洁净化”等等，也可以是用户自定义的情景模式，例如上文图12Z示例性示出的“居家办公”、“一梦天亮”、“长期出差”等等，本申请实施例对此不作限制。As mentioned above, the smart scene can be provided by default by the smart home app, such as "leave home with peace of mind", "come home warmly", "clean and purify" as shown in Figure 12X above, or it can be user-defined Scenario modes, such as "home office", "a dream", "long-term business trip" and the like shown in Fig. 12Z exemplarily above, are not limited in this embodiment of the present application.
参考图13A-图13C，图13A-图13C示例性示出移动终端根据用户状态控制家庭设备的用户界面示意图。Referring to FIG. 13A-FIG. 13C , FIG. 13A-FIG. 13C exemplarily show a schematic diagram of a user interface for a mobile terminal to control a home device according to a user status.
图13A示例性示出智慧家庭app提供的用户界面示意图。Fig. 13A exemplarily shows a schematic diagram of a user interface provided by the smart home app.
如图13A所示，用户界面61为智慧家庭APP提供的首页，此时，设备显示区614中显示有各个家庭设备的状态，例如空调A、智能电灯A、空调B等等处于开启状态。As shown in FIG. 13A , the user interface 61 is the home page provided by the smart home APP. At this time, the status of each home device is displayed in the device display area 614 , such as air conditioner A, smart light A, air conditioner B, etc. are turned on.
当移动终端100-1检测到用户状态为离家时，则移动终端100-1会根据智慧家庭app存储的用户状态与智能情景的对应关系，应用离家所对应的智能情景。When the mobile terminal 100-1 detects that the user's state is leaving home, the mobile terminal 100-1 will apply the smart scene corresponding to leaving home according to the correspondence between the user state and the smart scene stored in the smart home app.
可选的，当移动终端100应用对应的智能情景模式前，还会显示如图13B所示的提示信息。Optionally, before the mobile terminal 100 applies the corresponding smart scene mode, it will also display the prompt information as shown in FIG. 13B .
如图13B所示，移动终端会显示窗口617，该窗口617显示例如“检测到您已离家，即将为您应用“安心离家”模式”，以及还显示有控件617A和控件617B。其中控件617A用于拒绝应用“安心离家”模式，控件617B用于同意应用“安心离家”模式。而当移动终端在预设时间内没有检测到用户作用与上述控件的操作时，则移动终端会默认应用“安心离家”模式。之后，移动终端100-1会显示如图13C所示的用户界面示意图。As shown in FIG. 13B , the mobile terminal displays a window 617 that displays, for example, "It is detected that you have left home, and the "leave home" mode will be applied to you", and controls 617A and 617B are also displayed. Wherein, the control 617A is used to reject the application of the "leave home with peace of mind" mode, and the control 617B is used to agree to the application of the "leave home with peace of mind" mode. And when the mobile terminal does not detect the user's action and the operation of the above-mentioned controls within the preset time, the mobile terminal will default to the "leave home with peace of mind" mode. Afterwards, the mobile terminal 100-1 will display a schematic diagram of the user interface as shown in FIG. 13C .
如图13C所示，用户界面61为智慧家庭APP提供的首页，此时，设备显示区614中显示有各个家庭设备的状态，例如空调A、智能电灯A、空调B等等已经切换为关闭状态。As shown in Figure 13C, the user interface 61 is the home page provided by the smart home APP. At this time, the status of each home device is displayed in the device display area 614, such as air conditioner A, smart light A, air conditioner B, etc. have been switched to the off state .
可以理解的时，设备显示区614显示的状态根据“安心离家”设置的控制规则对应，当“安心离家”还包括关闭电视机等时，若应用“安心离家”模式之前，电视剧处于开启状态，则移动终端还会控制电视机关机等等。It is understandable that the status displayed in the device display area 614 corresponds to the control rules set by "Leave Home Safely". If the TV is turned on, the mobile terminal will also control the TV to turn off and so on.
图13A-图13C仅仅示例性示出移动终端根据用户的离家状态控制家庭设备的用户界面示意图，关于移动终端根据睡眠的用户状态控制家庭设备的相关界面示意图在此不进行一一赘述。13A-13C only illustrate schematic diagrams of the user interface for the mobile terminal to control the home device according to the user's away from home state, and the related interface schematic diagrams for the mobile terminal to control the home device according to the sleeping user state will not be repeated here.
其次，介绍移动终端根据用户状态，并结合获取到的应用程序对应的事件，来控制家庭设备执行对应事件的方法，具体如下：Secondly, introduce the method for the mobile terminal to control the home device to execute the corresponding event according to the user status and combined with the obtained event corresponding to the application program, as follows:
移动终端中预先存储有用户状态与智能情景对应的关系，当用户忘记主动开启对应的智能情景时，移动终端可以根据用户的状态，应用对应的智能情景模式。但由于智能情景所设置的家庭设备的联动控制是一成不变的，也就是说，智能情景中不同模式都对应一套固定的联动控制家庭设备的方案，例如睡眠模式被应用后，移动终端会联动控制家庭设备开启静音模式或者关机等等，例如控制娱乐设备例如电视剧、音响、投影设备等关机，控制窗帘、电灯等关闭。然而，在用户睡眠的时候，移动终端中可能会记录有线上会议类事件，但由于用户开启睡眠模式而错过重要会议。为了避免这一情况的发生，移动终端还会根据线上会议类事件，提前一定时间控制家中电灯开启、笔记本等办公设备开启，并提醒用户将有线上会议事件待完成，从而为用户做好预备工作。满足用户居家办公体验。进一步提高家庭生活的质量。The mobile terminal pre-stores the corresponding relationship between the user state and the smart scene. When the user forgets to activate the corresponding smart scene, the mobile terminal can apply the corresponding smart scene mode according to the user's state. However, the linkage control of home devices set in the smart scene is immutable, that is to say, different modes in the smart scene correspond to a fixed set of linkage control schemes for home devices. For example, after the sleep mode is applied, the mobile terminal will be linked. Turn on the silent mode or shut down the home equipment, etc., for example, control the shutdown of entertainment equipment such as TV dramas, audio, projection equipment, etc., and control the shutdown of curtains, lights, etc. However, when the user is sleeping, the mobile terminal may record online conference events, but the important meeting is missed because the user turns on the sleep mode. In order to avoid this situation, the mobile terminal will also control the lights at home and office equipment such as notebooks to be turned on a certain time in advance according to the online meeting event, and remind the user to wait for the online meeting event to be completed, so as to prepare for the user Work. Satisfy the user's home office experience. Further improve the quality of family life.
参考图13D-图13J，图13D-图13J示例性示出移动终端根据用户状态和获取到的事件信息来控制家庭设备的用户界面示意图。Referring to FIG. 13D-FIG. 13J , FIG. 13D-FIG. 13J exemplarily show a schematic diagram of a user interface for a mobile terminal to control a home device according to user status and acquired event information.
图13D示例性示出智慧家庭app提供的用户界面示意图。Fig. 13D exemplarily shows a schematic diagram of a user interface provided by the smart home app.
如图13D所示，用户界面61为智慧家庭APP提供的首页，此时，设备显示区614中显示有各个家庭设备的状态，例如电动窗帘A、智能电灯A、电动窗户B等等处于开启状态。As shown in Figure 13D, the user interface 61 is the homepage provided by the smart home APP. At this time, the device display area 614 displays the status of each home device, such as the electric curtain A, smart light A, electric window B, etc. are in the open state .
当移动终端100-1检测到用户状态为睡眠时，则移动终端100-1会根据智慧家庭app存储的用户状态与智能情景的对应关系，应用睡眠所对应的智能情景。When the mobile terminal 100-1 detects that the user state is sleep, the mobile terminal 100-1 will apply the smart scene corresponding to sleep according to the corresponding relationship between the user state and the smart scene stored in the smart home app.
可选的，当移动终端100应用对应的智能情景模式前，还会显示如图13E所示的提示信息。Optionally, before the mobile terminal 100 applies the corresponding smart scene mode, it will also display a prompt message as shown in FIG. 13E .
如图13E所示，移动终端会显示窗口618，该窗口618显示例如“检测到您即将睡觉，即将为您应用“一梦天亮”模式”，以及还显示有控件618A和控件618B。其中控件618A用于拒绝应用“一梦天亮”模式，控件618B用于同意应用“一梦天亮”模式。而当移动终端在预设时间内没有检测到用户作用与上述控件的操作时，则移动终端会默认应用“一梦天亮”模式。之后，移动终端100-1会显示如图13F所示的用户界面示意图。As shown in FIG. 13E , the mobile terminal displays a window 618 that displays, for example, "It has been detected that you are going to sleep, and the "Dream" mode is about to be applied to you," and controls 618A and 618B are also displayed. Among them, the control 618A is used to reject the application of the "One Dream" mode, and the control 618B is used to allow the application of the "One Dream" mode. And when the mobile terminal does not detect the user's action on the operation of the above-mentioned controls within the preset time, the mobile terminal will default to the "One Dream" mode. Afterwards, the mobile terminal 100-1 will display a schematic diagram of the user interface as shown in FIG. 13F.
如图13F所示，用户界面61为智慧家庭APP提供的首页，此时，设备显示区614中显示有各个家庭设备的状态，例如电动窗帘A、智能电灯A等等已经切换为关闭状态。As shown in FIG. 13F , the user interface 61 is the home page provided by the smart home APP. At this time, the status of each home device is displayed in the device display area 614 , such as the electric curtain A, the smart light A, etc. have been switched to the off state.
可以理解的时，设备显示区614显示的状态根据“一梦天亮”设置的控制规则对应，当“一梦天亮”还包括关闭电视机等时，若应用“安心离家”模式之前，电视剧处于开启状态，则移动终端还会控制电视机关机等等。When it is understandable, the state displayed in the device display area 614 corresponds to the control rule set by "Yimengtianliang". If the TV is turned on, the mobile terminal will also control the TV to turn off and so on.
假设用户从12：00开始睡觉，移动终端也从12：00开始应用“一梦天亮”模式，若移动终端从天气预报类应用程序中获取到13：20将有台风天气的事件信息时，尽管“一梦天亮”模式中不包含控制电动窗户的关闭，但移动终端会结合该事件控制电动窗户B关闭。可选的移动终端100-1会先显示如图13G所示的提示信息。Assuming that the user starts to go to bed at 12:00, and the mobile terminal also starts to apply the "Dream" mode from 12:00, if the mobile terminal obtains the event information of typhoon weather at 13:20 from the weather forecast application, although The "Dream" mode does not include controlling the closing of the electric window, but the mobile terminal will control the closing of the electric window B in combination with this event. The optional mobile terminal 100-1 will first display the prompt information as shown in FIG. 13G.
如图13G所示，用户界面121中显示有卡片1218，该卡片1218为移动终端中安装的智慧助手提供的卡片。具体的，卡片1218包含“小艺”智慧助手图标1218A、卡片提醒的日期1218B、事件主题1218C，和子卡片1218D等。As shown in FIG. 13G , a card 1218 is displayed on the user interface 121, and the card 1218 is a card provided by the smart assistant installed in the mobile terminal. Specifically, the card 1218 includes a "Xiaoyi" smart assistant icon 1218A, a card reminder date 1218B, an event theme 1218C, and sub-cards 1218D.
事件主题1218C具体为：检测到今天13:20降雨伴有台风，建议您关好门窗！The event theme 1218C is specifically: Rainfall with typhoon detected at 13:20 today, it is recommended that you close the doors and windows!
子卡片1218D主要显示有智能窗户B的状态，用户可以通过点击该子卡片1218D跳转至智慧家庭APP提供的设备详情页中，进而控制该设备。The sub-card 1218D mainly displays the status of the smart window B, and the user can click on the sub-card 1218D to jump to the device details page provided by the smart home APP, and then control the device.
值得注意的是，当移动终端100-1在13：00获取到台风天气的事件信息，并显示如图13G的卡片后，在预设时间内没有检测到用于关闭智能窗户B的操作，则移动终端100-1会在自动控制智能窗户B关闭。具体参见图13H。It is worth noting that when the mobile terminal 100-1 obtains the event information of the typhoon at 13:00 and displays the card shown in Figure 13G, but does not detect the operation for closing the smart window B within the preset time, then The mobile terminal 100-1 will automatically control the smart window B to close. See Figure 13H for details.
如图13H所示，此时例如为13：00，再过10分钟台风天气来临，此时移动终端100-1会控制电动窗户B关闭，设备显示区614中电动窗户B的状态已经切换为关闭。这样，尽管用户在睡觉，也不会因为台风天气而被影响，或者破坏家庭环境。As shown in Figure 13H, at this time, for example, it is 13:00, and the typhoon will come in 10 minutes. At this time, the mobile terminal 100-1 will control the electric window B to close, and the state of the electric window B in the device display area 614 has been switched to closed. . In this way, although the user is sleeping, he will not be affected by typhoon weather or damage the home environment.
若移动终端获取到用户在14：30有个线上会议要参加，而到14：20用户还在睡觉，尽管“一梦天亮”模式中不包含控制书房的电灯、笔记本等开启，但移动终端会结合线上会议时间控制书房的电灯打开，笔记本启动，同时还会重新打开用户卧室的智能电灯A以及电动窗帘A。可选的移动终端100-1会先显示如图13I所示的提示信息。If the mobile terminal obtains that the user has an online meeting to attend at 14:30, and the user is still sleeping at 14:20, although the "Dream" mode does not include turning on the lights and notebooks in the study room, the mobile terminal Combined with the online meeting time, it will control the lights in the study to turn on, the notebook will start, and at the same time, the smart lights A and electric curtains A in the user's bedroom will be turned on again. The optional mobile terminal 100-1 will first display the prompt information as shown in FIG. 13I.
如图13I所示，用户界面121中显示有卡片1219，该卡片1219为移动终端中安装的智慧助手提供的卡片。具体的，卡片1219包含“小艺”智慧助手图标1219A、卡片提醒的日期1219B、事件主题1219C，和子卡片1219D等。As shown in FIG. 13I , a card 1219 is displayed in the user interface 121, and the card 1219 is a card provided by the smart assistant installed in the mobile terminal. Specifically, the card 1219 includes the "Xiaoyi" smart assistant icon 1219A, the card reminder date 1219B, the event theme 1219C, and sub-cards 1219D.
事件主题1219C具体为：检测到今天14:30线上会议，建议做好相关准备！The event topic 1219C is specifically: An online meeting was detected at 14:30 today, and it is recommended to make relevant preparations!
子卡片1219D主要显示有笔记本的状态，用户可以通过点击该子卡片1219D跳转至智慧家庭APP提供的设备详情页中，进而控制该设备。The sub-card 1219D mainly displays the status of the notebook, and the user can click on the sub-card 1219D to jump to the device details page provided by the smart home APP, and then control the device.
值得注意的是，当移动终端100-1在14：10显示如图13I的卡片后，在预设时间内没有检测到用于开启笔记本的操作，则移动终端100-1会自动控制笔记本开机。It should be noted that when the mobile terminal 100-1 displays the card shown in Figure 13I at 14:10, and no operation for turning on the notebook is detected within the preset time, the mobile terminal 100-1 will automatically control the notebook to turn on.
图13I仅仅示例性示出用于提示用户开启笔记本的卡片，在本申请另一些实施例中，移动终端100-1还会显示例如开启书房电灯等的提示信息。FIG. 13I only exemplarily shows a card for prompting the user to turn on the notebook. In other embodiments of the present application, the mobile terminal 100-1 may also display prompt information such as turning on the light in the study.
如图13J所示，此时例如为14：20，再过10分钟将要开启线上会议，此时设备显示区614中显示有各个家庭设备的状态，例如电动窗帘A、智能电灯A等等再次切换为开启状态。值得注意的是，移动终端100还会控制书房的电灯开启，并启动小中的笔记本开启等，图13J暂未示出。As shown in Figure 13J, at this time, for example, it is 14:20, and the online meeting will start in another 10 minutes. At this time, the status of each home device is displayed in the device display area 614, such as electric curtain A, smart light A, etc. toggle to on. It is worth noting that the mobile terminal 100 will also control the lights in the study to turn on, and start the notebook in Xiaozhong, etc., which are not shown in FIG. 13J yet.
上述移动终端记录的14：30参加线上会议的事件信息可以称为第一事件，14：30属于第六时间段，移动终端检测到第六时间段用户将执行第一事件时，移动终端可以执行第十二操作，该第十二操作例如上文示出的：用于控制第二设备例如笔记本开机。The event information of participating in the online meeting at 14:30 recorded by the above mobile terminal can be called the first event, and 14:30 belongs to the sixth time period. When the mobile terminal detects that the user will execute the first event in the sixth time period, the mobile terminal can A twelfth operation is performed, and the twelfth operation is, for example, as shown above: controlling the second device such as a notebook to be turned on.
在本申请另一些实施例中，当移动终端控制第二设备例如笔记本开机后，移动终端还会显示第三控件，该第三控件用于撤回上一个操作，即撤回控制笔记本开机的操作，移动终端检测到作用于第三控件的操作，可以控制笔记本关机。In other embodiments of the present application, after the mobile terminal controls the second device such as a notebook to turn on, the mobile terminal will also display a third control, which is used to withdraw the previous operation, that is, to withdraw the operation of controlling the notebook to turn on, and move The terminal detects the operation acting on the third control, and can control the shutdown of the notebook.
最后，介绍移动终端仅根据获取到的应用程序对应的事件，来控制家庭设备执行对应事件时，具体包括：Finally, it is introduced that when the mobile terminal only controls the home device to execute the corresponding event according to the acquired event corresponding to the application program, it specifically includes:
移动终端中安装的智慧家庭APP可以获取到应用程序的记录的事件，关于应用程序的类型、事件的类型已经再上文介绍，在此在不赘述。这里仅对移动终端根据事件的信息控制家庭设备的方法作出详细描述。The smart home APP installed in the mobile terminal can obtain the recorded events of the application program. The types of the application program and the types of events have been introduced above, and will not be repeated here. Here, only a detailed description is made on the method for the mobile terminal to control the home device according to the event information.
这里先以移动终端100获取到应用程序中记录有如上文图12M所示的线上会议类事件的信息为例，当移动终端获取到用户将在9月26日下午14：30参加线上会议，则移动终端将在会议开启前控制书房的电灯开启，以及控制笔记本等办公设备启动等等。Here, take the mobile terminal 100 as an example of the information recorded in the application program as shown in Figure 12M above, when the mobile terminal obtains that the user will participate in the online meeting at 14:30 pm on September 26 , the mobile terminal will control the lights in the study to be turned on before the meeting starts, and control the startup of office equipment such as notebooks, etc.
参考图13K-图13L，图13K-图13L示例性示出移动终端仅根据获取到的事件，来控制 家庭设备执行对应事件的方法，具体如下：Referring to Fig. 13K-Fig. 13L, Fig. 13K-Fig. 13L exemplarily show the method for the mobile terminal to control the home device to execute the corresponding event only according to the acquired event, specifically as follows:
当移动终端100-1获取到小中在生活服务类APP预定了17：30餐厅A的餐位，移动终端100会根据小中出行习惯例如小中经常自驾出行，那么移动终端100-1会控制小中的车启动。When the mobile terminal 100-1 obtains that Xiaozhong has reserved a table in Restaurant A at 17:30 in the life service APP, the mobile terminal 100 will control the The small car starts.
图13K示例性示出移动终端显示的用于提示用户待办事件的用户界面示意图。FIG. 13K exemplarily shows a schematic diagram of a user interface displayed by a mobile terminal for prompting a user to do events.
如图13K所示，用户界面121中显示有用于提示用户启动车辆出发去餐厅A的卡片。该卡片中显示的事件主题具体为：检测到您下午17；30预约的餐厅A，建议您尽快出发！此外，该卡片还显示有车辆的当前状态，例如车辆目前处于锁定状态。As shown in FIG. 13K , a card for prompting the user to start the vehicle and go to restaurant A is displayed on the user interface 121 . The specific event theme displayed in this card is: It is detected that you have made a reservation for restaurant A at 17:30 in the afternoon. It is recommended that you leave as soon as possible! In addition, the card also shows the current status of the vehicle, such as the vehicle is currently locked.
值得注意的是，当移动终端100-1在17：00显示如图13K的卡片后，在预设时间内没有检测到用于启动车辆的操作，则移动终端100-1会自动控制车辆启动。It should be noted that when the mobile terminal 100-1 displays the card shown in Figure 13K at 17:00, and no operation for starting the vehicle is detected within the preset time, the mobile terminal 100-1 will automatically control the vehicle to start.
如图13L所示，此时例如为17：10，再过20分钟到了用餐时间，此时移动终端100-1会自动控制车辆启动，并显示如图13L所示的卡片提示信息。具体的该卡片显示的事件为主题为：已为您启动车辆，若您10分钟内未上车将自动熄火。且子卡片中显示的车辆的状态为开启状态。As shown in FIG. 13L , at this time, for example, it is 17:10, and it will be meal time in 20 minutes. At this time, the mobile terminal 100-1 will automatically control the vehicle to start, and display the card prompt information as shown in FIG. 13L . The specific theme of the event displayed on this card is: the vehicle has been started for you, if you do not get in the car within 10 minutes, it will automatically turn off. And the status of the vehicle displayed in the sub-card is on.
上述移动终端记录的17：00外出用餐的事件信息可以称为第一事件，17：00属于第六时间段，移动终端检测到第六时间段内用户将执行第一事件时，移动终端可以执行第十二操作，该第十二操作例如上文输出的：用于控制车辆启动。The above-mentioned event information of dining out at 17:00 recorded by the mobile terminal can be called the first event, and 17:00 belongs to the sixth time period. When the mobile terminal detects that the user will execute the first event within the sixth time period, the mobile terminal can execute The twelfth operation, the twelfth operation is as output above: it is used to control the start of the vehicle.
在本申请另一些实施例中，当移动终端控制车辆启动后，移动终端还会显示第三控件，该第三控件用于撤回上一个操作，即撤回启动车辆操作，移动终端检测到作用于第三控件的操作，可以控制车辆熄火。In other embodiments of the present application, after the mobile terminal controls the vehicle to start, the mobile terminal will also display a third control, which is used to withdraw the previous operation, that is, to withdraw the operation of starting the vehicle. The operation of the three controls can control the vehicle to turn off.
可以理解的是，上文图13K-图13L仅仅以用户预约就餐服务这一事件为例，来介绍移动终端仅根据事件信息控制家庭设备的用户界面示意图，不应构成对本申请的限制。It can be understood that the above Figures 13K-13L only take the event of a user ordering a dining service as an example to introduce a schematic diagram of a user interface for a mobile terminal to control a home device based on event information, which should not constitute a limitation to this application.
在本申请另一些实施例中，移动终端100-1还可以根据其他事件来控制家庭设备，例如，可以根据获取到的用户居家运动的事件后，控制家中健身房中的对应设备启动，在此不一一赘述。In other embodiments of the present application, the mobile terminal 100-1 can also control the home device according to other events, for example, it can control the corresponding device in the home gym to start after the acquired event of the user's home exercise. Let me repeat them one by one.
在本申请另一些实施例中，当检测到用户输入的第十一操作时，车辆可以锁车及锁门。也就是说当用户下车并锁定车辆后，若车辆检测到车内还有儿童或老人时，车辆的车载电脑会输出用于提车内还有儿童或老人的第九提示信息，或者车辆还会触发移动终端或者其他家庭设备输出用于提示用户车辆内还有用户的第九提示信息。此外，为了保证儿童和老人的生命安全，车辆可能会自动控制开门开窗。发送第八信息到用户的移动终端，提醒用户车内还有老人和儿童，车门车窗已经打开，请勿将车门车窗锁死，避免出现危险事件，影响儿童和老人的生命安全，进而提醒用户及时采取安全措施。之后用户的移动终端还可以显示有用于锁窗和锁门的第二控件，用户可以通过作用该控件来控制车辆重新锁窗和锁门。In some other embodiments of the present application, when the eleventh operation input by the user is detected, the vehicle may lock the car and the door. That is to say, when the user gets off the vehicle and locks the vehicle, if the vehicle detects that there are still children or old people in the car, the on-board computer of the vehicle will output a ninth prompt message for notifying that there are still children or old people in the car, or that the vehicle is still in use. It will trigger the mobile terminal or other household devices to output ninth prompt information for reminding the user that there is still a user in the vehicle. In addition, in order to ensure the safety of children and the elderly, the vehicle may automatically control the opening of doors and windows. Send the eighth message to the user's mobile terminal to remind the user that there are old people and children in the car, and the doors and windows have been opened. Please do not lock the doors and windows to avoid dangerous events that will affect the lives of children and the elderly. Users take safety measures in a timely manner. Afterwards, the user's mobile terminal can also display a second control for locking the windows and doors, and the user can control the vehicle to re-lock the windows and doors by acting on the controls.
上文图12A-图12Z介绍的在移动终端100-1检测用户状态，即关联前文数据银行系统中介绍的收集用户数据，具体表现为家庭设备例如智能门锁、家庭监控等收集用户的状态；或者智慧家庭应用程序收集用户的状态；或者移动终端的OS收集用户的数据例如断开与家庭设备的网络连接的相关数据；或者移动终端100-1的信息输入器件例如显示屏收集用户数据。Detecting the user status at the mobile terminal 100-1 described above in Figures 12A-12Z, that is, associating with the collection of user data introduced in the previous data bank system, is specifically manifested in the collection of user status by home devices such as smart door locks and home monitoring; Or the smart home application program collects the user's status; or the OS of the mobile terminal collects the user's data, such as data related to disconnecting the network connection with the home device; or the information input device of the mobile terminal 100-1, such as a display screen, collects user data.
上文图13A-图13L介绍的移动终端100-1根据用户状态控制家庭设备，即关联前文数据银行系统中介绍的用户数据的加工、开放、呈现，具体表现为移动终端将收集到的用户出行 事件信息加工为对应用户离家状态，然后控制家庭设备执行对应的操作，家庭设备将执行结果相关数据开放给移动终端，移动终端将该执行结果相关数据的价值呈现给用户，具体表现为显示家庭设备已完成对应操作的提示信息，或者智慧家庭APP中呈现的设备的状态信息发生变化等等。The mobile terminal 100-1 described above in Figure 13A-13L controls the home device according to the user status, that is, the processing, opening, and presentation of the user data described in the previous data bank system are associated, and the specific performance is that the mobile terminal will collect the user's travel information. The event information is processed to correspond to the state of the user leaving home, and then the home device is controlled to perform the corresponding operation. The home device opens the data related to the execution result to the mobile terminal, and the mobile terminal presents the value of the data related to the execution result to the user. The prompt information that the device has completed the corresponding operation, or the status information of the device presented in the smart home APP changes, etc.
关于用户数据的收集、加工、开放、价值呈现等的方法在此暂不赘述，具体可以参考前文对数据银行系统的介绍。The methods of collecting, processing, opening, and value presentation of user data will not be described here. For details, please refer to the introduction to the data banking system above.
本申请实施例中提及的小艺建议APP、智慧家庭APP、生活服务类APP、事件备忘类APP等APP获取用户的出行数据、习惯数据、设备数据中的一项或多项的方法，可以参考前述实施例中智慧家庭APP获取用户身份信息、家庭空间信息、设备使用规则的实现方式。这里不再赘述。The methods mentioned in the embodiments of this application for APPs such as Xiaoyi Suggestion APP, Smart Home APP, Life Service APP, and Event Memo APP to obtain one or more of the user’s travel data, habit data, and equipment data, You can refer to the implementation manner in which the smart home APP acquires user identity information, home space information, and device usage rules in the foregoing embodiments. I won't go into details here.
本申请所提及的小艺建议APP、智慧家庭APP、生活服务类APP、事件备忘类APP等APP，其存在形式不限于是APP，还可以是小程序、快应用、网页应用等可在电子设备上运行的程序。Apps such as Xiaoyi’s suggestion APP, smart home APP, life service APP, and event reminder APP mentioned in this application are not limited to APPs, but can also be small programs, quick applications, web applications, etc. Programs that run on electronic devices.
本申请实施例所描述的用户界面，仅为示例性说明，不应对本申请构成限定。The user interface described in the embodiment of the present application is only for illustration and shall not limit the present application.
可见，实施本身提供的家庭设备的控制方法后，移动终端可以根据用户在家庭关系中担任的角色、用户在家庭空间中的空间等因素，设置用户控制家庭设备的权限。之后，移动终端接收到用户用于控制家庭设备的操作，识别用户身份并根据用户身份所对应的权限，控制家庭设备执行对应的功能。It can be seen that after implementing the home device control method provided by itself, the mobile terminal can set the user's authority to control the home device according to the user's role in the family relationship, the user's space in the home space and other factors. Afterwards, the mobile terminal receives the user's operation for controlling the home device, identifies the user identity, and controls the home device to perform the corresponding function according to the authority corresponding to the user identity.
进一步的，父母还可以为子女设置家庭设备的使用规则，以及打破规则后的惩罚。从而节省家长对子女的教育时间，还能使得子女培养出良好的生活习惯以及学习习惯。Furthermore, parents can also set rules for their children to use family devices, as well as punishments for breaking the rules. In this way, it saves the time for parents to educate their children, and it can also enable children to develop good living habits and study habits.
进一步的，移动终端可以根据用户状态和/或用户终端设备中记录的事件信息，自动控制家庭设备执行对应的操作，避免用户因为忘记或者不在家，疏于对家庭设备的管控，进而导致危险事件的发生。Furthermore, the mobile terminal can automatically control the home device to perform corresponding operations according to the user status and/or the event information recorded in the user terminal device, so as to prevent the user from neglecting the management and control of the home device due to forgetting or not being at home, thereby causing dangerous events happened.
本申请的各实施方式可以任意进行组合，以实现不同的技术效果。Various implementation modes of the present application can be combined arbitrarily to achieve different technical effects.
在上述实施例中，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本申请所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质，(例如，软盘、硬盘、磁带)、光介质(例如，DVD)、或者半导体介质(例如固态硬盘Solid State Disk)等。In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the present application will be generated in whole or in part. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website, computer, server or data center Transmission to another website site, computer, server, or data center by wired (eg, coaxial cable, optical fiber, DSL) or wireless (eg, infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrated with one or more available media. The available medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, DVD), or a semiconductor medium (for example, a Solid State Disk).
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，该流程可以由计算机程序来指令相关的硬件完成，该程序可存储于计算机可读取存储介质中，该程序在执行时，可包括如上述各方法实施例的流程。而前述的存储介质包括：ROM或随机存储记忆体 RAM、磁碟或者光盘等各种可存储程序代码的介质。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments are realized. The processes can be completed by computer programs to instruct related hardware. The programs can be stored in computer-readable storage media. When the programs are executed , may include the processes of the foregoing method embodiments. The aforementioned storage medium includes various media that can store program codes such as ROM or random access memory RAM, magnetic disk or optical disk.
总之，以上所述仅为本发明技术方案的实施例而已，并非用于限定本发明的保护范围。凡根据本发明的揭露，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。In a word, the above description is only an embodiment of the technical solution of the present invention, and is not intended to limit the protection scope of the present invention. All modifications, equivalent replacements, improvements, etc. made according to the disclosure of the present invention shall be included in the protection scope of the present invention.

Claims (24)

  1. 一种设备的控制方法，所述方法应用于包含第一设备和第二设备的通信系统；其特征在于，所述第二设备位于第一空间中的第一区域；所述方法包括：A device control method, the method is applied to a communication system including a first device and a second device; characterized in that, the second device is located in a first area in a first space; the method includes:
    所述第一设备接收到第一操作；the first device receives a first operation;
    所述第一设备识别输入所述第一操作的用户的身份为第一用户；The first device identifies the identity of the user who inputs the first operation as the first user;
    所述第一设备触发所述第二设备启动第一功能；The first device triggers the second device to start a first function;
    所述第一设备再次接收到所述第一操作；The first device receives the first operation again;
    所述第一设备识别输入所述第一操作的用户的身份为第二用户；The first device identifies the identity of the user inputting the first operation as the second user;
    所述第一设备拒绝触发所述第二设备启动所述第一功能。The first device refuses to trigger the second device to start the first function.
  2. 根据权利要求1所述的方法，其特征在于，所述通信系统还包括第三设备；所述第一设备接收到第一操作之前，所述方法还包括：The method according to claim 1, wherein the communication system further comprises a third device; before the first device receives the first operation, the method further comprises:
    所述第一设备接收到第二操作后确定所述第二设备位于所述第一空间中的所述第一区域；After receiving the second operation, the first device determines that the second device is located in the first area in the first space;
    或者，or,
    所述第一设备接收到所述第三设备发送的第一信息，所述第一信息指示所述第二设备位于所述第一空间中的所述第一区域。The first device receives first information sent by the third device, where the first information indicates that the second device is located in the first area in the first space.
  3. 根据权利要求1或2所述的方法，其特征在于，所述第一设备拒绝触发所述第二设备启动所述第一功能之后，所述方法还包括：The method according to claim 1 or 2, wherein after the first device refuses to trigger the second device to start the first function, the method further comprises:
    所述第一设备再次识别输入所述第一操作的用户的身份；The first device re-identifies the identity of the user inputting the first operation;
    在所述用户有权限控制所述第一区域中设备的情况下，所述第一设备触发所述第二设备启动所述第一功能；In the case that the user has the authority to control devices in the first area, the first device triggers the second device to start the first function;
    在所述用户没有权限控制所述第一区域中设备的情况下，则所述第一设备拒绝触发所述第二设备启动所述第一功能。If the user has no authority to control devices in the first area, the first device refuses to trigger the second device to start the first function.
  4. 根据权利要求1-3任一项所述的方法，其特征在于，在所述第一设备触发所述第二设备启动所述第一功能之前，所述方法还包括以下一项或多项：The method according to any one of claims 1-3, wherein before the first device triggers the second device to start the first function, the method further includes one or more of the following:
    所述第一设备确定所述第一空间中有其他用户；The first device determines that there are other users in the first space;
    或者，所述第一设备确定所述用户与所述第一空间的距离小于第一值；Or, the first device determines that the distance between the user and the first space is smaller than a first value;
    或者，所述第一设备确定接收所述第一操作的时间为所述用户的非工作时间；Or, the first device determines that the time for receiving the first operation is the user's non-working time;
    或者，所述第一设备确定所述第一功能用于减少家庭耗电。Alternatively, the first device determines that the first function is used to reduce household power consumption.
  5. 一种设备的控制方法，所述方法应用于第四设备和第五设备的通信系统；其特征在于，所述方法包括：A device control method, the method is applied to the communication system of the fourth device and the fifth device; it is characterized in that the method includes:
    所述第四设备检测到所述第四设备位于第一电子围栏外；The fourth device detects that the fourth device is located outside the first geo-fence;
    所述第四设备输出第二提示信息，或者，所述第四设备向第五设备发送第二信息，所述第二信息用于指示所述第四设备位于所述第一电子围栏外；The fourth device outputs second prompt information, or the fourth device sends second information to the fifth device, and the second information is used to indicate that the fourth device is located outside the first electronic fence;
    所述第一电子围栏包括多个封闭区域以及所述多个封闭区域之间的路线。The first electronic fence includes multiple closed areas and routes between the multiple closed areas.
  6. 根据权利要求5所述的方法，其特征在于，所述第四设备检测到所述第四设备位于第一电子围栏外，具体包括：The method according to claim 5, wherein the fourth device detects that the fourth device is located outside the first electronic fence, specifically comprising:
    所述第四设备检测到所述第四设备位于所述第一电子围栏中的所述多个封闭区域外；The fourth device detects that the fourth device is located outside the plurality of enclosed areas in the first geo-fence;
    或者，or,
    所述第四设备检测到所述第四设备位于所述第一电子围栏中的所述路线外超过第一距离和/或位于所述第一电子围栏中的所述路线外的时间超过第一时间段。The fourth device detects that the fourth device is located outside the route in the first geo-fence for more than a first distance and/or is located outside the route in the first geo-fence for longer than a first time. period.
  7. 根据权利要求6所述的方法，其特征在于，所述方法还包括：The method according to claim 6, further comprising:
    所述第四设备检测到所述第四设备位于第二电子围栏内；所述第四设备输出第三提示信息，或者，所述第四设备向所述第五设备发送第三信息，所述第三信息用于指示所述第四设备位于所述第二电子围栏内。The fourth device detects that the fourth device is located in the second electronic fence; the fourth device outputs third prompt information, or the fourth device sends third information to the fifth device, the The third information is used to indicate that the fourth device is located within the second geo-fence.
  8. 一种设备的控制方法，所述方法应用于第一设备、第二设备和第四设备的通信系统；其特征在于，所述方法包括：A device control method, the method is applied to the communication system of the first device, the second device and the fourth device; it is characterized in that the method includes:
    第四设备检测到所述第四设备的使用情况不符合第一规则；The fourth device detects that the use of the fourth device does not comply with the first rule;
    所述第四设备停止提供所述第四设备的部分功能或全部功能；The fourth device stops providing some or all functions of the fourth device;
    所述第四设备接收到所述第二设备发送的第四信息，所述第四信息指示用户完成了第一任务；响应于接收到第四信息，所述第四设备继续提供所述第四设备的部分或全部功能；The fourth device receives fourth information sent by the second device, the fourth information indicating that the user has completed the first task; in response to receiving the fourth information, the fourth device continues to provide the fourth Part or all of the functionality of the device;
    或者，or,
    所述第四设备接收到所述第一设备发送的第五信息，所述第五信息用于指示所述第四设备继续提供所述第四设备的部分或全部功能；响应于接收到第五信息，所述第四设备继续提供所述第四设备的部分或全部功能。The fourth device receives fifth information sent by the first device, where the fifth information is used to instruct the fourth device to continue to provide some or all functions of the fourth device; in response to receiving the fifth Information, the fourth device continues to provide part or all of the functions of the fourth device.
  9. 根据权利要求8所述的方法，其特征在于，所述第四设备接收到所述第二设备发送的第四信息之前或者之后，并且所述第四设备继续提供所述第四设备的部分或全部功能之前；所述方法还包括：The method according to claim 8, characterized in that, before or after the fourth device receives the fourth information sent by the second device, and the fourth device continues to provide part or before full functionality; the method also includes:
    所述第二设备将所述第四信息发送至所述第一设备；The second device sends the fourth information to the first device;
    所述第一设备检测到第五操作；所述第一设备向所述第四设备发送所述第五信息，所述第五信息用于指示所述第四设备继续提供所述第四设备的部分或全部功能。The first device detects a fifth operation; the first device sends the fifth information to the fourth device, and the fifth information is used to instruct the fourth device to continue to provide the fourth device's some or all of the features.
  10. 根据权利要求8或9所述的方法，其特征在于，在所述第四设备接收到第二设备发送的第四信息之后，并且所述第四设备继续提供所述第四设备的部分或全部功能之前；所述方法还包括：The method according to claim 8 or 9, wherein after the fourth device receives the fourth information sent by the second device, the fourth device continues to provide part or all of the function; the method also includes:
    所述第四设备将所述第三信息发送至所述第一设备；The fourth device sends the third information to the first device;
    所述第一设备检测到第五操作，所述第一设备向所述第四设备发送所述第五信息，所述第五信息用于指示所述第四设备继续提供所述第四设备的部分或全部功能。The first device detects a fifth operation, the first device sends the fifth information to the fourth device, and the fifth information is used to instruct the fourth device to continue to provide the fourth device's some or all of the features.
  11. 根据权利要求8-10任一项所述的方法，其特征在于，所述第一规则包括以下任意一项或多项：The method according to any one of claims 8-10, wherein the first rule includes any one or more of the following:
    所述第四设备每天处于解锁状态的时长小于第一时长；The duration of the fourth device being in the unlocked state every day is less than the first duration;
    所述第四设备持续处于解锁状态的时长小于第二时长；The duration of the fourth device being in the unlocked state is shorter than the second duration;
    所述第四设备在第三时间段以外的其他时间处于锁屏状态；The fourth device is in a screen-locked state at other times than the third time period;
    所述第四设备拒绝运行第一应用程序以外的应用程序；The fourth device refuses to run applications other than the first application;
    所述第四设备持续运行第一应用程序的时长小于第三时长。The duration for which the fourth device continues to run the first application program is less than the third duration.
  12. 根据权利要求8-11任一项所述的方法，其特征在于，所述第四设备接收到第二设备发送的第四信息，具体包括：The method according to any one of claims 8-11, wherein the fourth device receives the fourth information sent by the second device, which specifically includes:
    所述第二设备认证所述用户的身份，并在所述用户的身份为第二用户的情况下，向所述第四设备发送第三信息。The second device authenticates the identity of the user, and sends third information to the fourth device when the identity of the user is the second user.
  13. 一种设备的控制方法，所述方法应用于第一设备第六设备的通信系统；其特征在于，所述方法包括：A device control method, the method is applied to the communication system of the first device and the sixth device; it is characterized in that the method includes:
    第一设备检测到第六操作，所述第六操作用于启动第二功能；the first device detects a sixth operation, the sixth operation is used to activate the second function;
    所述第一设备根据用户输入的第七操作获取第二用户的状态，或者通过第六设备获取所述第二用户的状态；The first device acquires the status of the second user according to the seventh operation input by the user, or acquires the status of the second user through the sixth device;
    在所述第二用户的状态为以下一项或多项的情况下：未睡觉、学习，所述第二用户与第一用户的距离小于第二距离与预设距离，或者所述第二用户与所述第一用户处于一个房间内；When the state of the second user is one or more of the following: not sleeping, studying, the distance between the second user and the first user is less than the second distance and the preset distance, or the second user be in the same room as the first user;
    所述第一设备拒绝启动所述第二功能。The first device refuses to activate the second function.
  14. 一种设备的控制方法，所述方法应用于第一设备和第六设备的通信系统；其特征在于，所述方法包括：A device control method, the method is applied to the communication system of the first device and the sixth device; it is characterized in that the method includes:
    所述第一设备检测到所述第二用户输入的第八操作，所述第八操作用于启动第三功能；The first device detects an eighth operation input by the second user, and the eighth operation is used to start a third function;
    所述第一设备获取所述第一用户的状态；The first device obtains the status of the first user;
    在所述第一用户的状态为以下一项或多项的情况下：睡觉、离家、工作；When the state of the first user is one or more of the following: sleeping, leaving home, working;
    所述第一设备拒绝启动所述第三功能。The first device refuses to start the third function.
  15. 一种设备的控制方法，所述方法应用于包含智能门锁、第一设备和第二设备的通信系统；其特征在于，所述方法包括：A device control method, the method is applied to a communication system including a smart door lock, a first device, and a second device; it is characterized in that the method includes:
    所述智能门锁检测到第九操作，所述智能门锁开门；The smart door lock detects a ninth operation, and the smart door lock opens the door;
    在所述智能门锁和所述第一设备之间的距离逐渐变大时，所述智能门锁执行以下一项或多项：拒绝关门，输出用于提示用户携带所述第一设备的第五提示信息，或，触发所述第一设备和/或所述第二设备输出用于提示用户携带所述第一设备的第五提示信息。When the distance between the smart door lock and the first device gradually increases, the smart door lock performs one or more of the following: refuse to close the door, and output a second message for prompting the user to carry the first device Five prompt information, or trigger the first device and/or the second device to output fifth prompt information for prompting the user to carry the first device.
  16. 根据权利要求15所述的方法，其特征在于，所述智能门锁、第一设备和第二设备位于第一空间；所述方法还包括：The method according to claim 15, wherein the smart door lock, the first device and the second device are located in the first space; the method further comprises:
    在第四时间段，所述第一设备确定用户离开所述第一空间，用户在所述第四时间段将携带第一物品出行；In the fourth time period, the first device determines that the user leaves the first space, and the user will travel with the first item during the fourth time period;
    所述第一设备输出第六提示信息，所述第六提示信息用于提示用户携带所述第一物品。The first device outputs sixth prompt information, where the sixth prompt information is used to prompt the user to carry the first item.
  17. 根据权利要求15或16所述的方法，其特征在于，所述智能门锁、第一设备和第二设备位于第一空间，所述方法还包括：The method according to claim 15 or 16, wherein the smart door lock, the first device and the second device are located in the first space, and the method further comprises:
    在第五时间段，所述第一设备确定用户离开所述第一空间；在所述第五时间段内出现极端天气；During a fifth time period, the first device determines that the user leaves the first space; extreme weather occurs during the fifth time period;
    所述第一设备输出第七提示信息，所述第七提示信息用于提示用户携带防护用品。The first device outputs seventh prompt information, and the seventh prompt information is used to remind the user to carry protective equipment.
  18. 根据权利要求15-17任一项所述的方法，其特征在于，所述通信系统还包括车辆；所述方法还包括：The method according to any one of claims 15-17, wherein the communication system further comprises a vehicle; the method further comprises:
    所述车辆检测到第十操作，所述车辆的车门打开；The vehicle detects a tenth operation, and a door of the vehicle is opened;
    在所述第车门和所述第一设备之间的距离逐渐变大时，所述车辆执行以下一项或多项：拒绝关闭车门，输出用于提示用户携带所述第一设备的第八提示信息，或，触发所述第一设备和/或所述第二设备输出用于提示用户携带所述第一设备的第八提示信息。When the distance between the first vehicle door and the first device gradually increases, the vehicle performs one or more of the following: refuse to close the vehicle door, and output an eighth prompt for prompting the user to carry the first device information, or trigger the first device and/or the second device to output eighth prompt information for prompting the user to carry the first device.
  19. 根据权利要求15-18任一项所述的方法，其特征在于，所述通信系统还包括车辆；所述方法还包括：The method according to any one of claims 15-18, wherein the communication system further comprises a vehicle; the method further comprises:
    所述车辆检测到第十一操作，所述车辆锁门及锁窗；The vehicle detects an eleventh operation, and the vehicle locks doors and windows;
    所述车辆检测到所述车辆内有用户，所述车辆执行以下一项或多项：开窗、开门，输出用于提示所述车辆内还有用户的第九提示信息，或，触发所述第一设备和/或所述第二设备输出用于提示所述车辆内还有用户的第九提示信息。The vehicle detects that there is a user in the vehicle, and the vehicle performs one or more of the following: open the window, open the door, output ninth prompt information for prompting that there is a user in the vehicle, or trigger the The first device and/or the second device outputs ninth prompt information for prompting that there is still a user in the vehicle.
  20. 一种设备的控制方法，所述方法应用于包含第一设备、第二设备、车辆的通信系统；其特征在于，所述方法包括：A device control method, the method is applied to a communication system including a first device, a second device, and a vehicle; it is characterized in that the method includes:
    在第六时间段，所述第一设备执行第十二操作；用户在所述第六时间段将执行第一事件；In the sixth time period, the first device performs a twelfth operation; the user will perform the first event in the sixth time period;
    所述第十二操作包括以下任意一下或多项：The twelfth operation includes any one or more of the following:
    所述第一设备触发所述第三设备启动第五功能，所述第五功能支持用户执行所述第一事件；The first device triggers the third device to start a fifth function, and the fifth function supports the user to execute the first event;
    或者，所述第一设备触发所述车辆启动，车辆启动支持用户执行所述第一事件。Alternatively, the first device triggers the vehicle to start, and the vehicle starts to support the user to perform the first event.
  21. 一种电子设备，其特征在于，所述电子设备包括一个或多个处理器和一个或多个存储器；其中，所述一个或多个存储器与所述一个或多个处理器耦合，所述一个或多个存储器用于存储计算机程序代码，所述计算机程序代码包括计算机指令，当所述一个或多个处理器执行所述计算机指令时，使得所述电子设备执行如权利要求1-3中任一项所述的方法。An electronic device, characterized in that the electronic device includes one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more or a plurality of memories for storing computer program codes, the computer program codes comprising computer instructions, which, when the one or more processors execute the computer instructions, cause the electronic device to perform any of claims 1-3 one of the methods described.
  22. 一种包含指令的计算机程序产品，其特征在于，当所述计算机程序产品在电子设备上运行时，使得所述电子设备执行如权利要求1-3中任一项所述的方法。A computer program product containing instructions, characterized in that, when the computer program product is run on an electronic device, the electronic device is made to execute the method according to any one of claims 1-3.
  23. 一种计算机可读存储介质，包括指令，其特征在于，当所述指令在电子设备上运行时，使得所述电子设备执行如权利要求1-3中任一项所述的方法。A computer-readable storage medium, comprising instructions, wherein when the instructions are run on an electronic device, the electronic device is made to execute the method according to any one of claims 1-3.
  24. 一种通信系统，其特征在于，所述通信系统包括第一电子设备、第二电子设备，所述第一电子设备用于执行如权利要求1-3中任一项所述的方法。A communication system, characterized in that the communication system includes a first electronic device and a second electronic device, and the first electronic device is configured to execute the method according to any one of claims 1-3.
PCT/CN2022/119115 2021-09-27 2022-09-15 Home appliance control method, related apparatus, and system WO2023045830A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111137777.9A CN115877723A (en) 2021-09-27 2021-09-27 Home device control method, related device and system
CN202111137777.9 2021-09-27

Publications (1)

Publication Number Publication Date
WO2023045830A1 true WO2023045830A1 (en) 2023-03-30

Family

ID=85720046

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/119115 WO2023045830A1 (en) 2021-09-27 2022-09-15 Home appliance control method, related apparatus, and system

Country Status (2)

Country Link
CN (1) CN115877723A (en)
WO (1) WO2023045830A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106302036A (en) * 2015-06-09 2017-01-04 中兴通讯股份有限公司 A kind of method and apparatus controlling home gateway
CN107171872A (en) * 2017-07-19 2017-09-15 上海百芝龙网络科技有限公司 A kind of user's behavior prediction method in smart home
US20180048940A1 (en) * 2016-08-15 2018-02-15 Rovi Guides, Inc. Systems and methods for using a home security system to alert a user about a media event
CN108986401A (en) * 2018-10-15 2018-12-11 赛米奇创新科技(广州)有限公司 A kind of donning system and control method based on fence
CN110058899A (en) * 2019-03-30 2019-07-26 惠州市惠泽电器有限公司 Autonomous unlocking type Anti-addiction method based on smartwatch
CN112767939A (en) * 2021-02-01 2021-05-07 邵阳学院 Intelligent device awakening method and device, computer device and storage medium
CN113129476A (en) * 2019-12-27 2021-07-16 佛山市云米电器科技有限公司 Intelligent door lock control method, intelligent door lock and computer readable storage medium
CN113314118A (en) * 2021-06-30 2021-08-27 杭州老板电器股份有限公司 Voice control method, device and equipment of intelligent terminal

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106302036A (en) * 2015-06-09 2017-01-04 中兴通讯股份有限公司 A kind of method and apparatus controlling home gateway
US20180048940A1 (en) * 2016-08-15 2018-02-15 Rovi Guides, Inc. Systems and methods for using a home security system to alert a user about a media event
CN107171872A (en) * 2017-07-19 2017-09-15 上海百芝龙网络科技有限公司 A kind of user's behavior prediction method in smart home
CN108986401A (en) * 2018-10-15 2018-12-11 赛米奇创新科技(广州)有限公司 A kind of donning system and control method based on fence
CN110058899A (en) * 2019-03-30 2019-07-26 惠州市惠泽电器有限公司 Autonomous unlocking type Anti-addiction method based on smartwatch
CN113129476A (en) * 2019-12-27 2021-07-16 佛山市云米电器科技有限公司 Intelligent door lock control method, intelligent door lock and computer readable storage medium
CN112767939A (en) * 2021-02-01 2021-05-07 邵阳学院 Intelligent device awakening method and device, computer device and storage medium
CN113314118A (en) * 2021-06-30 2021-08-27 杭州老板电器股份有限公司 Voice control method, device and equipment of intelligent terminal

Also Published As

Publication number Publication date
CN115877723A (en) 2023-03-31

Similar Documents

Publication Publication Date Title
US11287150B2 (en) Device control system
CN109445288B (en) Implementation method for popularization and application of smart home
de Barbaro Automated sensing of daily activity: A new lens into development
Greenfield Everyware: The dawning age of ubiquitous computing
Procter et al. The day-to-day co-production of ageing in place
US20180268735A1 (en) Mobile terminal-based life coaching method, mobile terminal, and computer-readable recording medium, onto which method is recorded
Burdon Digital data collection and information privacy law
CN104126315A (en) Mobile device parental control
CN106453481A (en) Electronic device and method for providing service in the electronic device
CN108351892A (en) Electronic device for providing object recommendation and method
CN108460261A (en) Method for managing content and its electronic equipment
Langheinrich et al. Privacy in mobile and pervasive computing
Park et al. Self‐Organizing Wearable Device Platform for Assisting and Reminding Humans in Real Time
Könings User-centered awareness and control of privacy in Ubiquitous Computing
WO2023046132A1 (en) Health management method, related apparatus, and communication system
WO2023045830A1 (en) Home appliance control method, related apparatus, and system
Briggs et al. M-health review: joining up healthcare in a wireless world
Wang et al. The Future Home in the 5G Era: Next Generation Strategies for Hyper-connected Living
Gong Configurable Dynamic Privacy for Pervasive Sensor Networks
Curran Innovative applications of ambient intelligence: advances in smart systems: advances in smart systems
Kosta et al. Ethical-legal challenges in user-centric AmI services
Savani A Communication System Architecture for Smart Homes Based on Internet of Things
Zhang Designing Usafe: An Analysis System that Tracks Unusual Behavioural Patterns to Support Elderly People Living Safely at Home Alone
Hsu et al. Smart object reminders with RFID and mobile technologies
Trivedi Simulated Study Platform To Test Smart Home Technologies For Older Adults

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22871877

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE