WO2024012413A1 - 显示控制方法、电子设备及计算机可读存储介质 - Google Patents

显示控制方法、电子设备及计算机可读存储介质 Download PDF

Info

Publication number
WO2024012413A1
WO2024012413A1 PCT/CN2023/106604 CN2023106604W WO2024012413A1 WO 2024012413 A1 WO2024012413 A1 WO 2024012413A1 CN 2023106604 W CN2023106604 W CN 2023106604W WO 2024012413 A1 WO2024012413 A1 WO 2024012413A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
electronic device
central control
control device
data
Prior art date
Application number
PCT/CN2023/106604
Other languages
English (en)
French (fr)
Inventor
张程蛟
孙继强
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2024012413A1 publication Critical patent/WO2024012413A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/2816Controlling appliance services of a home automation network by calling their functionalities
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]

Definitions

  • the present invention relates to the field of smart home technology, and in particular to a display control method, electronic equipment and a computer-readable storage medium.
  • the desktop provided by the central control screen to implement the above control functions can also be called a Super Launcher.
  • the current central control screen cannot flexibly switch the desktop display style to adapt to the preferences and usage habits of different users.
  • Embodiments of the present application provide a display control method, electronic equipment, and computer-readable storage media. Based on the scheme of the present application, users can use any central control device in the home environment with a personality that conforms to the user's preferences or usage habits. Transforming the desktop for control operations will help improve the user experience.
  • embodiments of the present application provide a display control method applied to a smart home system.
  • the smart home system includes a first electronic device and a second electronic device with a screen.
  • the method includes: the first electronic device controls the current The first user identifies; the first electronic device obtains the first display data corresponding to the first user from the second electronic device according to the identification result, and displays the first control interface based on the first display data, where the first display data is the same as the first display data.
  • a user's usage data of a second electronic device is associated.
  • the first electronic device when it recognizes the identity of the first user currently using the electronic device, it can display a control interface matching the user's identity.
  • the first electronic device and the second electronic device may be, for example, a central control device such as a central control screen in a smart home system.
  • the second electronic device may be the user's commonly used central control device.
  • the central control device 100-1 described in the following detailed description.
  • the first electronic device may be the central control device that the user currently needs to use.
  • the central control device 100-2 is described.
  • the first display data obtained by the first electronic device corresponding to the recognized first user is the display data generated by the central control device commonly used by the user, that is, the display data generated by the second electronic device.
  • the above-mentioned first display data is related to the usage data of the second electronic device by the first user.
  • the commonly used central control device adjusts the control interface corresponding to the user according to the corresponding usage data such as the user's usage habits or the user's setting operations. Display styles and generate corresponding display data.
  • the process of the first electronic device obtaining the first display data from the second electronic device may include the first electronic device directly obtaining the first display data from the second electronic device; it may also include the first electronic device obtaining the first display data from the cloud or server. Obtaining the first display data uploaded by the second electronic device is not limited here.
  • the first control interface includes a plurality of controls, and the controls are used to control smart home devices in the smart home system.
  • the user can control the smart home equipment in the smart home system through the control interface displayed on the first electronic device.
  • the smart home system further includes a third electronic device with a screen
  • the above method further includes: the first electronic device identifies the current second user; The recognition result obtains second display data corresponding to the second user from the third electronic device, and displays the second control interface based on the second display data, wherein the second display data is related to the second user's usage data of the third electronic device.
  • the first electronic device when it recognizes the second user currently using the first electronic device, it can display a control interface matching the identity of the second user.
  • the control interface for displaying the first user's matching, which will not be described again here.
  • the first electronic device obtains the first display data corresponding to the first user from the second electronic device according to the recognition result, including: obtaining the first display data used to identify the first user. user data; based on the first association relationship between the first user data and the second electronic device, determining the device information of the second electronic device; based on the device information of the second electronic device
  • the device sends a data acquisition request to obtain the first display data.
  • the first electronic device can use the acquired first user data to find the association between the first user data and the second electronic device, and then determine the device information of the second electronic device that can provide the first display data. Then the first electronic device can request the second electronic device to obtain the first display data.
  • the first electronic device can also send the obtained first user data to the cloud or server, so as to match the first display data uploaded by the second electronic device in the cloud or server, and then obtain the first user data in the cloud or server.
  • the first display data returned by the server There are no restrictions here.
  • the first electronic device obtains the first user data in the following manner: detecting user interaction and collecting the first user data of the first user; or receiving the first user data from the third electronic device. 1. User data.
  • detecting user interaction includes any of the following situations: detecting the user's approach; detecting the user's touch operation on the screen of the first electronic device; detecting the user's touch operation on the screen of the first electronic device. A pressing operation of a button on the first electronic device.
  • the first user data includes: any one of face recognition data, fingerprint recognition data, and voiceprint recognition data.
  • the first user data may be, for example, the collected face information, fingerprint information, or voiceprint information of the user.
  • determining the device information of the second electronic device based on the first association relationship between the first user data and the second electronic device includes: based on pre-obtaining from the second electronic device The first association relationship determines the device information of the second electronic device.
  • the manner in which the second electronic device generates the first association relationship includes any of the following: based on the detected operation of the first user inputting the first user data, and converting the first user data into the first user data.
  • the operation of the two electronic devices as common devices associated with the first user generates a first association relationship; the first association relationship is generated based on the frequency of use of the second electronic device by the first user; and the first association relationship is generated based on the location of the first user and the second electronic device.
  • the statistical duration of the location of the electronic device being in the first space generates a first association relationship, in which the location of the first user is determined through the location data collected by the fourth electronic device.
  • the above-mentioned second electronic device is the user's commonly used central control device.
  • the central control device detects that the user has registered identity information on the central control device and operates to set the central control device as a commonly used central control device, Establish an association with this user.
  • the central control device recognizes that the user uses the central control device the most frequently, or the user and the central control device have been in the same room for the longest time, etc., and establishes an association with the user as the user's common use Central control equipment.
  • association between the user and the commonly used central control device can also be established in other ways, which is not limited here.
  • the way for the first electronic device to pre-acquire the first association relationship from the second electronic device includes: the first electronic device receives the second synchronized synchronized information of the second electronic device through an open Internet of Things communication protocol. An association relationship; or, the first electronic device sends an acquisition request to the second electronic device through the open Internet of Things communication protocol, and receives the first association relationship returned by the second electronic device in response to the acquisition request.
  • the open IoT communication protocol is the HiLink communication protocol.
  • the first electronic device and the second electronic device can synchronize the association relationship between the user and the commonly used devices through the Hilink channel, that is, the above-mentioned first association relationship.
  • the communication method for synchronizing the association relationship between the first electronic device and the second electronic device can also be other methods, which are not limited here.
  • the second electronic device includes a second control interface
  • the first user's usage data of the second electronic device includes at least one of the following: obtained according to the first user's operating habits. Data; or, data obtained according to the first user's adjustment operation on the display content of the second control interface.
  • the method further includes: before the first electronic device displays the first control interface based on the first display data, the first electronic device displays a third control interface; based on the first display data Displaying the first control interface includes: switching and displaying the third control interface as the first control interface based on the first display data.
  • the first electronic device is the central control device currently used by the user.
  • the central control device can display the default desktop, that is, the above-mentioned third control interface.
  • the default desktop can be displayed if the screen needs to be turned on.
  • the central control device recognizes the identity of the user currently using the device, the displayed third control interface can be switched to the first control interface matching the user.
  • the first electronic device and the second electronic device are based on WiFi, Bluetooth or distributed Any one of the soft buses establishes a data transmission channel, and the data transmission channel is used to transmit the first display data from the second electronic device to the first electronic device.
  • the first control interface is an interface of a desktop application
  • the first display data includes at least one of the following: application data of the desktop application, a first application that interacts with the desktop application The application data, and the device data of the smart home device controlled by the controls on the first control interface.
  • the personalized desktop displayed after the central control screen recognizes the user's identity can be the above-mentioned first control interface.
  • inventions of the present application provide a display control method applied to a smart home system.
  • the smart home system includes a first electronic device and a second electronic device with a screen.
  • the method includes: the second electronic device receives the first The electronic device obtains the first display data request, wherein the first display data is used to display the first control interface of the first electronic device, and the first display data is generated by the second electronic device according to the first user's use of the second electronic device. Data generation; in response to the acquisition request, the second electronic device sends the first display data to the first electronic device.
  • the second electronic device includes a second control interface
  • the usage data of the second electronic device includes: data obtained by the second electronic device based on the first user's operating habits; or, Data obtained by the second electronic device based on the user's adjustment operation on the display content of the second control interface.
  • embodiments of the present application provide an electronic device, including: one or more processors; one or more memories; one or more memories store one or more programs. When one or more programs are When one or more processors are executed, the electronic device is caused to execute the display control method provided by the above-mentioned first aspect or execute the display control method provided by the above-mentioned second aspect.
  • embodiments of the present application provide a computer-readable storage medium. Instructions are stored on the storage medium. When the instructions are executed on a computer, they cause the computer to execute the display control method provided in the first aspect, or to execute the second aspect. Provided display control methods.
  • embodiments of the present application provide a computer program product, which includes a computer program/instruction.
  • the computer program/instruction When executed by a processor, the computer program/instruction implements the display control method provided in the first aspect or the second aspect.
  • Figure 1 shows a schematic diagram of a smart home scenario.
  • Figure 2a shows a schematic diagram of a central control device according to an embodiment of the present application that wakes up the screen to display a desktop that is displayed by default when it detects that a user is approaching.
  • Figure 2b shows a schematic diagram of a personalized desktop corresponding to the user that is displayed after the central control device according to the embodiment of the present application recognizes the user's identity when waking up the screen.
  • Figure 3 shows a schematic structural diagram of a central control device provided by an embodiment of the present application.
  • Figure 4 shows a schematic block diagram of the operating system architecture of a central control device provided by an embodiment of the present application.
  • Figure 5 shows a schematic diagram of the display data flow process between central control devices in a smart home scenario provided by an embodiment of the present application.
  • FIG. 6 shows a schematic flowchart of an implementation flow of a display control method provided by an embodiment of the present application.
  • Figure 7a shows a schematic diagram of a personalized desktop style provided by an embodiment of the present application.
  • Figure 7b shows a schematic diagram of another personalized desktop style provided by an embodiment of the present application.
  • FIG. 8 is a schematic flowchart of an implementation process for a user to register user identity information on a commonly used central control device and set a commonly used central control device associated with the user's identity information according to an embodiment of the present application.
  • Figure 9 shows a schematic diagram of the association between family member sub-accounts, user-registered face data, and commonly used central control devices provided by the embodiment of this application.
  • Figure 10 shows an interactive flow diagram of a display control method provided by an embodiment of the present application.
  • Figure 1 shows a schematic diagram of a smart home scenario according to an embodiment of the present application.
  • the smart home scene 10 includes multiple central control screens, such as central control screens 100-1, 100-2, 100-3, 100-4 and 100-5 in each space shown in Figure 1.
  • users can not only operate the central control screen in their regular activity space, such as the central control screen 100-1, but also operate the central control screen in other spaces, such as the central control screen 100-2.
  • the current central control screen can only display a local universal desktop when it detects that a user is approaching, and cannot display matching personalized desktops based on different users' preferences or usage habits.
  • embodiments of the present application provide a A display control method applied to smart home scenarios.
  • the above-mentioned electronic device that performs the central control function is hereinafter referred to as the central control device, such as the central control screen in the scene shown in Figure 1 above.
  • this method pre-stores the association between the user identity information and the corresponding commonly used central control devices in each central control device.
  • commonly used central control devices can store the personal display data set by the user.
  • the current central control device begins to identify the user's identity information when it detects user interaction.
  • the user interaction may be, for example, the user approaching the current central control device or the user touching the current central control device.
  • the wake-up operation of controlling the device screen, etc. is not limited here.
  • the current central control device can obtain the display data on the commonly used central control devices corresponding to the recognized user identity information based on the association between the stored user identity information and the corresponding commonly used central control devices, and display the data in line with the user's preferences or usage. Customized desktop.
  • users can use a personalized desktop that meets the user's preferences or usage habits to control operations on any central control device in the home environment, and the user experience is therefore improved.
  • the association between user identity information and corresponding commonly used central control devices can be stored in each central control device.
  • the current method for the central control device to obtain display data on commonly used central control devices corresponding to the identified user identity information may include: the current central control device may determine the user's identity information from its own stored association relationship.
  • the user's identity information corresponds to the device information of the commonly used central control device, and a request for obtaining display data is sent to the corresponding commonly used central control device, and the corresponding commonly used central control device returns corresponding display data based on the request.
  • the current central control device can also receive notifications and user identity information from other electronic devices in the home environment, and then obtain display data that matches the received user identity information, and display the corresponding personalized desktop.
  • the above notification and user identity information may be information sent by other electronic devices when they are close to the current central control device and recognize the user's identity. For example, when a smart watch worn by a user detects that the user is approaching the current central control device, it can send a notification of the user's approach and the user's identity information to the current central control device.
  • the association between user identity information and corresponding commonly used central control devices may be stored in a central device connected to each central control device or stored in the cloud in advance.
  • the current central control device can send the user's identity information to the central device or the cloud after identifying the user's identity information.
  • the central device or the cloud determines the device information of the commonly used central control devices corresponding to the user's identity information and returns it to the current central control device.
  • the central control device, and then the current central control device sends a request to obtain the display data to the corresponding common central control device, and the corresponding common central control device returns the corresponding display data based on the request.
  • the association between the user identity information and the corresponding commonly used central control devices, as well as the personalized desktop display data set by the user on the commonly used central control devices, are stored in the cloud.
  • the current central control device can send the user's identity information to the cloud after identifying the user's identity information.
  • the cloud directly calls the display data of the commonly used central control devices corresponding to the user's identity information according to the stored association relationship and sends it to the current central control device for use. .
  • the association relationships and display data pre-stored in the cloud can be encrypted accordingly, and there are no restrictions here.
  • the current central control device can quickly obtain the display data on the commonly used central control device corresponding to the user's identity information in other ways, which are not limited here.
  • the above-mentioned identity information includes but is not limited to face data, fingerprint data, voiceprint data, etc., and is not limited here.
  • the above display data is the display data generated corresponding to the personalized desktop style set by users on commonly used central control devices, including but not limited to the desktop application (Launcher) data of commonly used central control devices and the data displayed in each card window of the desktop application.
  • the system application can be, for example, a settings application.
  • a data flow channel can be established between various central control devices in a smart home scene to facilitate the transmission of relevant requests for display data or obtaining corresponding display data, and so on.
  • the data flow channel can be a flow channel established based on the same connected wireless LAN, such as a near-field data transmission channel based on WiFi, Bluetooth, ZigBee or distributed soft bus, etc. There are no restrictions here. In this way, personalized desktop display data generated based on user settings can only be transferred between central control devices in the home environment, which is conducive to protecting user privacy data.
  • the data flow channel can also be established based on wireless networks and clouds.
  • display data on commonly used central control devices can be transmitted to the cloud through wireless local area networks or mobile data communication networks.
  • the central control devices are in The display data is obtained from the cloud when the user's identity is recognized. In this way, the transmission of display data is not limited to wireless local area networks, and the display control method provided by the embodiments of the present application can also have greater adaptability to network scenarios.
  • Figure 2a shows a schematic diagram of a control interface in which a central control device wakes up the screen to display a default display when it detects that a user is approaching.
  • the central control device 100-2 shown in FIG. 2a may be the current central control device mentioned above, that is, the current central control device with which the user currently interacts.
  • the central control device 100-2 when the central control device 100-2 detects that the user is approaching, it can wake up the screen to display the control interface 210 shown in Figure 2a.
  • the control interface 210 has many icons, and the function introduction corresponding to each icon has a moderate font size. More in line with public usage habits. However, if the user operating the central control device 100-2 at this time is an elderly person at home, the function introduction of each icon may not be clear.
  • Figure 2b shows a schematic diagram of a personalized desktop corresponding to the user displayed after the central control device recognizes the user's identity when waking up the screen according to an embodiment of the present application.
  • the personalized desktop may be, for example, a simple mode desktop 220 that is in line with the usage habits of the elderly.
  • the font size displayed on the desktop 220 is larger, the function controls are fewer, and the layout is more convenient for the elderly to use.
  • the personalized desktop shown in Figure 2b can also be in other styles that conform to the preferences of other users, and there is no limitation here.
  • the user is an elderly person at home
  • the user's commonly used central control device is the central control device 100-1 located in the bedroom
  • the personalized desktop of the central control device 100-1 is set to comply with Simple mode desktop used by the elderly. If the user walks from the bedroom to the living room and wants to drink water, he can approach the central control device 100-2 located in the living room. When the central control device 100-2 detects that the user is approaching, it can wake up the screen and identify the user through face recognition or fingerprint recognition.
  • the central control device 100-2 When the central control device 100-2 confirms that the user is an elderly person at home, it can obtain the display data of the simple mode desktop that conforms to the usage habits of the elderly person from the central control device 100-1, and then display the simple mode desktop 220 shown in Figure 2b. , the user can click "One-click hot water" displayed in large text on the desktop 220 to satisfy his/her drinking water needs.
  • the above simple mode desktop 220 is the control interface displayed when the central control device 100-2 recognizes the identity information of the elderly person at home, it is recorded as the first control interface.
  • the central control device 100-2 recognizes the identity of another user, for example, when it recognizes the identity information of a child at home, it can also display a control interface set corresponding to the child, which can be recorded as a second control interface.
  • the default desktop shown in FIG. 2a may be displayed, for example, recorded as the third control interface. .
  • the process of displaying the first control interface when the above-mentioned central control device 100-2 recognizes the identity information of the elderly person at home is a process of switching from displaying the third control interface to displaying the first control interface.
  • the process of displaying the second control interface is a process of switching from displaying the third control interface to displaying the second control interface.
  • the interface prompt information 221 may also be displayed on the simple mode desktop 220 displayed by the central control device 100-2, such as "The owner's identity has been recognized and the user has entered the simple mode" as shown in Figure 2b. It can be understood that based on the display control method provided by the embodiments of the present application, whether it is an elderly person or other users at home, on any central control device in the home environment, they can use a desktop that meets the personalized needs of the corresponding user to control home equipment. Control operations, such as clicking the "Whole House Dehumidification" function shown in Figure 2b to turn on the home air conditioner for dehumidification, etc., provide an excellent user experience.
  • the display control method provided by the embodiments of the present application is applicable to electronic devices (i.e., the above-mentioned central control device), which may include but are not limited to mobile phones, tablet computers, desktops, laptops, handheld computers, netbooks, and enhanced Augmentedreality (AR) ⁇ virtual reality (VR) equipment, smart TVs, smart watches and other wearable devices, car equipment, portable game consoles, portable music players, reader devices, which are embedded or coupled with A television with one or more processors, or other electronic device capable of accessing a network.
  • electronic devices i.e., the above-mentioned central control device
  • electronic devices i.e., the above-mentioned central control device
  • AR Augmentedreality
  • VR virtual reality
  • smart TVs smart watches and other wearable devices
  • car equipment portable game consoles
  • portable music players portable music players
  • reader devices which are embedded or coupled with A television with one or more processors, or other electronic device capable of accessing a network.
  • Figure 3 shows a schematic structural diagram of a central control device 100 according to an embodiment of the present application.
  • the central control device 100 may include a processor 110, an external memory interface 120, an internal memory 130, a power management module 140, a wireless communication module 150, a display screen 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, and a headphone interface 170D.
  • Sensor module 180 button 190, motor 191, indicator 192, camera 193, etc.
  • the sensor module 180 may include a pressure sensor 180A, an air pressure sensor 180B, a distance sensor 180C, a proximity light sensor 180D, a fingerprint sensor 180E, a temperature sensor 180F, a touch sensor 180G, an ambient light sensor 180H, etc.
  • the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the central control device 100.
  • the central control device 100 may include more or fewer components than shown in the figures, or combine some components, or split some components, or arrange different components.
  • the components illustrated may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit
  • the controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.
  • the processor 110 can control the fetching and execution of instructions through the controller to implement the display control method provided by the embodiment of the present application.
  • the processor 110 may also be provided with a memory for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instruction or data again, it can be directly called from the above-mentioned memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.
  • processor 110 may include one or more interfaces.
  • Interfaces may include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver and transmitter (universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • UART universal asynchronous receiver and transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • the interface connection relationships between the modules illustrated in the embodiment of the present invention are only schematic illustrations and do not constitute a structural limitation on the central control device 100 .
  • the central control device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
  • the power management module 140 is connected to the processor 110, etc., and is used to manage power supply for the processor 110, the internal memory 130, the display screen 160, the camera 193, the wireless communication module 150, etc. In some other embodiments, the power management module 141 may also be provided in the processor 110 .
  • the wireless communication function of the central control device 100 can be realized through the antenna and the wireless communication module 150.
  • Antennas are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the central control device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.
  • the wireless communication module 150 can provide wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), and global navigation that are used on the central control device 100.
  • WLAN wireless local area networks
  • BT Bluetooth
  • Global navigation Global navigation satellite system
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication technology
  • infrared infrared
  • IR infrared
  • the antenna of the central control device 100 is coupled with the wireless communication module 150 so that the central control device 100 can communicate with other devices through the wireless communication network.
  • the central control device 100 implements the display function through the GPU, the display screen 160, and the application processor.
  • the GPU is an image processing microprocessor and is connected to the display screen 160 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 160 is used to display images, videos, etc.
  • Display 160 includes a display panel.
  • the central control device 100 can realize the function of collecting the user's face information for confirming the user's identity through the ISP, camera 193, application processor, etc., which is not limited here.
  • the ISP can be used to process the data fed back by the camera 193.
  • Camera 193 is used to capture still images or video.
  • the object passes through the lens to produce an optical image that is projected onto the photosensitive element.
  • the photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to convert it into a digital image signal.
  • ISP outputs digital image signals to DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other format image signals.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage of the central control device 100 ability.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function.
  • Internal memory 130 may be used to store computer executable program code, which includes instructions.
  • the internal memory 130 may include a program storage area and a data storage area.
  • the stored program area can store the operating system, at least one application program required for the function, etc.
  • the storage data area can store application data generated during use of the central control device 100, such as desktop application data and other application data displayed on the desktop application interface.
  • the application program stored in the stored program area may be, for example, a desktop application (Launcher) used to manage and control various smart devices in the home environment
  • the data stored in the data stored area may be, for example, the central control device 100 running
  • the internal memory 130 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
  • the processor 110 executes various functional applications and data processing of the central control device 100 by executing instructions stored in the internal memory 130 and/or instructions stored in a memory provided in the processor.
  • the processor 110 of the central control device 100 can run the relevant instructions stored in the internal memory 130 for executing each step of the implementation process of the display control method described below to realize switching of the user's personalized desktop. show.
  • the central control device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. For example, functions such as recording and voiceprint recognition.
  • the fingerprint sensor 180E is used to collect fingerprints.
  • the central control device 100 can use the collected fingerprint characteristics to compare with registered user identity information to identify the user's identity.
  • the central control device 100 can measure distance through infrared or laser. In some embodiments of the present application, the central control device 100 can use the distance sensor 180C to measure distance to detect the user's approach or distance, and then determine whether it is necessary to wake up the screen, collect the user's face information, etc. for identity recognition and display corresponding to the identified The user's personalized desktop.
  • the buttons 190 include a power button, a volume button, etc.
  • Key 190 may be a mechanical key. It can also be a touch button.
  • the central control device 100 can receive key input and generate key signal input related to user settings and function control of the central control device 100 .
  • the motor 191 can generate vibration prompts.
  • the indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, or may be used to indicate messages, missed calls, notifications, etc.
  • FIG. 4 shows a schematic block diagram of the operating system architecture of a central control device 100 according to an embodiment of the present application.
  • the central control device 100 can be installed with a distributed operating system, such as Harmony OS TM , or an operating system such as Android TM system, which is not limited here. It can be understood that in a smart home scenario, there can be multiple central control devices 100 , and distributed interaction between each central control device 100 can be realized based on the installed distributed operating system.
  • the following takes the central control device 100-1 and the central control device 100-2 shown in Figure 4 as an example to briefly introduce the distributed operating system used by the central control device 100.
  • the central control device 100-1 may be a common central control device commonly used by the above-mentioned user
  • the central control device 100-2 may be the second electronic device currently used by the above-mentioned user.
  • the distributed operating systems installed on the central control device 100-1 and the central control device 100-2 adopt a layered architecture.
  • the layered architecture divides the distributed operating system into several layers, and each layer has clear roles and division of labor.
  • the layers communicate through software interfaces.
  • the distributed operating system is divided into four layers, from top to bottom: application layer, application framework layer, system service layer and kernel layer.
  • the distributed operating system can also be divided into other numbers of hierarchical structures, which are not limited here.
  • the application layer can include a series of application packages.
  • the application package can include applications such as desktop (Launcher), settings, and music.
  • applications such as desktop (Launcher), settings, and music.
  • it can also include calendar, WLAN, Bluetooth, camera, gallery, call, map, video, etc., which are not limited here.
  • the application layer can also include some functional software development kits (SDK), such as the information hub SDK, which is used to store and manage some device static information, such as member account information and registration information logged in by users on the central control device.
  • SDK software development kits
  • User identity information and associating the user identity information with the device information of the central control device to set the central control device to the association information of the user's commonly used devices, etc.
  • the desktop (Launcher) application can display a corresponding personalized desktop in response to the user's setting operation.
  • the user's setting operations may include, for example, operations such as setting personalized wallpapers, large fonts, subscribing to Feature Ability (FA) cards for receiving express delivery, and FA cards for private devices in the user's own room.
  • the FA card displayed on the desktop/desktop corresponds to the status of the device and needs to be provided by the corresponding device or application.
  • the logistics status corresponding to the express FA card can be provided by the application data of the corresponding shopping APP, and the ambient air humidity detected by the FA card of a personal device such as a humidifier can be provided by the associated humidifier, etc.
  • the application framework layer provides distributed framework and light device proxy services for the application layer.
  • the distributed framework includes remote installation, remote startup, migration management, remote invocation, distributed system service management, FA association management and other functional frameworks for realizing interoperability within the system and between systems (including startup, calling, migration).
  • the application programming interface (API) corresponding to each framework.
  • the light device agent service can provide light device hosting services, master-slave service calling agents, etc., where the light device in HarmonyOS refers to a device with a screen.
  • the light device agent hosted by the light device agent service is, for example, It can be home smart devices such as electric water heaters, air conditioners, sweeping robots, and humidifiers in smart home environments, as well as wearable devices such as smart glasses.
  • the system service layer is the core of the distributed operating system.
  • the system service layer provides services to the applications and SDK in the application layer through the application framework layer.
  • the system service layer includes Hilink communication components, distributed data management, distributed soft bus, etc.
  • the Hilink communication component is used to establish a communication channel between the central control device 100-1 and the central control device 100-2 to synchronize some device static information.
  • the device static information includes user identity information registered through each central control device, user The relationship between identity information and device ID, as well as the related information of home equipment managed by each central control device, etc.
  • the above device static information of each central control device can be synchronized based on the Hilink channel provided by the Hilink communication component.
  • the distributed soft bus as an example structure of the underlying network, is used to transmit display data that flows between the user's commonly used central control equipment and the user's currently used central control equipment, that is, to realize Harmony distributed flow. .
  • the distributed soft bus is used in 1+8+N devices (1 is a mobile phone; 8 represents a car, a speaker, a headset, a watch, a bracelet, a tablet, a large screen, a personal computer (PC), an augmented reality ( Augmented Reality (AR), Virtual Reality (VR); N generally refers to other Internet of Things (Internet of Things, IOT) devices) to build an "invisible" bus between them, which has automatic discovery, ready-to-use, Ad hoc network (heterogeneous network networking), high bandwidth, low latency, high reliability and other characteristics.
  • IOT Internet of Things
  • the above-mentioned central control devices can not only share all data, but also achieve instant interconnection with any device on the same local area network or connected to it through Bluetooth.
  • the distributed soft bus can also share files between heterogeneous networks such as Bluetooth and Wireless-Fidelity (Wireless-Fidelity, WiFi) (for example, receiving files through Bluetooth on the one hand, and transmitting files through WiFi on the other hand).
  • Bluetooth Wireless-Fidelity
  • WiFi Wireless-Fidelity
  • the kernel layer is the layer between hardware and software.
  • the kernel layer of a distributed operating system includes: kernel subsystem and driver subsystem.
  • the kernel subsystem can adopt a multi-core design between distributed operating systems. Therefore, the kernel subsystem supports the selection of suitable OS kernels for different resource-limited devices. For example, in the embodiment of this application, Lite OS can be selected for central control devices. .
  • Kernel Abstract Layer on the kernel subsystem provides basic kernel capabilities to the upper layer by shielding multi-core differences, including process/thread management, memory management, file system, network management, and peripheral management.
  • the driver framework provided by the driver subsystem is the basis for the openness of the distributed system hardware ecosystem, providing unified peripheral access capabilities and driver development and management frameworks.
  • the kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
  • Figure 5 shows a schematic diagram of the display data flow process between central control devices in a smart home scenario according to an embodiment of the present application. .
  • the smart home scenario includes central control device 100-1, central control device 100-2, and central control device 100-3.
  • the central control device 100-1 can be a common central control device commonly used by the above-mentioned users
  • the central control device 100-2 can be the second electronic device currently used by the above-mentioned users
  • the central control device 100-3 can be a central control device commonly used by other users. control equipment.
  • Each central control device includes at least the following functional modules:
  • the proximity interaction module can be implemented based on a distance sensor to detect the user's approach and then wake up the central control device to display the desktop, that is, the control interface.
  • the face recognition module can be implemented based on the camera and the corresponding image processor (such as ISP). It is used to collect the user's face information as user identity information when the user registers a commonly used central control device, and is used to collect when the central control device wakes up. User face information is used to identify and verify the user's identity.
  • ISP image processor
  • the user synchronizes and stores static device information such as user identity information, association information binding the user to the corresponding central control device, etc.
  • the central control device can recognize the user's identity based on pre-obtained or stored information.
  • the above static device information determines the device information of the target central control device, such as the device ID, and then the current central control device or the desktop (Launcher) application on the current central control device can send a request to obtain display data based on the target central control device ID.
  • the information center can realize the synchronization of static device information between various central control devices based on the Hilink channel provided by the Hilink communication module.
  • the request for obtaining display data sent by the current central control device based on the ID of the target central control device can be based on the distributed soft bus. The details of data channel transmission will be introduced in the relevant content of distributed databases below, and will not be described in detail here.
  • different users can establish associations with different central control devices in the home environment, for example, user A can register identity information through the central control device 100-1 in his room to establish an association with the central control device 100-1.
  • User B can also register identity information through the central control device 100-3 in his room to establish an association relationship, etc.
  • the central control device can also proactively establish an association with the identity information of the user with the highest frequency of use based on the frequency with which each user uses the central control device.
  • the central control device can also obtain the user's location through the user's handheld device, etc., and based on this statistics, the user's time in the room where the central control device is located can be actively established with users who often stay in the room where the central control device is located. , that is, actively associate the user's identity information. There are no restrictions here. The process of establishing an association between a specific user and the central control device will be described in detail below and will not be described in detail here.
  • Distributed database that is, an application database that can be shared by applications in each central control equipment system, is used to store desktop application data, other application data that displays corresponding status data on the desktop through interaction with desktop applications, and data reported by associated devices. Data etc.
  • the distributed database in the central control device may also be a database provided for desktop (Launcher) applications, which is not limited here.
  • the distributed database in the central control device can be implemented based on the distributed data management capability (i.e. DataAbility) provided by the Data template. This capability allows each application to manage access to its own and other applications' stored data, and provides communication with other applications. Ways to share data.
  • Data can be used for data sharing between different applications on the same device, and can also support data sharing between different applications across devices. It can be understood that the transmission of display data between central control devices can be implemented based on a distributed soft bus or other wireless communication technologies, and is not limited here.
  • the central control device 100-1 is a commonly used device of the user, for example, the central control device in the user's own room
  • the display data of the personalized desktop set by the user is stored on the device.
  • the central control device 100-2 can send a data acquisition request to the central control device 100-1 through a data transfer channel such as a distributed soft bus.
  • the central control device 100-1 can send the user's personalized desktop display data to the central control device 100-2 through the distributed soft bus based on the received request. Refer to the distributed soft bus-based implementation shown in Figure 5. Show the data transfer process.
  • the user's personalized desktop can be displayed on the central control device 100-2 in the living room.
  • the central control device 100-2 can further display the status of some public household equipment located in the living room, such as the water temperature and water quality of the water dispenser, for the user to choose and use. There are no restrictions here.
  • the display data flow between the central control device 100-1 and the central control device 100-2 can also be done in other ways.
  • the central control device 100-1 can also upload the display data to the cloud through a wireless LAN.
  • the central control device 100-2 can obtain the display data of the central control device 100-1 from the cloud. This application does not limit this.
  • FIG. 6 shows a schematic flowchart of the implementation of a display control method according to an embodiment of the present application. It can be understood that the execution subject of each step in the process shown in Figure 6 is the central control device currently operated by the user, which may be the above-mentioned central control device 100-2, for example. For the convenience of description, the execution subjects of the following steps will not be described repeatedly.
  • the process includes the following steps:
  • 601 User interaction is detected and user personal information to be identified is collected.
  • user interaction may be, for example, the user approaching the current central control device or the user touching the screen of the current central control device to wake up the device, etc., which are not limited here.
  • the central control device 100-2 can detect the approach of the user based on the distance sensor 180C, etc. At this time, the central control device 100-2 wakes up and can collect the personal information of the currently approaching user to identify the user's identity before displaying the desktop.
  • the user's personal information collected by the central control device 100-2 at this time can be any of the user's face information, fingerprint information, and voiceprint information.
  • the type of user personal information collected when the central control device 100-2 performs this step can be the same as the user's identity information registered on the commonly used central control device 100-1 and synchronized to the central control device 100-2. corresponding to the type.
  • the central control device 100-1 is, for example, a commonly used device of the user, for example, it can be the central control screen in the user's bedroom in the scene shown in Figure 1; and the central control device 100-2 can be the central control screen in other rooms in the home environment.
  • the control device may be, for example, the central control screen in the living room in the scene shown in Figure 1, and is not limited here.
  • the central control device 100-2 can collect the person of the user who is currently close to him when performing this step. Face information and extract facial features to match the user's registered face data to identify the user's identity. Similarly, if the user's identity information registered on the commonly used central control device 100-1 and synchronized to the central control device 100-2 is fingerprint information, the central control device 100-2 can collect the currently approaching user when performing this step. The fingerprint information is used to identify the user, which is not limited here.
  • step 602 Determine whether the collected user personal information matches user identity information. If the judgment result is yes, it means that the user has If the identity information has been registered on a commonly used central control device, the central control device 100-2 can further perform the judgment of step 603 below to determine the commonly used central control device information bound to the user; if the judgment result is no, it indicates that the user If the identity information has not been registered, the central control device 100-2 does not need to match the user's common device, and the following step 606 is performed to display the desktop based on local display data.
  • the central control device 100-2 can synchronize the collected user personal information, such as face information, with the information of each user that the central control device 100-2 synchronizes from other central control devices (such as the central control device 100-1). Compare the identity information. If the identity information that is the same as the user's personal information can be matched, it can be determined that the user is a user who has registered identity information on a commonly used central control device; if there is no identity information that matches the user's personal information. , it can be determined that the user has not registered a commonly used central control device. For example, the user may be a guest, and there is no restriction here.
  • the central control device 100-2 can obtain the bound central control device information, such as the device ID of the central control device 100-1 (device ID), and continue to perform the following step 604; if the judgment result is no, indicating that the user's identity information has not been bound to a commonly used central control device, then the central control device 100-2 can perform the following step 606, based on the local display Data display desktop.
  • the association between user identity information and corresponding commonly used central control devices can be stored in each central control device. Therefore, after the central control device 100-2 matches the registered user identity information based on the collected user personal information when performing the above steps, it can determine the central control device 100-2 corresponding to the user identity information from its stored association relationship. 1's device information, and sends a request to obtain display data to the central control device 100-1, and the corresponding central control device 100-1 returns corresponding display data based on the request.
  • the association between the user identity information and the corresponding commonly used central control devices can be stored in a central device connected to each central control device or stored in the cloud in advance.
  • the central device may be a specified electronic device in a smart home scenario.
  • the central control device 100-2 can send the user identity information to the central device or the cloud after identifying the user's identity information, and the central device or the cloud determines the device information of the central control device 100-1 corresponding to the user identity information. And returned to the central control device 100-2, and then the central control device 100-2 sends a request to obtain the display data to the corresponding central control device 100-1, and the corresponding central control device 100-1 returns the corresponding display data based on the request.
  • the association between the user identity information and the corresponding commonly used central control devices, as well as the personalized desktop display data set by the user on the commonly used central control devices, are stored in the cloud.
  • the central control device 100-2 can send the user identity information to the cloud after identifying the user's identity information.
  • the cloud directly calls the display data of the central control device 100-1 corresponding to the user identity information according to the stored association relationship and sends it to the central control device 100-2.
  • Control device 100-2 is used.
  • the association relationships and display data pre-stored in the cloud can be encrypted accordingly, and there are no restrictions here.
  • the central control device 100-2 can send a data acquisition request to the central control device 100-1 based on the device ID of the central control device 100-1, that is, a request to obtain corresponding display data of the personalized desktop.
  • the central control device 100-1 can respond to the acquisition request sent by the central control device 100-2 and send the locally stored personalized desktop display data that conforms to the user's preferences or usage habits to the central control device 100-2.
  • the data acquisition request sent by the central control device 100-2 to the central control device 100-1 can also be used to request the establishment of a display data flow channel with the central control device 100-1, so as to During the period of maintaining the circulation channel, personalized desktop display data is obtained from the central control device 100-1 in real time.
  • the central control device 100-2 can also obtain the user's usage data from the central control device 100-1 commonly used by the user.
  • the usage data includes data generated corresponding to the user's operating habits on the central control device 100-1; or , the data generated corresponding to the user's settings or adjustments to the desktop style of the central control device 100-1 are not limited here.
  • the above-mentioned central control device 100-1 sends personalized desktop display data to the central control device 100-2, and the display data transmission/flow can be realized through the data transfer channel, such as a distributed soft bus.
  • the transmission of display data can also be completed through other communication methods, which is not limited here.
  • the user can edit the display style of the desktop displayed by the commonly used central control device 100-1 according to his or her own preferences.
  • the editing operations performed by the user on the desktop of the commonly used central control device 100-1 may include: 1) Adjusting the order and position of the whole-house service cards displayed on the desktop.
  • the whole-house service cards may be, for example, whole-house constant temperature, whole-house dehumidification. , whole-house ventilation, etc.; 2) Add, delete and adjust the order of commonly used applications in the folder; 3) Set the desktop font size and dark and light color display modes, etc.; 4) Add subscribed official or third-party value-added services, such as by adding The FA card for the corresponding service is completed; 5) Set up frequently executed scenarios, add frequently controlled devices, etc. There are no restrictions here.
  • the central control device 100-1 can respond to these editing operations of the user, generate corresponding display data and save it to the local storage.
  • the local storage space may be, for example, the distributed database of the central control device 100-1 involved in the data transfer process shown in Figure 5.
  • step 605 Based on the received display data, display the personalized desktop. After the central control device 100-2 completes this step, the following step 607 can be continued to receive the user's operation input on the desktop displayed by the central control device 100-2.
  • the central control device 100-2 After receiving the personalized desktop display data from the central control device 100-1 commonly used by the user, the central control device 100-2 performs desktop rendering and display based on the display data, so that the display meets the user's personal preferences and usage. Customized desktop. It can be understood that the personalized desktop displayed by the central control device 100-2 at this time may include the font size, wallpaper, dark and light color display modes set by the user on the central control device 100-1, and each associated device or application card The layout on the desktop, as well as official or third-party value-added services subscribed by users, etc., are not limited here.
  • Figures 7a to 7b show schematic diagrams of personalized desktop styles set by different users according to embodiments of the present application. It can be understood that the interfaces shown in Figures 7a to 7b do not constitute a restriction on the personalized desktop style. In other embodiments, the personalized desktop set by different users can also be in other styles.
  • the desktop style can be set to the simple mode desktop 710 shown in Figure 7a.
  • the simple desktop 710 has a larger display font size and a flatter desktop layout, making it easier for the user to identify and use various controls.
  • the personalized desktop displayed by the central control device 100-2 based on the received display data can refer to the simple mode desktop 710 shown in Figure 7a.
  • the desktop can also display a prompt message 711 indicating successful user identification, such as "The owner's identity has been recognized and the user has entered the simple mode" as shown in Figure 7a. model".
  • the child mode desktop 720 can automatically shield children from threatening operations on some electrical equipment and set operating boundaries, such as for some home equipment function cards. 721 is locked, and prompts such as "The device is locked” and "Please help me unlock and use it ⁇ " as shown in Figure 7b are displayed.
  • the display style of the child mode desktop 720 is relatively cartoon-like, and the learning channel 722 can also be displayed. Children selectively watch or listen, and can also automatically control some smart home devices to enter child safety mode. For example, the upper temperature limit of the water dispenser at home can be controlled to be within the safe temperature range of 37°C. Children can click "I want to drink water” 723 for safe drinking water, etc.
  • the personalized desktop displayed by the central control device 100-2 based on the received display data may refer to the child mode desktop 720 shown in FIG. 7b, etc., which is not limited here.
  • the desktop can also display a prompt message 724 indicating successful user identity recognition, such as "The identity of the little master has been recognized and has entered” as shown in Figure 7b. "Child Mode". There are no restrictions here.
  • the central control device 100-2 when the central control device 100-2 performs desktop rendering and display based on the received personalized display data, it can also display card information of associated home devices in the space where the central control device 100-2 is currently located. Or control the window, there are no restrictions here.
  • step 606 Based on local display data, display the local desktop. After the central control device 100-2 completes this step, the following step 607 can be continued to receive the user's operation input on the desktop displayed by the central control device 100-2.
  • the central control device 100-2 confirms that the collected user personal information does not match the registered user identity information when performing the above step 602, or if the central control device 100-2 confirms that it matches when performing the above step 603, If the user identity information has not been associated with a commonly used central control device, the local desktop can be displayed, that is, the desktop is rendered and displayed based on local display data. It can be understood that the local desktop of the central control device 100-2 can be the factory default desktop of the device, or it can be a desktop that is dynamically adjusted and displayed based on the associated home devices in the space where the central control device 100-2 is currently located. This is not the case here. Make restrictions.
  • the user can view the subscribed value-added service information, operate and play music, control to turn on the large-screen TV, or click on the whole-house service card such as whole-house ventilation to turn on the air-conditioning equipment on the desktop displayed by the central control device 100-2.
  • the central control device 100-2 can respond to the user's operation, display the corresponding application interface (such as displaying the music playback interface), or send relevant control instructions to the associated home equipment, such as sending a turn-on instruction to a large-screen TV and playing specified video content. instructions, etc.
  • the central control device 100-2 can detect that the user is far away based on the distance sensor. For example, the central control device 100-2 can confirm that the user does not need to use the current device after the user has been away from the preset distance for more than a preset time. desktop, at this time, the central control device 100-2 can disconnect the display data flow channel with the central control device 100-1, and turn off the screen and enter the sleep state.
  • Figure 8 shows a schematic flowchart of an implementation process in which a user registers user identity information on a commonly used central control device and sets a commonly used central control device associated with the user identity information according to an embodiment of the present application. It can be understood that the process shown in Figure 8 does not constitute a specific restriction on the implementation process of the solution of the present application. In other embodiments, the implementation order of each step shown in Figure 8 can also be adjusted according to needs, and is not limited here.
  • the process includes the following steps:
  • 801 Device initialization, log in to the main account on any central control device.
  • each central control device can connect to a unified trusted network and log in to the main account, such as unified access to WiFi, and then each central control device can establish a Trusted relationships, communication channels (such as Hilink) and data transmission channels (such as distributed soft buses).
  • a unified trusted network such as unified access to WiFi
  • each central control device can establish a Trusted relationships, communication channels (such as Hilink) and data transmission channels (such as distributed soft buses).
  • a whole-house scenario can be configured with a main account to manage each central control device in the whole-house scenario.
  • the setting operations or device management performed by the user after logging in to the main account The relevant operation result data corresponding to the operation can be synchronized to each central control device.
  • users can uniformly set the default desktop for each central control device, add home devices to be controlled, etc.
  • the user can also log in to the main account on other electronic devices other than the central control device to manage each central control device, such as logging in to the main account on a tablet or laptop, which is not limited here. .
  • the user can create a family group to add/set up multiple family member sub-accounts, for example, create M sub-accounts for M family members.
  • each family member can make some personalized settings by logging in to the sub-account.
  • each step of the process shown in Figure 8 is described as a family member.
  • Each family member is a user who uses each central control device. Unless otherwise specified, no distinction is made between the two. .
  • each central control device can be set with a commonly used family member sub-account information.
  • each central control device can be set.
  • the central control device in each room is set to correspond to the sub-account information of the family member who lives there, as a common sub-account of the central control device, to establish an association between each central control device and family members.
  • a certain room in a whole-house scenario may have multiple commonly used family members.
  • multiple family member sub-account information can also be set on a central control device. There is no restriction on this.
  • 804 Establish an association between the device information of each central control device and the family member sub-account information.
  • the device information of each central control device is, for example, a device ID.
  • the association relationship established between each central control device and the family member sub-account information may be, for example, a one-to-one or one-to-many relationship, which is not limited here. .
  • Each family member registers identity information on the associated common central control device.
  • each family member can log in to the sub-account on the associated common device and register an item such as face data, fingerprint data, or voiceprint data used to identify the user's identity as identity information to use each central control device. It is used to dynamically identify user identities to match the device information of the corresponding user's commonly used central control devices.
  • the identity information of each family member is associated with the set family member sub-account.
  • the identity information can be associated with the sub-account information of the corresponding logged-in family member, and in turn can also be associated with the corresponding central control device information.
  • the process of establishing an association between a user and a commonly used central control device is not limited to the process described in steps 804 to 806 above.
  • the central control device can also proactively establish an association with the identity information of the user with the highest frequency of use based on the frequency with which each user uses the central control device.
  • the central control device can also obtain the user's location through the user's handheld device, etc., and based on this statistics, the user's time in the room where the central control device is located can be actively established with users who often stay in the room where the central control device is located. , that is, actively associate the user's identity information. There are no restrictions here.
  • each family member's sub-account can be associated with the face data of each family member on the one hand, and the central control device commonly used by each family member on the other hand.
  • the central control device can quickly match the central control device associated with the associated family sub-account based on the association relationship shown in Figure 9, and then Get the device information of the central control device.
  • the user can associate the central control device information with each other.
  • Family member sub-account information, And the identity information of associated family members is stored in the distributed database of the corresponding central control device, and then the above information and association relationships can be synchronized between each central control device based on Hilink channels. In this way, the security of private data in user identity information and other information synchronized between various central control devices can also be ensured.
  • the information of each central control device, the sub-account information of associated family members, and the identity information of associated family members can also be synchronized between the central control devices in other ways, such as uniformly sending it to the smart home scene. It can be managed by a certain central control device in the central control device and synchronized between the central control devices, or uploaded to the cloud for unified management and synchronization between the central control devices, etc. There are no restrictions here.
  • Figure 10 shows an interactive flow diagram of a display control method according to an embodiment of the present application. It can be understood that the process shown in Figure 10 involves the interaction between the central control device 100-1 and the central control device 100-2, wherein the central control device 100-1 is, for example, a common device of the user, such as the central control screen in the user's bedroom. ;
  • the central control device 100-2 can be a central control device in other rooms in the home environment, such as a central control screen in the living room, which is not limited here.
  • the process includes the following steps:
  • the central control device 100-1 stores the face information registered by the associated user and is set as the user's common central control device.
  • the user can register personal identity information on a commonly used central control device, such as the central control device 100-1.
  • the identity information may include, for example, face information, fingerprint information, voiceprint information, etc., which are not limited here. .
  • face information when a user registers face information on the central control device 100-1, the association between the user's face information and the device information (such as device ID) of the central control device 100-1 can be completed. , which is equivalent to marking the central control device 100-1 in the home environment as the user's common central control device.
  • the central control device 100-1 synchronizes the registered user identity information with the central control device 100-2, as well as the association between the central control device 100-1 and the user identity information.
  • the central control device 100-1 can synchronize static device information based on the Hilink channel between information hubs, including synchronizing registered user identity information and the association between the central control device 100-1 and user identity information. Relationships etc.
  • the central control device 100-1 synchronizes the registered user identity information and the static device information such as the association between the central control device 100-1 and the user identity information with the central control device 100-2. It can be realized through other communication technologies, such as WiFi, Bluetooth and other communication methods, and is not limited here.
  • the central control device 100-1 synchronizes the registered user identity information with the central control device 100-2, and the association between the central control device 100-1 and the user identity information is just one
  • the central control device 100-1 can also upload the acquired user identity information and the association between the central control device 100-1 and the user identity information to the cloud to implement
  • the process of determining on the cloud the device information of the central control device 100-1 corresponding to the user personal information collected by the central control device 100-2 and feeding it back to the central control device 100-2 is not limited here.
  • the central control device 100-1 stores personalized display data set by the user for the desktop.
  • the user can refer to the relevant description in step 604 for the process of editing the desktop of the commonly used central control device 100-1.
  • the personalized desktop display style set by the user for the commonly used central control device 100-1 can refer to the above figure. 7a or 7b, and will not be described again here.
  • the central control device 100-2 detects the approach of the user.
  • the central control device 100-2 may detect the approach of the user based on the distance sensor 180C or the like.
  • the distance sensor 180C may detect the approach of the user based on the distance sensor 180C or the like.
  • the central control device 100-2 triggers face recognition.
  • the central control device 100-2 can activate the camera 193 to collect face information for face recognition.
  • the central control device 100-2 may also trigger other identification methods after detecting the approach of the user, such as triggering fingerprint recognition.
  • the central control device 100-2 detects face information.
  • the central control device 100-2 activates the camera 193, it can detect the face information of the user currently approaching, which is the process of collecting face information to be recognized.
  • the process of collecting face information please refer to the relevant description in step 601 above, and will not be described again here.
  • the type of user personal information collected when the central control device 100-2 performs this step can be the same as that in the above steps 1001 to 1002 when the user registers on the central control device 100-1 and synchronizes it to the central control device 100-2 corresponding to the type of identity information.
  • the central control device 100-2 determines whether the detected face information has been registered. If the judgment result is yes, it means that the detected face information has been registered, then continue to perform the following step 1008 to match the commonly used central control device; if the judgment result is no, it means that the detected face information has not been registered, you can perform the following Describe step 1012 to display the local desktop.
  • the central control device 100-2 can compare the detected face information with the registered face data of each family member (or user) obtained in the distributed database to determine the detected face. Whether the information has been registered.
  • the relevant description in step 605 above please refer to the relevant description in step 605 above, which will not be described again here.
  • the central control device 100-2 determines whether there is a commonly used central control device that matches the detected face information. If the judgment result is yes, it indicates that the current user has set up a commonly used central control device, then continue to perform the following step 1009 to obtain personalized display data on the commonly used central control device; if the judgment result is no, it indicates that the current user has not set up a commonly used central control device. device, you can perform the following step 1012 to display the local desktop.
  • step 603 For the specific judgment process, please refer to the relevant description in step 603 above, which will not be described again here.
  • the central control device 100-2 sends a request to obtain the display data corresponding to the personalized desktop to the central control device 100-1.
  • the central control device 100-1 sends personalized desktop display data to the central control device 100-2.
  • the central control device 100-2 can obtain the device information of the commonly used central control device, such as the device ID of the central control device 100-1, etc. , and then can send a display data acquisition request to the central control device 100-1 based on the device information, and then the central control device 100-1 can respond to the acquisition request and return the personalized desktop correspondence set by the user to the central control device 100-2. display data.
  • the device information of the commonly used central control device such as the device ID of the central control device 100-1, etc.
  • the central control device 100-1 can respond to the acquisition request and return the personalized desktop correspondence set by the user to the central control device 100-2. display data.
  • step 604 For the specific process of obtaining personalized display data, please refer to the relevant description in step 604 above, which will not be described again here.
  • the central control device 100-2 can draw and render based on the received display data corresponding to the personalized desktop, thereby displaying a personalized desktop that conforms to the current user's preferences and usage habits for the current user to use, thus effectively improving the user experience.
  • Use experience For the specific process of displaying the personalized desktop, please refer to the relevant description in step 605 above, which will not be described again here.
  • the central control device 100-2 can display a local desktop based on local display data, for example, display a general desktop based on default settings.
  • step 606 For the specific process of displaying the local desktop, please refer to the relevant description in step 606 above, and will not be described again here.
  • step 607 For the specific process of the central control device 100-2 responding to the relevant operations performed by the user on the displayed desktop, please refer to the relevant description in step 607 above, which will not be described again here.
  • the user can also adjust the desktop display style on the desktop displayed by the central control device 100-2, and the central control device 100-2 can generate corresponding operation instructions from the received user operations, and distribute them through
  • the soft bus is sent to the central control device 100-1 to respond, that is, the central control device 100-1 is remotely controlled to respond to the operation instruction, thereby changing the display data of the corresponding personalized desktop. If the desktop displayed by the central control device 100-2 is a personalized desktop displayed based on the received display data, then the central control device 100-2 can transfer the display data with the central control device 100-1 at this time.
  • the channel such as a distributed soft bus, saves the changed display data caused by the user's operation of adjusting the desktop display style to the distributed database of the central control device 100-1 in real time, so as to update and flow to the rendering display on the central control device 100-2
  • the data source is the personalized desktop display data stored on the central control device 100-1. There are no restrictions here.
  • step 608 For the specific process of the central control device 100-2 disconnecting the data flow and turning off the screen, please refer to the relevant description in step 608 above, which will not be described again here.
  • This apparatus may be specially constructed for the required purposes, or it may comprise a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer.
  • Such computer programs may be stored on a computer-readable medium such as, but not limited to, any type of disk including floppy disk, optical disk, CD-ROM, magneto-optical disk, read-only memory (ROM), random access memory (RAM) , EPROM, EEPROM, magnetic or optical card, application specific integrated circuit (ASIC), or any type of medium suitable for storing electronic instructions, and each may be coupled to a computer system bus.
  • the instructions in the manual References to computers may include a single processor or may be architectures employing multiple processors for increased computing power.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Automation & Control Theory (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请涉及智能家居技术领域,具体涉及一种显示控制方法、电子设备及计算机可读存储介质。该方法包括:第一电子设备对当前的第一用户进行识别;第一电子设备根据识别结果从第二电子设备获取与第一用户相对应的第一显示数据,并基于第一显示数据显示第一控制界面,其中第一显示数据与第一用户对第二电子设备的使用数据相关联。本申请方案可以在识别到用户身份时,显示与该用户身份相匹配的个性化桌面。如此,用户在家居环境中的任一中控设备上均可以使用符合该用户喜好或使用习惯的个性化桌面进行控制操作,有利于提高用户的使用体验。

Description

显示控制方法、电子设备及计算机可读存储介质
本申请要求于2022年07月11日提交中国专利局、申请号为202210818264.2、申请名称为“显示控制方法、电子设备及计算机可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明涉及智能家居技术领域,具体涉及一种显示控制方法、电子设备及计算机可读存储介质。
背景技术
随着智能家居技术的发展,在一些智能家居场景中,用户可以通过全屋智能中控屏(Home Panel)来开启家中的智能电视、智能音箱、电热水壶、饮水机以及窗帘等智能家居设备。其中,中控屏提供的用于实现上述控制功能的桌面也可以称之为超级桌面(Super Launcher)。
然而,在通过中控屏控制各智能家居设备的过程中,目前的中控屏无法灵活切换桌面显示样式,以适应不同用户的喜好和使用习惯。
发明内容
本申请实施例提供了一种显示控制方法、电子设备及计算机可读存储介质,基于本申请方案,用户在家居环境中的任一中控设备上均可以使用符合该用户喜好或使用习惯的个性化桌面进行控制操作,有利于提高用户的使用体验。
第一方面,本申请实施例提供了一种显示控制方法,应用于智能家居系统,智能家居系统包括具有屏幕的第一电子设备和第二电子设备,该方法包括:第一电子设备对当前的第一用户进行识别;第一电子设备根据识别结果从第二电子设备获取与第一用户相对应的第一显示数据,并基于第一显示数据显示第一控制界面,其中第一显示数据与第一用户对第二电子设备的使用数据相关联。
即第一电子设备可以在识别到当前使用该电子设备的第一用户身份时,显示与该用户身份相匹配的控制界面。上述第一电子设备和第二电子设备例如可以是智能家居系统中的中控屏等中控设备。第二电子设备例如可以是用户的常用中控设备,参考下文具体实施方式中描述的中控设备100-1,第一电子设备则为用户当前需要使用的中控设备,参考下文具体实施方式中描述的中控设备100-2。第一电子设备获取的与识别到的第一用户相对应的第一显示数据,即为该用户常用中控设备生成的显示数据,也就是上述第二电子设备上生成的显示数据。
上述第一显示数据与第一用户对第二电子设备的使用数据相关,例如可以是常用中控设备根据用户的使用习惯或者用户的设置操作等对应的使用数据,调整对应于该用户的控制界面显示样式、并生成相应的显示数据。
可以理解,上述第一电子设备从第二电子设备获取第一显示数据的过程,可以包括第一电子设备直接从第二电子设备获取第一显示数据;也可以包括第一电子设备从云端或服务器获取第二电子设备上传的第一显示数据,在此不做限制。
在上述第一方面的一种可能的实现中,第一控制界面包括多个控件,控件用于控制智能家居系统中的智能家居设备。
即用户可以通过第一电子设备显示的控制界面对智能家居系统中的智能家居设备进行控制操作。
在上述第一方面的一种可能的实现中,智能家居系统还包括具有屏幕的第三电子设备,并且上述方法还包括:第一电子设备对当前的第二用户进行识别;第一电子设备根据识别结果从第三电子设备获取与第二用户相对应的第二显示数据,并基于第二显示数据显示第二控制界面,其中第二显示数据与第二用户对第三电子设备的使用数据相关联。
即第一电子设备识别到当前使用该第一电子设备的第二用户时,可以显示与第二用户身份相匹配的控制界面。具体参考上述显示第一用户匹配的控制界面的相关描述,在此不做赘述。
在上述第一方面的一种可能的实现中,第一电子设备根据识别结果从第二电子设备获取与第一用户相对应的第一显示数据,包括:获取用于识别第一用户的第一用户数据;基于第一用户数据与第二电子设备之间的第一关联关系,确定第二电子设备的设备信息;基于第二电子设备的设备信息向第二电子设 备发送数据获取请求,以获取第一显示数据。
即第一电子设备可以将获取到的第一用户数据,查找到第一用户数据与第二电子设备之间的关联关系,进而确定可以提供第一显示数据的第二电子设备的设备信息。之后第一电子设备则可以向第二电子设备请求获取第一显示数据。
在另一些实施例中,第一电子设备也可以将获取到的第一用户数据发送到云端或服务器,以在云端或服务器中匹配到第二电子设备上传的第一显示数据,进而获取云端或服务器返回的第一显示数据。在此不做限制。
在上述第一方面的一种可能的实现中,第一电子设备通过以下方式获取第一用户数据:检测到用户互动,采集第一用户的第一用户数据;或者,从第三电子设备接收第一用户数据。
在上述第一方面的一种可能的实现中,检测到用户互动,包括下列情形中的任一项:检测到用户靠近;检测到用户对第一电子设备屏幕的触控操作;检测到用户对第一电子设备上按键的按压操作。
在上述第一方面的一种可能的实现中,第一用户数据包括:人脸识别数据、指纹识别数据、声纹识别数据中的任一项。
该第一用户数据例如可以是采集到的该用户的人脸信息、指纹信息或者声纹信息等。
在上述第一方面的一种可能的实现中,基于第一用户数据与第二电子设备之间的第一关联关系,确定第二电子设备的设备信息,包括:基于从第二电子设备预先获取的第一关联关系,确定第二电子设备的设备信息。
在上述第一方面的一种可能的实现中,第二电子设备生成第一关联关系的方式包括下列中的任一项:基于检测到的第一用户输入第一用户数据的操作、以及将第二电子设备设置为与第一用户关联的常用设备的操作,生成第一关联关系;基于第一用户对第二电子设备的使用频次,生成第一关联关系;基于第一用户所在位置与第二电子设备所在位置同处于第一空间的统计时长,生成第一关联关系,其中第一用户所在位置通过第四电子设备采集的位置数据确定。
例如,上述第二电子设备为用户的常用中控设备,该中控设备在检测到用户在该中控设备上注册身份信息并操作将该中控设备设定为常用中控设备时,则可以建立与该用户之间的关联关系。或者该中控设备识别到用户使用该中控设备的频次最高,又或者用户与该中控设备同处于一个房间内的时间最长等,建立与该用户之间的关联关系,作为用户的常用中控设备。
可以理解,在另一些实施例中,用户与常用中控设备之间的关联关系也可以通过其他方式建立,在此不做限制。
在上述第一方面的一种可能的实现中,第一电子设备从第二电子设备预先获取第一关联关系的方式包括:第一电子设备通过开放物联网通信协议接收第二电子设备同步的第一关联关系;或者,第一电子设备通过开放物联网通信协议向第二电子设备发送获取请求,并接收第二电子设备响应于获取请求返回的第一关联关系。
在上述第一方面的一种可能的实现中,开放物联网通信协议为HiLink通信协议。
例如,第一电子设备与第二电子设备之间可以通过Hilink通道同步用户与常用设备之间的关联关系,即上述第一关联关系。可以理解,在另一些实施例中,第一电子设备与第二电子设备之间同步关联关系的通信方式也可以为其他方式,在此不做限制。
在上述第一方面的一种可能的实现中,第二电子设备包括第二控制界面,第一用户对第二电子设备的使用数据,包括以下至少一项:根据第一用户的操作习惯获取的数据;或者,根据第一用户对第二控制界面的显示内容的调整操作获取的数据。
在上述第一方面的一种可能的实现中,上述方法还包括:在第一电子设备基于第一显示数据显示第一控制界面之前,第一电子设备显示第三控制界面;基于第一显示数据显示第一控制界面,包括:基于第一显示数据,将第三控制界面切换显示为第一控制界面。
例如第一电子设备为用户当前使用的中控设备,该中控设备亮屏时可以显示默认桌面,即上述第三控制界面。例如该中控设备未识别到用户身份,或者未采集到用户的人脸信息时,如需亮屏则可以显示默认桌面。当该中控设备识别出当前使用设备的用户身份时,则所显示的第三控制界面可以切换到与该用户匹配的第一控制界面。
在上述第一方面的一种可能的实现中,第一电子设备与第二电子设备基于WiFi、蓝牙或者分布式 软总线中的任一项建立数据传输通道,数据传输通道用于在将第一显示数据由第二电子设备传输至第一电子设备。
在上述第一方面的一种可能的实现中,第一控制界面为桌面应用的界面,并且第一显示数据包括下列中的至少一项:桌面应用的应用数据、与桌面应用交互的第一应用的应用数据、以及第一控制界面上的控件对应控制的智能家居设备的设备数据。
例如,中控屏识别到用户身份后显示的个性化桌面,即可以是上述第一控制界面。
第二方面,本申请实施例提供了一种显示控制方法,应用于智能家居系统,智能家居系统包括具有屏幕的第一电子设备和第二电子设备,该方法包括:第二电子设备接收第一电子设备对第一显示数据的获取请求,其中,第一显示数据用于显示第一电子设备的第一控制界面,第一显示数据由第二电子设备根据第一用户对第二电子设备的使用数据生成;响应于获取请求,第二电子设备向第一电子设备发送第一显示数据。
在上述第二方面的一种可能的实现中,第二电子设备包括第二控制界面,第二电子设备的使用数据,包括:第二电子设备基于第一用户的操作习惯获取的数据;或者,第二电子设备基于用户对第二控制界面的显示内容的调整操作获取的数据。
第三方面,本申请实施例提供了一种电子设备,包括:一个或多个处理器;一个或多个存储器;一个或多个存储器存储有一个或多个程序,当一个或者多个程序被一个或多个处理器执行时,使得电子设备执行上述第一方面提供的显示控制方法、或者执行上述第二方面提供的显示控制方法。
第四方面,本申请实施例提供了一种计算机可读存储介质,存储介质上存储有指令,指令在计算机上执行时使计算机执行上述第一方面提供的显示控制方法、或者执行上述第二方面提供的显示控制方法。
第五方面,本申请实施例提供了一种计算机程序产品,包括计算机程序/指令,该计算机程序/指令被处理器执行时实现上述第一方面或第二方面提供的显示控制方法。
附图说明
图1所示为一种智能家居场景示意图。
图2a所示为本申请实施例提供的一种中控设备在检测到用户靠近时唤醒屏幕显示默认显示的桌面示意图。
图2b所示为本申请实施例提供的一种中控设备在唤醒屏幕时,识别到用户身份后显示的对应于该用户的个性化桌面示意图。
图3所示为本申请实施例提供的一种中控设备的结构示意图。
图4所示为本申请实施例提供的一种中控设备的操作系统架构示意框图。
图5所示为本申请实施例提供的一种智能家居场景下各中控设备之间的显示数据流转过程示意图。
图6所示为本申请实施例提供的一种显示控制方法的实施流程示意图。
图7a所示为本申请实施例提供的一种个性化桌面样式示意图。
图7b所示为本申请实施例提供的另一种个性化桌面样式示意图。
图8所示为本申请实施例提供的一种用户在常用中控设备上注册用户身份信息、以及设置与用户身份信息相关联的常用中控设备的实施流程示意图。
图9所示为本申请实施例提供的家庭成员子账户、用户注册的人脸数据以及常用中控设备之间的关联关系示意图。
图10所示为本申请实施例提供的显示控制方法的一种交互流程示意图。
具体实施方式
图1根据本申请实施例示出了一种智能家居场景示意图。
如图1所示,该智能家居场景10包括多个中控屏,例如图1所示各个空间内的中控屏100-1、100-2、100-3、100-4以及100-5等,用户不仅可以在自己的经常活动空间内操作中控屏,例如中控屏100-1,也可以在其他空间内操作中控屏例如中控屏100-2。
然而,不同的用户,对中控屏的桌面样式的需求有所不同,例如青中年用户可能倾向于在桌面上尽可能多的显示各个家居设备的控制按钮或者设备数据,以便操作;老年人则可能倾向于简易模式的桌面, 字体较大,而且仅显示少数常用智能设备的控制按钮等;儿童所使用的中控屏的桌面,则可以自动屏蔽儿童对一些电器设备的威胁操作,以及显示一些学习相关应用或设备的内容推荐、控制按钮等。
但是,目前的中控屏仅能在检测到用户靠近时显示本地通用桌面,而无法根据不同用户的喜好或使用习惯显示匹配的个性化桌面。
为了解决上述图1所示的智能家居场景10中的中控屏等执行中枢控制功能的电子设备无法根据不同用户的喜好或使用习惯匹配显示相应个性化桌面的问题,本申请实施例提供了一种显示控制方法,应用于智能家居场景。其中,上述执行中枢控制功能的电子设备,以下简称中控设备,例如上述图1所示场景中的中控屏。
具体地,该方法通过在各中控设备中预先存储用户身份信息与对应的常用中控设备之间的关联关系,如此,用户若在常用中控设备上设置个人显示数据,即符合个人喜好或者使用习惯的个性化桌面样式,常用中控设备可以对用户设置的个人显示数据进行存储。当用户从常用的常用中控设备转移到当前中控设备前,当前中控设备检测到用户互动时则开始识别用户身份信息,其中用户互动例如可以是用户靠近当前中控设备或者用户触摸当前中控设备屏幕进行的唤醒操作等,在此不做限制。当前中控设备能够基于存储的用户身份信息与对应的常用中控设备之间的关联关系,获取与识别到的用户身份信息对应的常用中控设备上的显示数据,显示符合该用户喜好或使用习惯的个性化桌面。
基于此,用户在家居环境中的任一中控设备上均可以使用符合该用户喜好或使用习惯的个性化桌面进行控制操作,用户体验也因此得以提高。
在一些实施例中,用户身份信息与对应的常用中控设备之间的关联关系可以存储于各中控设备中。则当前中控设备获取与识别到的用户身份信息对应的常用中控设备上的显示数据的方式可以包括:当前中控设备可以在识别该用户的身份信息后从自身存储的关联关系中确定该用户身份信息对应的常用中控设备的设备信息,并向对应的常用中控设备发送获取显示数据的请求,对应的常用中控设备基于该请求返回相应显示数据。
可选地,当前中控设备也可以接收家居环境中其他电子设备发来的通知和用户身份信息,进而获取与接收到的用户身份信息相匹配的显示数据,并显示相应的个性化桌面,在此不做限制。上述通知和用户身份信息可以是其他电子设备在靠近当前中控设备并且识别出用户身份时发出的信息。例如,用户佩戴的智能手表检测到用户靠近当前中控设备时,可以向当前中控设备发送该用户靠近的通知以及用户的身份信息。
在一些实施例中,用户身份信息与对应的常用中控设备之间的关联关系可以存储于与各中控设备连接的中枢设备中或者预先存储在云端。当前中控设备可以在识别该用户的身份信息后将该用户身份信息发送给该中枢设备或云端,由该中枢设备或云端确定该用户身份信息对应的常用中控设备的设备信息并返回给当前中控设备,进而当前中控设备向对应的常用中控设备发送获取显示数据的请求,对应的常用中控设备基于该请求返回相应显示数据。
在一些实施例中,用户身份信息与对应的常用中控设备之间的关联关系、以及用户在常用中控设备设置的个性化桌面显示数据均存储在云端。当前中控设备可以在识别该用户的身份信息后将该用户身份信息发送给云端,云端直接根据存储的关联关系调用该用户身份信息对应的常用中控设备的显示数据发送至当前中控设备使用。其中,为了保护用户隐私数据,预先存储在云端的关联关系以及显示数据等可以进行相应的加密处理,在此不做限制。
在另一些实施例中,当前中控设备在识别该用户的身份信息后,快速获取与用户身份信息对应的常用中控设备上的显示数据的方式还可以是其他方式,在此不做限制。
可以理解,上述身份信息包括但不限于人脸数据、指纹数据、声纹数据等,在此不做限制。上述显示数据,为用户在常用的常用中控设备设置个性化桌面样式对应生成的显示数据,包括但不限于常用中控设备的桌面应用(Launcher)数据、在桌面应用的各卡片窗口中显示的应用数据或设备状态数据、以及一些能够设置桌面应用的显示字体、字号大小等桌面全局样式的一些系统应用数据等,该系统应用例如可以是设置应用等。
可以理解,在一些实施例中,其中智能家居场景的各中控设备之间可以建立数据流转通道,便于显示数据或获取相应显示数据的相关请求的传输等等。该数据流转通道,可以是基于所连接的同一无线局域网建立的流转通道,例如基于WiFi、蓝牙、ZigBee或者分布式软总线等实现的近场数据传输通道, 在此不做限制。如此,基于用户设置生成的个性化桌面显示数据可以仅在家居环境内的各中控设备之间流转,有利于保护用户隐私数据。
在另一些实施例中,该数据流转通道也可以基于无线网络和云端实现建立,例如常用中控设备上的显示数据可以通过无线局域网络或移动数据通信网络等传输到云端,当前中控设备在识别到用户身份时从云端获取该显示数据。如此,显示数据的传输则可以不局限于无线局域网络,本申请实施例所提供的显示控制方法也能具备更大的网络场景适应性。
图2a示出了一种中控设备在检测到用户靠近时唤醒屏幕显示默认显示的控制界面示意图。可以理解,图2a所示的中控设备100-2可以是上述当前中控设备,即用户当前互动的当前中控设备。
如图2a所示,当中控设备100-2检测到用户靠近时,均可以唤醒屏幕显示图2a所示的控制界面210,该控制界面210的图标较多,各图标对应的功能介绍字号适中,较为符合大众使用习惯。然而,如果此时操作该中控设备100-2的用户是家中老人,则可能会看不清楚各图标的功能介绍。
图2b根据本申请实施例示出了一种中控设备在唤醒屏幕时,识别到用户身份后显示的对应于该用户的个性化桌面示意图。
如图2b所示,该个性化桌面例如可以是符合老人使用习惯的简易模式桌面220。该桌面220上显示的字号较大,功能控件较少,并且布局比较便于老人使用。在另一些实施例中,图2b所示的个性化桌面也可以是符合其他用户使用喜好的其他样式,在此不做限制。
参考上述图1所示的场景,例如该用户是家中老人,该用户的常用中控设备是位于卧室的中控设备100-1,该中控设备100-1的个性化桌面对应设置的是符合老人使用习惯的简易模式桌面。如果该用户从卧室走到客厅,想要喝水,则可以走近位于客厅的中控设备100-2。当中控设备100-2检测到用户靠近时,可以唤醒屏幕并通过人脸识别或者指纹识别等方式识别用户身份。当该中控设备100-2确认该用户是家中老人时,则可以向中控设备100-1获取符合该老人使用习惯的简易模式桌面的显示数据,进而显示图2b所示的简易模式桌面220,该用户则可以点击该桌面220上大号文字显示的“一键热水”满足自己的饮水需求。
如果将上述简易模式桌面220为中控设备100-2识别到家中老人的身份信息时所显示的控制界面,记为第一控制界面。当中控设备100-2识别另一用户身份时,例如识别到家中儿童的身份信息时,还可以显示对应于该儿童设置的控制界面,该控制界面可以记为第二控制界面。而在中控设备100-2显示上述第一控制界面或者第二控制界面之前,例如未识别到任何用户的身份信息时,可以显示上述图2a所示的默认桌面,例如记为第三控制界面。
如此,上述中控设备100-2识别到家中老人的身份信息时显示第一控制界面的过程,即从显示第三控制界面切换到显示第一控制界面的过程。类似地,中控设备100-2在识别到家中儿童的身份信息时显示第二控制界面的过程,即从显示第三控制界面切换到显示第二控制界面的过程。
另外,中控设备100-2所显示的简易模式桌面220上还可以显示界面提示信息221,例如图2b所示的“识别到主人身份,已进入简易模式”等。如此可以理解,基于本申请实施例所提供的显示控制方法,无论是家中老人还是其他用户,在家居环境中的任一中控设备上,均能使用满足相应用户个性化需求的桌面进行家居设备控制操作,例如点击图2b所示的“全屋除湿”功能开启家中空调进行除湿等,用户体验极佳。
可以理解,本申请实施例所提供的显示控制方法,所适用的电子设备(即上述中控设备)可以包括但不限于手机、平板电脑、桌面型、膝上型、手持计算机、上网本,以及增强现实(augmentedreality,AR)\虚拟现实(virtual reality,VR)设备、智能电视、智能手表等可穿戴设备、车机设备、便携式游戏机、便携式音乐播放器、阅读器设备、其中嵌入或耦接有一个或多个处理器的电视机、或能够访问网络的其他电子设备。
图3根据本申请实施例示出了一种中控设备100的结构示意图。
中控设备100可以包括处理器110,外部存储器接口120,内部存储器130,电源管理模块140,无线通信模块150,显示屏160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193等。其中传感器模块180可以包括压力传感器180A,气压传感器180B,距离传感器180C,接近光传感器180D,指纹传感器180E,温度传感器180F,触摸传感器180G,环境光传感器180H等。
可以理解的是,本发明实施例示意的结构并不构成对中控设备100的具体限定。在本申请另一些实施例中,中控设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。在本申请实施例中,处理器110可以通过控制器控制取指令和执行指令,以实施本申请实施例所提供的显示控制方法。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从上述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口等。
可以理解的是,本发明实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对中控设备100的结构限定。在本申请另一些实施例中,中控设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
电源管理模块140与处理器110等连接,用于对处理器110,内部存储器130,显示屏160,摄像头193,和无线通信模块150等进行供电管理。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。
中控设备100的无线通信功能可以通过天线和无线通信模块150等实现。
天线用于发射和接收电磁波信号。中控设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
无线通信模块150可以提供应用在中控设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。在一些实施例中,中控设备100的天线和无线通信模块150耦合,使得中控设备100可以通过无线通信网络以及其他设备通信。
中控设备100通过GPU,显示屏160,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏160和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏160用于显示图像,视频等。显示屏160包括显示面板。
中控设备100可以通过ISP,摄像头193以及应用处理器等实现采集用户人脸信息以用于确认用户身份的功能,在此不做限制。
其中,ISP可以用于处理摄像头193反馈的数据。摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展中控设备100的存储 能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。
内部存储器130可以用于存储计算机可执行程序代码,该可执行程序代码包括指令。内部存储器130可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序等。存储数据区可存储中控设备100在使用过程中所产生的应用数据等,例如桌面应用数据、以及在桌面应用界面上显示的其他应用数据等。在本申请实施例中,存储程序区存储的应用程序例如可以是用于管理及控制家居环境中各类智能设备的桌面应用(Launcher),存储数据区存储的数据例如可以是中控设备100运行桌面应用的过程中获取到的用户操作设置的个性化显示数据,以及待与用户靠近时采集到的用户人脸信息或指纹信息进行比对的身份信息相关数据等。在此不做限制。
此外,内部存储器130可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。处理器110通过运行存储在内部存储器130的指令,和/或存储在设置于处理器中的存储器的指令,执行中控设备100的各种功能应用以及数据处理。在本申请实施例中,例如中控设备100的处理器110可以运行存储在内部存储器130的用于执行下文介绍的显示控制方法的实施流程各步骤的相关指令,来实现用户个性化桌面的切换显示。
中控设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如录音、声纹识别等功能。
指纹传感器180E用于采集指纹。在本申请的一些实施例中,中控设备100可以利用采集的指纹特性可以用于比对已注册的用户身份信息,以识别用户身份。
距离传感器180C,用于测量距离。中控设备100可以通过红外或激光测量距离。在本申请的一些实施例中,中控设备100可以利用距离传感器180C测距以检测用户的靠近或远离,进而确定是否需要唤醒屏幕、采集用户人脸信息等进行身份识别以及显示对应于所识别用户的个性化桌面。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。中控设备100可以接收按键输入,产生与中控设备100的用户设置以及功能控制有关的键信号输入。马达191可以产生振动提示。指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
图4根据本申请实施例示出了一种中控设备100的操作系统架构示意框图。
中控设备100上可以安装分布式操作系统,例如Harmony OSTM,也可以安装AndroidTM系统等操作系统,在此不做限制。可以理解,在智能家居场景中,中控设备100可以有多个,各中控设备100之间可以基于所安装的分布式操作系统实现分布式交互。下面以图4所示的中控设备100-1与中控设备100-2为例,对中控设备100所采用的分布式操作系统进行简单介绍。其中,中控设备100-1可以是上述用户常用的常用中控设备,中控设备100-2可以是上述用户当前使用的第二电子设备。
在一些实施例中,中控设备100-1与中控设备100-2上安装的分布式操作系统采用分层架构。分层架构将分布式操作系统分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将分布式操作系统分为四层,从上至下分别为应用层、应用框架层、系统服务层以及内核层。在另一些实施例中,分布式操作系统也可以分为其他数量的层级结构,在此不做限制。
如图4所示,应用层可以包括一系列应用程序包。应用程序包可以包括桌面(Launcher)、设置、以及音乐等应用程序,例如还可以包括日历,WLAN,蓝牙,相机,图库,通话,地图,视频等,在此不做限制。
应用层还可以包括一些功能性的软件开发工具包(Software Development Kit,SDK),例如信息中枢SDK,用于存储并管理一些设备静态信息,例如用户在中控设备上登录的成员账户信息、注册的用户身份信息、以及将用户身份信息与中控设备的设备信息之间进行关联,以将该中控设备设定为该用户的常用设备的关联关系信息等。
其中,桌面(Launcher)应用可以响应于用户的设置操作,显示相应的个性化桌面。用户的设置操作例如可以包括设置个性化壁纸、超大字体、订阅收取快递的特性能力(Feature Ability,FA)卡片、以及用户自己房间内的私人设备FA卡片等的操作。其中桌面/桌面上显示的FA卡片对应设备的状态,则需要相应设备或应用程序提供。例如快递FA卡片对应的物流状态可以由相应的购物APP的应用数据提供,私人设备例如加湿器的FA卡片对应检测到的周围空气湿度则可以由关联的加湿器提供,等等。
应用框架层为应用层提供分布式框架、以及轻设备代理服务。其中,分布式框架包括远程安装、远程启动、迁移管理、远程调用、分布式系统服务管理以及FA关联管理等用于实现系统内以及系统之间互通(包括启动、调用、迁移)的功能框架、以及各框架对应的应用编程接口(application programming interface,API)。轻设备代理服务则可以提供轻设备托管服务、主-从服务调用代理等,其中的轻设备在HarmonyOS中是指带屏设备,在本申请实施例中,轻设备代理服务代理托管的轻设备例如可以是智能家居环境中的电热水器、空调、扫地机器人、加湿器等家居智能设备,以及智能眼镜等穿戴设备等。
系统服务层是分布式操作系统的核心,系统服务层通过应用框架层对应用层中的应用程序以及SDK提供服务。系统服务层包括Hilink通信组件、分布式数据管理以及分布式软总线等。
其中,Hilink通信组件用于在中控设备100-1与中控设备100-2之间建立同步一些设备静态信息的通信通道,该设备静态信息包括通过各中控设备注册的用户身份信息、用户身份信息与设备id之间的关联关系、以及各中控设备关联管理的家居设备相关信息等。各中控设备的上述设备静态信息可以基于Hilink通信组件提供的Hilink通道实现同步。
分布式软总线,作为底层网路的一个示例结构,用于传输在用户常用中控设备与用户当前使用的中控设备之间流转的显示数据等,即实现鸿蒙分布式流转(Harmony distributed flow)。其中,对于分布式软总线功能的理解,可以参考计算机硬件总线。例如,分布式软总线是在1+8+N设备(1为手机;8代表车机、音箱、耳机、手表、手环、平板、大屏、个人计算机(personal computer,PC)、增强现实(Augmented Reality,AR)、虚拟现实(Virtual Reality,VR);N泛指其他物联网(Internet of Things,IOT)设备)之间搭建一条“无形”的总线,其具备自动发现、即连即用、自组网(异构网络组网)、高带宽、低时延、可靠性高等特点。也就是说,通过分布式软总线技术,上述各中控设备之间不仅可以实现全部数据的共享,还可以与其在同一局域网络或与其通过蓝牙连接的任意设备实现即时互联。另外,分布式软总线还能够在蓝牙、无线保真(Wireless-Fidelity,WiFi)等异构网络之间共享文件(例如一方面通过蓝牙接收文件,另一方面通过WiFi传输文件)。
内核层是硬件和软件之间的层。分布式操作系统的内核层包括:内核子系统和驱动子系统。其中,内核子系统介于分布式操作系统可以采用多内核设计,因此内核子系统支持针对不同资源受限设备选用适合的OS内核,例如在本申请实施例中,对于中控设备可以选用Lite OS。
内核子系统上的内核抽象层(Kernel Abstract Layer,KAL)通过屏蔽多内核差异,对上层提供基础的内核能力,包括进程/线程管理、内存管理、文件系统、网络管理和外设管理等。
驱动子系统提供的驱动框架是分布式系统硬件生态开放的基础,提供统一外设访问能力和驱动开发、管理框架。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。
基于上述图3所示的中控设备结构以及图4所示的分布式操作系统架构,图5根据本申请实施例示出了一种智能家居场景下各中控设备之间的显示数据流转过程示意图。
如图5所示,智能家居场景中包括中控设备100-1、中控设备100-2、中控设备100-3。其中,中控设备100-1可以是上述用户常用的常用中控设备,中控设备100-2可以是上述用户当前使用的第二电子设备,中控设备100-3可以是其他用户常用的中控设备。各中控设备至少包括以下各功能模块:
接近互动模块,可以基于距离传感器实现,用于检测用户靠近,进而唤醒中控设备显示桌面,即控制界面。
人脸识别模块,可以基于摄像头以及相应的图像处理器(例如ISP)实现,用于在用户注册常用中控设备时采集用户人脸信息作为用户身份信息,以及用于在中控设备唤醒时采集用户人脸信息进行用户身份的识别验证。
信息中枢,用户同步并存储用户身份信息、用户与相应中控设备建立绑定的关联关系信息等静态设备信息,基于信息中枢的调度,可以实现中控设备识别到用户身份基于预先获取或存储的上述静态设备信息确定目标中控设备的设备信息,例如设备ID,进而当前中控设备或者当前中控设备上的桌面(Launcher)应用便可以基于目标中控设备ID发送获取显示数据的请求。信息中枢可以基于Hilink通信模组提供的Hilink通道实现各中控设备之间各静态设备信息的同步,当前中控设备基于目标中控设备ID发送的获取显示数据的请求则可以基于分布式软总线等数据通道传输,具体在下文中介绍分布式数据库的相关内容中介绍,在此不做赘述。
可以理解,在一些实施例中,不同的用户可以与家居环境中不同的中控设备分别建立关联关系,例 如用户A可以通过自己房间的中控设备100-1注册身份信息,以与该中控设备100-1建立关联关系。用户B也可以通过自己房间的中控设备100-3注册身份信息以建立关联关系等。在另一些实施例中,中控设备也可以根据各用户使用该中控设备频次的高低,主动与使用频次最高的用户身份信息建立关联关系。或者,中控设备还可以通过用户的手持设备等获取到用户所在位置,据此统计用户在该中控设备所在房间的时长,从而与经常待在该中控设备所在房间的用户主动建立关联关系,即主动关联该用户的身份信息。在此不做限制。具体用户与中控设备建立关联关系的过程将在下文详细描述,在此不做赘述。
分布式数据库,即各中控设备系统内的各应用可共享的应用数据库,用于存储桌面应用数据、通过与桌面应用交互而在桌面上显示相应状态数据的其他应用程序数据以及关联设备上报的数据等。在一些实施例中,中控设备中的分布式数据库也可以是为桌面(Launcher)应用提供的数据库,在此不做限制。中控设备中的分布式数据库可以基于Data模板提供的分布式数据管理能力(即DataAbility)实现,该能力可以实现各应用程序管理自身及其他应用程序的存储数据的访问,并提供与其他应用程序共享数据的方法。其中,Data既可用于同设备不同应用的数据共享,也可以支持跨设备不同应用的数据共享。可以理解,各中控设备之间的显示数据的传输可以基于分布软总线实现,或者基于其他无线通信技术实现,在此不做限制。
参考上述图1所示场景,如果中控设备100-1为用户的常用设备,例如是该用户自己房间内的中控设备,该设备上存储有该用户设置的个性化桌面的显示数据。当该用户进入客厅需要通过客厅的中控设备100-2进行控制操作时,此时中控设备100-2则可以通过分布式软总线等数据流转通道向中控设备100-1发送数据获取请求。而中控设备100-1则可以基于接收到的该请求,通过分布式软总线向中控设备100-2发送用户的个性化桌面显示数据,参考图5所示的基于分布式软总线实现的显示数据流转过程。如此,客厅的中控设备100-2上则可以显示该用户的个性化桌面。在此基础上,中控设备100-2还可以进一步显示位于客厅的一些公用家居设备的状态,例如显示饮水机的水温、水质等,以供该用户选择使用。在此不做限制。
在另一些实施例中,中控设备100-1与中控设备100-2之间的显示数据流转也可以通过其他方式,例如中控设备100-1也可以将显示数据通过无线局域网上传至云端。当该用户进入客厅需要通过客厅的中控设备100-2进行控制操作时,中控设备100-2可以从云端获取中控设备100-1的显示数据。本申请对此不做限制。
图6根据本申请实施例示出了一种显示控制方法的实施流程示意图。可以理解,图6所示流程中各步骤的执行主体均为用户当前操作的中控设备,例如可以是上述中控设备100-2。为了便于描述,以下各步骤的执行主体将不再重复描述。
可以理解,图6所示流程并不构成对本申请方案实施流程的具体限制,在另一些实施例中,图6所示各步骤的执行顺序也可以依实施需要进行调整,在此不做限制。
如图6所示,该流程包括以下步骤:
601:检测到用户互动,采集待识别的用户个人信息。
示例性地,用户互动例如可以是用户靠近当前中控设备或者用户触摸当前中控设备屏幕进行的唤醒操作等,在此不做限制。中控设备100-2例如可以基于距离传感器180C等检测到用户靠近,此时中控设备100-2唤醒并在显示桌面之前可以先采集当前靠近的用户个人信息,以识别用户身份。
其中,中控设备100-2此时所采集的用户个人信息可以是用户的人脸信息、指纹信息、声纹信息中的任一项。值得注意的是,中控设备100-2执行本步骤时所采集的用户个人信息的类型可以与用户在常用的中控设备100-1上注册并同步至中控设备100-2的身份信息的类型相对应。其中,中控设备100-1例如是用户的常用设备,例如可以是上述图1所示场景中该用户卧室的中控屏;而中控设备100-2则可以是家居环境中其他房间的中控设备,例如可以是上述图1所示场景中客厅的中控屏,在此不做限制。
如果用户在常用的中控设备100-1上注册并同步至中控设备100-2的身份信息是人脸信息,则中控设备100-2在执行本步骤时可以采集当前靠近的用户的人脸信息并提取人脸特征,以与该用户已注册的人脸数据进行匹配,进而识别该用户身份。类似地,如果用户在常用的中控设备100-1上注册并同步至中控设备100-2的身份信息是指纹信息,则中控设备100-2在执行本步骤时可以采集当前靠近的用户的指纹信息以用于识别用户身份,在此不做限制。
602:判断采集到的用户个人信息是否有匹配的用户身份信息。如果判断结果为是,表明该用户已 在常用中控设备上注册过身份信息,则中控设备100-2可以进一步执行下述步骤603的判断,确定与该用户绑定的常用中控设备信息;如果判断结果为否,表明该用户未曾注册过身份信息,则中控设备100-2无需匹配该用户的常用设备,执行下述步骤606,基于本地显示数据显示桌面。
示例性地,中控设备100-2可以将采集到的用户个人信息,例如人脸信息,与中控设备100-2从其他中控设备(例如中控设备100-1)上同步的各个用户身份信息进行比对,如果能够匹配到与该用户个人信息相同的身份信息,则可以确定该用户是在常用中控设备上注册过身份信息的用户;如果没有与该用户个人信息匹配的身份信息,则可以确定该用户没有注册常用中控设备,例如该用户可能是访客,在此不做限制。
603:判断匹配到的用户身份信息是否有关联的常用中控设备。如果判断结果为是,表明该用户的身份信息已绑定了常用的中控设备,则中控设备100-2可以获取该绑定的中控设备信息,例如中控设备100-1的设备ID(device ID),并继续执行下述步骤604;如果判断结果为否,表明该用户的身份信息尚未绑定常用中控设备,则中控设备100-2可以执行下述步骤606,基于本地显示数据显示桌面。
在一些实施例中,用户身份信息与对应的常用中控设备之间的关联关系可以存储于各中控设备中。因此,中控设备100-2在执行上述步骤时基于采集到的用户个人信息匹配到已注册的用户身份信息后,可以从自身存储的关联关系中确定该用户身份信息对应的中控设备100-1的设备信息,并向该中控设备100-1发送获取显示数据的请求,对应的中控设备100-1基于该请求返回相应显示数据。
在另一些实施例中,用户身份信息与对应的常用中控设备之间的关联关系可以存储于与各中控设备连接的中枢设备中或者预先存储在云端。其中,该中枢设备例如可以是智能家居场景中指定的某一电子设备。中控设备100-2可以在识别该用户的身份信息后将该用户身份信息发送给该中枢设备或云端,由该中枢设备或云端确定该用户身份信息对应的中控设备100-1的设备信息并返回给中控设备100-2,进而中控设备100-2向对应的中控设备100-1发送获取显示数据的请求,对应的中控设备100-1基于该请求返回相应显示数据。
在一些实施例中,用户身份信息与对应的常用中控设备之间的关联关系、以及用户在常用中控设备设置的个性化桌面显示数据均存储在云端。中控设备100-2可以在识别该用户的身份信息后将该用户身份信息发送给云端,云端直接根据存储的关联关系调用该用户身份信息对应的中控设备100-1的显示数据发送至中控设备100-2使用。其中,为了保护用户隐私数据,预先存储在云端的关联关系以及显示数据等可以进行相应的加密处理,在此不做限制。
604:获取匹配到的常用中控设备上的个性化桌面显示数据。
示例性地,中控设备100-2可以基于中控设备100-1的设备ID,向中控设备100-1发送数据获取请求,即获取个性化桌面对应显示数据的请求。相应地,中控设备100-1可以响应于中控设备100-2发来的获取请求,将本地存储的符合该用户喜好或使用习惯的个性化桌面显示数据发送给中控设备100-2。可以理解,在一些实施例中,中控设备100-2向中控设备100-1发送的数据获取请求也可以用于请求与中控设备100-1之间建立显示数据流转通道,以在该流转通道保持期间实时从中控设备100-1获取个性化桌面显示数据。
可选地,中控设备100-2也可以从用户常用的中控设备100-1获取用户的使用数据,该使用数据包括用户在中控设备100-1上的操作习惯对应产生的数据;或者,用户对中控设备100-1的桌面样式进行设置或调整操作等对应产生的数据,在此不做限制。
上述中控设备100-1向中控设备100-2发送个性化桌面显示数据,可以通过该数据流转通道,例如分布式软总线,实现显示数据传输/流转。在另一些实施例中,也可以通过其他通信方式完成显示数据的传输,在此不做限制。
作为示例,用户可以对常用的中控设备100-1所显示的桌面,按照自己的喜好编辑桌面的显示样式。用户对常用的中控设备100-1的桌面进行的编辑操作可以包括:1)调整桌面上显示的全屋服务卡片的顺序及位置,该全屋服务卡片例如可以是全屋恒温、全屋除湿、全屋通风等;2)对常用应用文件夹中的常用进行增删以及顺序调整等;3)设置桌面字体大小以及深浅色显示模式等;4)添加订阅的官方或三方增值服务,例如通过添加相应服务的FA卡片完成;5)设置常执行的场景,添加常控制的设备等,在此不做限制。
相应地,中控设备100-1则可以响应于用户的这些编辑操作,生成相应的显示数据并保存至本地存 储空间,该本地存储空间例如可以是上述图5所示数据流转过程涉及的中控设备100-1的分布式数据库。
605:基于接收到的显示数据,显示个性化桌面。在中控设备100-2执行完本步骤之后,可以继续执行下述步骤607,接收用户在中控设备100-2所显示桌面上的操作输入。
示例性地,中控设备100-2接收到该用户常用的中控设备100-1发来的个性化桌面显示数据后,基于该显示数据进行桌面渲染显示,从而显示符合该用户个人喜好和使用习惯的个性化桌面。可以理解,此时中控设备100-2所显示的个性化桌面,可以包括该用户在中控设备100-1上所设置的字体大小、壁纸、深浅色显示模式,以及各关联设备或应用卡片在桌面上的布局,还有用户订阅的官方或第三方增值服务等,在此不做限制。
作为示例,图7a至7b根据本申请实施例示出了不同用户设置的个性化桌面样式示意图。可以理解,图7a至图7b所示界面并不构成对个性化桌面样式的限制,在另一些实施例中,不同用户所设置的个性化桌面也可以为其他样式。
如果该用户是老人,例如可以将桌面样式设置为图7a所示的简易模式桌面710,该简易桌面710的显示字号较大,桌面布局也较为扁平化,便于用户识别使用各控件。相应地,中控设备100-2基于接收到的显示数据所显示的个性化桌面,则可以参考图7a所示的简易模式桌面710。参考图7a所示,中控设备100-2在显示简易模式桌面710时,该桌面上还可以显示用户身份识别成功的提示信息711,例如图7a所示的“识别到主人身份,已进入简易模式”。
如果该用户是儿童,则可以设置为图7b所示的儿童模式桌面720,该儿童模式桌面720上可以自动屏蔽儿童对一些电器设备的威胁操作,设定操作边界,例如对一些家居设备功能卡片721上锁,并显示图7b所示的“设备已锁”以及“请爸爸妈妈来帮忙解锁使用哦~”等提示内容,儿童模式桌面720的显示样式比较卡通化,还可以显示学习频道722供儿童选择性观看或收听,还可以自动控制一些智能家居设备进入儿童安全模式,例如可以控制将家中的饮水机温度上限值调整至安全温度37℃范围内,儿童可以点击“我要喝水”723进行安全饮水等。相应地,中控设备100-2基于接收到的显示数据所显示的个性化桌面,则可以参考图7b所示的儿童模式桌面720等,在此不做限制。
参考图7b所示,中控设备100-2在显示儿童模式桌面720时,该桌面上也可以显示用户身份识别成功的提示信息724,例如图7b所示的“识别到小主人身份,已进入儿童模式”。在此不做限制。
可以理解,在一些实施例中,中控设备100-2在基于接收到的个性化显示数据进行桌面渲染显示时,还可以显示当前中控设备100-2所在空间内的关联家居设备的卡片信息或者控制窗口,在此不做限制。
606:基于本地显示数据,显示本地桌面。在中控设备100-2执行完本步骤之后,可以继续执行下述步骤607,接收用户在中控设备100-2所显示桌面上的操作输入。
示例性地,如果中控设备100-2执行上述步骤602时确认所采集到的用户个人信息未匹配到已注册的用户身份信息,或者中控设备100-2执行上述步骤603时确认匹配到的用户身份信息尚未关联常用中控设备,则可以显示本机桌面,即基于本地显示数据渲染显示的桌面。可以理解,中控设备100-2的本机桌面可以是该设备的出厂默认桌面,也可以是基于该中控设备100-2当前所在空间内的关联家居设备动态调整显示的桌面,在此不做限制。
607:响应于用户在桌面上的相关操作,并执行相应处理。
示例性地,用户可以在中控设备100-2所显示的桌面上查看订阅的增值服务资讯、操作播放音乐、控制打开大屏电视,或者点击全屋通风等全屋服务卡片开启空调设备等,中控设备100-2则可以响应用户的操作,显示相应应用界面(例如显示音乐播放界面),或者向关联的家居设备发送相关控制指令,例如向大屏电视发送开启指令、以及播放指定视频内容的指令等。
608:检测到用户离开超过预设时间,断开数据流转并熄屏。
示例性地,中控设备100-2可以基于距离传感器检测到用户远离,中控设备100-2例如可以在用户远离预设距离后超过预设时间的情况下,确认用户不需要再使用当前的桌面,此时中控设备100-2则可以断开与中控设备100-1之间的显示数据流转通道,并熄屏进入休眠状态。
可以理解,基于上述图6所示的实施流程,用户在转移到不常用的中控设备100-2上进行控制操作时,即用户当前位于中控设备100-2前,当前中控设备100-2则能够识别到用户身份并获取用户常用中控设备100-1上的个性化桌面显示数据,进而中控设备100-2可以显示符合该用户喜好或使用习惯的个性化桌面供用户使用。如此,可以方便用户操作,提高用户的使用体验。
图8根据本申请实施例示出了一种用户在常用中控设备上注册用户身份信息、以及设置与用户身份信息相关联的常用中控设备的实施流程示意图。可以理解,图8所示流程并不构成对本申请方案实施流程的具体限制,在另一些实施例中,图8所示各步骤的实施顺序也可以依需求调整,在此不做限制。
如图8所示,该流程包括以下步骤:
801:设备初始化,在任一中控设备上登录主账户。
示例性地,在全屋完成安装中控设备之后,用户可以操作将各中控设备接入统一的可信组网并登录主账户,例如统一接入WiFi,进而各中控设备之间可以建立可信关系、通信通道(例如Hilink)和数据传输通道(例如分布式软总线)。
可以理解,在一些全屋智能家居场景中,一个全屋场景可以配置一个主账户,用于管理该全屋场景中的各中控设备,登录该主账户后用户所进行的设置操作或设备管理操作对应的相关操作结果数据可以同步至各中控设备。例如,在任一中控设备上登录该主账户后,用户可以统一为各中控设备设置默认桌面、添加待控制的家居设备等。在另一些实施例中,用户也可以在中控设备以外的其他电子设备上登录该主账户对各中控设备进行管理,例如在平板电脑或者笔记本电脑上登录该主账户,在此不做限制。
802:创建家庭群组,并创建各家庭成员子账户。
示例性地,用户在登录主账户后,可以创建一个家庭群组,以添加/设置多个家庭成员子账户,例如为M个家庭成员分别创建M个子账户。如此,各家庭成员可以通过登录子账户来进行一些个性化设置。
可以理解,在本申请实施例中,为了方便描述,在图8所示流程各步骤中以家庭成员进行描述,各家庭成员即使用各中控设备的用户,除非特别说明,二者不做区分。
803:设置各中控设备的常用家庭成员子账户信息。
示例性地,在全屋智能家居场景中,每个中控设备可以对应设置一个常用的家庭成员子账户信息,例如某全屋场景中有N个中控设备分布在各个房间内,则可以对各个房间内的中控设备设置对应居住的家庭成员子账户信息,作为该中控设备的常用子账户,以建立各中控设备与家庭成员之间的关联关系。
可以理解,在另一些实施例中,全屋场景中某个房间可能会有多个常用的家庭成员,此种情形下,某个中控设备上也可以设置多个家庭成员子账户信息,在此不做限制。
804:各中控设备的设备信息与家庭成员子账户信息之间建立关联关系。
示例性地,各中控设备的设备信息例如是设备ID,各中控设备与家庭成员子账户信息之间建立的关联关系例如可以是一对一或者一对多的关系,在此不做限制。
805:各家庭成员在关联的常用中控设备上注册身份信息。
示例性地,各家庭成员可以在关联的常用设备上登录子账户并注册用于识别用户身份的人脸数据、指纹数据或者声纹数据等某一项作为身份信息,以在使用各中控设备时用于动态识别用户身份以匹配相应的用户常用中控设备的设备信息。
806:各家庭成员的身份信息与已设置的家庭成员子账户关联。
可以理解,各家庭成员在常用中控设备上登录子账户并注册身份信息后,该身份信息则可以与相应登录的家庭成员子账户信息关联,进而也可以关联相应的中控设备信息。
可以理解,用户与常用中控设备之间建立关联关系的过程并不局限于上述步骤804至步骤806所描述的过程。在另一些实施例中,中控设备也可以根据各用户使用该中控设备频次的高低,主动与使用频次最高的用户身份信息建立关联关系。或者,中控设备还可以通过用户的手持设备等获取到用户所在位置,据此统计用户在该中控设备所在房间的时长,从而与经常待在该中控设备所在房间的用户主动建立关联关系,即主动关联该用户的身份信息。在此不做限制。
参考图9所示,以注册的身份信息为人脸数据为例,各家庭成员子账户下可以一方面关联各家庭成员的人脸数据,另一方面关联各家庭成员常用的中控设备。如此,当用户在使用某一中控设备进行人脸识别确定用户身份时,该中控设备便可以基于图9所示的关联对应关系快速匹配到关联家庭子账户对应关联的中控设备,进而获取该中控设备的设备信息。
807:存储并在各中控设备上同步各中控设备信息、关联家庭成员子账户信息、以及关联家庭成员的身份信息。
示例性地,用户在执行上述步骤804至806完成中控设备信息、家庭成员子账户信息、以及家庭成员的用户身份信息之间关联关系的建立后,可以将相互关联的中控设备信息、关联家庭成员子账户信息、 以及关联家庭成员的身份信息存储至相应中控设备的分布式数据库中,进而各中控设备之间可以基于Hilink通道等完成上述各信息和关联关系的同步。如此,也可以保障各中控设备之间同步的用户身份信息等信息中隐私数据的安全。
在另一些实施例中,各中控设备信息、关联家庭成员子账户信息、以及关联家庭成员的身份信息也可以通过其他方式在各中控设备之间实现信息同步,例如统一发送给智能家居场景中的某个中控设备进行管理以及在各中控设备之间同步,或者上传至云端进行统一管理以及在各中控设备之间同步等,在此不做限制。
图10根据本申请实施例示出了一种显示控制方法的交互流程示意图。可以理解,图10所示流程涉及中控设备100-1与中控设备100-2之间的交互,其中,中控设备100-1例如是用户的常用设备,例如该用户卧室的中控屏;而中控设备100-2则可以是家居环境中其他房间的中控设备,例如客厅的中控屏,在此不做限制。
具体地,如图10所示,该流程包括以下步骤:
1001:中控设备100-1存储关联用户注册的人脸信息,并设定为该用户的常用中控设备。
示例性地,用户可以在常用的中控设备,例如中控设备100-1上注册个人的身份信息,该身份信息例如可以包括人脸信息、指纹信息、声纹信息等,在此不做限制。以人脸信息为例,用户在中控设备100-1上注册人脸信息时,可以完成用户人脸信息与中控设备100-1的设备信息(例如设备id)之间的关联关系绑定,这相当于将家居环境中的中控设备100-1标记为该用户的常用中控设备。
具体在中控设备100-1上注册用户身份信息、以及将用户身份与常用中控设备之间建立关联关系的详细过程,可以参考上述图8所示流程中步骤803至806中的相关描述,在此不做赘述。
1002:中控设备100-1向中控设备100-2同步已注册的用户身份信息、以及中控设备100-1与用户身份信息之间的关联关系。
示例性地,中控设备100-1可以基于信息中枢之间的Hilink通道实现静态设备信息的同步,包括同步已注册的用户身份信息、以及中控设备100-1与用户身份信息之间的关联关系等。
在另一些实施例中,中控设备100-1向中控设备100-2同步已注册的用户身份信息、以及中控设备100-1与用户身份信息之间的关联关系等设备静态信息,也可以通过其他通信技术实现,例如通过WiFi、蓝牙等通信方式实现,在此不做限制。
可以理解,在本申请实施例中,中控设备100-1向中控设备100-2同步已注册的用户身份信息、以及中控设备100-1与用户身份信息之间的关联关系只是一种示例性的说明,在另一些实施例中,中控设备100-1也可以将获取到的用户身份信息、以及中控设备100-1与用户身份信息之间的关联关系上传至云端,以实现在云端确定与中控设备100-2采集的用户个人信息相对应的中控设备100-1的设备信息反馈给中控设备100-2等过程,在此不做限制。
1003:中控设备100-1存储用户为桌面设置的个性化显示数据。
具体地,用户对常用的中控设备100-1的桌面进行编辑操作的过程可以参考上述步骤604中相关描述,用户对常用的中控设备100-1设置的个性化桌面显示样式可以参考上述图7a或图7b所示,在此不做赘述。
1004:中控设备100-2检测到用户靠近。
示例性地,中控设备100-2可以基于距离传感器180C等检测到用户靠近,具体过程可以参考上述步骤601中相关描述,在此不再赘述。
1005:中控设备100-2触发人脸识别。
示例性地,中控设备100-2检测到用户靠近后可以启动摄像头193以采集人脸信息进行人脸识别。在另一些实施例中,中控设备100-2检测到用户靠近后也可以触发其他身份识别方式,例如触发指纹识别等。
1006:中控设备100-2检测到人脸信息。
示例性地,中控设备100-2启动摄像头193后可以检测到当前靠近的用户人脸信息,即采集待识别的人脸信息的过程。具体采集人脸信息的过程可以参考上述步骤601中相关描述,在此不再赘述。
值得注意的是,中控设备100-2执行本步骤时所采集的用户个人信息的类型可以与上述步骤1001至1002中用户在中控设备100-1上注册并同步至中控设备100-2的身份信息的类型相对应。
1007:中控设备100-2判断检测到的人脸信息是否已注册。若判断结果为是,表明检测到的人脸信息已注册,则继续执行下述步骤1008,匹配常用中控设备;若判断结果为否,表明检测到的人脸信息未注册,则可以执行下述步骤1012,显示本地桌面。
示例性地,中控设备100-2可以将检测到的人脸信息与分布式数据库中获取的各家庭成员(或者说用户)已注册的人脸数据进行比对,以判断检测到的人脸信息是否已注册。具体判断过程可以参考上述步骤605中相关描述,在此不再赘述。
1008:中控设备100-2判断是否存在与检测到的人脸信息匹配的常用中控设备。若判断结果为是,表明当前用户已设置常用中控设备,则继续执行下述步骤1009,获取常用中控设备上的个性化显示数据;若判断结果为否,表明当前用户未设置常用中控设备,则可以执行下述步骤1012,显示本地桌面。
具体判断过程可以参考上述步骤603中相关描述,在此不再赘述。
1009:中控设备100-2向中控设备100-1发送获取个性化桌面对应显示数据的请求。
1010:中控设备100-1向中控设备100-2发送个性化桌面显示数据。
示例性地,中控设备100-2在确定当前用户已注册人脸数据并且已设置常用中控设备后,可以获取该常用中控设备的设备信息,例如中控设备100-1的设备ID等,进而可以基于该设备信息向中控设备100-1发送显示数据获取请求,进而中控设备100-1可以响应于该获取请求,向中控设备100-2返回该用户设置的个性化桌面对应的显示数据。
具体获取个性化显示数据的过程可以参考上述步骤604中相关描述,在此不再赘述。
1011:基于接收到的显示数据,显示个性化桌面。
示例性地,中控设备100-2可以基于接收到的个性化桌面对应的显示数据,进行绘制渲染,从而显示符合当前用户喜好及使用习惯的个性化桌面供当前用户使用,因此能够有效提高用户使用体验。具体显示个性化桌面的过程也可以参考上述步骤605中相关描述,在此不再赘述。
1012:基于本地显示数据,显示本地桌面。
示例性地,中控设备100-2在确定当前用户并未注册人脸数据、或者并未设置常用中控设备后,可以基于本地显示数据,显示本地桌面,例如基于默认设置显示通用桌面。
具体显示本地桌面的过程也可以参考上述步骤606中相关描述,在此不再赘述。
1013:响应用户在桌面上的相关操作,并执行相应处理。
具体中控设备100-2响应用户在所显示的桌面上进行的相关操作的过程,可以参考上述步骤607中相关描述,在此不再赘述。
可以理解,在一些实施例中,用户也可以在中控设备100-2所显示的桌面上调整桌面显示样式,中控设备100-2可以将接收到的用户操作生成相应的操作指令,通过分布式软总线发送给中控设备100-1进行响应,即远程控制中控设备100-1响应于该操作指令,从而实现变更相应个性化桌面的显示数据。如果此时中控设备100-2所显示的桌面是基于接收到的显示数据显示的个性化桌面,则此时中控设备100-2可以基于与中控设备100-1之间的显示数据流转通道,例如分布式软总线,将用户调整桌面显示样式的操作所引起变更的显示数据实时保存至中控设备100-1的分布式数据库中,以更新流转至中控设备100-2上渲染显示的数据源,该数据源即中控设备100-1上存储的个性化桌面显示数据。在此不做限制。
1014:检测到用户离开超过预设时间,断开数据流转并熄屏。
具体中控设备100-2断开数据流转并熄屏的过程,可以参考上述步骤608中相关描述,在此不再赘述。
在说明书对“一个实施例”或“实施例”的引用意指结合实施例所描述的具体特征、结构或特性被包括在根据本申请实施例公开的至少一个范例实施方案或技术中。说明书中的各个地方的短语“在一个实施例中”的出现不一定全部指代同一个实施例。
本申请实施例的公开还涉及用于执行文本中的操作装置。该装置可以专门处于所要求的目的而构造或者其可以包括被存储在计算机中的计算机程序选择性地激活或者重新配置的通用计算机。这样的计算机程序可以被存储在计算机可读介质中,诸如,但不限于任何类型的盘,包括软盘、光盘、CD-ROM、磁光盘、只读存储器(ROM)、随机存取存储器(RAM)、EPROM、EEPROM、磁或光卡、专用集成电路(ASIC)或者适于存储电子指令的任何类型的介质,并且每个可以被耦合到计算机系统总线。此外,说明书中所 提到的计算机可以包括单个处理器或者可以是采用针对增加的计算能力的多个处理器涉及的架构。
另外,在本说明书所使用的语言已经主要被选择用于可读性和指导性的目的并且可能未被选择为描绘或限制所公开的主题。因此,本申请实施例公开旨在说明而非限制本文所讨论的概念的范围。

Claims (19)

  1. 一种显示控制方法,应用于智能家居系统,所述智能家居系统包括具有屏幕的第一电子设备和第二电子设备,其特征在于,所述方法包括:
    第一电子设备对当前的第一用户进行识别;
    第一电子设备根据所述识别结果从第二电子设备获取与所述第一用户相对应的第一显示数据,并基于所述第一显示数据显示第一控制界面,其中所述第一显示数据与所述第一用户对所述第二电子设备的使用数据相关联。
  2. 根据权利要求1所述的方法,其特征在于,所述第一控制界面包括多个控件,所述控件用于控制智能家居系统中的智能家居设备。
  3. 根据权利要求1所述的方法,其特征在于,所述智能家居系统还包括具有屏幕的第三电子设备,并且所述方法还包括:
    第一电子设备对当前的第二用户进行识别;
    第一电子设备根据所述识别结果从第三电子设备获取与所述第二用户相对应的第二显示数据,并基于所述第二显示数据显示第二控制界面,其中所述第二显示数据与所述第二用户对所述第三电子设备的使用数据相关联。
  4. 根据权利要求1所述的方法,其特征在于,所述第一电子设备根据所述识别结果从第二电子设备获取与所述第一用户相对应的第一显示数据,包括:
    获取用于识别所述第一用户的第一用户数据;
    基于所述第一用户数据与所述第二电子设备之间的第一关联关系,确定所述第二电子设备的设备信息;
    基于所述第二电子设备的设备信息向所述第二电子设备发送数据获取请求,以获取所述第一显示数据。
  5. 根据权利要求4所述的方法,其特征在于,所述第一电子设备通过以下方式获取所述第一用户数据:
    检测到用户互动,采集所述第一用户的第一用户数据;或者,
    从第三电子设备接收所述第一用户数据。
  6. 根据权利要求5所述的方法,其特征在于,所述检测到用户互动,包括下列情形中的任一项:
    检测到用户靠近;
    检测到用户对所述第一电子设备屏幕的触控操作;
    检测到用户对所述第一电子设备上按键的按压操作。
  7. 根据权利要求4至6中任一项所述的方法,其特征在于,所述第一用户数据包括:
    人脸识别数据、指纹识别数据、声纹识别数据中的任一项。
  8. 根据权利要求4所述的方法,其特征在于,所述基于所述第一用户数据与所述第二电子设备之间的第一关联关系,确定所述第二电子设备的设备信息,包括:
    基于从第二电子设备预先获取的所述第一关联关系,确定所述第二电子设备的设备信息。
  9. 根据权利要求8所述的方法,其特征在于,所述第二电子设备生成所述第一关联关系的方式包括下列中的任一项:
    基于检测到的所述第一用户输入第一用户数据的操作、以及将所述第二电子设备设置为与所述第一用户关联的常用设备的操作,生成所述第一关联关系;
    基于所述第一用户对所述第二电子设备的使用频次,生成所述第一关联关系;
    基于所述第一用户所在位置与所述第二电子设备所在位置同处于第一空间的统计时长,生成所述第一关联关系,其中所述第一用户所在位置通过第四电子设备采集的位置数据确定。
  10. 根据权利要求7所述的方法,其特征在于,所述第一电子设备从第二电子设备预先获取所述第一关联关系的方式包括:
    所述第一电子设备通过开放物联网通信协议接收所述第二电子设备同步的所述第一关联关系;或者,
    所述第一电子设备通过开放物联网通信协议向所述第二电子设备发送获取请求,并接收所述第二电 子设备响应于所述获取请求返回的所述第一关联关系。
  11. 根据权利要求10所述的方法,其特征在于,所述开放物联网通信协议为HiLink通信协议。
  12. 根据权利要求1至11中任一项所述的方法,其特征在于,所述第二电子设备包括第二控制界面,所述第一用户对所述第二电子设备的使用数据,包括以下至少一项:
    根据所述第一用户的操作习惯获取的数据;或者,
    根据所述第一用户对所述第二控制界面的显示内容的调整操作获取的数据。
  13. 根据权利要求1至12中任一项所述的方法,其特征在于,所述方法还包括:
    在所述第一电子设备基于所述第一显示数据显示第一控制界面之前,所述第一电子设备显示第三控制界面;
    所述基于所述第一显示数据显示第一控制界面,包括:基于所述第一显示数据,将所述第三控制界面切换显示为所述第一控制界面。
  14. 根据权利要求1至13中任一项所述的方法,其特征在于,所述第一电子设备与所述第二电子设备基于WiFi、蓝牙或者分布式软总线中的任一项建立数据传输通道,所述数据传输通道用于在将所述第一显示数据由第二电子设备传输至第一电子设备。
  15. 根据权利要求1至13中任一项所述的方法,其特征在于,所述第一控制界面为桌面应用的界面,并且所述第一显示数据包括下列中的至少一项:
    所述桌面应用的应用数据、与所述桌面应用交互的第一应用的应用数据、以及所述第一控制界面上的控件对应控制的智能家居设备的设备数据。
  16. 一种显示控制方法,应用于智能家居系统,所述智能家居系统包括具有屏幕的第一电子设备和第二电子设备,其特征在于,所述方法包括:
    第二电子设备接收第一电子设备对第一显示数据的获取请求,其中,所述第一显示数据用于显示所述第一电子设备的第一控制界面,所述第一显示数据由第二电子设备根据第一用户对所述第二电子设备的使用数据生成;
    响应于所述获取请求,所述第二电子设备向所述第一电子设备发送所述第一显示数据。
  17. 根据权利要求16所述的方法,其特征在于,所述第二电子设备包括第二控制界面,所述第二电子设备的使用数据,包括:
    所述第二电子设备基于所述第一用户的操作习惯获取的数据;或者,
    所述第二电子设备基于用户对第二控制界面的显示内容的调整操作获取的数据。
  18. 一种电子设备,其特征在于,包括:一个或多个处理器;一个或多个存储器;所述一个或多个存储器存储有一个或多个程序,当一个或者多个程序被所述一个或多个处理器执行时,使得所述电子设备执行权利要求1至15中任一项所述的显示控制方法、或者执行权利要求16或17所述的显示控制方法。
  19. 一种计算机可读存储介质,其特征在于,所述存储介质上存储有指令,所述指令在计算机上执行时使所述计算机执行权利要求1至15中任一项所述的显示控制方法、或者执行权利要求16或17所述的显示控制方法。
PCT/CN2023/106604 2022-07-11 2023-07-10 显示控制方法、电子设备及计算机可读存储介质 WO2024012413A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210818264.2 2022-07-11
CN202210818264.2A CN117424772A (zh) 2022-07-11 2022-07-11 显示控制方法、电子设备及计算机可读存储介质

Publications (1)

Publication Number Publication Date
WO2024012413A1 true WO2024012413A1 (zh) 2024-01-18

Family

ID=89531324

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/106604 WO2024012413A1 (zh) 2022-07-11 2023-07-10 显示控制方法、电子设备及计算机可读存储介质

Country Status (2)

Country Link
CN (1) CN117424772A (zh)
WO (1) WO2024012413A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110688179A (zh) * 2019-08-30 2020-01-14 华为技术有限公司 一种显示方法及终端设备
CN111752443A (zh) * 2019-03-28 2020-10-09 华为技术有限公司 显示设备控制页面的方法、相关装置及系统
CN112558491A (zh) * 2020-11-27 2021-03-26 青岛海尔智能家电科技有限公司 基于语音识别的家庭场景联动智能家居系统及其控制方法、控制装置
WO2022088964A1 (zh) * 2020-10-31 2022-05-05 华为技术有限公司 一种电子设备的控制方法和装置
CN115826418A (zh) * 2021-09-16 2023-03-21 华为技术有限公司 一种智能家居控制方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111752443A (zh) * 2019-03-28 2020-10-09 华为技术有限公司 显示设备控制页面的方法、相关装置及系统
CN110688179A (zh) * 2019-08-30 2020-01-14 华为技术有限公司 一种显示方法及终端设备
WO2022088964A1 (zh) * 2020-10-31 2022-05-05 华为技术有限公司 一种电子设备的控制方法和装置
CN112558491A (zh) * 2020-11-27 2021-03-26 青岛海尔智能家电科技有限公司 基于语音识别的家庭场景联动智能家居系统及其控制方法、控制装置
CN115826418A (zh) * 2021-09-16 2023-03-21 华为技术有限公司 一种智能家居控制方法

Also Published As

Publication number Publication date
CN117424772A (zh) 2024-01-19

Similar Documents

Publication Publication Date Title
CN110336720B (zh) 设备控制方法和设备
WO2021109422A1 (zh) 待机控制方法及显示设备
WO2020192714A1 (zh) 显示设备控制页面的方法、相关装置及系统
CN105681969B (zh) 电子装置、音频装置、控制电子装置和音频装置电源的方法
EP2955907B1 (en) Wearable electronic device, system and control method
US20170060599A1 (en) Method and apparatus for awakening electronic device
US11159669B2 (en) Attachment device and method for controlling electronic device thereof
WO2020155014A1 (zh) 智能家居设备分享系统、方法及电子设备
WO2021218442A1 (zh) 通信方法、控制物联网设备的方法、电子设备
CN110543289A (zh) 控制音量的方法和电子设备
WO2023083262A1 (zh) 基于多设备提供服务的方法、相关装置及系统
WO2021013136A1 (zh) 一种设备的控制方法及电子设备
WO2019206039A1 (zh) 未读消息处理方法及终端
US20240095329A1 (en) Cross-Device Authentication Method and Electronic Device
JP7436532B2 (ja) ディスプレイ装置及びその制御方法
CN114286165A (zh) 一种显示设备、移动终端及投屏数据传输方法
EP4391459A1 (en) Scenario synchronization method and apparatus, and electronic device and readable storage medium
CN108919658A (zh) 智能设备控制方法及装置
WO2020187050A1 (zh) 一种显示设备
CN108282388B (zh) 用于向家居设备传递数据信息的装置与方法
WO2021121036A1 (zh) 一种折叠设备的自定义按键方法、设备及存储介质
WO2024012413A1 (zh) 显示控制方法、电子设备及计算机可读存储介质
CN112218145A (zh) 智能电视、vr显示设备以及相关方法
WO2023051643A1 (zh) 设备控制方法、相关装置及通信系统
WO2023024996A1 (zh) 一种显示方法及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23838905

Country of ref document: EP

Kind code of ref document: A1