CN115173938A - Method and device for determining noticed device and head-mounted electronic device - Google Patents

Abstract

The application relates to the field of terminal artificial intelligence, in particular to a method and a device for determining an attention-paid device and a head-mounted electronic device, wherein the method is applied to the head-mounted electronic device, the head-mounted electronic device comprises a central Li-Fi receiver and side Li-Fi receivers positioned on two sides of the central receiver, and the orientation of a receiving end of the central Li-Fi receiver is consistent with the direction faced by the face of a user wearing the head-mounted electronic device, and the method comprises the following steps: and determining an attention device according to the light power of the device received by the central Li-Fi receiver and the side Li-Fi receiver, wherein the attention device is determined when the light power of the device received by the central Li-Fi receiver is greater than the light power of the device received by the side Li-Fi receiver. Under the condition that a plurality of devices are awakened by voice instructions of a user together, the device in which the attention of the user is focused can be determined, and the user experience is improved.

Description

A method, device and head-mounted electronic device for determining a device to be noticed

technical field

The present application relates to the field of terminal artificial intelligence, and in particular, to a method, an apparatus and a head-mounted electronic device for determining a device to be noticed.

Background technique

With the continuous popularization of all-scenario smart devices, users' lives have become more convenient. However, when the user is in an environment with multiple full-scene smart devices, it is impossible to accurately prepare to judge which full-scene smart device the user's attention is focused on. This problem is critical for some scenarios. For example, in the scenario where multiple full-scene smart devices are awakened by the voice assistant together, when the user calls the voice assistant, the best experience is to accurately wake up the user's attention. The voice assistant on that all-scenario smart device.

SUMMARY OF THE INVENTION

In view of the above problems in the prior art, the purpose of the present application is to provide a method, an apparatus and a head-mounted electronic device for determining an attention device, which can determine the user's attention when multiple smart devices are awakened by the user's voice together. The device that focuses on improving the user experience.

In a first aspect of the embodiments of the present application, a method for determining an attention device is provided, the method is applied to a head-mounted electronic device, and the head-mounted electronic device includes: a central Li-Fi receiver and a The side Li-Fi receivers on both sides of the central Li-Fi receiver, the direction of the receiving end of the central Li-Fi receiver is consistent with the direction facing the face of the user wearing the head-mounted electronic device, so The orientation of the receiving end of the side Li-Fi receiver is at a first angle with respect to the orientation of the receiving end of the central Li-Fi receiver, and the method includes: passing the central Li-Fi receiver and the side Li-Fi The Fi receiver receives the Li-Fi optical signal transmitted by the device; when the optical power of the Li-Fi optical signal of the device received by the central Li-Fi receiver is greater than all the Li-Fi optical signals received by the side Li-Fi receiver When the optical power of the Li-Fi optical signal of the device is determined, the device is the device to be noticed.

Through the above settings, when the user's face is facing a certain device, it means that the user's attention will be focused on this device with a high probability. The optical power of the Li-Fi optical signal is greater than the optical power of the Li-Fi optical signal received by the side Li-Fi receiver, so that the device being noticed can be determined.

In a possible implementation manner, the method further includes: when there are multiple devices to be noticed, acquiring the distance between the central Li-Fi receiver and the device to be noticed; The relationship between the distance between the devices to be noticed and the degree of attention is determined, and the device with the highest degree of attention is determined as the device to be noticed.

Through the above settings, when the number of devices to be noticed is multiple, the only device to be noticed can be determined according to the relationship between the distance and the degree of attention between the central Li-Fi receiver and the device to be noticed, avoiding the need for Multiple rounds of voice interaction between users and devices to improve user experience.

In a possible implementation manner, the obtaining of the distance includes: according to the optical power of the noted device received by the central Li-Fi receiver, and the transmit power of the Li-Fi optical signal of the noted device , determine the distance between the noted device and the central Li-Fi receiver.

In a possible implementation manner, the distance between the noted device and the central Li-Fi receiver may also be directly acquired through a distance sensor.

Through the above settings, when the user is using the device, the distance from the device is usually relatively fixed. For example, when the user is using a TV, mobile phone, or air conditioner, the distance between the user and the TV, mobile phone, and air conditioner is usually relatively fixed and different. The same, therefore, when the number of attentive devices is multiple, the only attentive device on which the user's attention is focused can be determined based on the distance between the user and the attentive device.

In a possible implementation manner, the step of establishing the relationship between the distance between the central Li-Fi receiver and the device and the degree of attention includes: when the head-mounted electronic device is used, periodically collecting the The distance between the central Li-Fi receiver and the device, and the frequency of use of the device at that distance; the distance between the central Li-Fi receiver and the device is established from the distance and the frequency of use relationship with attention span.

Through the above setting, it is possible to collect multiple times of the user using each device at different distances in a long period of time. For example, in the first 6 months of the user's use of the head-mounted electronic device, the distance between the user and each device and the usage of each device at the current distance are collected every 2 minutes, so as to obtain the user's use at different distances. The number of times for each device. Since the distance from each device is relatively fixed and different when the user uses different devices, the more times the user uses a certain device at a certain distance, it indicates that the user's attention at this distance is focused on this The greater the possibility of a device, the relationship between the distance and the degree of attention between the user and the device is obtained, so as to prepare for determining the device on which the user's attention is focused.

In a possible implementation manner, before determining the noticed device, the method further includes: according to the received voice instruction, according to the information received by the central Li-Fi receiver and/or the side Li-Fi receiver The Li-Fi optical signal sent by the device determines the identity ID information of the device contained in the Li-Fi optical signal.

Through the above settings, other devices in the environment where the user is located that are not supported by the present application can be excluded, and the trusted devices supported by the present application can be determined.

In a possible implementation manner, the head-mounted electronic device includes: glasses and earphones.

In a second aspect of the embodiments of the present application, there is provided a device for determining an attention device, the device being applied to a head-mounted electronic device, and the head-mounted electronic device includes: a central Li-Fi receiver and a The side Li-Fi receivers on both sides of the central Li-Fi receiver, the direction of the receiving end of the central Li-Fi receiver is consistent with the direction facing the face of the user wearing the head-mounted electronic device, so The orientation of the receiving end of the side Li-Fi receiver is at a first angle relative to the orientation of the receiving end of the central Li-Fi receiver, and the device includes: a Li-Fi optical signal receiving module, which is used for passing through the central Li-Fi receiver. The Li-Fi receiver and the side Li-Fi receiver receive the Li-Fi optical signal transmitted by the device; the attention device determination module is used for when the central Li-Fi receiver receives the Li-Fi light signal of the device - When the optical power of the Fi optical signal is greater than the optical power of the Li-Fi optical signal of the device received by the side Li-Fi receiver, the device is determined as an attention device.

In a possible implementation manner, the noted device determining module is further configured to: when there are multiple noted devices, obtain the distance between the central Li-Fi receiver and the noted device;

According to the relationship between the distance and the attention degree between the central Li-Fi receiver and the attention device, the device with the highest attention degree is determined as the attention device.

In a possible implementation manner, the obtaining of the distance includes:

According to the optical power of the attentive device received by the central Li-Fi receiver and the transmit power of the Li-Fi optical signal of the attentive device, determine the attentive device and the central Li-Fi receiver the distance.

In a possible implementation manner, the distance between the noted device and the central Li-Fi receiver may also be directly acquired through a distance sensor.

In a possible implementation manner, the steps of establishing the relationship between the distance between the central Li-Fi receiver and the device and the degree of attention include:

When the head-mounted electronic device is used, periodically collect the distance between the central Li-Fi receiver and the device, and the frequency of use of the device under the distance;

A relationship between the distance and the level of attention between the central Li-Fi receiver and the device is established from the distance and the frequency of use.

In a possible implementation manner, before determining the noticed device, the apparatus further includes:

A device identity ID information determination module, which is used to determine the Li-Fi optical signal sent by the device received by the central Li-Fi receiver and/or the side Li-Fi receiver according to the received voice command. The identity ID information of the device contained in the Li-Fi optical signal.

In a possible implementation manner, the head-mounted electronic device includes: glasses and earphones.

The technical effects brought by the apparatus for determining an attention device provided by the second aspect of the embodiments of the present application and possible implementations thereof are the same as those provided by the method for determining an attention device provided by the first aspect and possible implementation modes of the embodiments of the present application. The technical effects brought about are the same, and for the sake of brevity, details are not repeated here.

In a third aspect of the embodiments of the present application, a head-mounted electronic device is provided, including: the apparatus for determining a device to be noticed provided by the second aspect of the embodiments of the present application and any possible implementation manners thereof; a central Li-Fi reception the receiver and the side Li-Fi receivers located on both sides of the central receiver, the receiving end of the central Li-Fi receiver is oriented in the same direction as the face of the user wearing the head-mounted electronic device, The orientation of the receiving end of the side Li-Fi receiver is at a first angle with respect to the orientation of the receiving end of the central Li-Fi receiver.

The technical effect brought by the head-mounted electronic device provided by the third aspect of the embodiment of the present application is the same as the technical effect brought by the method for determining the device to be noticed provided by the first aspect of the embodiment of the present application and its possible implementations, For the sake of brevity, details are not repeated here.

These and other aspects of the present application will be more clearly understood in the following description of the embodiment(s).

Description of drawings

The various features of the present application and the connections between the various features are further explained below with reference to the accompanying drawings. The drawings are exemplary, some features are not shown to scale, and some of the drawings may omit features that are customary in the field to which the application relates and not essential to the application, or additionally show The non-essential features of the present application, and the combination of individual features shown in the drawings are not intended to limit the present application. In addition, the same reference numerals refer to the same contents throughout the present specification. The specific drawings are described as follows:

FIG. 1 shows a schematic diagram of a specific application scenario of a method for determining an attention device provided by an embodiment of the present application;

FIG. 2 shows a schematic structural diagram of a specific implementation manner of a head-mounted electronic device provided by an embodiment of the present application;

FIG. 3 shows a schematic structural diagram of another specific implementation manner of the head-mounted electronic device provided by the embodiment of the present application;

FIG. 4 shows a flowchart of a method for determining an attention device provided by an embodiment of the present application;

Fig. 5 shows the correlation curve between the distance and the attention degree of each smart device of the central Li-Fi receiver provided by the embodiment of the present application;

6 shows a schematic block diagram of an apparatus for determining an attention device provided by an embodiment of the present application;

FIG. 7 shows a schematic block diagram of a computing device provided by an embodiment of the present application.

Detailed ways

The technical solutions involved in the specific embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments. Before describing the specific content of the technical solution, the terms used in this application are briefly explained.

The words "first, second, third, etc." in the description and claims, or similar terms such as module A, module B, module C, etc., are only used to distinguish similar objects, and do not represent a specific ordering of objects, which can be understood Indeed, where permitted, the specific order or sequence may be interchanged to enable the embodiments of the application described herein to be practiced in sequences other than those illustrated or described herein.

The term "comprising" used in the description and claims should not be interpreted as being limited to what is listed thereafter; it does not exclude other elements or steps. Accordingly, it should be interpreted as specifying the presence of said features, integers, steps or components mentioned, but not excluding the presence or addition of one or more other features, integers, steps or components and groups thereof. Therefore, the expression "apparatus comprising means A and B" should not be limited to apparatuses consisting of parts A and B only.

Reference in this specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the terms "in one embodiment" or "in an embodiment" in various places in this specification are not necessarily all referring to the same embodiment, but can refer to the same embodiment. Furthermore, the particular features, structures or characteristics can be combined in any suitable manner, as would be apparent to one of ordinary skill in the art from this disclosure, in one or more embodiments.

Explanation of related technical terms involved in this application:

Light fidelity (Li-Fi), also known as visible light wireless communication technology, is a wireless transmission technology that utilizes the visible light spectrum for data transmission. The technology transmits information by implanting a tiny chip on an LED (Light Emitting Diode) and using electrical signals to control the LED to emit high-speed blinking signals invisible to the naked eye. When the smart device communicates with the smart device, the data communication is realized through the Li-Fi transmitter and the Li-Fi receiver installed on the smart device. The Li-Fi transmitter may include, for example, a light-emitting diode and a transmit processor; the Li-Fi receiver may include, for example, a photodiode and a receive processor.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this application belongs. If there is any inconsistency, the meaning described in this specification or the meaning derived from the content described in this specification shall prevail. In addition, the terms used herein are only for the purpose of describing the embodiments of the present application, and are not intended to limit the present application.

Defects in the related art discovered by the inventors:

In order to enable the head-mounted electronic device to better select a trustworthy signal, a possible implementation manner provides an information processing method and a head-mounted electronic device, the head-mounted electronic device is provided with a signal receiving unit, A signal propagating along a straight line is received by the signal receiving unit according to a directional communication mode, and the state of the transmitting end of the signal is determined according to the information carried by the received signal, thereby avoiding useless or unsafe information.

This implementation has the following defects: it cannot judge the distance between the device that sends the signal and the head-mounted electronic device; it can only avoid receiving useless or unsafe information, and it does not record that when the signal receiving unit receives multiple When information is available, how to filter out the information the user wants from multiple available information.

Another possible implementation provides an eyeglass tracking using a scanning beam and multiple detectors, the infrared light source emits infrared light, and the scanning optics reflect the infrared light emitted by the infrared light source to be able to be directed towards the user's eye and encompass the user's cornea The reflected light of the area, the light detector detects the angle of the reflected light, which is then used to determine the gaze direction of the user's eyes.

This implementation has the following defects: it can only be used to determine the gaze direction of the user's eyes, and cannot determine the distance between the optical scanning devices of the central Li-Fi receiver; it cannot use infrared light to transmit data, and cannot support multi-device communication wireless communication between.

In order to determine which device the user's attention is focused on in a scenario where multiple smart devices are awakened by the user's voice command together, and control the device on which the user's attention is focused to perform corresponding operations according to the user's voice command, the Embodiments provide a method, apparatus, and head-mounted electronic device for determining an attentive device.

An application scenario of the method for determining an attention device provided by the embodiment of the present application:

FIG. 1 shows an application scenario of the method for determining an attention device provided by an embodiment of the present application. In the scenario shown in FIG. 1 , the environment where the user is located includes multiple smart devices: a smart cleaning robot 1 , a smart air conditioner 2 , a smart speaker 3 , a smart TV 4 , and a smart phone 5 . Li-Fi transmitters 6, 7, 8, 9, and 0 are respectively set on each smart device. After wearing the head-mounted electronic device, the user can issue voice commands as needed, for example: turn on the TV. After the user sends a voice command, the voice assistant on the smart device receives the user's voice command, and the control unit controls the Li-Fi transmitters 6, 7, 8, 9, and 0 set on the smart device to emit Li-Fi according to the user's voice command. -Fi optical signal, the Li-Fi receivers 10, 11, 12 arranged on the head-mounted electronic device receive the Li-Fi optical signals sent by each Li-Fi transmitter 6, 7, 8, 9, 0.

Embodiment 1: Head-mounted electronic device

FIG. 2 shows a schematic structural diagram of a specific implementation manner of a head-mounted electronic device provided by an embodiment of the present application. As shown in FIG. 2 , the head-mounted electronic device is smart glasses 100 . The smart glasses 100 include a spectacle frame 30 for mounting lenses, a first temple 31 and a second temple 32 arranged on both sides of the spectacle frame 30 , a central Li-Fi receiver 10 and a processor arranged on the spectacle frame 30 20. The first side Li-Fi receiver 11 and the second side Li-Fi receiver 12 respectively disposed on the first temple 31 and the second temple 32 . Among them, the central Li-Fi receiver 10, the first side Li-Fi receiver 11 and the second side Li-Fi receiver 12 are used to receive Li-Fi transmitters 6, 7, 8, 9, and 0. -Fi optical signal, the direction facing the receiving end of the central Li-Fi receiver 10 is consistent with the direction facing the face of the user wearing the smart glasses. The orientations of the receiving ends of the first side Li-Fi receiver 11 and the second side Li-Fi receiver 12 are at a first angle with respect to the receiving end of the central Li-Fi receiver 10 . In some embodiments, the first angle may be ±90°. The processor 20 is configured to perform, according to the Li-Fi optical signals received by the central Li-Fi receiver 10 , the Li-Fi receiver 11 on the first side, and the Li-Fi receiver 12 on the second side, the determination provided by the embodiments of the present application. Pay attention to the method of the device.

FIG. 3 shows a schematic structural diagram of another specific implementation manner of a head-mounted electronic device provided by an embodiment of the present application. As shown in FIG. 3 , the head-mounted electronic device is a smart earphone 300 . The smart earphone 300 includes a left headset 41, a right headset 42, a connecting rod 43 connecting the left headset 41 and the right headset 42, a central Li-Fi receiver 10 and a processor 20 disposed on the connecting rod 43, respectively disposed on the left The first side Li-Fi receiver 11 and the second side Li-Fi receiver 12 on the headset 41 and the right headset 42 . Among them, the central Li-Fi receiver 10, the first side Li-Fi receiver 11 and the second side Li-Fi receiver 12 are used to receive Li-Fi transmitters 6, 7, 8, 9, and 0. -Fi optical signal, the direction facing the receiving end of the central Li-Fi receiver 10 is consistent with the direction facing the face of the user wearing the smart earphone 300 . The receiving ends of the first side Li-Fi receiver 11 and the second side Li-Fi receiver 12 are oriented at a first angle with respect to the receiving end of the central Li-Fi receiver 10. In some embodiments, the The first angle may be ±90°. The processor 20 is configured to perform, according to the Li-Fi optical signals received by the central Li-Fi receiver 10 , the Li-Fi receiver 11 on the first side, and the Li-Fi receiver 12 on the second side, the determination provided by the embodiments of the present application. Pay attention to the method of the device.

The head-mounted electronic device provided by the embodiment of the present application is not limited to the smart glasses 100 and the smart earphone 300, and may also be any other electronic device that can be worn on the user's head.

Embodiment 2: A system for determining the device to be noticed

FIG. 6 shows a schematic block diagram of a system for determining an attention device provided by an embodiment of the present application. As shown in FIG. 6 , the system 1000 for determining an attention device provided by this embodiment of the present application may include: a central Li-Fi receiver 10 and side Li-Fi receivers located on both sides of the central Li-Fi receiver, so The direction facing the receiving end of the central Li-Fi receiver is consistent with the direction facing the face of the user wearing the head-mounted electronic device, and the receiving end of the side Li-Fi receiver is oriented relative to all The orientation of the receiving end of the central Li-Fi receiver is at a first angle, and the side Li-Fi receiver includes a first side Li-Fi receiver 11 and a second side Li-Fi receiver 12; the determining module 200 (processing device 20), configured to perform, according to the optical power of the Li-Fi optical signals of the devices received by the central Li-Fi receiver and the side Li-Fi receivers, the determining of the device to be noticed provided by the embodiment of the present application. method.

In some embodiments, the determination module 200 may be a cloud server, or may be a processor 20 provided on the head-mounted electronic device, which is not limited in this application.

Embodiment 3: Method for determining a device to be noticed

FIG. 4 shows a flowchart of a method for determining an attention device provided by an embodiment of the present application. As shown in FIG. 4, the method of determining the noticed device may include the following steps:

Step S1: The user wears the head-mounted electronic device.

In some embodiments, the head-mounted electronic device may be smart glasses, a smart headset, or other devices or smart devices, which are not limited in this application.

Step S2: The user issues a voice command.

In some embodiments, as shown in FIG. 1, the user in the smart device environment says: Turn on the TV. In FIG. 1 , the smart device environment where the user is located may include: a smart sweeping robot 1 , a smart air conditioner 2 , a smart speaker 3 , a smart TV 4 , and a smart phone 5 , and these smart devices all emit Li-Fi optical signals. Of course, the method for determining a device to be noticed provided by the embodiments of the present application can also be applied to other non-intelligent devices, and the "device" in this document and the accompanying drawings refers to smart devices and other non-intelligent devices.

Step S3: Li-Fi transmitters of multiple smart devices transmit Li-Fi optical signals.

After the user sends a voice command, the voice assistants of multiple smart devices receive the voice command sent by the user, and the control unit controls the Li-Fi transmitter installed on the smart device to emit Li-Fi optical signals according to the user's voice command.

Step S4: The central Li-Fi receiver, the first side Li-Fi receiver and the second side Li-Fi receiver receive Li-Fi optical signals from Li-Fi transmitters of multiple smart devices.

In some embodiments, the direction facing the receiving end of the central Li-Fi receiver corresponds to the direction facing the face of the user wearing the head mounted electronic device. The orientations of the receiving ends of the Li-Fi receivers on the first side and the Li-Fi receivers on the second side are at a certain angle (the first angle) with respect to the orientation of the receiving ends of the central Li-Fi receiver, and the angles may be the same or the same. Alternatively, the angular range may be ±90°. The central Li-Fi receiver, the first side Li-Fi receiver and the second side Li-Fi receiver may be one or more, and the first side Li-Fi receiver and the second side Li-Fi receiver are respectively central Both sides of the Li-Fi receiver.

Step S5: The processor determines a trusted smart device according to the identity ID information of the smart device contained in the Li-Fi optical signal.

In some embodiments, the Li-Fi optical signal sent by the Li-Fi transmitter on the smart device may contain the identity document (Identity document) information of the smart device, for example, the Li-Fi optical signal may contain the information of the smart device User account information. The processor can match the user account information to which the smart device belongs with the user account information to which the head-mounted electronic device belongs. When the two user account information is consistent, the smart device corresponding to the Li-Fi optical signal is a trusted smart device.

Step S6: The processor determines whether the optical power of the Li-Fi optical signal sent by the smart device received by the central Li-Fi receiver is the maximum.

When the user's face is facing a certain device, it means that the user's attention is likely to focus on this device. At this time, the receiving end of the central Li-Fi receiver is opposite to the receiving end of the side Li-Fi receiver. The Li-Fi optical signal received by the central Li-Fi receiver at a certain angle and the direction facing the receiving end of the central Li-Fi receiver is the same as the orientation of the face of the user wearing the head-mounted electronic device The optical power is greater than the optical power of the Li-Fi optical signal received by the side Li-Fi receiver, and then the device that is noticed can be determined.

In some embodiments, for any smart device, when the Li-Fi optical power received by the central Li-Fi receiver is greater than the Li-Fi optical power received by either side Li-Fi receiver, the central Li-Fi receiver - The angle between the axis of the receiving end of the Fi receiver and the incident angle of the Li-Fi optical signal it receives can be regarded as 0°.

When the optical power of the Li-Fi optical signal sent by the smart device received by the central Li-Fi receiver is the largest, step S7 is performed: the smart device is determined as the noticed smart device.

When the optical power of the Li-Fi optical signal sent by the smart device received by the central Li-Fi receiver is not the maximum, that is, the optical power of the Li-Fi optical signal sent by the smart device received by the central Li-Fi receiver is less than that of the side Li-Fi - the optical power received by the Fi receiver, then step S61 is executed: the processor regards the smart device as a non-attention smart device.

Step S8: The processor determines whether the number of the noticed smart devices is 0.

When the number of noticed smart devices is 0, step S81 is executed: the processor determines that there is no noticed smart device.

When the number of noticed smart devices is not 0, step S9 is executed: the processor determines whether the number of noticed smart devices is 1.

When the number of noticed smart devices is 1, step S91 is executed: the processor determines that the device is a noticed smart device.

When the number of noticed smart devices is not 1, step S10 is performed: calculating the distance between each noticed smart device and the central Li-Fi receiver.

When the user is using the device, the distance from the device is usually relatively fixed. For example, when the user is using the TV, mobile phone, and air conditioner, the distance between the user and the TV, mobile phone, and air conditioner is usually relatively fixed and different. Sitting on the sofa and using the TV, the distance from the TV is roughly 2 meters to 3 meters. When the user is using the mobile phone, the distance from the mobile phone is roughly 0.3 meters to 0.8 meters. The user usually uses the air conditioner when entering the room. The distance from the air conditioner It is approximately 2 meters to 10 meters. Therefore, when the number of attention devices is multiple, the only attention device that the user pays attention to can be determined based on the distance between the user and the attention device.

In some embodiments, the distance between the user attention device and the central Li-Fi receiver can be calculated by the following steps:

Calculate H (0) according to formula (1) P _LOS =P _t ×H _{( 0)} , where P _LOS is the optical power of the Li-Fi optical signal of the smart device received by the central Li-Fi receiver; P _t is The optical power of the Li-Fi optical signal emitted by the Li-Fi transmitter of the smart device; H ₍₀₎ is the DC gain of the channel.

确定智能设备与中央Li-Fi接收器之间的距离。According to formula (2)

Determine the distance between the smart device and the central Li-Fi receiver.

Among them, H ₍₀₎ is the DC gain of the channel; m is the Lambertian order, m=-ln2/ln(cosφ _1/2 ), and φ _1/2 is the half-power angle of the LED lamp of the Li-Fi transmitter; A is the receiving area of the photodiode of the receiver; ψ is the angle between the axis of the receiving end of the receiver and the incident light; T _s (ψ) is the optical filter gain of the receiver; g(ψ) is the optical lens convergence signal of the receiver gain; ψ _c is the half-angle width of the field of view; φ is the angle between the vertical axis of the LED lamp of the Li-Fi transmitter and the emitted light; r is the distance between the LED lamp of the Li-Fi transmitter and the central Li-Fi receiver Distance (the distance between the smart device and the central Li-Fi receiver), which can represent the distance between the user and the smart device.

In step S6, when the optical power received by the central Li-Fi receiver is greater than the optical power received by the first and second Li-Fi receivers (all side Li-Fi receivers), the central Li-Fi receiver The angle between the axis of the receiving end of the receiver and the incident angle of the light it receives may be regarded as 0°. Therefore, in formula (2), except that the distance between the LED light of the Li-Fi transmitter and the central Li-Fi receiver is unknown, the rest are known, so that the distance between the LED light of the Li-Fi transmitter and the central Li-Fi receiver can be calculated. The distance r of the Li-Fi receiver, i.e. the distance between the smart devices noticed by the user of the central Li-Fi receiver.

Step S11: According to the relationship between the distance and the attention degree between the user (central Li-Fi receiver) and each attention device, determine the attention degree that each attention device is noticed by the user.

Since the distance from each device is relatively fixed and different when the user uses different devices, the more times the user uses a certain device at a certain distance, it indicates that the user's attention at this distance is focused on this A device is more likely.

In some embodiments, the correlation curve of distance and attention level between each device and the central Li-Fi receiver can be obtained by the following steps:

Step S111 : when the user wears the head-mounted electronic device, collect (periodically collect) the distance between the central Li-Fi receiver and each smart device every predetermined time.

For example, in the first 6 months of the user's use of the head-mounted electronic device, the distance between the user and each device and the usage of each device at the current distance can be collected every 2 minutes, and then the user's distance at different distances can be obtained. The number of times each device was used.

In some embodiments, the predetermined time may be any length of time, for example, 1 minute to 20 minutes, which is not limited in this application. When wearing the head-mounted electronic device, the user can move around freely in the smart device environment. Taking the scenario shown in Figure 1 as an example, the processor can calculate the central Li-Fi respectively according to the Li-Fi optical signals obtained by the central Li-Fi receiver or the side Li-Fi receivers set on the head-mounted electronic device. The distance between the receiver and the smart sweeping robot 1, smart air conditioner 2, smart speaker 3, smart TV 4, and smart phone 5. For example, the distances between the central Li-Fi receiver and the smart sweeping robot 1, smart air conditioner 2, smart speaker 3, smart TV 4, and smart phone 5 are 2.1 meters, 2.4 meters, 2.2 meters, 2.1 meters, and 0.4 meters, respectively.

Step S112: Determine the situations in which the user uses the smart device at different distances.

In some embodiments, at the first moment, the user is watching TV and playing with a mobile phone, and the user is using the device as follows: the user uses a smart TV and a smart phone, but does not use a smart sweeping robot, smart air conditioner, or smart speaker. ; When the user uses a smart TV, the distance between the central Li-Fi receiver and the smart TV is 2.1 meters; when the user uses a smartphone, the distance between the central Li-Fi receiver and the smartphone is 0.4 meters.

Step S113 : According to the collected distances between the central Li-Fi receiver and the device for N times, determine the use frequency of the device at different distances.

In some embodiments, the central Li-Fi receiver may be collected every 2 minutes when the user wears the head-mounted electronic device within the first 3 months of using the head-mounted electronic device provided by the embodiments of the present application. For the distance from various smart devices, the number of acquisitions and N in the past three months are taken as the total number of acquisitions. For example, in the first 3 months, the head-mounted electronic device collected a total of 13,500 distances between the central Li-Fi receiver and each smart device, of which the distance between the central Li-Fi receiver and the smart TV was The distance between the central Li-Fi receiver and the smart air conditioner is between 0.5 and 10 meters, and the distance between the central Li-Fi receiver and the smartphone is between 0.1 and 2 meters. The distance between the central Li-Fi receiver and the smart speaker is between 0.3 meters and 9 meters, and the distance between the central Li-Fi receiver and the intelligent sweeping robot is between 0.2 meters and 15 meters. The user used the smart TV 300 times, used the smart air conditioner 15 times, used the smart phone 9,500 times, and used the smart cleaning robot 30 times between 0.1 and 2 meters away from the smart TV. The number of smart speakers is 100 times; the number of times the user uses the smart TV between 2 meters and 3 meters away from the smart TV is 7,200 times, the number of times of using the smart air conditioner is 70 times, the number of times of using the smart phone is 500 times, and the number of times of using the smart sweeper is The number of times the robot is used is 40 times, the number of times of using the smart speaker is 680 times; the number of times the user uses the smart TV between 3 meters and 12 meters away from the smart TV is 505 times, the number of times of using the smart air conditioner is 115 times, and the number of using the smart phone is 505 times. The number of times is 12, the number of times of using the smart sweeping robot is 20 times, and the number of times of using the smart speaker is 115 times.

Step S114: According to the number of times the user uses the smart device at different distances, obtain the correlation curve between the distance and the degree of attention.

In some embodiments, the more times the user uses a certain smart device within a certain distance or distance range, it indicates that the user uses the smart device more frequently within this distance or distance range, and the user uses this smart device within this distance or distance range. The greater the possibility of focusing on the smart device within the distance range, that is, the number of times the user uses the smart home device in this time period (eg, 3 months in step S113 ) can represent the user's attention level.

In some embodiments, the user's attention level curve of using a smart TV, a smart phone, a smart speaker, a smart air conditioner, and a smart cleaning robot within a range of 0 meters to 15 meters is shown in FIG. 5 . Of course, the distance and attention level correlation table can also be drawn according to the number of times the user uses the smart device at different distances. This application does not limit this, as long as it can reflect the number of times the user uses the smart device and the central Li-Fi receiver and the central Li-Fi receiver. The correspondence between the distances between the smart devices is sufficient.

Step S12: Use the smart device with the highest degree of attention as the user's attention device.

In some embodiments, as shown in FIG. 1 , the distance between the user (the central Li-Fi receiver) and each smart device is known in step S111 , according to the correlation curve between the distance and the degree of attention shown in FIG. 5 . , respectively determine the user's attention level of each smart device, and the device with the highest attention level is the device that the user pays attention to.

Embodiment four:

FIG. 7 is a schematic structural diagram of a computing device 1500 provided by an embodiment of the present application. The computing device 1500 includes: a processor 1510 , a memory 1520 , a communication interface 1530 , and a bus 1540 .

It should be understood that the communication interface 1530 in the computing device 1500 shown in FIG. 7 may be used to communicate with other devices.

Wherein, the processor 1510 can be connected with the memory 1520 . The memory 1520 may be used to store the program codes and data. Therefore, the memory 1520 may be a storage unit inside the processor 1510 , or an external storage unit independent from the processor 1510 , or may include a storage unit inside the processor 1510 and an external storage unit independent from the processor 1510 . part.

Optionally, computing device 1500 may also include bus 1540 . The memory 1520 and the communication interface 1530 may be connected to the processor 1510 through the bus 1540 . The bus 1540 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus or the like. The bus 1540 can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one line is shown in FIG. 7, but it does not mean that there is only one bus or one type of bus.

It should be understood that, in this embodiment of the present application, the processor 1510 may adopt a central processing unit (central processing unit, CPU). The processor may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other Programming logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. Alternatively, the processor 1510 uses one or more integrated circuits to execute related programs to implement the technical solutions provided by the embodiments of the present application.

The memory 1520 may include read only memory and random access memory and provides instructions and data to the processor 1510 . A portion of the processor 1510 may also include non-volatile random access memory. For example, the processor 1510 may also store device type information.

When the computing device 1500 is running, the processor 1510 executes the computer-implemented instructions in the memory 1520 to perform the operation steps of the above-described method.

It should be understood that the computing device 1500 according to the embodiments of the present application may correspond to corresponding subjects in executing the methods according to the various embodiments of the present application, and the above-mentioned and other operations and/or functions of the modules in the computing device 1500 are respectively for the purpose of realizing the present application. For the sake of brevity, the corresponding processes of each method in the embodiment will not be repeated here.

Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described systems, devices and units may refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes .

Embodiments of the present application further provide a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, is used to execute a method for generating diverse problems, and the method includes the methods described in the foregoing embodiments. at least one of the options.

The computer storage medium of the embodiments of the present application may adopt any combination of one or more computer-readable media. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples (a non-exhaustive list) of computer readable storage media include: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), Erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

A computer-readable signal medium may include a propagated data signal in baseband or as part of a carrier wave, with computer-readable program code embodied thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device .

Program code embodied on a computer readable medium may be transmitted using any suitable medium including, but not limited to, wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for performing the operations of the present application may be written in one or more programming languages, including object-oriented programming languages—such as Java, Smalltalk, C++, but also conventional Procedural programming language - such as the "C" language or similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or wide area network (WAN), or may be connected to an external computer (eg, through the Internet using an Internet service provider) connect).

Note that the above are only the preferred embodiments of the present application and the applied technical principles. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present application, all of which belong to The scope of protection of this application.

Claims (13)

1. A method for determining an attention device, the method being applied to a head-mounted electronic device, the head-mounted electronic device comprising: a central Li-Fi receiver having a receiving end oriented in line with a direction in which a face of a user wearing the head-mounted electronic device faces, and side Li-Fi receivers positioned on either side of the central Li-Fi receiver, the receiving ends of the side Li-Fi receivers oriented at a first angle relative to the orientation of the receiving end of the central Li-Fi receiver, the method comprising:

receiving, by the central Li-Fi receiver and the lateral Li-Fi receivers, li-Fi optical signals transmitted by devices;

when the light power of the device's Li-Fi light signal received by the central Li-Fi receiver is greater than the light power of the device's Li-Fi light signal received by the lateral Li-Fi receiver, the device is an attended device.

2. The method of claim 1, further comprising: when the noticed device is a plurality of devices, acquiring the distance between the central Li-Fi receiver and the noticed device;

and determining the device with the maximum attention degree as the attention-paid device according to the relation between the distance between the central Li-Fi receiver and the attention-paid device and the attention degree.

3. The method of claim 2, wherein the obtaining of the distance comprises:

determining the distance of the noticed device from the central Li-Fi receiver according to the received optical power of the noticed device and the received emission power of the Li-Fi optical signal of the noticed device.

4. The method according to claim 2, wherein the relationship between distance and attention level between the central Li-Fi receiver and the device is established by:

periodically collecting a distance between the central Li-Fi receiver and a device and a frequency of use of the device at the distance when the head-mounted electronic device is used;

establishing a relationship between the distance and the degree of attention between the central Li-Fi receiver and the device according to the distance and the frequency of use.

5. The method of any of claims 1-4, wherein prior to determining the attended device, further comprising:

and according to the received voice instruction, determining the identity ID information of the equipment contained in the Li-Fi optical signal according to the Li-Fi optical signal sent by the equipment and received by the central Li-Fi receiver and/or the side Li-Fi receiver.

6. The method of any of claims 1-5, wherein the head-mounted electronic device comprises: glasses, earphones.

7. An apparatus for determining an attention device, the apparatus being applied to a head-mounted electronic device, the head-mounted electronic device comprising: a central Li-Fi receiver having a receiving end oriented in a direction that is coincident with a direction in which a face of a user wearing the head-mounted electronic device faces, and side Li-Fi receivers positioned on either side of the central Li-Fi receiver, the side Li-Fi receivers having receiving ends oriented at a first angle relative to the orientation of the receiving end of the central Li-Fi receiver, the apparatus comprising:

a Li-Fi optical signal receiving module, which is used for receiving the Li-Fi optical signal transmitted by the equipment through the central Li-Fi receiver and the side Li-Fi receiver;

an attended device determination module to determine the device as an attended device when the optical power of the device's Li-Fi optical signal received by the central Li-Fi receiver is greater than the optical power of the device's Li-Fi optical signal received by the lateral Li-Fi receiver.

8. The apparatus of claim 7, wherein the noted device determination module is further configured to: when the noted device is multiple, acquiring the distance between the central Li-Fi receiver and the noted device;

and determining the device with the maximum attention degree as the attention-paid device according to the relation between the distance between the central Li-Fi receiver and the attention-paid device and the attention degree.

9. The apparatus of claim 8, wherein the obtaining of the distance comprises:

determining the distance of the noticed device from the central Li-Fi receiver according to the received optical power of the noticed device and the received emission power of the Li-Fi optical signal of the noticed device.

10. The apparatus of claim 8, wherein the relationship between the distance and the attention level between the central Li-Fi receiver and the device is established by:

periodically collecting a distance between the central Li-Fi receiver and a device and a frequency of use of the device at the distance when the head-mounted electronic device is used;

establishing a relationship between the distance and the degree of attention between the central Li-Fi receiver and the device according to the distance and the frequency of use.

11. The apparatus of any of claims 7-10, wherein prior to determining the attended device, the apparatus further comprises:

and the equipment identity ID information determining module is used for determining the identity ID information of the equipment contained in the Li-Fi optical signals according to the received voice instructions and the Li-Fi optical signals sent by the equipment and received by the central Li-Fi receiver and/or the side Li-Fi receiver.

12. The apparatus of any of claims 7-11, wherein the head-mounted electronic device comprises: glasses, earphones.

13. A head-mounted electronic device, comprising: means for determining an attended device as defined in any of claims 7-12;

the head-mounted electronic equipment comprises a central Li-Fi receiver and side Li-Fi receivers positioned on two sides of the central receiver, wherein the orientation of a receiving end of the central Li-Fi receiver is consistent with the direction faced by the face of a user wearing the head-mounted electronic equipment, and the orientation of the receiving ends of the side Li-Fi receivers is at a first angle relative to the orientation of the receiving end of the central Li-Fi receiver.

Images