CN115119055A - Control method, control device, display equipment and storage medium - Google Patents

Control method, control device, display equipment and storage medium Download PDF

Info

Publication number
CN115119055A
CN115119055A CN202110306851.9A CN202110306851A CN115119055A CN 115119055 A CN115119055 A CN 115119055A CN 202110306851 A CN202110306851 A CN 202110306851A CN 115119055 A CN115119055 A CN 115119055A
Authority
CN
China
Prior art keywords
measurement
parameter
sensing
wireless
perception
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110306851.9A
Other languages
Chinese (zh)
Other versions
CN115119055B (en
Inventor
徐金虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Jimi Technology Co Ltd
Original Assignee
Chengdu Jimi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Jimi Technology Co Ltd filed Critical Chengdu Jimi Technology Co Ltd
Priority to CN202110306851.9A priority Critical patent/CN115119055B/en
Publication of CN115119055A publication Critical patent/CN115119055A/en
Application granted granted Critical
Publication of CN115119055B publication Critical patent/CN115119055B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Arrangements For Transmission Of Measured Signals (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The present application relates to the field of display device control, and in particular, to a control method, apparatus, display device, and storage medium. The method is applied to the display device and comprises the following steps: after detecting the network parameters and the wireless sensing function parameters, sending a wireless sensing measurement request; judging whether the wireless perception measurement is only carried out by a wireless module of the display equipment according to the wireless perception measurement request, if so, carrying out perception measurement and feeding back a perception measurement result by the wireless module of the display equipment; if not, the wireless module of the display equipment and response equipment negotiate perception measurement and obtain a perception measurement result, wherein the response equipment is the display equipment supporting wireless perception; and instructing a control module of the display device to execute operation according to the perception measurement result. The state of the target object is measured through wireless perception, so that the display device is controlled, and the method has the advantages of no radiation, high precision and the like.

Description

Control method, control device, display equipment and storage medium
Technical Field
The present application relates to the field of display device control technologies, and in particular, to a control method, an apparatus, a display device, and a storage medium.
Background
In an 802.11 system, an access device AP STA and a terminal device Non-AP STA are both internally deployed with an MAC layer and a PHY layer, where the main functions of the MAC layer include channel management, connection management, quality of service management, power control, time synchronization, and the like, and the main functions of the PHY layer include modulation, coding, transmission, and the like.
Both the MAC layer and the PHY layer conceptually include management entities referred to as a MAC layer management unit mlme (MAC sublayer management entity) and a physical layer management unit plme (PHY sublayer management entity), respectively. These elements provide low-level management service interfaces through which low-level management functions can be invoked.
In order to provide proper MAC operation, each STA includes a Non-AP STA and an AP STA, and each STA has a higher management unit, such as an SME (device management element), which represents a higher management entity above the MAC layer, is a layer-independent entity, and is located in a separate management plane. The function of SME: this unit is responsible for functions such as collecting the states associated with the layers from the various layer management units (MLME and PLME), and similarly sets the parameter values for a particular layer. SMEs typically perform such functions on behalf of a general system management entity. The layers interact with each other through defined primitives.
802.11be networks, also known as Extreme High Throughput (EHT) networks, are enhanced by a range of system features and a variety of mechanisms to achieve very High Throughput. As the use of Wireless Local Area Networks (WLANs) continues to grow, it becomes increasingly important to provide wireless data services in many environments, such as homes, businesses, and hot spots. 802.11be networks aim to ensure the competitiveness of WLANs by further increasing overall throughput and reducing latency, while ensuring backward compatibility and coexistence with legacy technology standards. 802.11 compatible devices operating in the 2.4GHz, 5GHz and 6GHz bands.
Disclosure of Invention
An object of the embodiments of the present application is to provide a control method, a control apparatus, a display device, and a storage medium to solve the above problems.
In a first aspect, a control method provided in an embodiment of the present application is applied to a display device, and includes:
after detecting the network parameters and the wireless sensing function parameters, sending a wireless sensing measurement request;
judging whether the wireless perception measurement is only carried out by a wireless module of the display equipment according to the wireless perception measurement request, if so, carrying out perception measurement and feeding back a perception measurement result by the wireless module of the display equipment; if not, the wireless module of the display equipment and response equipment negotiate perception measurement and obtain a perception measurement result, wherein the response equipment is the display equipment supporting wireless perception;
instructing a control module of the display device to perform operations according to the perception measurement result:
if the sensing measurement result _ code is FAILED, no processing is performed; if the sensing measurement result _ code is SUCCESS, the display device control module closes the display device, or closes an optical machine of the display device, or reduces the volume of the display device, or closes the volume of the display device, or displays a preset image, or plays a preset sound file.
Preferably, the wireless sensing measurement is judged whether to be performed only by the wireless module of the display device according to the wireless sensing measurement request, and if yes, the wireless module of the display device performs sensing measurement and feeds back a sensing measurement result; if not, the wireless module of the display device and the response device negotiate perception measurement and obtain a perception measurement result, wherein the response device is the display device supporting wireless perception and comprises the following steps:
the wireless module of the display equipment comprises a media access layer management unit (MLME) and an equipment management unit (SME), wherein the MLME is responsible for executing a wireless sensing measurement process, and the SME is responsible for setting measurement parameters according to a wireless sensing measurement request of an application unit and initiating a sensing measurement process;
the MLME receives an MLME-SENSMEIREMENMENT.request primitive sent by the SME, wherein the MLME-SENSMEIREMENMENT.request primitive comprises an address parameter PeerSTAAddress and a sensing measurement parameter of equipment participating in sensing measurement;
judging whether the value of PeerSTAAddress is the wireless module address of the display equipment, if so, carrying out perception measurement by the wireless module of the display equipment according to perception measurement parameters in MLME-SENSMEIREREMENT. And if not, the wireless module of the display equipment sends a Sensing request frame to equipment corresponding to the PeerSTAAddress to negotiate Sensing measurement and report.
Preferably, the step of sending a Sensing request frame to a device negotiation Sensing measurement and report corresponding to PeerSTAAddress by a wireless module of the display device includes the following steps:
the wireless module of the display device is used as a perception process initiator, and the device corresponding to the PeerSTAAddress is used as a perception process responder;
a sensing process initiator sends a sending request frame to a sensing process responder;
after receiving a sending response frame sent by a sensing process responder, the MLME of a sensing process initiator sends an MLME-SENSSMEARUREMENT confirm primitive to the SME, wherein the sending response frame comprises a parameter status code for identifying whether the request of the sensing process initiator is supported or not;
a perception process initiator sends a perception data packet to a perception process responder;
a sensing process initiator receives a sensing report frame sent by a sensing process responder after sensing measurement is carried out on the sensing process responder, wherein the sensing report frame comprises a measurement result;
and the MLME of the perception process initiator sends an MLME-SENSEPOTT.indication primitive to the SME, wherein the MLME-SENSEPOTT.indication primitive comprises a measurement result.
Preferably, the perceptual Measurement parameter comprises a parameter Measurement configuration representing a Measurement configuration, the parameter Measurement configuration comprising a Measurement control parameter Measurement control; the Measurement control parameter Measurement control comprises a parameter Measurement ID used for representing the current wireless sensing Measurement process, a parameter Measurement type used for representing the type of a reported result, and a parameter M-band used for representing the execution Measurement frequency band.
Preferably, the parameter Measurement configuration further includes an Event Measurement parameter Event profile, where the Event Measurement parameter Event profile includes at least one Event, and the Event includes a parameter Event ID indicating an Event identifier and a parameter Threshold indicating an Event judgment condition.
Preferably, the parameter Measurement configuration further includes a periodic Measurement parameter periodic profile including a parameter Report Interval indicating a transmission Report Interval, a parameter Max Number indicating the Number of transmission reports, and a parameter Report item indicating a Report item.
Preferably, the Report item comprises one or more of: distance, angle, position, heart rate, respiration rate, occupied and unoccupied.
Preferably, the Threshold comprises one or more of the following: measuring distance, field angle range and target state.
Preferably, the sending request frame and the sending response frame each include a parameter Action representing a frame type and a parameter Role configuration representing a Role of a device participating in the sensing process, and the sending request frame further includes a parameter Measurement configuration representing a Measurement configuration.
Preferably, the value of the parameter Role configuration includes one or more of an address or identification of a perception initiator, an address or identification of a perception responder, an address or identification of a perception sender, and an address or identification of a perception receiver.
Preferably, the MLME-senserurement. confirm primitive includes an address parameter PeerSTAAddress of a device participating in the sensing measurement and a parameter Status code indicating whether a request of a sensing process initiator is supported.
Preferably, the sending report frame includes a parameter Action representing a frame type and a parameter Sens-report representing a measurement report.
Preferably, the parameter Sens-report includes a parameter Measurement control indicating Measurement control, and the parameter Measurement control includes a parameter Measurement ID indicating a parameter for identifying a current wireless sensing Measurement process and a parameter Measurement type indicating a Measurement type.
Preferably, the parameter Sens-Report further includes a periodic measurement Report periodic Report including a parameter Result item indicating a Result of a measurement item and a parameter Report number indicating a number of times that has been reported.
Preferably, the Sens-report further includes an Event measurement report Event report including a parameter Event ID indicating an Event identification and a parameter Detect time indicating a time when the Event is detected.
Preferably, the MLME-Sens sreport.indication primitive includes an address parameter PeerSTAAddress indicating a device participating in the sensing measurement and a parameter Sens-report indicating a measurement report.
Preferably, the step of the wireless module of the display device performing the sensing measurement according to the sensing measurement parameter in the MLME-sensor measurement.
The wireless sensing measurement request comprises a parameter Event ID representing an Event identification;
and if the value of the PeerSTAAddress is the wireless module address of the display equipment, searching local setting according to the Event ID, and sending a sensing signal and receiving an echo signal for measurement according to the parameter set by the Event.
Preferably, the instructing the control module of the display device to perform an operation according to the sensing measurement result includes the steps of:
preprocessing the perception measurement result to obtain breathing frequency domain data and heartbeat frequency domain data;
inputting the breathing frequency domain data and the heartbeat frequency domain data into a preset learning model to obtain a first state of a target person; if the first state is the sleep state, the display device control module closes the display device, or closes an optical machine of the display device, or reduces the volume of the display device, or closes the volume of the display device, or displays a preset image, or plays a preset sound file.
Preferably, the wireless sensing measurement request includes a parameter Event ID indicating an Event identification and a parameter period indicating a detection duration.
In a second aspect, an apparatus provided in an embodiment of the present application includes:
the application module is used for detecting network parameters and wireless sensing function parameters and sending a wireless sensing measurement request;
the sensing module is used for judging whether the wireless sensing measurement is only performed by the wireless module of the display equipment according to the wireless sensing measurement request, and if so, the wireless module of the display equipment performs sensing measurement and feeds back a sensing measurement result; if not, the wireless module of the display equipment and response equipment negotiate perception measurement and obtain a perception measurement result, wherein the response equipment is the display equipment supporting wireless perception;
and the control module is used for controlling the display equipment to execute preset operation according to the perception measurement result.
The apparatus provided in the embodiment of the present application has the same beneficial effects as the control method provided in the first aspect or any one of the optional implementation manners of the first aspect, and details are not described here.
In a third aspect, a display device provided in an embodiment of the present application includes a processor and a memory, where the memory stores a computer program, and the processor is configured to execute the computer program to implement the control method provided in the first aspect or any optional implementation manner of the first aspect.
The display device provided in the embodiment of the present application has the same beneficial effects as the control method provided in the first aspect or any one of the optional implementation manners of the first aspect, and details are not repeated here.
In a fourth aspect, an embodiment of the present application further provides a storage medium, where a computer program is stored on the storage medium, and when the computer program is executed, the control method provided in the foregoing first aspect or any optional implementation manner of the first aspect is implemented.
The storage medium provided in the embodiment of the present application has the same beneficial effects as the control method provided in the first aspect or any one of the optional implementation manners of the first aspect, and details are not described here.
Has the advantages that: the state of target object is measured through wireless perception to this application to control display device possesses advantages such as radiationless, precision height, and based on current wireless device, richenes the display device function. Meanwhile, the wireless sensing measurement function is optimized by judging whether the display equipment performs sensing measurement or the display equipment and the response equipment negotiate the sensing measurement, so that the stability, compatibility and the like of the wireless sensing measurement are facilitated.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
FIG. 1 is a schematic flow chart of the method of the present application;
FIG. 2 is a schematic diagram of a wireless sensing function of a display device according to the present application;
fig. 3 is a schematic view of an interface of a display device according to the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. Furthermore, it should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The inventor researches and finds that most households are provided with the projection equipment. Due to the influence of some uncertainty factors, the viewer can enter a sleep state when watching the image, and the projection equipment still works normally. The existing method for detecting the state of a viewer comprises a camera mode or a radar millimeter wave mode, the camera mode needs conditions such as sufficient light, and privacy hidden dangers exist; the radar millimeter wave mode has high cost, large volume and radiation; the wireless sensing technology is a new technology, which can realize motion detection, gesture recognition and biometric measurement by using the existing wireless signals based on the existing wireless network and equipment. In wireless sensing, changes caused by movement of objects, pets and people in the environment are detected by using a mode based on Channel State Information (CSI) or a Radar mode, the detected objects do not need to wear any equipment, and the equipment is existing, light conditions are not needed, and privacy risks are avoided. The inventor therefore proposes a control method based on the existing home display device.
As shown in fig. 1, a control method applied to a display device includes:
after detecting the network parameters and the wireless sensing function parameters, sending a wireless sensing measurement request;
judging whether the wireless perception measurement is only carried out by a wireless module of the display equipment according to the wireless perception measurement request, and if so, carrying out the perception measurement and feeding back a perception measurement result by the wireless module of the display equipment; if not, the wireless module of the display equipment and response equipment negotiate perception measurement and obtain a perception measurement result, wherein the response equipment is the display equipment supporting wireless perception;
and instructing a control module of the display device to execute operation according to the perception measurement result.
As shown in fig. 2, the wireless module of the display device includes a media access layer management unit MLME and a device management unit SME, and the display device includes an application unit; the MLME is responsible for executing the wireless sensing measurement process, and the SME is responsible for setting measurement parameters according to the wireless sensing measurement request of the application unit and initiating a sensing measurement process.
The MLME receives an MLME-SENSSMEARUREMENT primitive sent by the SME, wherein the MLME-SENSSMEARUREMENT primitive comprises an address parameter PeerSTAAddress and a sensing measurement parameter of equipment participating in sensing measurement;
judging whether the value of PeerSTAAddress is the wireless module address of the display equipment, if so, carrying out perception measurement by the wireless module of the display equipment according to perception measurement parameters in MLME-SENSMEIREREMENT. And if not, the wireless module of the display equipment sends a Sensing request frame to equipment corresponding to the PeerSTAAddress to negotiate Sensing measurement and report.
Specifically, the display device is described by taking an intelligent projector as an example:
the intelligent projector uses an android system, and the application unit application can use java written programs with UI interface control. The following functions are realized:
it is determined whether a network is connected. If networking is enabled, the buttons on the application can be clicked normally, and if no network is connected, all the buttons on the application appear grey and cannot be clicked.
If the network is connected, whether a human body detection mode switch is turned on or not can be selected optionally, and the switch is turned off by default. When the sleep detection is clicked for the first time, the application sends a ping service command to the gateway and calculates the using time of pings, and when the time between every two frames of pings exceeds 1s, the application prompts the prompt of 'weak network signals and incapability of detection', wherein the prompt means that the current network cannot be used for perception detection. The method has the advantages that the premise of wireless sensing measurement is ensured by detecting the network condition, and meanwhile, the specific condition of the network is detected, and the rate of the wireless sensing measurement is ensured.
When the Application judges that the projection equipment is connected with the network and the setting switch is opened, the Application sends a sending _ start (EventID, period) command to a terminal management entity SME; the method comprises the following steps that an eventID is set to be 'sleepedchoice', sleep detection is needed, period is set to be T1, the duration needing to be detected is shown, when T1 is 0, detection is always shown, and an SME executes a wireless sensing process according to a sending _ start (eventID, period) command, wherein the execution of the wireless sensing process by the SME specifically comprises the following steps:
sending MLME-SENSMEIREREMENT primitive to MLME, wherein the primitive comprises parameters as shown in Table 1:
TABLE 1
Parameter(s) Description of the invention
PeerSTAAddress Setting as an address of a device participating in the perception measurement;
Measurement configuration measurement arrangement
Wherein the Measurement configuration settings are as in table 2:
TABLE 2
Figure BDA0002988062220000091
Wherein the Measurement control settings are as in table 3:
TABLE 3
Figure BDA0002988062220000092
Wherein the periodic profile settings are as in table 4:
TABLE 4
Figure BDA0002988062220000101
Wherein Event profile settings are as in table 5:
TABLE 5
Figure BDA0002988062220000102
Wherein, Event1-EventN is preset locally as shown in Table 6:
TABLE 6
Event ID Threshold
Event identification Condition of event judgment
Examples are as follows:
event definition Event a1 (sleep): measuring whether a target with a viewing angle range of (H1, V1) within D1 m is in a sleep state;
the Event1-N setting is as in Table 7:
TABLE 7
Figure BDA0002988062220000103
Figure BDA0002988062220000111
(xii) after receiving the MLME-SENSSMEARUREMENT. request primitive,
a: if the PeerSTAAddress value is the address of the projection equipment, searching local setting according to the Event ID, sending a sensing signal according to the parameter set by the Event, and receiving an echo signal by the projection equipment for measurement;
and b, if the value of the PeerSTAAddress is the address of other equipment, the equipment serving as a perception process initiator (STA) sends a Sensing request frame to equipment corresponding to the PeerSTAAddress, namely a perception process responder (AP). The sending request frame settings are as in table 8:
TABLE 8
Parameter(s) Description of the invention
Action Frame type, set to Sensing request
Role configuration Role of devices participating in a process of awareness
Measurement configuration Measurement arrangement
Where the Role configuration setting is as in table 9, the following four parameters may all be contained, with no corresponding value set to null, or with only explicit values:
TABLE 9
Figure BDA0002988062220000112
After receiving the Sensing request frame, the Sensing process responder (AP) determines whether the requested Sensing service is supported according to the Sensing SID, if so, sets the value of the parameter status code to SUCCESS, and if not, sets the value of the parameter status code to REFUSED, and sends the Sensing response frame to the initiator (STA) of the Sensing process, and the setting of the Sensing response frame is as shown in table 10:
watch 10
Parameter(s) Description of the invention
Action Frame type, set to Sensing response
Status code Request of whether STA is supported
Role configuration Role of devices participating in a process of awareness
After receiving the sending response frame, the MLME of the aware process initiator (STA) sends an MLME-senseruurement. confirm primitive to the SME, and the primitive settings are as shown in table 11:
TABLE 11
Parameter(s) Description of the invention
PeerSTAAddress The address of the AP;
Status code request of whether STA is supported
A perception process initiator (STA) sends a perception data packet to a perception process responder (AP); a perception process responder (AP) receives a perception data packet, measures Channel State Information (CSI), and reports according to Measurement configuration; if the Measurement type comprises 'Event-based', judging the Measurement result of the listed Event ID according to the definition of the Event and the threshold parameter according to the Event set in the Event profile, and sending a Measurement report when the condition is met;
the aware process responder (AP) sends a sending report frame to the STA, which is set as table 12:
TABLE 12
Parameter(s) Description of the invention
Action Frame type set to Sensing report
Sens-report Measurement reporting
Where Sens-report settings are as in Table 13:
watch 13
Figure BDA0002988062220000131
Wherein the Measurement control settings are as in table 14:
TABLE 14
Figure BDA0002988062220000132
Where the periodic report settings are as in table 15:
watch 15
Result item Report number (optional)
Results of the measurement items Number of times reported
Wherein Event report is set as in table 16:
TABLE 16
Figure BDA0002988062220000133
After receiving the sending report, the MLME of the aware process initiator (STA) sends an MLME-senssreport.indication primitive to the SME, where the primitive settings are as in table 17:
TABLE 17
Figure BDA0002988062220000141
Thirdly, if the SME receives the report of successfully detecting the event, setting the result _ code corresponding to the event as SUCCESS, and if the SME does not receive the report of detecting the event within the specified time T1, setting the result _ code corresponding to the event as FAILED;
and fourthly, transmitting sensing _ result (event ID, result _ code) in a time cycle mode at Application intervals to obtain an event detection result.
If the result _ code received by the Application is FAILED, no processing is performed, and if the result is SUCCESS, measurement report data is received.
The control module of the display device firstly carries out normalization processing on the acquired report to remove environmental noise, and then uses Fourier transform to extract time domain information and frequency domain information of report data. And screening the respiratory frequency domain data and the heartbeat frequency domain data from the extracted frequency domain data through a low-pass filter (ILPF) and a Gaussian low-pass filter (GLPF). The normal heart rate at rest is between 60-100 beats/minute. Adult males are approximately 60-80/min; the number of female patients is about 70-90 times/min. The heart rate is slowed down when falling asleep, with about 50-70 beats/min for men and 60-70 beats/min for women. The breathing frequency of a normal person is between 16 and 18 times/minute, the breathing frequency is stable during sleep, and the breathing frequency fluctuates during waking or according to different actions of the human body. By the method, a large amount of heartbeat and respiratory frequency data in a sleep state and heartbeat and respiratory frequency data in a waking state are collected, and a data set is trained by adopting a machine learning method.
And performing characteristic matching on the obtained respiratory frequency domain data, heartbeat frequency domain data and trained frequency domain data of the human body during sleeping, calling PowerManager service of Android Manager of the projection equipment if the matching result is in a sleeping state, sending PowerDown keywords to the PowerManager, cutting off power supply of a system after the PowerManager receives the PowerDown keywords, and closing the projection equipment. Otherwise, no processing is performed.
As shown in FIG. 3, the UI interface of the Application has a device detection button, a button for opening and closing a device and the like, and a window for configuring some parameters. The interface comprises functions of equipment detection, a perception switch, people number detection, limb detection, sleep detection, environment detection and the like. When the application is installed, calling of a PowerManager service of the Android Manager is prompted, a relevant authority is required to be obtained, the application can be normally installed only after clicking determination, and an interface is opened for the first time after installation as shown in FIG. 3. And clicking the detection equipment, and if the detection device is connected with the projection equipment and is normally powered on, and then clicking the sleep detection button, popping up a corresponding parameter output of the sleep detection function interface by the software interface. And when the switch button of the equipment is clicked, the equipment can close the operation or start the operation. If the operation is closed, the application parameter column is grayed out, and the corresponding parameters are not displayed. The switch is turned off by default, and the default previously set starting state is started next time.
The method comprises the steps of detecting whether a viewer enters a sleep state or not in a non-contact mode by means of wireless perception, judging the state to adopt the wireless perception, and carrying out wireless perception measurement by adopting projection equipment or negotiating the wireless perception measurement by adopting the projection equipment and response equipment by adopting the wireless perception; if the sleep state is entered, the projection device is paused and turned off or the projection device is directly turned off; or closing an optical machine of the display device, or turning down the volume of the display device, or closing the volume of the display device, or displaying a preset image, or playing a preset sound file.
Referring to fig. 2, an exemplary structural block diagram of a display device, which may be a smart phone, a tablet display device, or the like, is provided in an embodiment of the present application. The display device comprises a smart television or a smart projector.
It should be understood that the structure shown in fig. 2 is only an illustration, and the display device provided in the embodiment of the present application may have fewer or more components than those shown in fig. 2, or may have a different configuration from that shown in fig. 2, and the embodiment of the present application is not particularly limited thereto.
Based on the same inventive concept as the control method, the embodiment of the application also provides a device; the device comprises:
the application module is used for detecting network parameters and wireless sensing function parameters and sending a wireless sensing measurement request;
the sensing module is used for judging whether the wireless sensing measurement is only performed by the wireless module of the display equipment according to the wireless sensing measurement request, and if so, the wireless module of the display equipment performs sensing measurement and feeds back a sensing measurement result; if not, the wireless module of the display equipment and response equipment negotiate perception measurement and obtain a perception measurement result, wherein the response equipment is the display equipment supporting wireless perception;
and the control module is used for controlling the display equipment to execute preset operation according to the perception measurement result.
The application module comprises a network detection unit, a perception function detection unit and a communication unit; the network detection unit is used for detecting the network connection condition, wherein the connection condition comprises whether networking is performed or not, the network quality and the like; the sensing function detection unit is used for detecting the on-off state of the sensing function; the communication unit is used for sending a wireless sensing measurement request to the sensing module.
The sensing module comprises a wireless module, and the wireless module comprises a media access layer management unit (MLME) and a device management unit (SME), wherein the MLME is responsible for executing a wireless sensing measurement process, and the SME is responsible for setting measurement parameters according to a wireless sensing measurement request of an application unit and initiating a sensing measurement process.
The control module comprises a processing unit for controlling the display device to execute preset operations according to the sensing measurement result. Or comprises a processing unit, a preprocessing unit and a learning unit; the preprocessing unit is used for preprocessing the sensing measurement result to acquire respiratory frequency domain data and heartbeat frequency domain data; the learning unit is used for inputting the breathing frequency domain data and the heartbeat frequency domain data into a preset learning model to obtain a first state of a target person; the processing unit is used for controlling the display device to execute preset operation according to the first state, and the preset operation includes closing the display device, or closing an optical machine of the display device, or turning down the volume of the display device, or closing the volume of the display device, or displaying a preset image, or playing a preset sound file.
To sum up, this application obtains viewing person's state through wireless perception measurement to control the projecting apparatus, based on current wireless device, richen the projecting apparatus function. By judging whether the projection equipment carries out perception measurement or the projection equipment and the response equipment negotiate the perception measurement, the stability, compatibility and the like of the wireless perception measurement are facilitated, and the wireless perception measurement function is optimized.
In addition, an embodiment of the present application further provides a display device, which includes a processor and a memory, where the memory stores a computer program, and the processor is configured to execute the computer program to implement the control method provided in the foregoing method embodiment.
In addition, an embodiment of the present application further provides a storage medium, where a computer program is stored on the storage medium, and when the computer program is executed, the control method provided in the foregoing method embodiment is implemented, which may be referred to specifically in the foregoing method embodiment, and details of this are not described in this embodiment of the present application.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, the functional modules in each embodiment of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method described in each embodiment of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Random Access Memory (RAM), a Read Only Memory (ROM), a magnetic disk, or an optical disk.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Moreover, it is noted that, in this document, relational terms such as "first," "second," "third," and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.

Claims (22)

1. A control method, applied to a display device, includes:
after detecting the network parameters and the wireless sensing function parameters, sending a wireless sensing measurement request;
judging whether the wireless perception measurement is only carried out by a wireless module of the display equipment according to the wireless perception measurement request, and if so, carrying out the perception measurement and feeding back a perception measurement result by the wireless module of the display equipment; if not, the wireless module of the display equipment and response equipment negotiate perception measurement and obtain a perception measurement result, wherein the response equipment is the display equipment supporting wireless perception;
instructing a control module of the display device to perform operations according to the perception measurement result:
if the sensing measurement result _ code is FAILED, no processing is performed; if the sensing measurement result _ code is SUCCESS, the display device control module closes the display device, or closes an optical machine of the display device, or reduces the volume of the display device, or closes the volume of the display device, or displays a preset image, or plays a preset sound file.
2. The control method according to claim 1, wherein the determining, according to the wireless sensing measurement request, whether the wireless sensing measurement is performed only by a wireless module of the display device, and if so, the wireless module of the display device performs sensing measurement and feeds back a sensing measurement result; if not, the wireless module of the display equipment and the response equipment negotiate perception measurement and obtain a perception measurement result, wherein the response equipment is the display equipment supporting wireless perception and comprises the following steps:
the wireless module of the display equipment comprises a media access layer management unit (MLME) and an equipment management unit (SME), wherein the MLME is responsible for executing a wireless sensing measurement process, and the SME is responsible for setting measurement parameters according to a wireless sensing measurement request of an application unit and initiating a sensing measurement process;
the MLME receives an MLME-SENSSMEARUREMENT primitive sent by the SME, wherein the MLME-SENSSMEARUREMENT primitive comprises an address parameter PeerSTAAddress and a sensing measurement parameter of equipment participating in sensing measurement;
judging whether the value of PeerSTAAddress is the wireless module address of the display equipment, if so, carrying out perception measurement by the wireless module of the display equipment according to perception measurement parameters in MLME-SENSMEIREREMENT. And if not, the wireless module of the display equipment sends a Sensing request frame to equipment corresponding to the PeerSTAAddress to negotiate Sensing measurement and report.
3. The control method according to claim 2, wherein the step of sending a Sensing request frame to a device negotiation Sensing measurement and report corresponding to PeerSTAAddress by the wireless module of the display device comprises the steps of:
the wireless module of the display device is used as a perception process initiator, and the device corresponding to the PeerSTAAddress is used as a perception process responder;
a sensing process initiator sends a sending request frame to a sensing process responder;
after receiving a sending response frame sent by a sensing process responder, the MLME of a sensing process initiator sends an MLME-SENSSMEARUREMENT confirm primitive to the SME, wherein the sending response frame comprises a parameter status code for identifying whether the request of the sensing process initiator is supported or not;
a perception process initiator sends a perception data packet to a perception process responder;
a sensing process initiator receives a sensing report frame sent by a sensing process responder after sensing measurement is carried out on the sensing process responder, wherein the sensing report frame comprises a measurement result;
and the MLME of the perception process initiator sends an MLME-SENSEPOTT.indication primitive to the SME, wherein the MLME-SENSEPOTT.indication primitive comprises a measurement result.
4. A control method according to claim 2, wherein the perceptual Measurement parameter comprises a parameter Measurement configuration representing a Measurement configuration, the parameter Measurement configuration comprising a Measurement control parameter; the Measurement control parameter Measurement control comprises a parameter Measurement ID for representing the current wireless sensing Measurement process, a parameter Measurement type for representing the type of a reporting result and a parameter M-band for representing the execution Measurement frequency band.
5. The control method according to claim 4, wherein the parameter Measurement configuration further includes an Event Measurement parameter Event profile including at least one Event including a parameter Event ID indicating an Event identification and a parameter Threshold indicating an Event determination condition.
6. The control method according to claim 4, wherein the parameter Measurement configuration further includes a periodic Measurement parameter periodic profile including a parameter Report Interval indicating a transmission Report Interval, a parameter Max Number indicating the Number of transmission reports, and a parameter Report item indicating a Report item.
7. A control method according to claim 6, wherein the Report item comprises one or more of: distance, angle, position, heart rate, respiration rate, occupied and unoccupied.
8. A control method according to claim 5, wherein said Threshold comprises one or more of: measuring distance, field angle range and target state.
9. The control method according to claim 3, wherein the sending request frame and the sending response frame each include a parameter Action indicating a frame type and a parameter Role configuration indicating a Role of the device participating in the sensing process, and the sending request frame further includes a parameter Measurement configuration indicating a Measurement configuration.
10. A control method according to claim 9, characterized in that the value of the parameter Role configuration comprises one or more of the address or identity of the aware originator, the address or identity of the aware responder, the address or identity of the aware sender and the address or identity of the aware recipient.
11. A control method according to claim 3, characterized in that said MLME-senseruurement. confirm primitive comprises the address parameter PeerSTAAddress of the devices participating in the sensing measurement and the parameter Status code indicating whether the request of the sensing process initiator is supported or not.
12. A control method according to claim 3, characterized in that said sending report frame comprises a parameter Action representing the frame type and a parameter Sens-report representing the measurement report.
13. The control method according to claim 12, wherein the parameter Sens-report includes a parameter Measurement control indicating Measurement control, and the parameter Measurement control includes a parameter Measurement ID indicating a parameter for identifying a current wireless sensing Measurement process and a parameter Measurement type indicating a Measurement type.
14. A control method according to claim 12, characterized in that said parameter Sens-Report further comprises a periodic measurement Report periodic Report, said periodic measurement Report periodic Report comprising a parameter Result item representing the measurement item results and a parameter Report number representing the number of reported times.
15. A control method according to claim 12, characterized in that said Sens-report further comprises an Event measurement report Event report, said Event measurement report Event report comprising a parameter Event ID indicating the identity of the Event and a parameter Detect time indicating the time at which the Event was detected.
16. A control method according to claim 3, characterized in that said MLME-senssreport.indication primitive comprises an address parameter PeerSTAAddress representing a device participating in the perceptual measurement and a parameter Sens-report representing a measurement report.
17. The control method according to claim 2, wherein the step of performing the sensing measurement by the wireless module of the display device according to the sensing measurement parameter in the MLME-sensor measurement primitive comprises the steps of:
the wireless sensing measurement request comprises a parameter Event ID representing an Event identification;
and if the value of the PeerSTAAddress is the wireless module address of the display equipment, searching local setting according to the Event ID, and sending a sensing signal and receiving an echo signal for measurement according to the parameter set by the Event.
18. The control method according to claim 1, wherein the instructing the control module of the display device to perform an operation according to the perceptual measurement result comprises the steps of:
preprocessing the perception measurement result to obtain breathing frequency domain data and heartbeat frequency domain data;
inputting the breathing frequency domain data and the heartbeat frequency domain data into a preset learning model to obtain a first state of a target person; if the first state is the sleep state, the display device control module closes the display device, or closes an optical machine of the display device, or reduces the volume of the display device, or closes the volume of the display device, or displays a preset image, or plays a preset sound file.
19. The control method according to claim 1, wherein the wireless awareness measurement request includes a parameter Event ID indicating an Event identification and a parameter period indicating a detection duration.
20. An apparatus, comprising:
the application module is used for detecting network parameters and wireless sensing function parameters and sending a wireless sensing measurement request;
the sensing module is used for judging whether the wireless sensing measurement is only performed by the wireless module of the display equipment according to the wireless sensing measurement request, and if so, the wireless module of the display equipment performs sensing measurement and feeds back a sensing measurement result; if not, the wireless module of the display equipment and response equipment negotiate perception measurement and obtain a perception measurement result, wherein the response equipment is the display equipment supporting wireless perception;
and the control module is used for controlling the display equipment to execute preset operation according to the perception measurement result.
21. A display device comprising a processor and a memory, the memory having a computer program stored thereon, the processor being configured to execute the computer program to implement the control method of any one of claims 1 to 19.
22. A storage medium having a computer program stored thereon, wherein the computer program, when executed, implements the control method of any one of claims 1 to 19.
CN202110306851.9A 2021-03-23 2021-03-23 Control method, control device, display equipment and storage medium Active CN115119055B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110306851.9A CN115119055B (en) 2021-03-23 2021-03-23 Control method, control device, display equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110306851.9A CN115119055B (en) 2021-03-23 2021-03-23 Control method, control device, display equipment and storage medium

Publications (2)

Publication Number Publication Date
CN115119055A true CN115119055A (en) 2022-09-27
CN115119055B CN115119055B (en) 2023-06-27

Family

ID=83323438

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110306851.9A Active CN115119055B (en) 2021-03-23 2021-03-23 Control method, control device, display equipment and storage medium

Country Status (1)

Country Link
CN (1) CN115119055B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024087711A1 (en) * 2022-10-24 2024-05-02 华为技术有限公司 Multi-link-based sensing method and apparatus, storage medium, and chip system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017156487A1 (en) * 2016-03-11 2017-09-14 Origin Wireless, Inc. Methods, apparatus, servers, and systems for human identification based on human radio biometric information
CN108900393A (en) * 2018-06-27 2018-11-27 努比亚技术有限公司 Control method, communication processing equipment, terminal and the storage medium of smart home
CN110682914A (en) * 2019-09-29 2020-01-14 皖西学院 Driving behavior recognition system and method based on wireless perception
US20200064444A1 (en) * 2015-07-17 2020-02-27 Origin Wireless, Inc. Method, apparatus, and system for human identification based on human radio biometric information
CN110934566A (en) * 2019-09-09 2020-03-31 精华隆智慧感知科技(深圳)股份有限公司 Intelligent detection, automatic sleep-aiding and emergency alarm device
EP3692898A1 (en) * 2019-02-11 2020-08-12 Nokia Technologies Oy Sleep/motion determination based on wi-fi signals

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200064444A1 (en) * 2015-07-17 2020-02-27 Origin Wireless, Inc. Method, apparatus, and system for human identification based on human radio biometric information
WO2017156487A1 (en) * 2016-03-11 2017-09-14 Origin Wireless, Inc. Methods, apparatus, servers, and systems for human identification based on human radio biometric information
CN108900393A (en) * 2018-06-27 2018-11-27 努比亚技术有限公司 Control method, communication processing equipment, terminal and the storage medium of smart home
EP3692898A1 (en) * 2019-02-11 2020-08-12 Nokia Technologies Oy Sleep/motion determination based on wi-fi signals
CN110934566A (en) * 2019-09-09 2020-03-31 精华隆智慧感知科技(深圳)股份有限公司 Intelligent detection, automatic sleep-aiding and emergency alarm device
CN110682914A (en) * 2019-09-29 2020-01-14 皖西学院 Driving behavior recognition system and method based on wireless perception

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
LIU XUEFENG;CAO JIANNONG; TANG SHAOJIE; WEN JIAQI: "wi-sleep:contactless sleep monitoring via wifi signals", 《2014 IEEE REAL-TIME SYSTEM SYMPOSIUM,ROME,ITALY,2014》, pages 346 - 355 *
与非网:安森美半导体: "基于CSI的wi-fi传感技术能为智能家居带来哪些改变?", Retrieved from the Internet <URL:https://www.eefocus.com/airticle/483605.html> *
韩小飞: "基于无线信号的非侵入式人体信息感知技术研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》, vol. 2020, no. 8 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024087711A1 (en) * 2022-10-24 2024-05-02 华为技术有限公司 Multi-link-based sensing method and apparatus, storage medium, and chip system

Also Published As

Publication number Publication date
CN115119055B (en) 2023-06-27

Similar Documents

Publication Publication Date Title
CN113115341B (en) Method, device, equipment and storage medium for negotiating wireless sensing process
Wang et al. E-eyes: device-free location-oriented activity identification using fine-grained wifi signatures
US10743782B1 (en) Monitoring baby physical characterstics
CN104597825B (en) Information pushing method and device
US9801033B1 (en) Family member tracking
CN104104910B (en) It is a kind of to carry out two-way live shared terminal and method with intelligent monitoring
CN109259952A (en) Sleep monitoring system and Sleep-Monitoring method based on the sleep monitoring system
CN105257140B (en) Method and device for controlling intelligent door and window
US20160091604A1 (en) Apparatus, system and method for space status detection based on acoustic signal
CN106534785A (en) Monitoring method and apparatuses
CN104104927A (en) Infant monitoring and reminding method and system based on television
CN104270504A (en) Non-contact health monitoring mobile phone based on Internet and method
WO2023098287A1 (en) Message pushing method and apparatus, storage medium and electronic apparatus
CN105466028A (en) Water heater system, water heater, control method of water heater and wearable equipment
US20230121623A1 (en) Method for notifying a message of a smart home based on a smart screen Apparatus and Smart screen
CN102599889A (en) Medical examination instrument, physiological information recognition method and physiological information acquisition method
WO2018006541A1 (en) Sleep state monitoring method and device, and terminal and computer storage medium
CN115119055A (en) Control method, control device, display equipment and storage medium
CN107422703B (en) Equipment control method and device
CN105466020A (en) Water heater system, water heater, control method of water heater and wearable equipment
CN106982292A (en) A kind of alarm clock prompting method and system
US20240000376A1 (en) Processing Radio Frequency Wireless Signals in a Motion Detection System
CN113288064B (en) Method, device and equipment for sending alarm information
Machado et al. An iot approach to an ECG online monitor system in an android application
CN208284077U (en) Nurse host and nursing system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 610000 building 4, zone a, Tianfu Software Park, No. 1129, shijicheng Road, high tech Zone, Chengdu, Sichuan

Applicant after: Jimi Technology Co.,Ltd.

Address before: No.2, floor 2, unit 1, building 4, Tianfu Software Park, no.1129, shijicheng Road, hi tech Zone, Chengdu, Sichuan 610041

Applicant before: Chengdu Jimi Technology Co.,Ltd.

GR01 Patent grant
GR01 Patent grant