CN111563105A

CN111563105A - Sleep management method and device, electronic equipment and storage medium

Info

Publication number: CN111563105A
Application number: CN202010425489.2A
Authority: CN
Inventors: 郭彤; 张泽; 方琪; 张寅艳; 裴欢
Original assignee: Shenzhen Sensetime Technology Co Ltd
Current assignee: Shenzhen Sensetime Technology Co Ltd
Priority date: 2020-05-19
Filing date: 2020-05-19
Publication date: 2020-08-21

Abstract

The application discloses a sleeping management method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a dormitory entering management rule and a first record of the dormitory entering and exiting of accommodation personnel; and determining the sleeping state of the accommodation personnel according to the sleeping management rule and the first record.

Description

Sleep management method and device, electronic equipment and storage medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to a sleeping management method and apparatus, an electronic device, and a storage medium.

Background

Dormitory management relates to the safety problem of staff in enterprises and students in schools. According to the traditional sleeping management method, the record of the accommodation personnel going in and out of the dormitory building is obtained through intelligent equipment. And the sleeping manager determines the sleeping state of the accommodation personnel according to the record. But this method is inefficient and less accurate.

Disclosure of Invention

The application provides a sleeping management method and device, an electronic device and a storage medium.

In a first aspect, a method for managing sleeping is provided, the method comprising:

acquiring a dormitory entering management rule and a first record of the dormitory entering and exiting of accommodation personnel;

and determining the sleeping state of the accommodation personnel according to the sleeping management rule and the first record.

In this aspect, the sleeping status of the lodging person can be determined based on the sleeping rules and the first record of the lodging person to improve the speed and accuracy of determining the sleeping status of the lodging person and reduce the labor cost of determining the sleeping status of the lodging person.

In combination with any embodiment of the present application, the accommodation person belongs to a sleeping group; the bedtime management rule is used for determining the bedtime state of the objects in the bedtime group.

With reference to any embodiment of the present application, before determining the sleeping status of the lodging person according to the sleeping management rule and the first record, the method further includes:

acquiring accommodation states of the accommodation personnel; the accommodation state is used for representing whether the accommodation personnel please leave;

and under the condition that the accommodation state is not requested to be left, executing the step of determining the sleeping state of the accommodation personnel according to the sleeping management rule and the first record.

With reference to any one of the embodiments of the present application, before determining the sleeping status of the lodging person according to the sleeping management rule and the first record, the method includes:

obtaining the latest sleeping time;

under the condition that the current time is the latest sleeping time, determining the sleeping state of the lodging personnel according to the sleeping management rule and the first record, wherein the sleeping state comprises the following steps:

determining a second record from the first record; the second record is the last entrance and exit record of the lodging personnel before the latest retiring time;

determining that the sleeping state of the lodging personnel is not returned under the condition that the second record is that the lodging personnel goes out of the dormitory building; or, under the condition that the second record indicates that the accommodation person enters the dormitory building, determining that the sleeping state of the accommodation person is normal sleeping.

In combination with any embodiment of the present application, the method further comprises:

acquiring a third record; the third record is an entrance and exit record of the accommodation person after the latest retiring time and before an expiration time;

updating the sleeping state of the lodging personnel to be not in the dormitory building under the condition that the third record indicates that the lodging personnel go out of the dormitory building; or the like, or, alternatively,

and updating the sleeping state of the lodging personnel to be late when the third record indicates that the lodging personnel enter the dormitory building and the sleeping state of the lodging personnel is not returned or normally returned.

In combination with any embodiment of the present application, the first record is stored in an access record database; the method further comprises the following steps:

obtaining screening conditions of the access records;

and searching the access record database by using the access record screening condition to obtain a record matched with the access record screening condition as a fourth record.

In combination with any embodiment of the present application, in a case where the access record screening condition includes at least two conditions, determining a retrieval order according to the priority of the screening conditions;

the step of searching the access record database by using the access record screening condition to obtain a record matching with the access record screening condition as a fourth record comprises:

and searching the access record database by using the conditions in the access record screening conditions in sequence according to the searching sequence to obtain the fourth access record.

In combination with any embodiment of the present application, the acquiring the first record includes:

acquiring an access record to be confirmed; the to-be-confirmed entrance and exit record carries biological characteristic information of the accommodation personnel;

and determining a record carrying the biological characteristic information matched with the biological characteristic template of the accommodation personnel from the access record to be confirmed to obtain the first record.

With reference to any embodiment of the present application, in a case that the entry and exit record to be confirmed includes a first face image, before obtaining the first record, the method further includes:

performing living body detection processing on the first face image to obtain a living body detection result;

the determining a record carrying biometric information matched with a biometric template of the accommodation personnel from the access record to be confirmed to obtain the first record comprises:

and under the condition that the person in the first face image is determined to be the living body according to the living body detection result, determining a record carrying biological characteristic information matched with a biological characteristic template of the accommodation personnel from the access record to be confirmed to obtain the first record.

With reference to any one of the embodiments of the present application, the performing a living body detection process on the first face image to obtain a living body detection result includes:

performing feature extraction processing on the first face image to obtain texture features of the first face image;

and obtaining the living body detection result according to the texture characteristics.

With reference to any one of the embodiments of the present application, in a case where it is determined that the person in the first face image is a living body based on the living body detection result, before determining a record carrying biometric information matching a biometric template of the accommodation person from the entry/exit record to be confirmed and obtaining the first record, the method further includes:

obtaining a quality score of the first face image according to an image quality evaluation index; the image quality evaluation index includes at least one of: whether the image contains the human faces, the number of the human faces contained in the image, the definition of a human face area in the image and the shielding condition of the human face area in the image;

the determining, when it is determined that the person in the first face image is a living body according to the living body detection result, a record carrying biometric information matching a biometric template of the accommodation person from the entry and exit record to be confirmed to obtain the first record, including:

and when the mass fraction exceeds a mass fraction data threshold value and the person in the first face image is determined to be the living body according to the living body detection result, determining a record carrying biological characteristic information matched with a biological characteristic template of the accommodation person from the access record to be confirmed to obtain the first record.

In combination with any embodiment of the present application, the first recorded state includes: out or in;

the method further comprises the following steps:

acquiring a second face image of the accommodation personnel;

obtaining the displacement direction of the accommodation personnel according to the first face image and the second face image;

and determining the state of the first record according to the displacement direction.

In a second aspect, there is provided a hometown management device, the device comprising:

the acquisition unit is used for acquiring a dormitory management rule and a first record of the accommodation personnel going in and out of the dormitory building;

and the determining unit is used for determining the sleeping state of the accommodation personnel according to the sleeping management rule and the first record.

With reference to any one of the embodiments of the present application, the obtaining unit is configured to obtain the lodging status of the lodging person before determining the sleeping status of the lodging person according to the sleeping management rule and the first record; the accommodation state is used for representing whether the accommodation personnel please leave;

and the determining unit is used for executing the step of determining the sleeping state of the accommodation personnel according to the sleeping management rule and the first record under the condition that the accommodation state is not requested to be left.

With reference to any one of the embodiments of the present application, the obtaining unit is configured to obtain a latest sleeping time before determining the sleeping status of the lodging person according to the sleeping management rule and the first record;

the determining unit, when the current time is the latest sleeping time, is configured to:

With reference to any embodiment of the present application, the obtaining unit is further configured to:

In combination with any embodiment of the present application, the first record is stored in an access record database; the obtaining unit is further configured to:

obtaining screening conditions of the access records;

the device further comprises:

and the retrieval unit is used for retrieving the access record database by using the access record screening condition to obtain a record matched with the access record screening condition as a fourth record.

In combination with any embodiment of the present application, the apparatus further includes: a sorting unit configured to determine a retrieval order according to a priority of a filtering condition in a case where the access record filtering condition includes at least two conditions;

the retrieval unit is configured to:

With reference to any embodiment of the present application, the obtaining unit is configured to:

In combination with any embodiment of the present application, the apparatus further includes: the living body detection unit is used for determining a record carrying biological characteristic information matched with a biological characteristic template of the accommodation personnel from the access record to be confirmed under the condition that the access record to be confirmed comprises a first human face image, and performing living body detection processing on the first human face image to obtain a living body detection result before obtaining the first record;

the acquisition unit is configured to:

In combination with any embodiment of the present application, the living body detecting unit is configured to:

In combination with any embodiment of the present application, the apparatus further includes: the quality evaluation unit is used for determining records carrying biological characteristic information matched with biological characteristic templates of the lodging persons from the records to be confirmed when the persons in the first face image are determined to be living bodies according to the living body detection result, and obtaining the quality scores of the first face image according to image quality evaluation indexes before obtaining the first records; the image quality evaluation index includes at least one of: whether the image contains the human faces, the number of the human faces contained in the image, the definition of a human face area in the image and the shielding condition of the human face area in the image;

the acquisition unit is configured to:

the obtaining unit is further configured to:

acquiring a second face image of the accommodation personnel;

In a third aspect, an electronic device is provided, including: a processor and a memory for storing computer program code comprising computer instructions, the electronic device performing the method of the first aspect and any one of its possible implementations as described above, if the processor executes the computer instructions.

In a fourth aspect, a computer-readable storage medium is provided, in which a computer program is stored, the computer program comprising program instructions that, if executed by a processor, cause the processor to perform the method of the first aspect and any one of its possible implementations.

In a fifth aspect, there is provided a computer program product comprising a computer program or instructions which, when run on a computer, causes the computer to perform the method of the first aspect and any of its possible implementations.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments or the background art of the present application, the drawings required to be used in the embodiments or the background art of the present application will be described below.

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the application.

Fig. 1 is a schematic flowchart of a sleep management method according to an embodiment of the present application;

fig. 2 is a schematic flowchart of another sleep management method according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a point of identity provided by an embodiment of the present application;

fig. 4 is a schematic structural diagram of a sleep management device according to an embodiment of the present application;

fig. 5 is a schematic diagram of a hardware structure of a sleep management device according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

The execution subject of the embodiment of the method is a sleep management device. Optionally, the sleep management device may be one of the following: cell-phone, computer, server, panel computer, entrance guard's equipment. The method embodiment of the present application can also be implemented by a processor executing computer program codes. The embodiments of the present application will be described below with reference to the drawings.

Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a sleep management method according to an embodiment of the present application.

101. The dormitory management method includes the steps of obtaining a dormitory management rule and a first record of the dormitory entrance and exit of accommodation personnel.

In the embodiment of the application, the sleeping rule is used for determining the sleeping state of the accommodation personnel according to the first record of the accommodation personnel. The bedtime status includes at least one of: normal entering dormitory, late entering and failing to enter.

In the embodiment of the application, the first record carries the information of the accommodation personnel going in and out of the dormitory building. The first record may contain all records of the lodging in and out of the dormitory building within a certain day. The first record may also contain a record of the last time the accommodation personnel went in or out of the dormitory building within a certain day.

In one implementation of obtaining a sleep-returning rule, the sleep-returning management device receives the sleep-returning rule input by the user through the input component. The above-mentioned input assembly includes: keyboard, mouse, touch screen, touch pad, audio input device, etc.

In another implementation manner of acquiring the sleeping rule, the sleeping management device receives the sleeping rule transmitted by the first terminal. Optionally, the first terminal may be any one of the following: cell-phone, computer, panel computer, server, wearable equipment.

In one implementation of obtaining the at least one first record, the bedtime management device receives the at least one first record input by the user through the input component. The above-mentioned input assembly includes: keyboard, mouse, touch screen, touch pad, audio input device, etc.

In another implementation manner of acquiring at least one first record, the sleep management device receives a sleep rule sent by the second terminal. Optionally, the second terminal may be any one of the following: cell-phone, computer, panel computer, server, wearable equipment. The second terminal may be the same as or different from the first terminal, and this application does not limit this.

In yet another implementation of obtaining the at least one first record, the bedtime management device collects the at least one first record through the collection device. The above-mentioned collection equipment includes: fingerprint collection subassembly, camera, iris collection subassembly.

The first record may be an entrance and exit dormitory building record generated by actively checking a card on the acquisition device by the lodging personnel, or an entrance and exit dormitory building record generated by automatically acquiring biological information (such as a face image) of the lodging personnel by the acquisition device of the dormitory building and then recognizing the biological information.

102. And determining the sleeping state of the accommodation personnel according to the sleeping management rule and the first record.

The sleeping management device can determine the sleeping state of the accommodation personnel according to the sleeping management rule and the first record. For example, the sleeping management rule is: returning to sleep before 22 o' clock, wherein the sleeping state is normal; after 22 o' clock, returning to sleep, wherein the sleeping state is returned late; and if the last record of going in and out of the dormitory building is output, the dormitory building is in a non-dormitory state. The dormitory management device determines, based on the acquired first record, that zhang san has 3 trips to the dormitory building on the day of 5, 8 and 2020. The 3 recordings were: the dormitory building is taken out from 7: 50/40 seconds in 8: 5/2020, is taken into the dormitory building in 50/50 seconds in 5/8: 15: 10/30 seconds in 5/8: 2020. According to the first record of Zhang III, the sleeping state of Zhang III in 5, month and 8 days of 2020 is determined to be unremoved.

For another example, the sleeping management rule is: the patient returns to sleep normally before 22 o' clock; after 22 o' clock, the patient returns to sleep as late. The dormitory management device determines, based on the acquired first record, that zhang san has 2 trips to the dormitory building on the day of 5, 8 and 2020. The 2 recordings were: the dormitory building is taken out from 7 o 'clock and 40 min/8/7/20/min/2020, and is taken into the dormitory building from 22 o' clock and 10 min/30 sec/8/5/8/2020. According to the first record of Zhang III, the sleeping state of Zhang III in 5, month and 8 days of 2020 is determined to be late.

Optionally, when the number of the lodging personnel is greater than 1, the sleeping management device may determine the sleeping state of each lodging personnel according to the sleeping management rule and the first record of each lodging personnel after acquiring the sleeping management rule and the first record of each lodging personnel.

For example, school a uses the technical solution provided in the present application to perform sleep management on students in school. The students in school a include a book student, a master student and a doctor student, wherein the sleeping rules of the book student and the master student (hereinafter, the sleeping rules will be referred to as sleeping rules 1) are as follows: returning to sleep before 22 o' clock, wherein the sleeping state is normal; after 22 o' clock, returning to sleep, wherein the sleeping state is returned late; and if the last record of going in and out of the dormitory building is output, the dormitory building is in a non-dormitory state. The bedtime rule (which will be referred to as bedtime rule 2 hereinafter) of doctor birth is: returning to sleep before 23 o' clock, wherein the sleeping state is normal; after 23 o' clock, returning to sleep, wherein the sleeping state is returned late; and if the last record of going in and out of the dormitory building is output, the dormitory building is in a non-dormitory state.

The dormitory management device acquires a dormitory management rule 1, a

dormitory management rule

2, 2 records of Zhang III in dormitory building (namely, the first record of Zhang III) and 2 records of Li Si in dormitory building (namely, the first record of Li Si), wherein Zhang III is a master of school A and Li Si is a doctor of school A. The 2 records of Zhang San in and out of the dormitory building are respectively as follows: the dormitory building is taken out from the dormitory building at 8 o ' clock and 30 seconds in 5 month and 7 day in 2020, and the dormitory building is taken in 15 o ' clock and 30 seconds in 22 o ' clock and 7 day in 5 month and 7 day in 2020. The 2 records of the four Li's dormitory buildings are respectively as follows: the dormitory building is taken out from 7 o 'clock 45 min 30 sec in 5 month and 7 day in 2020, and is taken into the dormitory building from 22 o' clock 15 min 30 sec in 5 month and 7 day in 2020. The sleep returning management device can determine that the sleep returning state of Zhang III in 5, month and 7 days of 2020 is late sleep and that of Li IV in 5, month and 7 days of 2020 is normal sleep according to sleep returning rule 1.

In the embodiment of the application, the sleeping state of the accommodation personnel can be determined by the sleeping management device according to the sleeping rule and the first record of the accommodation personnel, so that the speed and the accuracy of determining the sleeping state of the accommodation personnel are improved, and the labor cost consumed by determining the sleeping state of the accommodation personnel is reduced.

As an optional implementation manner, the lodging personnel belongs to a sleeping group, and at least one object is contained in the sleeping group. The sleeping rules are used to determine the sleeping status of the objects in the sleeping group. For example, homed group 1 includes: zhang three and Li four. Homely group 2 includes: wangwu and saturday. The sleeping rule of the sleeping group 1 can be used for determining the sleeping state of Zhang III and the sleeping state of Li IV, and the sleeping rule of the sleeping group 2 can be used for determining the sleeping state of Wang Wu and the sleeping state of Saturday.

Different accommodation personnel are distinguished through the sleeping group, and sleeping management of the accommodation personnel is facilitated. For example, in dormitory building C of school B, not only the junior middle school students but also the senior high school students live. The sleeping rules of junior middle school students are different from those of senior middle school students.

Since the sleeping rules of junior middle school students are different from the sleeping rules of senior high school students, the students in dormitory building C can be distinguished by setting different sleeping groups for improving the sleeping state efficiency of the students in dormitory building C. Specifically, the students in the junior middle school are classified into the same sleep group (hereinafter, referred to as a junior middle school sleep group), and the students in the high school are classified into the same sleep group (hereinafter, referred to as a high school sleep group). A sleep return rule (which will be referred to as a "junior-school-life-falling-back rule" hereinafter) for determining the sleep return state of an object in a junior-school-life group (i.e., a "junior-school-life") and a sleep return rule (which will be referred to as a "junior-school-life-saving rule" hereinafter) for determining the sleep return state of an object in a high-school-life group (i.e., a "high-school-life") are input or transmitted to the sleep return device. The sleep returning device can determine the sleep returning state of the objects in the newborn sleep returning group according to the newborn sleep returning rule, and determine the sleep returning state of the objects in the high school sleep returning group according to the high school sleep returning rule.

Optionally, the homed administrator may create a homed group through the homed device. The creating process comprises the following steps: the sleep setting device displays a sleep setting group creation page when receiving an instruction to create a sleep setting group input by a sleep setting manager. The homed group creation page includes at least one of the following regions: a sleeping group name input area, a lodging person (i.e., an object in the sleeping group) selection area, and a sleeping device selection area. The sleep returning equipment is used for recording the entrance and exit of the lodging personnel in the dormitory building, for example, is provided with a camera device with a sensible/non-sensible card punching function. The homed manager can input the name of the homed group, select objects in the homed group and select a homed device through the homed group creation page. The homed-sleeping management device creates a homed-sleeping group according to the homed-sleeping group name acquired through the homed-sleeping creation page, the objects in the homed-sleeping group and the homed-sleeping equipment.

For example, a homed manager may enter the quiz park in the homed group name entry area via a keyboard. The homed device creates a homed group named quiet yuan. The accommodation person (i.e., the object within the sleeping group) selects a zone that includes at least one of the following: the number of layers input area, the number of rooms in each layer input area and the number of beds in each layer input area of the elegant garden floor. The dormitory manager inputs 6 floors into the elegant garden floor input area through the keyboard, and inputs "fixed" in the number of rooms per floor input area (e.g., selects the "fixed" option in the number of rooms per floor input area). When receiving the information of "6 floors" and "fixed" input by the sleeping manager, the sleeping management device displays the number of rooms on the 6 th floor: 18 hours. The bedtime manager inputs 6 sheets in the bed number per unit input area. When receiving the information of 6 sheets inputted per bed number input area, the homed-sleeping management device adds all the lodging people on the 6 th layer of the elegant park to the homed-sleeping group as the objects in the homed-sleeping group of the elegant park.

The bedding device selection area includes at least one of the following areas: the passing direction is a sleeping device selection area for entering and the passing direction is a sleeping device selection area for exiting. The sleeping manager selects the No. 1 snapshot machine in a sleeping equipment selection area where the passing direction is forward. And under the condition that the homed management device receives the information of selecting the No. 1 snapshot machine as the homed equipment which advances in the passing direction, determining the record of the object in the elegant garden homed group entering or exiting the dormitory building according to the image collected by the No. 1 snapshot machine, and taking the record as the record of entering the dormitory building. And the sleeping manager selects the No. 2 snapshot machine in a sleeping equipment selection area with the passing direction as the exit. And under the condition that the homed sleep management device receives the information of the homed sleep equipment selected by the No. 2 snapshot machine, the record of the determined object in the elegant park homed sleep group to go in and out of the dormitory building according to the image collected by the No. 2 snapshot machine is used as the record of going out of the dormitory building.

As an alternative embodiment, before executing step 102, the sleep management device further executes the following steps:

1. and acquiring the accommodation state of the accommodation personnel.

In the embodiment of the application, the accommodation state is used for representing whether the accommodation personnel leave. Optionally, the accommodation state of the accommodation person includes one of the following: please leave, don't leave.

In one implementation of obtaining the accommodation state of the accommodation personnel, the sleep management device receives the accommodation state of the accommodation personnel input by a user through an input component. The above-mentioned input assembly includes: keyboard, mouse, touch screen, touch pad, audio input device, etc.

In another implementation manner of acquiring the accommodation state of the accommodation personnel, the sleep-returning management device receives the accommodation state of the accommodation personnel transmitted by the first control terminal. Optionally, the first control terminal may be any one of: cell-phone, computer, panel computer, server, wearable equipment.

For example, after the student a initiates a leave request and the dormitory manager posts the leave request, the dormitory manager may analyze the information of the student a by the sleep management device to perform leave request operation, and set the lodging status of the student a as leave request.

2. If the accommodation state is not false, step 102 is executed.

If the state of the lodging person is not yet to be asked for, the sleep management device executes step 102; when the accommodation state of the accommodation person is not requested to be left, the sleep management device determines the sleep state of the accommodation person without depending on the sleep management rule and the first record. For example, when the sleep management device acquires that the lodging status of the lodging person a is leave in the period of 5/10/2020, the sleep management device directly sets the sleep status of the lodging person a in the period of 5/10/2020 as leave in place, and does not determine the sleep status of the lodging person a according to the sleep management rules during the leave in place period.

As an alternative embodiment, before executing step 102, the sleep management device executes the following steps:

3. and obtaining the latest sleeping time.

In the embodiment of the application, the latest sleeping time is used for determining the sleeping state of the lodging people. The lodging personnel can fall back to sleep before the latest falling-back time, and the falling-back state is normal. The lodging personnel can fall back to sleep after the latest falling-back time, and the falling-back state is late falling.

In one implementation of obtaining the latest sleeping time, the sleeping time management device receives the latest sleeping time input by the user through the input component. The above-mentioned input assembly includes: keyboard, mouse, touch screen, touch pad, audio input device, etc.

In another implementation manner of obtaining the latest sleep time, the sleep time management device receives the latest sleep time transmitted by the third terminal. Optionally, the third terminal may be any one of: cell-phone, computer, panel computer, server, wearable equipment.

In another embodiment of obtaining the latest sleep time, the sleep time management rule includes the latest sleep time, and the sleep time management device obtains the latest sleep time by obtaining the sleep time management rule.

When the current time is the latest sleep time, the sleep management device executes the following steps in the process of executing step 102:

4. a second record is determined from the first record.

In the embodiment of the present application, the second record is the last entrance and exit record of the lodging before the latest retiring time. For example, the first record of zhang san includes 2 records of zhang san in 5/8 days of 2020, and the 2 records are respectively: 7, 40 min and 30 sec to go out of the dormitory building, and 20, 40 min and 30 sec to go into the dormitory building. Assume that the latest bedtime is 22 o 'clock, the second record is 20 o' clock, 40 min 30 sec.

For another example, the first record of zhang san includes 3 records of zhang san in 5/8 days of 2020, and the 3 records are respectively: 7, 40 min and 30 sec, 20, 40 min and 30 sec, 21, 48 min and 30 sec. Assuming that the latest bedtime is 22 o 'clock, the second record is 21 o' clock, 48 min 30 sec going out of the dormitory building.

As another example, the first record of zhang san includes 4 records of zhang san in 5/8 days of 2020, where the 4 records are: 7, 40 min and 30 sec out of the dormitory building, 20, 40 min and 30 sec into the dormitory building, 21, 48 min and 30 sec out of the dormitory building, and 22, 23 min and 30 sec into the dormitory building. Assuming that the latest bedtime is 22 o 'clock, the second record is 21 o' clock, 48 min 30 sec going out of the dormitory building.

Optionally, the latest sleeping time is a trigger condition for the sleeping management device to execute step 4. For example, assume that the latest bedtime is 22: 00. When the time comes to 22:00, the sleep management device executes step 4.

After obtaining the second record, the sleep management device may determine the sleep state of the lodging person by at least one of the following implementations:

determining that the sleeping state of the lodging personnel is not returned under the condition that the second record is going out of the dormitory building;

and under the condition that the second record indicates that the person enters the dormitory building, determining that the sleeping state of the lodging person is normal sleeping.

Optionally, the bedtime management device executes step 4 within the execution time period. The starting time of the execution time period is the latest bedtime, and the ending time of the execution time period is the deadline. The deadline can be set according to actual requirements, for example, the latest bedtime is 22:00, and the deadline can be 5: 00.

The sleep state management device does not perform an operation of determining the sleep state of the accommodation person from the deadline of the day to the latest sleep time of the day. The sleep state management device starts to perform an operation of determining the sleep state of the accommodation person only when the time of day reaches the deadline from the latest sleep time to the next day. Thus, the data processing amount of the sleep management device can be reduced. For example, assume that the latest bedtime is 22 points and the deadline is 6: 00. The sleep return management device does not perform an operation of determining the sleep return state of the resident at 6 o 'clock of 5/15/2020 to 21 o' clock of 21/59/15/5/2020. The sleep return management device performs an operation of determining the sleep return state of the resident at 5 o ' clock and 15 o ' clock in 2020 to 5 o ' clock and 59 min and 59 sec in 5 o ' clock and 16 o ' clock in 2020.

Optionally, the upper sleeping management device acquires the expiration time before executing step 4. In one implementation of obtaining the deadline, the bedtime management apparatus receives the deadline input by the user through the input component. The above-mentioned input assembly includes: keyboard, mouse, touch screen, touch pad, audio input device, etc.

In another implementation manner of acquiring the deadline, the sleep management device receives the deadline transmitted by the second control terminal. Optionally, the second control terminal may be any one of: cell-phone, computer, panel computer, server, wearable equipment.

In yet another implementation of obtaining the deadline, the bedtime management rule includes the deadline, and the bedtime management device obtains the deadline by obtaining the bedtime management rule.

Optionally, the sleeping manager may edit the sleeping rule through the sleeping management device. The editing process comprises the following steps: and displaying the editing page when the homed sleep management device receives the editing homed sleep management rule. The editing page includes at least one of the following regions: a sleep time rule valid time input area, a time rule input area, and an entry/exit time rule use state input area. The bedtime manager may input the effective time period of the bedtime rule through the effective time input area. The bedtime manager may input the execution period and the rest period of the bedtime rule through the time rule input area. The dormitory building to which the dormitory rule applies can be input by the dormitory manager through the in-and-out time rule use state area.

For example, the execution time period when the bedtime manager inputs from 3/month 1/2020 to 5/month 15/2020 in the valid time input region and inputs in the time rule input region is: 22: 00-6: 00, and the rest time period input in the time rule input area is as follows: 6: 00-22: 00, and the dormitory building input and selected in the area of the regular use state of the access time is as follows: dormitory building No. 2. When receiving information input by a sleep manager through an edit page, the sleep management device determines that 22:00 is the latest sleep time, 6:00 is the deadline, the time period from 22:00 of the day to 6:00 of the next day is the execution time period of the sleep management rule, the time period from 6:00 of the day to 22:00 of the day is the rest time period of the sleep management rule, and determines that the sleep management rule is used for determining the sleep state of the lodging personnel in dormitory building No. 2 within 3 and 1 day of 2020 and 5 and 15 days of 2020.

After the latest sleeping time, the record of the lodging people going in and out of the dormitory building may be updated, and the updating of the record of the lodging people going in and out of the dormitory building brings about the updating of the sleeping state of the lodging people. Therefore, after determining the sleeping state of the accommodation person according to the second record, the sleeping management device further executes the following steps:

5. a third record is obtained.

In the embodiment of the present application, the third record is the latest entry and exit record of the lodging person after the latest bedtime of the day and before the deadline of the next day, for example, the entry and exit record of the lodging person a closest to the current time is the entry and exit record after the latest bedtime of the day and before the deadline of the next day.

In one implementation of obtaining the third record, the bedtime management device receives the third record input by the user through the input component. The above-mentioned input assembly includes: keyboard, mouse, touch screen, touch pad, audio input device, etc.

In another implementation manner of acquiring the third record, the bedtime management device receives the third record transmitted by the fourth terminal. Optionally, the fourth terminal may be any one of: cell-phone, computer, panel computer, server, wearable equipment.

After acquiring the third record, the sleep management device further executes step 6 and step 7:

6. and if the third record indicates that the accommodation person goes out of the dormitory building, updating the sleeping state of the accommodation person to be unreported.

For example, assume that the latest bedtime is 22 points. At 22 o' clock 3 min 30 sec, 8 th day of 2020, Zhang III is normal. The sleep returning management device acquires a third record of Zhang III at 22 o' clock 3 min 30 sec on 8 d/5 in 2020, wherein the third record is a record of Zhang III going out of the dormitory building. The homed state management device updates the homed state of the Zhang III from normal homed state to non-homed state.

For another example, assume that the latest bedtime is 22 points. At 22 o' clock 3 min 30 sec at 8 d.5/2020, the sleeping state of Zhang III is late. The sleep returning management device acquires a third record of Zhang III at 22 o' clock 3 min 30 sec on 8 d/5 in 2020, wherein the third record is a record of Zhang III going out of the dormitory building. The sleeping returning management device updates the sleeping returning state of the Zhang III from late returning to unremoved state.

7. And updating the sleeping state of the lodging personnel to be late when the third record indicates that the lodging personnel enter the dormitory building and the sleeping state of the lodging personnel is not returned or normally returned.

For example, assume that the latest bedtime is 22 points. At 22 o' clock 3 min 30 sec, 8 th month in 2020, the sleeping status of Zhang III is not returned. The sleeping management device acquires a third record of Zhang III at 22 o' clock 3 min 30 sec on 8 d/5/2020, wherein the third record is a record of Zhang III going into the dormitory building. The sleeping returning management device updates the sleeping returning state of the Zhang III from non-returning to late returning.

For example, assume that the latest bedtime is 22 points. Zhangsan, 21 at 5/8/2020: 50 into dormitory building and 21 at 5 months and 8 days in 2020: 58 into a dormitory building. In the hometown management device, the second record of zhang san on year 2020, month 5 and day 8 is zhang on year 2020, month 5 and day 8 21: 50 into dormitory buildings. At 22 o' clock 3 min 30 sec, 8 th day of 2020, Zhang III is normal. The sleeping management device acquires a third record of Zhang III at 22 o' clock 3 min 30 sec on 8 d/5/2020, wherein the third record is a record of Zhang III going into the dormitory building. The sleeping returning management device updates the sleeping returning state of the Zhang III from normal sleeping returning to late sleeping.

As an alternative embodiment, the first record is stored in an access record database. For example, the accommodation personnel are three students in school A. The school A has 50000 students in the school and lodging, and the access record database comprises the record of the 50000 students going out of the dormitory building. Because the data volume in the access record database is very large, for the dormitory manager, the workload of determining to search for a specific access record (such as searching for an abnormal access record) from a plurality of access records is very large. To this end, the present application also provides a method for determining an abnormal access record by retrieving an access record database. The method comprises the following steps:

8. and obtaining screening conditions of the access records.

In the embodiment of the application, the screening condition of the access record comprises at least one of the following conditions: name, date, sleeping status, sleeping group.

In one implementation of obtaining the screening conditions for the access records, the entering device receives the screening conditions for the access records input by the user through the input component. The above-mentioned input assembly includes: keyboard, mouse, touch screen, touch pad, audio input device, etc.

In another implementation manner of acquiring the entry and exit record screening conditions, the sleep device receives the entry and exit record screening conditions transmitted by the fifth terminal. Optionally, the fifth terminal may be any one of: cell-phone, computer, panel computer, server, wearable equipment.

9. And searching the access record database by using the access record screening condition to obtain a fourth record matched with the access record screening condition.

For example, the screening conditions are: zhang III recorded the entrance and exit of the year 2020 within 5, 8 and 8. According to the screening conditions, a record of Zhang III going in and out of the dormitory building within 5, month and 8 days of 2020 is determined from the access record database as a fourth record.

For another example, the screening conditions are: the record of entrance and exit with the state of going to bed in 6/5/2020 to 8/5/2020. Based on the screening conditions, at least one entry/exit record, for which the bedtime status is not returned within the range from 6/5/2020 to 8/5/2020, is determined from the entry/exit record database as a fourth record.

For another example, the screening conditions are: a record of the entrance and exit of the subject in dormitory group a. Assume that the sleeping objects within the sleeping group a include zhang san and lie si. According to the screening condition, the sleeping device determines the record of Zhangsan dormitory building access from the access record database as a fourth record.

It should be understood that the sleeping status of the lodging personnel is based on the last entry record of the lodging personnel, and that the lodging personnel may have multiple entries during the day. Thus, one bedtime status corresponds to at least one record. For example, the access records database contains three records of Zhang III accessing dormitory buildings within 5, 8 and 2020. According to the 3 entrance and exit records, the bedtime state of Zhang III in 5-month and 8-day of 2020 is determined to be unremoved. Three of 3 entrance records in 5, 8 and 2020 month are entrance records that do not correspond to the bedtime status of three in 5, 8 and 2020 month.

As an alternative embodiment, since there is a difference in significance between different screening conditions, the screening condition priority order is determined as the retrieval order according to the difference in significance of the screening conditions.

In one implementation of obtaining the screening condition priority, the sleeping device receives the screening condition priority input by the user through the input component. The above-mentioned input assembly includes: keyboard, mouse, touch screen, touch pad, audio input device, etc.

In another implementation manner of obtaining the screening condition priority, the screening condition priority is stored in a storage component of the sleep device. The sleep device obtains the screening condition priority by reading the screening condition priority from the storage component.

The bedtime management device searches the entry/exit record database using the conditions in the entry/exit record screening conditions in order of the search order, thereby improving the search efficiency.

For example: the screening conditions of the access records are as follows: entry/exit records indicating that the state of going to bed is not returned from 8/4/2020 to 13/4/2020. The number of entrance/exit records due to absenteeism in the bedtime state is smaller than the number of entrance/exit records from 8/4/2020 to 13/4/2020, that is, the condition of "not being classified" is more significant than the condition of "from 8/4/2020 to 13/4/2020". Therefore, the entry/exit record database can be searched for an entry/exit record with an unleashed status (hereinafter, referred to as an unleashed record) by using the condition of "unleashed", and then the unleashed record can be searched for by using the condition of "from 4/8/2020/8 to 4/13/2020/4", so that an entry/exit record with an unleashed status within 4/8/2020/4 to 13/2020/4 can be screened out.

For another example, school a has 10000 students from this family and 50 students from scratch. The current homed manager needs to check that the abnormal entrance and exit records of students are reserved within 15 days 4 and 4 in 2020 (the abnormal entrance and exit records include at least one of the entrance and exit records with homed state of late homed and unremoved), and the following entrance and exit record screening conditions can be input into the homed device: the abnormal exit and entrance records of students are kept in the year 2020 within 4 and 15. Considering that the number of abnormal entrance and exit records of school student a in year 4, month 15 in 2020 is greater than the number of entrance and exit records of student in year 4, month 15 in 2020, that is, the condition of "entrance and exit records of student in year 4, month 15 in 2020" is more significant than the condition of "abnormal entrance and exit records in year 4, month 15 in 2020". Therefore, the condition of "leaving student's access record in 4/15/2020 can be used to search the access record database, that is, the access record of the student in 4/15/2020 (hereinafter referred to as" leaving student's access record ") can be searched from the access record database, and then the condition of" abnormal access record "can be used to search the access record of the student, so as to screen out the abnormal access record of the student in 4/15/2020.

The retrieval sequence of the screening conditions is determined according to the priority sequence of the screening conditions, and the access record screening conditions are used for retrieving the access record database according to the retrieval sequence, so that the retrieval range can be quickly narrowed, and the retrieval speed is improved.

Referring to fig. 2, fig. 2 is a flowchart illustrating a method for implementing step 101 according to an embodiment of the present disclosure.

201. And acquiring access records to be confirmed, wherein the access records to be confirmed all carry the biological characteristic information of the accommodation personnel.

In an embodiment of the present application, the biometric information includes at least one of: face image, iris information, fingerprint information, and voiceprint information. The sleeping management device can obtain the record of the entrance and the exit to be confirmed according to the biological characteristic information of the accommodation personnel obtained by the biological characteristic acquisition device.

In one possible implementation, the sleep management device is loaded with a biometric acquisition assembly. The sleeping management device collects the biological characteristic information of the accommodation personnel through the biological characteristic collection assembly and obtains the entrance and exit records according to the biological characteristic information. The above-mentioned biological characteristic collection system includes at least one of the following: camera, snapshot machine, fingerprint collection subassembly, iris collection subassembly, vocal print collection subassembly. For example, the sleep management device is an entrance guard equipped with a camera. The entrance guard equipment acquires the face image of the accommodation personnel through the camera, and obtains the record to be confirmed of the accommodation personnel going in and out of the dormitory building according to the acquired face image.

In another possible implementation manner, the sleep management device is a server, and the server and the face recognition access control device have a communication connection therebetween. The server may obtain biometric information of the accommodation person from the access control device through the communication connection.

202. And determining a record carrying the biological characteristic information matched with the biological characteristic template of the accommodation personnel from the access record to be confirmed to obtain the first record.

In an embodiment of the application, the biometric template comprises at least one of: face image template, fingerprint template, iris template, vocal print template. The biological characteristic template is used for identifying the identity of the accommodation personnel, and each accommodation personnel corresponds to one biological characteristic template. For example, the image of the face of a person carrying an accommodation is recorded to be confirmed. And under the condition that the face image of the lodging personnel is matched with the face image template, representing that the lodging personnel and the people in the face image template are the same person. For another example, the record to be confirmed carries fingerprint information of the accommodation personnel. And when the face image of the lodging personnel is matched with the face image template and the identity indicated by the face image template is Zhang III, the lodging personnel is represented as Zhang III.

And matching the biological characteristic information carried in the access record to be confirmed with the biological characteristic template, representing that the lodging personnel and the person indicated by the biological characteristic template are the same person, namely determining that the access record to be confirmed is the access record of the lodging personnel corresponding to the biological characteristic template. The first record can be obtained by comparing each access record to be confirmed in the access records to be confirmed with a pre-stored biological characteristic template of the accommodation personnel, and taking the access record to be confirmed carrying biological characteristic information matched with the biological characteristic template of the accommodation personnel as the access record of the accommodation personnel.

And under the condition that the access record to be confirmed comprises the first face image, the sleeping management device processes the first face image based on a face recognition technology to determine the identity of the person in the first face image, and further determines whether the access record to be confirmed is the access record of the accommodation personnel.

However, recently, an event of attacking the face recognition technology using a "non-living body" face image has been increasingly occurring. The above-mentioned "non-living body" face image includes: paper photos, electronic images, etc. The face recognition technology is attacked by using the non-living face image, so that the accuracy of the access record is reduced. For example, the third image is placed in an image acquisition area of the entrance guard device, the entrance guard device acquires a first face image including the face of the fourth image, and the bedtime management device generates an entrance/exit record of the fourth image based on the first face image.

In order to improve the accuracy of the sleeping status determined based on the face recognition technology, as an alternative embodiment, before executing step 202, the sleeping management apparatus further executes the following steps:

10. and performing living body detection processing on the first face image to obtain a living body detection result.

In the embodiment of the present application, the living body detection result includes: the person in the first face image is a living body or the person in the first face image is not a living body.

In a possible implementation manner, feature extraction processing is performed on the first face image to obtain texture features of the first face image. And obtaining a living body detection result according to the texture feature.

In the embodiment of the present application, the texture feature carries at least one of the following information: the skin color information of the human face skin, the glossiness information of the human face skin, the wrinkle information of the human face skin and the texture information of the human face skin.

The above-described feature extraction processing is used to extract texture features from the first face image. Optionally, the feature extraction processing may be implemented by any one of the following methods: open-source face recognition networks, multi-task cascaded convolutional neural networks (MTCNN), Tuned Convolutional Neural Networks (TCNN), or task-constrained deep convolutional neural networks (TCDCN).

Since the texture features in the face of a real person carry more information than the texture features in a "non-living body". Therefore, it is possible to determine whether or not the person in the first face image is a living body from information carried by the texture feature in the first face image.

Optionally, the confidence that the person in the first face image is a living body may be obtained according to the texture features. Determining that the person in the first face image is a living body as a living body detection result when the confidence exceeds a confidence threshold; in a case where the confidence does not exceed the confidence threshold, it is determined that the living body detection result is that the person in the first face image is not a living body.

In another possible implementation manner, during the process of acquiring the first face image by the sleep management device (such as a terminal loaded with a camera), a living body detection video and an instruction are output, wherein the instruction is used for instructing accommodation personnel to do reference actions according to the living body detection video. The bedtime management device captures a target video stream using an imaging component (e.g., a camera) upon receiving an instruction to start capturing a live-body detection video. The bedtime management device determines that the person in the first face image is the living body in the living body detection result when the target video stream is acquired and the person in the target video stream is determined to be the accommodation person and the action of the person in the target video stream is matched with the reference action; the sleep management device determines that the living body detection result is that the person in the first face image is not a living body when the target video stream is acquired and it is determined that the person in the target video stream is not an accommodation person and/or the action performed by the person in the target video stream does not match the reference action.

In yet another possible implementation, the above-described liveness detection process may be implemented by a liveness detection network. The living body detection network can be obtained by training the convolutional neural network by using at least one image with labeling information as training data, wherein the labeling information comprises whether objects (including people and objects) in the training data are living bodies.

After obtaining the result of the living body detection, the sleep management apparatus specifically executes the following steps in the process of executing step 202:

11. when the person in the first face image is determined to be a living body based on the living body detection result, a record carrying biometric information matching the biometric template of the accommodation person is determined from the entry/exit record to be confirmed, and the first record is obtained.

When the person in the first face image is determined to be the living body according to the living body detection result, the record carrying the biological characteristic information matched with the biological characteristic template of the accommodation personnel is determined from the access record to be confirmed, the first record is obtained, and the accuracy of the access record can be improved.

As an alternative embodiment, before executing step 11 or step 202, the sleep management device further executes the following steps:

12. obtaining a quality score of the first face image according to an image quality evaluation index, wherein the image quality evaluation index comprises at least one of the following: whether the image contains the human face, the number of the human faces contained in the image, the definition of a human face area in the image and the shielding condition of the human face area in the image.

Because the sleep management device needs to process the face area in the first face image in the subsequent processing to determine the identity of the person in the first face image, the clearer and more complete the face area in the first face image is, and the higher the accuracy of the identity of the person in the obtained first face image is. Therefore, the first face image comprises the face, and the quality of the first face image is high; the higher the definition of a face region in the first face image is, the higher the quality of the first face image is represented; the smaller the occluded area of the face region in the first face image is, the higher the quality of the first face image is represented.

In addition, when the number of faces included in the first face image is greater than 1, the determination of the identity of the person in the first face image by the sleep management device may be affected, and the accuracy of the identity of the person in the first face image may be reduced. Therefore, the smaller the number of faces contained in the first face image, the higher the quality of the first face image is characterized.

For example, if the first face image includes a face image, the quality score is added by 5. For another example, if the first face image includes at least 2 faces, the quality score is reduced by 2.

For another example, in the first face image, the ratio of the area of the blocked area to the face area is less than or equal to 15%, the mass fraction is decreased by 0.5, the ratio of the area of the blocked area to the face area is greater than 15% and less than or equal to 40%, the mass fraction is decreased by 1, the ratio of the area of the blocked area to the face area is greater than 40% and less than or equal to 70%, the mass fraction is decreased by 2, the ratio of the area of the blocked area to the face area is greater than 70%, and the mass fraction is decreased by 3.5.

For another example, in the first face image, the face definition is level 1, and the quality score is reduced by 0.5; the face definition is level 2, and the mass fraction is added by 0.5; the face definition is 3 grades, and the mass fraction is added by 1.5; the face definition is level 4, and the mass fraction is added by 2.5; the face definition is grade 5, and the mass fraction is added with 4.5. Optionally, the face sharpness may be obtained by one of the following methods: quadratic blur (reblur), energy gradient function, entropy function.

After the bedtime management apparatus performs step 12 to obtain the quality score of the first face image before performing step 11, step 11 specifically includes the following steps:

13. when the mass score exceeds a mass score data threshold value and the person in the first face image is determined to be a living body based on the living body detection result, data carrying biometric information matching a biometric template of the accommodation person is determined from the entry/exit record to be confirmed, and the first record is obtained.

In the embodiment of the present application, the quality score threshold is a positive number. The higher the quality score threshold, the higher the accuracy of the identity of the person in the first face image, and the higher the accuracy of the first record of the lodging.

And under the condition that the mass fraction exceeds the mass fraction data threshold value and the person in the first face image is determined to be the living body according to the texture characteristics, determining the data carrying the biological characteristic information matched with the biological characteristic template of the accommodation personnel from the access records to be confirmed to obtain a first record, and further improving the accuracy of the first record of the accommodation personnel.

After the bedtime management device executes step 12 to obtain the quality score of the face image to be confirmed before executing step 202, step 202 specifically includes the following steps:

14. and when the mass fraction exceeds a mass fraction data threshold value, determining data carrying biological characteristic information matched with the biological characteristic template of the accommodation personnel from the access records to be confirmed to obtain the first record.

And under the condition that the mass fraction exceeds the mass fraction data threshold, determining the data carrying the biological characteristic information matched with the biological characteristic template of the accommodation personnel from the access records to be confirmed to obtain a first record, so that the accuracy of the first record of the accommodation personnel can be improved.

In step 101, the first record carries the information of the lodging personnel going in and out of the dormitory building. In the embodiment of the application, the state of the first record can be obtained according to the information carried by the first record, wherein the state of the first record includes an entry or an exit. "enter" means that the lodging personnel enter the dormitory building; "go" means that the accommodation personnel go out of the dormitory building. As an alternative embodiment, the sleep management device may obtain the status of the first record by performing the following steps:

15. acquiring a second face image of the accommodation personnel;

in the embodiment of the application, the second face image and the first face image are both acquired by the imaging device in the process that the accommodation personnel go in and out of the dormitory building at the same time.

In one implementation of acquiring the second face image, the bedtime management device receives the second face image input by the user through the input component. The above-mentioned input assembly includes: keyboard, mouse, touch screen, touch pad, audio input device, etc.

In another implementation manner of acquiring the second face image, the sleep setting management device receives a sleep setting rule sent by the sixth terminal. Optionally, the sixth terminal may be any one of: cell-phone, computer, panel computer, server, wearable equipment.

In yet another implementation of acquiring the second face image, the bedtime management device is loaded with an imaging assembly. And the bedtime management device acquires a second face image through the imaging component. The above-mentioned imaging assembly includes: camera, snapshot subassembly.

16. And obtaining the displacement direction of the accommodation personnel according to the first face image and the second face image.

In one possible implementation manner, a pixel area covered by the lodging person in the first face image is referred to as a first pixel area, and a pixel area covered by the lodging person in the second face image is referred to as a second pixel area. And performing feature matching processing on the first face image and the second face image to obtain the same-name points in the first pixel area and the second pixel area. In the embodiment of the application, the pixel points of the same physical point in different images are the same-name points. As shown in fig. 3, the pixel point a and the pixel point C are homonyms, and the pixel point B and the pixel point D are homonyms. And obtaining the pixel displacement of the accommodation personnel according to the pixel displacement between the same-name points in the first pixel area and the second pixel area. And taking the direction of the pixel displacement of the lodging personnel as the displacement direction of the lodging personnel.

In another possible implementation manner, the person displacement direction model is trained by using an image pair marked with information as the person displacement direction as training data, wherein the image pair comprises at least two images, and each of the at least two images contains the person. And processing the first face image and the second face image by using the trained person displacement model to obtain the displacement direction of the accommodation personnel.

17. And determining the state of the first record according to the displacement direction.

According to the direction of the speed of the lodging personnel going in and out of the dormitory building, whether the lodging personnel go out of the dormitory building or go into the dormitory building can be determined, and then the state of the first record can be determined.

In the embodiment of the present application, the bedtime management apparatus can determine the state of the first record through a single imaging device or a single imaging component through steps 15 to 17, which can reduce the device cost.

In other embodiments, whether the accommodation personnel go out of the dormitory building or enter the dormitory building may be determined by at least two imaging devices. For example, a camera No. 1 and a camera No. 2 are installed at a gate of a dormitory building. And determining the state of a first record obtained according to the image acquired by the No. 1 camera as the output state. And determining the state of a first record obtained according to the image acquired by the No. 2 camera as positive.

The embodiment of the application also provides an application scene of applying the technical scheme to the campus. Under this scene, based on above-mentioned technical scheme can realize going back to bed management to the student of school.

In this scenario, the sleep management device is a server. The server is in communication connection with a snapshot machine installed in a dormitory building. The snapshot machine is used for snapshot of pictures of the accommodation personnel going in and out of the dormitory building. Through the communication connection, the server can acquire the pictures captured by the capturing machine. And then, based on the picture, a record of the accommodation people going in and out of the dormitory building is obtained, and the sleeping state of the accommodation people is determined according to the record.

Optionally, each dormitory building is provided with a snapshot machine. Through establishing communication connection between the server and the snapshot machine, dormitory building dormitory management is realized. For example, school a has two dormitory buildings, dormitory building 1 and dormitory building 2. Dormitory building 1 is installed and is taken a candid photograph machine 1, and dormitory building 2 is installed and is taken a candid photograph machine 2. Communication connection is established between the server and the snapshot machine 1, and dormitory building 1 can be subjected to sleep returning management through the server. Communication connection is established between the server and the snapshot machine 1, communication connection is established between the server and the snapshot machine 2, and dormitory building 1 and dormitory building 2 can be managed through the server.

It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.

The method of the embodiments of the present application is set forth above in detail and the apparatus of the embodiments of the present application is provided below.

Referring to fig. 4, fig. 4 is a schematic structural diagram of a sleep management device according to an embodiment of the present application. This sleep management device 1 includes: an acquisition unit 11, a determination unit 12, a sorting unit 13, a retrieval unit 14, a living body detection unit 15, and a quality evaluation unit 16. Wherein:

determining that the sleeping state of the lodging personnel is not returned under the condition that the second record is that the lodging personnel goes out of the dormitory building; or the like, or, alternatively,

and under the condition that the second record indicates that the accommodation person enters the dormitory building, determining that the sleeping state of the accommodation person is normal sleeping.

obtaining screening conditions of the access records;

the device further comprises:

the retrieval unit is configured to:

the acquisition unit is configured to:

the obtaining unit is further configured to:

acquiring a second face image of the accommodation personnel;

In some embodiments, functions of or modules included in the apparatus provided in the embodiments of the present application may be used to execute the method described in the above method embodiments, and specific implementation thereof may refer to the description of the above method embodiments, and for brevity, will not be described again here.

Fig. 5 is a schematic diagram of a hardware structure of a sleep management device according to an embodiment of the present application. The sleep management device 2 includes a processor 21 and a memory 22, and may further include an input device 23 and an output device 24. The processor 21, the memory 22, the input device 23 and the output device 24 are coupled by a connector, which includes various interfaces, transmission lines or buses, etc., and the embodiment of the present application is not limited thereto. It should be appreciated that in various embodiments of the present application, coupled refers to being interconnected in a particular manner, including being directly connected or indirectly connected through other devices, such as through various interfaces, transmission lines, buses, and the like.

The processor may include one or more processors, for example, one or more Central Processing Units (CPUs), and in the case of one CPU, the CPU may be a single-core CPU or a multi-core CPU. Alternatively, the processor 21 may be a processor group composed of a plurality of GPUs, and the plurality of processors are coupled to each other through one or more buses. Alternatively, the processor may be other types of processors, and the like, and the embodiments of the present application are not limited.

Memory 22 may be used to store computer program instructions, as well as various types of computer program code for executing the program code of aspects of the present application. Alternatively, the memory includes, but is not limited to, Random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM), which is used for related instructions and data.

The input means 23 are for inputting data and/or signals and the output means 24 are for outputting data and/or signals. The input device 23 and the output device 24 may be separate devices or may be an integral device.

It is understood that, in the embodiment of the present application, the memory 22 may be used to store not only the relevant instructions, but also relevant data, for example, the memory 22 may be used to store the bedtime management rule obtained through the input device 23, or the memory 22 may also be used to store the bedtime status obtained through the processor 21, and the like, and the embodiment of the present application is not limited to the data specifically stored in the memory.

It will be appreciated that fig. 5 shows only a simplified design of a bedding management device. In practical applications, the sleep management devices may further include other necessary elements, including but not limited to any number of input/output devices, processors, memories, etc., and all sleep management devices that can implement the embodiments of the present application are within the scope of the present application.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. It is also clear to those skilled in the art that the descriptions of the various embodiments of the present application have different emphasis, and for convenience and brevity of description, the same or similar parts may not be repeated in different embodiments, so that the parts that are not described or not described in detail in a certain embodiment may refer to the descriptions of other embodiments.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in or transmitted over a computer-readable storage medium. The computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)), or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a Digital Versatile Disk (DVD)), or a semiconductor medium (e.g., a Solid State Disk (SSD)), among others.

One of ordinary skill in the art will appreciate that all or part of the processes in the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, which may be stored in a computer-readable storage medium, and when executed, may include the processes of the above method embodiments. And the aforementioned storage medium includes: various media that can store program codes, such as a read-only memory (ROM) or a Random Access Memory (RAM), a magnetic disk, or an optical disk.

Claims

1. A method of homeing management, the method comprising:

2. The method of claim 1, wherein the accommodation personnel belong to a dormitory group; the bedtime management rule is used for determining the bedtime state of the objects in the bedtime group.

3. The method of claim 1 or 2, wherein prior to said determining a bedtime status of the accommodation person in accordance with the bedtime management rule and the first record, the method further comprises:

4. The method of any of claims 1-3, wherein prior to determining the bedtime status of the lodging person in accordance with the bedtime management rule and the first record, the method comprises:

obtaining the latest sleeping time;

5. The method of claim 4, further comprising:

6. The method of any one of claims 1 to 5, wherein the first record is stored in an access record database; the method further comprises the following steps:

obtaining screening conditions of the access records;

7. The method of claim 6,

determining a retrieval order according to the priority of the screening condition when the screening condition of the access record comprises at least two conditions;

8. The method of any of claims 1-7, wherein obtaining the first record comprises:

9. The method of claim 8, wherein in the case where the entry record to be confirmed includes a first facial image, the method further comprises, prior to obtaining the first record, determining from the entry record to be confirmed a record carrying biometric information matching a biometric template of the accommodation person:

10. The method according to claim 9, wherein the performing a living body detection process on the first face image to obtain a living body detection result comprises:

11. The method according to claim 9, wherein, in a case where it is determined that the person in the first face image is a living body from the living body detection result, before determining a record carrying biometric information matching a biometric template of the accommodation person from the entry and exit record to be confirmed and obtaining the first record, the method further comprises:

12. The method of any of claims 9 to 11, wherein the first recorded state comprises: out or in;

the method further comprises the following steps:

acquiring a second face image of the accommodation personnel;

13. A homed sleep management device, comprising:

14. An electronic device, comprising: a processor and a memory for storing computer program code comprising computer instructions which, if executed by the processor, the electronic device performs the method of any of claims 1 to 12.

15. A computer-readable storage medium, in which a computer program is stored, which computer program comprises program instructions which, if executed by a processor, cause the processor to carry out the method of any one of claims 1 to 12.