CN113807264A

CN113807264A - Task demonstration method and device, electronic equipment and storage medium

Info

Publication number: CN113807264A
Application number: CN202111101214.4A
Authority: CN
Inventors: 谢洪彪; 刘春秋; 王再阔; 王国君; 焦建成; 李雪春
Original assignee: Beijing Sensetime Technology Development Co Ltd
Current assignee: Beijing Sensetime Technology Development Co Ltd
Priority date: 2021-09-18
Filing date: 2021-09-18
Publication date: 2021-12-17
Anticipated expiration: 2041-09-18
Also published as: CN113807264B

Abstract

The disclosure relates to a task demonstration method and device, an electronic device and a storage medium, wherein the method comprises the following steps: responding to a starting instruction sent by display equipment, and acquiring a task image; according to the task image, running an image processing task to obtain a processing result of the task image, wherein the processing result comprises position information and category information of a human face in the task image; and sending the processing result and/or the task image to a display device, wherein the display device is used for displaying the task image and/or the processing result. The embodiment of the disclosure can realize convenient and fast function demonstration of the face recognition equipment.

Description

Task demonstration method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a task demonstration method and apparatus, an electronic device, and a storage medium.

Background

The intelligent door lock integrated face recognition module is a trend, and the face recognition module is also a component of the intelligent door lock. When the face recognition module is popularized to a client, the functional effect of the face recognition module is required to be demonstrated generally, and the function demonstration mode of the face recognition module in the related technology is not convenient enough.

Disclosure of Invention

The present disclosure proposes a task demonstration technical solution.

According to an aspect of the present disclosure, there is provided a task presentation method applied to a face recognition device connected to a display device, the method including: responding to a starting instruction sent by the display equipment, and acquiring a task image; running an image processing task according to the task image to obtain a processing result of the task image, wherein the processing result comprises position information and category information of a human face in the task image; and sending the processing result and/or the task image to the display equipment, wherein the display equipment is used for displaying the task image and/or the processing result. By the method, hardware cost such as a display screen is not required to be additionally added on the face recognition equipment, software development cost for driving the display screen to display an interactive interface is not required to be additionally added, and function demonstration of executing image processing tasks by a plurality of different face recognition equipment can be conveniently realized.

In one possible implementation manner, the sending the processing result and/or the task image to the display device includes: generating task information according to a preset information transmission format and the processing result; compressing the task image according to a preset data compression format to obtain a compressed task image; and sending the task information and/or the compressed task image to the display equipment. By the method, the task image and the processing result can be quickly and effectively transmitted to the display equipment according to the information transmission format and the data compression format.

In one possible implementation, the task information includes: at least one of a sync word, a data amount, a data type, an information content, and a check word; the synchronous words are used for indicating that information sent by the face recognition equipment is task information, the data volume is used for indicating the data volume of a task image sent by the face recognition equipment, the data type is used for indicating that the data sent by the face recognition equipment is the task image, the information content comprises an image identifier of the task image and a processing result of the task image, and the check words are used for checking the integrity of the task information. By the method, a generalized and universal communication format can be realized, and the method is beneficial for the face recognition equipment to transmit the processing result of the image processing task to the display equipment and display the processing result to the user.

In a possible implementation manner, the image processing task includes a face detection task and a face recognition task, and the face detection task is used for detecting a face in the task image; the face recognition task is used for carrying out face recognition on the face in the task image according to the face information of the pre-stored registered face to obtain the class information of the face; the position information comprises at least one of position information of a face detection frame of the face and position information of face key points of the face, and the category information is used for representing the identity category of the face; wherein the method further comprises: and under the condition that the identity type indicates that the face in the task image is a registered face, sending an unlocking instruction to door lock equipment connected with the face recognition equipment, wherein the unlocking instruction is used for indicating the door lock equipment to unlock a door lock. Through the mode, the function effect that the face recognition equipment is applied to the intelligent access control equipment can be conveniently demonstrated to the user.

In one possible implementation, the method further includes: under the condition that an operation instruction aiming at a face registration task sent by the display equipment is received, a face image of a registered face is obtained; extracting the features of the face image to obtain the face features of the face image; and determining and storing face information of the registered face according to the face image of the registered face, wherein the face information comprises the face image and/or the face features. By the mode, the face recognition equipment can be controlled to be switched to operate the face registration task through the display equipment, so that the face registration function of the face recognition equipment can be demonstrated to a user.

According to an aspect of the present disclosure, there is provided a task presentation method applied to a display device connected to at least one face recognition device for executing an image processing task, the method including: acquiring a processing result of the image processing task sent by the face recognition device and a task image corresponding to the processing result, wherein the task image is an image processed by the image processing task; generating a face image according to the task image and the processing result under the condition that the processing result is that the face exists in the task image, wherein the processing result comprises position information and category information of the face in the task image; and displaying the face image in a display interface of the display equipment. By the method, hardware cost such as a display screen and the like can be not required to be additionally added on the face recognition equipment, software development cost for driving the display screen to display an interactive interface is not required to be additionally added, and function demonstration of executing image processing tasks by a plurality of different face recognition equipment can be conveniently realized.

In a possible implementation manner, the acquiring a processing result of the image processing task sent by the face recognition device and a task image corresponding to the processing result includes: receiving task information sent by the face recognition equipment, wherein the task information is generated according to a preset information transmission format; analyzing the task information according to the information transmission format to obtain an image identifier and a processing result in the task information; and determining a task image corresponding to the processing result from at least one task image sent by the face recognition equipment according to the image identifier. By the method, the processing result of the task image can be effectively obtained according to the information transmission format and the task information sent by the face recognition equipment, so that the face image can be conveniently generated later.

In a possible implementation manner, the image processing task includes a face recognition task, the location information includes at least one of location information of a face detection frame and location information of a face key point, and the category information is used to characterize an identity category of the face; wherein, the generating a face image according to the task image and the processing result comprises: according to the position information of the face detection frame, superimposing the face detection frame on the task image to generate a first image; and/or according to the position information of the face key points, superimposing the face key points on the task image to generate a second image; and/or, the category information is superposed on the task image to generate a third image; wherein the face image comprises at least one of the first image, the second image and the third image. By the method, the process that the face recognition equipment executes the face recognition task can be effectively displayed in the display equipment, and the face recognition function of the face recognition equipment can be conveniently demonstrated to a user.

In a possible implementation manner, the task information further includes: at least one of a sync word, a data amount, a data type, and a check word; the synchronous word is used for indicating that information sent by the face recognition equipment is task information, the data volume is used for indicating the data volume of a task image sent by the face recognition equipment, the data type is used for indicating that the data sent by the face recognition equipment is the task image, and the check word is used for checking the integrity of the task information. By the method, a generalized and universal communication format can be realized, and the method is beneficial for the face recognition equipment to transmit the processing result of the image processing task to the display equipment and display the processing result to the user.

In one possible implementation, the method further includes: checking the integrity of the task information according to the check word in the task information; and/or allocating a storage space corresponding to the data volume in the task information according to the data volume in the task information so as to store the task image sent by the face recognition equipment. By the method, various items of information in the task information can be effectively utilized, and the display of the processing result of the image processing task in the display equipment is realized.

In one possible implementation, the image processing task includes a face registration task, and the method further includes: responding to a triggering operation aiming at a face registration task, and sending an operating instruction aiming at the face registration task to face recognition equipment indicated by the triggering operation, wherein the operating instruction is used for indicating the face recognition equipment to operate the face registration task, and the face registration task is used for indicating that face information of a registered face is collected and stored in advance. By the mode, the face recognition equipment can be controlled to be switched to operate the face registration task through the display equipment, so that the face registration function of the face recognition equipment can be demonstrated to a user.

According to an aspect of the present disclosure, a task presentation system is provided, which includes a face recognition device configured to perform the above method and a display device configured to perform the above method.

According to an aspect of the present disclosure, there is provided a task presentation apparatus applied to a face recognition device connected to a display device, the apparatus including: the image acquisition module is used for responding to a starting instruction sent by the display equipment and acquiring a task image acquired by the image acquisition equipment; the task operation module is used for operating an image processing task according to the task image to obtain a processing result of the task image, wherein the processing result comprises position information and category information of a human face in the task image; and the sending module is used for sending the processing result and/or the task image to the display equipment, and the display equipment is used for displaying the task image and/or the processing result.

In one possible implementation manner, the sending module includes: the information generation submodule is used for generating task information according to a preset information transmission format and the processing result; the data compression submodule is used for compressing the task image according to a preset data compression format to obtain a compressed task image; and the sending submodule is used for sending the task information and/or the compressed task image to the display equipment.

In one possible implementation, the task information includes: at least one of a sync word, a data amount, a data type, an information content, and a check word; the synchronous words are used for indicating that information sent by the face recognition equipment is task information, the data volume is used for indicating the data volume of a task image sent by the face recognition equipment, the data type is used for indicating that the data sent by the face recognition equipment is the task image, the information content comprises an image identifier of the task image and a processing result of the task image, and the check words are used for checking the integrity of the task information.

In a possible implementation manner, the image processing task includes a face detection task and a face recognition task, and the face detection task is used for detecting a face in the task image; the face recognition task is used for carrying out face recognition on the face in the task image according to the face information of the pre-stored registered face to obtain the class information of the face; the position information comprises at least one of position information of a face detection frame of the face and position information of face key points of the face, and the category information is used for representing the identity category of the face; wherein the apparatus further comprises: and the unlocking module is used for sending an unlocking instruction to the door lock equipment connected with the face recognition equipment under the condition that the identity type indicates that the face in the task image is a registered face, and the unlocking instruction is used for indicating the door lock equipment to unlock the door lock.

In one possible implementation, the apparatus further includes: the instruction receiving module is used for acquiring a face image of a registered face under the condition of receiving an operation instruction aiming at a face registration task sent by the display equipment; the characteristic extraction module is used for extracting the characteristics of the face image to obtain the face characteristics of the face image; and the information storage module is used for determining and storing the face information of the registered face according to the face image of the registered face, wherein the face information comprises the face image and/or the face characteristics.

According to an aspect of the present disclosure, there is provided a task presentation apparatus applied to a display device connected to at least one face recognition device for executing an image processing task, the apparatus including: a result obtaining module, configured to obtain a processing result of the image processing task sent by the face recognition device and a task image corresponding to the processing result, where the task image is an image processed by the image processing task; the image generation module is used for generating a face image according to the task image and the processing result under the condition that the processing result is that the face exists in the task image, and the processing result comprises position information and category information of the face in the task image; and the display module is used for displaying the face image in a display interface of the display equipment.

In one possible implementation manner, the result obtaining module includes: the information receiving submodule is used for receiving task information sent by the face recognition equipment, and the task information is generated according to a preset information transmission format; the analysis submodule is used for analyzing the task information according to the information transmission format to obtain an image identifier and a processing result in the task information; and the determining submodule is used for determining a task image corresponding to the processing result from at least one task image sent by the face recognition equipment according to the image identifier.

In a possible implementation manner, the image processing task includes a face recognition task, the location information includes at least one of location information of a face detection frame and location information of a face key point, and the category information is used to characterize an identity category of the face; wherein the image generation module comprises: the first image generation submodule is used for superposing a face detection frame on the task image according to the position information of the face detection frame to generate a first image; and/or the second image generation submodule is used for superposing the face key points on the task image according to the position information of the face key points to generate a second image; and/or a third image generation sub-module, configured to superimpose the category information on the task image to generate a third image; wherein the face image comprises at least one of the first image, the second image and the third image.

In a possible implementation manner, the task information further includes: at least one of a sync word, a data amount, a data type, and a check word; the synchronous word is used for indicating that information sent by the face recognition equipment is task information, the data volume is used for indicating the data volume of a task image sent by the face recognition equipment, the data type is used for indicating that the data sent by the face recognition equipment is the task image, and the check word is used for checking the integrity of the task information.

In one possible implementation, the apparatus further includes: the checking module is used for checking the integrity of the task information according to the check words in the task information; and/or the allocation module is used for allocating a storage space corresponding to the data volume in the task information according to the data volume in the task information so as to store the task image sent by the face recognition equipment.

In one possible implementation, the image processing task includes a face registration task, and the apparatus further includes: the instruction sending module is used for responding to triggering operation aiming at a face registration task, sending an operating instruction aiming at the face registration task to face recognition equipment indicated by the triggering operation, wherein the operating instruction is used for indicating the face recognition equipment to operate the face registration task, and the face registration task is used for indicating face information of a registered face to be collected and stored in advance.

According to an aspect of the present disclosure, there is provided an electronic device including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the memory-stored instructions to perform the above-described method.

According to an aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the above-described method.

In the embodiment of the disclosure, the display device is connected to the face recognition device, and the display device can display the processing result and the task image of the image processing task sent by the face recognition device, so that hardware cost such as a display screen does not need to be additionally added to the face recognition device, software development cost for driving the display screen to display an interactive interface does not need to be additionally added, and function demonstration of a plurality of different face recognition devices to execute the image processing task can be conveniently realized.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.

FIG. 1 shows a schematic diagram of a task presentation system according to an embodiment of the present disclosure.

Fig. 2 is a flowchart illustrating a task demonstration method in a face recognition device according to an embodiment of the present disclosure.

Fig. 3 shows a schematic diagram of an information transmission format according to an embodiment of the present disclosure.

Fig. 4 shows a flowchart illustrating a task presentation method in a display device according to an embodiment of the present disclosure.

FIG. 5 shows a flowchart of a task demonstration method according to an embodiment of the present disclosure.

FIG. 6 shows a flowchart of a task demonstration method according to an embodiment of the present disclosure.

Fig. 7 illustrates a block diagram of a task presentation device according to an embodiment of the present disclosure.

Fig. 8 illustrates a block diagram of a task presentation device according to an embodiment of the present disclosure.

Fig. 9 shows a block diagram of an electronic device in accordance with an embodiment of the disclosure.

FIG. 10 shows a block diagram of an electronic device in accordance with an embodiment of the disclosure.

Detailed Description

Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers can indicate functionally identical or similar elements. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

The term "and/or" herein is merely an association describing an association target, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.

Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a better understanding of the present disclosure. It will be understood by those skilled in the art that the present disclosure may be practiced without some of these specific details. In some instances, methods, means, elements and circuits that are well known to those skilled in the art have not been described in detail so as not to obscure the present disclosure.

Fig. 1 shows a schematic diagram of a task presentation system according to an embodiment of the present disclosure, which, as shown in fig. 1, includes: the face recognition device is connected to the display device.

The display device may also be referred to as an upper computer, and the display device may be a notebook computer, for example. Face identification equipment can understand the face identification module that does not have external display screen, and face identification equipment can integrate in intelligent entrance guard's equipment, brush face payment equipment etc. intelligent device, as the part of these intelligent device. It should be understood that the face recognition device may be connected to the display device by wire or wirelessly, and the disclosed embodiments are not limited thereto.

In a possible implementation manner, the face recognition device and the display device may be connected by a wired connection through a data line such as a USB (Universal Serial Bus), an SPI (Serial Peripheral Interface), and the like, which is not limited in this embodiment of the disclosure.

In a possible implementation manner, after the face recognition device is powered on and started, images can be periodically acquired through a camera of the face recognition device, and the acquisition frequency can be any value which can be reached by the camera capability of 30fps, 15fps and the like. The face recognition program is deployed in the face recognition device, so that a face recognition task can be executed on any collected frame image, and the face recognition task comprises the following steps: carrying out face detection on the image and outputting a face detection frame; and according to the stored face features of the registered faces, carrying out face feature matching on the faces in the face detection frame to obtain a face recognition result. It should be understood that the face recognition program may continuously select images and perform face recognition processing on the continuously selected images.

Fig. 2 is a flowchart illustrating a task demonstration method in a face recognition device according to an embodiment of the present disclosure, where as shown in fig. 2, the task demonstration method includes:

the method comprises the steps that a camera of the face recognition device periodically collects images, and the frame rate can be set to be the maximum frame rate of a load capable of being carried by wired transmission bandwidth; the face detection algorithm carries out face detection on the collected image and outputs a face detection frame of a face area in the task image, and the face recognition algorithm carries out face recognition on the face in the face detection frame to obtain a face recognition result; compressing the collected image by an image compression algorithm to obtain a compressed image, such as single-frame image coding or multi-frame image video coding; and packaging the processing result of the face recognition task (including the face recognition result, the position information of the face detection frame and the like) according to a preset information transmission format to obtain task information, and packaging and transmitting the compressed image and the task information to display equipment through serial port communication in wired connection.

In consideration of the limited bandwidth performance of the wired transmission protocol, for example, the limited serial port transmission speed, the limited supported transmission baud rate, and the data size of the image is usually large, so the image is usually compressed. The compression method may be various, for example, each image is compressed in JPEG format, or multiple frames of images are encoded by video, for example, in h.264 or h.265 format. It should be understood that the compression rate and the frame rate of acquisition of the image may be adjusted according to the bandwidth performance of the actual cable transmission, and the embodiment of the present disclosure is not limited thereto.

Fig. 3 is a schematic diagram illustrating an information transmission format according to an embodiment of the disclosure, as shown in fig. 3, the information transmission format includes: at least one of a sync word, a data amount, a data type, an information content, and a check word; the synchronous words are used for indicating that information sent by the face recognition device is task information, the data size is used for indicating the data size of an image sent by the face recognition device, the data type is used for indicating that the data sent by the face recognition device is the image, the information content comprises an image identifier of the image and a processing result of the face recognition task, the processing result of the face recognition task comprises at least one of a face recognition result, position information of a face detection frame and position information of a face key point (such as a key point on the five sense organs of the face), and the check words are used for checking the integrity of the task information.

It should be understood that the task information obtained by encapsulating the processing result according to the information transmission format includes: at least one of a sync word, a data amount, a data type, an information content, and a check word; the sync word may indicate a start end of the task information, and the check word may indicate an end of the task information.

In one possible implementation manner, the display device may communicate with the face recognition device according to a communication protocol of wired connection, so as to receive task information and a compressed image sent by the face recognition device; the display equipment can analyze the task information sent by the display equipment according to the information transmission format to obtain a processing result of the face recognition task; decompressing the compressed image to obtain a decompressed image; and displaying the decompressed image, the face recognition result, the face detection frame and the like on a display interface of the display device, for example, overlapping the face detection frame, the face recognition result and the like in the decompressed image and displaying in the display interface, wherein the face recognition result may be, for example, success or failure of identity authentication.

Fig. 4 is a flowchart illustrating a task demonstration method in a display device according to an embodiment of the present disclosure, where the task demonstration method includes, as shown in fig. 4:

the display device receives the task information and the compressed image sent by the face recognition device through serial port communication, and integrity check is carried out on the task information and the compressed image; detecting task information or a compressed image sent by face recognition equipment; analyzing the task information to obtain a processing result, namely a face recognition result, position information of a face detection frame and the like; decompressing (or decoding) the compressed image to obtain a decompressed image; and superposing the face recognition result or the face detection frame on the decompressed image and displaying the face recognition result or the face detection frame in a display interface (or a preview window) of the display equipment.

The task information can be checked for completeness according to check words in the task information, the check words are the sum of the length of the task information or the number of bits of a character, and if the actual length of the task information is the same as the check words, the task information can be considered to be complete; each frame of compressed image can be provided with a check word to indicate the data length of the frame of compressed image, and if the actual length of the compressed image sent by the face recognition device is consistent with the check word, the compressed image can be considered to be complete. Of course, a person skilled in the art may also use any known integrity checking means in the art to implement integrity checking on the compressed image and the task information, and the embodiment of the present disclosure is not limited thereto.

According to the task demonstration system disclosed by the embodiment of the disclosure, the function demonstration experience for the face recognition equipment can be improved, and the hardware cost of function demonstration is not required to be additionally increased; the display device can be in wired connection with at least one different face recognition device, and function demonstration of the face recognition device can be conveniently performed on a large number of different clients.

According to the task demonstration system disclosed by the embodiment of the disclosure, the face recognition device is connected with the display device, and the low-cost friendly face recognition function demonstration system is realized by matching with an information transmission protocol; the information transmission format which can be generalized and universal is provided, so that task information in the face recognition process can be effectively transmitted to display equipment in real time and displayed to a user; can realize that can a display device corresponds a plurality of face identification equipment, be convenient for to carry out the function demonstration to a large amount of different users, improve face identification equipment's popularization demonstration and experience, be favorable to reducing the hardware cost and the software development cost of function demonstration.

Fig. 5 is a flowchart illustrating a task presentation method according to an embodiment of the present disclosure, the method being applied to a face recognition device connected to a display device, as shown in fig. 5, the task presentation method including:

in step S11, in response to a start instruction sent by the display device, a task image is acquired;

in step S12, an image processing task is executed according to the task image to obtain a processing result of the task image, where the processing result includes position information and category information of a face in the task image;

in step S13, the processing result and/or the task image is transmitted to a display device for displaying the task image and/or the processing result.

In one possible implementation manner, in step S11, the user may manually control the display device to send a start instruction; or, after the display device is connected to the face recognition device, the display device may automatically send a start instruction, which is not limited to the embodiment of the present disclosure.

In one possible implementation, the task image may be acquired by an image acquisition device, and the image acquisition device may be various cameras, for example, a monocular camera, a binocular camera, an infrared camera, and the like, which is not limited to the embodiments of the present disclosure. It should be understood that the image capturing device may be a component belonging to the face recognition device, for example, a camera is disposed in the face recognition device, and of course, the image capturing device may also be a camera independent from the face recognition device, for example, a camera externally connected to the face recognition device, and the embodiment of the present disclosure is not limited thereto.

In a possible implementation manner, the image processing task may include a face detection task and a face recognition task, where the face detection task is used to detect a face in the task image; the face recognition task is used for carrying out face recognition on the face in the task image according to the pre-stored face information of the registered face to obtain the class information of the face; the position information comprises at least one of position information of a face detection frame of the face and position information of face key points of the face, the category information is used for representing the identity category of the face, and the identity category can comprise a registered face or a non-registered face; the face information of the registered face includes a face image or a face feature.

In one possible implementation manner, in step S22, running the image processing task according to the task image to obtain a processing result of the task image may include: performing face detection on the task image to obtain position information of a face area of a face in the task image; extracting the characteristics of the face area in the task image to obtain the face characteristics of the face in the task image; and performing feature similarity matching according to the face features of the registered faces and the face features of the faces in the task images to obtain the class information of the faces in the task images.

It should be understood that if the feature similarity matching is successful, the identity category of the face in the task image is the registered face, and the successful similarity matching can be understood that the feature similarity exceeds a preset threshold, and the probability that the face in the task image and the registered face are the same face is high. If the task image does not contain the face, the face detection is carried out on the task image, the face area of the face in the task image is not obtained, and the processing result of the task image is empty.

In a possible implementation manner, under the condition that the face information contains a face image, feature extraction can be performed on the face image to obtain face features of a registered face; and then according to the face features of the registered face and the face features of the face in the task image, performing feature similarity matching to obtain the identity category of the face in the task image.

It should be understood that, when the image processing task is executed, a processing result corresponding to the task image may not be obtained, for example, a frame of task image has no human face, in which case, only the task image may be sent to the display device, or the processing result of the frame of task image may be set to null; and under the condition that the image processing task is operated to obtain a processing result corresponding to the task image, sending the processing result and the task image to the display equipment.

In a possible implementation manner, the display device displays the task image and/or the processing result, for example, the task image and/or the processing result may be displayed through a display interface of the display device, wherein the processing result may be superimposed on the task image for display, and the embodiment of the present disclosure is not limited thereto.

In a possible implementation mode, the face recognition module can be regarded as by the face recognition equipment, and the face recognition module is applied to electronic equipment such as intelligent access control equipment and face brushing payment equipment.

In one possible implementation, in step S13, the sending the processing result and/or the task image to the display device includes:

generating task information according to a preset information transmission format and a processing result; compressing the task image according to a preset data compression format to obtain a compressed task image; and sending the task information and/or the compressed task image to a display device.

Wherein, the information transmission format may be the format shown in fig. 3, and it should be understood that according to the information transmission format shown in fig. 3, in a possible implementation manner, the task information includes: at least one of a sync word, a data amount, a data type, an information content, and a check word; the synchronous words are used for indicating that information sent by the face recognition device is task information, the data volume is used for indicating the data volume of a task image sent by the face recognition device, the data type is used for indicating that the data sent by the face recognition device is the task image, the information content comprises an image identifier of the task image and a processing result of the task image, and the check words are used for checking the integrity of the task information.

As described above, the data size of the task image may be large, and in one possible implementation, the task image may be compressed to obtain a compressed task image; and sending the compressed task image and the task information to the display equipment in a serial port communication mode.

It should be understood that after receiving the task information, the display device may analyze the task information to obtain an image identifier and a processing result in the task information; according to the image identification, determining a task image corresponding to a processing result from at least one decompressed task image sent by the face recognition equipment; and then generating a face image according to the task image corresponding to the processing result and the processing result, and displaying the face image in a display interface of the display device, thereby realizing displaying an image processing function of the face recognition device, such as a face recognition function, in the display device.

In the embodiment of the disclosure, the task image and the processing result can be quickly and effectively transmitted to the display device according to the information transmission format and the data compression format.

As described above, the face recognition device includes a face recognition device, the face recognition device may be applied to an intelligent access control device, the image processing task includes a face recognition task, the category information is used to characterize an identity category of a face, and the identity category may include a registered face or an unregistered face, and in a possible implementation manner, the method further includes:

and under the condition that the face in the identity type indication task image is the registered face, sending an unlocking instruction to door lock equipment connected with the face recognition equipment, wherein the unlocking instruction is used for indicating the door lock equipment to unlock the door lock.

It should be understood that the smart door access device may include a face recognition device and a door lock device, or the face recognition device and the door lock device may be components of the smart door access device.

When the identity type indicates that the face in the task image is the registered face, the face in the task image can be regarded as a user allowed to unlock, so that an unlocking instruction can be sent to the door lock device to indicate the door lock device to unlock the door lock. It should be understood that in the case where the identity class indicates that the face in the task image is an unregistered face, an unlocking instruction may not be sent to the door lock device.

In the embodiment of the disclosure, the function and effect of applying the face recognition device to the intelligent access control device can be conveniently demonstrated to a user.

As described above, the display device may send an operation instruction for the face registration task to the face recognition device, so that the face recognition device operates the face registration task, and in one possible implementation, the method further includes:

acquiring a face image of a registered face under the condition of receiving an operation instruction aiming at a face registration task sent by display equipment; according to the face image of the registered face, face information of the registered face is determined and stored, and the face information comprises the face image and/or face features.

The face image of the registered face may be acquired by the image acquisition device. Determining and storing face information of the registered face according to the face image of the registered face, which may include: and extracting the face features of the registered face in the face image, and storing the face features and/or the face image of the registered face. It should be understood that, persons skilled in the art may collect feature extraction manners known in the art, for example, a feature extraction network, to implement extraction of facial features of a facial image of a registered face, and the embodiment of the present disclosure is not limited thereto.

As described above, the face information stored by the face recognition device can be used for the face recognition device to perform a face recognition task; the face recognition device can send the face image and/or the face features of the registered face obtained by running the face registration task to the display device, and the face registration process can be shown to the user through the display device. It should be understood that the processing result of the face registration task may include face registration success or face registration failure.

In the embodiment of the disclosure, the face recognition device can be controlled by the display device to switch to operate the face registration task, so that the face registration function of the face recognition device can be demonstrated to a user.

Fig. 6 is a flowchart illustrating a task demonstration method according to an embodiment of the present disclosure, the method is applied to a display device, and the display device may be an electronic device such as a User Equipment (UE), a mobile device, a User terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, and the like. The display device is connected to at least one face recognition device, the face recognition device is used for running an image processing task, as shown in fig. 6, the task presentation method includes:

in step S21, a processing result of the image processing task sent by the face recognition device and a task image corresponding to the processing result are obtained, where the task image is an image processed by the image processing task;

in step S22, when the processing result is that the task image has a face, a face image is generated based on the task image and the processing result, and the processing result includes position information and category information of the face in the task image;

in step S23, the face image is presented in the display interface of the display device.

In a possible implementation manner, a wired connection (e.g., a USB connection) may be used between the face recognition device and the display device, and a wireless connection (e.g., a WiFi connection) may also be used, which is not limited to this embodiment of the disclosure.

In one possible implementation manner, the face recognition device can be used as a module applied to intelligent access control equipment, face brushing payment equipment and the like; the image processing task may include the face recognition task, the face detection task, the face registration task, and the like.

The face registration task is used for acquiring and storing face information of a registered face in advance, wherein the face information can comprise a face image and/or face features of the registered face; the face detection task is used for detecting the face in the task image, and the face recognition task is used for carrying out face recognition on the face in the task image according to the face information of the pre-stored registered face to obtain the class information of the face.

In a possible implementation manner, the task image sent by the face recognition device may also be a compressed task image, and the display device may decompress the compressed task image to obtain a decompressed task image, so that the face image is generated according to the task image and the processing result.

It should be understood that each frame of task image may correspond to a processing result, where in a case where a face exists in the task image (for example, a face exists), the processing result may include location information and category information of the face in the image, and accordingly, in a case where the face does not exist in the task image, the processing result of the frame of task image may be null.

In a possible implementation manner, the location information includes at least one of location information of the face detection box and location information of key points of the face, the category information is used to represent an identity category of the face, and the identity category may include a registered face or a non-registered face, it is understood that the non-registered face may be understood as a stranger who cannot unlock the door, and the registered face may be understood as a non-stranger who can unlock the door.

As described above, the processing result of the task image may be null, that is, the task image does not have a human face, and in a possible implementation manner, the task image may be directly displayed in the display interface of the display device when the processing result is that the task image does not have a human face.

In one possible implementation manner, in step S22, in the case that the processing result is that a human face exists in the task image, generating a human face image according to the task image and the processing result may include: according to the position information of the face detection frame, overlapping the face detection frame on the task image to generate a first image; and/or according to the position information of the face key points, overlaying the face key points on the task image to generate a second image; and/or, superimposing the category information on the task image to generate a third image; the face image comprises at least one of a first image, a second image and a third image. By the method, the process that the face recognition equipment executes the face recognition task can be effectively displayed in the display equipment, and the face recognition function of the face recognition equipment can be conveniently demonstrated to a user.

The position information of the face detection frame may include image coordinates of four vertices of the face detection frame, and it should be understood that the face detection frame may be drawn on the task image according to the image coordinates of the four vertices, that is, the face detection frame may be superimposed on the task image; the position information of the face key points can comprise the image positions of key points on facial features and/or the image positions of key points on a face contour, and it is understood that the face key points can be drawn on the task image according to the image coordinates of the face key points, namely the superposition of the face key points on the task image is realized; and overlaying prompting sentences corresponding to the category information, such as non-registered users or registered users, on the task image.

It should be understood that a person skilled in the art may adopt programming languages known in the art, such as C language, Python language, and the like, to implement the program code of the task presentation method applied to the face recognition device, and a display interface corresponding to the task presentation method, so as to present the processing procedure, the processing result, and the like of the image processing task to the user. The display interface may be referred to as an interactive interface, a graphical user interface, and the like, and it should be understood that a person skilled in the art may design an interface layout, an interface function, and the like of the display interface according to actual requirements, and the embodiment of the present disclosure is not limited thereto.

In the embodiment of the disclosure, the display device is connected to at least one face recognition device, the display device obtains a processing result and a task image of an image processing task sent by the face recognition device, and then generates a face image according to the processing result and the task image and displays the face image in a display interface of the display device, so that hardware costs such as a display screen and the like do not need to be additionally added on the face recognition device, software development cost for driving the display screen to display an interactive interface does not need to be additionally added, and function demonstration of executing the image processing task by a plurality of different face recognition devices can be conveniently realized.

Considering that the information is transmitted between the devices according to the conventional information transmission format, and the processing result may be that the face recognition device packages and transmits the information to the display device according to the conventional information transmission format, in a possible implementation manner, in step S11, the processing result of the image processing task transmitted by the face recognition device and the task image corresponding to the processing result are acquired, including:

receiving task information sent by face recognition equipment, wherein the task information is generated according to a preset information transmission format;

analyzing the task information according to the information transmission format to obtain an image identifier and a processing result in the task information; and according to the image identification, determining a task image corresponding to the processing result from at least one task image sent by the face recognition equipment.

In a possible implementation manner, the task information may be information obtained by encapsulating, by the face recognition device, the processing result of the task image according to the information transmission format, and for the generation manner of the task information, reference may be made to the relevant description of the embodiment of the present disclosure, which is not described herein again.

The information transmission format may be, for example, the format shown in fig. 3, and may also be other information transmission formats, which is not limited to this embodiment of the present disclosure. It should be understood that according to the information transmission format shown in fig. 3, the task information may include an image identifier and a processing result corresponding to the image identifier, or a processing result of a task image corresponding to the image identifier.

It should be understood that the task image sent by the face recognition device may include at least one task image, and the task information may also include at least one task image, and the task image corresponding to the image identifier may be found through the image identifier in the task information, that is, the task image corresponding to the processing result is determined from the at least one task image sent by the face recognition device.

In the embodiment of the disclosure, the processing result of the task image can be effectively obtained according to the information transmission format and the task information sent by the face recognition device, so that the face image can be conveniently generated later.

In a possible implementation manner, according to the information transmission format shown in fig. 3, the task information further includes: at least one of a sync word, a data amount, a data type, and a check word; the synchronous word is used for indicating that information sent by the face recognition device is task information, the data volume is used for indicating the data volume of a task image sent by the face recognition device, the data type is used for indicating that the data sent by the face recognition device is the task image, and the check word is used for checking the integrity of the task information. As described above, the sync word may indicate a start end of the task information, and the check word may indicate an end of the task information.

By the method, a generalized and universal communication format can be realized, and the method is beneficial for the face recognition equipment to transmit the processing result of the image processing task to the display equipment and display the processing result to the user.

In one possible implementation, the method further includes:

checking the integrity of the task information according to the check words in the task information; and/or allocating a storage space corresponding to the data amount in the task information according to the data amount in the task information so as to store the task image sent by the face recognition equipment.

As described above, the check word is the sum of the length of the task information or the number of the character bits, and if the actual length of the task information is the same as the check word, the task information can be considered to be complete; correspondingly, if the actual length of the task information is different from the check word, the task information can be considered to be incomplete.

As described above, the face recognition device may send a compressed image (i.e., a compressed task image) to the display device, where each frame of the compressed image may have a check word to indicate the data length of the frame of the compressed image, and if the actual length of the compressed image sent by the face recognition device is consistent with the check word, the compressed image may be considered to be complete. Of course, a person skilled in the art may also use any known integrity checking means in the art to implement integrity checking on the compressed image and the task information, and the embodiment of the present disclosure is not limited thereto.

In a possible implementation manner, the data amount in the task information may be used to indicate the data amount of a compressed image (i.e., a compressed task image), and may also be used to indicate the data amount of a task image before compression, which is not limited by the embodiment of the present disclosure. According to the data amount in the task information, the storage space can be automatically allocated to store the task image.

In the embodiment of the disclosure, each item of information in the task information can be effectively utilized, and the display of the processing result of the image processing task in the display device is realized.

In one possible implementation, the image processing task includes a face registration task, and the method further includes:

and responding to the triggering operation aiming at the face registration task, and sending an operating instruction aiming at the face registration task to the face recognition equipment indicated by the triggering operation, wherein the operating instruction is used for indicating the face recognition equipment to operate the face registration task, and the face registration task is used for indicating the face information of the registered face to be collected and stored in advance.

As described above, the face recognition device (e.g., the face recognition device) may automatically run the face recognition task after being powered on, and the face registration task may need additional operations to be manually triggered, for example, the intelligent access control device runs the face recognition task normally, and if a new registered user is to be added, the face registration task may be executed by switching to the manual triggering mode.

The triggering operation for the face registration task can be realized through a display interface corresponding to the task demonstration method, for example, a triggering control for the face registration task can be provided in the display interface, and a user can select any face recognition device and instruct the face recognition device to run the face registration task through the triggering control, that is, a running instruction for the face registration task is sent to the face recognition device instructed by the triggering operation. It should be understood that the disclosed embodiments are not limited to the implementation of the trigger operation.

The face information of the registered face may include a face image and/or a face feature, and it should be understood that a person skilled in the art may collect a feature extraction manner known in the art to extract the face feature of the face image, which is not limited in this disclosure.

As described above, the face recognition task is configured to perform face recognition on a face in the task image according to pre-stored face information of a registered face, so as to obtain an identity type of the face in the task image. In a possible implementation mode, image similarity matching can be carried out according to a face image of a registered face and a task image to obtain the identity category of the face in the task image; and performing feature similarity matching according to the face features of the registered face and the face features of the face in the task image to obtain the identity category of the face in the task image.

It should be understood that, persons skilled in the art may use face recognition technology and face registration technology known in the art to implement a face recognition task and a face registration task, and the embodiment of the present disclosure is not limited thereto.

In a possible implementation manner, the face recognition device may send a face image and/or face features of a registered face obtained by running the face registration task to the display device, and may present the face registration process to the user through the display device. It should be understood that the processing result of the face registration task may include face registration success or face registration failure.

It is understood that the above-mentioned method embodiments of the present disclosure can be combined with each other to form a combined embodiment without departing from the logic of the principle, which is limited by the space, and the detailed description of the present disclosure is omitted. Those skilled in the art will appreciate that in the above methods of the specific embodiments, the specific order of execution of the steps should be determined by their function and possibly their inherent logic.

In addition, the present disclosure also provides a task demonstration apparatus, an electronic device, a computer-readable storage medium, and a program, which can be used to implement any one of the task demonstration methods provided by the present disclosure, and the corresponding technical solutions and descriptions and corresponding descriptions in the method section are omitted for brevity.

Fig. 7 is a block diagram illustrating a task presentation apparatus according to an embodiment of the present disclosure, as shown in fig. 7, the apparatus being applied to a face recognition device connected to a display device, the apparatus including:

the image acquisition module 101 is configured to respond to a start instruction sent by the display device and acquire a task image acquired by an image acquisition device;

the task running module 102 is configured to run an image processing task according to the task image to obtain a processing result of the task image, where the processing result includes position information and category information of a face in the task image;

a sending module 103, configured to send the processing result and/or the task image to the display device, where the display device is configured to display the task image and/or the processing result.

In a possible implementation manner, the sending module 103 includes: the information generation submodule is used for generating task information according to a preset information transmission format and the processing result; the data compression submodule is used for compressing the task image according to a preset data compression format to obtain a compressed task image; and the sending submodule is used for sending the task information and/or the compressed task image to the display equipment.

Fig. 8 is a block diagram illustrating a task presentation apparatus according to an embodiment of the present disclosure, as shown in fig. 8, the apparatus is applied to a display device connected to at least one face recognition device for executing an image processing task, the apparatus includes:

a result obtaining module 201, configured to obtain a processing result of the image processing task sent by the face recognition device and a task image corresponding to the processing result, where the task image is an image processed by the image processing task;

an image generating module 202, configured to generate a face image according to the task image and the processing result when the processing result indicates that the task image has a face, where the processing result includes position information and category information of the face in the task image;

and the display module 203 is configured to display the face image in a display interface of the display device.

In a possible implementation manner, the result obtaining module 201 includes: the information receiving submodule is used for receiving task information sent by the face recognition equipment, and the task information is generated according to a preset information transmission format; the analysis submodule is used for analyzing the task information according to the information transmission format to obtain an image identifier and a processing result in the task information; and the determining submodule is used for determining a task image corresponding to the processing result from at least one task image sent by the face recognition equipment according to the image identifier.

In some embodiments, functions of or modules included in the apparatus provided in the embodiments of the present disclosure may be used to execute the method described in the above method embodiments, and specific implementation thereof may refer to the description of the above method embodiments, and for brevity, will not be described again here.

Embodiments of the present disclosure also provide a computer-readable storage medium having stored thereon computer program instructions, which when executed by a processor, implement the above-mentioned method. The computer readable storage medium may be a volatile or non-volatile computer readable storage medium.

An embodiment of the present disclosure further provides an electronic device, including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the memory-stored instructions to perform the above-described method.

The disclosed embodiments also provide a computer program product comprising computer readable code or a non-transitory computer readable storage medium carrying computer readable code, which when run in a processor of an electronic device, the processor in the electronic device performs the above method.

The electronic device may be provided as a terminal, server, or other form of device.

Fig. 9 illustrates a block diagram of an electronic device 800 in accordance with an embodiment of the disclosure. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, a display device as described above, a face recognition device, and the like.

Referring to fig. 9, electronic device 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.

The processing component 802 generally controls overall operation of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations at the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 806 provides power to the various components of the electronic device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.

The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 800 is in an operation mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the electronic device 800. For example, the sensor assembly 814 may detect an open/closed state of the electronic device 800, the relative positioning of components, such as a display and keypad of the electronic device 800, the sensor assembly 814 may also detect a change in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, orientation or acceleration/deceleration of the electronic device 800, and a change in the temperature of the electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a Complementary Metal Oxide Semiconductor (CMOS) or Charge Coupled Device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 may access a wireless network based on a communication standard, such as a wireless network (WiFi), a second generation mobile communication technology (2G) or a third generation mobile communication technology (3G), or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium, such as the memory 804, is also provided that includes computer program instructions executable by the processor 820 of the electronic device 800 to perform the above-described methods.

Fig. 10 shows a block diagram of an electronic device 1900 according to an embodiment of the disclosure. For example, the electronic device 1900 may be provided as a server. Referring to fig. 10, electronic device 1900 includes a processing component 1922 further including one or more processors and memory resources, represented by memory 1932, for storing instructions, e.g., applications, executable by processing component 1922. The application programs stored in memory 1932 may include one or more modules that each correspond to a set of instructions. Further, the processing component 1922 is configured to execute instructions to perform the above-described method.

The electronic device 1900 may also include a power component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input/output (I/O) interface 1958. The electronic device 1900 may operate based on an operating system, such as the Microsoft Server operating system (Windows Server), stored in the memory 1932^TM) Apple Inc. of the present application based on the graphic user interface operating System (Mac OS X)^TM) Multi-user, multi-process computer operating system (Unix)^TM) Free and open native code Unix-like operating System (Linux)^TM) Open native code Unix-like operating System (FreeBSD)^TM) Or the like.

In an exemplary embodiment, a non-transitory computer readable storage medium, such as the memory 1932, is also provided that includes computer program instructions executable by the processing component 1922 of the electronic device 1900 to perform the above-described methods.

The present disclosure may be systems, methods, and/or computer program products. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the present disclosure.

The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.

The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.

The computer program instructions for carrying out operations of the present disclosure may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry that can execute the computer-readable program instructions implements aspects of the present disclosure by utilizing the state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).

Various aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The computer program product may be embodied in hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.

Having described embodiments of the present disclosure, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A task presentation method, applied to a face recognition device connected to a display device, the method comprising:

responding to a starting instruction sent by the display equipment, and acquiring a task image;

running an image processing task according to the task image to obtain a processing result of the task image, wherein the processing result comprises position information and category information of a human face in the task image;

and sending the processing result and/or the task image to the display equipment, wherein the display equipment is used for displaying the task image and/or the processing result.

2. The method of claim 1, wherein sending the processing result and/or the task image to the display device comprises:

generating task information according to a preset information transmission format and the processing result;

compressing the task image according to a preset data compression format to obtain a compressed task image;

and sending the task information and/or the compressed task image to the display equipment.

3. The method of claim 2, wherein the task information comprises: at least one of a sync word, a data amount, a data type, an information content, and a check word;

the synchronous words are used for indicating that information sent by the face recognition equipment is task information, the data volume is used for indicating the data volume of a task image sent by the face recognition equipment, the data type is used for indicating that the data sent by the face recognition equipment is the task image, the information content comprises an image identifier of the task image and a processing result of the task image, and the check words are used for checking the integrity of the task information.

4. The method according to any one of claims 1-3, wherein the image processing task comprises a face detection task and a face recognition task, wherein the face detection task is used for detecting a face in the task image; the face recognition task is used for carrying out face recognition on the face in the task image according to the face information of the pre-stored registered face to obtain the class information of the face;

the position information comprises at least one of position information of a face detection frame of the face and position information of face key points of the face, and the category information is used for representing the identity category of the face;

wherein the method further comprises:

and under the condition that the identity type indicates that the face in the task image is a registered face, sending an unlocking instruction to door lock equipment connected with the face recognition equipment, wherein the unlocking instruction is used for indicating the door lock equipment to unlock a door lock.

5. The method of claim 1, further comprising:

under the condition that an operation instruction aiming at a face registration task sent by the display equipment is received, a face image of a registered face is obtained;

extracting the features of the face image to obtain the face features of the face image;

and determining and storing face information of the registered face according to the face image of the registered face, wherein the face information comprises the face image and/or the face features.

6. A task presentation method, applied to a display device connected to at least one face recognition device for running an image processing task, the method comprising:

acquiring a processing result of the image processing task sent by the face recognition device and a task image corresponding to the processing result, wherein the task image is an image processed by the image processing task;

generating a face image according to the task image and the processing result under the condition that the processing result is that the face exists in the task image, wherein the processing result comprises position information and category information of the face in the task image;

and displaying the face image in a display interface of the display equipment.

7. The method according to claim 6, wherein the acquiring of the processing result of the image processing task sent by the face recognition device and the task image corresponding to the processing result comprises:

receiving task information sent by the face recognition equipment, wherein the task information is generated according to a preset information transmission format;

analyzing the task information according to the information transmission format to obtain an image identifier and a processing result in the task information;

and determining a task image corresponding to the processing result from at least one task image sent by the face recognition equipment according to the image identifier.

8. The method according to claim 6 or 7, wherein the image processing task comprises a face recognition task, the position information comprises at least one of position information of a face detection frame and position information of a face key point, and the category information is used for representing an identity category of the face;

wherein, the generating a face image according to the task image and the processing result comprises:

according to the position information of the face detection frame, superimposing the face detection frame on the task image to generate a first image; and/or the presence of a gas in the gas,

according to the position information of the face key points, superimposing the face key points on the task image to generate a second image; and/or the presence of a gas in the gas,

overlaying the category information on the task image to generate a third image;

wherein the face image comprises at least one of the first image, the second image and the third image.

9. The method of claim 8, wherein the task information further comprises: at least one of a sync word, a data amount, a data type, and a check word;

the synchronous word is used for indicating that information sent by the face recognition equipment is task information, the data volume is used for indicating the data volume of a task image sent by the face recognition equipment, the data type is used for indicating that the data sent by the face recognition equipment is the task image, and the check word is used for checking the integrity of the task information.

10. The method of claim 9, further comprising:

checking the integrity of the task information according to the check word in the task information; and/or the presence of a gas in the gas,

and allocating a storage space corresponding to the data amount in the task information according to the data amount in the task information so as to store the task image sent by the face recognition equipment.

11. The method of any of claims 6-10, wherein the image processing task comprises a face registration task, the method further comprising:

responding to a triggering operation aiming at a face registration task, and sending an operating instruction aiming at the face registration task to face recognition equipment indicated by the triggering operation, wherein the operating instruction is used for indicating the face recognition equipment to operate the face registration task, and the face registration task is used for indicating that face information of a registered face is collected and stored in advance.

12. A task presentation system, characterized in that the task presentation system comprises a face recognition device configured to perform the method of any of claims 1-5 and a display device configured to perform the method of any of claims 6-11.

13. A task presentation apparatus, wherein the apparatus is applied to a face recognition device connected to a display device, the apparatus comprising:

the image acquisition module is used for responding to a starting instruction sent by the display equipment and acquiring a task image acquired by the image acquisition equipment;

the task operation module is used for operating an image processing task according to the task image to obtain a processing result of the task image, wherein the processing result comprises position information and category information of a human face in the task image;

and the sending module is used for sending the processing result and/or the task image to the display equipment, and the display equipment is used for displaying the task image and/or the processing result.

14. A task presentation apparatus for application to a display device connected to at least one face recognition device for running image processing tasks, the apparatus comprising:

a result obtaining module, configured to obtain a processing result of the image processing task sent by the face recognition device and a task image corresponding to the processing result, where the task image is an image processed by the image processing task;

the image generation module is used for generating a face image according to the task image and the processing result under the condition that the processing result is that the face exists in the task image, and the processing result comprises position information and category information of the face in the task image;

and the display module is used for displaying the face image in a display interface of the display equipment.

15. An electronic device, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to invoke the memory-stored instructions to perform the method of any of claims 1 to 11.

16. A computer readable storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1 to 11.