WO2021218926A1

WO2021218926A1 - Image display method and apparatus, and computer device

Info

Publication number: WO2021218926A1
Application number: PCT/CN2021/089984
Authority: WO
Inventors: 陈莹; 何胜远; 王梁; 申川
Original assignee: 杭州海康威视数字技术股份有限公司
Priority date: 2020-04-30
Filing date: 2021-04-26
Publication date: 2021-11-04
Also published as: CN113592874A

Abstract

Embodiments of the resent application relate to the technical field of image processing. Disclosed are an image display method and apparatus, and a computer device. The method comprises: obtaining an image, and determining a face area in the image; determining a target area in the image according to the face area in the image, the size of the target area being the same as the size of a display interface; cropping the target area in the image to obtain a target image; and displaying the target image in the display interface. In the embodiments of the present application, once a user is in an image acquisition range, the face of the user will be included as much as possible in the target image displayed in the display interface, thereby expanding the position range within which face display can be implemented, and improving the flexibility of face display, thus greatly improving user experience.

Description

Image display method, device and computer equipment

The embodiments of this application require the priority of the Chinese patent application filed on April 30, 2020, with the application number 202010364395.9 and the invention title "Image Display Method, Apparatus, and Computer Equipment", the entire content of which is incorporated into this application by reference. In the example.

Technical field

The embodiments of the present application relate to the field of image processing technology, and in particular to an image display method, device, and computer equipment.

Background technique

With the development of image processing technology, biometric access control systems based on artificial intelligence and deep learning have developed rapidly. Among them, face recognition access control is more and more widely used in access control systems due to its fast speed, convenient traffic and good user experience.

At present, the face recognition access control system is limited by the appearance of the device, and its preview interface for users to watch their face is often displayed as a fixed scene, that is, the image at a fixed position in the capture range of the camera is displayed in the preview. Interface. In this case, the user must stand at the fixed position to see his face on the preview interface, which limits the display position of the face to a small range, which brings inconvenience to the user.

Summary of the invention

The embodiments of the present application provide an image display method, device, computer equipment, and storage medium, which can expand the position where the human face can be displayed.

In one aspect, an image display method is provided, and the method includes:

Acquiring an image, and determining a face area in the image;

Determining a target area in the image according to the face area in the image, where the size of the target area is the same as the size of the display interface;

Crop out the target area in the image to obtain the target image;

The target image is displayed on the display interface.

Optionally, the determining the face area in the image includes:

Determine one or more detection frames in the image, where the detection frames contain a human face;

The area indicated by the largest detection frame in one or more detection frames in the image is taken as the face area in the image.

Optionally, the determining the target area in the image according to the face area in the image includes:

Taking an area in the image with the same size as the size of the display interface and the same center point as the center point of the face area in the image as the first area;

Taking the target area in the last frame of image collected before the image is collected as the second area;

According to the first area and the second area, a target area in the image is determined.

Optionally, the determining the target area in the image according to the first area and the second area includes:

If the distance between the position of the first area and the position of the second area is less than or equal to a preset distance, using the first area as the target area in the image;

If the distance between the position of the first area and the position of the second area is greater than the preset distance, the position of the second area is moved to the direction of the position of the first area by the preset distance , Obtain the target position; take an area in the image with the same position as the target position as the target area in the image.

Optionally, the method further includes:

If there is no face area in the image, use an area in the image with the same size as the size of the display interface and the same center point as the center point of the image as the first area;

In one aspect, an image display device is provided, and the device includes:

The processor is configured to determine the face area in the acquired image; determine the target area in the image according to the face area in the image, and the size of the target area is the same as the size of the display interface; Describe the target area in the image to obtain the target image;

The display is used to display the target image on the display interface.

Optionally, the processor is used to:

Optionally, the processor is further configured to:

Optionally, the device further includes:

The image acquisition module is used to acquire images.

In one aspect, an image display device is provided, and the device includes:

Image acquisition module for acquiring images;

The first determining module is used to determine the face area in the image;

The second determining module is configured to determine a target area in the image according to the face area in the image, and the size of the target area is the same as the size of the display interface;

The cropping module is used to crop out the target area in the image to obtain the target image;

The display module is used to display the target image on the display interface.

Optionally, the first determining module is used to:

Optionally, the second determining module is used to:

Optionally, the device further includes:

The third determining module is configured to, if there is no face area in the image, use an area in the image with the same size as the size of the display interface and the same center point as the center point of the image as the first area ；

A fourth determining module, configured to use the target area in the last frame of image acquired before the image is acquired as the second area;

The fifth determining module is configured to determine a target area in the image according to the first area and the second area.

In one aspect, a computer device is provided. The computer device includes a processor and a memory, the memory is used to store a computer program, and the processor is used to execute the program stored in the memory to realize the above-mentioned image display Method steps.

In one aspect, a computer-readable storage medium is provided, and a computer program is stored in the storage medium, and when the computer program is executed by a processor, the steps of the above-mentioned image display method are realized.

On the one hand, a computer program product containing instructions is provided, which when run on a computer, causes the computer to execute the steps of the above-mentioned image display method.

The technical solutions provided by the embodiments of the present application can at least bring about the following beneficial effects:

After acquiring the image, determine the face area in the image. Then, the target area in the image is determined according to the face area in the image, and then the target area in the image is cut out to obtain the target image. Finally, the target image is displayed on the display interface. In this way, as long as the user is within the image acquisition range, the target image displayed on the display interface will contain the user's face as much as possible. Compared with the solution in the related art that requires the user to stand at a fixed position to realize the face display, the embodiment of the present application expands the position range that can realize the face display, improves the flexibility of the face display, and can greatly improve the user. Experience.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

FIG. 1 is a flowchart of an image display method provided by an embodiment of the present application;

FIG. 2 is a flowchart of another image display method provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of a face area and a first area provided by an embodiment of the present application;

FIG. 4 is a schematic diagram of a first area, a second area, and a target area provided by an embodiment of the present application;

FIG. 5 is a flowchart of another image display method provided by an embodiment of the present application;

FIG. 6 is a schematic structural diagram of an image display device provided by an embodiment of the present application;

FIG. 7 is a schematic structural diagram of another image display device provided by an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a terminal provided by an embodiment of the present application;

Fig. 9 is a schematic structural diagram of a server provided by an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the following further describes the embodiments of the present application in detail with reference to the accompanying drawings.

It should be understood that the "plurality" mentioned in the embodiments of the present application refers to two or more. In the description of the embodiments of the present application, unless otherwise specified, "/" means or, for example, A/B can mean A or B; "and/or" in this document is only an association describing the associated object Relationship means that there can be three kinds of relationships. For example, A and/or B can mean that: A alone exists, A and B exist at the same time, and B exists alone. In addition, in order to clearly describe the technical solutions of the embodiments of the present application, words such as "first" and "second" are used to distinguish the same items or similar items that have substantially the same function and effect. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and order of execution, and words such as "first" and "second" do not limit the difference.

Fig. 1 is a flowchart of an image display method provided by an embodiment of the present application. Referring to Figure 1, the method includes the following steps:

Step 101: Obtain an image, and determine the face area in the image.

Step 102: Determine a target area in the image according to the face area in the image, and the size of the target area is the same as the size of the display interface.

Step 103: Cut out the target area in the image to obtain the target image.

Step 104: Display the target image on the display interface.

In the embodiment of the present application, after the image is acquired, the face area in the image is determined. Then, the target area in the image is determined according to the face area in the image, and then the target area in the image is cut out to obtain the target image. Finally, the target image is displayed on the display interface. In this way, as long as the user is within the image acquisition range, the target image displayed on the display interface will contain the user's face as much as possible. Compared with the solution in the related art that requires the user to stand at a fixed position to realize the face display, the embodiment of the present application expands the position range that can realize the face display, improves the flexibility of the face display, and can greatly improve the user. Experience.

Optionally, determining the face area in the image includes:

Determine one or more detection frames in the image, where the detection frames contain human faces;

Optionally, determining the target area in the image according to the face area in the image includes:

Taking an area in the image that has the same size as the size of the display interface and the center point is the same as the center point of the face area in the image as the first area;

According to the first area and the second area, the target area in the image is determined.

Optionally, determining the target area in the image according to the first area and the second area includes:

If the distance between the position of the first area and the position of the second area is less than or equal to the preset distance, the first area is taken as the target area in the image;

If the distance between the position of the first area and the position of the second area is greater than the preset distance, the position of the second area is moved to the direction of the position of the first area by the preset distance to obtain the target position; The area with the same position as the target position is regarded as the target area in the image.

Optionally, the method further includes:

If there is no face area in the image, then an area in the image with the same size as the size of the display interface and the same center point as the center point of the image is taken as the first area;

All the above-mentioned optional technical solutions can be combined in any combination to form optional embodiments of the present application, and the embodiments of the present application will not repeat them one by one.

Fig. 2 is a flowchart of an image display method provided by an embodiment of the present application. Referring to Figure 2, the method includes the following steps.

Step 201: Obtain an image, and determine a target area in the image.

Among them, when acquiring an image, one frame of image can be acquired every time the camera acquires a frame of image during the image acquisition process.

The camera can collect images in real time. The camera may be a camera used in an access control device. On the one hand, the image collected by the camera can be used for face recognition. The access control device can open the door when the face recognition is successful, and maintain the door when the face recognition fails. On the other hand, the image collected by the camera can be previewed by the user, that is, can be used for display on the display screen of the access control device, and can be specifically displayed according to the image display method provided in the embodiment of the present application.

Of course, the image display method provided in the embodiments of the present application can be applied not only to access control devices, but also to other devices with image display requirements, such as payment devices, which are not limited in the embodiments of the present application.

It should be noted that the size of the target area is the same as the size of the display interface. In other words, the width and height of the target area are consistent with the screen display resolution. In this way, the image of the target area can be directly displayed on the display interface.

It is worth noting that every time the camera collects a frame of image, the target area in the image can be determined, so that the subsequent image preview in the display interface can be realized accordingly. That is, the embodiment of the present application can realize real-time preview of the image collected by the camera during the image collection process.

Among them, when determining the target area in the image, if there is a face area in the image, the target area in the image can be determined according to the following first possible way; if there is no face area in the image, you can Determine the target area in the image according to the second possible way as follows.

The first possible way: determine the face area in the image; determine the target area in the image according to the face area in the image.

It should be noted that the face area in the image is an area where a face exists in the image.

Wherein, when determining the face area in the image, one or more detection frames in the image can be determined, and the area indicated by the largest detection frame in the one or more detection frames in the image is taken as the area in the image Of the face area.

It should be noted that the detection frame contains a human face, and the detection frame is used to indicate an area where the human face exists. The area can usually be a rectangular area, so the size of the detection frame can usually include the width and height of the detection frame.

In addition, the face contained in the largest detection frame in one or more detection frames in the image is most likely to be the face of the person currently using the camera, so one or more of the The area indicated by the largest detection frame in the detection frame is taken as the face area in the image. For example, the area indicated by the widest or highest detection frame in one or more detection frames in the image can be used as the face area in the image.

There are many ways to determine one or more detection frames in the image. For example, the image can be input to a face detection model, and the face detection model outputs the position of each detection frame in the image. The position of the detection frame may include the size and position of the detection frame (such as the upper left corner point). , The lower left corner point, the upper right corner point, the lower right corner point or the center point) coordinates. Of course, one or more detection frames in the image can also be determined in other ways, which is not limited in the embodiment of the present application.

It should be noted that the face detection model may be a pre-trained model that can determine the detection frame where the face appears in the image. For example, the face detection model may be CNN (Convolutional Neural Network, convolutional neural network).

In addition, if the coordinates of the position point included in the position of the detection frame are not the coordinates of the center point, the area indicated by the largest detection frame in one or more detection frames in the image is regarded as the person in the image. After the face area, the coordinates of the center point of the face area can also be determined according to the size of the face area and the coordinates of the location point.

Wherein, according to the face area in the image, the operation of determining the target area in the image may be: the size in the image is the same as the size of the display interface, and the center point is the same as the center point of the face area in the image As the target area in the image. Or, the area in the image whose size is the same as the size of the display interface and the center point is the same as the center point of the face area is regarded as the first area; the target area in the last frame of the image captured before the image is captured As the second area; according to the first area and the second area, determine the target area in the image.

It should be noted that when there is a face area in the image, the boundary of the first area in the image is obtained by expanding or shrinking the boundary of the face area in the image in the image. That is to say, when the size of the face area in the image is smaller than the size of the display interface, the boundary of the first area in the image is expanded by the boundary of the face area in the image. Obtained; when the size of the face area in the image is greater than the size of the display interface, the boundary of the first area in the image is obtained by shrinking the boundary of the face area in the image in the image When the size of the face area in the image is equal to the size of the display interface, the face area in the image can be directly used as the first area.

For example, as shown in Figure 3, suppose the size of the face area in the image is smaller than the size of the display interface, and the center point of the face area in the image is point M, the width of the display interface is a, and the height is b. Then you can take the center point of the face area in the image (ie M point) as the starting point, and expand the area boundary to one-half of the width of the display interface (ie 1/2 of a) in the width direction , In the height direction, expand the area boundary to one-half of the height of the display interface (that is, 1/2 of b), and the area enclosed by the expanded area boundary is the first area. At this time, the size of the first area in the image is the same as the size of the display interface, and the center point is the same as the center point of the face area in the image.

In addition, if the boundary of the first region obtained after the boundary of the face region in the image is expanded beyond the boundary of the image, the boundary adjustment of the first region may be performed. For example, the boundary of the first area may be moved in the width direction and/or the height direction into the image until the boundary of the first area is exactly in the image.

It should be noted that the image is the image currently collected by the camera. The image of the target area in the last frame of the image collected by the camera before the image is collected is the image currently displayed on the display interface. That is, the image of the second area is the image being displayed on the display interface when the camera collects the image.

In addition, in the embodiments of the present application, the first area and the second area may be combined, that is, the area where the face is located in the current image and the area where the image being displayed on the display interface is located in the previous frame of the image. Determine the area in the current image where the image to be displayed on the display interface is located in the current image. In this way, it helps to achieve a smooth display of the image.

Wherein, according to the first area and the second area, the operation of determining the target area in the image may be: if the distance between the position of the first area and the position of the second area is less than or equal to the preset distance, then the first area The area is used as the target area in the image. If the distance between the position of the first area and the position of the second area is greater than the preset distance, the position of the second area is moved to the direction of the position of the first area by the preset distance to obtain the target position; The same area as the target position is taken as the target area in the image.

It should be noted that the preset distance can be set according to actual usage requirements, and the preset distance can be set to be smaller.

In addition, since the size of the first area and the size of the second area are the same, the position of the first area and the position of the second area can both be indicated by corresponding position points. That is, the distance between the position of the first area and the position of the second area can be measured by the corresponding position point in the first area and the second area, and the position point may be a corner point or a center point.

For example, the distance between the upper left corner point of the first area and the upper left corner point of the second area can be taken as the distance between the position of the first area and the position of the second area; or, the lower left corner of the first area can be The distance between the point and the lower left corner point of the second area is taken as the distance between the position of the first area and the position of the second area; alternatively, the upper right corner point of the first area and the upper right corner point of the second area The distance between the first area and the second area is the distance between the position of the first area and the position of the second area; alternatively, the distance between the lower right corner point of the first area and the lower right corner point of the second area can be taken as the distance between the position of the first area and the position of the second area. The distance between the positions of the second area; or, the distance between the center point of the first area and the center point of the second area may be taken as the distance between the position of the first area and the position of the second area.

If the distance between the position of the first area and the position of the second area is less than or equal to the preset distance, it means that the position of the first area is relatively close to the position of the second area. At this time, the image display of the second area is switched to The image display of the first area is relatively smooth, so the first area can be directly used as the target area in the image, so that the area where the human face is located in the current image can be directly displayed subsequently.

If the distance between the position of the first area and the position of the second area is greater than the preset distance, it means that the position of the first area is farther away from the position of the second area. At this time, the image display of the second area is switched to the first area. The image display of the area is likely to show fluctuations in the display screen, so at this time, the first area is not used as the target area in the image, but the position of the second area is moved in the direction of the position of the first area. Distance to get the location of the target area in the image. That is to say, in this case, the position of the image being displayed on the display interface is approached to the position of the human face in the current image by a fixed step (ie, a preset distance), so that a smooth transition of the displayed image can be realized.

Wherein, the operation of moving the position of the second area toward the position of the first area by a preset distance to obtain the target position can be realized by adjusting the position of the second area.

It is assumed that the position of the first area and the position of the second area are both indicated by the upper left corner point. The coordinates of the upper left corner of the first area are (X ₁ , Y ₁ ), the coordinates of the upper left corner of the second area are (X ₂ , Y ₂ ), the preset distance is v, then the difference between X ₁ _{and X 2} Greater than v, _{the difference between Y 1} and Y ₂ is also greater than v. In this case, the target position includes the size and the coordinates of the upper left corner point. This size is the size of the first area. The upper left corner point coordinates are obtained by adjusting the coordinates of the upper left corner point of the second area, that is, the The coordinates of the upper left corner point are adjusted (X ₂ , Y ₂ ).

If X ₁ －X ₂ _{>v, the abscissa X 2} of the upper left corner point included in the target position is X ₂ +v; if X ₂ －X ₁ ＞v, then the abscissa of the upper left corner point included in the target position X ₂ is X ₂ -v. If Y ₁ －Y ₂ _{>v, the ordinate Y 2} of the upper left corner point included in the target position is Y ₂ +v; if Y ₂ －Y ₁ ＞v, then the ordinate Y 2 of the upper left corner point included in the target position Y ₂ is Y ₂ -v.

For example, as shown in FIG. 4, the coordinates of the upper left corner of the first area are (X ₁ , Y ₁ ), the coordinates of the upper left corner of the second area are (X ₂ , Y ₂ ), and the preset distance is v. In addition, X ₁ -X ₂ >v, and Y ₁ -Y ₂ >v. Then the second area can be moved to the right by v, and the second area can be moved down by v, and the position of the moved second area is the position of the target area.

The second possible way: if there is no face area in the image, then the area in the image with the same size as the size of the display interface and the same center point as the center point of the image is taken as the first area; The target area in the last frame of image collected before the image is taken as the second area; the target area in the image is determined according to the first area and the second area.

It should be noted that when there is no face area in the image, the first area in the image is the central area of the image, and the central point of the central area of the image is the central point of the image, and the central area of the image The size of is the size of the display interface.

In addition, the image is the image currently collected by the camera. The image of the target area in the last frame of the image collected by the camera before the image is collected is the image currently displayed on the display interface. That is, the image of the second area is the image being displayed on the display interface when the camera collects the image.

Furthermore, in the embodiments of the present application, the first area and the second area may be combined, that is, combined with the center area of the current image and the area where the image being displayed on the display interface is located in the previous frame of image, to determine the current image Is used for the area where the image displayed on the display interface is located in the current image. In this way, it helps to achieve a smooth display of the image.

If the distance between the position of the first area and the position of the second area is less than or equal to the preset distance, it means that the position of the first area is relatively close to the position of the second area. At this time, the image display of the second area is switched to The image display of the first area is relatively smooth, so the first area can be directly used as the target area in the image, so that the central area of the current image can be directly displayed subsequently.

If the distance between the position of the first area and the position of the second area is greater than the preset distance, it means that the position of the first area is farther away from the position of the second area. At this time, the image display of the second area is switched to the first area. The image display of the area is likely to show fluctuations in the display screen, so at this time, the first area is not used as the target area in the image, but the position of the second area is moved in the direction of the position of the first area. Distance to get the location of the target area in the image. That is to say, in this case, the position of the image being displayed on the display interface is approached to the center position of the current image by a fixed step (ie, a preset distance), so that a smooth transition of the displayed image can be achieved.

Step 202: Cut out the target area in the image to obtain the target image.

The image located within the boundary of the target area in the image is the target image. Since the size of the target area is the same as the size of the display interface, the resolution of the target image is the same as the resolution of the display interface.

Step 203: Display the target image on the display interface.

Since the resolution of the target image is the same as the resolution of the display interface, the target image can be displayed clearly and completely in the display interface, so that the preview image will not be distorted and the preview effect is better.

In addition, since the camera is usually fixed, the background and position range of the captured image are also fixed. In the embodiment of the present application, the face area can be detected first, and then the new preview area is gradually approached to the detected face area, so as to ensure that the previewed target image can contain the face as much as possible, and it can also generate A preview effect similar to tracking human faces, which can significantly improve the visual effect and user experience.

For ease of understanding, the image display method provided by the embodiment of the present application will be described with reference to FIG. 5 as an example. Referring to Fig. 5, in the image acquisition process, each frame of image captured by the camera is acquired, the image display can be implemented according to the following steps.

Step 501: Detect whether there is a human face in the image. If there is a human face, continue to perform the following steps 502-504; if there is no human face, continue to perform the following steps 505-508.

Step 502: Determine the face area in the image.

Step 503: A region in the image with the same size as the size of the display interface and the same center point as the center point of the face region in the image is taken as the first region.

Step 504: If the distance between the position of the first area and the position of the second area is greater than the preset distance, move the position of the second area to the position of the first area by the preset distance to obtain the target in the image The location of the area.

Wherein, the second area is the target area in the last frame of image collected by the camera before the image is collected.

Step 505: Determine whether the target area in the previous frame of image is its central area; if it is, proceed to step 506; if not, proceed to step 507 to step 508.

Among them, the center point of the center area is the same as the image center point, and the size of the center area is the same as the size of the display interface.

Step 506: Use the central area of the image as the target area in the image.

Step 507: Use the central area of the image as the first area.

Step 508: If the distance between the position of the first area and the position of the second area is greater than the preset distance, move the position of the second area to the position of the first area by the preset distance to obtain the target in the image The location of the area.

After the target area in the image is obtained through step 504, step 506, or step 508, the following steps 509 to 510 can be performed to realize image display.

Step 509: Cut out the target area in the image to obtain the target image.

Step 510: Display the target image on the display interface.

FIG. 6 is a schematic structural diagram of an image display device provided by an embodiment of the present application. Referring to Figure 6, the device includes:

The image acquisition module 601 is used to acquire an image;

The first determining module 602 is configured to determine the face area in the image;

The second determining module 603 is configured to determine a target area in the image according to the face area in the image, and the size of the target area is the same as the size of the display interface;

The cropping module 604 is used to crop out the target area in the image to obtain the target image;

The display module 605 is used to display the target image on the display interface.

Optionally, the first determining module 602 is used to:

Optionally, the second determining module 603 is used to:

Optionally, the device further includes:

The third determining module is configured to, if there is no face area in the image, use an area in the image with the same size as the size of the display interface and the same center point as the center point of the image as the first area;

The fourth determining module is configured to use the target area in the last frame of image acquired before the image is acquired as the second area;

The fifth determining module is used to determine the target area in the image according to the first area and the second area.

In this embodiment of the application, an image is acquired, and the face area in the image is determined. Then, the target area in the image is determined according to the face area in the image, and then the target area in the image is cut out to obtain the target image. Finally, the target image is displayed on the display interface. In this way, as long as the user is within the image acquisition range, the target image displayed on the display interface will contain the user's face as much as possible. Compared with the solution in the related art that requires the user to stand at a fixed position to realize the face display, the embodiment of the present application expands the position range that can realize the face display, improves the flexibility of the face display, and can greatly improve the user. Experience.

FIG. 7 is a schematic structural diagram of an image display device provided by an embodiment of the present application. Referring to Figure 7, the device includes:

The processor 701 is configured to determine the face area in the acquired image; determine the target area in the image according to the face area in the image, and the size of the target area is the same as the size of the display interface; The target area, the target image is obtained;

The display 702 is used to display a target image on the display interface.

Optionally, the processor 701 is configured to:

If the distance between the position of the first area and the position of the second area is greater than the preset distance, the position of the second area is moved to the direction of the position of the first area by the preset distance to obtain the target position; The same area as the target position is taken as the target area in the image.

Optionally, the processor 701 is configured to:

Optionally, the device further includes:

The image acquisition module is used to acquire images.

In the embodiment of the present application, the human face area is determined in the acquired image. Then, the target area in the image is determined according to the face area in the image, and then the target area in the image is cut out to obtain the target image. Finally, the target image is displayed on the display interface. In this way, as long as the user is within the image acquisition range, the target image displayed on the display interface will contain the user's face as much as possible. Compared with the solution in the related art that requires the user to stand at a fixed position to realize the face display, the embodiment of the present application expands the position range that can realize the face display, improves the flexibility of the face display, and can greatly improve the user. Experience.

It should be noted that when the image display device provided in the above embodiment displays images, only the division of the above functional modules is used as an example for illustration. In actual applications, the above functions can be allocated by different functional modules as needed, i.e. The internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the image display device provided in the foregoing embodiment and the image display method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, and will not be repeated here.

FIG. 8 is a schematic structural diagram of a terminal 800 provided by an embodiment of the present application. The terminal 800 can be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, a moving picture expert compresses standard audio layer 3), MP4 (Moving Picture Experts Group Audio Layer IV, a moving picture expert compresses a standard audio layer) 4) Player, laptop or desktop computer. The terminal 800 may also be called user equipment, portable terminal, laptop terminal, desktop terminal and other names.

Generally, the terminal 800 includes a processor 801 and a memory 802.

The processor 801 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 801 may adopt at least one hardware form among DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array, Programmable Logic Array). accomplish. The processor 801 may also include a main processor and a coprocessor. The main processor is a processor used to process data in the wake state, also called a CPU (Central Processing Unit, central processing unit); the coprocessor is A low-power processor used to process data in the standby state. In some embodiments, the processor 801 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used for rendering and drawing content that needs to be displayed on the display screen. In some embodiments, the processor 801 may further include an AI (Artificial Intelligence) processor, and the AI processor is used to process computing operations related to machine learning.

The memory 802 may include one or more computer-readable storage media, which may be non-transitory. The memory 802 may also include high-speed random access memory and non-volatile memory, such as one or more magnetic disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 802 is used to store at least one instruction, and the at least one instruction is used to be executed by the processor 801 to implement the method provided in the embodiment of the present application. The operation performed in the image display method.

In some embodiments, the terminal 800 may optionally further include: a peripheral device interface 803 and at least one peripheral device. The processor 801, the memory 802, and the peripheral device interface 803 may be connected by a bus or a signal line. Each peripheral device can be connected to the peripheral device interface 803 through a bus, a signal line, or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 804, a display screen 805, a camera component 806, an audio circuit 807, a positioning component 808, and a power supply 809.

The peripheral device interface 803 may be used to connect at least one peripheral device related to I/O (Input/Output) to the processor 801 and the memory 802. In some embodiments, the processor 801, the memory 802, and the peripheral device interface 803 are integrated on the same chip or circuit board; in some other embodiments, any one of the processor 801, the memory 802, and the peripheral device interface 803 or The two can be implemented on separate chips or circuit boards, which are not limited in the embodiment of the present application.

The radio frequency circuit 804 is used for receiving and transmitting RF (Radio Frequency, radio frequency) signals, also called electromagnetic signals. The radio frequency circuit 804 communicates with a communication network and other communication devices through electromagnetic signals. The radio frequency circuit 804 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 804 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 804 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: metropolitan area networks, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (Wireless Fidelity, wireless fidelity) networks. In some embodiments, the radio frequency circuit 804 may also include a circuit related to NFC (Near Field Communication), which is not limited in the embodiment of the present application.

The display screen 805 is used to display UI (User Interface). The UI can include graphics, text, icons, videos, and any combination thereof. When the display screen 805 is a touch display screen, the display screen 805 also has the ability to collect touch signals on or above the surface of the display screen 805. The touch signal can be input to the processor 801 as a control signal for processing. At this time, the display screen 805 may also be used to provide virtual buttons and/or virtual keyboards, also called soft buttons and/or soft keyboards. In some embodiments, there may be one display screen 805, which is arranged on the front panel of the terminal 800; in other embodiments, there may be at least two display screens 805, which are respectively arranged on different surfaces of the terminal 800 or in a folded design; In some other embodiments, the display screen 805 may be a flexible display screen, which is disposed on the curved surface or the folding surface of the terminal 800. Furthermore, the display screen 805 can also be set as a non-rectangular irregular pattern, that is, a special-shaped screen. The display screen 805 may be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

The camera assembly 806 is used to capture images or videos. Optionally, the camera assembly 806 includes a front camera and a rear camera. Generally, the front camera is set on the front panel of the terminal, and the rear camera is set on the back of the terminal. In some embodiments, there are at least two rear cameras, each of which is a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth-of-field camera to realize the background blur function, the main camera Integrate with the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, the camera assembly 806 may also include a flash. The flash can be a single-color flash or a dual-color flash. Dual color temperature flash refers to a combination of warm light flash and cold light flash, which can be used for light compensation under different color temperatures.

The audio circuit 807 may include a microphone and a speaker. The microphone is used to collect sound waves of the user and the environment, and convert the sound waves into electrical signals to be input to the processor 801 for processing, or input to the radio frequency circuit 804 to implement voice communication. For the purpose of stereo collection or noise reduction, there may be multiple microphones, which are respectively set in different parts of the terminal 800. The microphone can also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert the electrical signal from the processor 801 or the radio frequency circuit 804 into sound waves. The speaker can be a traditional thin-film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, not only can the electrical signal be converted into human audible sound waves, but also the electrical signal can be converted into human inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 807 may also include a headphone jack.

The positioning component 808 is used to locate the current geographic location of the terminal 800 to implement navigation or LBS (Location Based Service, location-based service). The positioning component 808 may be a positioning component based on the GPS (Global Positioning System, Global Positioning System) of the United States, the Beidou system of China, the Grenas system of Russia, or the Galileo system of the European Union.

The power supply 809 is used to supply power to various components in the terminal 800. The power source 809 may be alternating current, direct current, disposable batteries, or rechargeable batteries. When the power source 809 includes a rechargeable battery, the rechargeable battery may support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

In some embodiments, the terminal 800 further includes one or more sensors 810. The one or more sensors 810 include, but are not limited to: an acceleration sensor 811, a gyroscope sensor 812, a pressure sensor 813, a fingerprint sensor 814, an optical sensor 815, and a proximity sensor 816.

The acceleration sensor 811 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the terminal 800. For example, the acceleration sensor 811 can be used to detect the components of the gravitational acceleration on three coordinate axes. The processor 801 may control the display screen 805 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 811. The acceleration sensor 811 may also be used for the collection of game or user motion data.

The gyroscope sensor 812 can detect the body direction and rotation angle of the terminal 800, and the gyroscope sensor 812 can cooperate with the acceleration sensor 811 to collect the user's 3D actions on the terminal 800. The processor 801 can implement the following functions according to the data collected by the gyroscope sensor 812: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

The pressure sensor 813 may be disposed on the side frame of the terminal 800 and/or the lower layer of the display screen 805. When the pressure sensor 813 is arranged on the side frame of the terminal 800, the user's holding signal of the terminal 800 can be detected, and the processor 801 performs left and right hand recognition or quick operation according to the holding signal collected by the pressure sensor 813. When the pressure sensor 813 is arranged on the lower layer of the display screen 805, the processor 801 controls the operability controls on the UI interface according to the pressure operation of the user on the display screen 805. The operability control includes at least one of a button control, a scroll bar control, an icon control, and a menu control.

The fingerprint sensor 814 is used to collect the user's fingerprint. The processor 801 identifies the user's identity according to the fingerprint collected by the fingerprint sensor 814, or the fingerprint sensor 814 identifies the user's identity according to the collected fingerprint. When it is recognized that the user's identity is a trusted identity, the processor 801 authorizes the user to perform related sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings. The fingerprint sensor 814 may be provided on the front, back, or side of the terminal 800. When a physical button or a manufacturer logo is provided on the terminal 800, the fingerprint sensor 814 may be integrated with the physical button or the manufacturer logo.

The optical sensor 815 is used to collect the ambient light intensity. In an embodiment, the processor 801 may control the display brightness of the display screen 805 according to the ambient light intensity collected by the optical sensor 815. Specifically, when the ambient light intensity is high, the display brightness of the display screen 805 is increased; when the ambient light intensity is low, the display brightness of the display screen 805 is decreased. In another embodiment, the processor 801 may also dynamically adjust the shooting parameters of the camera assembly 806 according to the ambient light intensity collected by the optical sensor 815.

The proximity sensor 816 is also called a distance sensor, and is usually arranged on the front panel of the terminal 800. The proximity sensor 816 is used to collect the distance between the user and the front of the terminal 800. In one embodiment, when the proximity sensor 816 detects that the distance between the user and the front of the terminal 800 gradually decreases, the processor 801 controls the display screen 805 to switch from the on-screen state to the off-screen state; when the proximity sensor 816 detects When the distance between the user and the front of the terminal 800 gradually increases, the processor 801 controls the display screen 805 to switch from the rest screen state to the bright screen state.

Those skilled in the art can understand that the structure shown in FIG. 8 does not constitute a limitation on the terminal 800, and may include more or fewer components than shown in the figure, or combine certain components, or adopt different component arrangements.

FIG. 9 is a schematic structural diagram of a server 900 provided by an embodiment of the present application. The server 900 may be a server in a background server cluster. Specifically:

The server 900 includes a CPU (Central Processing Unit) 901, a system memory 904 including RAM (Random Access Memory) 902 and ROM (Read-Only Memory) 903, and a system memory connected to it 904 and the system bus 905 of the central processing unit 901. The server 900 also includes a basic I/O (Input/Output) system 906 that helps transfer information between various devices in the computer, and a large-capacity storage system 913, application programs 914, and other program modules 915. Storage device 907.

The basic input/output system 906 includes a display 908 for displaying information and an input device 909 such as a mouse and a keyboard for the user to input information. The display 908 and the input device 909 are both connected to the central processing unit 901 through the input/output controller 910 connected to the system bus 905. The basic input/output system 906 may also include an input/output controller 910 for receiving and processing input from multiple other devices such as a keyboard, a mouse, or an electronic stylus. Similarly, the input/output controller 910 also provides output to a display screen, a printer, or other types of output devices.

The mass storage device 907 is connected to the central processing unit 901 through a mass storage controller (not shown) connected to the system bus 905. The mass storage device 907 and its associated computer-readable medium provide non-volatile storage for the server 900. That is, the mass storage device 907 may include a computer-readable medium (not shown) such as a hard disk or a CD-ROM (Compact Disc Read-Only Memory) drive.

Without loss of generality, computer-readable media may include computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented by any method or technology for storing information such as computer readable instructions, data structures, program modules, or other data. Computer storage media include RAM, ROM, EPROM (Electrically Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory or other Solid-state storage technology, and includes CD-ROM, DVD (Digital Versatile Disc, Digital Versatile Disc) or other optical storage, tape cartridges, magnetic tape, magnetic disk storage or other magnetic storage devices. Of course, those skilled in the art may know that the computer storage medium is not limited to the above-mentioned types. The system memory 904 and the mass storage device 907 may be collectively referred to as memory.

According to various embodiments of the present application, the server 900 may also be connected to a remote computer on the network to run through a network such as the Internet. That is, the server 900 can be connected to the network 912 through the network interface unit 911 connected to the system bus 905, or in other words, the network interface unit 911 can also be used to connect to other types of networks or remote computer systems (not shown).

The foregoing memory also includes one or more programs, and one or more programs are stored in the memory and configured to be executed by the CPU. The one or more programs include instructions for performing operations performed in the image display method provided by the method embodiment in the embodiment of the present application.

In some embodiments, a computer-readable storage medium is also provided, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the image display method provided in the embodiment of FIG. 2 are implemented. . For example, the computer-readable storage medium may be ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

It should be noted that the computer-readable storage medium mentioned in the embodiment of the present application may be a non-volatile storage medium, in other words, it may be a non-transitory storage medium.

It should be understood that all or part of the steps for implementing the foregoing embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part. The computer program product includes one or more computer instructions. The computer instructions can be stored in the aforementioned computer-readable storage medium.

In some embodiments, a computer program product containing instructions is also provided, which when running on a computer, causes the computer to execute the steps of the image display method provided in the embodiment of FIG. 2 above.

The above are only optional embodiments of this application and are not intended to limit this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in the protection of this application. Within range.

Claims

An image display method, characterized in that the method includes:

Acquiring an image, and determining a face area in the image;

Determining a target area in the image according to the face area in the image, where the size of the target area is the same as the size of the display interface;

Crop out the target area in the image to obtain the target image;

The target image is displayed on the display interface.
The method of claim 1, wherein the determining the face area in the image comprises:

Determine one or more detection frames in the image, where the detection frames contain a human face;

The area indicated by the largest detection frame in one or more detection frames in the image is taken as the face area in the image.
The method according to claim 1 or 2, wherein the determining the target area in the image according to the face area in the image comprises:

Taking an area in the image with the same size as the size of the display interface and the same center point as the center point of the face area in the image as the first area;

Taking the target area in the last frame of image collected before the image is collected as the second area;

According to the first area and the second area, a target area in the image is determined.
The method of claim 3, wherein the determining the target area in the image according to the first area and the second area comprises:

If the distance between the position of the first area and the position of the second area is less than or equal to a preset distance, using the first area as the target area in the image;

If the distance between the position of the first area and the position of the second area is greater than the preset distance, the position of the second area is moved to the direction of the position of the first area by the preset distance , Obtain the target position; take an area in the image with the same position as the target position as the target area in the image.
The method of claim 1, wherein the method further comprises:

If there is no face area in the image, use an area in the image with the same size as the size of the display interface and the same center point as the center point of the image as the first area;

Taking the target area in the last frame of image collected before the image is collected as the second area;

According to the first area and the second area, a target area in the image is determined.
An image display device, characterized in that the device includes:

The processor is configured to determine the face area in the acquired image; determine the target area in the image according to the face area in the image, and the size of the target area is the same as the size of the display interface; Describe the target area in the image to obtain the target image;

The display is used to display the target image on the display interface.
The device of claim 6, wherein the processor is configured to:

Determine one or more detection frames in the image, where the detection frames contain a human face;

The area indicated by the largest detection frame in one or more detection frames in the image is taken as the face area in the image.
The device according to claim 6 or 7, wherein the processor is configured to:

Taking an area in the image with the same size as the size of the display interface and the same center point as the center point of the face area in the image as the first area;

Taking the target area in the last frame of image collected before the image is collected as the second area;

According to the first area and the second area, a target area in the image is determined.
The device according to claim 8, wherein the processor is configured to:

If the distance between the position of the first area and the position of the second area is less than or equal to a preset distance, using the first area as the target area in the image;

If the distance between the position of the first area and the position of the second area is greater than the preset distance, the position of the second area is moved to the direction of the position of the first area by the preset distance , Obtain the target position; take an area in the image with the same position as the target position as the target area in the image.
The device according to claim 6, wherein the processor is further configured to:

If there is no face area in the image, use an area in the image with the same size as the size of the display interface and the same center point as the center point of the image as the first area;

Taking the target area in the last frame of image collected before the image is collected as the second area;

According to the first area and the second area, a target area in the image is determined.
The device according to claim 6, wherein the device further comprises:

The image acquisition module is used to acquire images.
A computer device, characterized in that the computer device includes a processor and a memory, the memory is used to store a computer program, and the processor is used to execute the program stored in the memory to implement claims 1-5 Steps of any of the described methods.