WO2021218416A1 - Readable storage medium, display device and image processing method therefor - Google Patents

Abstract

A readable storage medium, a display device and an image processing method therefor, relating to the technical field of display. The image processing method comprises: obtaining an initial image (S110); obtaining a clipping proportion and a target feature (S120); identifying the target feature in the initial image, and determining a focus area according to the identification result (S130); and clipping the initial image according to the clipping proportion and the focus area to obtain a target image, and displaying the target image on a display device (S140).

Description

Readable storage medium, display device and image processing method thereof

cross reference

This disclosure claims the priority of a Chinese patent application entitled "Readable Storage Medium, Display Device and Image Processing Method" filed on April 29, 2020 with an application number of 202010354667.7. The entire content of the Chinese patent application is fully incorporated by reference. Incorporated into this article.

Technical field

The present disclosure relates to the field of display technology, and in particular, to a readable storage medium, a display device, and an image processing method of the display device.

Background technique

In order to display images stored in terminals such as mobile phones, cameras, and computers, it is often necessary to display the images through display devices such as picture screens and electronic picture frames. However, the ratio of the image obtained from the terminal and the ratio of the display device often do not match, which affects the display effect.

It should be noted that the information disclosed in the above background section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to those of ordinary skill in the art.

Public content

The purpose of the present disclosure is to provide a readable storage medium, a display device, and an image processing method of the display device.

According to an aspect of the present disclosure, there is provided an image processing method of a display device, including:

Get the initial image;

Obtain tailoring ratio and target characteristics;

Identifying target features in the initial image, and determining the focus area according to the recognition result;

The initial image is cropped according to the cropping ratio and the focus area to obtain a target image, which is displayed on the display device.

In an exemplary embodiment of the present disclosure, determining the focus area according to the recognition result includes:

If the target feature does not exist in the initial image, use an area in the initial image whose definition reaches a specified threshold as the focus area;

If the target feature exists in the initial image, the focus area is determined according to the proportion of the target feature in the initial image.

In an exemplary embodiment of the present disclosure, determining the focus area according to the proportion of the target feature in the initial image includes:

Comparing the proportion of the target feature in the initial image with a threshold range;

If the proportion of the target feature in the initial image is greater than the maximum value of the threshold range, the initial image is used as the focus area;

If the proportion of the target feature in the initial image is within the threshold range, the area of the target feature is used as the focus area;

If the proportion of the target feature in the initial image is less than the minimum value of the threshold range, then the area in the initial image whose definition reaches the specified threshold is taken as the focus area.

In an exemplary embodiment of the present disclosure, using an area in the initial image whose sharpness reaches a specified threshold as the focus area includes:

Taking an area in the initial image where the definition has not been acquired as the first starting area, a line scanning action is performed through a scanning window, and the line scanning action includes: starting from the first starting area, aligning in a row direction The initial image is scanned to obtain the definition of a line scanning area and each line acquisition area in the line scanning area; the boundary of the line scanning area in the line direction coincides with the boundary of the initial image in the line direction; The line acquisition area is an area corresponding to the scan window in the line scan area;

Judging whether the sharpness of each of the line acquisition areas in the line scanning area reaches a specified threshold;

If there is a line acquisition area whose definition reaches the specified threshold in the line scanning area, determining the first reference area according to the line acquisition area whose definition reaches the specified threshold;

If the definition of each of the line acquisition areas in the line scanning area does not reach the specified threshold, then reselect the first starting area from the areas where the definition has never been obtained, and perform the line scanning action until it is determined Out of the first reference area; the distance in the column direction between the reselected first starting area and the first starting area before reselecting is an integer multiple of the height of the scan window in the column direction;

Determining a second starting area according to the first reference area, and scanning the initial image in a column direction through the scanning window to obtain a column scanning area and the definition of each column acquisition area in the column scanning area; The boundary of the column scanning area in the column direction coincides with the boundary of the initial image in the column direction; the column acquisition area is an area in the column scanning area corresponding to the scanning window;

Taking a column acquisition area whose definition reaches a specified threshold in the column scanning area as a second reference area;

The focus area is determined according to the first reference area and the second reference area.

In an exemplary embodiment of the present disclosure, if there are multiple first reference regions, the boundary of the focus region in the row direction is the outer boundary of the two outermost first reference regions in the row direction;

If there are multiple second reference areas, the boundary of the focus area in the column direction is the outer boundary of the two outermost second reference areas in the column direction.

In an exemplary embodiment of the present disclosure, if the number of the first reference area is one, the second starting area is the first reference area;

If the number of the first reference regions is multiple, the center of the second starting region coincides with the midpoint of the center lines of the two outermost first reference regions in the row direction.

In an exemplary embodiment of the present disclosure, clipping the initial image according to the clipping ratio and the focus area includes:

Generating a plurality of clipping regions in the initial image according to the clipping ratio, and two opposite edges of each clipping region coincide with the edges of the initial image;

Take the clipping area with the smallest distance from the center of the focus area as the target clipping area;

The initial image is cropped along the edge of the target cropping area.

In an exemplary embodiment of the present disclosure, the image processing method further includes:

Acquiring and displaying the initial image and the target image through a tailoring terminal;

Receiving a trimming area parameter generated by the trimming terminal in response to a user's operation;

The initial image is cropped according to the cropping area parameter.

In an exemplary embodiment of the present disclosure, the target feature includes a human face.

According to an aspect of the present disclosure, there is provided a display device including an image processing device, the image processing device including:

The image acquisition unit is used to acquire the initial image;

The parameter acquisition unit is used to acquire the tailoring ratio and target characteristics;

A recognition unit, configured to recognize the target feature in the initial image, and determine the focus area according to the recognition result;

The processing unit is configured to trim the initial image according to the trimming ratio and the focus area to obtain and display a target image.

In an exemplary embodiment of the present disclosure, the identification unit includes:

An image recognition module for recognizing target features in the initial image;

The analysis module is configured to, when the target feature does not exist in the initial image, use an area in the initial image whose definition reaches a specified threshold as the focus area; and when the target feature exists in the initial image, The focus area is determined according to the proportion of the target feature in the initial image.

In an exemplary embodiment of the present disclosure, the analysis module includes:

A comparison circuit for comparing the proportion of the target feature in the initial image with a threshold range;

The execution circuit is configured to use the initial image as the focus area when the proportion of the target feature in the initial image is greater than the maximum value of the threshold range; when the target feature is in the initial image When the proportion is within the threshold range, the area of the target feature is used as the focus area; and when the proportion of the target feature in the initial image is less than the minimum value of the threshold range, the initial The area in the image whose sharpness reaches the specified threshold is regarded as the focus area.

According to one aspect of the present disclosure, there is provided a readable storage medium on which a computer program is stored, and the computer program implements the image processing method described in any one of the above when the computer program is executed.

It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure.

Description of the drawings

The drawings herein are incorporated into the specification and constitute a part of the specification, show embodiments consistent with the disclosure, and are used together with the specification to explain the principle of the disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

FIG. 1 is a flowchart of an embodiment of the image processing method of the present disclosure.

2 is a schematic diagram of a display device and a photographing terminal in an embodiment of the image processing method of the present disclosure.

FIG. 3 is a flowchart of step S130 in an embodiment of the image processing method of the present disclosure.

FIG. 4 is a flowchart of step S1310 in an embodiment of the image processing method of the present disclosure.

FIG. 5 is a flowchart of step S1320 in an embodiment of the image processing method of the present disclosure.

FIG. 6 is a flowchart of step S140 in an embodiment of the image processing method of the present disclosure.

FIG. 7 is a schematic diagram of the working principle of an embodiment of the image processing method of the present disclosure.

FIG. 8 is a schematic diagram of an embodiment of the display device of the present disclosure.

FIG. 9 is a schematic diagram of an identification unit in an embodiment of the display device of the present disclosure.

FIG. 10 is a schematic diagram of an analysis module in an embodiment of the display device of the present disclosure.

FIG. 11 is a schematic diagram of an embodiment of the display system of the present disclosure.

FIG. 12 is a schematic diagram of an embodiment of a readable storage medium of the present disclosure.

Detailed ways

Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms, and should not be construed as being limited to the embodiments set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be comprehensive and complete, and fully convey the concept of the example embodiments To those skilled in the art. The same reference numerals in the figures indicate the same or similar structures, and thus their detailed descriptions will be omitted. In addition, the drawings are only schematic illustrations of the present disclosure, and are not necessarily drawn to scale.

The terms "a", "a", "the", "said" and "at least one" are used to indicate the presence of one or more elements/components/etc.; the terms "including" and "have" are used to indicate open-ended The inclusive means and means that in addition to the listed elements/components/etc., there may be other elements/components/etc.; the terms "first" and "second" are only used as marks, not to The number of its objects is limited.

The embodiments of the present disclosure provide an image processing method for a display device. The display device may be a screen, a TV, a computer, a mobile phone, etc., as long as the image can be acquired and displayed, and there is no special limitation here.

As shown in FIG. 1, the image processing method of the embodiment of the present disclosure includes step S110-step S140, wherein:

Step S110: Obtain an initial image;

Step S120: Obtain a tailoring ratio and target characteristics;

Step S130: Identify the target feature in the initial image, and determine the focus area according to the recognition result;

Step S140: Clip the initial image according to the clipping ratio and the focus area to obtain a target image, and display it on the display device.

The image processing method of the embodiment of the present disclosure can determine the focus area in the initial image based on the recognition result of the target feature, and then crop the initial image according to the focus area and the cropping ratio, so as to obtain a target image that matches the display device more. Improve the display effect.

The following describes in detail the image processing method of the embodiment of the present disclosure:

As shown in Fig. 1, in step S110, an initial image is acquired.

The initial image can come from a terminal device, which can be a camera terminal or other terminal, and the camera terminal can be a device that can take images such as a camera, a mobile phone, or a tablet computer.

In some embodiments of the present disclosure, the terminal device is a camera terminal, which can communicate with the display device through wireless communication to transmit the image taken by the terminal device to the display device. The wireless communication method can be wifi, Bluetooth, etc. The specific type is not specifically limited here. Of course, the image can also be transmitted through a physical interface with a wired connection.

The initial image is any image taken by the camera terminal, and its specific parameters and size are not specifically limited here. For example, the initial image may be a group photo of a person, a landscape photo, etc. Obtaining the initial image refers to acquiring the image data of the initial image.

As shown in FIG. 2, in some embodiments of the present disclosure, the photographing terminal 121 may be a single-lens reflex camera, which has a wifi transmission module 122. The display device 111 may be a picture screen, and the display device 111 may have a wifi signal processing module 112 and a system-on-a-chip (SOC, System-on-a-Chip) that can match and communicate with the wifi transmission module 122, and may also include an image processing device 114 And display module 115. The display device 111 can package the initial image through the wifi transmission module 122 and load it into a wifi signal of 2.4g, 5g or other frequency bands and send it to the wifi signal processing module 112 of the display device 111. After the wifi signal processing module 112 processes the wifi signal, The image data is transmitted to the system chip 113 so that the system chip 113 generates the image data of the initial image, which is transmitted to the image processing device 114 to execute the image processing method of the present disclosure, perform image processing, and then display the target image through the display module 115.

As shown in Fig. 1, in step S120, the cropping ratio and the target feature are acquired.

Both the tailoring ratio and the target feature can be pre-stored in a remote terminal by the user through an operation on a tailoring terminal, and the remote terminal may be a remote server. The cropping ratio can be a user-defined ratio, or a ratio determined according to the display mode of the display device, and the cropping ratio determined according to the display mode can be used as the default cropping ratio. When the user does not set a custom cropping ratio, directly Use the default crop ratio.

The display mode depends on the type and placement of the display device. For example, the display device is a drawing screen, and its display modes include landscape mode and portrait mode. For landscape mode, the cropping ratio can be 9:16, for portrait mode. Mode, the cropping ratio can be 16:9. The cropping ratio can be used as the cropping area ratio when cropping the initial image.

Regarding the cropping ratio determined according to the display mode, in some embodiments of the present disclosure, the display mode can be preset, and at the same time, the mapping relationship between the display mode and the cropping ratio can be established, so that as long as the display mode is set, the corresponding Cropping ratio. Alternatively, in some other embodiments of the present disclosure, the placement mode of the display device can also be sensed by a device such as a position sensor, and based on a pre-established mapping of placement mode, display mode, and clipping ratio, the clipping can be determined in real time. ratio.

The target feature can be used as a reference standard for determining the focus area of the initial image, so that the target feature can be retained to the greatest extent after cropping. It can be a human face, a specific type of animal, a specific type of plant, a building, etc., which are not specifically limited here. The user can select on the tailoring terminal and store the target feature information in the remote terminal for recall. For example, the user can select the target feature of the face on the tailoring terminal and upload it to the remote terminal.

As shown in FIG. 1, in step S130, the target feature is recognized in the initial image, and the focus area is determined according to the recognition result.

According to the target feature acquired from the remote terminal, the target feature can be identified in the initial image. For example, if the target feature stored by the remote terminal is a human face, after acquiring the target feature, the human face can be identified in the initial image.

In some embodiments of the present disclosure, the human face is not the facial feature of a specific user, but only refers to the recognition mode. Recognizing the facial area of any person belongs to face recognition. The specific process of face recognition is not specifically limited here, as long as it can perform face detection on the initial image.

In other embodiments of the present disclosure, the face may be a facial feature of a specific user, for example, the facial feature of the user "Zhang San". Only when the facial feature of "Zhang San" is recognized in the initial image can it be determined that there is a facial feature in the initial image. Target characteristics. The specific technical details of face recognition for a specific user are not specifically limited here, as long as the function can be realized. The user can set the specific content of the target feature by operating on the tailoring terminal.

The target feature may or may not exist in the initial image. Therefore, the recognition result does not necessarily include the target feature. For the initial image with the target feature, the target feature can be used as the reference standard, while for the initial image without the target feature, the target feature cannot be used as the reference standard, and the area that needs to be retained can be determined by other methods.

It should be noted that determining that the target feature does not exist in the initial image includes: actually there is no image data about the target feature, and there is image data of the target feature, but the amount of data is too small, for example, less than a specified value, so It can be considered that there is no target feature.

As shown in FIG. 3, in some embodiments of the present disclosure, determining the focus area according to the recognition result includes step S1310 and step S1320, where:

Step S1310: If the target feature does not exist in the initial image, use an area in the initial image whose definition reaches a specified threshold as a focus area.

Clarity can be characterized by variance function, gray variance function, gray variance product function, Brenner gradient function or other functions. The specific algorithm is not specifically limited here. The higher the resolution, the clearer the initial image and the lower the resolution. , The more blurry the initial image.

In some embodiments of the present disclosure, a scanning window can be used to scan the initial image from the row direction and the column direction to obtain the definition of the region corresponding to the scanning window, where the region whose definition reaches the specified threshold is determined as a reference Area, the reference area can be regarded as a more important area in the initial image, and should be cropped based on the reference area. For example, you can first determine the area where the sharpness reaches the specified threshold along the row direction, and then determine the area where the sharpness reaches the specified threshold along the column direction based on the area where the sharpness in the row direction reaches the specified threshold; through the row and column directions, the sharpness reaches the specified threshold The threshold area can be used to construct the focus area.

It should be noted that the row direction and the column direction only refer to two different directions that cross each other. Those skilled in the art can know that as the position of the display device changes, the actual orientation of the row direction and the column direction may also change.

Specifically: as shown in Fig. 4, the area in the initial image whose sharpness reaches the specified threshold is taken as the focus area, that is, step S1310, which may include step S13110-step S13170, in which:

Step S13110, taking an area in the initial image where the definition has not been acquired as the first starting area, and performing a line scanning action through a scanning window. The line scanning action includes: starting from the first starting area and moving along Scan the initial image in the row direction to obtain the definition of the row scan area and each row acquisition area in the row scan area; the boundary of the row scan area in the row direction and the boundary of the initial image in the row direction Coincidence; the line acquisition area is an area corresponding to the scan window in the line scan area.

The scan window is used to obtain the definition of its corresponding area, and the shape and size of the first starting area are the same as those of the scan window, depending on the scan window. The first starting area may be located at the middle position of the initial image in the column direction and at the boundary position in the row direction, of course, it may also be other positions.

When performing the row scanning action, the scanning window can be translated along the row direction by a specified length at a time, and the specified length can be equal to the width of the scanning window in the row direction. Of course, the scan window can also move in the row direction in other ways.

After performing a line scan action, the area scanned by the scan window in the line direction is a line scan area. Since the boundary of the line scan area in the line direction coincides with the boundary of the original image in the line direction, it is possible to avoid unscanned areas in the line direction. Since the line scanning area is formed by the movement of the scanning window, the line scanning area has a plurality of line acquisition areas corresponding to the scanning windows at various positions, and each line acquisition area is an area where the definition has been acquired. Each time the scanning window moves along the row direction, the row acquisition area is synchronously increased by one, and the definition of the row acquisition area is obtained.

Step S13120: It is judged whether the definition of each line acquisition area in the line scanning area reaches a specified threshold.

After obtaining the definition of a line collection area, the definition can be compared with a specified threshold to determine whether the definition reaches the specified threshold, that is, whether there is a collection area with a definition not less than the specified threshold.

Step S13130: If there is a line acquisition area whose definition reaches the specified threshold value in the line scanning area, a first reference area is determined according to the line acquisition area whose definition reaches the specified threshold value.

If there is a line acquisition area whose definition reaches the specified threshold in the line scanning area, the position of the corresponding line acquisition area is recorded, so as to determine each line acquisition area in the travel scanning area whose definition reaches the specified threshold. Of course, it is also possible to compare the definition of each line acquisition area with the specified threshold one by one after acquiring the definition, and if there is a line acquisition area whose definition reaches the specified threshold, record the acquisition area.

The line acquisition area whose sharpness reaches the specified threshold can be used as the first reference area to limit the range of the focus area in the line direction.

In some embodiments of the present disclosure, the number of the first reference area is one, and the boundary of the focus area in the row direction is the extension line of the boundary of the first reference area in the row direction along the column direction, that is, the definition reaches the specified threshold. The extension line of the boundary of the row collection area in the row direction.

In other embodiments of the present disclosure, the number of the first reference regions is multiple, and the boundary of the focus region in the row direction is the extension line of the outer boundary of the two outermost first reference regions in the row direction along the column direction. The two outermost first reference regions are the two first reference regions furthest apart in the row direction, and the outer boundaries of the two first reference regions in the row direction are the opposite boundaries in the row direction.

It should be noted that, for a row area where there are multiple first reference areas, the first reference area may be a plurality of continuous acquisition areas, of course, it may also be a plurality of discrete acquisition areas.

Step S13140: If the definition of each of the line acquisition areas of the line scan area does not reach the specified threshold, reselect the first starting area from the areas where the definition has never been obtained, and execute the line scan action , Until the first reference area is determined; the distance in the column direction between the reselected first starting area and the first starting area before reselecting is an integer multiple of the height of the scan window in the column direction.

In some embodiments of the present disclosure, if the definition of each row acquisition area of the row scan area does not reach the specified threshold, the scan window after the last row scan operation can be moved in the column direction For the preset distance, take the area corresponding to the scan window after the preset distance is moved as the new first starting area, and execute the scan action. Accordingly, step S13120 and step S13130 are executed again, until the first reference area is determined, stop scanning. The preset distance may be an integer multiple of the height of the scan window in the column direction, for example, 1 time, 2 times, and so on. At the same time, the area after the scanning window moves along the column direction is an area where the definition has not been obtained, so as to avoid repeatedly obtaining the definition of the same area.

Step S13150: Determine a second starting area according to the first reference area, and scan the initial image in the column direction through the scanning window to obtain the column scanning area and the acquisition area of each column in the column scanning area. Definition; the boundary of the column scanning area in the column direction coincides with the boundary of the initial image in the column direction; the column acquisition area is an area corresponding to the scanning window in the column scanning area.

The shape and size of the second starting area are defined by the scan window, that is, the shape and size of the two are the same. Starting from the second starting area, scan the initial image along the column direction to obtain the definition of the area of the scanning window corresponding to different positions. When scanning along the column direction, the scanning window can move towards the second starting area along the column direction. The two sides of, simultaneously translate a specified length each time, and the specified length can be equal to the height of the scan window in the column direction. Of course, the scan window can also move in the column direction in other ways. The column scanning area includes a plurality of column acquisition areas corresponding to different positions of the scanning window. The specific principles of the formation of the column scanning area and the column acquisition area and the acquisition of definition can refer to the principle of the row scanning action in step S13140, which will not be repeated here. Detailed.

In some embodiments of the present disclosure, a scan window of the same size and shape as in step S13140 may be used in step S13150, but not limited to this. In other embodiments of the present disclosure, when scanning is performed along the column direction, It is also possible to use a scanning window other than scanning in the row direction.

In some embodiments of the present disclosure, the number of the first reference area is one, and the second starting area is the first reference area.

In other embodiments of the present disclosure, the number of the first reference area is multiple, and the second starting area is: the center line of the two outermost first reference areas in the row direction corresponds to the midpoint of the center line of the first reference area. An area with the same size as the scanning window, and the center of the second starting area coincides with the midpoint. The two outermost first reference areas are the two first reference areas furthest apart in the row direction, and the center lines of the outermost two first reference areas are the line connecting the centers of the two first reference areas.

Step S13160: Use a column acquisition area whose definition reaches a specified threshold in the column scanning area as a second reference area.

After obtaining the definition of the collection area, the definition can be compared with the specified threshold to determine whether the definition reaches the specified threshold, that is, whether there is a column collection area with a definition not less than the specified threshold.

The column acquisition area whose sharpness reaches the specified threshold is used as the second reference area and recorded to limit the range of the focus area in the column direction.

In some embodiments of the present disclosure, there are multiple second reference regions, and the boundary of the focus region in the column direction is an extension line of the outer boundaries of the two outermost second reference regions in the row direction. The two outermost second reference areas are the two second reference areas farthest in the column direction, and the outer boundary of the outermost second reference area is the opposite of the two second reference areas in the column direction. boundary.

In some embodiments of the present disclosure, there is one second reference area, and the boundary of the focus area in the column direction is an extension line of the outer boundary of the second reference area in the row direction.

Step S13170: Determine the focus area according to the first reference area and the second reference area.

Based on the above description of step S13140 and step S13160, the boundary of the focus area can be determined through the first reference area and the second reference area.

In some embodiments of the present disclosure, there are multiple first reference areas, and the boundary of the focus area in the row direction is the extension line of the outer boundaries of the two outermost first reference areas along the column direction; the second reference area is multiple One, the boundary of the focus area in the column direction is the outer boundary of the outermost two second reference areas extending in the row direction, and the area enclosed by the two extension lines may be the focus area.

Of course, the focus area can also be determined based on the outer boundaries of the two outermost first reference areas and the outer boundaries of the two outermost second reference areas through a preset algorithm or image processing method.

In other embodiments of the present disclosure, the definition of each column acquisition area in the column scanning area can also be sorted, and one or more column acquisition areas with the highest definition are used as the second reference area. Less than the total number of column collection areas.

Step S1320: If the target feature exists in the initial image, determine the focus area according to the proportion of the target feature in the initial image.

If there is a target feature in the initial image, the focus area needs to be determined based on the size of the area where the target feature is located. For example, if the area occupied by the target feature is larger, the focus area can be determined based on the target feature area. Consider whether the sharpness of the target feature area reaches the specified threshold. If the area occupied by the target feature is too small, it means that it is not the main element of the initial image, so the target feature can be ignored, and the focus area is determined according to the area whose sharpness reaches the specified threshold.

It should be noted that if there are multiple target features, the proportion of the target feature in the initial image is the total proportion of all target features in the initial image, that is, the sum of the proportions of each target feature in the initial image.

As shown in FIG. 5, in some embodiments of the present disclosure, the focus area is determined according to the proportion of the target feature in the initial image, that is, step S1320 includes step S13210-step S13240, wherein:

Step S13210: Compare the proportion of the target feature in the initial image with a threshold range.

The proportion of the target feature in the initial image is the ratio of the size of the area of the target feature to the total size of the initial image. For example, the proportion may be the ratio of the area of the target feature area to the total area of the initial image; or, the proportion may be the ratio of the number of pixels in the area of the target feature to the number of pixels in the initial image.

The specific value of the threshold range is not specifically limited here. For example, the proportion of the target feature in the initial image can be expressed as a percentage. The minimum value of the threshold range can be 5% and the maximum value is 25%, that is, the threshold range is 5%-25%.

Step S13220: If the proportion of the target feature in the initial image is greater than the maximum value of the threshold range, the initial image is used as the focus area.

The proportion of the target feature in the initial image is greater than the maximum value of the threshold range, indicating that the target feature occupies more areas in the initial image. Therefore, the initial image can be directly used as the focus area, regardless of whether the definition reaches the specified threshold. Taking the target feature as a human face and the threshold range is 5%-25% as an example, if the proportion of the human face in the initial image is greater than 25%, it means that the initial image is a close-up image of a human face. In this case, the initial image can be directly used as the focus area .

Step S13230: If the proportion of the target feature in the initial image is within the threshold range, the area of the target feature is used as the focus area.

Taking the target feature as a human face and the threshold range is 5%-25% as an example, if the proportion of the human face in the initial image is not less than 5% and not more than 25%, it means that the initial image is an ordinary person image. Therefore, the area of the target feature can be directly used as the focus area, instead of specifically determining the focus area, the boundary of the focus area is the boundary of the area of the target feature.

Step S13240: If the proportion of the target feature in the initial image is less than the minimum value of the threshold range, use an area in the initial image whose definition reaches a specified threshold as a focus area.

Taking the target feature as a face and the threshold range is 5%-25% as an example, if the proportion of the face in the initial image is less than 5%, it means that the subject of the initial image is not a person, or most of the face data is lost, and it is difficult to base The human face determines the focus area. Therefore, the area whose definition reaches the specified threshold in the initial image can be used as the focus area, and the area whose definition reaches the specified threshold in the initial image is used as the focus area. It is explained in detail in, so I won’t repeat it here.

In step S140, the initial image is cropped according to the cropping ratio and the focus area to obtain a target image, which is displayed on the display device.

In order to preserve as much of the focus area as possible, the focus area can be used to determine the basis of trimming, and the trimming ratio can be used to determine the size of the trimming range, that is, the size of the trimming area.

In some embodiments of the present disclosure, as shown in FIG. 6, the initial image is cropped according to the cropping ratio and the focus area, that is, step S140, which may include step S1410-step S1430, wherein:

Step S1410: Generate a plurality of clipping regions in the initial image according to the clipping ratio, and two opposite edges of each clipping region coincide with the edges of the initial image.

The cropping area can be regarded as a window conforming to the cropping ratio. For example, for a rectangular display device in portrait mode and the cropping ratio is 16:9, the cropping area is a window with an aspect ratio of 16:9. The size of each cropping area is the same. In order to maximize the cropping area, the two opposite edges of the cropping area can be overlapped with the edge of the original image. The edges of the image overlap, as long as the cropping ratio can be satisfied, so that an image that meets the cropping ratio can be cropped on the basis of preserving the overlapped edges, and the maximum cropping can be achieved. For example, the initial image and the cropped area are both rectangular, the two opposite edges of the cropped area may coincide with the two opposite edges in the initial image, and the other edges and the overlapped edges conform to the crop ratio. The overlap in this embodiment only refers to the collinear edges, and is not limited to the same length of the edges.

In step S1420, the cropping area with the smallest distance from the center of the focus area is taken as the target cropping area.

For each clipping area, calculate the center distance between its center and the center of the focus area; at the same time, compare the size of each center distance, determine the clipping area corresponding to the minimum center distance, as the target clipping area, so that under the premise of compound clipping ratio, Keep the focus area to the greatest extent. In particular, the minimum value of the center distance may be zero, that is, the center of the cropping area may coincide with the center of the focus area.

Step S1430, crop the initial image along the edge of the target crop area.

Remove the area outside the target crop area in the initial image, and only keep the image in the target crop area as the target image. When the target image is displayed on the display device, if the crop ratio is the crop ratio determined according to the display mode of the display device , The size of the target image can be matched with the display device; at the same time, because the target image is determined based on the focus area, the target features in the initial image can be retained to the greatest extent, the loss caused by clipping can be reduced, and the display device's performance can be guaranteed. display effect.

In the image processing method of the present disclosure, the initial image can also be tailored through user-defined operations. In some embodiments of the present disclosure, the image processing method further includes step S150-step S170, wherein:

Step S150: Acquire and display the initial image and the target image through a tailoring terminal.

The tailoring terminal can be a mobile phone, a tablet computer or other electronic equipment that can realize human-computer interaction, and it is three independent devices with the camera terminal and the display device. The cutting terminal can communicate with the display device and the camera terminal at the same time, and can acquire and display the initial image, and if there is a target image, it can also acquire and display the target image.

Step S160: Receive the cropping area parameter generated by the cropping terminal in response to the user's operation.

The trimming area parameters include at least the location and trimming ratio of the trimming area, and the trimming ratio is a user-defined trimming ratio, such as 4:3, 16:9, 7:5, etc.

After the trimming terminal receives the initial image, if the user performs a custom trimming operation on the initial image on the trimming terminal, a custom trimming area parameter can be generated and sent to the display device.

Step S170: Cropping the initial image according to the cropping area parameter.

The trimming action can be performed directly according to the trimming area parameter, and the initial image is trimmed according to the location and trimming ratio of the trimming area included in the trimming area parameter to obtain the target image and display it on the display device.

In some embodiments of the present disclosure, after the user sees the initial image on the trimming terminal, the user can directly perform the custom trimming operation, or first confirm the execution of the smart trimming operation, that is, perform step S110-step S140 to obtain the target image, if The target image does not meet the requirements of the user, or the target image cannot be output, and the above-mentioned custom clipping operation is executed through the clipping terminal to regenerate the target image.

As shown in Fig. 7, Fig. 7 shows the working project of an embodiment of the image processing method of the present disclosure, which includes steps S200-S290 and steps S300-step S370, the specific principles of which have been described in detail above.

It should be noted that although the various steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that these steps must be performed in the specific order, or that all the steps shown must be performed. Achieve the desired result. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step for execution, and/or one step may be decomposed into multiple steps for execution, etc.

The embodiments of the present disclosure provide a display device. As shown in FIG. 8, the display device 100 may include an image processing device 101. The image processing device 101 includes an image acquisition unit 1, a parameter acquisition unit 2, an identification unit 3, and a processing unit 4. in:

The image acquisition unit 1 is used to acquire an initial image.

The parameter acquisition unit 2 is used to acquire the tailoring ratio and the target feature.

The recognition unit 3 is used for recognizing the target feature in the initial image, and determining the focus area according to the recognition result.

The processing unit 4 is configured to cut the initial image according to the cut ratio and the focus area to obtain a target image, and display it on the display device.

The display device 100 of the embodiment of the present disclosure can determine the focus area in the initial image based on the recognition result of the target feature, and then crop the initial image according to the focus area and the cropping ratio, so as to obtain a target image that better matches the display device. Improve the display effect.

As shown in FIG. 9, in some embodiments of the present disclosure, the recognition unit 3 includes an image recognition module 31 and an analysis module 32, wherein:

The image recognition module 31 is used to recognize target features in the initial image.

The analysis module 32 is configured to, when the target feature does not exist in the initial image, use an area in the initial image whose definition reaches a specified threshold as the focus area; and when the target feature exists in the initial image, The focus area is determined according to the proportion of the target feature in the initial image.

As shown in FIG. 10, in some embodiments of the present disclosure, the analysis module 32 includes a comparison circuit 321 and an execution circuit 322, wherein:

The comparison circuit 321 is configured to compare the proportion of the target feature in the initial image with a threshold range;

The execution circuit 322 is configured to use the initial image as the focus area when the proportion of the target feature in the initial image is greater than the maximum value of the threshold range; When the proportion is within the threshold range, the target feature is used as the focus area; and when the proportion of the target feature in the initial image is less than the minimum value of the threshold range, the initial image is The area where the sharpness reaches the specified threshold is regarded as the focus area.

The details and beneficial effects of the units, modules, and circuit parts of the display device in the embodiments of the present disclosure have been described in detail in the above embodiment of the image processing method, and will not be described in detail here. The image processing device 101 in the embodiment of the present disclosure may be the image processing device 114 in FIG. 2.

It should be noted that although several modules, units, or circuits of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules, units or circuits described above may be embodied in one module, unit or circuit. Conversely, the features and functions of a module, unit or circuit described above can be further divided into multiple modules, units or circuits to be embodied.

The embodiment of the present disclosure also provides a display system. As shown in FIG. 11, the display system may include a display device 100 and a camera terminal 200, wherein:

The display device 100 includes the image processing device 101 of the image processing method of any of the above embodiments. Therefore, the image processing device 101 may be the image processing device 101 of any of the above embodiments. The specific details of the image processing method and the image processing device 101 are here. No longer.

The camera terminal 200 can be used to take an initial image, and it can be a camera, a mobile phone, a tablet computer, etc., as long as the image can be taken and transmitted. The content and form of the initial image are not specifically limited here.

In addition, in some embodiments of the present disclosure, the display system may further include a tailoring terminal 300 and a remote terminal 400. The functions and specific details of the tailoring terminal 300 and the remote terminal 400 have been described in the above image processing method implementation. It is explained in, so I won’t repeat it here.

It should be noted that, for other structures of the display device 100, reference may be made to the display device 111 in FIG. 2 and will not be described in detail.

The embodiments of the present disclosure also provide a readable storage medium on which a computer program is stored, and when the computer program is executed, the image processing method of any of the foregoing embodiments is implemented. In some embodiments, the various aspects of the present invention can also be implemented in the form of a program product, which includes program code, and when the program product runs on a terminal device, the program code is used to make the terminal device The steps according to various exemplary embodiments of the present invention described in the above-mentioned image processing method of this specification are performed.

As shown in FIG. 12, a program product for implementing the above-mentioned image processing method according to an embodiment of the present invention is described. , Such as running on a personal computer. However, the program product of the present invention is not limited thereto. In this document, the readable storage medium 500 can be any tangible medium that contains or stores a program, and the program can be used by or in combination with an instruction execution system, device, or device.

The program product can use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above. More specific examples (non-exhaustive list) of readable storage media include: electrical connections with one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable Type programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.

The computer-readable signal medium may include a data signal propagated in baseband or as a part of a carrier wave, and readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The readable signal medium may also be any readable medium other than a readable storage medium, and the readable medium may send, propagate, or transmit a program for use by or in combination with the instruction execution system, apparatus, or device.

The program code contained on the readable medium can be transmitted by any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

The program code used to perform the operations of the present invention can be written in any combination of one or more programming languages. The programming languages include object-oriented programming languages—such as Java, C++, etc., as well as conventional procedural styles. Programming language-such as "C" language or similar programming language. The program code can be executed entirely on the user's computing device, partly on the user's device, executed as an independent software package, partly on the user's computing device and partly executed on the remote computing device, or entirely on the remote computing device or server Executed on. In the case of a remote computing device, the remote computing device can be connected to a user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (for example, using Internet service providers). Business to connect via the Internet).

Through the description of the above embodiments, those skilled in the art can easily understand that the example embodiments described here can be implemented by software, or can be implemented by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, U disk, mobile hard disk, etc.) or on the network , Including several instructions to make a computing device (which may be a personal computer, a server, a mobile terminal, or a network device, etc.) execute the method according to the embodiments of the present disclosure.

Those skilled in the art will easily think of other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptive changes of the present disclosure. These variations, uses, or adaptive changes follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field that are not disclosed in the present disclosure. . The description and the embodiments are only regarded as exemplary, and the true scope and spirit of the present disclosure are pointed out by the appended claims.

Claims (13)

1. An image processing method for a display device, which includes:

   Get the initial image;

   Obtain tailoring ratio and target characteristics;

   Identifying target features in the initial image, and determining the focus area according to the recognition result;

   The initial image is cropped according to the cropping ratio and the focus area to obtain a target image, which is displayed on the display device.
2. The image processing method according to claim 1, wherein determining the focus area according to the recognition result comprises:

   If the target feature does not exist in the initial image, use an area in the initial image whose definition reaches a specified threshold as the focus area;

   If the target feature exists in the initial image, the focus area is determined according to the proportion of the target feature in the initial image.
3. The image processing method according to claim 2, wherein determining the focus area according to the proportion of the target feature in the initial image comprises:

   Comparing the proportion of the target feature in the initial image with a threshold range;

   If the proportion of the target feature in the initial image is greater than the maximum value of the threshold range, the initial image is used as the focus area;

   If the proportion of the target feature in the initial image is within the threshold range, the area of the target feature is used as the focus area;

   If the proportion of the target feature in the initial image is less than the minimum value of the threshold range, then the area in the initial image whose definition reaches the specified threshold is taken as the focus area.
4. The image processing method according to claim 2 or 3, wherein the use of an area in the initial image whose sharpness reaches a specified threshold as the focus area includes:

   Taking an area in the initial image where the definition has not been acquired as the first starting area, a line scanning action is performed through a scanning window, and the line scanning action includes: starting from the first starting area, aligning in a row direction The initial image is scanned to obtain the definition of a line scanning area and each line acquisition area in the line scanning area; the boundary of the line scanning area in the line direction coincides with the boundary of the initial image in the line direction; The line acquisition area is an area corresponding to the scan window in the line scan area;

   Judging whether the sharpness of each of the line acquisition areas in the line scanning area reaches a specified threshold;

   If there is a line acquisition area whose definition reaches the specified threshold in the line scanning area, determining the first reference area according to the line acquisition area whose definition reaches the specified threshold;

   If the definition of each of the line acquisition areas in the line scanning area does not reach the specified threshold, then reselect the first starting area from the areas where the definition has never been obtained, and perform the line scanning action until it is determined Out of the first reference area; the distance in the column direction between the reselected first starting area and the first starting area before reselecting is an integer multiple of the height of the scan window in the column direction;

   Determining a second starting area according to the first reference area, and scanning the initial image in a column direction through the scanning window to obtain a column scanning area and the definition of each column acquisition area in the column scanning area; The boundary of the column scanning area in the column direction coincides with the boundary of the initial image in the column direction; the column acquisition area is an area in the column scanning area corresponding to the scanning window;

   Taking a column acquisition area whose definition reaches a specified threshold in the column scanning area as a second reference area;

   The focus area is determined according to the first reference area and the second reference area.
5. The image processing method according to claim 4, wherein if there are multiple first reference regions, the boundary of the focus region in the row direction is the outer boundary of the two outermost first reference regions in the row direction ；

   If there are multiple second reference areas, the boundary of the focus area in the column direction is the outer boundary of the two outermost second reference areas in the column direction.
6. 4. The image processing method according to claim 4, wherein if the number of the first reference area is one, the second starting area is the first reference area;

   If the number of the first reference regions is multiple, the center of the second starting region coincides with the midpoint of the center lines of the two outermost first reference regions in the row direction.
7. 3. The image processing method according to claim 3, wherein the cropping of the initial image according to the cropping ratio and the focus area comprises:

   Generating a plurality of clipping regions in the initial image according to the clipping ratio, and two opposite edges of each clipping region coincide with the edges of the initial image;

   Take the clipping area with the smallest distance from the center of the focus area as the target clipping area;

   The initial image is cropped along the edge of the target cropping area.
8. The image processing method according to claim 1, wherein the image processing method further comprises:

   Acquiring and displaying the initial image and the target image through a tailoring terminal;

   Receiving a trimming area parameter generated by the trimming terminal in response to a user's operation;

   The initial image is cropped according to the cropping area parameter.
9. The image processing method according to claim 1, wherein the target feature includes a human face.
10. A display device, which includes an image processing device, and the image processing device includes:

    The image acquisition unit is used to acquire the initial image;

    The parameter acquisition unit is used to acquire the tailoring ratio and target characteristics;

    A recognition unit, configured to recognize the target feature in the initial image, and determine the focus area according to the recognition result;

    The processing unit is configured to trim the initial image according to the trimming ratio and the focus area to obtain and display a target image.
11. The display device according to claim 10, wherein the identification unit comprises:

    An image recognition module for recognizing target features in the initial image;

    The analysis module is configured to, when the target feature does not exist in the initial image, use an area in the initial image whose definition reaches a specified threshold as the focus area; and when the target feature exists in the initial image, The focus area is determined according to the proportion of the target feature in the initial image.
12. The display device according to claim 11, wherein the analysis module comprises:

    A comparison circuit for comparing the proportion of the target feature in the initial image with a threshold range;

    The execution circuit is configured to use the initial image as the focus area when the proportion of the target feature in the initial image is greater than the maximum value of the threshold range; when the target feature is in the initial image When the proportion is within the threshold range, the area of the target feature is used as the focus area; and when the proportion of the target feature in the initial image is less than the minimum value of the threshold range, the initial The area in the image whose sharpness reaches the specified threshold is regarded as the focus area.
13. A readable storage medium having a computer program stored thereon, wherein the computer program implements the image processing method according to any one of claims 1-9 when the computer program is executed.

Images