CN108024065B

CN108024065B - Terminal shooting method, terminal and computer readable storage medium

Info

Publication number: CN108024065B
Application number: CN201711457417.0A
Authority: CN
Inventors: 郭启凡
Original assignee: Zhuhai Dahengqin Technology Development Co Ltd
Current assignee: Zhuhai Dahengqin Technology Development Co Ltd
Priority date: 2017-12-28
Filing date: 2017-12-28
Publication date: 2020-07-10
Anticipated expiration: 2037-12-28
Also published as: CN108024065A

Abstract

The embodiment of the invention discloses a terminal shooting method, a terminal and a computer readable storage medium, wherein the method comprises the following steps: acquiring an initial shooting image of a shooting scene; recognizing a photographic subject in an initial photographic image, and determining position information of the photographic subject in the initial photographic image; adjusting a region of interest ROI in an initial shot image according to the position information of the shot subject; the percentage of the area occupied by the shooting subject in the adjusted ROI is larger than a first threshold; and taking the adjusted ROI as a focusing area to shoot a shooting scene to obtain a final shot image. Therefore, the size of the ROI is adjusted in a self-adaptive mode according to the size of the shooting main body, and the focusing accuracy of the shooting object is improved.

Description

Terminal shooting method, terminal and computer readable storage medium

Technical Field

The present invention relates to image processing technologies, and in particular, to a method for terminal shooting, a terminal, and a computer-readable storage medium.

Background

Regions of Interest (ROI), i.e. the Regions in the image that are most interesting to the user and most representative of the image content, if these Regions can be extracted, the efficiency and accuracy of image processing and analysis will be greatly improved. Nowadays, the ROI extraction technology has been applied in many fields, such as JPEG2000 compression coding, target region positioning and recognition in machine vision, automatic extraction and recognition of subtitles and identifications in video information, automatic extraction and recognition of license plate regions in intelligent transportation systems, medical image analysis, and the like, and has a wide market potential.

At present, when an object is shot, the object is shot through a preset ROI, the size of the ROI is fixed in the shooting process, when the size of a shooting subject (such as an electric wire, hair, tiny animals and plants and the like) is small, the shooting subject occupies less positions in the fixed ROI, so that the shooting subject is easily focused on other objects during shooting, the shooting subject is blurred in an image, and the image quality is reduced.

Disclosure of Invention

In order to solve the above technical problem, embodiments of the present invention provide a method for terminal shooting, a terminal, and a computer-readable storage medium, which can adaptively adjust the size of an ROI according to the size of a shooting subject, and improve the accuracy of focusing of a shooting object.

In order to achieve the above purpose, the technical solution of the embodiment of the present invention is realized as follows: the embodiment of the invention provides a terminal shooting method, which comprises the following steps:

acquiring an initial shooting image of a shooting scene;

recognizing a photographic subject in the initial photographic image, and determining position information of the photographic subject in the initial photographic image;

adjusting the ROI in the initial shot image according to the position information of the shot subject; the percentage of the area occupied by the shooting subject in the adjusted ROI is larger than a first threshold value;

and taking the adjusted ROI as a focusing area to shoot the shooting scene to obtain a final shot image.

In the foregoing solution, the adjusting the ROI in the initial captured image according to the position information of the subject includes: taking a first region as an adjusted ROI, wherein the first region is a minimum region containing the shooting subject; or, a second region is used as the adjusted ROI, and a percentage of an area of the subject in the second region to a total area of the subject is greater than a second threshold.

In the above scheme, the first region is a rectangular region, a circular region, an elliptical region or a region surrounded by the shooting subject boundary; the second area is a rectangular area, a circular area or an elliptical area.

In the foregoing solution, before the acquiring an initial captured image of a captured scene, the method further includes: acquiring an initial ROI of the shooting scene;

the adjusting the ROI in the initial shot image according to the position information of the shot subject includes:

determining the matching degree of the shooting subject and the initial ROI according to the position information, wherein the matching degree is the percentage of the area of the overlapped region of the shooting subject and the initial ROI in the initial shooting image to the total area of the initial ROI;

and when the matching degree meets an adjusting condition, adjusting the ROI in the initial shot image according to the position information of the shot subject.

In the foregoing solution, the adjusting condition includes: the matching degree is smaller than a third threshold value; the third threshold is less than or equal to the first threshold.

In the above aspect, the method for identifying the photographic subject in the initial photographic image includes: and determining the shooting subject according to the central point of the focusing area.

The embodiment of the invention also provides a terminal, which comprises: a processor and a memory; wherein the content of the first and second substances,

the processor is used for executing the terminal shooting program stored in the memory so as to realize the following steps:

acquiring an initial shooting image of a shooting scene;

In the foregoing solution, the processor is specifically configured to execute a terminal shooting program stored in the memory, so as to implement the following steps:

taking a first region as an adjusted ROI, wherein the first region is a minimum region containing the shooting subject;

or, a second region is used as the adjusted ROI, and a percentage of an area of the subject in the second region to a total area of the subject is greater than a second threshold.

In the foregoing solution, before the acquiring the initial captured image of the captured scene, the processor is further configured to execute a terminal capture program stored in a memory to implement the following steps: acquiring an initial ROI of the shooting scene;

Embodiments of the present invention also provide a computer readable storage medium, and the computer program realizes the steps of any one of the above methods when executed by a processor.

The terminal shooting method, the terminal and the computer readable storage medium provided by the embodiment of the invention are used for acquiring an initial shooting image of a shooting scene; recognizing a photographic subject in an initial photographic image, and determining position information of the photographic subject in the initial photographic image; adjusting an ROI in an initial shot image according to the position information of the shot subject; the percentage of the area occupied by the shooting subject in the adjusted ROI is larger than a first threshold; and taking the adjusted ROI as a focusing area to shoot a shooting scene to obtain a final shot image.

By adopting the technical scheme, before shooting a tiny object, the position of the shooting main body is identified by acquiring a frame of initial shooting image, the size of the ROI is adaptively adjusted according to the position of the shooting main body, and the adjusted ROI is taken as a focusing area to finish shooting, so that the problem of inaccurate focusing caused by the fixed ROI during terminal shooting is solved, the focusing accuracy of the tiny-size and tiny-size special objects is improved, and the shooting quality is ensured.

Drawings

Fig. 1 is a schematic diagram of a hardware structure of an alternative mobile terminal for implementing various embodiments of the present invention;

FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;

fig. 3 is a flowchart of a first embodiment of a terminal shooting method in an embodiment of the present invention;

FIG. 4 is a schematic diagram illustrating a first adjustment of a region of interest according to an embodiment of the present invention;

FIG. 5 is a flowchart of a second embodiment of a terminal shooting method in an embodiment of the present invention;

FIG. 6 is a schematic diagram illustrating a second adjustment of a region of interest involved in an embodiment of the present invention;

FIG. 7A is a third schematic diagram of a region of interest adjustment involved in an embodiment of the present invention;

FIG. 7B is a diagram illustrating a fourth adjustment of the region of interest according to an embodiment of the present invention;

fig. 8 is a flowchart of a third embodiment of a terminal photographing method in an embodiment of the present invention;

fig. 9 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.

The terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a wearable device, a smart band, a pedometer, and the like, and a fixed terminal such as a Digital TV, a desktop computer, and the like.

The following description will be given by way of example of a mobile terminal, and it will be understood by those skilled in the art that the construction according to the embodiment of the present invention can be applied to a fixed type terminal, in addition to elements particularly used for mobile purposes.

Referring to fig. 1, which is a schematic diagram of a hardware structure of a mobile terminal for implementing various embodiments of the present invention, the mobile terminal 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, a/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 1 is not intended to be limiting of mobile terminals, which may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The following describes each component of the mobile terminal in detail with reference to fig. 1:

the Radio Frequency unit 101 may be configured to receive and transmit signals during a message transmission or call, specifically, receive downlink information of a base station and then process the received downlink information to the processor 110, and transmit uplink data to the base station, in General, the Radio Frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like, and in addition, the Radio Frequency unit 101 may further communicate with a network and other devices through wireless communication, and the wireless communication may use any communication standard or protocol, including, but not limited to, GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000(Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access ), TD-SCDMA (Synchronous Time Division Multiple Access, Code Division Multiple Access, Time Division Multiple Access, etc., TDD — Time Division Multiple Access, L Time Division Multiple Access, etc.

WiFi belongs to short-distance wireless transmission technology, and the mobile terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 102, and provides wireless broadband internet access for the user. Although fig. 1 shows the WiFi module 102, it is understood that it does not belong to the essential constitution of the mobile terminal, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or a backlight when the mobile terminal 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.

The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a liquid Crystal Display (L acquired Crystal Display, L CD), an Organic light-Emitting Diode (O L ED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.

Further, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although the touch panel 1071 and the display panel 1061 are shown in fig. 1 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the mobile terminal, and is not limited herein.

The interface unit 108 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and external devices.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The mobile terminal 100 may further include a power supply 111 (e.g., a battery) for supplying power to various components, and preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system.

Although not shown in fig. 1, the mobile terminal 100 may further include a bluetooth module or the like, which is not described in detail herein.

In order to facilitate understanding of the embodiments of the present invention, a communication network system on which the mobile terminal of the present invention is based is described below.

Referring to fig. 2, fig. 2 is an architecture diagram of a communication Network system according to an embodiment of the present invention, the communication Network system is L TE system of universal mobile telecommunications technology, and the L TE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and an IP service 204 of an operator, which are in communication connection in sequence.

Specifically, the UE201 may be the terminal 100 described above, and is not described herein again.

The E-UTRAN202 includes eNodeB2021 and other eNodeBs 2022, among others. Among them, the eNodeB2021 may be connected with other eNodeB2022 through backhaul (e.g., X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide the UE201 access to the EPC 203.

The EPC203 may include an MME (Mobility Management Entity) 2031, an HSS (Home Subscriber Server) 2032, other MMEs 2033, an SGW (Serving gateway) 2034, a PGW (PDN gateway) 2035, and a PCRF (Policy and charging functions Entity) 2036, and the like. The MME2031 is a control node that handles signaling between the UE201 and the EPC203, and provides bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location register (not shown) and holds subscriber specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034, PGW2035 may provide IP address assignment for UE201 and other functions, and PCRF2036 is a policy and charging control policy decision point for traffic data flow and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).

The IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem), or other IP services, among others.

Although L TE system is described as an example, it should be understood by those skilled in the art that the present invention is not limited to L TE system, but also applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems.

Based on the above mobile terminal hardware structure and communication network system, the present invention provides various embodiments of the method.

First embodiment

The first embodiment of the invention provides a terminal shooting method, which can be applied to a terminal with a shooting function.

Here, the terminal described above may be a fixed terminal having a display screen, or may be a mobile terminal having a display screen.

The above-mentioned fixed terminal may be a computer, and the above-mentioned mobile terminal includes but is not limited to a mobile phone, a notebook computer, a camera, a PDA, a PAD, a PMP, a navigation device, and the like. The terminal can be connected to the internet, wherein the connection can be made through a mobile internet network provided by an operator, or through accessing a wireless access point.

Here, if the mobile terminal has an operating system, the operating system may be UNIX, L inux, Windows, Android (Android), Windows Phone, or the like.

The type, shape, size, and the like of the display screen on the terminal are not limited, and the display screen on the terminal may be a liquid crystal display screen, for example.

In the first embodiment of the present invention, the display screen described above is used to provide a human-computer interaction interface for a user.

Fig. 3 is a flowchart of a first embodiment of a terminal shooting method in an embodiment of the present invention, and as shown in fig. 3, the method includes:

step 301: an initial captured image of a captured scene is acquired.

In actual implementation, an initial shot image is acquired through a terminal such as a mobile phone, a tablet computer or a camera with a shooting function.

Illustratively, when a current shooting scene is shot by using the mobile terminal 100 shown in fig. 1, a shooting lens of the terminal is aligned with a shooting subject, and the shooting subject is focused by using a currently set ROI of the terminal to obtain an initial shooting image of one frame; and analyzing the initial shot image by adopting the method of the embodiment of the invention, and determining the ROI area suitable for the current shooting scene.

Step 302: a photographic subject in an initial photographic image is identified, and position information of the photographic subject in the initial photographic image is determined.

In practical implementation, the distance between the shooting object and the center point of the focusing area can be used as a main basis for determining the shooting subject, and it can be understood that, generally, when the object is shot, the shooting subject is placed within the frame of the focusing area, and the area surrounded by the focusing frame is the focusing area. And the user is used to place the photographic subject at the center of the focusing frame, i.e. the photographic subject is closer to the center point of the focusing frame than other objects. Therefore, the closer to the focus frame center point, the more likely it is a photographic subject. In addition, other influencing factors can be used as auxiliary bases, such as the distance between the shooting object and the center point of the shooting picture, the integrity of the edge of the shooting object, the type of the shooting object and the like.

For example, the position of the center point of the focusing area is determined as the position of the shooting subject, and after the position of the shooting subject is determined, the object at the position in the initial shooting image is identified by using the existing image identification technology. Specifically, the existing pattern recognition technology includes the following processes: the method comprises the steps of image preprocessing, image segmentation, normalization processing, characteristic value extraction, neural network training and the like, and position information of an object at the central point of a focusing area, namely information such as the shape and the size of a shooting subject is identified.

Step 303: adjusting an ROI in an initial shot image according to the position information of the shot subject; the percentage of the area occupied by the subject in the adjusted ROI is greater than the first threshold.

Here, the ROI is a region to be processed, which is defined by a box, a circle, an ellipse, an irregular polygon, or the like from a processed image in machine vision and image processing, and is referred to as a region of interest. In the field of image processing, an ROI region is an image region selected from an image, which is a focus of interest for image analysis. The ROI is used for delineating the shooting main body, so that the shooting main body can be clearly focused and processed in a key mode, the processing time can be shortened, and the processing efficiency can be improved. In the embodiment of the present invention, the ROI may also be understood as a focusing area, and since the size of the focusing area is fixed in practical applications, when the subject is a special object (e.g., an object with a long and thin size, a small size, etc.), the focusing area includes many background or foreground objects due to the large focusing area, which may cause the terminal to focus on the foreground or the background, thereby causing the real subject to be blurred, and reducing the quality of the shot. Therefore, the embodiment of the present invention provides a method for adaptively changing an ROI (i.e., a focusing area) according to a subject, so as to solve a problem that a specific object cannot be focused accurately.

Exemplarily, after determining the position information of the photographic subject, the first region is taken as the adjusted ROI, and the first region is the minimum region containing the photographic subject; or, the second region is used as the adjusted ROI, and the percentage of the area of the subject in the second region to the total area of the subject is greater than the second threshold. Specifically, the first region may be a rectangular region, a circular region, an elliptical region, or a region surrounded by the shooting subject boundary; the second region is a rectangular region, a circular region, or an elliptical region.

In this step, the percentage of the area occupied by the shooting subject in the adjusted ROI is greater than a first threshold, where the first threshold is a minimum standard for ensuring the shooting subject to be clear, and if the area occupied by the shooting subject in the ROI is smaller than the first threshold, it can be determined that the initial ROI contains more non-shooting subjects, which may affect the accuracy of focusing on the shooting subject. In practical implementation, the first threshold may be equal to or greater than the third threshold.

Step 304: and taking the adjusted ROI as a focusing area to shoot a shooting scene to obtain a final shot image.

In the embodiment of the invention, the size of the adjusted ROI (region of interest) is also the size of the adjusted focusing area, and the adjusted focusing area is adaptive to the size of the shooting main body, so that the problem of focusing on the foreground or the background when an overlarge focusing area is used for focusing is solved, most focusing areas can be positioned on the shooting main body when shooting is carried out by utilizing the adjusted focusing area, and the focusing accuracy of the shooting main body is improved.

Fig. 4 is a schematic diagram illustrating first adjustment of an area of interest according to an embodiment of the present invention, and as shown in fig. 4, when focusing is performed on a plant leaf, a main subject leaf only occupies a part of a position in a focusing area before adjustment (an area surrounded by a left image frame), and other positions of the focusing area further include a background object. By using the ROI adjusting method in the embodiment of the invention, the area surrounded by the boundary of the shooting subject is used as a new focusing area, the adjusted focusing area (the area surrounded by the thick solid line of the left figure) is used as the area surrounded by the leaf boundary, and the boundary outline of the shooting subject is determined by identifying the shooting subject, so that the ROI is adjusted according to the boundary outline to determine the new focusing area.

In order to further embody the object of the present invention, the above-mentioned scheme is further exemplified on the basis of the first embodiment of the present invention.

Second embodiment

Fig. 5 is a flowchart of a second embodiment of a terminal shooting method in the embodiment of the present invention, and as shown in fig. 5, the flowchart includes:

step 501: an initial captured image of a captured scene is acquired.

Illustratively, an initial photographic image of a photographic scene is acquired with a currently set ROI, or an initial photographic image of a photographic scene is acquired without setting the ROI. Here, the currently set ROI may be a default ROI of the terminal or an ROI automatically adjusted at the last photographing, and an image obtained if the ROI is not set may be blurred. It can be understood that, since the subject is a special object, the definition of the subject in the initial captured image obtained by setting the ROI is affected, and the ROI (i.e., the focusing region) adapted to the subject can be determined by using the capturing method provided in the embodiment of the present invention, so as to improve the accuracy of focusing on the special object and the overall quality of the image.

The special object mentioned in the embodiments of the present invention refers to a minute object or a slim object. Such objects occupy a small area in the photographed picture, resulting in a small area occupied in the focusing area, for example, less than 50% in the focusing area. Therefore, when such an object is photographed, since the area occupied in the focusing area is small, the object is likely to be focused on another non-photographic subject, and the photographic subject is blurred in the image, thereby degrading the image quality.

Step 502: position information of an initial ROI of a photographing scene is acquired.

In practical implementations, the size of the initial ROI is fixed, so only the position information of the initial ROI needs to be determined. For example: establishing a rectangular coordinate system with the upper left corner of the image as an origin and the pixels as units, wherein the position information of the initial ROI comprises: ROI abscissa start position ROI _ u, ordinate start position ROI _ v, ROI width ROI _ w, and ROI height ROI _ h.

Step 503: a photographic subject in an initial photographic image is identified, and position information of the photographic subject in the initial photographic image is determined.

Illustratively, the position information includes a coordinate position of the photographic subject in the initial photographic image, and specifically includes: the abscissa start position ROI _ u ', the ordinate start position ROI _ v', the subject width ROI _ w ', and the subject height ROI _ h' of the subject in the initial captured image.

Step 504: and determining the matching degree of the shooting subject and the initial ROI according to the position information.

Specifically, the matching degree is the percentage of the area of the overlapped region of the shooting subject and the initial ROI in the initial shooting image to the total area of the initial ROI.

Fig. 6 is a schematic diagram illustrating second adjustment of a region of interest according to an embodiment of the present invention, and as shown in fig. 6, a rectangular coordinate system in pixels is established with an upper left corner of an initial captured image as an origin, where the initial ROI is located at a center of the initial captured image, and location information of the initial ROI includes: ROI horizontal coordinate starting position ROI _ u, vertical coordinate starting position ROI _ v, ROI width ROI _ w and ROI height ROI _ h; the position information of the photographic subject includes: the abscissa start position ROI _ u ', the ordinate start position ROI _ v', the subject width ROI _ w ', and the subject height ROI _ h' of the subject in the initial captured image.

The area S 'of the overlapping area (shaded portion in fig. 6) of the two is determined according to the position information of the two, and the matching degree R is determined by using the formula R ═ S'/S, and S is the area of the initial ROI. Specifically, the matching degree is determined by calculating the ratio of the number of pixels occupied by the shaded portion in the initial ROI region to the total number of pixels in the ROI region.

Step 505: judging whether the matching degree meets the adjusting condition, if so, executing step 506; if not, step 508 is performed.

The method specifically comprises the following steps: and when the matching degree meets the adjustment condition, adjusting the ROI in the initial shot image according to the position information of the shot subject. Here, the adjustment condition is a condition for determining to change the ROI according to an actual shooting scene, and the current ROI of the camera or the mobile phone is adjusted only when the adjustment condition is satisfied, otherwise, a default ROI or a last determined ROI is used for shooting.

For example, the adjustment condition may be: the degree of matching is less than a third threshold, which is less than or equal to the first threshold, and which may be 20%, 30%, 40%, or 50%. It can be understood that the adjustment condition is a condition for determining to change the ROI according to the actual shooting scene, and when the area percentage of the shooting subject in the initial ROI is smaller than the third threshold, it may be determined that the initial ROI includes more non-shooting subjects, which may affect the accuracy of focusing on the shooting subject, and therefore, the initial ROI size needs to be adjusted to adapt to the current shooting scene size.

Step 506: the minimum region including the subject is set as the adjusted ROI.

In this step, the minimum region including the photographic subject may be a rectangular region, a circular region, an elliptical region, or a region surrounded by the boundaries of the photographic subject. Here, the region surrounded by the boundary of the subject is the ROI that fits the subject most, but when the boundary of the subject is complicated and is not easy to recognize or it is not necessary to recognize, a regular region including the subject, which is a region surrounded by regular patterns such as a rectangle, a circle, and an ellipse, may be used as the adjusted ROI.

Here, the regular region including the photographic subject may be a regular region including the entire photographic subject, or a regular region including most of the contents of the photographic subject.

In the embodiment of the invention, the percentage of the area occupied by the shooting subject in the adjusted ROI is larger than a first threshold, wherein the first threshold is the minimum standard for ensuring the clarity of the shooting subject, and if the area occupied by the shooting subject in the ROI is smaller than the first threshold, the fact that the initial ROI contains more non-shooting subjects can be determined, and the focusing accuracy of the shooting subject can be influenced. In practical implementation, the first threshold may be equal to or greater than the third threshold.

Step 507: and shooting the shooting scene by using the adjusted ROI as a focusing area to obtain a final shooting image.

Step 508: and shooting the shooting scene by using the current focusing area.

In the embodiment of the present invention, a process of adjusting the size of the ROI region of the photographed image according to the position information of the photographic subject is exemplarily given, using the minimum rule region containing the photographic subject as the ROI of the current photographing scene. Fig. 7A is a schematic diagram illustrating third adjustment of a region of interest according to an embodiment of the present invention, as shown in fig. 7A, when an elongated object is photographed by using a conventional focusing method, most of a fixed focusing region (a square region surrounded by four right angles in the drawing) is background content, so that the background is easily focused during photographing, and a photographing subject is blurred.

Therefore, when the position of the shooting subject is not matched with the position of the focusing area, the size of the focusing area is adjusted, fig. 7B is a fourth adjustment schematic diagram of the region of interest according to the embodiment of the present invention, as shown in fig. 7B, the adjusted focusing area is matched with the outer dimension of the shooting subject, and for the slender shooting subject, most of the shooting subject is located in the adjusted focusing area, so that the influence of excessive foreground and background objects in the focusing area on the shooting subject is reduced.

In order to further embody the object of the present invention, further illustration is made on the basis of the first embodiment and the second embodiment of the present invention.

Third embodiment

Fig. 8 is a flowchart of a third embodiment of a terminal shooting method in the embodiment of the present invention, and as shown in fig. 8, the flowchart includes:

step 801: an initial captured image of a captured scene is acquired.

Step 802: a photographic subject in an initial photographic image is identified.

Exemplarily, training different images based on an image recognition technology of deep learning to obtain a recognition model with an image recognition capability; and identifying the object in the initial shot image by using the obtained identification model, and determining different objects in the initial shot image.

Specifically, a plurality of objects contained in the initial shot image are recognized, and further, the shooting subject is automatically recognized by the terminal through a preset recognition strategy.

Here, the preset identification policy may include: acquiring the 1 st parameter to the Nth parameter of each object, wherein N is a positive integer; acquiring weight coefficients preset by the N parameters; performing weight calculation on the 1 st parameter to the Nth parameter of each object to obtain a weight value of each object which may be a shooting subject; and determining the object with the largest weight value as a shooting subject.

In practical implementation, when N is 1, that is, each object only contains one parameter, the photographic subject is determined directly according to the evaluation criteria of the parameter. For example, the parameter is the distance from the object to the center point of the focusing area, or the distance from the object to the center point of the initial shot image; and determining the object with the minimum distance as a shooting subject.

In practical implementation, when N is greater than 1, that is, each object includes at least two parameters, and then the weight operation is performed on the N parameters to obtain a weight value of each object as a shooting subject; the formula for calculating the weight value S is as follows:

P_iis the i parameter, q_iAnd the weight coefficient is corresponding to the ith parameter. For example, the first parameter is a distance from the object to a center point of the focusing area, and the weight coefficient corresponding to the first parameter is 0.8; the second parameter is the integrity of each object, and the weighting factor corresponding to the second parameter is 0.2.

Illustratively, 3 different objects included in an initial captured image are identified, namely a 1 st object, a2 nd object and a 3 rd object, the three objects are subjected to weight operation to obtain a 1 st weight value, a2 nd weight value and a 3 rd weight value respectively, and if the 1 st weight value is the largest, the 1 st object is determined to be a subject of capturing.

Another alternative embodiment is that the initial photographed image is displayed through a display screen of the terminal, and then the user directly designates the photographing subject. For example, the user clicks a touch screen to photograph to determine a photographic subject.

Step 803: position information of a photographic subject and position information of an initial ROI in an initial photographic image are determined.

Step 804: and determining the matching degree of the shooting subject and the initial ROI according to the position information.

In actual implementation, the position information of the photographic subject may be position information for displaying all pixel points of the photographic subject, and the position information of the initial ROI may also be position information for all pixel points included in the initial focusing region. Correspondingly, the matching degree is the percentage of the number of pixels of the shooting subject located in the initial ROI in the total number of pixels of the initial ROI.

Step 805: judging whether the matching degree meets the adjusting condition, if so, executing step 806; if not, step 808 is performed.

Step 806: and taking the second area as the adjusted ROI, wherein the percentage of the area of the shooting subject in the second area to the total area of the shooting subject is larger than a second threshold value.

In practical implementation, the second region is a region surrounded by regular images such as a rectangle, a circle, and an ellipse.

It should be noted that, when the boundary of the subject is not easily recognized or the boundaries are sparsely distributed, the size of the ROI is adjusted according to the position of the main portion of the object, but the percentage of the area of the subject in the adjusted ROI to the total area of the subject needs to be greater than the second threshold. Illustratively, the second threshold is 50%, 60%, 80%, etc. It should be noted that, the threshold value is larger than the second threshold value to ensure that most of the shooting subjects are already located in the focusing area, so as to ensure the sharpness of the overall focusing of the shooting subjects.

Step 807: and shooting the shooting scene by using the adjusted ROI as a focusing area to obtain a final shooting image.

Step 808: and shooting the shooting scene by using the current focusing area.

Fourth embodiment

Based on the same inventive concept, the embodiment of the invention also provides a terminal. Fig. 9 is a schematic diagram of a composition structure of a terminal according to an embodiment of the present invention, and as shown in fig. 9, the terminal 90 includes: a processor 901 and a memory 902, wherein,

the processor 901 is configured to execute the terminal shooting program stored in the memory 902 to implement the following steps:

acquiring an initial shooting image of a shooting scene;

In practical implementation, the processor 901 is specifically configured to execute a terminal shooting program stored in the memory, so as to implement the following steps: taking a first region as an adjusted ROI, wherein the first region is a minimum region containing the shooting subject; or, a second region is used as the adjusted ROI, and a percentage of an area of the subject in the second region to a total area of the subject is greater than a second threshold.

Illustratively, the first region is a rectangular region, a circular region, an elliptical region or a region surrounded by the photographic subject boundary; the second area is a rectangular area, a circular area or an elliptical area.

In practical implementation, before the acquiring the initial captured image of the captured scene, the processor 901 is further configured to execute a terminal capture program stored in a memory to implement the following steps: acquiring an initial ROI of the shooting scene;

For example, the adjustment condition may include: the matching degree is smaller than a third threshold value; the third threshold is less than or equal to the first threshold.

In practical implementation, the processor 901 is specifically configured to implement the following steps: and determining the shooting subject according to the central point of the focusing area.

In practical implementations, the terminal 90 may be the mobile terminal 100 shown in fig. 1, the processor 901 may be the processor 110 in the mobile terminal 100, and the memory 902 may be the memory 109 in the mobile terminal 100.

In practical applications, the processor may be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processing Device (DSPD), a Programmable logic Device (P L D, a Programmable L ic Device), a Field-Programmable Gate Array (FPGA), a controller, a microcontroller, and a microprocessor.

The Memory may be a volatile Memory (volatile Memory), such as a Random-Access Memory (RAM); or a non-volatile Memory (non-volatile Memory), such as a Read-Only Memory (ROM), a flash Memory (flash Memory), a Hard Disk (HDD), or a Solid-State Drive (SSD); or a combination of the above types of memories and provides instructions and data to the processor.

In addition, each functional module in this embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware or a form of a software functional module.

Based on the understanding that the technical solution of the present embodiment essentially or a part contributing to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium, and include several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the method of the present embodiment. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

Fifth embodiment

Based on the same inventive concept, embodiments of the present invention also provide a computer-readable storage medium, such as a memory including a computer program, which is executable by a processor of a terminal to perform the method steps in one or more of the foregoing embodiments.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A method for shooting by a terminal is characterized by comprising the following steps:

acquiring an initial shooting image of a shooting scene;

adjusting a region of interest ROI in the initial shot image according to the position information of the shot subject; the percentage of the area occupied by the shooting subject in the adjusted ROI is larger than a first threshold value;

taking the adjusted ROI as a focusing area to shoot the shooting scene to obtain a final shot image;

wherein the recognizing the photographic subject in the initial photographic image includes:

automatically identifying a plurality of objects in the initial shot image by using a preset identification strategy, and identifying a shot subject in the initial shot image;

the preset identification strategy comprises the following steps:

acquiring the 1 st parameter to the Nth parameter of each object, wherein N is a positive integer; acquiring weight coefficients preset by the N parameters; performing weight operation on the 1 st parameter to the Nth parameter of each object to obtain the weight value of each object; and determining the object with the largest weight value as a shooting subject.

2. The method of claim 1, wherein the adjusting the ROI in the initial captured image according to the position information of the subject comprises: taking a first region as an adjusted ROI, wherein the first region is a minimum region containing the shooting subject;

3. The method according to claim 2, wherein the first region is a rectangular region, a circular region, an elliptical region, or a region surrounded by the photographic subject boundary;

the second area is a rectangular area, a circular area or an elliptical area.

4. The method of claim 1, wherein prior to said acquiring an initial captured image of a captured scene, the method further comprises: acquiring an initial ROI of the shooting scene;

5. The method of claim 4, wherein the adjustment condition comprises: the matching degree is smaller than a third threshold value; the third threshold is less than or equal to the first threshold.

6. The method according to claim 1, wherein the method of identifying the photographic subject in the initial photographic image comprises: and determining the shooting subject according to the central point of the focusing area.

7. A terminal, characterized in that the terminal comprises: a processor and a memory; wherein the content of the first and second substances,

acquiring an initial shooting image of a shooting scene;

the preset identification strategy comprises the following steps:

8. The terminal of claim 7, wherein the processor is specifically configured to execute a terminal capture program stored in the memory to implement the steps of:

9. The terminal of claim 7, wherein prior to said obtaining the initial captured image of the captured scene, the processor is further configured to execute a terminal capture program stored in the memory to perform the steps of: acquiring an initial ROI of the shooting scene;

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 6.