CN114567727B - Shooting control system, shooting control method and device, storage medium and electronic equipment - Google Patents

Abstract

The present disclosure provides a shooting control system, a shooting control method, a shooting control device, a computer-readable storage medium and an electronic device, and relates to the field of imaging technology. The shooting control system includes a processing platform and a camera module, and the camera module includes a lens, a driving chip and a motor; the processing platform is used to obtain a first image shot by the camera module, determine the coordinate position of the target object in the first image, and when the camera module shakes, obtain a second image shot by the camera module, determine the coordinate position of the target object in the second image, and calculate the lens offset according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image; the driving chip is used to receive the lens offset sent by the processing platform, and output an electrical signal according to the lens offset; the motor is used to receive the electrical signal output by the driving chip, and control the movement of the lens according to the electrical signal. The present disclosure can improve the shooting effect.

Description

Shooting control system, method and device, storage medium and electronic device

Technical Field

The present disclosure relates to the field of imaging technology, and in particular to a shooting control system, a shooting control method, a shooting control device, a computer-readable storage medium, and an electronic device.

Background technique

With the rapid development of terminal technology, terminal devices such as smart phones and tablet computers have become indispensable tools in people's daily work and life. Among them, the phenomenon of using camera modules equipped with terminal devices to take pictures is becoming more and more common.

However, in the process of shooting using the camera module of the terminal device, there may be a problem of poor quality of the captured image due to the shaking of the camera module.

Summary of the invention

The present disclosure provides a shooting control system, a shooting control method, a shooting control device, a computer-readable storage medium and an electronic device, thereby overcoming the problem of poor shooting effect caused by the shaking of the camera module at least to a certain extent.

According to a first aspect of the present disclosure, a shooting control system is provided, comprising a processing platform and a camera module, the camera module comprising a lens, a driving chip and a motor; the processing platform is used to obtain a first image taken by the camera module, determine the coordinate position of a target object in the first image, and when the camera module shakes, obtain a second image taken by the camera module, determine the coordinate position of the target object in the second image, and calculate a lens offset according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image; the driving chip is used to receive the lens offset sent by the processing platform, and output an electrical signal according to the lens offset; the motor is used to receive the electrical signal output by the driving chip, and control the movement of the lens according to the electrical signal.

According to a second aspect of the present disclosure, a shooting control method is provided, including: acquiring a first image captured by a camera module, and determining the coordinate position of a target object in the first image; when the camera module shakes, acquiring a second image captured by the camera module, and determining the coordinate position of the target object in the second image; calculating a lens offset according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image; sending the lens offset to a driving chip so that the driving chip outputs an electrical signal to a motor according to the lens offset, and the motor controls the movement of the lens according to the electrical signal; wherein the driving chip, the motor and the lens are configured in the camera module.

According to a third aspect of the present disclosure, a shooting control device is provided, comprising: a first position determination module, used to acquire a first image captured by a camera module, and determine the coordinate position of a target object in the first image; a second position determination module, used to acquire a second image captured by the camera module when the camera module shakes, and determine the coordinate position of the target object in the second image; an offset calculation module, used to calculate a lens offset according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image; a lens control module, used to send the lens offset to a driving chip, so that the driving chip outputs an electrical signal to a motor according to the lens offset, and the motor controls the movement of the lens according to the electrical signal; wherein the driving chip, the motor and the lens are configured in the camera module.

According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the above-mentioned shooting control method is implemented.

According to a fifth aspect of the present disclosure, an electronic device is provided, comprising a processor; and a memory for storing one or more programs, wherein when the one or more programs are executed by the processor, the processor implements the above-mentioned shooting control method.

In the technical solutions provided by some embodiments of the present disclosure, the processing platform calculates the lens offset based on the change in the coordinate position of the target object in the image before and after the shaking, and controls the movement of the lens based on the lens offset. On the one hand, the present disclosure performs shooting control by optical image stabilization based on the image content, which can realize image tracking for the target object and control the target object to be as stable as possible in the image, and the optical image stabilization can extend the exposure time of the target object on the photosensitive element, so that the captured target object is clearer, especially for shooting the target object in motion, which can effectively avoid the occurrence of image blur; on the other hand, the process of calculating the lens offset using the position of the target object in the image in the present disclosure is configured to be executed on the processing platform. Compared with some solutions that deploy the algorithm on the driver chip, the present disclosure can reduce the communication interaction between the processing platform and the driver chip, and then reduce the number of transmission lines configured between the two, saving costs. In addition, for the manufacturers of terminal equipment, since the algorithm is mainly deployed on the processing platform rather than the camera module, the purchase price of the camera module can be reduced, further saving costs.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

FIG1 is a schematic diagram showing a system architecture of a shooting control system according to an embodiment of the present disclosure;

FIG2 is a schematic diagram showing a system architecture of a shooting control system according to another embodiment of the present disclosure;

FIG3 is a schematic diagram showing a lens travel according to an embodiment of the present disclosure;

FIG4 schematically shows a flow chart of a shooting control method according to an embodiment of the present disclosure;

FIG5 is a schematic diagram showing a one-shot control process according to an embodiment of the present disclosure;

FIG6 schematically shows a block diagram of a shooting control device according to an embodiment of the present disclosure;

FIG. 7 schematically shows a block diagram of an electronic device according to an exemplary embodiment of the present disclosure.

Detailed ways

Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as being limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be more comprehensive and complete, and the concepts of the example embodiments are fully conveyed to those skilled in the art. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and/or processor devices and/or microcontroller devices.

The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the steps. For example, some steps may be decomposed, while some steps may be combined or partially combined, so the actual execution order may change according to the actual situation. In addition, all the terms "first" and "second" below are only for the purpose of distinction and should not be used as limitations of the present disclosure.

The shooting control system of the embodiment of the present disclosure can be configured in a terminal device, which is any electronic device with a shooting function, including but not limited to smart phones, tablet computers, smart watches, cameras, mobile monitoring devices, etc.

FIG. 1 is a schematic diagram showing a system architecture of a shooting control system according to an embodiment of the present disclosure.

1 , the shooting control system according to the embodiment of the present disclosure may include a processing platform 11 and a camera module 12 .

The processing platform 11 may be a chip platform of the terminal device, and may be a CPU (Central Processing Unit). In addition, the processing platform 11 may also be a SOC (System on Chip), an MCU (Microcontroller Unit), a DSP (Digital Signal Processor), etc. of the terminal device.

The camera module 12 may include at least a driving chip 121, a motor 122 and a lens 123. Although not shown, it is understandable that the camera module may also include other components such as a photosensitive element (sensor).

The driver chip 121 may be a chip for driving loads such as motors. The driver chip 121 may be a single-channel driver chip or a multi-channel driver chip, which is not limited in the present disclosure. A single-channel driver chip refers to a driver chip that has only one electrical signal transmitted to the motor, and a multi-channel driver chip refers to a driver chip that can simultaneously output multiple electrical signals to the motor. It is understandable that a single-channel driver chip is not limited to having only one output terminal, but may also have multiple output terminals, and there may be only one output terminal output to the motor. The electrical signal referred to in the embodiments of the present disclosure may be a current signal, a voltage signal, or other types of electrical signals, which is not limited in the present disclosure.

The motor 122 may be a voice coil motor (VCM), which is a device for converting electrical energy into mechanical energy to drive the lens 123 to move.

The lens 123 may be various types of lenses, such as a fixed focus lens, a zoom lens, a wide angle lens, a telephoto lens, a macro lens, etc.

In the process of implementing the shooting control of the embodiment of the present disclosure, first, the processing platform 11 can obtain the first image taken by the camera module 12 and determine the coordinate position of the target object in the first image; next, when the camera module 12 shakes, the processing platform 11 can obtain the second image taken by the camera module 12 and determine the coordinate position of the target object in the second image; then, the processing platform 11 can calculate the lens offset according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image; then, the processing platform 11 can send the lens offset to the driver chip 121 in the camera module 12. Among them, the processing platform 11 and the driver chip 121 can be connected through IIC (Inter-Integrated Circuit, integrated circuit bus).

After receiving the lens offset sent by the processing platform 11, the driving chip 121 can output an electrical signal to the motor 122 according to the lens offset. The motor 122 can control the movement of the lens 123 according to the electrical signal. The electrical signal can carry a direction identifier and a signal strength. The direction in which the lens 123 is pushed to move can be determined according to the direction identifier, and the distance in which the lens 123 is pushed to move can be determined according to the signal strength.

It can be understood that by controlling the movement direction of the lens 123 to be opposite to the shaking direction of the camera module 12, combined with the lens movement distance corresponding to the shaking distance, the lens offset caused by the shaking can be eliminated.

The disclosed embodiments do not limit the type of the target object, which may be an object selected by the user according to the image content, or a predetermined object, such as a face, a football, a moon, etc. In the following exemplary description, the coordinate position of the center point of the target object may be used as the coordinate position of the target object. However, it is to be understood that in an embodiment where the target object is confined within a rectangular frame, the length and width of the rectangular frame and the coordinates of a predetermined point (such as a vertex, a center point, etc.) on the rectangular frame may also be used to characterize the coordinate position of the target object.

The following is an explanation of the process by which the processing platform 11 determines the coordinate position of the target object in the first image.

According to some embodiments of the present disclosure, when the first image is presented on the touch screen of the terminal device, the processing platform 11 can respond to the object selection operation, determine the target object, and then determine the coordinate position of the target object in the first image.

For example, the user can click on an object on the first image through the touch screen, and the processing platform 11 responds to the user's click operation and determines the target object. For example, if the user clicks on a football in the first image, the football can be determined as the target object. Next, the coordinates of the center of the football can be used as the coordinate position of the target object in the first image mentioned in the present disclosure.

According to other embodiments of the present disclosure, after acquiring the first image, the processing platform 11 may perform image recognition on the first image, and calculate the similarity between the image recognition result and the predefined target object. When the similarity is greater than the similarity threshold, the processing platform 11 may determine the image recognition result as the target object, and further determine the coordinate position of the target object in the first image. The present disclosure does not limit the specific value of the similarity threshold.

Specifically, the processing platform 11 can extract a set of feature points from the first image based on a preconfigured feature extraction algorithm, and compare the feature points in the set with the preconfigured feature points of the target object to determine the similarity between the two, and then use the similarity to determine the target object, and then determine the coordinate position of the target object in the first image.

It can be understood that when the target image is not determined from the image, the shooting control scheme of the embodiment of the present disclosure stops, and the processing platform 11 can continuously execute the target object confirmation process until the target object and the coordinate position of the target object in the image are determined, and then continue to execute the shooting control scheme of the embodiment of the present disclosure.

In addition, the process of the processing platform 11 determining the coordinate position of the target object in the second image is similar to the above content and will not be repeated herein.

The following is an explanation of the process by which the processing platform 11 determines whether the camera module 12 is shaking.

According to some embodiments of the present disclosure, the processing platform 11 may use data sensed by the gyroscope sensor to determine whether the camera module 12 is shaking.

Referring to FIG. 2 , the shooting control system of the disclosed embodiment may further include a gyro sensor 21. The gyro sensor 21 is a device for detecting the angular motion of a high-speed rotating body relative to the inertial space around the axis of rotation orthogonal to the momentum sensitive shell, and may be any one of a piezoelectric gyro sensor, a mechanical gyro sensor, a fiber optic gyro sensor, and a laser gyro sensor. In addition, the gyro sensor 21 and the processing platform 11 may be connected via a SPI (Serial Peripheral Interface).

The gyro sensor 21 can detect the angular velocity of the camera module 12 in one or more directions, so as to determine whether the camera module 12 is shaking according to the detected angular velocity.

Specifically, the processing platform 11 can obtain the angular velocity sensed by the gyroscope sensor 21, and compare the sensed angular velocity with the angular velocity threshold. When the sensed angular velocity is greater than the angular velocity threshold, the processing platform 11 determines that the camera module 12 is shaking. When the sensed angular velocity is less than or equal to the angular velocity threshold, the processing platform 11 determines that the camera module 12 is not shaking. The present disclosure does not limit the specific value of the angular velocity threshold.

According to other embodiments of the present disclosure, with respect to the process in which the processing platform 11 determines whether the camera module 12 is shaking, in a continuous shooting scenario, it can be determined based on the captured images whether the camera module 12 is shaking.

Specifically, the fixed objects in the scene, such as tables, trees, buildings, etc., can be determined through the captured images, and then the positions of the fixed objects in adjacent frames are determined to determine whether the camera module 12 is shaking. For example, if the position change of the fixed objects in adjacent frames is within a predetermined range, it indicates that the camera module 12 is shaking.

The process of calculating the lens offset by the processing platform 11 is described below.

When the camera module 12 shakes, the position of the image of the target object on the photosensitive element in the camera module 12 will change, that is, the coordinate position of the target object in the first image and the second image will change.

First, the processing platform 11 may calculate the pixel offset of the target object according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image.

If the coordinate position of the target object in the first image is recorded as src_local(x,y), the coordinate position of the target object in the second image is recorded as rotate_local(x,y), and the pixel offset is recorded as delta(x,y), then the pixel offset delta(x,y) can be calculated using the following formula:

delta(x,y)＝rotate_local(x,y)-src_local(x,y)

Next, the processing platform 11 may calculate the lens offset using the pixel offset of the target object. It is understandable that the lens offset includes the direction and degree of lens movement compensation.

Specifically, the processing platform 11 may multiply the pixel offset of the target object by the gain threshold to obtain the lens offset.

If the lens offset is recorded as delta_hall(hall_x, hall_y) and the gain threshold is recorded as pixelgain(x, y), the lens offset delta_hall(hall_x, hall_y) can be calculated using the following formula:

delta_hall(hall_x,hall_y)=delta(x,y)*pixelgain(x,y)

By using the above formula, the lens offset in the x direction and the lens offset in the y direction can be calculated respectively.

It should be understood that the unit of the pixel offset is pixel (pixel), and the unit of the lens offset is code.

It should be noted that the motor 122 can control the movement of the lens 123 in the x-direction and the y-direction respectively. In actual scenarios, the travel range of the lens 123 is limited by hardware. FIG3 shows a schematic diagram of the lens travel of an embodiment of the present disclosure. The lens is configured at the center position by default. When the lens is driven to move, the linear travel only accounts for a part of the full travel, and the rest is a nonlinear travel.

The above exemplary shooting control scheme of the present disclosure is described by taking the analysis of the first image and the second image as an example. However, it should be understood that in the scenario of continuously collecting images, the above shooting control process can be continuously performed. The frequency of controlling the movement of the lens 123 is usually high. In the process of continuously performing line-by-line exposure and imaging, the movement of the lens 123 is continuously controlled to improve the shooting effect.

Furthermore, a shooting control method is also provided in the embodiment of the present disclosure. The shooting control method can be implemented by a terminal device, and specifically, each step of the shooting control method can be executed by the above-mentioned processing platform 11. In this case, the following shooting control device can be configured in the processing platform 11.

FIG4 schematically shows a flow chart of a shooting control method according to an exemplary embodiment of the present disclosure. Referring to FIG4 , the shooting control method may include the following steps:

S42. Acquire a first image captured by the camera module, and determine the coordinate position of the target object in the first image.

The disclosed embodiments do not limit the type of the target object, which may be an object selected by the user according to the image content, or a predetermined object, such as a face, a football, a moon, etc. In the following exemplary description, the coordinate position of the center point of the target object may be used as the coordinate position of the target object. However, it is to be understood that in an embodiment where the target object is confined within a rectangular frame, the length and width of the rectangular frame and the coordinates of a predetermined point (such as a vertex, a center point, etc.) on the rectangular frame may also be used to characterize the coordinate position of the target object.

According to some embodiments of the present disclosure, when the first image is presented on the touch screen of the terminal device, the processing platform can respond to the object selection operation, determine the target object, and then determine the coordinate position of the target object in the first image.

For example, a user can click on an object on the first image through the touch screen, and the processing platform responds to the user's click operation to determine the target object. For example, if the user clicks on a football in the first image, the football can be determined as the target object. Next, the coordinates of the center of the football can be used as the coordinate position of the target object in the first image as described in the present disclosure.

According to other embodiments of the present disclosure, after acquiring the first image, the processing platform may perform image recognition on the first image, and calculate the similarity between the image recognition result and the predefined target object. When the similarity is greater than a similarity threshold, the processing platform may determine the image recognition result as the target object, and further determine the coordinate position of the target object in the first image. The present disclosure does not limit the specific value of the similarity threshold.

Specifically, the processing platform can extract a set of feature points from the first image based on a preconfigured feature extraction algorithm, and compare the feature points in the set with the preconfigured feature points of the target object to determine the similarity between the two, and then use the similarity to determine the target object, and then determine the coordinate position of the target object in the first image.

It is understandable that the first image is an image containing the target object. In the case that the captured image does not include the target image, the shooting control scheme of the embodiment of the present disclosure stops, and the processing platform can continuously perform the target object confirmation process for the captured image until the target object and the coordinate position of the target object in the image are determined, and then continue to execute the shooting control scheme of the embodiment of the present disclosure.

S44. When the camera module shakes, obtain a second image captured by the camera module and determine the coordinate position of the target object in the second image.

According to some embodiments of the present disclosure, the processing platform may use data sensed by the gyroscope sensor to determine whether the camera module is shaking.

The gyroscope sensor can detect the angular velocity of the camera module in one or more directions, so that it can be determined whether the camera module is shaking based on the detected angular velocity.

Specifically, the processing platform can obtain the angular velocity sensed by the gyroscope sensor, and compare the sensed angular velocity with the angular velocity threshold. When the sensed angular velocity is greater than the angular velocity threshold, the processing platform determines that the camera module is shaking. When the sensed angular velocity is less than or equal to the angular velocity threshold, the processing platform determines that the camera module is not shaking. The present disclosure does not limit the specific value of the angular velocity threshold.

According to other embodiments of the present disclosure, with respect to the process of the processing platform determining whether the camera module is shaking, in a continuous shooting scenario, it can be determined whether the camera module is shaking based on the captured images.

Specifically, the fixed objects in the scene, such as tables, trees, buildings, etc., can be determined through the captured images, and then the positions of the fixed objects in adjacent frames can be determined to determine whether the camera module is shaking. For example, if the position change of the fixed objects in adjacent frames is within a predetermined range, it indicates that the camera module is shaking.

The process of determining the coordinate position of the target object in the second image is similar to the process of determining the coordinate position of the target object in the first image in step S42, and will not be described in detail.

S46. Calculate the lens offset according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image.

When the camera module shakes, the position of the image of the target object on the photosensitive element in the camera module will change, that is, the coordinate position of the target object in the first image and the second image will change.

First, the processing platform may calculate a pixel offset of the target object according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image.

If the coordinate position of the target object in the first image is recorded as src_local(x,y), the coordinate position of the target object in the second image is recorded as rotate_local(x,y), and the pixel offset is recorded as delta(x,y), then the pixel offset delta(x,y) can be calculated using the following formula:

delta(x,y)＝rotate_local(x,y)-src_local(x,y)

Next, the processing platform can calculate the lens offset using the pixel offset of the target object. It can be understood that the lens offset includes the direction and degree of lens movement compensation.

Specifically, the processing platform may multiply the pixel offset of the target object by the gain threshold to obtain the lens offset.

If the lens offset is recorded as delta_hall(hall_x, hall_y) and the gain threshold is recorded as pixelgain(x, y), the lens offset delta_hall(hall_x, hall_y) can be calculated using the following formula:

delta_hall(hall_x,hall_y)=delta(x,y)*pixelgain(x,y)

By using the above formula, the lens offset in the x direction and the lens offset in the y direction can be calculated respectively.

It should be understood that the unit of the pixel offset is pixel (pixel), and the unit of the lens offset is code.

S48. Send the lens offset to the driving chip so that the driving chip outputs an electrical signal to the motor according to the lens offset, and the motor controls the movement of the lens according to the electrical signal.

In an exemplary embodiment of the present disclosure, a driving chip, a motor, and a lens are configured in a camera module.

The process of controlling the movement of the lens is described below with reference to an embodiment.

The center of the initial position of the lens is taken as the origin, and the plane where the lens is located establishes an xy coordinate system. When the current coordinate position of the lens is (-1, +5), if the x-axis offset of the lens offset calculated by the processing platform is +2 and the y-axis offset is -3, the driver chip outputs an electrical signal according to the lens offset to control the motor to move 2 unit lengths in the positive direction of the x-axis and 3 unit lengths in the negative direction of the y-axis.

In addition, the lens offset may also be expressed in the form of a vector, that is, the lens offset may include the offset direction and offset of the lens, which is not limited in the present disclosure.

FIG. 5 is a schematic diagram showing a one-shot control process according to an embodiment of the present disclosure.

As shown in FIG. 5 , when the camera module is in a stationary state, the target object can be imaged on the photosensitive element to generate a first image.

When the lens and the photosensitive element rotate as a whole, the imaging position of the target object is offset compared to the static state, and at this time, a second image is generated.

After the shooting control scheme based on the embodiment of the present disclosure, the lens offset can be calculated by using the change of the coordinate position of the target object, and then the lens is pushed, so that the image of the target object on the photosensitive element is compensated to the middle position when it is in a static state.

The above describes the exemplary shooting control scheme of the present disclosure using one control process. However, it should be understood that in a scene where images are continuously collected, the above shooting control process can be continuously performed. The frequency of controlling the movement of the lens is usually high. In the process of continuous exposure and imaging line by line, the movement of the lens is continuously controlled to improve the shooting effect.

It should be noted that although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and/or one step may be decomposed into multiple steps, etc.

Furthermore, a shooting control device is also provided in an embodiment of the present disclosure.

6 schematically shows a block diagram of a photographing control device 6 according to an exemplary embodiment of the present disclosure. Referring to FIG6 , the photographing control device 6 according to an exemplary embodiment of the present disclosure may include a first position determination module 61 , a second position determination module 63 , an offset calculation module 65 and a lens control module 67 .

Specifically, the first position determination module 61 can be used to obtain the first image captured by the camera module and determine the coordinate position of the target object in the first image; the second position determination module 63 can be used to obtain the second image captured by the camera module when the camera module shakes and determine the coordinate position of the target object in the second image; the offset calculation module 65 can be used to calculate the lens offset according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image; the lens control module 67 can be used to send the lens offset to the driver chip so that the driver chip outputs an electrical signal to the motor according to the lens offset, and the motor controls the movement of the lens according to the electrical signal. The driver chip, the motor and the lens are configured in the camera module.

Since the functional modules of the shooting control device in the embodiment of the present disclosure are the same as those in the above-mentioned system and method embodiments, they will not be described in detail here.

FIG7 shows a schematic diagram of an electronic device suitable for implementing an exemplary embodiment of the present disclosure. The terminal device of the exemplary embodiment of the present disclosure may be configured as shown in FIG7. It should be noted that the electronic device shown in FIG7 is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

The electronic device of the present disclosure includes at least a processor and a memory, and the memory is used to store one or more programs. When the one or more programs are executed by the processor, the processor can implement the shooting control method of the exemplary embodiment of the present disclosure.

Specifically, as shown in FIG7 , the electronic device 70 may include: a processor 710, an internal memory 721, an external memory interface 722, a Universal Serial Bus (USB) interface 730, a charging management module 740, a power management module 741, a battery 742, an antenna 1, an antenna 2, a mobile communication module 750, a wireless communication module 760, an audio module 770, a sensor module 780, a display screen 790, a camera module 791, an indicator 792, a motor 793, a button 794, and a Subscriber Identification Module (SIM) card interface 795, etc. The sensor module 780 may include a depth sensor, a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, and a bone conduction sensor, etc.

It is to be understood that the structure illustrated in the embodiment of the present disclosure does not constitute a specific limitation on the electronic device 70. In other embodiments of the present disclosure, the electronic device 70 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

The processor 710 may include one or more processing units, for example, the processor 710 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor and/or a neural network processor (NPU). Different processing units may be independent devices or integrated into one or more processors. In addition, a memory may be provided in the processor 710 for storing instructions and data.

The electronic device 70 can realize the shooting function through the ISP, the camera module 791, the video codec, the GPU, the display screen 790 and the application processor. In some embodiments, the electronic device 70 may include 1 or N camera modules 791, where N is a positive integer greater than 1. If the electronic device 70 includes N cameras, one of the N cameras is a main camera.

The internal memory 721 can be used to store computer executable program codes, which include instructions. The internal memory 721 can include a program storage area and a data storage area. The external memory interface 722 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 70.

The present disclosure also provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiments; or may exist independently without being assembled into the electronic device.

Computer-readable storage media may be, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or components, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination thereof. In the present disclosure, computer-readable storage media may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, device, or device.

Computer-readable storage media can send, propagate or transmit programs for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable storage medium can be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

The computer-readable storage medium carries one or more programs. When the one or more programs are executed by an electronic device, the electronic device implements the method described in the embodiments of the present disclosure.

The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, and the units described may also be arranged in a processor. The names of these units do not constitute limitations on the units themselves in some cases.

Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present disclosure, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing what is disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and embodiments are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (7)

1. The shooting control system is characterized by comprising a processing platform and a camera module, wherein the camera module comprises a driving chip, a motor and a lens;

the processing platform is used for acquiring a first image shot by the camera module, determining the coordinate position of a target object in the first image, acquiring a second image shot by the camera module when the camera module shakes, determining the coordinate position of the target object in the second image, and calculating the lens offset according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image; in a scene of continuous shooting, if the position change of a fixed object in adjacent frames is within a preset range, the camera module shakes;

The driving chip is used for receiving the lens offset sent by the processing platform and outputting an electric signal according to the lens offset;

The motor is used for receiving the electric signal output by the driving chip and controlling the lens to move according to the electric signal;

Wherein the process of the processing platform determining the coordinate position of the target object in the first image is configured to:

Under the condition that the first image is displayed on the touch screen, responding to an object selection operation, determining a target object, and determining the coordinate position of the target object in the first image; or alternatively

And carrying out image recognition on the first image, calculating the similarity between the image recognition result and a target object, determining the image recognition result as the target object under the condition that the similarity is larger than a similarity threshold value, and determining the coordinate position of the target object in the first image.

2. The photographing control system of claim 1, wherein the process of the processing platform calculating the lens offset from the coordinate position of the target object in the first image and the coordinate position of the target object in the second image is configured to: and calculating the pixel offset of the target object according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image, and calculating the lens offset by using the pixel offset of the target object.

3. The photographing control system of claim 2, wherein the process of the processing platform calculating the lens offset using the pixel offset of the target object is configured to: and multiplying the pixel offset of the target object by a gain threshold to obtain the lens offset.

4. A photographing control method, characterized by comprising:

acquiring a first image shot by a camera module, and determining the coordinate position of a target object in the first image;

when the camera module shakes, acquiring a second image shot by the camera module, and determining the coordinate position of the target object in the second image; in a scene of continuous shooting, if the position change of a fixed object in adjacent frames is within a preset range, the camera module shakes;

calculating a lens offset according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image;

The lens offset is sent to a driving chip, so that the driving chip outputs an electric signal to a motor according to the lens offset, the motor controls the lens to move according to the electric signal, and the driving chip, the motor and the lens are configured in the camera module;

wherein the process of determining the coordinate position of the target object in the first image is configured to:

Under the condition that the first image is displayed on the touch screen, responding to an object selection operation, determining a target object, and determining the coordinate position of the target object in the first image; or alternatively

And carrying out image recognition on the first image, calculating the similarity between the image recognition result and a target object, determining the image recognition result as the target object under the condition that the similarity is larger than a similarity threshold value, and determining the coordinate position of the target object in the first image.

5. A photographing control apparatus, comprising:

the first position determining module is used for acquiring a first image shot by the camera module and determining the coordinate position of a target object in the first image;

The second position determining module is used for acquiring a second image shot by the camera module when the camera module shakes, and determining the coordinate position of the target object in the second image; in a scene of continuous shooting, if the position change of a fixed object in adjacent frames is within a preset range, the camera module shakes;

The offset calculation module is used for calculating the lens offset according to the coordinate position of the target object in the first image and the coordinate position of the target object in the second image;

The lens control module is used for sending the lens offset to the driving chip so that the driving chip outputs an electric signal to the motor according to the lens offset, the motor controls the lens to move according to the electric signal, and the driving chip, the motor and the lens are configured in the camera module;

wherein the process of the first position determination module determining the coordinate position of the target object in the first image is configured to:

Under the condition that the first image is displayed on the touch screen, responding to an object selection operation, determining a target object, and determining the coordinate position of the target object in the first image; or alternatively

And carrying out image recognition on the first image, calculating the similarity between the image recognition result and a target object, determining the image recognition result as the target object under the condition that the similarity is larger than a similarity threshold value, and determining the coordinate position of the target object in the first image.

6. A computer-readable storage medium having stored thereon a computer program, wherein the program when executed by a processor implements the photographing control method according to claim 4.

7. An electronic device, comprising:

A processor;

A memory for storing one or more programs that, when executed by the processor, cause the processor to implement the photographing control method of claim 4.