CN113950821A - Camera device and shooting method suitable for shooting limit scene - Google Patents
Camera device and shooting method suitable for shooting limit scene Download PDFInfo
- Publication number
- CN113950821A CN113950821A CN202080031233.1A CN202080031233A CN113950821A CN 113950821 A CN113950821 A CN 113950821A CN 202080031233 A CN202080031233 A CN 202080031233A CN 113950821 A CN113950821 A CN 113950821A
- Authority
- CN
- China
- Prior art keywords
- scene
- speed
- camera
- image pickup
- motion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 230000008859 change Effects 0.000 claims abstract description 80
- 238000012545 processing Methods 0.000 claims abstract description 15
- 239000003570 air Substances 0.000 claims description 21
- 238000005259 measurement Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 6
- 239000012080 ambient air Substances 0.000 claims description 3
- 238000003384 imaging method Methods 0.000 claims description 3
- 238000009530 blood pressure measurement Methods 0.000 claims 1
- 230000009189 diving Effects 0.000 description 5
- 230000007704 transition Effects 0.000 description 5
- 230000001133 acceleration Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000035945 sensitivity Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 241000700159 Rattus Species 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
Abstract
The invention discloses a camera device and a shooting method suitable for shooting a limit scene, wherein the camera device comprises: the first sensing unit, the second sensing unit and the third sensing unit are respectively used for acquiring the motion state, the position change and the scene information of the environment where the camera device is located; a processing unit for receiving the motion state, the position change and/or the scene information and selecting one convergence coefficient from at least two preset convergence coefficients as a target convergence coefficient for the automatic exposure unit based thereon; and the automatic exposure unit is used for automatically adjusting the exposure parameters based on the target convergence coefficient so as to carry out exposure. The camera device and the shooting method adopt the convergence schemes with different convergence rates to automatically expose the common scene and the extreme motion scene, so that the convergence rate is accelerated in the extreme scene, the picture of the picture is not overexposed or excessively dark, the brightness of the video picture can be quickly adjusted to a proper value, and the picture color is vivid.
Description
The present invention generally relates to the field of communications, and in particular, to an image capturing apparatus and an image capturing method suitable for capturing a limit scene.
The common camera performs poorly in sports scenes (such as diving, skiing, etc.), so that an anti-shake, lightweight and portable sports camera is produced. In the field of motion cameras, covering as much of the motion scene as possible is one of the goals pursued.
At present, in extreme scenes such as crossing machines, parachuting, flying rats, surfing and the like, which are more and more popular, rapid changes of light and scenes place higher and higher requirements on convergence speed of automatic exposure. The existing motion camera has a good automatic exposure performance in a common motion scene, but the convergence speed of automatic exposure is slow when the brightness changes rapidly in an extreme motion scene, which causes many problems, for example, when the speed is high, a picture is easy to overexpose or too dark, or the brightness of a video picture cannot be adjusted to a proper value all the time, thereby causing picture color distortion, and seriously affecting the shooting effect and the video quality.
In order to solve this problem, an image capturing apparatus and an image capturing method suitable for capturing a limited scene are required to solve the problem of a low convergence rate of automatic exposure.
Disclosure of Invention
In this summary, concepts in a simplified form are introduced that are further described in the detailed description. This summary of the invention is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
In view of the above technical problems, it is necessary to provide an image capturing apparatus, an image capturing method and a computer readable medium suitable for capturing extreme scenes to solve the problem of slow convergence rate of the existing motion cameras in extreme motion scenes.
According to an aspect of the embodiments of the present invention, there is provided an image pickup apparatus adapted to photograph a limit scene, the image pickup apparatus including: the first sensing unit is used for acquiring the motion state of the camera device; a second sensing unit for acquiring a position change of the image pickup device; the third sensing unit is used for acquiring scene information of an environment where the camera device is located; a processing unit for receiving the motion state, the position change and/or the scene information, and selecting one convergence coefficient from at least two preset convergence coefficients as a target convergence coefficient for the automatic exposure unit based on the motion state, the position change and/or the scene information; and the automatic exposure unit is used for automatically adjusting the exposure parameters based on the target convergence coefficient so as to carry out exposure.
According to another aspect of the embodiments of the present invention, there is provided a method for an image capturing apparatus to capture a limit scene, the method including: acquiring the motion state and position change of a camera device and/or scene information of the environment in which the camera device is positioned; selecting one convergence coefficient from at least two preset convergence coefficients as a target convergence coefficient for an automatic exposure unit of the image pickup apparatus based on the motion state, the position change, and/or the scene information; and automatically adjusting the exposure parameters of the automatic exposure unit based on the target convergence coefficient to perform exposure.
According to a further aspect of embodiments of the present invention, a computer-readable medium is provided, on which a computer program is stored, which, when running, executes the method as described above for an image capture device to capture extreme scenes.
The camera shooting device, the camera shooting method and the computer readable medium suitable for shooting the extreme scenes of the embodiment of the invention adopt the convergence schemes with different convergence rates to automatically expose the ordinary scenes and the extreme motion scenes, so that the convergence rate is accelerated in the extreme scenes, the picture of the picture is not overexposed or excessively dark, the brightness of the video picture can be quickly adjusted to a proper value, the color of the picture is vivid, and the picture quality is obviously improved.
The following drawings of the invention are included to provide a further understanding of the invention. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
In the drawings:
fig. 1 shows a schematic block diagram of an image pickup apparatus adapted to shoot extreme scenes according to an embodiment of the present invention;
fig. 2 shows a flowchart of the steps of a method for a camera to capture extreme scenes, according to an embodiment of the invention.
In order to make the objects, technical solutions and advantages of the present invention more apparent, exemplary embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. It is to be understood that the described embodiments are merely a subset of embodiments of the invention and not all embodiments of the invention, with the understanding that the invention is not limited to the example embodiments described herein. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the invention described herein without inventive step, shall fall within the scope of protection of the invention.
In order to solve the above-described technical problem, the present invention provides an image pickup apparatus suitable for photographing a limit scene, the image pickup apparatus including: the first sensing unit is used for acquiring the motion state of the camera device; a second sensing unit for acquiring a position change of the image pickup device; the third sensing unit is used for acquiring scene information of an environment where the camera device is located; a processing unit for receiving the motion state, the position change and/or the scene information, and selecting one convergence coefficient from at least two preset convergence coefficients as a target convergence coefficient for the automatic exposure unit based on the motion state, the position change and/or the scene information; and the automatic exposure unit is used for automatically adjusting the exposure parameters based on the target convergence coefficient so as to carry out exposure.
The camera shooting device suitable for shooting the extreme scenes adopts the convergence schemes with different convergence rates to automatically expose the ordinary scenes and the extreme motion scenes, so that the convergence rate is accelerated in the extreme scenes, the picture of the picture is not overexposed or excessively dark, the brightness of the video picture can be quickly adjusted to a proper value, the color of the picture is vivid, and the picture quality is obviously improved.
An image pickup apparatus, a photographing method, and a computer readable medium suitable for photographing a limit scene according to embodiments of the present invention are described in detail below with reference to specific embodiments.
Example one
The present embodiment provides an image pickup apparatus suitable for shooting a limit scene.
Referring to fig. 1, fig. 1 shows a schematic block diagram of an image pickup apparatus 100 suitable for shooting extreme scenes according to an embodiment of the present invention. In one embodiment, the image capturing device 100 may be any type of image capturing device known in the art, such as a CCD camera, a CMOS camera, and the like, but the invention is not limited thereto.
As shown in fig. 1, the image pickup apparatus 100 may include a first sensing unit 110, a second sensing unit 120, a third sensing unit 130, an auto exposure unit 140, and a processing unit 150. It should be understood that the camera device 100 may also comprise any other units known in the art for carrying out the respective functions, which are not shown in the present invention, in order to avoid unnecessarily obscuring the present invention.
The first sensing unit 110 is used for acquiring the motion state of the image capturing apparatus 100 to determine that the image capturing apparatus 100 is in a violent motion state according to the rapid change of the motion state.
In one embodiment, the first sensing unit 110 may include an Inertial Measurement Unit (IMU) sensor, such as a micro-electro-mechanical system (MEMS) IMU, for measuring a motion parameter of the image capture device 100. In one embodiment, the motion parameters may include a motion speed (i.e., linear velocity), a velocity direction, an angular velocity, an acceleration, and the like of the image capture device 100.
In one embodiment, the first sensing unit 110 may further include an attitude sensor for measuring an attitude angle of the image pickup apparatus 100, including a pitch angle, a yaw angle, and a roll angle. It should be understood that the first sensing unit 110 may also include other sensors, and the present invention is not limited thereto.
The second sensing unit 120 is used for acquiring a real-time position of the image capturing apparatus 100 to acquire a position change of the image capturing apparatus 100 according to the real-time position.
In one embodiment, the second sensing unit 120 may include a GPS device for measuring a position parameter of the image pickup device 100 and acquiring a change in position of the image pickup device 100 based on the position parameter, thereby acquiring whether the height/horizontal distance, etc. of the image pickup device 100 changes sharply. In one embodiment, the location parameters may include longitude, latitude, altitude, and the like of the camera device 100. For example, the GPS device may be any suitable type of GPS device known in the art as desired and not intended to be limiting.
In one embodiment, the second sensing unit 120 may further include an air pressure measuring device for measuring an air pressure parameter of an environment in which the image capturing device 100 is located, and further acquiring a position change of the image capturing device 100 based on the air pressure parameter. For example, the air pressure measuring device may be any suitable type of air pressure measuring device known in the art, such as an air pressure gauge, as desired, but the invention is not limited thereto.
In one embodiment, the second sensing unit 120 may further include an airspeed measuring device for measuring a moving speed of the image pickup device 100 relative to the ambient air, and further acquiring a position change of the image pickup device 100 based on the moving speed. Illustratively, the airspeed measurement device may employ any suitable type of airspeed measurement device known in the art, such as an airspeed meter, as desired, and the invention is not limited in this regard.
It should be understood that the second sensing unit 120 may include only a GPS device, and may further include an air pressure measuring device and/or an airspeed measuring device in addition to the GPS device to assist the GPS device to more accurately determine the position change of the camera device 100, which is not limited by the invention.
The third sensing unit 130 is configured to acquire scene information of an environment in which the image capturing apparatus 100 is located, so as to determine whether a scene in which the image capturing apparatus 100 is located changes. In one embodiment, the scenes may include a still scene, a normal motion scene, and an extreme motion scene, wherein the extreme motion scene may include types of skiing, diving, parachuting, wing-mounted flight (volleyball), surfing, racing, cross-car, and the like, without limitation thereto. In these extreme motion scenarios, the motion speed of the camera is usually fast, and therefore the brightness of the environment changes rapidly.
In one embodiment, the third sensing unit 130 may include a computational photography unit for photographing a video of an environment in which the image pickup apparatus 100 is located and acquiring scene information of the environment in which the image pickup apparatus 100 is located by frame extraction based on the video. In particular, the decimation may be performed in any suitable decimation manner, such as decimation of video scene transition frames, decimation by time uniformity, and the like. For example, when frames are decimated uniformly in time, the decimation rate of the decimated frames may be selected as needed, for example, 10 frames per second, etc., which is not limited by the present invention.
The automatic exposure unit 140 is configured to automatically adjust the exposure parameters based on the convergence coefficient to perform automatic exposure. At least two convergence coefficients (e.g., 2, 3, 4, 5, 6, etc.) may be preset, and different convergence coefficients correspond to different convergence rates of the exposure parameters, so that the automatic exposure unit can automatically adjust the exposure parameters (e.g., exposure time, aperture size, sensitivity (iso), etc.) according to a selected one of the convergence coefficients (referred to herein as a target convergence coefficient) to perform automatic exposure. In one embodiment, two convergence coefficients may be preset, one of which is suitable for the image capturing apparatus 100 to capture a still scene and a normal moving scene, and the other of which is suitable for the image capturing apparatus 100 to capture an extreme moving scene. In another embodiment, a plurality of convergence coefficients (e.g., 3, 4, 5, 6, etc.) may be preset, wherein one of the convergence coefficients is suitable for the image capturing apparatus 100 to capture a still scene and a normal motion scene, and the other convergence coefficients are respectively suitable for the image capturing apparatus 100 to capture different types of extreme motion scenes.
The processing unit 150 is configured to receive the motion state acquired by the first sensing unit 110, the position change acquired by the second sensing unit 120, and/or the scene information acquired by the third sensing unit 130, and select one convergence coefficient from at least two preset convergence coefficients as a target convergence coefficient for the automatic exposure unit 140 based on the motion state, the position change, and/or the scene information. Specifically, two convergence coefficients are preset as an example for explanation: when the motion state indicates that the image capturing apparatus 100 is in a severe motion state (e.g., a large velocity, a large acceleration, etc.), and the position change indicates that the height and/or horizontal distance of the image capturing apparatus 100 is rapidly changing, and/or the scene information indicates that the scene is changing, it may be determined that the image capturing apparatus 100 is in a limit motion scene, the processing unit 150 may select the larger of the two convergence coefficients as the target convergence coefficient for the automatic exposure unit 140, and otherwise select the smaller convergence coefficient as the target convergence coefficient.
In one embodiment, the motion state, the position change and/or the scene information may be preset with respective weights, and after receiving the motion state, the position change and/or the scene information of the image capturing apparatus, the processing unit 150 may respectively obtain the preset respective weights of the motion state, the position change and/or the scene information, and calculate and select the target convergence coefficient for the automatic exposure unit 140 based on the respective weights. For example, weights of 70%, 20%, 10% may be preset for the motion state, the position change, and the scene information, respectively. For example, different weights may be preset for the motion state, the position change, and/or the scene information according to the scene used by the image capturing apparatus 100.
In one embodiment, the scene information may include a scene type and/or a picture brightness change speed, and the like. In one embodiment, the scene types may include types of skiing, diving, parachuting, wing flying (volleyball), surfing, racing, traversing, and the like, but are not limited thereto. In these scene types, the motion characteristics of the image capturing apparatus 100 are different from each other, and the brightness change characteristics in the scene are also different from each other, so in one embodiment, different weights may be preset for the motion state, the position change, the scene type, and the screen brightness change speed for different scene types. Exemplary weight settings under several exemplary scenarios are shown below:
scene one: parachuting, paraglider
In this type of scene, the motion features are usually high altitude and fast speed, and the picture is mostly sky and earth, so the weights can be set as follows: 70% of motion state, 10% of position change, 10% of scene type and 10% of picture brightness change speed.
Scene two: traversing machine
In this type of scenario, the motion is typically very fast (e.g., the highest hourly speed can reach 120 km/h-230 km/h), the altitude is generally not high, and thus the weights can be set as follows: 70% of motion state and 30% of picture brightness change speed.
Scene three: skiing and bicycle
In this type of scenario, it sometimes happens that the speed is very fast (e.g. the speed per hour of the bicycle exceeds 296km/h), so the weight setting may be similar to traversing an airport scene: 70% of motion state, 10% of position change, 10% of scene type and 10% of picture brightness change speed.
……
It should be understood that the above division of scene types and the weight settings corresponding to the scene types are only exemplary and are not intended to be limiting, and those skilled in the art may also set different scene types or other scene types and corresponding weight settings as needed, and the present invention is not limited thereto.
In one embodiment, after acquiring the motion state, the position change, and/or the scene information of the image capturing apparatus 100, the processing unit 150 may further acquire respective weights of the motion state, the position change, the scene type, and the screen brightness change speed corresponding to the scene type according to different scene types, and calculate and select a target convergence coefficient for the scene type based on the respective weights.
In one embodiment, the moving speed of the image capturing apparatus 100 may be divided into several (e.g., 3, 4, 5, 6, etc.) speed ranges, and different convergence coefficients may be preset for different speed ranges. Taking the traversing machine as an example, the speed of the traversing machine is generally between 33m/s and 64m/s, and exemplary convergence coefficients corresponding to different speed ranges are shown:
the speed is 0m/s to 40m/s, the convergence coefficient is 1,
the speed is 40m/s to 50m/s, the convergence coefficient is 1.5,
the speed is 50m/s to 60m/s, the convergence coefficient is 2.0,
the speed is 60 m/s-70 m/s, the convergence coefficient is 3.5,
the speed is 70m/s to 80m/s, and the convergence coefficient is 4.0.
Wherein, the convergence coefficient is 1 corresponding to the static scene and the normal motion scene, when the speed is increased, the corresponding convergence coefficient is increased, the convergence speed is increased, and the speed of adjusting the exposure parameters by the automatic exposure unit 150 is increased. It should be understood that the above division of the speed range and the setting of the convergence coefficient corresponding to the speed range are only exemplary and not intended to be limiting, and those skilled in the art may also set different speed ranges and corresponding convergence coefficients as needed (e.g., according to different scene types), and the present invention is not limited thereto.
In one embodiment, the processing unit 150 may also receive the movement speed of the image capture device 100 and select a convergence coefficient corresponding to the speed range as the target convergence coefficient of the automatic exposure unit based on the speed range in which the movement speed is located. Still taking the above speed range and convergence factor as examples, when the speed of the traversing machine is 43m/s, and is within the speed range of 40m/s to 50m/s, the processing unit 150 may select the convergence factor of 1.5 as the target convergence factor of the automatic exposure unit; when the traversing machine has a speed of 68m/s, which is in the range of 40m/s to 50m/s, the processing unit 150 may select a convergence factor of 3.5 as the target convergence factor of the automatic exposure unit.
According to the camera device suitable for shooting the extreme scenes, the convergence schemes with different convergence rates are adopted for automatic exposure aiming at the common scenes and the extreme motion scenes, and the convergence schemes are finely divided according to different scene types and speed ranges, so that the convergence rate is lower in the normal scenes, the exposure speed is proper during image switching, the transition time is provided, the actual situation of human eyes is met, the convergence rate is increased in the extreme scenes, the images of the pictures cannot be overexposed or excessively dark in different scene types, the brightness of the video images can be quickly adjusted to a proper value, the image color is vivid, and the image quality is remarkably improved.
Example two
The embodiment provides a method suitable for an image pickup device to shoot a limit scene.
In one embodiment, the image capturing device may be any type of image capturing device known in the art, such as a CCD camera, a CMOS camera, and the like, but the invention is not limited thereto.
Referring to fig. 2, fig. 2 shows a flow diagram of steps of a method 200 for an imaging device to capture extreme scenes, according to one embodiment of the invention. As shown in fig. 2, the method 200 may include the steps of:
in step S210, the motion state, the position change, and/or the scene information of the environment in which the image pickup apparatus is located are acquired.
In one embodiment, the motion state of the image pickup apparatus may be acquired by an inertial measurement unit by measuring a motion parameter of the image pickup apparatus. Illustratively, the inertial measurement unit may be a micro-electro-mechanical system (MEMS) IMU for measuring a motion parameter of the camera. In one embodiment, the motion parameters may include a motion speed (i.e., linear velocity), a velocity direction, an angular velocity, an acceleration, and the like of the camera device.
In one embodiment, the change in the position of the camera may be obtained by the GPS device by measuring a position parameter of the camera and based on the position parameter. In one embodiment, the location parameters may include longitude, latitude, altitude, and the like of the camera device 100. Illustratively, the positional change may include a change in height/horizontal distance or the like of the image pickup device. In one embodiment, the GPS device may be any suitable type of GPS device known in the art as desired and not limiting to the present invention.
In one embodiment, the position change of the camera device may be obtained by measuring an air pressure parameter of an environment in which the camera device is located by an air pressure measuring device, and further based on the air pressure parameter. The air pressure measuring device may be any suitable type of air pressure measuring device known in the art, such as an air pressure measuring device, as needed, but the invention is not limited thereto.
In one embodiment, the change in position of the camera may also be obtained by an airspeed measurement device by measuring the speed of movement of the camera relative to the surrounding air and further based on the speed of movement. The airspeed measurement device may be any suitable type of airspeed measurement device known in the art, such as an airspeed meter, as desired, and the invention is not limited in this respect.
It should be understood that the position change of the camera device may be obtained only by the GPS device, and may also be obtained by the air pressure measuring device and/or the airspeed measuring device to assist the GPS device in determining the position change of the camera device more accurately, which is not limited by the present invention.
In one embodiment, the scene information of the environment in which the camera is located is acquired by the computational photography unit by taking a video of the environment in which the camera is located and by frame decimation based on the video. In particular, the decimation may be performed in any suitable decimation manner, such as decimation of video scene transition frames, decimation by time uniformity, and the like. For example, when frames are decimated uniformly in time, the decimation rate of the decimated frames may be selected as needed, for example, 10 frames per second, etc., which is not limited by the present invention. In one embodiment, the scenes may include a still scene, a normal motion scene, and an extreme motion scene, wherein the extreme motion scene may include types of skiing, diving, parachuting, wing-mounted flight (volleyball), surfing, racing, cross-car, and the like, without limitation thereto. In these extreme motion scenarios, the motion speed of the camera is usually fast, and therefore the brightness of the environment changes rapidly.
In step S220, one convergence coefficient is selected from at least two preset convergence coefficients as a target convergence coefficient for an automatic exposure unit of the image pickup apparatus based on the motion state, the positional change, and/or the scene information.
At least two convergence coefficients (e.g., 2, 3, 4, 5, 6, etc.) may be preset, and different convergence coefficients correspond to different convergence rates of the exposure parameters, so that the automatic exposure unit can automatically adjust the exposure parameters (e.g., exposure time, aperture size, sensitivity (iso), etc.) according to a selected one of the convergence coefficients (referred to herein as a target convergence coefficient) to perform automatic exposure. In one embodiment, two convergence coefficients may be preset, one of which is suitable for the image pickup device to photograph a still scene and a normal moving scene, and the other of which is suitable for the image pickup device to photograph an extreme moving scene. In another embodiment, a plurality of convergence coefficients (e.g., 3, 4, 5, 6, etc.) may be preset, wherein one of the convergence coefficients is suitable for the image capturing device to capture a still scene and a normal motion scene, and the other convergence coefficients are respectively suitable for the image capturing device to capture different types of extreme motion scenes.
Specifically, two convergence coefficients are preset as an example for explanation: when the motion state indicates that the image pickup apparatus is in a severe motion state (for example, a velocity is large, an acceleration is large, or the like), and a position change indicates that the height and/or horizontal distance of the image pickup apparatus is rapidly changed, and/or scene information indicates that a scene is changed, it may be determined that the image pickup apparatus is in a limit motion scene, and a larger convergence coefficient of the two convergence coefficients may be selected as a target convergence coefficient for the automatic exposure unit, otherwise a smaller convergence coefficient is selected as the target convergence coefficient.
In one embodiment, weights may be preset for the motion state, the position change and/or the scene information, respectively, and after receiving the motion state, the position change and/or the scene information of the image capturing apparatus, the method 200 may include: respective weights of preset motion states, position changes and/or scene information are acquired, respectively, and a target convergence coefficient for the automatic exposure unit is calculated and selected based on the respective weights. For example, weights of 70%, 20%, 10% may be preset for the motion state, the position change, and the scene information, respectively. For example, different weights may be preset for the motion state, the position change, and/or the scene information according to different scenes used by the image capturing apparatus.
In one embodiment, the scene information may include a scene type and/or a picture brightness change speed, and the like. In one embodiment, the scene types may include types of skiing, diving, parachuting, wing flying (volleyball), surfing, racing, traversing, and the like, but are not limited thereto. The motion characteristics of the camera device vary from scene type to scene type, and the brightness variation characteristics vary from scene to scene, so in one embodiment, the method 200 may comprise: different weights can be preset for the motion state, the position change, the scene type and the picture brightness change speed according to different scene types. Exemplary weight settings under several exemplary scenarios are shown below:
scene one: parachuting, paraglider
In this type of scene, the motion features are usually high altitude and fast speed, and the picture is mostly sky and earth, so the weights can be set as follows: 70% of motion state, 10% of position change, 10% of scene type and 10% of picture brightness change speed.
Scene two: traversing machine
In this type of scenario, the motion is typically very fast (e.g., the highest hourly speed can reach 120 km/h-230 km/h), the altitude is generally not high, and thus the weights can be set as follows: 70% of motion state and 30% of picture brightness change speed.
Scene three: skiing and bicycle
In this type of scenario, it sometimes happens that the speed is very fast (e.g. the speed per hour of the bicycle exceeds 296km/h), so the weight setting may be similar to traversing an airport scene: 70% of motion state, 10% of position change, 10% of scene type and 10% of picture brightness change speed.
……
It should be understood that the above division of scene types and the weight settings corresponding to the scene types are only exemplary and are not intended to limit the present invention, and those skilled in the art may also set different or other scene types and corresponding weight settings as needed, and the present invention is not limited thereto.
In one embodiment, after acquiring the motion state, the position change and/or the scene information of the camera, the method 200 may further include: according to different scene types, respective weights of a motion state, a position change, a scene type and a picture brightness change speed corresponding to the scene type are respectively obtained, and a target convergence coefficient for the scene type is calculated and selected based on the respective weights.
In one embodiment, the moving speed of the image capturing device may be divided into several (e.g., 3, 4, 5, 6, etc.) speed ranges, and different convergence coefficients may be preset for different speed ranges. Taking the traversing machine as an example, the speed of the traversing machine is generally between 33m/s and 64m/s, and exemplary convergence coefficients corresponding to different speed ranges are shown:
the speed is 0m/s to 40m/s, the convergence coefficient is 1,
the speed is 40m/s to 50m/s, the convergence coefficient is 1.5,
the speed is 50m/s to 60m/s, the convergence coefficient is 2.0,
the speed is 60 m/s-70 m/s, the convergence coefficient is 3.5,
the speed is 70m/s to 80m/s, and the convergence coefficient is 4.0.
The convergence coefficient is 1 corresponding to a static scene and a common motion scene, when the speed is accelerated, the corresponding convergence coefficient is increased, the convergence speed is accelerated, and the speed of adjusting the exposure parameters by the automatic exposure unit is accelerated. It should be understood that the above division of the speed range and the setting of the convergence coefficient corresponding to the speed range are only exemplary, and the present invention is not intended to be limited thereto, and those skilled in the art may also set different speed ranges and corresponding convergence coefficients as needed (e.g., according to different scene types), and the present invention is not limited thereto.
In one embodiment, the method 200 may further comprise: the movement speed of the image pickup apparatus is received, and based on a speed range in which the movement speed is located, a convergence coefficient corresponding to the speed range is selected as a target convergence coefficient of the automatic exposure unit. Still taking the above speed range and convergence factor as an example, when the speed of the traversing machine is 43m/s, and is within the speed range of 40m/s to 50m/s, the convergence factor of 1.5 can be selected as the target convergence factor of the automatic exposure unit; when the speed of the traversing machine is 68m/s, and is in the speed range of 40 m/s-50 m/s, the convergence coefficient of 3.5 can be selected as the target convergence coefficient of the automatic exposure unit.
In step S230, the exposure parameters of the automatic exposure unit are automatically adjusted based on the target convergence coefficient to perform exposure.
In one embodiment, the exposure parameters may include exposure time (i.e., shutter speed), aperture size, sensitivity (iso), isp gain, and the like.
According to the method for shooting the extreme scene by the camera device, the convergence schemes with different convergence rates are automatically selected for automatic exposure aiming at the common scene and the extreme motion scene, and the convergence schemes are finely divided according to different scene types and speed ranges, so that the convergence rate is lower in the normal scene, the exposure speed is proper during the picture switching, the transition time is provided, the actual situation of human eyes is met, the convergence rate is accelerated in the extreme scene, the picture of the picture cannot be overexposed or excessively dark in different scene types, the brightness of the video picture can be quickly adjusted to a proper value, the picture color is vivid, and the picture quality is remarkably improved.
EXAMPLE III
The present embodiment provides a computer-readable medium having stored thereon a computer program which, when executed, performs the method as described above for an imaging apparatus to capture extreme scenes.
According to the computer readable medium of the invention, when a computer program on the medium is executed, convergence schemes with different convergence rates can be automatically selected for automatic exposure aiming at a common scene and an extreme motion scene, and the convergence schemes are finely divided according to different scene types and speed ranges, so that the convergence rate is lower in a normal scene, the exposure speed is proper during picture switching, transition time is provided, the actual situation of human eyes is met, the convergence rate is accelerated in an extreme scene, photo pictures in different scene types cannot be overexposed or excessively dark, the brightness of video pictures can be quickly adjusted to a proper value, and thus, the picture color is vivid, and the picture quality is obviously improved.
Although the illustrative embodiments have been described herein with reference to the accompanying drawings, it is to be understood that the foregoing illustrative embodiments are merely exemplary and are not intended to limit the scope of the invention thereto. Various changes and modifications may be effected therein by one of ordinary skill in the pertinent art without departing from the scope or spirit of the present invention. All such changes and modifications are intended to be included within the scope of the present invention as set forth in the appended claims.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described device embodiments are merely illustrative, and for example, the division of the units is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another device, or some features may be omitted, or not executed.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the invention and aiding in the understanding of one or more of the various inventive aspects. However, the method of the present invention should not be construed to reflect the intent: that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
It will be understood by those skilled in the art that all of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where such features are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.
The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It will be appreciated by those skilled in the art that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functionality of some of the modules in an item analysis apparatus according to embodiments of the present invention. The present invention may also be embodied as apparatus programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
The above description is only for the specific embodiment of the present invention or the description thereof, and the protection scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and the changes or substitutions should be covered within the protection scope of the present invention. The protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (21)
- An image pickup apparatus adapted to photograph a limit scene, the image pickup apparatus comprising:the first sensing unit is used for acquiring the motion state of the camera device;a second sensing unit for acquiring a position change of the image pickup device;the third sensing unit is used for acquiring scene information of an environment where the camera device is located;a processing unit for receiving the motion state, the position change and/or the scene information, and selecting one convergence coefficient from at least two preset convergence coefficients as a target convergence coefficient for the automatic exposure unit based on the motion state, the position change and/or the scene information;and the automatic exposure unit is used for automatically adjusting the exposure parameters based on the target convergence coefficient so as to carry out exposure.
- The image pickup apparatus according to claim 1, wherein the processing unit is further configured to acquire respective weights of the motion state, the positional change, and/or the scene information, which are preset, respectively, and to calculate and select the target convergence coefficient for the automatic exposure unit based on the respective weights.
- The image capturing apparatus according to claim 1, wherein the scene information includes a scene type and/or a picture brightness change speed.
- The image capturing apparatus according to claim 3, wherein the processing unit is further configured to acquire respective weights of the preset motion state, the position change, the scene type, and the screen luminance change speed corresponding to the scene type, respectively, according to different scene types, and calculate and select the target convergence coefficient for the scene type based on the respective weights.
- The image pickup apparatus according to claim 1, wherein the first sensing unit includes an inertial measurement unit that measures a motion parameter of the image pickup apparatus and acquires a motion state of the image pickup apparatus based on the motion parameter.
- The image pickup apparatus according to claim 5, wherein the motion parameter includes a motion speed of the image pickup apparatus, and the processing unit further receives the motion speed of the image pickup apparatus, and selects a convergence coefficient corresponding to a speed range in which the motion speed is located as a target convergence coefficient of the automatic exposure unit based on the speed range.
- The image pickup apparatus according to claim 1, wherein the third sensing unit includes a computational photography unit that photographs a video of an environment in which the image pickup apparatus is located and acquires scene information of the environment in which the image pickup apparatus is located by frame-decimation based on the video.
- The image pickup apparatus according to claim 1, wherein the second sensing unit includes a GPS device that measures a position parameter of the image pickup apparatus and acquires a change in position of the image pickup apparatus based on the position parameter.
- The camera device according to claim 1, wherein the second sensing unit includes an air pressure measuring device for measuring an air pressure parameter of an environment in which the camera device is located, and further acquiring a change in position of the camera device based on the air pressure parameter.
- The camera device of claim 8, wherein the second sensing unit further comprises an airspeed measurement device for measuring a speed of movement of the camera device relative to ambient air and further acquiring a change in position of the camera device based on the speed of movement.
- A method for an imaging device to capture extreme scenes, the method comprising:acquiring the motion state and position change of a camera device and/or scene information of the environment in which the camera device is positioned;selecting one convergence coefficient from at least two preset convergence coefficients as a target convergence coefficient for an automatic exposure unit of the image pickup apparatus based on the motion state, the position change, and/or the scene information;and automatically adjusting the exposure parameters of the automatic exposure unit based on the target convergence coefficient to perform exposure.
- The method of claim 11, wherein the method further comprises: and respectively acquiring respective weights of the preset motion state, the position change and/or the scene information, and calculating and selecting the target convergence coefficient for the automatic exposure unit based on the respective weights.
- The method of claim 11, wherein the scene information comprises a scene type and/or a picture brightness change speed.
- The method of claim 13, wherein the method further comprises: and respectively acquiring respective weights of the preset motion state, the position change, the scene type and/or the picture brightness change speed corresponding to the scene type according to different scene types, and calculating and selecting the target convergence coefficient for the scene type based on the respective weights.
- The method of claim 11, wherein the motion state of the camera is obtained by an inertial measurement unit by measuring a motion parameter of the camera.
- The method of claim 15, wherein the motion parameter comprises a speed of motion of the camera, the method further comprising: receiving a movement speed of the image pickup device, and selecting a convergence coefficient corresponding to a speed range in which the movement speed is located as a target convergence coefficient of the automatic exposure unit based on the speed range.
- The method according to claim 11, wherein the scene information of the environment in which the camera is located is acquired by a computational photography unit by taking a video of the environment in which the camera is located and by frame-taking based on the video.
- The method of claim 11, wherein the change in the location of the camera is obtained by a GPS device by measuring a location parameter of the camera and based on the location parameter.
- The method of claim 11, wherein the change in the position of the camera is obtained by an air pressure measurement device by measuring an air pressure parameter of an environment in which the camera is located and further based on the air pressure parameter.
- The method of claim 11, wherein the change in position of the camera is obtained by an airspeed measurement device by measuring a speed of movement of the camera relative to ambient air and further based on the speed of movement.
- A computer-readable medium, in which a computer program is stored which, when running, executes a method as claimed in any one of claims 11 to 20, which is adapted for a camera unit to photograph extreme scenes.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2020/090462 WO2021226990A1 (en) | 2020-05-15 | 2020-05-15 | Photographic device and photographing method applicable to photographing extreme scenario |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113950821A true CN113950821A (en) | 2022-01-18 |
Family
ID=78525963
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202080031233.1A Pending CN113950821A (en) | 2020-05-15 | 2020-05-15 | Camera device and shooting method suitable for shooting limit scene |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113950821A (en) |
| WO (1) | WO2021226990A1 (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107343158A (en) * | 2017-07-25 | 2017-11-10 | 广东欧珀移动通信有限公司 | Accelerate the convergent method and devices of AEC, terminal device |
| CN108234894A (en) * | 2018-01-15 | 2018-06-29 | 维沃移动通信有限公司 | A kind of exposure adjustment method and terminal device |
| CN108989695A (en) * | 2018-06-28 | 2018-12-11 | 努比亚技术有限公司 | Initial automatic exposure convergence method, mobile terminal and computer readable storage medium |
| US20190394379A1 (en) * | 2018-06-21 | 2019-12-26 | Qualcomm Incorporated | Auto exposure control predictive convergence |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013058923A (en) * | 2011-09-08 | 2013-03-28 | Olympus Imaging Corp | Photographing apparatus |
| CN204392420U (en) * | 2014-11-17 | 2015-06-10 | 谭斌 | A kind of image recording apparatus, smart machine and image recording system |
| CN106713778B (en) * | 2016-12-28 | 2019-04-23 | 上海兴芯微电子科技有限公司 | Exposal control method and device |
| CN106657805A (en) * | 2017-01-13 | 2017-05-10 | 广东欧珀移动通信有限公司 | Shooting method in movement and mobile terminal |
| CN109951647A (en) * | 2019-01-23 | 2019-06-28 | 努比亚技术有限公司 | A kind of acquisition parameters setting method, terminal and computer readable storage medium |
-
2020
- 2020-05-15 CN CN202080031233.1A patent/CN113950821A/en active Pending
- 2020-05-15 WO PCT/CN2020/090462 patent/WO2021226990A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107343158A (en) * | 2017-07-25 | 2017-11-10 | 广东欧珀移动通信有限公司 | Accelerate the convergent method and devices of AEC, terminal device |
| CN108234894A (en) * | 2018-01-15 | 2018-06-29 | 维沃移动通信有限公司 | A kind of exposure adjustment method and terminal device |
| US20190394379A1 (en) * | 2018-06-21 | 2019-12-26 | Qualcomm Incorporated | Auto exposure control predictive convergence |
| CN108989695A (en) * | 2018-06-28 | 2018-12-11 | 努比亚技术有限公司 | Initial automatic exposure convergence method, mobile terminal and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021226990A1 (en) | 2021-11-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8305452B2 (en) | Remote determination of image-acquisition settings and opportunities | |
| CN109218627B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| US7664293B2 (en) | Image sensing apparatus and control method thereof | |
| JP2017085551A (en) | Method of determining duration of exposure of camera on board drone, and associated drone | |
| US9571741B1 (en) | Smart shutter in low light | |
| CN110493524B (en) | Photometric adjustment method, device and equipment and storage medium | |
| CN104469136B (en) | Photographic device, image capture method and recording medium | |
| CN107615744B (en) | Image shooting parameter determining method and camera device | |
| US10602064B2 (en) | Photographing method and photographing device of unmanned aerial vehicle, unmanned aerial vehicle, and ground control device | |
| CN110291780B (en) | Image stability augmentation control method, shooting equipment and movable platform | |
| CN113485464A (en) | Handheld holder device, control method thereof and computer readable storage medium | |
| WO2021035744A1 (en) | Image collection method for mobile platform, device and storage medium | |
| CN110493522A (en) | Anti-fluttering method and device, electronic equipment, computer readable storage medium | |
| CN110337668B (en) | Image stability augmentation method and device | |
| WO2021051304A1 (en) | Shutter speed adjustment and safe shutter calibration methods, portable device and unmanned aerial vehicle | |
| CN112204946A (en) | Data processing method, device, movable platform and computer readable storage medium | |
| JP2021096865A (en) | Information processing device, flight control instruction method, program, and recording medium | |
| CN112449105A (en) | Method and device for synthesizing multiple images of shooting celestial body | |
| CN113950821A (en) | Camera device and shooting method suitable for shooting limit scene | |
| US20160156825A1 (en) | Outdoor exposure control of still image capture | |
| WO2016009199A2 (en) | Minimisation of blur in still image capture | |
| WO2022016340A1 (en) | Method and system for determining exposure parameters of main camera device, mobile platform, and storage medium | |
| WO2022160294A1 (en) | Exposure control method and device, and computer-readable storage medium | |
| WO2022126378A1 (en) | Control method and apparatus for camera | |
| CN110771144B (en) | Control method and device of electronic equipment, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |