CN111327831A - Image acquisition method and device for UGC, electronic equipment and system - Google Patents
Image acquisition method and device for UGC, electronic equipment and system Download PDFInfo
- Publication number
- CN111327831A CN111327831A CN202010235957.XA CN202010235957A CN111327831A CN 111327831 A CN111327831 A CN 111327831A CN 202010235957 A CN202010235957 A CN 202010235957A CN 111327831 A CN111327831 A CN 111327831A
- Authority
- CN
- China
- Prior art keywords
- image
- focusing
- user
- camera
- present
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
Abstract
The invention relates to the technical field of image acquisition, and particularly discloses an image acquisition method, device and system for UGC and electronic equipment. The method detects whether the moving image photographing apparatus supports continuous focusing, detects whether the moving image photographing apparatus is kept in a still state for a predetermined time threshold when it is detected that the moving image photographing apparatus does not support continuous focusing, and performs automatic focusing when the predetermined time threshold is reached. Meanwhile, the invention provides that the image preview data is adopted to detect the ambient light intensity in real time to better indicate a user to start a flash lamp, and meanwhile, the acquired photo is subjected to automatic fuzziness detection. The invention improves the focusing efficiency of the equipment, improves the shooting quality of the picture for UGC, lightens the processing load of the UGC platform and improves the user experience.
Description
Technical Field
The invention relates to the technical field of image acquisition, in particular to an image acquisition method and device for UGC and electronic equipment. The method is suitable for occasions with higher quality requirements for UGC image acquisition in online education and related industries.
Background
Ugc (user Generated content) refers to user Generated content, and generally refers to content originally created by a user in an internet application environment and uploaded to a platform to be shared with other users. A large portion of the UGC is obtained by a mobile image obtaining device, such as a cell phone, a portable tablet computer, a smart watch or smart glasses, and so forth.
The built-in operating systems of the current mobile image acquisition devices are mainly iOS and Android: the native camera of the iOS system is single in photographing and does not support continuous photographing. For a common user, a high-quality picture meeting the platform specification is difficult to shoot, so that the uploading quality is not high, the auditing passing rate is low, and the platform content quality and experience are reduced. The Android system has fewer camera functions, only supports automatic focusing, gyroscope detection and grid lines, does not support manual focusing and light real-time detection, and the focusing mode of the camera is to trigger focusing once every 2 seconds, so that the efficiency is low and the experience effect is poor. In addition, the fuzzy detection threshold of the current system is unreasonable, and the fuzzy picture cannot be accurately identified.
Most of the existing camera technologies for mobile image acquisition devices are slightly packaged on the basis of a native camera, so as to meet the general requirements of users for taking pictures and uploading. However, the UGC service has high requirements for the specification and quality of pictures uploaded by users, such as shooting angle, shooting definition, shooting direction and the like. When a common user is not well trained, the conventional camera technology is difficult to shoot photos meeting the requirements in a short time, so that the background audit passing rate is low, and the period of the whole UGC business link is prolonged. For a platform taking content as an original, the content quality reduction will seriously affect the user experience.
As for the focusing method when taking a picture, the existing focusing method is to trigger focusing every 2 seconds, for example, and the user performs focusing continuously regardless of whether the user is focusing. It is possible that the user has focused on the shooting button to take a picture, and a new focus is triggered, which causes the picture to be blurred.
For light detection during photo taking, the existing mobile phone camera usually only performs light detection at the moment of opening the camera, but in view of the fact that continuous shooting can occur to UGC service users, environmental changes can be large, and the change of light can greatly affect the quality of pictures. In addition, because the existing mobile phone camera does not support real-time detection of light, even if a user is in a dark environment, the user cannot be prompted to turn on a flash lamp or go to the environment with good light for photographing, and the light intensity of the surrounding environment during photographing cannot be ensured.
For the fuzzy detection during the photo taking, the fuzzy recognition threshold of the existing mobile terminal shooting technology is inaccurate, the fuzzy picture cannot be recognized accurately, and when a user takes a fuzzy picture to be uploaded, the user cannot be given an accurate prompt to the current picture to be fuzzy.
In addition, the existing mobile image acquisition device is usually designed for shooting general portrait or landscape photos, and is not specially optimized for UGC uploaded paper pictures, especially for application scenes for shooting book page photos, so that user experience of corresponding APP applications is poor.
Disclosure of Invention
The invention aims to solve the problems that photos uploaded by mobile image acquisition equipment for UGC do not meet the requirements of a platform, and the manual auditing cost is high due to unclear images. The unclear image comprises blurred pictures, dark picture light, uploading irrelevant pictures and the like.
To achieve the above object, an aspect of the present invention provides an image acquisition method for moving an image photographing apparatus, comprising the steps of: detecting whether the moving image photographing apparatus supports continuous focusing; when detecting that the moving image photographing device does not support continuous focusing, detecting whether the moving image photographing device is kept in a static state for a preset time threshold value, and carrying out automatic focusing when the preset time threshold value is reached; and receiving user operation to acquire an image.
According to a preferred embodiment of the present invention, the moving image photographing apparatus includes an inertial sensor; the detecting whether the moving image photographing apparatus is maintained in a stationary state for a predetermined time period threshold includes: detecting, by the inertial sensor, whether the predetermined time period threshold value is maintained after the moving image photographing apparatus is transitioned from the moving state to the stationary state.
According to an embodiment of the invention, the predetermined duration threshold is 150ms to 250 ms.
According to an embodiment of the invention, the method further comprises the steps of: detecting whether the mobile image photographing device supports a touch screen operation; when it is detected that the mobile image capturing apparatus supports a touch screen operation, a user operation interface is provided to switch between auto focus and manual focus when a user-specific operation is received.
According to an embodiment of the invention, the method further comprises the steps of: calling image preview data in real time; calculating the average brightness of the image according to the image preview data; and when the calculated average brightness of the image is less than a preset brightness threshold value, automatically turning on the flash lamp, or turning on the flash lamp when receiving the operation of turning on the flash lamp by a user.
According to an embodiment of the present invention, the step of calculating the average brightness of the image comprises: and acquiring brightness values of at least part of pixels in the image preview data, and calculating the average value of the acquired brightness values as the average brightness of the image.
According to one embodiment of the invention, the acquisition is an equally spaced acquisition.
According to an embodiment of the present invention, the retrieving the image preview data in real time includes: and acquiring image preview data in real time in preset time steps.
According to an embodiment of the present invention, the method further comprises the steps of: carrying out ambiguity recognition on the obtained image; and when the identified image blurring degree exceeds a preset blurring detection threshold value, abandoning the current image and re-receiving user operation to re-acquire the image.
According to one embodiment of the present invention, the blur detection threshold is obtained from sampling statistics on a sample image set, the sample image set including a picture marked as "blur" and a picture marked as "sharp".
According to an embodiment of the invention, the method further comprises the steps of: detecting whether an included angle between the mobile image shooting equipment and a horizontal plane is within a preset included angle range; and when the fact that the included angle between the mobile image shooting equipment and the horizontal plane is not within the preset included angle range is detected, prompting that the shooting angle is not appropriate.
According to an embodiment of the invention, the method further comprises: controlling a screen display grid of an image capture device for presenting image preview data.
A second aspect of the present invention provides an image pickup apparatus comprising: the detection module is used for detecting whether the device supports continuous focusing; the focusing module is used for detecting whether the mobile image shooting equipment is kept in a static state to reach a preset time threshold value or not when detecting that the device does not support continuous focusing, and carrying out automatic focusing when the preset time threshold value is reached; and the shooting module is used for receiving user operation to acquire an image.
A third aspect of the present invention provides an electronic device for acquiring an image, comprising a camera, a processor and a memory, the camera being configured to acquire an image according to instructions of the processor; the memory is for storing a computer executable program which, when executed by the processor, performs the method.
A fourth aspect of the present invention provides a system for acquiring an image, comprising a mobile image acquisition device and a server for information interaction with the device, the mobile image acquisition device comprising a camera, a processor and a memory, the camera being configured to acquire an image according to instructions from the processor; the memory is for storing a computer executable program which, when executed by the processor, performs the method described above.
A fifth aspect of the invention provides a computer readable medium storing a computer executable program which, when executed, performs the method of the claims.
The invention improves the aspects of camera automatic focusing, light ray detection, ambiguity identification and the like in the mobile image acquisition equipment, improves the focusing efficiency of the equipment, improves the shooting quality of the picture for UGC, reduces the processing load of a UGC platform and improves the user experience.
Drawings
In order to make the technical problems solved by the present invention, the technical means adopted and the technical effects obtained more clear, the following will describe in detail the embodiments of the present invention with reference to the accompanying drawings. It should be noted, however, that the drawings described below are only illustrations of exemplary embodiments of the invention, from which other embodiments can be derived by those skilled in the art without inventive faculty.
FIG. 1 is a schematic illustration of a scene to which the image acquisition method for UGC of the present invention is applied;
FIG. 2 is a flow chart of an image acquisition method when capturing an image with a cell phone according to an exemplary embodiment of the present invention;
fig. 3 is a flowchart of a light detecting method when an image is photographed with a mobile phone according to an exemplary embodiment of the present invention.
FIG. 4 illustrates an exemplary pixel data storage format for a single image frame;
FIG. 5 is a position in the respective data byte stream of FIG. 4;
FIG. 6 is a flowchart of a focusing method in photographing an image with a mobile phone according to an exemplary embodiment of the present invention;
FIG. 7 is a block diagram of an image capture device for UGC in accordance with an exemplary embodiment of the present invention;
FIG. 8 is a schematic diagram of an electronic device for acquiring images in accordance with one embodiment of the present invention;
fig. 9 is a schematic diagram of a computer-readable recording medium of an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will now be described more fully with reference to the accompanying drawings. The exemplary embodiments, however, may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these exemplary embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the invention to those skilled in the art. The same reference numerals denote the same or similar elements, components, or parts in the drawings, and thus their repetitive description will be omitted.
Features, structures, characteristics or other details described in a particular embodiment do not preclude the fact that the features, structures, characteristics or other details may be combined in a suitable manner in one or more other embodiments in accordance with the technical idea of the invention.
In describing particular embodiments, the present invention has been described with reference to features, structures, characteristics or other details that are within the purview of one skilled in the art to provide a thorough understanding of the embodiments. One skilled in the relevant art will recognize, however, that the invention may be practiced without one or more of the specific features, structures, characteristics, or other details.
The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the contents and operations/steps, nor do they necessarily have to be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.
It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements, components, or sections, these terms should not be construed as limiting. These phrases are used to distinguish one from another. For example, a first device may also be referred to as a second device without departing from the spirit of the present invention.
The term "and/or" and/or "includes any and all combinations of one or more of the associated listed items.
The image acquisition method provided by the invention is applied to the mobile image shooting equipment. The mobile image shooting equipment in the invention is electronic equipment which is opposite to professional shooting equipment and is convenient for a user to carry and hold, and can obtain an electronic image, and the electronic equipment comprises a mobile phone, a portable flat computer, an intelligent watch or intelligent glasses and the like.
In view of the deficiencies of the prior art, the present invention first improves the focusing method of the existing moving image photographing apparatus. In view of the fact that the existing apparatus is likely to support a continuous focusing mode, the present invention is preferably such that for a moving image photographing apparatus not having the continuous focusing mode, it is detected whether the apparatus is kept still for a predetermined time period threshold value, and when the predetermined time period threshold value is reached, automatic focusing is performed. That is, the present invention first detects whether the moving image photographing device supports continuous focusing, and performs the auto-focusing operation of the present invention when detecting that the moving image photographing device does not support continuous focusing. Compared with the prior art, the automatic focusing operation of the invention provides that whether the equipment is in a moving state or a static state is detected in real time, and focusing is carried out when the equipment is detected to be in the static state.
At the same time, in order to exclude a short, uncontrollable standstill of the device, the invention proposes to detect whether the device is standing still for a predetermined time threshold and to perform autofocus only when said predetermined time threshold is reached. According to the test of the invention, the predetermined duration threshold may be set between 150ms and 250ms, preferably 200 ms.
It should be noted that the static state in the present invention is a relative static state, that is, the real-time position change of the device is within a range (for example, 5mm), that is, the device is considered to be in the static state. The automatic focusing referred to in the present invention means that the focusing operation is automatically started without the user starting the focusing operation. The autofocus operation generally uses an autofocus operation that the device itself has.
The real-time position change of the detecting device is preferably detected using an inertial sensor included in the moving image capturing device, that is, the present invention preferably detects whether the predetermined time period threshold value is maintained after the moving image capturing device is transitioned from the moving state to the stationary state by the inertial sensor. The inertial sensor includes an acceleration sensor, a gyroscope, and the like, and the present invention preferably uses the acceleration sensor, and the detection of the position change using the acceleration sensor or the gyroscope is well known in the art, and therefore, will not be described here.
After the automatic focusing operation is finished, the mobile image shooting equipment is in a better shooting state. In order to ensure the picture quality, the present invention preferably performs photographing only in a state where focusing is completed, that is, only in a state where focusing is completed, an operation of a user is acceptable to acquire an image. The user operation referred to herein is an operation of a user operating the device to perform shooting, and is, for example, a key operation, an operation of clicking a screen, an operation performed by voice control, or a gesture operation, etc. is not excluded.
According to a preferred embodiment of the present invention, the auto focus mode of the present invention may be switched to manual focus under certain conditions. The manual focusing referred to in the present invention refers to focusing that requires user to start, and not to the operation of manually adjusting the focal length in a professional camera. That is, the present invention can be switched to manual focusing in the aforementioned automatic focusing mode, so as to facilitate flexible operation of the user. The present invention needs to provide a function of accepting a user operation for switching, such as displaying a focus mode switching button or icon on a screen, pressing the icon for operation, or performing a mode switching manner through a preset physical button, etc. Preferably, the present invention supports focus mode switching only for the mobile image photographing device capable of touch screen operation. Therefore, the present invention preferably includes detecting whether the moving image photographing device supports a touch screen operation, and when it is detected that the moving image photographing device supports a touch screen operation, providing a user operation interface to switch between auto focus and manual focus when a user-specific operation is received.
Another aspect of the invention is to enhance the manner of detection of the ambient light intensity to prompt the user that the ambient light is weak, thereby automatically turning on the flash, or turning on the flash upon receiving a user turn on operation of the flash. Of course, if the automatic turning on of the flash light is selected, the user may not be prompted.
In general, ambient light detection is performed by a dedicated brightness sensor or by using a camera lens, and the detection time is fixed, so that it is difficult to adapt to various complex environments where light changes rapidly. The invention proposes here to detect the brightness of the acquired image in real time using the image preview data and to decide if a flash needs to be turned on depending on the image brightness. Specifically, the step of calculating the average brightness of the image according to the present invention includes: the method comprises the steps of calling image preview data in real time, calculating image average brightness according to the image preview data, and automatically turning on a flash lamp when the calculated image average brightness is smaller than a preset brightness threshold value, or turning on the flash lamp when receiving the operation of turning on the flash lamp by a user.
In order to improve the processing efficiency, it is preferable that the luminance values of some pixels in the image preview data are collected, and an average value of the collected luminance values is used as the image average luminance. For example, the pixels may be collected at equal intervals by collecting every 10 pixels, or every 100 pixels. Further, the interval of acquisition may also be adjusted according to the size of the image (the number of pixels). Meanwhile, in order to avoid an excessive calculation amount, when the image preview data is called in real time, the image preview data may be acquired in real time at a predetermined time step in time, for example, the image preview data is acquired every 200 ms.
According to a further aspect of the invention, the invention further comprises the step of ambiguity recognition of the acquired image, so as to identify the device immediately acquired by the mobile image acquisition device locally, so as not to lose bandwidth, traffic, time, or provide a picture useful for the platform when uploading to the server.
Specifically, the present invention discards the current image and re-receives a user operation to re-acquire the image when the identified image blur degree exceeds a predetermined blur detection threshold. This step is an automatic ambiguity detection step and relies entirely on the mobile device itself for processing and automatic scaling of the current image after recognition of the blurred image. Therefore, on one hand, the user does not need to judge whether the image is fuzzy or not, the workload of the user is reduced, and the user experience is improved; on the other hand, it is also convenient to adjust the requirement for the ambiguity according to different requirements of the platform by changing the identified parameter settings, and to achieve the same ambiguity requirement criteria between different mobile image obtaining apparatuses.
The blur detection threshold may be determined from sampling statistics on a sample image set including pictures that are marked as "blurred" and pictures that are marked as "sharp". A suitable image blur threshold may be calculated by conventional statistical analysis calculations, for example taking an intermediate value between the average blur of the image marked as "blurred" and the average blur of the image marked as "sharp".
Further, according to other aspects of the present invention, in consideration of the application of the present invention to scenes where books or the like are photographed while being placed on a horizontal plane, the present invention is also configured to detect whether an angle between the moving image photographing apparatus and the horizontal plane is within a predetermined angle range, and when it is detected that the angle between the moving image photographing apparatus and the horizontal plane is not within the predetermined angle range, to prompt that the photographing angle is not appropriate. The included angle between the detection device and the horizontal plane can be detected by a gyroscope of the device. Further, in order to align the photographed book with the lens, the photographing preview screen display grid may be controlled to facilitate user alignment.
FIG. 1 is a schematic illustration of a scene to which the image acquisition method for UGC of the present invention is applied. As shown in fig. 1, a mobile phone 1 as a moving image obtaining apparatus is held by a user to take a picture of a page of a book 3, and then transmits the taken picture to a remote server 2 via a network. The method is mainly applied to shooting and uploading books, magazines, text materials and the like, the uploaded contents are usually determined by a User and are shot and uploaded by the User, and therefore the contents are also called User Generated contents, namely User Generated Content (UGC for short). And the uploaded UGC picture needs to be checked and then put in a warehouse after being checked by a platform where the server is located, and the UGC picture can be used as data for providing services to the outside. In order to reduce the working intensity of the server and improve the UGC auditing passing rate, the method is executed on the mobile image acquisition equipment.
Generally, the method of the present invention can be implemented in the form of APP, that is, a specific APP is installed on a mobile phone, and the APP obtains the right to call a mobile phone camera, and an interface (including a button, a touch screen, etc.) interacting with a user can be called by using the APP, so as to receive user input and show information to the user. Thus, the user can operate the mobile phone 1 to open the APP of the present invention so that the mobile phone performs the method of the present invention.
However, it should be noted that the present invention can be applied not only to a mobile phone, but also to an intelligent portable device such as a tablet pc, an electronic book reader, a smart watch, and smart glasses, as long as the device has a function of taking a picture. Further, the present invention is not limited to the communication connection between the mobile image capturing apparatus and the server 2, and includes a wireless or wired manner as long as the captured photograph can be uploaded.
Fig. 2 is a flowchart of an image acquisition method when an image is photographed with a mobile phone according to an exemplary embodiment of the present invention. This embodiment is also explained by taking a mobile phone as an example.
As shown in fig. 2, when the APP of the present invention supporting taking and uploading of photos is installed on the mobile phone of the user, the user may start the APP, which would require the user to allow the user to use the camera right of the local computer in advance. When the user chooses to allow the camera to be used, the APP starts the camera in preparation for shooting. After the camera is started, the camera acquires image preview data in real time. When the screen of the mobile phone is opened, the image preview data is directly displayed on the screen of the mobile phone. In this embodiment, the screen also controls the on-screen display grid simultaneously with presentation of the image preview data. When the mobile phone is used for taking a picture, a real-time picture can be displayed on a screen of the mobile phone, and grids are also displayed on the picture and are used for facilitating positioning of books. The real-time picture on the mobile phone screen is called image preview data, and the display network is mainly applied to shooting books, magazines and other paper materials, so that the display network is favorable for users to align shot objects and prevent shot pictures from tilting.
As described above, the method of the present invention mainly improves focusing, light intensity detection, blur degree detection, and the like of a camera, and the focusing and light intensity detection of the camera are performed cyclically in a state where the camera is started. That is, the method of the present invention continues the control of focusing and light detection as long as it is not the moment when a picture is taken.
With continued reference to fig. 2, in this embodiment, after the camera is started, the mobile phone-mounted gyroscope is also continuously used to detect whether the camera is level, when it is detected that the included angle between the camera and the horizontal plane exceeds a predetermined value (for example, 15 degrees), the user is prompted that the shooting angle is not specified, shooting is prohibited by disabling the shooting button or the touch screen shooting icon, and when it is detected again that the included angle between the camera and the horizontal plane does not exceed the predetermined value, the shooting button or the touch screen shooting icon is restarted. As for paper materials such as books and the like, the paper materials are usually required to be placed on a desktop for shooting, and the limitation measures can effectively avoid picture inclination or blurring caused by incorrect shooting angle of a user. It should be noted that there are various ways of prohibiting shooting, and the modes are not limited to the above two ways, and for example, display of the entire screen may be prohibited, but the present invention is preferably a mode suitable for prompt prohibition, that is, a mode capable of quickly returning to a normal shooting mode when a camera level is detected.
In this embodiment, while the camera remains horizontal, the method of the present invention controls the camera to perform the focusing method of the present invention while continuing to perform the detection of the intensity of the ambient light. For the focusing step, it is not listed separately in fig. 2, but it should be understood that the focusing step is continued throughout the camera startup process except for the moment of the actual shot. For the specific focusing step, it will be further explained in the following description of fig. 6.
With continued reference to fig. 2, the detection of the ambient light brightness is performed after the camera is started and acquires the image preview data. As mentioned above, the present invention obtains an accurate value of the ambient light intensity by performing a calculation on the image preview data. Specifically, the step of calculating the average brightness of the image according to the present invention includes: the method comprises the steps of calling image preview data in real time, calculating image average brightness according to the image preview data, and automatically turning on a flash lamp when the calculated image average brightness is smaller than a preset brightness threshold value, or turning on the flash lamp when receiving the operation of turning on the flash lamp by a user. In order to improve the processing efficiency, it is preferable that the luminance values of some pixels in the image preview data are collected, and an average value of the collected luminance values is used as the image average luminance. In this embodiment, every 10 pixels are acquired. In this embodiment, the image preview data is acquired every 500ms in real time, and of course, other interval durations may be set.
Fig. 3 is a flowchart of a light detection method for capturing an image with a mobile phone according to an exemplary embodiment of the present invention, and as shown in fig. 3, the light detection implementation steps specifically adopted in this embodiment are as follows:
the first step is as follows: obtaining image preview data
Calling a built-in method of the camera to obtain a byte array in NV21 format, wherein NV21 is one of YUV formats. YUV is mainly used for optimizing the transmission of color video signals; where "Y" represents brightness, i.e., a gray-scale value, and "U" and "V" represent chromaticity. The step is carried out once every 500ms, namely whether the distance from the last detection exceeds 500ms is judged, if so, the next step is carried out, and if not, the step is directly finished.
The second step is that: calculating average brightness of preview image data
For image brightness, it is sufficient to take the Y value, which is the first N in the array (N is the total number of pixels obtained by multiplying the image width by the height). Fig. 4 exemplarily shows a pixel data storage format of a single image frame. Fig. 5 is a position in the respective data byte stream of fig. 4.
Thus, the total luminance is the sum of the first N Y values in the array (step size can be set for efficiency, one per 10 points)
Average brightness is total brightness/number of collected points
The third step: comparing the threshold value with the average brightness
Comparing the average brightness with a set brightness threshold, and if the average brightness is greater than the set brightness threshold, indicating that the light brightness is sufficient and a picture can be taken; if the light intensity is less than the threshold value, the light is dark, and a prompt for turning on the flash lamp by the user needs to be given.
Through the detection steps, the mobile phone can detect the ambient light brightness in real time so as to accurately prompt a user to start a flash lamp, and the definition of image acquisition is improved.
As shown in fig. 2, when the camera is turned on and the horizontal angle is kept within the appropriate range, and the camera is completely focused, the user can perform a photographing operation at any time. The invention also integrates the function of detecting the image ambiguity in the APP of the mobile phone. That is, after the photo is acquired, the blur degree of the photo is firstly detected, and when the recognized image blur degree exceeds a preset blur detection threshold, the current image is abandoned, and the user operation is received again to acquire the image again.
The fuzzy detection threshold is preset in the APP. The threshold may be updated through information interaction with the server. Since the requirements of the platform for the ambiguity may vary from application scenario to application scenario and from tolerance to application scenario, the present invention preferably periodically obtains the ambiguity detection threshold from the server. The blur detection threshold may be calculated by the platform, for example, by sampling statistics on a sample image set including images marked as "blurred" and images marked as "sharp". A suitable image blur threshold may be calculated by conventional statistical analysis calculations, for example taking an intermediate value between the average blur of the image marked as "blurred" and the average blur of the image marked as "sharp". The invention may also employ other ways to calculate the image blur level threshold, such as obtaining the best image blur level threshold through machine learning.
In the embodiment of the invention, if the device detects that the picture is fuzzy, the user is prompted to take a picture again or select a clear picture to upload.
The overall operational flow of the camera of the exemplary embodiment has been described above. As described above, in the state where the camera is turned on, the focusing operation is continued. The focusing operation of the camera in this embodiment is explained below with reference to fig. 6.
Fig. 6 is a flowchart of a focusing method in photographing an image with a mobile phone according to an exemplary embodiment of the present invention.
Considering that the existing mobile phone may support the continuous focusing mode, the present invention first detects whether the device supports continuous focusing for the camera, and if so, directly adopts the same continuous focusing mode, as shown in fig. 6. The continuous focusing mode has high focusing efficiency, can achieve real-time continuous focusing, can focus in real time even if an object to be shot moves but the mobile phone is not moved during previewing, and has good experience, so the method is directly adopted in the embodiment.
The difference of the invention is that if the mobile phone does not have the continuous focusing mode, the acceleration sensor is called to detect whether the mobile phone is kept in a static state for 200ms, and when the static state reaches 200ms, the automatic focusing is carried out.
Specifically, in the embodiment, it is first detected whether the mobile phone supports continuous focusing, and when it is detected that the mobile image capturing device does not support continuous focusing, it is detected whether the mobile phone supports touch screen operation, if so, an option for automatic focusing or manual focusing is provided for a user, and if not, the automatic focusing operation of the present invention is performed. Compared with the prior art, the automatic focusing operation of the invention provides that whether the equipment is in a moving state or a static state is detected in real time, and focusing is carried out when the equipment is detected to be in the static state.
In addition, when the mobile phone supports touch screen operation and the user selects manual focusing, the manual focusing is configured according to the touch screen operation of the user. The manual focusing here means that focusing is performed by a user's operation, and the focal length is not completely adjusted by the user.
As mentioned above, the stationary state is a relative stationary state, i.e. the real-time position change of the mobile phone is within a range (e.g. 5mm), i.e. the device is considered to be in the stationary state. The automatic focusing referred to in the present invention means that the focusing operation is automatically started without the user starting the focusing operation. The autofocus operation generally uses an autofocus operation that the device itself has.
Fig. 7 is a block diagram of an image capturing apparatus for UGC according to an exemplary embodiment of the present invention. As shown in fig. 7, the apparatus includes a detection module, a focusing module, and a photographing module. The detection module is used for detecting whether the device supports continuous focusing. The focusing module is used for detecting whether the mobile image shooting equipment is kept in a static state to reach a preset time threshold value or not when detecting that the device does not support continuous focusing, and carrying out automatic focusing when the preset time threshold value is reached; and the shooting module is used for receiving user operation to acquire an image.
It should be noted that the above modules may be functional modules, and may be implemented by hardware or software.
Fig. 8 is a schematic structural diagram of an electronic device for acquiring an image, which includes a camera, a processor and a memory, according to an embodiment of the present invention. The camera is used for acquiring images according to instructions of the processor; the memory is for storing a computer executable program that, when executed by the processor, the processor performs an image acquisition method for UGC. The electronic device, i.e., the image acquisition device, includes an electronic device having a shooting function, such as a mobile phone, a tablet computer, and a smart watch.
As shown in fig. 8, the electronic device is in the form of a general purpose computing device. The processor can be one or more and can work together. The invention also does not exclude that distributed processing is performed, i.e. the processors may be distributed over different physical devices. The electronic device of the present invention is not limited to a single entity, and may be a sum of a plurality of entity devices.
The memory stores a computer executable program, typically machine readable code. The computer readable program may be executed by the processor to enable an electronic device to perform the method of the invention, or at least some of the steps of the method.
The memory may include volatile memory, such as Random Access Memory (RAM) and/or cache memory, and may also be non-volatile memory, such as read-only memory (ROM).
Optionally, in this embodiment, the electronic device further includes an I/O interface, which is used for data exchange between the electronic device and an external device. The I/O interface may be a local bus representing one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, and/or a memory storage device using any of a variety of bus architectures.
It should be understood that the electronic device shown in fig. 8 is only one example of the present invention, and elements or components not shown in the above example may be further included in the electronic device of the present invention. For example, some electronic devices further include a display unit such as a display screen, and some electronic devices further include a human-computer interaction element such as a button, a keyboard, and the like. Electronic devices are considered to be covered by the present invention as long as the electronic devices are capable of executing a computer-readable program in a memory to implement the method of the present invention or at least a part of the steps of the method.
The electronic device can interact with the server to form a system, the electronic device is used as a mobile image acquisition device to execute the method, and the server is used for receiving UGC pictures uploaded by the mobile image acquisition device. Also, as previously mentioned, the server may also communicate parameters to the mobile image acquisition device, such as light detection brightness thresholds, ambiguity thresholds, etc., to improve the method of the present invention according to the real-time needs of the server.
Fig. 9 is a schematic diagram of a computer-readable recording medium of an embodiment of the present invention. As shown in fig. 9, the computer-readable recording medium stores a computer-executable program, and when the computer-executable program is executed, the method for intelligent assistance pushing of a vehicle based on rotation angle monitoring according to the present invention is implemented. The computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
From the above description of the embodiments, those skilled in the art will readily appreciate that the present invention can be implemented by hardware capable of executing a specific computer program, such as the system of the present invention, and electronic processing units, servers, clients, mobile phones, control units, processors, etc. included in the system, and the present invention can also be implemented by a vehicle including at least a part of the above system or components. The invention can also be implemented by computer software for performing the method of the invention, for example, by control software executed by a microprocessor, an electronic control unit, a client, a server, etc. of the locomotive side. It should be noted that the computer software for executing the method of the present invention is not limited to be executed by one or a specific hardware entity, but may also be implemented in a distributed manner by hardware entities without specific details, for example, some method steps executed by the computer program may be executed at the locomotive end, and another part may be executed in the mobile terminal or the smart helmet, etc. For computer software, the software product may be stored in a computer readable storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or may be distributed over a network, as long as it enables the electronic device to perform the method according to the present invention.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention and are not intended to limit the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. An image acquisition method for UGC for moving an image capturing apparatus, comprising the steps of:
detecting whether the moving image photographing apparatus supports continuous focusing;
when detecting that the moving image photographing device does not support continuous focusing, detecting whether the moving image photographing device is kept in a static state for a preset time threshold value, and carrying out automatic focusing when the preset time threshold value is reached;
and receiving user operation to acquire an image.
2. The image acquisition method according to claim 1,
the moving image photographing apparatus includes an inertial sensor;
the detecting whether the moving image photographing apparatus is maintained in a stationary state for a predetermined time period threshold includes: detecting, by the inertial sensor, whether the predetermined time period threshold value is maintained after the moving image photographing apparatus is transitioned from a moving state to a stationary state;
optionally, the predetermined duration threshold is 150ms to 250 ms.
3. The image acquisition method according to claim 1 or 2, further comprising the steps of:
detecting whether the mobile image photographing device supports a touch screen operation;
when it is detected that the mobile image capturing apparatus supports a touch screen operation, a user operation interface is provided to switch between auto focus and manual focus when a user-specific operation is received.
4. The image acquisition method according to any one of claims 1 to 3, further comprising the steps of:
calling image preview data in real time;
calculating the average brightness of the image according to the image preview data;
when the calculated average brightness of the image is smaller than a preset brightness threshold value, automatically turning on a flash lamp, or turning on the flash lamp when receiving the operation of turning on the flash lamp by a user;
optionally, the step of calculating the average brightness of the image comprises: acquiring brightness values of at least part of pixels in the image preview data, and calculating an average value of the acquired brightness values as an image average brightness;
optionally, the acquiring is equally spaced;
optionally, the retrieving the image preview data in real time includes: and acquiring image preview data in real time in preset time steps.
5. The image acquisition method according to any one of claims 1 to 4, further comprising the steps of:
carrying out ambiguity recognition on the obtained image;
when the identified image fuzziness exceeds a preset fuzzy detection threshold, abandoning the current image, and receiving user operation again to obtain the image again;
optionally, the blur detection threshold is obtained from sampling statistics on a sample image set, the sample image set comprising a picture marked as "blur" and a picture marked as "sharp".
6. The image acquisition method according to any one of claims 1 to 5, further comprising the steps of:
detecting whether an included angle between the mobile image shooting equipment and a horizontal plane is within a preset included angle range;
when the fact that the included angle between the mobile image shooting device and the horizontal plane is not within the preset included angle range is detected, prompting that the shooting angle is not appropriate is conducted;
optionally, the method further comprises: controlling a screen display grid of an image capture device for presenting image preview data.
7. An image acquisition apparatus, characterized by comprising:
the detection module is used for detecting whether the device supports continuous focusing;
the focusing module is used for detecting whether the mobile image shooting equipment is kept in a static state to reach a preset time threshold value or not when detecting that the device does not support continuous focusing, and carrying out automatic focusing when the preset time threshold value is reached;
and the shooting module is used for receiving user operation to acquire an image.
8. An electronic device for acquiring images, comprising a camera, a processor and a memory,
the camera is used for acquiring images according to instructions of the processor;
the memory for storing a computer executable program, characterized in that:
the computer program, when executed by the processor, performs the method of any of claims 1 to 6.
9. A system for capturing images comprising a mobile image capturing device and a server for information interaction with the device, the mobile image capturing device comprising a camera, a processor and a memory,
the camera is used for acquiring images according to instructions of the processor;
the memory for storing a computer executable program, characterized in that:
the computer program, when executed by the processor, performs the method of any of claims 1 to 6.
10. A computer-readable medium storing a computer-executable program, wherein the computer-executable program, when executed, implements the method of any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010235957.XA CN111327831B (en) | 2020-03-30 | 2020-03-30 | Image acquisition method and device for UGC, electronic equipment and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010235957.XA CN111327831B (en) | 2020-03-30 | 2020-03-30 | Image acquisition method and device for UGC, electronic equipment and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111327831A true CN111327831A (en) | 2020-06-23 |
| CN111327831B CN111327831B (en) | 2021-09-10 |
Family
ID=71171705
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010235957.XA Active CN111327831B (en) | 2020-03-30 | 2020-03-30 | Image acquisition method and device for UGC, electronic equipment and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111327831B (en) |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20100013171A (en) * | 2008-07-30 | 2010-02-09 | 삼성디지털이미징 주식회사 | Method and apparatus for compensating a motion of the autofocus region, and autofocus method and apparatus using thereof |
| CN101715063A (en) * | 2008-10-06 | 2010-05-26 | 宏达国际电子股份有限公司 | Method for starting automatic focusing function and electronic device thereof |
| CN104125487A (en) * | 2013-04-28 | 2014-10-29 | 腾讯科技（深圳）有限公司 | Method and device for uploading image data |
| CN105049734A (en) * | 2015-08-31 | 2015-11-11 | 广州市幸福网络技术有限公司 | License camera capable of giving shooting environment shooting prompt and shooting environment detection method |
| CN105592263A (en) * | 2015-12-17 | 2016-05-18 | 小米科技有限责任公司 | Image capturing method, device and terminal |
| CN106161919A (en) * | 2015-04-15 | 2016-11-23 | 阿里巴巴集团控股有限公司 | The method and apparatus of scanogram |
| CN106230994A (en) * | 2016-09-29 | 2016-12-14 | 广州鹤互联网科技有限公司 | A kind of sign-off file acquisition and method for uploading, device |
| CN106713780A (en) * | 2017-01-16 | 2017-05-24 | 维沃移动通信有限公司 | Control method for flash lamp and mobile terminal |
| CN106775332A (en) * | 2017-02-07 | 2017-05-31 | 珠海市魅族科技有限公司 | Image processing method and picture processing system |
| WO2018036276A1 (en) * | 2016-08-22 | 2018-03-01 | 平安科技（深圳）有限公司 | Image quality detection method, device, server and storage medium |
| CN108600605A (en) * | 2017-02-17 | 2018-09-28 | Lg 电子株式会社 | Mobile terminal and its control method |
| CN108683850A (en) * | 2018-05-15 | 2018-10-19 | 维沃移动通信有限公司 | A kind of shooting reminding method and mobile terminal |
| CN109829859A (en) * | 2018-12-05 | 2019-05-31 | 平安科技（深圳）有限公司 | Image processing method and terminal device |
| CN110532232A (en) * | 2019-08-20 | 2019-12-03 | 珠海格力电器股份有限公司 | Method and device for processing uploaded pictures |
| CN110719327A (en) * | 2019-10-08 | 2020-01-21 | 珠海格力电器股份有限公司 | Interactive method and device for uploading image and storage medium |
| CN110838102A (en) * | 2019-10-24 | 2020-02-25 | 开望(杭州)科技有限公司 | Intelligent image uploading method |
-
2020
- 2020-03-30 CN CN202010235957.XA patent/CN111327831B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20100013171A (en) * | 2008-07-30 | 2010-02-09 | 삼성디지털이미징 주식회사 | Method and apparatus for compensating a motion of the autofocus region, and autofocus method and apparatus using thereof |
| CN101715063A (en) * | 2008-10-06 | 2010-05-26 | 宏达国际电子股份有限公司 | Method for starting automatic focusing function and electronic device thereof |
| CN104125487A (en) * | 2013-04-28 | 2014-10-29 | 腾讯科技（深圳）有限公司 | Method and device for uploading image data |
| CN106161919A (en) * | 2015-04-15 | 2016-11-23 | 阿里巴巴集团控股有限公司 | The method and apparatus of scanogram |
| CN105049734A (en) * | 2015-08-31 | 2015-11-11 | 广州市幸福网络技术有限公司 | License camera capable of giving shooting environment shooting prompt and shooting environment detection method |
| CN105592263A (en) * | 2015-12-17 | 2016-05-18 | 小米科技有限责任公司 | Image capturing method, device and terminal |
| WO2018036276A1 (en) * | 2016-08-22 | 2018-03-01 | 平安科技（深圳）有限公司 | Image quality detection method, device, server and storage medium |
| CN106230994A (en) * | 2016-09-29 | 2016-12-14 | 广州鹤互联网科技有限公司 | A kind of sign-off file acquisition and method for uploading, device |
| CN106713780A (en) * | 2017-01-16 | 2017-05-24 | 维沃移动通信有限公司 | Control method for flash lamp and mobile terminal |
| CN106775332A (en) * | 2017-02-07 | 2017-05-31 | 珠海市魅族科技有限公司 | Image processing method and picture processing system |
| CN108600605A (en) * | 2017-02-17 | 2018-09-28 | Lg 电子株式会社 | Mobile terminal and its control method |
| CN108683850A (en) * | 2018-05-15 | 2018-10-19 | 维沃移动通信有限公司 | A kind of shooting reminding method and mobile terminal |
| CN109829859A (en) * | 2018-12-05 | 2019-05-31 | 平安科技（深圳）有限公司 | Image processing method and terminal device |
| CN110532232A (en) * | 2019-08-20 | 2019-12-03 | 珠海格力电器股份有限公司 | Method and device for processing uploaded pictures |
| CN110719327A (en) * | 2019-10-08 | 2020-01-21 | 珠海格力电器股份有限公司 | Interactive method and device for uploading image and storage medium |
| CN110838102A (en) * | 2019-10-24 | 2020-02-25 | 开望(杭州)科技有限公司 | Intelligent image uploading method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111327831B (en) | 2021-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2018415738B2 (en) | Photographing Mobile Terminal | |
| CN108712609A (en) | Focusing process method, apparatus, equipment and storage medium | |
| US7688379B2 (en) | Selecting quality images from multiple captured images | |
| CN112135046B (en) | Video shooting method, video shooting device and electronic equipment | |
| JP4807284B2 (en) | Camera device, camera device control program, and camera device control method | |
| CN108307120B (en) | Image shooting method and device and electronic terminal | |
| EP2858341B1 (en) | Information processing device, system, and storage medium | |
| KR20100138141A (en) | Method and apparatus for guiding composition, and digital photographing apparatus | |
| US11233949B2 (en) | Image capturing apparatus, control method for image capturing apparatus, and control program for image capturing apparatus | |
| JPWO2013183338A1 (en) | Information processing apparatus and storage medium | |
| CN106161970B (en) | A kind of image pickup method, device and mobile terminal | |
| US20130286249A1 (en) | Automatically capturing images that include lightning | |
| JP2006094082A (en) | Image photographing device, and program | |
| CN106488128B (en) | Automatic photographing method and device | |
| CN106961549B (en) | Shooting method and device based on double cameras | |
| JPWO2018235382A1 (en) | IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD, AND IMAGING DEVICE CONTROL PROGRAM | |
| CN112672055A (en) | Photographing method, device and equipment | |
| CN111327831B (en) | Image acquisition method and device for UGC, electronic equipment and system | |
| CN113873160B (en) | Image processing method, device, electronic equipment and computer storage medium | |
| CN107920210A (en) | Image capturing method, device and terminal | |
| CN112153291B (en) | Photographing method and electronic equipment | |
| US11012629B2 (en) | Image capturing apparatus, control method for image capturing apparatus, and control program for image capturing apparatus | |
| CN114189628A (en) | Control method and device of shooting function, AR device and storage medium | |
| CN112399092A (en) | Shooting method and device and electronic equipment | |
| CN108881636B (en) | Backlight mode automatic switching method and device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230626 Address after: 6001, 6th Floor, No.1 Kaifeng Road, Shangdi Information Industry Base, Haidian District, Beijing, 100085 Patentee after: Beijing Baige Feichi Technology Co.,Ltd. Address before: Room 4003, floor 4, No. 18, Shangdi Information Road, Haidian District, Beijing 100085 Patentee before: Beijing Zhimei Zhixue Technology Co.,Ltd. |