WO2019056242A1 - Camera photographing parameter setting method for smart terminal, setting device, and smart terminal - Google Patents

Camera photographing parameter setting method for smart terminal, setting device, and smart terminal Download PDF

Info

Publication number
WO2019056242A1
WO2019056242A1 PCT/CN2017/102592 CN2017102592W WO2019056242A1 WO 2019056242 A1 WO2019056242 A1 WO 2019056242A1 CN 2017102592 W CN2017102592 W CN 2017102592W WO 2019056242 A1 WO2019056242 A1 WO 2019056242A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
parameter
layer
preview
parameter setting
Prior art date
Application number
PCT/CN2017/102592
Other languages
French (fr)
Chinese (zh)
Inventor
张学熙
Original Assignee
深圳传音通讯有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳传音通讯有限公司 filed Critical 深圳传音通讯有限公司
Priority to PCT/CN2017/102592 priority Critical patent/WO2019056242A1/en
Publication of WO2019056242A1 publication Critical patent/WO2019056242A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules

Definitions

  • the invention relates to a camera shooting parameter setting method, a setting device and an intelligent terminal of an intelligent terminal.
  • Photographing is also a handprint of civilization.
  • Photography is the crystallization of the natural convergence between natural science and social science. It is a visual means of understanding, understanding and reflecting social reality. It is an art form with aesthetic value and a perfect combination of science and art.
  • the photographer brings beautiful enjoyment to the viewer, so that the viewer truly gets the satisfaction of the soul.
  • photography is not just about playing with the camera, but a comprehensive process that includes applied science, imagination and design, professional skills and organizational skills.
  • the camera is one of the basic applications in the smart phone. It is not only convenient and quick to take pictures with the smart phone camera, but also the image quality of the smart phone camera is better. At present, whether it is an android phone or a hot ios phone, its camera camera function is very important in the mobile phone, and it is also the most attractive place for customers.
  • a variety of mobile phone applications are emerging one after another.
  • the smart phone app for taking photos is even more spectacular. The most famous ones are such as the US.
  • These third-party applications are based on the three modes of preview, photo and video of the camera itself. Third-party camera functions such as eye pattern recognition, night shot lighting, panorama, and beauty have greatly satisfied the needs of users.
  • the camera application layer issues a preview instruction or a take picture, and the preview instruction is transmitted to the hardware abstraction layer through the camera frame layer and the camera server module;
  • the image management module of the image signal processing module uses the default camera parameters
  • the hardware abstraction layer calls the camera hardware layer through the camera driver layer to acquire image data according to the currently set camera parameters, and the hardware abstraction layer transmits the preview image to the camera application layer through the preview server data channel module through the preview data control channel module. display.
  • the current mainstream camera shooting parameter setting is to solidify the entire calibration scheme into the system layer of the device after the parameters of the camera shooting are completed in the system development environment. It is impossible to re-edit the camera shooting parameters that have been solidified in this way. If you need to modify the camera shooting parameters, you need to re-create the device system firmware, which leads to the inconvenience of system development, debugging, and optimization, which affects the camera calibration. effectiveness. At the same time, the inflexible camera shooting parameter modification method will also affect the use and upgrade experience of the camera itself. In addition, in the specific user application scenario, the general camera calibration scheme may not achieve a good shooting effect, and the camera provided by the smart terminal may not be able to achieve a good shooting effect.
  • the camera preview and camera effect parameters used by these enhancements in the function are the same as the camera preview and camera effect parameters of the basic camera function, which results in the optimal preview of the camera preview and camera effect of the basic camera function.
  • the effect of the enhanced function may not be optimal, so that the effect of the enhanced function is limited, and the maximum display cannot be performed, which affects the photographing effect and reduces the user experience.
  • the invention provides an imaging parameter setting method, a setting device and an intelligent terminal of an intelligent terminal, which adjusts the imaging parameters for different imaging functions, and displays the effect of the parameter adjustment in real time during the previewing process, thereby improving the shooting effect. Improved user experience.
  • the present invention provides a method for setting an imaging parameter of a smart terminal, which comprises the following steps:
  • the hardware abstraction layer receives the preview instruction or the shooting instruction issued by the camera application layer, and the camera application layer turns on the camera enhancement function, and the hardware abstraction layer calls the parameter setting function in the preview data control channel module to create a camera parameter setting interface, the camera parameter.
  • the setting interface transmits an enhanced function enable signal to the parameter management module in the image signal processing module in the camera hardware layer, and the parameter management module adjusts and modifies the camera parameter corresponding to the camera enhancement function according to the enhanced function enable signal, Get the best preview and shooting results.
  • the hardware abstraction layer receives a preview command or a shooting instruction issued by the camera application layer, and the camera application layer does not turn on the camera enhancement function, and the parameter management module in the image signal processing module in the camera hardware layer uses the default camera parameters for previewing and shooting. .
  • the camera enhancement functions include, but are not limited to, the following functions: night shot, panorama, and beauty.
  • the camera parameter setting interface is configured to set and acquire an automatic exposure parameter, an auto focus parameter, and an automatic white balance parameter.
  • the imaging parameters include, but are not limited to, automatic exposure parameters, auto focus parameters, auto white balance parameters, sensitivity parameters, aperture parameters, shutter parameters, exposure parameters, contrast parameters, saturation parameters, brightness noise reduction parameters, color Noise reduction parameters.
  • the invention also provides an imaging parameter setting device of the intelligent terminal, comprising:
  • a camera application layer for transmitting a preview instruction or a shooting instruction, and displaying a preview image and a captured image
  • a camera frame layer for providing an application interface to a camera application layer
  • Binder inter-process communication module for providing a communication interface between a camera framework layer and a camera server module
  • a camera server module for providing a camera hardware layer operation interface
  • a hardware abstraction layer having a camera parameter setting interface for transmitting a camera enhancement function enable signal
  • a camera driver layer for driving a camera hardware layer
  • the image signal processing module in the camera hardware layer has a parameter management module for adjusting and modifying the corresponding camera enhancement function according to the camera enhancement function enable signal Like parameters.
  • the invention also provides an intelligent terminal, which comprises the camera parameter setting device.
  • the invention adjusts the camera parameters for different camera functions, and displays the effect of the parameter adjustment in real time during the preview process, thereby improving the shooting effect and improving the user experience.
  • FIG. 1 is a flowchart of a method for setting an imaging parameter of a camera function provided on a smart terminal in the background art.
  • FIG. 2 is a schematic structural view of a camera system.
  • FIG. 3 is a flowchart of a method for setting an imaging parameter of a smart terminal according to the present invention.
  • FIG. 4 is a schematic structural diagram of an imaging parameter setting apparatus of a smart terminal according to the present invention.
  • the camera system adopts the C/S mode.
  • the client and the server only two processes exist, that is, the client and the server, and the client and the server communicate between the Binder processes.
  • the camera system includes a camera application layer, a camera frame layer, a Binder interprocess communication module, a camera server module, a hardware abstraction layer, a camera driver layer, and a camera hardware layer.
  • the client includes a camera application layer and a camera framework layer
  • the server includes a camera server module and a hardware abstraction layer.
  • the code of the camera frame layer is run on the client side
  • the code of the camera server module and the interface of the hardware abstraction layer HAL include the implementation code running on the server side.
  • you can also know that the camera service is not a separate process, but a module in the Media Server process.
  • the camera framework layer is used to provide a basic camera function implementation for application development, and generally provides an interface in the form of a standard Android SDK. Since the camera system framework is entirely in C/S mode, this layer acts as a client. As a camera client, all that must be done is to communicate with the server. The way of this communication is not fixed. The specific version depends on the version released by Android, but in general it is Binder interprocess communication.
  • the camera framework layer includes the Camera API (Application Programming Interface), which can Provides an effective application development interface for camera development, packaging operations on camera devices, enabling communication with camera modules for a simple camera client.
  • the Binder interprocess communication module is a channel for implementing the camera client and the server. The channel between them is bidirectional. The client uses this module to call the server function. The server also uses this module to complete the notification to the client. The responsibility of the Binder interprocess communication module is to provide the required programming interfaces to both ends by using the interprocess communication mechanism. His function is to realize the camera function call across processes, which is a bridge to realize the C/S mode of the camera system.
  • the camera server module is a module that manages and uses camera functions.
  • the camera server module is a background service that is hosted in the Media Server process and provides an interface for the client to operate the camera. Since the characteristics of the camera are exclusive hardware devices, the real owner of the camera should be the server rather than the client. The client can only operate the camera device through the server. Parameters and other information should be saved on the server. Since the characteristics of the server are to allow multiple clients to be connected at the same time, whether the specific server can support the specific implementation, and whether the detailed features of multiple cameras can be used at the same time depends on the specific implementation.
  • the definition of the camera server module is just the ability to manage the camera and provide camera operations for the client. This capability will vary depending on the version released by Android.
  • the hardware abstraction layer is the underlying system, which can encapsulate the operation interface of the hardware device camera of the system, provide an interface upward, and shield the implementation details of the underlying layer.
  • the hardware abstraction layer completely separates the system software from the hardware, which makes the system's device driver independent of the hardware device, thus greatly improving the system's portability. From the perspective of hardware and software testing, the testing of hardware and software can be done separately based on the hardware abstraction layer, making parallel testing of software and hardware possible.
  • the abstraction layer should generally contain the initialization of the relevant hardware, the input of the data / Output operations, configuration operations of hardware devices, and other functions.
  • the camera hardware layer is a camera module CCM (Camera Compact Module), and the CCM includes a lens group (Lens), a camera sensor (Camera sensor), an image signal processing module ISP (Image Signal Processing), a soft board (FPC), and an image processing chip ( DSP).
  • the lens is the soul of the camera. The lens plays an important role in the imaging effect. Using the refraction principle of the lens, the scene light passes through the lens to form a clear image on the focal plane.
  • the sensor is the core module of CCM, and there are two widely used ones: one is a CCD charge-coupled original and the other is a CMOS complementary metal-oxide-semiconductor device.
  • Image Signal Processing Module is mainly responsible for processing preview data, controlling exposure parameters (3A), with several buffers, pre-processing, preview enhancement ( Preview enhancement), post-processing, etc.
  • the main function of the image signal processing module ISP is to post-process the signal output from the front-end sensor.
  • the main functions include linear correction, noise removal, dead point removal, interpolation, white balance, automatic exposure control, etc., depending on the ISP to be in different optics. Under the conditions, the scene details can be better restored, and the ISP technology largely determines the imaging quality of the camera. It is divided into two forms, independent and integrated.
  • a mobile phone equipped with a separate ISP has a greater advantage in image processing, and with the increase of the pixel of the mobile phone camera, high-speed continuous shooting, full HD or even 4K recording, the processing performance requirements of the mobile phone to the ISP are coming. The higher.
  • Many manufacturers with the main shooting function have added independent ISPs to their mobile phones. For example, Meizu MX3 has adopted Fujitsu's four-channel ISP. The official claims that its transmission speed has doubled, and it can perfectly achieve 25 continuous shots per second, making it excellent. The image processing capability and comprehensive shooting performance have been greatly improved compared to the MX2.
  • the MeituKiss mobile phone, featuring the self-timer function is the first to have a separate ISP chip for the front camera worldwide.
  • FPC flexible circuit board also known as flexible circuit board, is used to connect chips and mobile phones for electrical signal transmission.
  • the image processing chip DSP is an important part of CCM. It converts the data obtained by the photosensitive sensor into standard GRB, YUV and other image signals, and transmits them to the central processor and refreshes the sensor in time.
  • the Android system Take the Android system as an example to illustrate the camera photographing process:
  • the camera application layer when running the camera application, as shown in Figure 2, the camera application layer, camera frame layer, camera server module, hardware abstraction layer, camera driver layer and camera are generally required. Interact between hardware layers.
  • the camera application layer issues a corresponding shooting instruction (take The picture command) is transmitted to the hardware abstraction layer via the camera frame layer and the camera server module.
  • take The picture command is transmitted to the hardware abstraction layer via the camera frame layer and the camera server module.
  • the hardware abstraction layer receives the shooting instruction, the camera module is called to take a photo, and the camera driver layer saves the image data collected by the camera module.
  • the hardware abstraction layer of the mobile terminal acquires image data collected by the camera module from the camera driver layer, and transmits the image data to the camera application layer via the camera server module and the camera frame layer, and the camera application layer generates the image data according to the image data. And display the corresponding picture.
  • the present invention provides a method for setting an imaging parameter of a smart terminal.
  • the hardware abstraction layer receives a preview instruction or a shooting instruction issued by the camera application layer, and the camera application layer turns on the camera enhancement function
  • the hardware abstraction layer calls the preview data.
  • the parameter setting function in the control channel module creates a camera parameter setting interface
  • the camera parameter setting interface transmits an enhanced function enable signal to the parameter management module in the image signal processing module in the camera hardware layer, and the parameter management module makes the enhanced function according to the enhanced function.
  • the signal can adjust and modify the camera parameters corresponding to the camera enhancement function to obtain the best preview and shooting effect; and when the hardware abstraction layer receives the preview command or shooting instruction issued by the camera application layer, and the camera application layer is not turned on.
  • the parameter management module in the image signal processing module in the camera hardware layer uses the default camera parameters for previewing and shooting.
  • the present invention provides a method for setting an imaging parameter of an intelligent terminal, which specifically includes the following steps:
  • Step S1 The camera application layer issues a preview instruction or a take picture, and the preview instruction or the shooting instruction is transmitted to the hardware abstraction layer through the camera frame layer and the camera server module;
  • Step S2 the hardware abstraction layer calls the parameter setting function in the preview data control channel module to create a camera parameter setting interface
  • Step S3 the camera server module determines whether the camera application layer has selected the camera enhancement function, and if so, proceeds to step S4, and if not, proceeds to step S7;
  • Step S4 the camera parameter setting interface transmits an enable signal to the parameter management module in the image signal processing module ISP in the camera hardware layer, the enable signal indicates that its corresponding camera enhancement function has been enabled, proceed to step S5;
  • Step S5 the parameter management module determines whether an enable signal is received, and if so, proceeds to step S6, and if not, proceeds to step S7;
  • Step S6 the parameter management module determines the enabled camera enhancement function according to the enable signal, and adjusts and modifies the camera parameters corresponding to the camera enhancement function to obtain an optimal preview effect, and proceeds to step S8;
  • Step S7 the parameter management module uses the default camera parameters, step S8;
  • Step S8 the hardware abstraction layer calls the camera hardware layer through the camera driver layer to acquire image data according to the currently set camera parameters, and the hardware abstraction layer transmits the preview image to the camera application layer through the camera server module and the camera frame layer through the preview data control channel module. Display.
  • the camera parameter setting interface is used to set and acquire auto exposure parameters (Auto Exposure), auto focus parameters (Auto Focus), and auto white balance parameters (Auto White Balance).
  • Exposure is a physical quantity used to calculate the amount of light that reaches the camera from the scene. Using a camera to capture the lens CCD/CMOS is the only way to get a high-quality photo. Overexposed, the photo looks too bright, underexposed, and the photo looks too dark.
  • the shutter speed and aperture value can be controlled electronically or mechanically. In addition, in addition to the shutter speed and aperture value, you can control the exposure by changing the sensitivity of the camera.
  • Autofocus the camera captures more detail in the photo.
  • Autofocus is one of the key technologies in imaging systems and has a wide range of uses in camera imaging systems.
  • Conventional autofocus technology mostly uses the ranging method, that is, by measuring the object distance, and determining the image distance or focal length of the system by the lens equation to adjust the system to be in an accurate focus state.
  • autofocus technology has entered a new digital age. More and more autofocus methods are based on image processing theory to analyze and calculate image related information, and then according to the control strategy. Drive the motor and adjust the system to focus accurately.
  • the camera enhancement functions include, but are not limited to, the following functions: night shot, panorama, beauty, and the like.
  • the enable signals respectively correspond to different camera enhancement functions, for example, the night shot function corresponds to the night shot enable signal, the panorama function corresponds to the panorama enable signal, the beauty function corresponds to the beauty enable signal, and the like.
  • the imaging parameters include: automatic exposure parameter, auto focus parameter, auto white balance parameter, sensitivity parameter (ISO), aperture parameter, shutter parameter, exposure parameter, contrast parameter, saturation parameter, brightness noise reduction parameter (ANR) ), color noise reduction parameters (CCR) and so on.
  • ISO sensitivity parameter
  • ANR brightness noise reduction parameter
  • CCR color noise reduction parameters
  • the camera system is based on the MT6797 platform
  • the camera application layer issues a preview instruction
  • the preview instruction is transmitted to the hardware abstraction layer through the camera frame layer and the camera server module
  • the hardware abstraction layer calls the preview data control channel.
  • the parameter setting function setParameters in the module FlowControl creates a camera parameter setting interface IHal3A
  • the camera server module determines that the camera application layer selects the camera enhancement function
  • the camera parameter setting interface IHal3A manages the parameters in the image signal processing module ISP in the camera hardware layer.
  • the module IspTuningCustom transmits an enable signal
  • the parameter management module IspTuningCustom determines the enabled camera enhancement function according to the enable signal, and adjusts and modifies the camera parameters corresponding to the camera enhancement function
  • the hardware abstraction layer calls the camera hardware layer through the camera driver layer.
  • the image data is acquired according to the currently set camera parameters
  • the hardware abstraction layer transmits the preview image to the camera application layer through the preview server control channel module to the camera application layer for display.
  • the camera application layer issues a preview or take picture
  • the preview instruction or shooting instruction is transmitted to the hardware abstraction layer through the camera frame layer and the camera server module, and the camera application layer
  • the parameter management module in the image signal processing module ISP in the camera hardware layer uses the default camera parameters
  • the hardware abstraction layer calls the camera hardware layer through the camera driver layer to acquire image data according to the currently set camera parameters, hardware.
  • the abstraction layer displays the preview image through the preview data control channel module to the camera application layer through the camera server module and camera frame layer for display.
  • the camera application layer issues a preview or take picture
  • the preview instruction or shooting instruction is transmitted to the hardware abstraction layer through the camera frame layer and the camera server module, and the camera service
  • the end module determines that the camera application layer selects the night shot function
  • the hardware abstraction layer calls the parameter setting function in the preview data control channel module to create a camera parameter setting interface
  • the camera parameter setting interface is directed to the image signal processing module ISP in the camera hardware layer.
  • the parameter management module transmits a night shot enable signal indicating that the corresponding camera night shot function has been enabled, and the parameter management module adjusts and modifies the camera parameters corresponding to the camera night shot function to obtain the best Preview effect, the hardware abstraction layer calls the camera hardware layer through the camera driver layer to obtain image data according to the currently set camera parameters, and the hardware abstraction layer transmits the preview image to the camera application layer through the preview server data channel module through the preview data control channel module. Display.
  • the parameter management module receives a night shot enable signal.
  • the parameter management module adjusts and modifies the camera parameters involved in the night shot enhancement function. For night scenes, it is usually necessary to pay attention to the following:
  • Use the manual exposure mode first measure the aperture value and sensitivity with the aperture priority mode. For example, use f/8, ISO200, and the shutter speed given by the camera is 2 seconds. Then go to manual exposure mode, set the aperture to f/8, ISO 200 sensitivity, shutter speed 2 seconds, and take a test shot. Check the effect of the shot, and refer to the histogram to set the exposure parameters when necessary. If you feel the overall darkness, you will usually choose to extend the exposure time without increasing the aperture or increasing the sensitivity. This is because the camera is already mounted on a tripod. Modifying the shutter speed only affects the cumulative amount of light. If the aperture is increased, the depth of field will be lighter. Increasing the sensitivity will cause noise problems.
  • modify the white balance is to change the color of the photo. Shooting night scenes doesn't have to use automatic white balance. Many times you can change the white balance to make your photos look different. A cold white balance will make the city look like a science fiction, while a warm white balance will make the city look bustling. So you can try different white balance settings in the same scene.
  • shooting with different aperture shooting night scenes do not have to use a small aperture to shoot.
  • a small aperture such as f/8
  • a large aperture to shoot night scenes for example
  • slow shutter slow shutter is the same very fun and useful shooting skills. Shooting at slow shutter speeds at night allows you to shoot beautiful tracks, star tracks, light paintings, and even some light that is invisible to the naked eye.
  • the adjustment and setting of the camera parameters usually require setting the sensitivity higher and increasing the exposure time.
  • the camera's ISP obtains the current camera environment parameter
  • the target scene of the current photographing environment is determined.
  • the camera's current camera parameters are set using the parameter configuration initial value corresponding to the target scene, such as locking the sensitivity to ISO6000 (ISO).
  • ISO6000 Indicates the sensitivity
  • ISO6000 means the sensitivity value is 6000
  • close the OIS Optical Image Stabilizer
  • adjust the exposure time to find a reasonable amount of light to complete the photo, but the user deletes all the photos
  • the setting parameter adjustment strategy such as reducing the sensitivity to ISO2000 (ISO indicates sensitivity, ISO2000 indicates sensitivity value is 2000), while increasing the exposure time, continue to take pictures.
  • the camera application layer issues a preview or take picture
  • the preview instruction or shooting instruction is transmitted to the hardware abstraction layer through the camera frame layer and the camera server module
  • the camera service determines that the camera application layer selects the beauty function
  • the hardware abstraction layer calls the parameter setting function in the preview data control channel module to create a camera parameter setting interface, and the camera parameter setting interface to the image signal processing module ISP in the camera hardware layer
  • the parameter management module transmits a beauty enable signal indicating that the corresponding camera beauty function has been enabled, and the parameter management module adjusts and modifies the camera parameters corresponding to the camera beauty function to obtain the best Preview effect
  • the hardware abstraction layer calls the camera hardware layer through the camera driver layer to obtain image data according to the currently set camera parameters
  • the hardware abstraction layer transmits the preview image to the camera application layer through the preview server data channel module through the preview data control channel module. Display.
  • the parameter management module receives a beauty enable signal.
  • the parameter management module adjusts and modifies the camera parameters involved in the beauty enhancement function, usually for exposure, contrast, saturation, sharpening, highlights, shadows, color temperature, hue, vignetting, grain, shadow tones, highlights Adjust the parameters.
  • the present invention further provides an imaging parameter setting device for an intelligent terminal, comprising:
  • a camera application layer 1 which is used to send a preview instruction or a shooting instruction, and display a preview image and a captured image;
  • a camera frame layer 2 for providing an application interface to a camera application layer
  • Binder inter-process communication module 3 configured to provide a communication interface between a camera framework layer and a camera server module
  • a camera server module 4 for providing a camera hardware layer operation interface
  • a hardware abstraction layer 5 having a camera parameter setting interface 501 for transmitting a camera enhancement function enable signal
  • a camera driver layer 6 for driving a camera hardware layer
  • the camera hardware layer 7 has a parameter management module 7011 in the image signal processing module 701 for adjusting and modifying the camera parameters of the corresponding camera enhancement function according to the camera enhancement function enable signal.
  • the present invention also provides an intelligent terminal, which can provide a shooting function, the intelligent terminal includes an imaging parameter setting device, and the imaging parameter setting device further includes:
  • a camera application layer for transmitting a preview instruction or a shooting instruction, and displaying a preview image and a captured image
  • a camera frame layer for providing an application interface to a camera application layer
  • Binder inter-process communication module for providing a communication interface between a camera framework layer and a camera server module
  • a camera server module for providing a camera hardware layer operation interface
  • a hardware abstraction layer having a camera parameter setting interface for transmitting a camera enhancement function enable signal
  • a camera driver layer for driving a camera hardware layer
  • a camera hardware layer having a parameter management module in an image signal processing module in the camera hardware layer A block for adjusting and modifying the camera parameters of the corresponding camera enhancement function according to the camera enhancement function enable signal.
  • the invention adjusts the camera parameters for different camera functions, and displays the effect of the parameter adjustment in real time during the preview process, thereby improving the shooting effect and improving the user experience.
  • the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better.
  • Implementation Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, can be embodied in the form of a software product that can be stored in a storage medium (such as ROM/RAM, disk).
  • the optical disc includes a plurality of instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method described in various embodiments of the present invention.

Abstract

A camera parameter setting method for a smart terminal, a setting device, and the smart terminal. A hardware abstraction layer receives a preview instruction or a photographing instruction issued by a camera application layer, and the camera application layer enables a camera enhancement function, then, the hardware abstraction layer calls a parameter setting function in a preview data control channel module to create one photographing parameter setting interface, the photographing parameter setting interface transmits one enhancement function enabling signal to a parameter management module in an image signal processing module in a camera hardware layer, the parameter management module adjusts and modifies a photographing parameter corresponding to the camera enhancement function on the basis of the enhancement function enabling signal, thus acquiring the optimal preview and photographing effects. The present invention adjusts the photographing parameter with respect to different photographing functions and displays in real-time during a preview process the effects when the parameter is adjusted, thus increasing photographing effects and enhancing user experience.

Description

一种智能终端的相机拍摄参数设置方法、设置装置及智能终端Camera shooting parameter setting method, setting device and intelligent terminal of intelligent terminal 技术领域Technical field
本发明涉及一种智能终端的相机拍摄参数设置方法、设置装置及智能终端。The invention relates to a camera shooting parameter setting method, a setting device and an intelligent terminal of an intelligent terminal.
背景技术Background technique
随着人们的生活水平不断提高,记录人生每一个瞬间已成为人们生活的重要组成部分,也是生活中不可或缺的一部分,摄影拍照亦是文明的手印。摄影是自然科学与社会科学自然交汇的结晶,是了解、认识、反映社会现实的形象化手段,是具有审美价值的艺术形式,是科学与艺术的完美结合。摄影者通过画面的构思、色调的均衡、场景的剪裁给观赏者带来美的享受,使观赏者真正得到心灵的满足。与此同时,通过对摄影器材的了解,我们可以接触到现代科学各个领域,拓宽知识范围,提高艺术修养。因此,摄影不仅仅是会摆弄照相机,而是一种包括应用科学、想象与设计、专业技巧和组织能力的综合过程。As people's living standards continue to improve, recording every moment of life has become an important part of people's lives, and an indispensable part of life. Photographing is also a handprint of civilization. Photography is the crystallization of the natural convergence between natural science and social science. It is a visual means of understanding, understanding and reflecting social reality. It is an art form with aesthetic value and a perfect combination of science and art. Through the conception of the picture, the balance of the tones, and the tailoring of the scene, the photographer brings beautiful enjoyment to the viewer, so that the viewer truly gets the satisfaction of the soul. At the same time, through the understanding of photographic equipment, we can reach out to all areas of modern science, broaden the scope of knowledge, and improve artistic accomplishment. Therefore, photography is not just about playing with the camera, but a comprehensive process that includes applied science, imagination and design, professional skills and organizational skills.
近年来,随着科技的发展,带拍摄功能的手机、平板电脑(PAD)等移动终端得到了广泛应用,而数码相机、智能手机、平板电脑等电子移动终端一般都具有拍照功能,满足了人们可以随时随地进行拍摄的需求。与此同时,人们对于移动终端所拍出来的图片的质量要求也越来越高,期望通过移动终端拍出高清图片。In recent years, with the development of technology, mobile terminals such as mobile phones and tablet computers (PADs) with shooting functions have been widely used, and electronic mobile terminals such as digital cameras, smart phones, and tablet computers generally have camera functions, which satisfy people. The need to shoot anytime, anywhere. At the same time, people have higher and higher requirements for the quality of pictures taken by mobile terminals, and it is expected to take high-definition pictures through mobile terminals.
相机是智能手机中的基础应用之一,使用智能手机相机拍照不仅方便快捷,而且智能手机相机的成像质量也较好。目前无论是android手机还是火热的ios手机,其相机camera功能在手机里是十分举足轻重的,也是最能吸引客户眼球的地方。现在五花八门的手机应用层出不穷,针对拍照的智能手机应用程序更是多如牛毛,最有名的诸如美拍,这些第三方应用以智能终端本身自带相机应用的预览、拍照、录像三种模式为基础,提供了如眼纹识别、夜拍提亮、全景、美颜等第三方相机功能,极大地满足了用户的需求。既然 这些第三方应用都必须基于智能终端本身自带的相机应用来实现,受此启发,智能终端自带的相机功能中也相继开发出了很多增强功能,如全景、美颜、夜拍等等,也完全能够满足用户的需求,并且由于可以在移动终端锁屏的时候直接进入自带的相机功能,因此使用移动终端自带的相机功能会比使用第三方相机应用更加便捷。The camera is one of the basic applications in the smart phone. It is not only convenient and quick to take pictures with the smart phone camera, but also the image quality of the smart phone camera is better. At present, whether it is an android phone or a hot ios phone, its camera camera function is very important in the mobile phone, and it is also the most attractive place for customers. Nowadays, a variety of mobile phone applications are emerging one after another. The smart phone app for taking photos is even more fascinating. The most famous ones are such as the US. These third-party applications are based on the three modes of preview, photo and video of the camera itself. Third-party camera functions such as eye pattern recognition, night shot lighting, panorama, and beauty have greatly satisfied the needs of users. Since These third-party applications must be implemented based on the camera application that comes with the smart terminal itself. Inspired by this, the camera functions of the smart terminal have also developed a number of enhancements, such as panorama, beauty, night shot, etc. It can also fully meet the needs of users, and since it can directly enter the camera function when the mobile terminal locks the screen, it is more convenient to use the camera function that comes with the mobile terminal than to use the third-party camera application.
如图1所示,是目前智能终端上自带的相机功能的相机拍摄参数设置方法:As shown in Figure 1, it is the camera shooting parameter setting method of the camera function that comes with the smart terminal:
1、相机应用层发出预览指令(preview)或拍摄指令(take picture),该预览指令通过相机框架层和相机服务端模块传输至硬件抽象层;1. The camera application layer issues a preview instruction or a take picture, and the preview instruction is transmitted to the hardware abstraction layer through the camera frame layer and the camera server module;
2、图像信号处理模块ISP中的参数管理模块使用默认的摄像参数;2. The image management module of the image signal processing module uses the default camera parameters;
3、硬件抽象层通过相机驱动层调用相机硬件层按照当前设置的摄像参数获取图像数据,硬件抽象层通过预览数据控制通道模块将预览图像通过相机服务端模块和相机框架层传输至相机应用层进行显示。3. The hardware abstraction layer calls the camera hardware layer through the camera driver layer to acquire image data according to the currently set camera parameters, and the hardware abstraction layer transmits the preview image to the camera application layer through the preview server data channel module through the preview data control channel module. display.
可以看出,当前主流通用的相机拍摄参数设置,是在系统开发环境下将各影响相机拍摄的参数设置完成后,将整个调校方案固化制作到设备的系统层中。无法对通过这种方式固化后的相机拍摄参数进行再编辑,如果需要对相机拍摄参数进行修改,则需要重新制作设备系统固件,导致系统开发、调试、优化的不便利性,影响相机的调校效率。同时不灵活的相机拍摄参数修改方式也会影响相机本身的使用和升级体验;此外,在具体用户应用场景下,通用的相机调校方案可能无法达到较好的拍摄效果,智能终端自带的相机功能中这些增强功能使用的摄像预览和拍照效果参数与基本相机功能的摄像预览和拍照效果参数是相同的,这样一来,会导致在基本相机功能的摄像预览和拍照效果是最佳状态时,增强功能的效果却未必能达到最佳效果,从而使增强功能的效果受到限制,不能得到最大程度的展示,影响了拍照效果,降低了用户体验。It can be seen that the current mainstream camera shooting parameter setting is to solidify the entire calibration scheme into the system layer of the device after the parameters of the camera shooting are completed in the system development environment. It is impossible to re-edit the camera shooting parameters that have been solidified in this way. If you need to modify the camera shooting parameters, you need to re-create the device system firmware, which leads to the inconvenience of system development, debugging, and optimization, which affects the camera calibration. effectiveness. At the same time, the inflexible camera shooting parameter modification method will also affect the use and upgrade experience of the camera itself. In addition, in the specific user application scenario, the general camera calibration scheme may not achieve a good shooting effect, and the camera provided by the smart terminal may not be able to achieve a good shooting effect. The camera preview and camera effect parameters used by these enhancements in the function are the same as the camera preview and camera effect parameters of the basic camera function, which results in the optimal preview of the camera preview and camera effect of the basic camera function. The effect of the enhanced function may not be optimal, so that the effect of the enhanced function is limited, and the maximum display cannot be performed, which affects the photographing effect and reduces the user experience.
发明的公开Disclosure of invention
本发明提供一种智能终端的摄像参数设置方法、设置装置及智能终端,针对不同的摄像功能对摄像参数进行调整,并在预览过程中将参数调整后的效果实时显示出来,提高了拍摄效果,提升了用户体验。 The invention provides an imaging parameter setting method, a setting device and an intelligent terminal of an intelligent terminal, which adjusts the imaging parameters for different imaging functions, and displays the effect of the parameter adjustment in real time during the previewing process, thereby improving the shooting effect. Improved user experience.
为了达到上述目的,本发明提供一种智能终端的摄像参数设置方法,其特征在于,包含以下步骤:In order to achieve the above object, the present invention provides a method for setting an imaging parameter of a smart terminal, which comprises the following steps:
硬件抽象层接收到相机应用层发出的预览指令或拍摄指令,且相机应用层开启了相机增强功能,则硬件抽象层调用预览数据控制通道模块中的参数设置函数创建一个摄像参数设置接口,摄像参数设置接口向相机硬件层中的图像信号处理模块中的参数管理模块传输一个增强功能使能信号,参数管理模块根据该增强功能使能信号对该相机增强功能对应的摄像参数进行调整和修改,以获得最佳的预览和拍摄效果。The hardware abstraction layer receives the preview instruction or the shooting instruction issued by the camera application layer, and the camera application layer turns on the camera enhancement function, and the hardware abstraction layer calls the parameter setting function in the preview data control channel module to create a camera parameter setting interface, the camera parameter. The setting interface transmits an enhanced function enable signal to the parameter management module in the image signal processing module in the camera hardware layer, and the parameter management module adjusts and modifies the camera parameter corresponding to the camera enhancement function according to the enhanced function enable signal, Get the best preview and shooting results.
硬件抽象层接收到相机应用层发出的预览指令或拍摄指令,且相机应用层未开启相机增强功能,则相机硬件层中的图像信号处理模块中的参数管理模块使用默认的摄像参数进行预览和拍摄。The hardware abstraction layer receives a preview command or a shooting instruction issued by the camera application layer, and the camera application layer does not turn on the camera enhancement function, and the parameter management module in the image signal processing module in the camera hardware layer uses the default camera parameters for previewing and shooting. .
所述的相机增强功能包含但不限于以下功能:夜拍、全景、美颜。The camera enhancement functions include, but are not limited to, the following functions: night shot, panorama, and beauty.
不同的相机增强功能分别对应不同的使能信号。Different camera enhancements correspond to different enable signals.
所述的摄像参数设置接口用于设置和获取自动曝光参数、自动聚焦参数和自动白平衡参数。The camera parameter setting interface is configured to set and acquire an automatic exposure parameter, an auto focus parameter, and an automatic white balance parameter.
所述的摄像参数包含但不限于:自动曝光参数、自动聚焦参数、自动白平衡参数、感光度参数、光圈参数、快门参数、曝光度参数、对比度参数、饱和度参数、亮度降噪参数、彩色降噪参数。The imaging parameters include, but are not limited to, automatic exposure parameters, auto focus parameters, auto white balance parameters, sensitivity parameters, aperture parameters, shutter parameters, exposure parameters, contrast parameters, saturation parameters, brightness noise reduction parameters, color Noise reduction parameters.
本发明还提供一种智能终端的摄像参数设置装置,包含:The invention also provides an imaging parameter setting device of the intelligent terminal, comprising:
相机应用层,其用于发送预览指令或拍摄指令,并显示预览图像和拍摄图像;a camera application layer for transmitting a preview instruction or a shooting instruction, and displaying a preview image and a captured image;
相机框架层,其用于为相机应用层提供应用接口;a camera frame layer for providing an application interface to a camera application layer;
Binder进程间通信模块,其用于提供相机框架层和相机服务端模块之间的通信接口;a Binder inter-process communication module for providing a communication interface between a camera framework layer and a camera server module;
相机服务端模块,其用于提供相机硬件层操作接口;a camera server module for providing a camera hardware layer operation interface;
硬件抽象层,该硬件抽象层中具有摄像参数设置接口,用于传输相机增强功能使能信号;a hardware abstraction layer having a camera parameter setting interface for transmitting a camera enhancement function enable signal;
相机驱动层,其用于驱动相机硬件层;a camera driver layer for driving a camera hardware layer;
相机硬件层,该相机硬件层中的图像信号处理模块中具有参数管理模块,用于根据相机增强功能使能信号来调整和修改对应的相机增强功能的摄 像参数。a camera hardware layer, the image signal processing module in the camera hardware layer has a parameter management module for adjusting and modifying the corresponding camera enhancement function according to the camera enhancement function enable signal Like parameters.
本发明还提供一种智能终端,该智能终端包含所述的摄像参数设置装置。The invention also provides an intelligent terminal, which comprises the camera parameter setting device.
本发明针对不同的摄像功能对摄像参数进行调整,并在预览过程中将参数调整后的效果实时显示出来,提高了拍摄效果,提升了用户体验。The invention adjusts the camera parameters for different camera functions, and displays the effect of the parameter adjustment in real time during the preview process, thereby improving the shooting effect and improving the user experience.
附图的简要说明BRIEF DESCRIPTION OF THE DRAWINGS
图1是背景技术中智能终端上自带的相机功能的摄像参数设置方法的流程图。FIG. 1 is a flowchart of a method for setting an imaging parameter of a camera function provided on a smart terminal in the background art.
图2是相机系统的结构示意图。2 is a schematic structural view of a camera system.
图3是本发明提供的一种智能终端的摄像参数设置方法的流程图。FIG. 3 is a flowchart of a method for setting an imaging parameter of a smart terminal according to the present invention.
图4是本发明提供的一种智能终端的摄像参数设置装置的结构示意图。FIG. 4 is a schematic structural diagram of an imaging parameter setting apparatus of a smart terminal according to the present invention.
实现本发明的最佳方式The best way to implement the invention
以下根据图2~图4,具体说明本发明的较佳实施例。DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be specifically described with reference to Figs. 2 to 4 .
以Android系统为例,相机系统采用的是C/S模式,在相机系统中其实只有2个进程存在,即客户端和服务端,客户端和服务端之间是通过Binder进程间通信的。Taking the Android system as an example, the camera system adopts the C/S mode. In the camera system, only two processes exist, that is, the client and the server, and the client and the server communicate between the Binder processes.
如图2所示,相机系统包含相机应用层,相机框架层,Binder进程间通信模块,相机服务端模块、硬件抽象层、相机驱动层和相机硬件层。客户端包含相机应用层和相机框架层,服务端包含相机服务端模块和硬件抽象层。相机框架层的代码是运行在客户端的,而相机服务端模块的代码和硬件抽象层HAL的接口包括实现代码都是运行在服务端的。而且从服务端中还能知道,相机服务不是一个单独的进程,而是媒体服务(Media Server)进程中的一个模块而已。As shown in FIG. 2, the camera system includes a camera application layer, a camera frame layer, a Binder interprocess communication module, a camera server module, a hardware abstraction layer, a camera driver layer, and a camera hardware layer. The client includes a camera application layer and a camera framework layer, and the server includes a camera server module and a hardware abstraction layer. The code of the camera frame layer is run on the client side, and the code of the camera server module and the interface of the hardware abstraction layer HAL include the implementation code running on the server side. And from the server, you can also know that the camera service is not a separate process, but a module in the Media Server process.
相机框架层用于向上给应用程序开发提供基础的相机功能实现,一般以标准的Android SDK形式提供接口。由于相机系统框架整体采用的是C/S模式,因此,这一层就充当成客户端的角色。作为相机客户端,必须要做的就是与服务器端通信,这种通信的方式是没有固定的,具体的还是要看Android发布的版本,但是一般来说肯定用的是Binder进程间通信。相机框架层包含有Camera API(Application Programming Interface,应用程序编程接口),能 够提供一套有效的应用程序开发接口,用于相机开发,封装对相机设备的操作,实现与相机模块的通讯,实现简单的相机客户端。The camera framework layer is used to provide a basic camera function implementation for application development, and generally provides an interface in the form of a standard Android SDK. Since the camera system framework is entirely in C/S mode, this layer acts as a client. As a camera client, all that must be done is to communicate with the server. The way of this communication is not fixed. The specific version depends on the version released by Android, but in general it is Binder interprocess communication. The camera framework layer includes the Camera API (Application Programming Interface), which can Provides an effective application development interface for camera development, packaging operations on camera devices, enabling communication with camera modules for a simple camera client.
Binder进程间通信模块是实现相机客户端与服务器端的通道,他们之间的通道是双向的,客户端利用此模块调用服务器的功能,同样服务器端也会使用此模块完成对客户端的通知。Binder进程间通信模块的职责是,利用进程间通信机制向两端提供各自需要的编程接口。他的功能是实现跨进程的相机功能调用,是实现相机系统C/S模式的桥梁。The Binder interprocess communication module is a channel for implementing the camera client and the server. The channel between them is bidirectional. The client uses this module to call the server function. The server also uses this module to complete the notification to the client. The responsibility of the Binder interprocess communication module is to provide the required programming interfaces to both ends by using the interprocess communication mechanism. His function is to realize the camera function call across processes, which is a bridge to realize the C/S mode of the camera system.
相机服务端模块是管理和使用相机功能的模块,相机服务端模块是一个后台服务,寄宿在Media Server进程中,提供用于客户端操作相机的接口。由于摄像头的特性是属于独占性的硬件设备,因此摄像头的真正拥有者应该是服务端而非客户端,客户端仅能够通过服务端操作相机设备而已,参数等信息都应该保存在服务端。由于服务端的特性是允许同时连接多个客户端,因此具体服务端能否支持需要依靠具体的实现,还有能否同时使用多个摄像头等这些详细的特性也是需要依靠具体的实现。相机服务端模块的定义也仅仅只是管理相机和为客户端提供相机操作的能力,这个能力根据Android发布的版本不同也会有所变化。开发商可以根据需求修改服务端的能力,不过修改的力度必须遵从Google的兼容性定义,而且能保证CTS的通过。比如说,服务端的能力必须要确保同一个摄像头设备不能被多个客户端打开等。总括的来说,至少包含2块功能:1、以服务的形式管理相机设备,提供给客户端查询相机的能力,比如说,当前服务下面有多少个摄像头模组。2、打开摄像头,提供对摄像头模组操作的代理,通过访问硬件接口直接操作硬件模块。The camera server module is a module that manages and uses camera functions. The camera server module is a background service that is hosted in the Media Server process and provides an interface for the client to operate the camera. Since the characteristics of the camera are exclusive hardware devices, the real owner of the camera should be the server rather than the client. The client can only operate the camera device through the server. Parameters and other information should be saved on the server. Since the characteristics of the server are to allow multiple clients to be connected at the same time, whether the specific server can support the specific implementation, and whether the detailed features of multiple cameras can be used at the same time depends on the specific implementation. The definition of the camera server module is just the ability to manage the camera and provide camera operations for the client. This capability will vary depending on the version released by Android. Developers can modify the capabilities of the server as needed, but the strength of the changes must comply with Google's compatibility definitions and ensure the passage of CTS. For example, the ability of the server must ensure that the same camera device cannot be opened by multiple clients. In summary, there are at least two functions: 1. Manage the camera device in the form of a service, and provide the client with the ability to query the camera, for example, how many camera modules are under the current service. 2. Open the camera, provide a proxy for the operation of the camera module, and directly operate the hardware module by accessing the hardware interface.
硬件抽象层HAL(Hardware Abstraction Layer)即底层系统,可以是对系统的硬件设备摄像头操作接口的封装,向上提供接口,屏蔽底层的实现细节。硬件抽象层完全把系统软件和硬件部分隔离开来,这样就使得系统的设备驱动程序与硬件设备无关,从而大大提高了系统的可移植性。从软硬件测试角度来看,软硬件的测试工作都可分别基于硬件抽象层来完成,使得软硬件的测试工作的并行进行成为可能。在抽象层的定义方面,需要规定统一的软硬件接口标准,其设计工作需要基于系统需求来做,代码工作可由对硬件比较熟悉的人员来完成。抽象层一般应包含相关硬件的初始化、数据的输入/ 输出操作、硬件设备的配置操作等功能。The hardware abstraction layer (HAL) is the underlying system, which can encapsulate the operation interface of the hardware device camera of the system, provide an interface upward, and shield the implementation details of the underlying layer. The hardware abstraction layer completely separates the system software from the hardware, which makes the system's device driver independent of the hardware device, thus greatly improving the system's portability. From the perspective of hardware and software testing, the testing of hardware and software can be done separately based on the hardware abstraction layer, making parallel testing of software and hardware possible. In the definition of the abstraction layer, it is necessary to specify a unified hardware and software interface standard. The design work needs to be done based on the system requirements. The code work can be completed by personnel who are familiar with the hardware. The abstraction layer should generally contain the initialization of the relevant hardware, the input of the data / Output operations, configuration operations of hardware devices, and other functions.
相机硬件层为摄像头模组CCM(Camera Compact Module),CCM包含镜头组(Lens)、相机传感器(Camera sensor)、图像信号处理模块ISP(Image Signal Processing)、软板(FPC)和图像处理芯片(DSP)。镜头是相机的灵魂,镜头对成像的效果有很重要的作用,利用透镜的折射原理,景物光线通过镜头,在聚焦平面上形成清晰的影像。传感器是CCM的核心模块,目前广泛使用的有两种:一种是CCD电荷耦合原件,另一种CMOS互补金属氧化物半导体器件。图像信号处理模块ISP(Image Signal Processing),主要负责处理预览数据(Preview data),控制曝光参数(3A),并带有几个缓存(Buffer),做预处理(Pre-processing)、预览增强(Preview enhancement)、后处理(Post-processing)等。图像信号处理模块ISP主要作用是对前端传感器输出的信号做后期处理,主要功能有线性纠正、噪声去除、坏点去除、内插、白平衡、自动曝光控制等,依赖于ISP才能在不同的光学条件下都能较好的还原现场细节,ISP技术在很大程度上决定了摄像机的成像质量。它分为独立与集成两种形式。一般情况下,配备独立ISP的手机,在图像处理方面有更大的优势,且随着手机摄像头像素的提高,高速连拍,全高清甚至4K录制的加入,手机对ISP的处理性能要求越来越高。不少主打拍摄功能的厂商都在手机当中加入了独立ISP,例如魅族MX3就采用了富士通四通道ISP,官方宣称其传输速度提升两倍,能完美实现每秒25张连拍,使其拥有卓越的图像处理能力,综合拍摄性能相对于MX2来讲有了较大的进步。主打自拍功能的MeituKiss手机,在全球范围内首次为前置摄像头配置了独立ISP芯片。这款来自富士通的高端芯片有着出众的噪点和色彩还原能力,被广泛应用于数码相机等专业领域。FPC柔性电路板又称柔性线路板,用于连接芯片和手机,起到电信号传输作用。图像处理芯片DSP是CCM的重要组成部分,将感光传感器获得的数据转换成标准的GRB、YUV等格式图像信号,并及时快速的传递到中央处理器并刷新传感器。The camera hardware layer is a camera module CCM (Camera Compact Module), and the CCM includes a lens group (Lens), a camera sensor (Camera sensor), an image signal processing module ISP (Image Signal Processing), a soft board (FPC), and an image processing chip ( DSP). The lens is the soul of the camera. The lens plays an important role in the imaging effect. Using the refraction principle of the lens, the scene light passes through the lens to form a clear image on the focal plane. The sensor is the core module of CCM, and there are two widely used ones: one is a CCD charge-coupled original and the other is a CMOS complementary metal-oxide-semiconductor device. Image Signal Processing Module (ISP) is mainly responsible for processing preview data, controlling exposure parameters (3A), with several buffers, pre-processing, preview enhancement ( Preview enhancement), post-processing, etc. The main function of the image signal processing module ISP is to post-process the signal output from the front-end sensor. The main functions include linear correction, noise removal, dead point removal, interpolation, white balance, automatic exposure control, etc., depending on the ISP to be in different optics. Under the conditions, the scene details can be better restored, and the ISP technology largely determines the imaging quality of the camera. It is divided into two forms, independent and integrated. Under normal circumstances, a mobile phone equipped with a separate ISP has a greater advantage in image processing, and with the increase of the pixel of the mobile phone camera, high-speed continuous shooting, full HD or even 4K recording, the processing performance requirements of the mobile phone to the ISP are coming. The higher. Many manufacturers with the main shooting function have added independent ISPs to their mobile phones. For example, Meizu MX3 has adopted Fujitsu's four-channel ISP. The official claims that its transmission speed has doubled, and it can perfectly achieve 25 continuous shots per second, making it excellent. The image processing capability and comprehensive shooting performance have been greatly improved compared to the MX2. The MeituKiss mobile phone, featuring the self-timer function, is the first to have a separate ISP chip for the front camera worldwide. This high-end chip from Fujitsu has outstanding noise and color reproduction capabilities, and is widely used in professional fields such as digital cameras. FPC flexible circuit board, also known as flexible circuit board, is used to connect chips and mobile phones for electrical signal transmission. The image processing chip DSP is an important part of CCM. It converts the data obtained by the photosensitive sensor into standard GRB, YUV and other image signals, and transmits them to the central processor and refreshes the sensor in time.
以Android系统为例阐述相机拍照流程:在Android系统中,运行摄像头应用时,如图2所示,一般需要相机应用层、相机框架层、相机服务端模块、硬件抽象层、相机驱动层和相机硬件层之间进行交互。Take the Android system as an example to illustrate the camera photographing process: In the Android system, when running the camera application, as shown in Figure 2, the camera application layer, camera frame layer, camera server module, hardware abstraction layer, camera driver layer and camera are generally required. Interact between hardware layers.
当用户通过移动终端进行拍照时,相机应用层发出相应的拍摄指令(take  picture指令),该拍摄指令经由相机框架层和相机服务端模块传输至硬件抽象层。当硬件抽象层接收到该拍摄指令时,调用摄像头模组进行拍照,相机驱动层保存摄像头模组所采集的图像数据。When the user takes a photo through the mobile terminal, the camera application layer issues a corresponding shooting instruction (take The picture command) is transmitted to the hardware abstraction layer via the camera frame layer and the camera server module. When the hardware abstraction layer receives the shooting instruction, the camera module is called to take a photo, and the camera driver layer saves the image data collected by the camera module.
移动终端的硬件抽象层从相机驱动层获取到摄像头模组采集的图像数据,并将该图像数据经由相机服务端模块和相机框架层传输至相机应用层,由相机应用层根据该图像数据,生成并显示相应的图片。The hardware abstraction layer of the mobile terminal acquires image data collected by the camera module from the camera driver layer, and transmits the image data to the camera application layer via the camera server module and the camera frame layer, and the camera application layer generates the image data according to the image data. And display the corresponding picture.
在更加详细地讨论示例性实施例之前应当提到的是,一些示例性实施例被描述成作为流程图描绘的处理或方法。虽然流程图将各项步骤描述成顺序的处理,但是其中的许多步骤可以被并行地、并发地或者同时实施。此外,各项步骤的顺序可以被重新安排。当其步骤完成时所述处理可以被终止,但是还可以具有未包括在附图中的附加步骤。所述处理可以对应于方法、函数、规程、子例程、子程序等等。Before discussing the exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as a process or method depicted as a flowchart. Although the flowcharts describe the various steps as a sequential process, many of the steps can be implemented in parallel, concurrently or concurrently. In addition, the order of the steps can be rearranged. The process may be terminated when its steps are completed, but may also have additional steps not included in the figures. The processing may correspond to methods, functions, procedures, subroutines, subroutines, and the like.
在使用移动终端的相机功能时,为了能够将增强功能得到最大程度的展示,从而获得更好的拍摄效果,则要想办法让增强功能的参数设置能够被独立调整设置,而不是单纯地使用与相机基本功能一样的参数设置。When using the camera function of the mobile terminal, in order to maximize the enhancements and achieve better shooting results, it is necessary to make the parameter settings of the enhanced function be adjusted independently, instead of simply using The same basic parameter settings as the camera.
基于此,本发明提供一种智能终端的摄像参数设置方法,当硬件抽象层接收到相机应用层发出的预览指令或拍摄指令,且相机应用层开启了相机增强功能,则硬件抽象层调用预览数据控制通道模块中的参数设置函数创建一个摄像参数设置接口,摄像参数设置接口向相机硬件层中的图像信号处理模块中的参数管理模块传输一个增强功能使能信号,参数管理模块根据该增强功能使能信号对该相机增强功能对应的摄像参数进行调整和修改,以获得最佳的预览和拍摄效果;而当硬件抽象层接收到相机应用层发出的预览指令或拍摄指令,且相机应用层未开启相机增强功能,则相机硬件层中的图像信号处理模块中的参数管理模块使用默认的摄像参数进行预览和拍摄。Based on this, the present invention provides a method for setting an imaging parameter of a smart terminal. When the hardware abstraction layer receives a preview instruction or a shooting instruction issued by the camera application layer, and the camera application layer turns on the camera enhancement function, the hardware abstraction layer calls the preview data. The parameter setting function in the control channel module creates a camera parameter setting interface, and the camera parameter setting interface transmits an enhanced function enable signal to the parameter management module in the image signal processing module in the camera hardware layer, and the parameter management module makes the enhanced function according to the enhanced function. The signal can adjust and modify the camera parameters corresponding to the camera enhancement function to obtain the best preview and shooting effect; and when the hardware abstraction layer receives the preview command or shooting instruction issued by the camera application layer, and the camera application layer is not turned on. With the camera enhancement function, the parameter management module in the image signal processing module in the camera hardware layer uses the default camera parameters for previewing and shooting.
如图3所示,本发明提供一种智能终端的摄像参数设置方法,具体包含以下步骤:As shown in FIG. 3, the present invention provides a method for setting an imaging parameter of an intelligent terminal, which specifically includes the following steps:
步骤S1、相机应用层发出预览指令(preview)或拍摄指令(take picture),该预览指令或拍摄指令通过相机框架层和相机服务端模块传输至硬件抽象层;Step S1: The camera application layer issues a preview instruction or a take picture, and the preview instruction or the shooting instruction is transmitted to the hardware abstraction layer through the camera frame layer and the camera server module;
步骤S2、硬件抽象层调用预览数据控制通道模块中的参数设置函数创建 一个摄像参数设置接口;Step S2, the hardware abstraction layer calls the parameter setting function in the preview data control channel module to create a camera parameter setting interface;
步骤S3、相机服务端模块判断相机应用层是否选择了相机增强功能,若是,进行步骤S4,若否,进行步骤S7;Step S3, the camera server module determines whether the camera application layer has selected the camera enhancement function, and if so, proceeds to step S4, and if not, proceeds to step S7;
步骤S4、摄像参数设置接口向相机硬件层中的图像信号处理模块ISP中的参数管理模块传输一个使能信号,该使能信号表明其对应的相机增强功能已经被启用,进行步骤S5;Step S4, the camera parameter setting interface transmits an enable signal to the parameter management module in the image signal processing module ISP in the camera hardware layer, the enable signal indicates that its corresponding camera enhancement function has been enabled, proceed to step S5;
步骤S5、参数管理模块判断是否收到使能信号,若是,进行步骤S6,若否,进行步骤S7;Step S5, the parameter management module determines whether an enable signal is received, and if so, proceeds to step S6, and if not, proceeds to step S7;
步骤S6、参数管理模块根据使能信号确定被启用的相机增强功能,并对该相机增强功能对应的摄像参数进行调整和修改,以获得最佳的预览效果,进行步骤S8;Step S6, the parameter management module determines the enabled camera enhancement function according to the enable signal, and adjusts and modifies the camera parameters corresponding to the camera enhancement function to obtain an optimal preview effect, and proceeds to step S8;
步骤S7、参数管理模块使用默认的摄像参数,进行步骤S8;Step S7, the parameter management module uses the default camera parameters, step S8;
步骤S8、硬件抽象层通过相机驱动层调用相机硬件层按照当前设置的摄像参数获取图像数据,硬件抽象层通过预览数据控制通道模块将预览图像通过相机服务端模块和相机框架层传输至相机应用层进行显示。Step S8, the hardware abstraction layer calls the camera hardware layer through the camera driver layer to acquire image data according to the currently set camera parameters, and the hardware abstraction layer transmits the preview image to the camera application layer through the camera server module and the camera frame layer through the preview data control channel module. Display.
所述的摄像参数设置接口用于设置和获取自动曝光参数(Auto Exposure)、自动聚焦参数(Auto Focus)和自动白平衡参数(Auto White Balance)。The camera parameter setting interface is used to set and acquire auto exposure parameters (Auto Exposure), auto focus parameters (Auto Focus), and auto white balance parameters (Auto White Balance).
曝光是用来计算从景物到达相机光通量大小的物理量,利用相机拍摄是只有使感光芯片CCD/CMOS获得正确的曝光,才能获得高质量的照片。曝光过度,照片看起来就太亮,曝光不足,照片看起来就太暗。相机中,快门速度和光圈值大小既可以由电子控制也可以机械控制。另外,除了快门速度和光圈值,还可以通过改变相机的感光度来控制曝光。Exposure is a physical quantity used to calculate the amount of light that reaches the camera from the scene. Using a camera to capture the lens CCD/CMOS is the only way to get a high-quality photo. Overexposed, the photo looks too bright, underexposed, and the photo looks too dark. In the camera, the shutter speed and aperture value can be controlled electronically or mechanically. In addition, in addition to the shutter speed and aperture value, you can control the exposure by changing the sensitivity of the camera.
通过自动对焦,相机可以捕获到更多的照片细节,自动对焦是成像系统的关键技术之一,在相机成像系统中有着广泛的用途。传统的自动对焦技术较多采用测距法,即通过测出物距,由镜头方程求出系统的像距或焦距,来调整系统使之处于准确对焦的状态。随着现代计算技术的发展和数字图像处理理论的日益成熟,自动对焦技术进入一个新的数字时代,愈来愈多的自动对焦方法基于图像处理理论对图像有关信息进行分析计算,然后根据控制策略驱动电机,调节系统使之准确对焦。 With autofocus, the camera captures more detail in the photo. Autofocus is one of the key technologies in imaging systems and has a wide range of uses in camera imaging systems. Conventional autofocus technology mostly uses the ranging method, that is, by measuring the object distance, and determining the image distance or focal length of the system by the lens equation to adjust the system to be in an accurate focus state. With the development of modern computing technology and the growing maturity of digital image processing theory, autofocus technology has entered a new digital age. More and more autofocus methods are based on image processing theory to analyze and calculate image related information, and then according to the control strategy. Drive the motor and adjust the system to focus accurately.
在彩色图像获取过程中,同一景物在不同光照下,采集的图像颜色差别较大,因此寻求一个合适的颜色校正算法,将非标准光照条件下获得的彩色图像变换到标准光照下的彩色图像。对一幅数码图像用白平衡和彩色校正进行处理,可以保证它的彩色逼真度。数码相机是靠一列带有彩色滤波器的光探测器来检测和捕获图像的,不可能比人眼精确,所以就有必要对图像进行一些必要的处理和校正,以保证最终图像尽量逼真地再现景物的色彩。In the process of color image acquisition, the color of the acquired images is different under different illuminations. Therefore, a suitable color correction algorithm is sought to transform the color images obtained under non-standard illumination conditions into the color images under standard illumination. Handling a digital image with white balance and color correction ensures its color fidelity. Digital cameras rely on a series of light detectors with color filters to detect and capture images. It is impossible to be more accurate than the human eye. Therefore, it is necessary to perform some necessary processing and correction on the images to ensure that the final images are reproduced as faithfully as possible. The color of the scene.
所述的相机增强功能包含但不限于以下功能:夜拍、全景、美颜等。The camera enhancement functions include, but are not limited to, the following functions: night shot, panorama, beauty, and the like.
所述的使能信号分别对应不同的相机增强功能,例如:夜拍功能对应夜拍使能信号,全景功能对应全景使能信号,美颜功能对应美颜使能信号等等。The enable signals respectively correspond to different camera enhancement functions, for example, the night shot function corresponds to the night shot enable signal, the panorama function corresponds to the panorama enable signal, the beauty function corresponds to the beauty enable signal, and the like.
所述的摄像参数包含:自动曝光参数、自动聚焦参数、自动白平衡参数、感光度参数(ISO)、光圈参数、快门参数、曝光度参数、对比度参数、饱和度参数、亮度降噪参数(ANR)、彩色降噪参数(CCR)等等。The imaging parameters include: automatic exposure parameter, auto focus parameter, auto white balance parameter, sensitivity parameter (ISO), aperture parameter, shutter parameter, exposure parameter, contrast parameter, saturation parameter, brightness noise reduction parameter (ANR) ), color noise reduction parameters (CCR) and so on.
在本发明的一个实施例中,相机系统基于MT6797平台,相机应用层发出预览指令(preview)该预览指令通过相机框架层和相机服务端模块传输至硬件抽象层,硬件抽象层调用预览数据控制通道模块FlowControl中的参数设置函数setParameters创建一个摄像参数设置接口IHal3A,相机服务端模块判断相机应用层选择了相机增强功能,摄像参数设置接口IHal3A向相机硬件层中的图像信号处理模块ISP中的参数管理模块IspTuningCustom传输一个使能信号,参数管理模块IspTuningCustom根据使能信号确定被启用的相机增强功能,并对该相机增强功能对应的摄像参数进行调整和修改,硬件抽象层通过相机驱动层调用相机硬件层按照当前设置的摄像参数获取图像数据,硬件抽象层通过预览数据控制通道模块将预览图像通过相机服务端模块和相机框架层传输至相机应用层进行显示。In one embodiment of the present invention, the camera system is based on the MT6797 platform, the camera application layer issues a preview instruction, the preview instruction is transmitted to the hardware abstraction layer through the camera frame layer and the camera server module, and the hardware abstraction layer calls the preview data control channel. The parameter setting function setParameters in the module FlowControl creates a camera parameter setting interface IHal3A, the camera server module determines that the camera application layer selects the camera enhancement function, and the camera parameter setting interface IHal3A manages the parameters in the image signal processing module ISP in the camera hardware layer. The module IspTuningCustom transmits an enable signal, the parameter management module IspTuningCustom determines the enabled camera enhancement function according to the enable signal, and adjusts and modifies the camera parameters corresponding to the camera enhancement function, and the hardware abstraction layer calls the camera hardware layer through the camera driver layer. The image data is acquired according to the currently set camera parameters, and the hardware abstraction layer transmits the preview image to the camera application layer through the preview server control channel module to the camera application layer for display.
在本发明的一个实施例中,相机应用层发出预览指令(preview)或拍摄指令(take picture),该预览指令或拍摄指令通过相机框架层和相机服务端模块传输至硬件抽象层,相机应用层没有选择相机增强功能,则相机硬件层中的图像信号处理模块ISP中的参数管理模块使用默认的摄像参数,硬件抽象层通过相机驱动层调用相机硬件层按照当前设置的摄像参数获取图像数据,硬件抽象层通过预览数据控制通道模块将预览图像通过相机服务端模块和相机框架层传输至相机应用层进行显示。 In one embodiment of the present invention, the camera application layer issues a preview or take picture, and the preview instruction or shooting instruction is transmitted to the hardware abstraction layer through the camera frame layer and the camera server module, and the camera application layer If the camera enhancement function is not selected, the parameter management module in the image signal processing module ISP in the camera hardware layer uses the default camera parameters, and the hardware abstraction layer calls the camera hardware layer through the camera driver layer to acquire image data according to the currently set camera parameters, hardware. The abstraction layer displays the preview image through the preview data control channel module to the camera application layer through the camera server module and camera frame layer for display.
在本发明的另一个实施例中,相机应用层发出预览指令(preview)或拍摄指令(take picture),该预览指令或拍摄指令通过相机框架层和相机服务端模块传输至硬件抽象层,相机服务端模块判断相机应用层选择了夜拍功能,硬件抽象层调用预览数据控制通道模块中的参数设置函数创建一个摄像参数设置接口,摄像参数设置接口向相机硬件层中的图像信号处理模块ISP中的参数管理模块传输一个夜拍使能信号,该使能信号表明其对应的相机夜拍功能已经被启用,参数管理模块对该相机夜拍功能对应的摄像参数进行调整和修改,以获得最佳的预览效果,硬件抽象层通过相机驱动层调用相机硬件层按照当前设置的摄像参数获取图像数据,硬件抽象层通过预览数据控制通道模块将预览图像通过相机服务端模块和相机框架层传输至相机应用层进行显示。In another embodiment of the present invention, the camera application layer issues a preview or take picture, and the preview instruction or shooting instruction is transmitted to the hardware abstraction layer through the camera frame layer and the camera server module, and the camera service The end module determines that the camera application layer selects the night shot function, and the hardware abstraction layer calls the parameter setting function in the preview data control channel module to create a camera parameter setting interface, and the camera parameter setting interface is directed to the image signal processing module ISP in the camera hardware layer. The parameter management module transmits a night shot enable signal indicating that the corresponding camera night shot function has been enabled, and the parameter management module adjusts and modifies the camera parameters corresponding to the camera night shot function to obtain the best Preview effect, the hardware abstraction layer calls the camera hardware layer through the camera driver layer to obtain image data according to the currently set camera parameters, and the hardware abstraction layer transmits the preview image to the camera application layer through the preview server data channel module through the preview data control channel module. Display.
随着人们生活水平的丰富,活动也多姿多彩,夜间城市的璀璨灯光、游乐园里的绚烂烟火、夜间派对上的欢声笑语,这些都是人们想要留下的记忆,将各种光源色彩斑斓的美丽夜景作为拍摄对象是颇具魅力的,但是与白天的拍摄不同,夜景摄影需要独特的技巧,假设相机应用层中选择了夜拍增强功能,则参数管理模块收到一个夜拍使能信号,参数管理模块对夜拍增强功能会涉及的摄像参数进行调整和修改,针对夜拍场景,通常需要注意以下:With the richness of people's living standards, the activities are also colorful, the night lights of the city, the gorgeous fireworks in the amusement park, the laughter at night parties, these are the memories people want to leave, the color of various light sources The beautiful night scene is attractive as a subject, but unlike daytime shooting, night photography requires unique skills. Assuming the night shot enhancement is selected in the camera application layer, the parameter management module receives a night shot enable signal. The parameter management module adjusts and modifies the camera parameters involved in the night shot enhancement function. For night scenes, it is usually necessary to pay attention to the following:
1、使用手动曝光模式:先用光圈优先模式测光,设定光圈值和感光度,例如使用f/8,ISO200,相机最后给出的快门速度是2秒。然后转到手动曝光模式,将光圈设定为f/8,感光度ISO 200,快门速度2秒,试拍一张。.查看拍出来的效果,有需要时参考直方图来设定曝光参数。如果觉得整体偏暗,通常会选择延长曝光时间,而不加大光圈或提升感光度。这是因为相机已经架在三脚架上,修改快门速度仅影响累积通光量,如果增大光圈则会让景深变浅,提升感光度则会带来噪点问题。1. Use the manual exposure mode: first measure the aperture value and sensitivity with the aperture priority mode. For example, use f/8, ISO200, and the shutter speed given by the camera is 2 seconds. Then go to manual exposure mode, set the aperture to f/8, ISO 200 sensitivity, shutter speed 2 seconds, and take a test shot. Check the effect of the shot, and refer to the histogram to set the exposure parameters when necessary. If you feel the overall darkness, you will usually choose to extend the exposure time without increasing the aperture or increasing the sensitivity. This is because the camera is already mounted on a tripod. Modifying the shutter speed only affects the cumulative amount of light. If the aperture is increased, the depth of field will be lighter. Increasing the sensitivity will cause noise problems.
2、修改白平衡:修改白平衡就是改变照片的颜色。拍摄夜景不一定要用自动白平衡,很多时修改白平衡能让你的照片带来与众不同的效果。偏冷的白平衡会让城市显得科幻,而偏暖的白平衡则可以让城市显得热闹繁华。因此同一场景下可以试试不同的白平衡设定。2, modify the white balance: modify the white balance is to change the color of the photo. Shooting night scenes doesn't have to use automatic white balance. Many times you can change the white balance to make your photos look different. A cold white balance will make the city look like a science fiction, while a warm white balance will make the city look bustling. So you can try different white balance settings in the same scene.
3、使用不同光圈拍摄:拍摄夜景不一定非要使用小光圈拍摄。虽然小光圈(如f/8)会让景深变深,但有时我们也可以使用大光圈来拍摄夜景,例如 下列两种情况:手持拍摄,手持拍摄有“安全快门”的限制,如果快门过慢容易出现画面抖动现象,这时要加大光圈,有需要时提升感光度;利用浅景深效果突出细节,构图不要一成不变,拍摄夜景除了可以拍摄“大景”外,利用浅景深效果突出细节也能拍出好照片,这时我们便可以使用大光圈来营造浅景深了,圣诞灯饰便是一个很好的例子。3, shooting with different aperture: shooting night scenes do not have to use a small aperture to shoot. Although a small aperture (such as f/8) will make the depth of field deeper, sometimes we can also use a large aperture to shoot night scenes, for example The following two situations: hand-held shooting, handheld shooting has a "safe shutter" limit, if the shutter is too slow, it is easy to appear picture jitter, then increase the aperture, increase the sensitivity when needed; use shallow depth of field effect to highlight details, composition Don't be the same, shooting night scenes in addition to shooting "big scene", using shallow depth of field effect to highlight the details can also take good pictures, then we can use a large aperture to create a shallow depth of field, Christmas lights is a good example .
4、慢速快门:慢速快门是一样非常好玩又有用的拍摄技巧。在夜间使用慢速快门拍摄,可以拍出漂亮的车轨、星轨、光绘,甚至一些肉眼看不到的光线。4, slow shutter: slow shutter is the same very fun and useful shooting skills. Shooting at slow shutter speeds at night allows you to shoot beautiful tracks, star tracks, light paintings, and even some light that is invisible to the naked eye.
当处于夜拍增强功能启动状态下,对摄像参数的调整和设定通常需要将感光度设置的较高,并增加曝光时间。当相机的ISP获得当前拍照环境参数后,确定当前拍照环境的目标场景,默认使用与所述目标场景对应的参数配置初始值设置所述相机的当前拍照参数,比如将感光度锁定在ISO6000(ISO表示的是感光度,ISO6000表示感光度数值是6000),关闭OIS(Optical Image Stabilizer,光学图像稳定器)的同时拉动快门,调整曝光时间寻找合理进光量完成拍照,但是用户看到照片后全部删除,此时确定所述相机出现拍摄异常,则基于设定参数调整策略对所述相机的当前拍照参数进行调整,如将感光度降至ISO2000(ISO表示的是感光度,ISO2000表示感光度数值是2000),同时增加曝光时间,继续拍照。When the night shot enhancement function is activated, the adjustment and setting of the camera parameters usually require setting the sensitivity higher and increasing the exposure time. After the camera's ISP obtains the current camera environment parameter, the target scene of the current photographing environment is determined. By default, the camera's current camera parameters are set using the parameter configuration initial value corresponding to the target scene, such as locking the sensitivity to ISO6000 (ISO). Indicates the sensitivity, ISO6000 means the sensitivity value is 6000), close the OIS (Optical Image Stabilizer) while pulling the shutter, adjust the exposure time to find a reasonable amount of light to complete the photo, but the user deletes all the photos At this time, it is determined that the camera is abnormal in shooting, and the current camera parameters of the camera are adjusted based on the setting parameter adjustment strategy, such as reducing the sensitivity to ISO2000 (ISO indicates sensitivity, ISO2000 indicates sensitivity value is 2000), while increasing the exposure time, continue to take pictures.
在本发明的另一个实施例中,相机应用层发出预览指令(preview)或拍摄指令(take picture),该预览指令或拍摄指令通过相机框架层和相机服务端模块传输至硬件抽象层,相机服务端模块判断相机应用层选择了美颜功能,硬件抽象层调用预览数据控制通道模块中的参数设置函数创建一个摄像参数设置接口,摄像参数设置接口向相机硬件层中的图像信号处理模块ISP中的参数管理模块传输一个美颜使能信号,该使能信号表明其对应的相机美颜功能已经被启用,参数管理模块对该相机美颜功能对应的摄像参数进行调整和修改,以获得最佳的预览效果,硬件抽象层通过相机驱动层调用相机硬件层按照当前设置的摄像参数获取图像数据,硬件抽象层通过预览数据控制通道模块将预览图像通过相机服务端模块和相机框架层传输至相机应用层进行显示。In another embodiment of the present invention, the camera application layer issues a preview or take picture, and the preview instruction or shooting instruction is transmitted to the hardware abstraction layer through the camera frame layer and the camera server module, and the camera service The end module determines that the camera application layer selects the beauty function, and the hardware abstraction layer calls the parameter setting function in the preview data control channel module to create a camera parameter setting interface, and the camera parameter setting interface to the image signal processing module ISP in the camera hardware layer The parameter management module transmits a beauty enable signal indicating that the corresponding camera beauty function has been enabled, and the parameter management module adjusts and modifies the camera parameters corresponding to the camera beauty function to obtain the best Preview effect, the hardware abstraction layer calls the camera hardware layer through the camera driver layer to obtain image data according to the currently set camera parameters, and the hardware abstraction layer transmits the preview image to the camera application layer through the preview server data channel module through the preview data control channel module. Display.
现在的用户,尤其是女性用户,往往都喜欢对拍摄的照片做一些修饰, 遮掩面部的缺陷,比如:痘痘、雀斑、皮肤暗黄等等,这样能够提高一些自信心,假设相机应用层中选择了美颜增强功能,则参数管理模块收到一个美颜使能信号,参数管理模块对美颜增强功能会涉及的摄像参数进行调整和修改,通常会对曝光度、对比度、饱和度、锐化、高光、阴影、色温、色调、暗角、颗粒、阴影色调、高光色调等参数进行调整。Today's users, especially female users, often like to make some modifications to the photos they take. Covering facial defects such as acne, freckles, dark yellow skin, etc., which can improve some self-confidence. Assuming that the beauty enhancement function is selected in the camera application layer, the parameter management module receives a beauty enable signal. The parameter management module adjusts and modifies the camera parameters involved in the beauty enhancement function, usually for exposure, contrast, saturation, sharpening, highlights, shadows, color temperature, hue, vignetting, grain, shadow tones, highlights Adjust the parameters.
如图4所示,本发明还提供一种智能终端的摄像参数设置装置,包含:As shown in FIG. 4, the present invention further provides an imaging parameter setting device for an intelligent terminal, comprising:
相机应用层1,其用于发送预览指令或拍摄指令,并显示预览图像和拍摄图像;a camera application layer 1, which is used to send a preview instruction or a shooting instruction, and display a preview image and a captured image;
相机框架层2,其用于为相机应用层提供应用接口;a camera frame layer 2 for providing an application interface to a camera application layer;
Binder进程间通信模块3,其用于提供相机框架层和相机服务端模块之间的通信接口;a Binder inter-process communication module 3, configured to provide a communication interface between a camera framework layer and a camera server module;
相机服务端模块4,其用于提供相机硬件层操作接口;a camera server module 4 for providing a camera hardware layer operation interface;
硬件抽象层5,该硬件抽象层中具有摄像参数设置接口501,用于传输相机增强功能使能信号;a hardware abstraction layer 5 having a camera parameter setting interface 501 for transmitting a camera enhancement function enable signal;
相机驱动层6,其用于驱动相机硬件层;a camera driver layer 6 for driving a camera hardware layer;
相机硬件层7,该相机硬件层中的图像信号处理模块701中具有参数管理模块7011,用于根据相机增强功能使能信号来调整和修改对应的相机增强功能的摄像参数。The camera hardware layer 7 has a parameter management module 7011 in the image signal processing module 701 for adjusting and modifying the camera parameters of the corresponding camera enhancement function according to the camera enhancement function enable signal.
本发明还提供一种智能终端,该智能终端可以提供拍摄功能,该智能终端中包含摄像参数设置装置,所述的摄像参数设置装置进一步包含:The present invention also provides an intelligent terminal, which can provide a shooting function, the intelligent terminal includes an imaging parameter setting device, and the imaging parameter setting device further includes:
相机应用层,其用于发送预览指令或拍摄指令,并显示预览图像和拍摄图像;a camera application layer for transmitting a preview instruction or a shooting instruction, and displaying a preview image and a captured image;
相机框架层,其用于为相机应用层提供应用接口;a camera frame layer for providing an application interface to a camera application layer;
Binder进程间通信模块,其用于提供相机框架层和相机服务端模块之间的通信接口;a Binder inter-process communication module for providing a communication interface between a camera framework layer and a camera server module;
相机服务端模块,其用于提供相机硬件层操作接口;a camera server module for providing a camera hardware layer operation interface;
硬件抽象层,该硬件抽象层中具有摄像参数设置接口,用于传输相机增强功能使能信号;a hardware abstraction layer having a camera parameter setting interface for transmitting a camera enhancement function enable signal;
相机驱动层,其用于驱动相机硬件层;a camera driver layer for driving a camera hardware layer;
相机硬件层,该相机硬件层中的图像信号处理模块中具有参数管理模 块,用于根据相机增强功能使能信号来调整和修改对应的相机增强功能的摄像参数。a camera hardware layer having a parameter management module in an image signal processing module in the camera hardware layer A block for adjusting and modifying the camera parameters of the corresponding camera enhancement function according to the camera enhancement function enable signal.
本发明针对不同的摄像功能对摄像参数进行调整,并在预览过程中将参数调整后的效果实时显示出来,提高了拍摄效果,提升了用户体验。The invention adjusts the camera parameters for different camera functions, and displays the effect of the parameter adjustment in real time during the preview process, thereby improving the shooting effect and improving the user experience.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本发明各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, can be embodied in the form of a software product that can be stored in a storage medium (such as ROM/RAM, disk). The optical disc includes a plurality of instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method described in various embodiments of the present invention.
最后,还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者终端设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者终端设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者终端设备中还存在另外的相同要素。Finally, it should also be noted that in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities. There is any such actual relationship or order between operations. Furthermore, the terms "comprises" or "comprising" or "comprising" or any other variations are intended to encompass a non-exclusive inclusion, such that a process, method, article, or terminal device that includes a plurality of elements includes not only those elements but also Other elements that are included, or include elements inherent to such a process, method, article, or terminal device. An element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or terminal device that comprises the element, without further limitation.
尽管本发明的内容已经通过上述优选实施例作了详细介绍,但应当认识到上述的描述不应被认为是对本发明的限制。在本领域技术人员阅读了上述内容后,对于本发明的多种修改和替代都将是显而易见的。因此,本发明的保护范围应由所附的权利要求来限定。 Although the present invention has been described in detail by the preferred embodiments thereof, it should be understood that the foregoing description should not be construed as limiting. Various modifications and alterations of the present invention will be apparent to those skilled in the art. Therefore, the scope of the invention should be defined by the appended claims.

Claims (8)

  1. 一种智能终端的摄像参数设置方法,其特征在于,包含以下步骤:A camera parameter setting method for an intelligent terminal, characterized in that the method comprises the following steps:
    硬件抽象层接收到相机应用层发出的预览指令或拍摄指令,且相机应用层开启了相机增强功能,则硬件抽象层调用预览数据控制通道模块中的参数设置函数创建一个摄像参数设置接口,摄像参数设置接口向相机硬件层中的图像信号处理模块中的参数管理模块传输一个增强功能使能信号,参数管理模块根据该增强功能使能信号对该相机增强功能对应的摄像参数进行调整和修改,以获得最佳的预览和拍摄效果。The hardware abstraction layer receives the preview instruction or the shooting instruction issued by the camera application layer, and the camera application layer turns on the camera enhancement function, and the hardware abstraction layer calls the parameter setting function in the preview data control channel module to create a camera parameter setting interface, the camera parameter. The setting interface transmits an enhanced function enable signal to the parameter management module in the image signal processing module in the camera hardware layer, and the parameter management module adjusts and modifies the camera parameter corresponding to the camera enhancement function according to the enhanced function enable signal, Get the best preview and shooting results.
  2. 如权利要求1所述的智能终端的摄像参数设置方法,其特征在于,硬件抽象层接收到相机应用层发出的预览指令或拍摄指令,且相机应用层未开启相机增强功能,则相机硬件层中的图像信号处理模块中的参数管理模块使用默认的摄像参数进行预览和拍摄。The camera parameter setting method of the smart terminal according to claim 1, wherein the hardware abstraction layer receives a preview instruction or a shooting instruction issued by the camera application layer, and the camera application layer does not enable the camera enhancement function, and the camera hardware layer The parameter management module in the image signal processing module uses the default camera parameters for previewing and shooting.
  3. 如权利要求1所述的智能终端的摄像参数设置方法,其特征在于,所述的相机增强功能包含但不限于以下功能:夜拍、全景、美颜。The camera parameter setting method of the smart terminal according to claim 1, wherein the camera enhancement function includes but is not limited to the following functions: night shot, panorama, and beauty.
  4. 如权利要求3所述的智能终端的摄像参数设置方法,其特征在于,不同的相机增强功能分别对应不同的使能信号。The imaging parameter setting method of the smart terminal according to claim 3, wherein the different camera enhancement functions respectively correspond to different enable signals.
  5. 如权利要求1所述的智能终端的摄像参数设置方法,其特征在于,所述的摄像参数设置接口用于设置和获取自动曝光参数、自动聚焦参数和自动白平衡参数。The imaging parameter setting method of the intelligent terminal according to claim 1, wherein the imaging parameter setting interface is configured to set and acquire an automatic exposure parameter, an auto focus parameter, and an automatic white balance parameter.
  6. 如权利要求1所述的智能终端的摄像参数设置方法,其特征在于,所述的摄像参数包含但不限于:自动曝光参数、自动聚焦参数、自动白平衡参数、感光度参数、光圈参数、快门参数、曝光度参数、对比度参数、饱和度参数、亮度降噪参数、彩色降噪参数。The imaging parameter setting method of the intelligent terminal according to claim 1, wherein the imaging parameters include, but are not limited to, an automatic exposure parameter, an auto focus parameter, an automatic white balance parameter, a sensitivity parameter, an aperture parameter, and a shutter. Parameters, exposure parameters, contrast parameters, saturation parameters, brightness noise reduction parameters, color noise reduction parameters.
  7. 一种智能终端的摄像参数设置装置,其特征在于,包含:An imaging parameter setting device for an intelligent terminal, comprising:
    相机应用层,其用于发送预览指令或拍摄指令,并显示预览图像和拍摄图像;a camera application layer for transmitting a preview instruction or a shooting instruction, and displaying a preview image and a captured image;
    相机框架层,其用于为相机应用层提供应用接口;a camera frame layer for providing an application interface to a camera application layer;
    Binder进程间通信模块,其用于提供相机框架层和相机服务端模块之 间的通信接口;Binder interprocess communication module, which is used to provide a camera frame layer and a camera server module Communication interface
    相机服务端模块,其用于提供相机硬件层操作接口;a camera server module for providing a camera hardware layer operation interface;
    硬件抽象层,该硬件抽象层中具有摄像参数设置接口,用于传输相机增强功能使能信号;a hardware abstraction layer having a camera parameter setting interface for transmitting a camera enhancement function enable signal;
    相机驱动层,其用于驱动相机硬件层;a camera driver layer for driving a camera hardware layer;
    相机硬件层,该相机硬件层中的图像信号处理模块中具有参数管理模块,用于根据相机增强功能使能信号来调整和修改对应的相机增强功能的摄像参数。In the camera hardware layer, the image signal processing module in the camera hardware layer has a parameter management module for adjusting and modifying the camera parameters of the corresponding camera enhancement function according to the camera enhancement function enable signal.
  8. 一种智能终端,其特征在于,该智能终端包含如权利要求1所述的摄像参数设置装置。 An intelligent terminal comprising the imaging parameter setting device according to claim 1.
PCT/CN2017/102592 2017-09-21 2017-09-21 Camera photographing parameter setting method for smart terminal, setting device, and smart terminal WO2019056242A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/102592 WO2019056242A1 (en) 2017-09-21 2017-09-21 Camera photographing parameter setting method for smart terminal, setting device, and smart terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/102592 WO2019056242A1 (en) 2017-09-21 2017-09-21 Camera photographing parameter setting method for smart terminal, setting device, and smart terminal

Publications (1)

Publication Number Publication Date
WO2019056242A1 true WO2019056242A1 (en) 2019-03-28

Family

ID=65810961

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/102592 WO2019056242A1 (en) 2017-09-21 2017-09-21 Camera photographing parameter setting method for smart terminal, setting device, and smart terminal

Country Status (1)

Country Link
WO (1) WO2019056242A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112399087A (en) * 2020-12-07 2021-02-23 Oppo(重庆)智能科技有限公司 Image processing method, image processing apparatus, image capturing apparatus, electronic device, and storage medium
CN112770040A (en) * 2019-11-01 2021-05-07 Oppo广东移动通信有限公司 Shooting method and device and computer readable storage medium
CN113347378A (en) * 2021-06-02 2021-09-03 展讯通信(天津)有限公司 Video recording method and device
CN113890998A (en) * 2021-10-26 2022-01-04 Oppo广东移动通信有限公司 Image data processing method and device, electronic equipment and storage medium
CN113971048A (en) * 2021-10-29 2022-01-25 Oppo广东移动通信有限公司 Application program starting method and device, storage medium and electronic equipment
CN114007009A (en) * 2020-07-15 2022-02-01 Oppo广东移动通信有限公司 Electronic device and image processing method
CN115034948A (en) * 2021-12-30 2022-09-09 荣耀终端有限公司 Image processing method and electronic equipment
CN115706849A (en) * 2021-08-05 2023-02-17 北京小米移动软件有限公司 Camera software architecture, platform and terminal equipment
EP4141860A1 (en) 2021-08-27 2023-03-01 Roche Diabetes Care GmbH Methods and devices for controlling auto white balance settings of a mobile device for a color based measurement using a color reference card
WO2023160269A1 (en) * 2022-02-25 2023-08-31 荣耀终端有限公司 Electronic device and photographing method thereof, and medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102968315A (en) * 2012-10-30 2013-03-13 广东欧珀移动通信有限公司 Method and system for quickly starting camera previewing of intelligent equipment and intelligent equipment
CN103442172A (en) * 2013-08-15 2013-12-11 Tcl集团股份有限公司 Camera image quality adjusting method, system and mobile terminal based on android platform
CN104994277A (en) * 2015-06-30 2015-10-21 青岛海信移动通信技术股份有限公司 Rapid shooting method and device for mobile communication terminal
US20150350466A1 (en) * 2014-05-29 2015-12-03 Asustek Computer Inc. Mobile device, computer device and image control method thereof
CN105827942A (en) * 2015-09-24 2016-08-03 维沃移动通信有限公司 Rapid photographing method and electronic device
CN106506937A (en) * 2016-10-11 2017-03-15 芜湖哈特机器人产业技术研究院有限公司 A kind of smart camera for being available for secondary development
CN106775902A (en) * 2017-01-25 2017-05-31 北京奇虎科技有限公司 A kind of method and apparatus of image procossing, mobile terminal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102968315A (en) * 2012-10-30 2013-03-13 广东欧珀移动通信有限公司 Method and system for quickly starting camera previewing of intelligent equipment and intelligent equipment
CN103442172A (en) * 2013-08-15 2013-12-11 Tcl集团股份有限公司 Camera image quality adjusting method, system and mobile terminal based on android platform
US20150350466A1 (en) * 2014-05-29 2015-12-03 Asustek Computer Inc. Mobile device, computer device and image control method thereof
CN104994277A (en) * 2015-06-30 2015-10-21 青岛海信移动通信技术股份有限公司 Rapid shooting method and device for mobile communication terminal
CN105827942A (en) * 2015-09-24 2016-08-03 维沃移动通信有限公司 Rapid photographing method and electronic device
CN106506937A (en) * 2016-10-11 2017-03-15 芜湖哈特机器人产业技术研究院有限公司 A kind of smart camera for being available for secondary development
CN106775902A (en) * 2017-01-25 2017-05-31 北京奇虎科技有限公司 A kind of method and apparatus of image procossing, mobile terminal

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112770040A (en) * 2019-11-01 2021-05-07 Oppo广东移动通信有限公司 Shooting method and device and computer readable storage medium
CN112770040B (en) * 2019-11-01 2022-05-13 Oppo广东移动通信有限公司 Shooting method and device and computer readable storage medium
CN114007009B (en) * 2020-07-15 2023-08-18 Oppo广东移动通信有限公司 Electronic device and image processing method
CN114007009A (en) * 2020-07-15 2022-02-01 Oppo广东移动通信有限公司 Electronic device and image processing method
CN112399087A (en) * 2020-12-07 2021-02-23 Oppo(重庆)智能科技有限公司 Image processing method, image processing apparatus, image capturing apparatus, electronic device, and storage medium
CN112399087B (en) * 2020-12-07 2022-05-20 Oppo(重庆)智能科技有限公司 Image processing method, image processing apparatus, image capturing apparatus, electronic device, and storage medium
CN113347378A (en) * 2021-06-02 2021-09-03 展讯通信(天津)有限公司 Video recording method and device
CN115706849B (en) * 2021-08-05 2024-01-30 北京小米移动软件有限公司 Camera software architecture, platform and terminal equipment
CN115706849A (en) * 2021-08-05 2023-02-17 北京小米移动软件有限公司 Camera software architecture, platform and terminal equipment
EP4141860A1 (en) 2021-08-27 2023-03-01 Roche Diabetes Care GmbH Methods and devices for controlling auto white balance settings of a mobile device for a color based measurement using a color reference card
WO2023025866A1 (en) 2021-08-27 2023-03-02 F. Hoffmann-La Roche Ag Methods and devices for controlling auto white balance settings of a mobile device for a color based measurement using a color reference card
CN113890998A (en) * 2021-10-26 2022-01-04 Oppo广东移动通信有限公司 Image data processing method and device, electronic equipment and storage medium
CN113971048A (en) * 2021-10-29 2022-01-25 Oppo广东移动通信有限公司 Application program starting method and device, storage medium and electronic equipment
CN115034948A (en) * 2021-12-30 2022-09-09 荣耀终端有限公司 Image processing method and electronic equipment
WO2023160269A1 (en) * 2022-02-25 2023-08-31 荣耀终端有限公司 Electronic device and photographing method thereof, and medium
CN116708988A (en) * 2022-02-25 2023-09-05 荣耀终端有限公司 Electronic equipment and shooting method and medium thereof

Similar Documents

Publication Publication Date Title
WO2019056242A1 (en) Camera photographing parameter setting method for smart terminal, setting device, and smart terminal
WO2020034737A1 (en) Imaging control method, apparatus, electronic device, and computer-readable storage medium
US8531573B2 (en) Digital camera and operating method thereof
US9264630B2 (en) Method and apparatus for creating exposure effects using an optical image stabilizing device
JP6259185B2 (en) IMAGING DEVICE, ITS CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM
US8937677B2 (en) Digital photographing apparatus, method of controlling the same, and computer-readable medium
CN110198417A (en) Image processing method, device, storage medium and electronic equipment
CN104092955B (en) Flash control method and control device, image-pickup method and collecting device
JP2001211359A (en) Electronic camera
CN103188423A (en) Camera shooting device and camera shooting method
JP2011146957A (en) Imaging apparatus, control method thereof, and program
WO2015131614A1 (en) Mobile terminal and photographing method therefor
KR102207633B1 (en) Image photographing apparatus and control methods thereof
WO2020034702A1 (en) Control method, device, electronic equipment and computer readable storage medium
JP2010286752A (en) Imaging device and imaging method
JP2001238115A (en) Electronic camera
JP2007124665A (en) Programmable anti-aliasing systems and methods for cameras
CN106878606B (en) Image generation method based on electronic equipment and electronic equipment
JP2012165078A (en) Imaging apparatus and imaging program
KR20150116350A (en) Photographing apparatus and method
CN105208286A (en) Photographing method and device for simulating low-speed shutter
Gibson Exposure and Understanding the Histogram
US20210400192A1 (en) Image processing apparatus, image processing method, and storage medium
KR102146853B1 (en) Photographing apparatus and method
WO2022245344A1 (en) Mobile device support for capture and synthesis of extreme low-light video

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17925819

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17925819

Country of ref document: EP

Kind code of ref document: A1