TW201828256A - Image preview method and apparatus for camera application, and camera application system solving the poor compatibility of an image preview scheme for the camera application in the prior art - Google Patents

Abstract

An embodiment of this invention provides an image preview method and apparatus for a camera application, and a camera application system, wherein the method comprises the following steps: triggering a framework to receive an image acquired by a hardware adaptation layer (HAL); and processing the image to obtain a processed image; and outputting the processed image to a corresponding display module of a framework layer for display. By adopting the solution in the embodiment of this application, the problem that a poor compatibility of an image preview scheme for the camera application in the prior art can be solved.

Description

 Image preview method, device and camera application system for camera application  

The present application relates to computer technology, and more particularly to an image preview method, apparatus, and camera application system for a camera application.

At present, a variety of applications can call a mobile device camera to perform different modes of shooting. The application may be an application such as a QQ, a universal camera, a super camera, etc., and the mobile device may be a device such as a mobile phone, a tablet computer, etc., the mode may be For example, photographing, photography, panoramic mode, etc.; in this application, the applications that can call the camera of the mobile device to perform different modes of shooting are collectively referred to as a camera application.

In order to make the images taken by the user look better, many camera applications provide image processing functions, such as beauty processing. At the same time, in order to enable users to understand the effect after image processing before shooting, many camera applications provide instant preview function, for example, beauty preview; that is, when the lens is facing the user's face, the use of the display on the screen The face of the person is a preview image that has been beautifully processed.

In the prior art, the method for implementing the image preview function of the camera application is as shown in FIG. 1 : S101, adding image processing function to the HAL (Hardware Adapter Layer) of the camera; S102, HAL acquiring the preview image And then performing image processing; S103, outputting the processed image to the display module of the HAL for display. Since HAL relies on various platforms such as MTK, Qualcomm, Spreadtrum, etc., the implementation methods of image preview functions of camera applications of different platforms in the prior art are quite different.

The image preview scheme of the prior art camera application relies on the HAL of each platform, and the implementation of the code is large and the compatibility is poor.

An embodiment of the present invention provides an image preview method, a device, and a camera application system for a camera application, which are used to solve the problem of poor compatibility of an image preview solution of a camera application in the prior art.

According to an aspect of an embodiment of the present application, an image preview method for a camera application is provided, including: triggering a framework to receive an image acquired by a hardware adaptation layer HAL; processing the image to obtain a processed image The processed image is output to a display module corresponding to the Framework layer for display.

According to another aspect of the embodiments of the present application, an image preview apparatus for a camera application includes: a trigger module for triggering a frame framework to receive an image acquired by a HAL; and an image processing module for pairing an image Processing is performed to obtain a processed image; and the first output module is configured to output the processed image to a display module corresponding to the Framework layer for display.

According to still another aspect of the embodiments of the present application, a camera application system is provided, including: the image preview device of the camera application described above.

The image preview method of the camera application in the embodiment of the present application can implement image preview in combination with the Framework layer. Since the framework is a system-owned framework and does not depend on the platform, it can be used across platforms and mobile phones, thereby improving compatibility. Sex.

500‧‧‧Image preview device for camera applications

502‧‧‧ Trigger Module

504‧‧‧Image Processing Module

506‧‧‧First output module

600‧‧‧ Camera Application System

The drawings described herein are intended to provide a further understanding of the present application, and are intended to be a part of this application. In the drawings: FIG. 1 is a flowchart of a method for implementing an image preview function of a camera application in the prior art; FIG. 2 is a flowchart of an image preview method for a camera application according to Embodiment 1 of the present application; The flowchart of the image preview method of the camera application shown in the second embodiment of the present invention; FIG. 4 is a flowchart of the image preview method of the camera application according to the third embodiment of the present application; FIG. FIG. 6 is a schematic structural diagram of a camera application system according to Embodiment 5 of the present application.

The exemplary embodiments of the present application are further described in detail below with reference to the accompanying drawings. Not all embodiments are exhaustive. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

In the process of implementing the present application, the applicant finds that in the prior art, the image preview function of the camera application is implemented as shown in FIG. 1 : the image processing function is added to the HAL of the camera; the HAL collects the preview image, and then performs Image processing, output the processed image to the HAL display module for display. Since HAL relies on various platforms such as MTK, Qualcomm, Spreadtrum, etc., the implementation methods of image preview functions of camera applications of different platforms in the prior art are quite different. The solution in the prior art relies on the HAL of each platform, and the implementation of the code is different and the compatibility is poor. In addition, for a three-party mobile phone that does not open the original code, since the HAL original code cannot be obtained, the prior art solution cannot be implemented.

In response to the above problem, an image preview method for a camera application is provided in the embodiment of the present application. by adding an image processing function and a display module in the Framework layer, the image captured by the HAL is processed correspondingly and displayed, thereby being able to combine The Framework layer implements image preview. Since the Framework is a system-owned framework and does not depend on the platform, it can be used across platforms and mobile phones, improving compatibility.

The solution in the embodiment of the present application may be implemented in a hardware underlayer of a camera application, such as a Framework layer, or in an operating system layer.

The solution in the embodiment of the present application may be applied to a camera application, such as a camera manufacturer such as Camera360, a universal camera, a super camera, or the like, or a hardware such as Xiaomi, Samsung, Lenovo, Coolpad, Huawei, etc. The manufacturer's built-in camera application can also be a camera application such as an operating system such as an OS (Operating System), a Xiaomi ROM (Android Collaborative Operating System), and a Baidu ROM.

 Embodiment 1  

FIG. 2 is a flowchart of an image preview method of a camera application according to Embodiment 1 of the present application.

As shown in FIG. 2, the image preview method of the camera application according to the first embodiment of the present application includes the following steps: S201, the trigger frame Framework receives an image acquired by the hardware adaptation layer HAL; and S202, processes the image. And obtaining the processed image; S203, outputting the processed image to a display module SurfaceTexture corresponding to the Framework layer for display.

In a specific implementation of S201, the framework can receive the image acquired by the HAL through the image return component of the HAL (the function is a standard function supported by all platforms).

In a specific implementation manner of S202, a plurality of image processing methods commonly used by those skilled in the art may be used to process images in various modes, such as beauty, nostalgia, rinsing, black and white, candlelight, etc., which is not limited in this application. .

In the specific implementation, the Framework can be a framework of the operating system such as the Android Android system, which can be used to apply the APK to the camera to control the interface of the camera hardware.

In a specific implementation, the interface between the image preview method and the framework of the camera application in the embodiment of the present application may adopt various logics and names, and those skilled in the art should understand that as long as the image can be displayed to the display module. .

In a specific implementation, the image preview method of the camera application in the embodiment of the present application may be implemented in the form of an original code, or may be invoked by the Framework in the form of a static library or a dynamic library.

In a specific implementation, the display module may be a software function module for display, which is created by the camera application.

In the embodiment of the present application, before the step 203, the display module may be set in advance for the framework, and the display module may be a SurfaceTexture in the Android system.

In a specific implementation, the display module of the HAL can be set as the display module of the framework to set the display module for the Framework layer; more specifically, the control code user of the HAL display module can be modified into a Framework; For example, in Android, the control code user of SurfaceTexture is changed from the original HAL to Framework. This single display module mode can also achieve the effect of the scheme on some platforms, that is, although the display logic of the HAL is modified (ie, the HAL is no longer displayed), on platforms such as MTK, Qualcomm, and Samsung Exynos. It is also operational.

In the specific implementation, a new display module can be created, and the created display module is set as the display module of the framework, and the display module is set for the Framework layer. In the specific implementation, a new SurfaceTexture can be created by calling the UI (User Interface) interface in the application layer of the Android system. By adopting the dual display module mode of the new display module in the framework, the display logic of the HAL can be avoided, and the cross-platform can be better.

In another embodiment of the present application, before the trigger frame Framework receives the image acquired by the hardware adaptation layer HAL, the method further includes: acquiring an image preview mode of the camera application, where the image preview mode includes processing Mode and non-processing mode.

In the specific implementation, the image preview mode of the camera application may be set by the user, or may be set by default by the camera application, which is not limited in this application. In a specific implementation, the processing mode may be that the camera is required to provide the processed image for preview by the user, and the non-processing mode may be that the camera is required to provide the original HAL layer captured image for the user to preview. The image preview mode setting provides users with a wider variety of preview modes to enhance the user experience.

In another specific implementation manner of the embodiment of the present application, when the dual display module mode of the display module is added in the framework, in order to avoid the influence between the HAL display module and the Framework display module, When the preview mode is the processing mode, the display module of the HAL is hidden; at the same time, the processed image is output to the display module of the framework for display.

In the specific implementation, the HAL display module can be realized by setting the parameters of the HAL display module, for example, the transparency of the HAL display module is set to 100%, or the display module of the HAL can also be used. The size is set to a very small size, such as 1x1 pixels; it is also possible to place the HAL display module outside the user's viewable area in the display screen, for example, to set the HAL display module in the visible area. At a fixed position other than the top of the page (0, -9999) in the upper right corner of the visible area.

In the specific implementation, the HAL display module can also be hidden by setting the parameters of the framework display module. For example, the position of the framework display module is set on the HAL display module, and the Framework is The transparency of the display module is set to 0%. Since the code of the HAL display module is not modified, and the running logic of the HAL is not modified, that is, the running logic of the HAL is not affected by setting certain parameters; therefore, the HAL is not relied on, so the cross-platform capability is greatly enhanced.

In another specific implementation manner of the embodiment of the present application, when the dual display module mode of the display module is added in the framework, in order to avoid the influence between the HAL display module and the Framework display module, When the preview mode is non-processing mode, the display module of the framework is hidden; and the image captured by the HAL is output to the display module of the HAL for display.

In the specific implementation, the display module of the framework can be hidden in various ways, for example, the transparency of the display module of the framework is set to 100%, or the position of the display module of the HAL is set to the display module of the framework. The transparency of the display module of the HAL is set to 0%; the size of the display module of the framework can be set to a very small manner, for example, 1×1 pixels; and the display module of the framework can be placed on the display screen. The way the user in the screen is outside the visible area, for example, setting the display module of the Framework to a fixed position outside the visible area, for example, at the top right of the visible area (0, -9999) .

In a specific implementation manner of the embodiment of the present application, when the image is included in the image captured by the HAL, the processed image may be a post-make image; and processing the image may include: identifying the HAL collection. The face in the image; the face is treated with beauty.

The image preview method of the camera application in the embodiment of the present application can implement image preview in combination with the Framework layer. Since the framework is a system-owned framework and does not depend on the platform, it can be used across platforms and mobile phones, thereby improving compatibility. Sex.

In addition, compared with the related art in the camera application APK layer to achieve image preview, the transfer of the preview image to the APK requires a cross-process transfer and at least one JNI (Java Native Interface, JAVA local call) copy, which takes a long time, affecting user experience.

The image preview method of the camera application in the embodiment of the present application, combined with the framework layer, does not require cross-process transmission and JNI copy of the image to be previewed, and is more fluent and less time-consuming than the APK, and the use time is shorter. user experience.

The flow of the image preview method in the embodiment of the present application will be described below by taking a specific application example as an example.

 Embodiment 2  

FIG. 3 is a flowchart of an image preview method of a camera application according to Embodiment 2 of the present application.

In the second embodiment of the present application, the display module of the HAL is set as the single display module of the display module of the framework.

As shown in FIG. 3, the image preview method of the camera application according to the second embodiment of the present application includes the following steps: S301: Receive an image preview mode selected by a user; S302, after the HAL acquires an image, output the image. Go to the Framework layer; S303, if the image preview mode selected by the user is the non-processing mode, perform steps S304-S305; if it is the "beauty" processing mode, perform steps S306-S307; S304, in the Framework layer For example, the transparent processing is performed, that is, the image is not processed, and the input image is directly output; in S305, the transparently processed image is output to the display module of the Framework layer for display. At this point, the image preview of the non-processing mode ends.

After performing step S305, the user sees an unprocessed image displayed by the display module of the Framework layer.

S306, combining the framework layer to perform facial treatment on the image; S307, outputting the processed image to the display module of the Framework layer for display. At this point, the image preview of the processing mode ends. After performing step S307, the user sees the beautifully processed image displayed in the display module of the Framework layer.

 Embodiment 3  

4 is a flowchart of an image preview method of a camera application according to Embodiment 3 of the present application.

In the third embodiment of the present application, a dual display module for creating a new display module for the framework is adopted.

As shown in FIG. 4, the image preview method of the camera application according to the third embodiment of the present application includes the following steps: S401: Receive an image preview mode selected by a user; S402, after the HAL acquires an image, output the image. The display module and the Framework layer to the HAL; S403, if the image preview mode selected by the user is the non-processing mode, steps S404 and S405 are performed; if the image processing mode is "beauty", steps S406 and S407 are performed; The image is transparently processed in the Framework layer, that is, the image is not processed, the input image is directly output, and the transparent image is output to the display module of the Framework layer; S405, triggering the hidden framework Display module. At this point, the image preview of the non-processing mode ends.

After performing step S405, the user sees the unprocessed image displayed in the display module of the HAL.

In a specific implementation, there is no strict time sequence between steps S404 and S405, and S404 may be performed first, and then S405 may be performed; or S405 may be performed first, and then S404 is performed.

S406, combining the framework layer to perform facial treatment on the image, and outputting the image after the beauty to the display module of the Framework layer; S407, triggering the display module for hiding the HAL. At this point, the image preview of the processing mode ends.

After performing step S407, the user sees the beautifully processed image displayed in the display module of the Framework layer.

In a specific implementation, there is no strict time sequence between steps S406 and S407, and S406 may be performed first, and then S407 may be performed; or S406 may be performed first, and then S407 is performed.

Since the display module, such as the SurfaceTextue in the Android system, is a standard component provided by the operating system, the creation, hiding, display, and the like of the display module are not dependent on the platform, thereby improving the cross-platform capability of the embodiment of the present application.

The image preview method of the camera application in the embodiment of the present application can implement image preview in combination with the Framework layer. Since the framework is a system-owned framework and does not depend on the platform, it can be used across platforms and mobile phones, thereby improving compatibility. Sex.

Based on the same inventive concept, an image preview device for a camera application is also provided in the embodiment of the present application. Since the principle of solving the problem is similar to the method provided by the embodiment of the present application, the implementation of the device can refer to the implementation of the method. , the repetition will not be repeated.

 Embodiment 4  

FIG. 5 is a schematic structural diagram of an image preview apparatus applied to a camera according to Embodiment 4 of the present application.

As shown in FIG. 5, the image preview device 500 of the camera application according to the fourth embodiment of the present application includes: a trigger module 501, configured to trigger the frame Framework to receive an image acquired by the hardware adaptation layer HAL; The module 502 is configured to process the image to obtain a processed image, and the first output module 503 is configured to output the processed image to a display module corresponding to the Framework layer for display.

Preferably, the image preview device of the camera application according to the second embodiment of the present application further includes: a setting module, configured to set a display module for the framework.

Optionally, the creation module is specifically configured to set the HAL's SurfaceTexture to the Framework's SurfaceTexture.

Preferably, the creating module is specifically configured to set the display module of the HAL as the display module of the framework.

Preferably, the setting module is specifically configured to modify the control code user of the display module of the HAL into a framework.

Preferably, the setting module specifically includes: creating a sub-module for creating a display module; and setting a sub-module for setting the created display module as a display module of the framework.

Preferably, the image preview device of the camera application according to the second embodiment of the present application further includes: a mode acquisition module, configured to acquire an image preview mode of the camera application, where the image preview mode includes a processing mode and a non-processing mode. .

Preferably, when the image preview mode is the processing mode, the image preview device of the camera application according to the second embodiment of the present application further includes: a first hidden module for hiding the display module of the HAL.

Preferably, the image preview device of the camera application according to the second embodiment of the present application further includes: a second hidden module, configured to hide the display module of the framework, when the image preview mode is the non-processing mode.

Preferably, the device further includes: a second output module, configured to output the image captured by the HAL to the display module corresponding to the HAL for display.

Preferably, the image captured by the HAL includes a human face; the processed image is a post-beauty image; and the image processing module specifically includes: an identification sub-module for recognizing a face in the image captured by the HAL Beauty face module for facial treatment of faces.

The image preview device of the camera application in the embodiment of the present application can realize the beauty preview of the face in combination with the Framework layer. Since the framework is a system-owned framework and does not depend on the platform, it can be used across platforms and mobile phones. Compatibility.

Based on the same inventive concept, a camera application system is also provided in the embodiment of the present application. Since the principle of solving the problem is similar to the method provided by the embodiment of the present application, the implementation of the system can refer to the implementation of the method, and the repetition is performed. No longer.

 Embodiment 5  

FIG. 6 is a schematic structural diagram of a camera application system according to Embodiment 5 of the present application.

As shown in FIG. 6, the camera application system 600 according to the fifth embodiment of the present application includes an image preview device 500 for a camera application.

The camera application system in the embodiment of the present application can realize the beauty preview of the face in the framework. Since the framework is a system-owned framework and does not depend on the platform, it can be used across platforms and mobile phones, thereby improving compatibility.

Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Thus, the present application can take the form of a fully hardware embodiment, a fully software embodiment, or an embodiment combining the software and hardware. Moreover, the present application can take the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) containing computer usable code therein. .

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, a special purpose computer, an embedded processor or other programmable data processing device to produce a machine that executes instructions executed by a processor of a computer or other programmable data processing device Means are provided for implementing the functions specified in one or more of the flow or in one or more blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can boot a computer or other programmable data processing device to operate in a particular manner, such that instructions stored in the computer readable memory produce an article of manufacture including the instruction device. The instruction means implements the functions specified in one or more blocks of the flow or in a flow or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device to perform a series of operational steps on a computer or other programmable device to produce computer-implemented processing on a computer or other programmable device. The instructions executed above provide steps for implementing the functions specified in one or more blocks of the flowchart or in a block or blocks of the flowchart.

Although the preferred embodiment of the present application has been described, those skilled in the art can make additional changes and modifications to the embodiments once they are aware of the basic inventive concept. Therefore, the scope of the appended claims is intended to be construed as a

It will be apparent to those skilled in the art that various modifications and changes can be made in the present application without departing from the spirit and scope of the application. Thus, it is intended that the present invention cover the modifications and variations of the invention,

Claims (21)

 An image preview method for a camera application, comprising: triggering a framework to receive an image acquired by a hardware adaptation layer HAL; processing the image to obtain a processed image; and processing the processed image Output to the display module corresponding to the Framework layer for display.    The method of claim 1, wherein before the processed image is output to the display module of the Framework layer for display, the method further includes: setting a display module for the framework.    The method of claim 2, wherein the setting the display module for the framework comprises: setting the display module of the HAL as the display module of the framework.    The method of claim 3, wherein the setting of the HAL display module to the display module of the framework comprises: modifying the control code user of the HAL display module to a framework.    The method of claim 2, wherein the setting the display module for the framework comprises: creating a display module; and setting the created display module as the display module of the framework.    The method of claim 1, wherein before the trigger frame receives the image acquired by the hardware adaptation layer HAL, the method further includes: acquiring an image preview mode of the camera application, where the image preview mode includes Processing mode and non-processing mode.    The method of claim 6, wherein the image preview mode is a processing mode, the method further comprising: hiding the display module of the HAL.    According to the method of claim 6, wherein the image preview mode is a non-processing mode, the method further includes: hiding the display module of the framework.    The method of claim 8, wherein the method further comprises: outputting the image acquired by the HAL to a display module corresponding to the HAL for display.    The method of claim 1, wherein the image captured by the HAL includes a human face; the processed image is a post-make image; and processing the image specifically includes: identifying the image The face in the image captured by the HAL; the face is beautifully processed.    An image preview device for a camera application, comprising: a trigger module, configured to trigger a frame framework to receive an image captured by the HAL; and an image processing module configured to process the image to obtain a processed image The first output module is configured to output the processed image to a display module corresponding to the Framework layer for display.    The device of claim 11, further comprising: a setting module, configured to set a display module for the framework.    The device of claim 12, wherein the setting module is specifically configured to set the display module of the HAL as the display module of the framework.    The device of claim 13, wherein the setting module is specifically configured to modify a control code user of the HAL display module to a framework.    The device of claim 12, wherein the setting module comprises: creating a sub-module for creating a display module; and setting a sub-module for setting the created display module to the The display module of the Framework.    The device of claim 11, further comprising: a mode acquisition module, configured to acquire an image preview mode of the camera application, the image preview mode comprising a processing mode and a non-processing mode.    According to the device of claim 16, wherein the image preview mode is a processing mode, the device further includes: a first hidden module for hiding the display module of the HAL.    According to the device of claim 16, wherein the image preview mode is a non-processing mode, the device further includes: a second hidden module, configured to hide the display module of the framework.    The device of claim 18, wherein the device further comprises: a second output module, configured to output the image captured by the HAL to the display module corresponding to the HAL for display.    The device of claim 11, wherein the image captured by the HAL includes a human face; the processed image is a post-beauty image; and the image processing module specifically includes: an identification sub-module , for identifying a face in the image captured by the HAL; a beauty sub-module for performing facial treatment on the face.    A camera application system, comprising: an image preview device for a camera application according to any one of claims 11 to 20.