WO2015192713A1

WO2015192713A1 - Image processing method and device, mobile terminal, and computer storage medium

Info

Publication number: WO2015192713A1
Application number: PCT/CN2015/080302
Authority: WO
Inventors: 金蓉
Original assignee: 努比亚技术有限公司
Priority date: 2014-06-19
Filing date: 2015-05-29
Publication date: 2015-12-23
Also published as: CN104023178A

Abstract

An image processing method and device, a mobile terminal, and a computer storage medium. The method comprises: displaying a preview image of framing, the preview image being a candidate stitching material; receiving an image stitching instruction and entering an image stitching mode; receiving an operation instruction; and synthesizing the selected stitching material and a stitching template according to the operation instruction.

Description

Image processing method, device, mobile terminal, computer storage medium

Technical field

The present invention relates to a picture processing technology in the field of image data processing, and in particular, to a method, an apparatus, and a mobile terminal for performing picture processing in a shooting process.

Background technique

With the development of digital imaging technology, image shooting has been popularized and applied in daily life. People have been accustomed to taking various pictures or images at any time, but the pictures taken are single pictures, and the content and visual effects are relatively monotonous. .

In order to obtain a better visual effect, the prior art provides a picture stitching software or a photo wall application software. The software is designed to allow users to freely select multiple images to be placed in the template, resulting in a picture containing multiple photos, each frame being framed to the specified frame position. Such applications can connect multiple different images with templates as a medium to facilitate sharing of images and the like.

However, the above-mentioned software of the prior art is only applicable to a computer, and the materials required in the puzzle process are already taken in advance, so even if the effect is not satisfactory during the operation, the content of the material cannot be modified, and the user is inevitably inevitably I feel sorry. On the other hand, in some application scenarios, such as supermarket shopping, zoo shooting small animals, botanical gardens, plant flowers, etc., users will want to be able to process the pictures on the spot in order to get the desired results. Therefore, it is necessary to provide a method, a device and a mobile terminal for performing image processing in a process of shooting to enhance the user experience.

Summary of the invention

Embodiments of the present invention provide a method and apparatus for performing picture processing in a process capable of shooting And the mobile terminal and the computer storage medium, in order to solve the problem that the user cannot find the picture taken in time during the shooting process is ideal, and the defect that cannot be retaken or retaked in time is caused.

The technical solutions adopted by the embodiments of the present invention to solve the above technical problems are as follows:

According to an aspect of the embodiments of the present invention, a method for performing picture processing in a shooting process includes the following steps: displaying a preview picture of a framing in real time, the preview picture being an alternate splicing material; receiving a picture splicing instruction, Entering a picture stitching mode; receiving an operation instruction; and synthesizing the selected stitching material and the user-selected stitching template according to the operation instruction.

Providing a method as described above, the synthesizing processing of the selected splicing material and the user-selected splicing template comprises: determining a type of the operation instruction; if the operation instruction is a template selection instruction or a template replacement instruction Initializing the selected mosaic template, and displaying the mosaic template after initialization; if the operation instruction is a drag instruction, adding or modifying the mosaic material in the mosaic template according to a user operation, and The result is stored in the buffer area; if the operation instruction is an end instruction, a preset splicing algorithm is called, and the splicing template and the splicing material are spliced and combined according to the data in the buffer area.

Providing a method as described above, the adding or modifying a spliced material in the splicing template according to a user operation, and storing the result of the operation in a buffer area, comprising: selecting an alternative according to a user operation The spliced material is dragged into the splicing template as a splicing material, and data of the candidate preview image is stored in the buffer area; or, according to a user operation, the splicing material in the splicing template is removed, and The data of the spliced material to be removed is deleted from the buffer area; or, according to the operation of the user, the candidate splicing material is dragged into the splicing template to replace the existing splicing material, and the splicing will be replaced. The data of the material is deleted from the buffer area, and the data of the candidate spliced material is stored in the buffer area; or, according to the operation of the user, the order of the spliced materials in the splicing template is modified, and The data in the buffer area is modified accordingly.

Providing a method as described above, after the spliced material selected by the user is combined with the splicing template selected by the user, the method further includes: displaying an effect diagram of the compositing process and prompting the user to select whether to The result of the synthesis process is stored; the result of the synthesis process is stored or deleted according to the user's selection.

According to another aspect of the embodiments of the present invention, there is provided an apparatus for performing picture processing during a shooting process, the apparatus comprising: a display unit configured to display a preview picture of a framing, the preview picture being an alternative splicing material a receiving unit configured to receive a picture stitching instruction when the display unit displays a preview picture; the processing unit is configured to enter the picture stitching mode after the receiving unit receives the picture stitching instruction; the receiving unit is further configured to be in After the processing unit enters the splicing mode, the operation unit receives the operation instruction; the processing unit is further configured to perform the compositing processing on the selected splicing material and the splicing template selected by the user according to the receiving operation instruction received by the receiving unit.

A device as described above, the processing unit comprising: a determining module configured to determine a type of an operation instruction received by the receiving unit; and an execution module configured to determine, in the determining module, that the operation instruction is a template selection When the instruction or template replaces the instruction, the splicing template selected by the user is initialized; the display unit is further configured to display the splicing template after the execution module initializes the splicing template selected by the user; the execution module is further configured to be When the determining module determines that the operation instruction is a drag instruction, adding or modifying the spliced material in the splicing template according to a user operation, and storing the result of the operation in a buffer area, or configured to be in the determining When the module determines that the operation instruction is an end instruction, the preset splicing algorithm is called, and the splicing template and the splicing material are spliced and combined according to the data in the buffer area.

An apparatus as described above, wherein the execution module includes a trigger sub-module, a first execution sub-module, a second execution sub-module, a third execution sub-module, and a fourth execution sub-module;

The triggering submodule is configured to trigger, in the first execution submodule, the second execution submodule, the third execution submodule, and the fourth execution submodule, when the operation instruction is a drag instruction A submodule:

The first execution sub-module is configured to drag an alternate mosaic material into the mosaic template as a mosaic material, and store data of the candidate mosaic material into the buffer area;

The second execution sub-module is configured to remove the mosaic material in the mosaic template, and delete data of the removed mosaic material from the buffer area;

The third execution sub-module is configured to replace the existing mosaic material in the mosaic template by dragging the candidate mosaic material, and delete the data of the replaced mosaic material from the buffer area, and Data of the alternative spliced material is stored in the buffer area;

The fourth execution submodule is configured to modify an order of the stitched materials in the stitching template, and modify data in the buffer area accordingly.

Providing an apparatus as described above, wherein the display unit is further configured to display a result of the synthesizing process and prompt a user to select whether to store a result of the synthesizing process; the processing unit is further configured to be based on a user The result of the synthesis process is selected, stored or deleted.

According to still another aspect of an embodiment of the present invention, there is provided a mobile terminal comprising the apparatus for performing picture processing during photographing as described above.

According to still another aspect of an embodiment of the present invention, a computer storage medium is provided, in which executable instructions are stored, the executable instructions being used to perform the above-described method of picture processing.

The method and device for performing picture processing in the shooting process, and the mobile terminal and the computer storage medium can receive the picture splicing instruction when the display unit displays the preview picture of the framing, thereby entering the picture splicing mode and directly framing the framing. The preview image is used as an alternative stitching material, and then the selected stitching material is combined with the user-selected stitching template according to the received operation instruction, so that the user can directly obtain the ideal picture at the shooting scene, avoiding In the process of processing the taken pictures, the prior art is unsatisfactory because the shooting effect is unsatisfactory, which makes the user feel sorry and improves the user experience.

DRAWINGS

1 is a schematic block diagram of an apparatus for performing picture processing in a shooting process according to an embodiment of the present invention;

2 is a flowchart of a method for performing picture processing in a shooting process according to an embodiment of the present invention;

FIG. 3 is a flowchart of another method for performing picture processing in a shooting process according to an embodiment of the present invention.

detailed description

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments, in order to make the present invention. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The present invention provides a mobile terminal that performs picture processing during shooting, and the mobile terminal may be a smartphone with an imaging device or a camera or video camera having an image processing function. The mobile terminal is provided with means capable of performing picture processing during shooting.

Referring to Figure 1, the device includes:

The display unit 101 is configured to display a preview image of the framing and use the displayed preview image as an alternative splicing material.

Specifically, the preview image can be obtained by collecting data of the camera hardware, and the effect pre-processing operation is performed according to the preset effect parameter.

The receiving unit 102 is configured to receive a picture stitching instruction when the display unit displays the preview picture.

The processing unit 103 is configured to enter the image after the receiving unit 102 receives the splicing instruction Stitching mode.

Specifically, after entering the picture stitching mode, the display unit 101 can simultaneously display the preview picture and the stitching template to facilitate the user to perform the stitching operation. For example, the preview image or the splicing template can be reduced to a certain corner of the display unit 101 as needed, and the reduced preview image or the splicing template can be redisplayed when needed, for example, when the splicing operation is performed, so that the user can view the current The result of the stitching and a series of stitching control operations.

The receiving unit 102 is further configured to receive an operation instruction after the processing unit 103 enters the stitching mode.

The processing unit 103 is further configured to perform a synthesis process on the selected mosaic material and the user-selected mosaic template according to the receiving operation instruction received by the receiving unit 102.

Specifically, the processing unit 103 includes:

a determining module configured to determine a type of an operation instruction received by the receiving unit;

The execution module (coupled with the determination module) is configured to initialize the splicing template selected by the user when the determining module determines that the operation instruction is a template selection instruction or a template replacement instruction;

At this time, the display unit 101 is further configured to display the splicing template after the execution module initializes the splicing template selected by the user;

The execution module is further configured to: when the determining module determines that the operation instruction is a drag instruction, add or modify the spliced material in the splicing template according to a specific operation according to a specific operation, and store the result of the operation in a buffer area, Or configured to: when the determining module determines that the operation instruction is an end instruction, retrieve a preset splicing algorithm, and perform splicing and splicing the splicing template and the splicing material according to the data in the buffer area.

The execution module includes a trigger submodule, a first execution submodule, a second execution submodule, a third execution submodule, and a fourth execution submodule (the trigger unit is respectively associated with the first execution submodule, the second execution submodule, and the third execution The sub-module and the fourth execution sub-module are coupled to each other; specifically, when the judging module judges that the operation instruction is a drag instruction, the trigger sub-module triggers the first execution sub-module and the second execution The sub-module, the third sub-module, and the fourth sub-module perform corresponding processing according to the specific operation of the user, where the first execution sub-module is configured to drag the alternate splicing material into the splicing The template is used as a splicing material, and the data of the candidate spliced material is stored in the buffer area; the second execution sub-module is configured to remove the spliced material in the splicing template, and the data of the spliced material to be removed is removed. The third execution sub-module is configured to replace the existing mosaic material in the mosaic template by dragging the candidate mosaic material into the mosaic template, and delete the data of the replaced mosaic material from the buffer area, and The data of the candidate spliced material is stored in the buffer area; the fourth execution sub-module is configured to modify the order of the spliced materials in the splicing template, and modify the data in the buffer area accordingly.

In practical applications, the display unit 101 can be implemented by a liquid crystal display panel and an associated display driving circuit; the receiving unit 102 can be implemented by a component that supports human-computer interaction, such as a keyboard, a mouse, or a display 101 that supports touch operations; the processing unit 103 can be a processor. In conjunction with a memory implementation, where the memory user stores data for processing by the processing unit 103, the processor herein may be a CPU or a microprocessor (MCU); the processing unit 103 may also have an application specific integrated circuit (ASIC) or a logic programmable gate array (FPGA). )achieve.

In this embodiment, when the operation instruction is an end instruction, the execution module retrieves a preset splicing algorithm, and according to the data in the buffer area, the splicing template and the splicing material are spliced and combined, and can be implemented by two methods. The splicing template of the buffer area and the splicing of the spliced material:

Method 1: Firstly, the splicing template is first decomposed, and then the decomposed part is superimposed with the corresponding splicing material (the respective superpositions can be multi-threaded concurrent operations), and finally the fitting operation is performed on the result of each superposition operation.

Method 2: First, the splicing material is scaled so that it can correspond to each part of the splicing template, and then the spliced material is respectively pasted into the specified position of the splicing template (here, multi-thread concurrent operation can also be used, and finally summarized) .

After the execution module splicing and synthesizing the splicing template and the splicing material, the display unit 101. The method is further configured to display the result of the synthesizing process and prompt the user to select whether to store the result of the synthesizing process; the processing unit 103 is further configured to store or delete the result of the synthesizing process according to the user's selection.

The apparatus for performing image processing in the shooting process provided by the embodiment can receive the image stitching instruction when the display unit 101 displays the preview image of the framing, thereby entering the image stitching mode, and directly using the preview image of the framing as an alternative stitching material. Then, according to the received operation instruction, the selected mosaic material is combined with the user-selected mosaic template, so that the user can directly obtain the ideal picture at the shooting scene, thereby avoiding the prior art processing of the captured image. The user feels regret because the shooting effect is not ideal, which enhances the user experience.

On the basis of the above embodiments, the present invention also provides a method for performing picture processing during shooting. Referring to FIG. 2, the method includes:

S201. Display a preview image of the framing in real time, and the preview image is an alternative splicing material;

S202. Receive a picture stitching instruction, and enter a picture stitching mode.

S203. Receive an operation instruction.

S204. Synthesize the spliced material selected by the user and the splicing template selected by the user according to the operation instruction.

Specifically, S204 includes the following steps:

Determine the type of the operation instruction;

If the operation instruction is a template selection instruction or a template replacement instruction, initializing the selected mosaic template, and displaying the mosaic template after initialization;

If the operation instruction is a drag instruction, the spliced material is added or modified in the splicing template according to a specific operation, and the result of the operation is stored in the buffer area;

If the operation instruction is an end instruction, the preset splicing algorithm is called, and the splicing template and the splicing material are spliced and synthesized according to the data in the buffer area.

Specifically, when the operation instruction is a drag instruction, the specific operation is in the mosaic template. Add or modify the stitched material and store the results of the operation in the buffer, including:

Dragging the alternate stitching material into the stitching template as a stitching material according to the user's operation, and storing the data of the candidate stitching material into the buffer area; or

Removing the stitched material in the stitching template according to the user's operation, and deleting the data of the removed stitching material from the buffer area; or

According to the operation of the user, the candidate mosaic material is dragged into the mosaic template to replace the existing mosaic material, and the data of the replaced mosaic material is deleted from the buffer area, and the data of the candidate mosaic material is deleted. Stored in this cache; or,

According to the operation of the user, the order of the stitched materials in the stitching template is modified, and the data in the buffer area is modified accordingly.

S205. Display the effect of the synthesizing process and prompt the user to select whether to store the result of the synthesizing process.

In practical applications, in order to enable the mobile terminal to quickly respond to the user's operation, this step can display only a rough composite rendering, and the final splicing material and splicing template synthesis will be more accurate than the displayed compositing effect.

S206. Store or delete the result of the synthesizing process according to a user's selection.

The method for performing image processing in the shooting process provided by the embodiment can receive the image stitching instruction when displaying the preview image of the framing, thereby entering the image stitching mode, directly using the preview image of the framing as an alternative stitching material, and then according to The received operation instruction combines the selected spliced material with the splicing template selected by the user, so that the user can directly obtain the ideal picture at the shooting scene, thereby avoiding the prior art processing effect on the captured picture. The ideal makes the user feel sorry and enhances the user experience.

Please refer to FIG. 3 , which is another method for performing image processing during shooting according to the above two embodiments of the present invention. The method includes:

S301. Displaying a preview image of the framing in real time during the shooting process;

S302. Receive a picture stitching instruction.

S303. Enter a picture stitching mode.

S304. Initialize a default stitching template, and display the default stitching after initialization.

At this point, the preview image of the framing will be displayed in the form of a small window outside the splicing template;

S305. Wait and receive an operation instruction.

S306. Determine whether the type of the received operation instruction is a drag instruction. If yes, execute step S307; otherwise, perform step 308.

S307. Add, delete, or replace the spliced material in the splicing template according to the specific operation of the user, or modify the order of the spliced materials, and store the result of the operation in the buffer area, and perform step S305.

Specifically, the implementation manner of step S307 is as follows:

S3071, adding the splicing material to the splicing template, the operation can be implemented by sliding the screen from the splicing material (ie, preview picture) displayed outside the splicing template in the mobile terminal to the splicing frame specified in the splicing template. The stitched data is added to the stitched data pool, where the stitched data is data containing the stitched material.

S3072, the splicing material is deleted from the splicing template, and the operation can be performed by sliding the splicing material out of the splicing frame from a splicing frame of the splicing template. The stitched data corresponding to the stitched material is removed from the data pool.

S3073, replacing the stitching material in a splicing frame of the splicing template, can overwrite the existing splicing material by directly dragging the new splicing material from outside the splicing frame. This operation can be considered as a combination of (1) and (2) to remove the old stitched material from the stitching frame and then add a new stitching material.

S3074, the order of splicing pictures is modified. This operation can be implemented by placing a finger in two splicing frames and performing a finger folding operation.

It should be noted that each time after the above actions are performed, the spliced data in the spliced data pool and its changes will be stored in the buffer area.

S308. Determine whether the type of the received operation instruction is a template replacement instruction, and if yes, execute Step S309, otherwise step S310 is performed.

S309. Replace the splicing template selected by the user with the default splicing template, and display the template selected by the user, and perform step S305.

S310. Determine whether the received operation instruction is an end instruction. If yes, execute step S311, otherwise execute step S305.

S311: splicing and synthesizing the current splicing template and the splicing material.

In practical applications, the user can preview the effect of the stitching after splicing the image into the process, and after the stitching is completed, so that it is possible to find out whether the processed image is ideal in time, and when the image is not satisfactory, it can be timely. Re-framing and taking pictures at the shooting scene until you get the ideal picture.

An embodiment of the present invention provides a computer storage medium, where the computer storage medium stores executable instructions, and the executable instructions are used to execute the method for sharing pictures shown in FIG. 1.

A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to the program instructions. The foregoing program may be stored in a computer readable storage medium, and the program is executed when executed. The foregoing storage medium includes: a mobile storage device, a random access memory (RAM), a read-only memory (ROM), a magnetic disk, or an optical disk. A medium that can store program code.

Alternatively, the above-described integrated unit of the present invention may be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as a standalone product. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product, which is stored in a storage medium and includes a plurality of instructions for making A computer device (which may be a personal computer, server, or network device, etc.) performs all or part of the methods described in various embodiments of the present invention. The foregoing storage medium includes various media that can store program codes, such as a mobile storage device, a RAM, a ROM, a magnetic disk, or an optical disk.

The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the appended claims.

Claims

A method of image processing, comprising:

Displaying a preview image of the framing in real time, and the preview image is an alternative splicing material;

Receiving a picture stitching instruction and entering a picture stitching mode;

Receiving an operation instruction;

According to the operation instruction, the selected mosaic material is combined with the user-selected mosaic template.
The method according to claim 1, wherein the splicing material to be selected is combined with the splicing template selected by the user, including:

Determining the type of the operation instruction;

If the operation instruction is a template selection instruction or a template replacement instruction, initializing the selected mosaic template, and displaying the mosaic template after initialization;

If the operation instruction is a drag instruction, adding or modifying the spliced material in the splicing template according to a user operation, and storing the result of the operation in a buffer area;

If the operation instruction is an end instruction, a preset splicing algorithm is called, and the splicing template and the splicing material are spliced and combined according to the data in the buffer area.
The method according to claim 2, wherein the adding or modifying the spliced material in the splicing template according to a specific operation and storing the result of the operation to the buffer area comprises:

Dragging the candidate stitching material into the stitching template according to a user operation, and storing data of the candidate stitching material into the buffer area; or

Removing the stitched material in the stitching template according to a user operation, and deleting data of the removed stitching material from the buffer area; or

Dragging the candidate stitching material into the stitching template to replace the existing stitching material according to an operation of the user, deleting data of the replaced stitching material from the buffer area, and deleting the candidate The data of the stitched material is stored in the buffer area; or

Modifying the order of the stitched materials in the stitching template according to the operation of the user, and modifying the data in the buffer area accordingly.
The method according to any one of claims 1 to 3, wherein after the splicing material to be selected is combined with the splicing template selected by the user, the method further comprises:

Displaying an effect map of the synthesizing process and prompting the user to select whether to store the result of the synthesizing process;

The result of the synthesis process is stored or deleted according to the user's selection.
A device for image processing, the device comprising:

a display unit configured to display a preview image of the framing, the preview image being an alternate spliced material;

a receiving unit, configured to receive a picture stitching instruction when the display unit displays a preview picture;

The processing unit is configured to enter the picture stitching mode after the receiving unit receives the picture stitching instruction;

The receiving unit is further configured to receive an operation instruction after the processing unit enters the splicing mode;

The processing unit is further configured to perform a synthesis process on the selected splicing material and the splicing template selected by the user according to the receiving operation instruction received by the receiving unit.
The apparatus of claim 5 wherein said processing unit comprises:

a determining module configured to determine a type of an operation instruction received by the receiving unit;

An execution module, configured to initialize a splicing template selected by a user when the determining module determines that the operation instruction is a template selection instruction or a template replacement instruction;

The display unit is further configured to display the splicing template after the execution module initializes the splicing template selected by the user;

The execution module is further configured to: when the determining module determines that the operation instruction is a drag instruction, add or modify a spliced material in the splicing template according to a user operation, and The result of the operation is stored in the buffer area;

When the determining module determines that the operation instruction is an end instruction, the preset splicing algorithm is called, and the splicing template and the splicing material are spliced and combined according to the data in the buffer area.
The apparatus according to claim 6, wherein the execution module comprises a trigger submodule, a first execution submodule, a second execution submodule, a third execution submodule, and a fourth execution submodule;

The triggering submodule is configured to trigger the first execution submodule, the second execution submodule, the third execution submodule, and the fourth execution submodule according to a user operation when the operation instruction is a drag instruction A submodule in:

The first execution sub-module is configured to drag an alternate mosaic material into the mosaic template as a mosaic material, and store data of the candidate mosaic material into the buffer area;

The second execution sub-module is configured to remove the mosaic material in the mosaic template, and delete data of the removed mosaic material from the buffer area;

The third execution sub-module is configured to replace the existing mosaic material in the mosaic template by dragging the candidate mosaic material, and delete the data of the replaced mosaic material from the buffer area, and Data of the alternative spliced material is stored in the buffer area;

The fourth execution submodule is configured to modify an order of the stitched materials in the stitching template, and modify data in the buffer area accordingly.
The apparatus according to claim 6 or 7, wherein

The display unit is further configured to display an effect diagram of the synthesizing process and prompt the user to select whether to store the result of the synthesizing process;

The processing unit is further configured to store or delete a result of the synthesizing process according to a user's selection.
A mobile terminal comprising the apparatus for picture processing according to any one of claims 5 to 8.
A computer storage medium storing executable instructions in the computer storage medium, The executable instructions are for performing the method of picture processing according to any one of claims 1 to 4.