CN113467906A

CN113467906A - Picture processing method, device, equipment and storage medium

Info

Publication number: CN113467906A
Application number: CN202110678523.1A
Authority: CN
Inventors: 杜宏辉
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2021-06-18
Filing date: 2021-06-18
Publication date: 2021-10-01

Abstract

The present disclosure relates to a picture processing method, apparatus, device and storage medium, the method uploads pictures to be processed to a queue to be processed according to the arrangement order of the pictures to be processed; under the condition that the preset service processing condition is met, reading a preset number of pictures to be processed from the queue to be processed and inputting the pictures to the service processing assembly, performing service processing through the service processing assembly to obtain a corresponding picture processing result, and updating the state information of the service processing assembly after the service processing; and outputting the picture processing result. Therefore, the whole picture processing process does not need to depend on a server, only needs one registration of the service processing assembly, reduces the performance consumption of the browser, does not have the problem of page blocking during batch picture processing, and has high picture processing effect.

Description

Picture processing method, device, equipment and storage medium

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a method, an apparatus, a device, and a storage medium for processing an image.

Background

In a web page, image processing requirements such as image clipping, beautification, special effects and the like often occur.

In the related art, on one hand, the picture processing logic runs in a background server, and heavily depends on the server, and the picture processing is more costly and has a larger pressure on the server. In addition, the image processing interface request is an asynchronous process, the transmission between the server and the browser has time difference, and a long waiting time is needed between the uploading of the image and the acquisition of the processed image by the user.

On the other hand, pictures are processed through JavaScript in a web page, however, JavaScript runs in a single-thread mode in a browser, and cannot run multiple scripts simultaneously, that is, only a single picture can be processed through JavaScript. Taking picture clipping as an example, when a user uses a function of clipping pictures on a web page, the user can only load, clip, and export one picture, and a clipping component needs to be registered each time a single picture is clipped, the registration process is time-consuming and consumes browser performance, and particularly when more pictures are clipped simultaneously, the problem of page jamming is likely to occur. In addition, since the loading, clipping, and the like of the picture are asynchronous processes, who generates the picture first and who derives the picture first, the order of the picture result output has uncertainty, and the abnormal problem occurring in the clipping process is difficult to capture.

Disclosure of Invention

The present disclosure provides a method, an apparatus, a device and a storage medium for processing a picture, so as to solve at least one of the problems of low picture processing efficiency, delay, dead page, uncertain picture processing sequence, difficulty in capturing and processing exception, and the like in the related art. The technical scheme of the disclosure is as follows:

according to a first aspect of the embodiments of the present disclosure, there is provided an image processing method, including:

uploading the pictures to be processed to a queue to be processed according to the arrangement sequence of the pictures to be processed;

under the condition that the state information of the queue to be processed and the service processing assembly meets the service processing condition, reading a preset number of pictures to be processed from the queue to be processed and inputting the pictures to the service processing assembly, performing service processing on the input pictures to be processed through the service processing assembly to obtain a corresponding picture processing result, and updating the state information of the service processing assembly after the service processing;

and outputting the picture processing result.

As an optional implementation manner, the outputting the picture processing result includes:

storing the picture processing result to a result queue according to the arrangement sequence of the pictures to be processed;

and outputting the picture processing result read from the result queue.

As an optional implementation manner, the reading a preset number of pictures to be processed from the queue to be processed and inputting the pictures to the service processing component includes:

reading a preset number of pictures to be processed from the queue to be processed according to the queue sequence;

and inputting the read to-be-processed picture into the business processing assembly, and removing the input to-be-processed picture from the to-be-processed queue.

As an optional implementation manner, the performing, by the service processing component, service processing on the input to-be-processed picture to obtain a corresponding picture processing result includes:

performing service processing on the input picture to be processed through the service processing component;

capturing an abnormal to-be-processed picture corresponding to the abnormal service processing under the condition that the abnormal service processing is detected, and performing corresponding abnormal processing according to a preset abnormal processing strategy to obtain a corresponding picture processing result;

and under the condition that the normal business processing is detected, taking the picture after the business processing as the corresponding picture processing result.

As an optional implementation manner, in a case that the business process includes a cropping process, the performing, by the business process component, the business process on the input to-be-processed picture includes:

acquiring picture cutting parameter information of the picture to be processed, wherein the picture cutting parameter information comprises a target cutting size and a cutting starting point coordinate;

and drawing the picture to be processed to a canvas label for cutting according to the cutting start point coordinate, wherein the size of the canvas corresponding to the canvas label is the same as the target cutting size.

As an optional implementation manner, the performing corresponding exception handling according to a preset exception handling policy to obtain a corresponding picture handling result includes:

throwing out service processing exception information, wherein the service processing exception information comprises an exception identifier of an exception to-be-processed picture corresponding to the occurrence of the service processing exception;

stopping the subsequent picture processing step, and sending the prompt message carrying the abnormal identifier to a user; or generating an abnormal mark corresponding to the abnormal to-be-processed picture, and taking the abnormal mark as the corresponding picture processing result.

As an optional implementation manner, the preset service processing condition includes that a to-be-processed picture which is not input to the service processing component for service processing is stored in the to-be-processed queue, and the state information of the service processing component is in an idle state;

the picture processing ending condition comprises at least one of the pictures to be processed in the queue to be processed executing service processing, abnormal service processing and interrupted picture processing.

According to a second aspect of the embodiments of the present disclosure, there is provided a picture processing apparatus including:

the uploading module is configured to upload the pictures to be processed to a queue to be processed according to the arrangement sequence of the pictures to be processed;

the processing module is configured to read a preset number of pictures to be processed from the queue to be processed and input the pictures to be processed to the business processing component under the condition that the monitoring that the state information of the queue to be processed and the business processing component meets the business processing condition; performing service processing on the input picture to be processed through the service processing component to obtain a corresponding picture processing result, and updating the state information of the service processing component after the service processing;

and the result output module is configured to output the picture processing result.

As an optional implementation, the result output module includes:

the storage unit is configured to store the picture processing result to a result queue according to the arrangement sequence of the pictures to be processed;

and the output unit is configured to output the picture processing result read from the result queue.

As an optional implementation, the processing module includes:

the first processing submodule is configured to read a preset number of pictures to be processed from the queue to be processed according to the queue sequence;

and the second processing submodule is configured to input the read to-be-processed picture into the business processing assembly and remove the input to-be-processed picture from the to-be-processed queue.

As an optional implementation, the processing module includes:

the third processing submodule is configured to execute business processing on the input picture to be processed through the business processing component;

the fourth processing submodule is configured to capture an abnormal to-be-processed picture corresponding to the abnormal service processing under the condition that the abnormal service processing is detected, and perform corresponding abnormal processing according to a preset abnormal processing strategy to obtain a corresponding picture processing result;

and the fifth processing submodule is configured to execute that the picture after the business processing is taken as the corresponding picture processing result under the condition that the normal business processing is detected.

As an optional implementation manner, in a case that the business process includes a clipping process, the third processing sub-module includes:

an obtaining unit configured to perform obtaining picture cropping parameter information of the picture to be processed, the picture cropping parameter information including a target cropping size and a cropping start point coordinate;

and the first processing unit is configured to execute drawing the picture to be processed to a canvas label according to the cutting start point coordinate so as to perform cutting processing, wherein the canvas size corresponding to the canvas label is the same as the target cutting size.

As an optional implementation, the root fourth processing submodule includes:

the system comprises a throwing unit, a processing unit and a processing unit, wherein the throwing unit is configured to execute throwing of abnormal service processing information, and the abnormal service processing information comprises an abnormal identifier of an abnormal to-be-processed picture corresponding to the abnormal service processing;

the second processing unit is configured to execute the step of stopping subsequent picture processing and send the prompt message carrying the abnormal identifier to a user; or generating an abnormal mark corresponding to the abnormal to-be-processed picture, and taking the abnormal mark as the corresponding picture processing result.

According to a third aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, wherein instructions, when executed by a processor of an electronic device, enable the electronic device to perform the picture processing method according to any one of the above embodiments.

According to a fourth aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the picture processing method according to any of the above embodiments.

According to a fifth aspect of embodiments of the present disclosure, there is provided a computer program product, the computer program product comprising a computer program, the computer program, when executed by a processor, implementing the picture processing method provided in any one of the above-mentioned embodiments.

The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:

according to the method and the device for processing the pictures, the pictures to be processed are uploaded to a queue to be processed according to the arrangement sequence of the pictures to be processed; under the condition that the state information of the queue to be processed and the service processing assembly meets the preset service processing condition, reading a preset number of pictures to be processed from the queue to be processed and inputting the pictures to the service processing assembly, performing service processing on the input pictures to be processed through the service processing assembly to obtain a corresponding picture processing result, and updating the state information of the service processing assembly after the service processing; and outputting the picture processing result. Therefore, the whole picture processing process can be executed at a web end, the picture processing is not required to be carried out by depending on a server, the processing pressure of the server is reduced, and the time difference and the low delay of the picture transmission of a server interface do not exist. In addition, by setting the queue to be processed and updating the state information of the business processing assembly after the business processing assembly executes the business processing once, only one registration of the business processing assembly is needed in the whole image processing process, the performance consumption of the browser is reduced, the problem of page blocking does not exist during batch picture processing, and the picture processing effect is high.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

Fig. 1 is a flowchart illustrating a picture processing method according to an exemplary embodiment.

Fig. 2 is a flow chart illustrating steps of a business process according to an exemplary embodiment.

Fig. 3 is a flow diagram illustrating the output of a picture processing result according to an example embodiment.

Fig. 4 is an overall flowchart illustrating a picture processing method according to an exemplary embodiment.

Fig. 5 is a block diagram illustrating a picture processing apparatus according to an exemplary embodiment.

Fig. 6 is a block diagram illustrating a picture processing apparatus according to an exemplary embodiment.

FIG. 7 is a block diagram illustrating an electronic device in accordance with an example embodiment.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

Fig. 1 is a flowchart illustrating a picture processing method according to an exemplary embodiment. The image processing method can be applied to a terminal device, and the terminal device can be, but is not limited to, an entity device such as a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart wearable device, a digital assistant, an augmented reality device, a virtual reality device, or one or more of an application program and an applet running in the entity device. As shown in fig. 1, the picture processing method includes the following steps.

In step S101, the to-be-processed pictures are uploaded to the to-be-processed queue according to the arrangement order of the to-be-processed pictures.

The queue to be processed is used for storing pictures to be processed. A pending queue is a data structure that has a first-in-first-out characteristic. The pictures to be processed in the queue to be processed are arranged according to the uploading sequence, that is, the queue to be processed is a queue in which the pictures to be processed are arranged according to the first-in first-out sequence.

In practical applications, to-be-processed picture data including a plurality of to-be-processed pictures (such as img1, img2, img3, and the like) may be obtained first, where the obtaining manner includes but is not limited to shooting, scanning, downloading, recording, and the like, and then the to-be-processed picture data is uploaded through the web end, so that the web end obtains the to-be-processed picture, and a subsequent picture processing process is performed at the web end.

The picture data may specifically be a picture set, a picture stream, or the like. The picture set may be a plurality of pictures obtained by shooting, scanning, downloading, and the like. The picture stream may be a continuous video frame picture obtained by shooting, recording, downloading, and the like. The task type corresponding to the task processing can be emotion bag making, special effect processing and the like. Each task type can correspond to at least one business process, and the business type corresponding to the business process can include but is not limited to at least one of cutting, beautifying, special effects, matting and the like.

Each picture to be processed has its specific sorting order in the picture data. For example, for a picture set, the pictures may be sorted according to the order of the acquisition timestamps of the pictures, or may be sorted according to the names of the pictures, the sizes of the pictures, and the like. For the picture stream, the arrangement order of the pictures to be processed may be the time stamp sequence of each frame of picture. The picture types of the pictures to be processed may be the same or different, and this disclosure does not specifically limit this.

Alternatively, after the pictures to be processed are obtained, the pictures to be processed may be uploaded to the queue to be processed by, for example, an uploading component according to the arrangement order of the pictures to be processed in the picture data in response to the execution of the business processing task, without directly executing the business processing on the pictures to be processed. For example, in the queue to be processed, each picture to be processed has its corresponding arrangement position identifier, and the arrangement position identifiers may correspond to the picture identifiers of the pictures to be processed one to one, that is, the corresponding pictures to be processed can be obtained through the arrangement position identifiers. The permutation position identification may be an index value.

At least one pending queue may be set for different traffic types. Each queue to be processed may correspond to different service types, and each queue to be processed may correspond to at least one service processing component. Taking the service cutting as an example, the corresponding queue to be processed is the queue to be cut, and the corresponding service processing component is the cutting component. Of course, a pending queue may be shared by a plurality of different traffic types.

In step S103, under the condition that it is monitored that the state information of the queue to be processed and the service processing component satisfy the service processing condition, a preset number of pictures to be processed are read from the queue to be processed and input to the service processing component, the input pictures to be processed are subjected to service processing by the service processing component, a corresponding picture processing result is obtained, and the state information of the service processing component is updated after the service processing.

Optionally, when at least one to-be-processed picture in the picture data is uploaded to the to-be-processed queue, a listening thread in the browser may be triggered to start working. The monitoring thread is used for executing the general checking logic to monitor whether the state information of the queue to be processed and the registered business processing assembly meets the preset business processing condition.

For example only, the service processing condition may include that a pending picture which is not input to the service processing component for service processing is stored in the pending queue, and the state information of the service processing component is an idle state. At this time, the listening thread may specifically execute: monitoring whether the pending pictures which are not input to the service processing assembly for service processing are stored in the pending queue, and monitoring whether the state information of the service processing assembly is in an idle state. Under the condition that the state information of the queue to be processed and the service processing assembly meets the service processing condition, a preset number of pictures to be processed can be read from the queue to be processed and input to the service processing assembly, so that the service processing assembly can conveniently process the input pictures to be processed. The preset number may be one or several, and the preset number M may be at least 1/2, which is smaller than the total number of all the pictures to be processed in the picture data, or even lower. Then, the business processing component performs business processing on the input picture to be processed to obtain a corresponding picture processing result, and updates the state information of the business processing component after the business processing.

The service processing component may be a service processing component that has been registered in advance, or a service processing component that is registered before the browser performs the first data exchange with the service processing component. The business process component may only need to register once during the entire picture processing process.

In an optional embodiment, the reading a preset number of to-be-processed pictures from the to-be-processed queue and inputting the to-be-processed pictures to the service processing component includes: reading a preset number of pictures to be processed from the queue to be processed according to the queue sequence; and inputting the read to-be-processed picture into the business processing assembly, and removing the input to-be-processed picture from the to-be-processed queue.

The queue sequence is used for representing the arrangement sequence of the pictures to be processed in the queue to be processed. As shown in fig. 4, the queue order is img1, img2, and img3. When the input step is executed, taking a preset number as an example, according to the queue order, the img1 in the queue to be processed is firstly input into the business processing component, so as to perform business processing on the img1 in the business processing component, after the img1 is input into the business processing component, the image to be processed (for example, the img1) which has been input can be removed from the queue to be processed, and at this time, the image to be processed in the queue to be processed can be updated to the img2 and the img3.

Of course, in other embodiments, the to-be-processed queue may be notified to input one to-be-processed picture to the service processing component according to the queue order, the step of removing the already-input to-be-processed picture from the to-be-processed queue may not be continuously performed, but an arrangement position sequence number n of the to-be-processed picture currently input to the service processing component may be recorded, where n is a positive integer, or the to-be-processed picture already input to the service processing component may be marked, so that when one to-be-processed picture needs to be input next time, the to-be-processed picture corresponding to the arrangement position sequence number n +1 may be input, or the first unmarked to-be-processed picture with the top sequence may be input.

Optionally, the service processing component determines according to a service type corresponding to the service processing. Illustratively, if the service type is a clipping service, the corresponding service processing component is a clipping component.

Before the service processing component executes service processing, the service processing component is in an idle state, that is, the service processing component does not perform service processing on other pictures. When the service processing component receives the input to-be-processed picture, the working state can be started, corresponding service processing (such as clipping processing) is executed on the input to-be-processed picture, and a corresponding picture processing result is obtained. The picture processing result may include any of a clipped picture, clipping abnormality information, and the like. After the input to-be-processed picture is processed, the working state of the service processing component can be closed, that is, the state information of the service processing component is adjusted from the working state to the idle state.

In an optional embodiment, as shown in fig. 2, the performing, by the service processing component, service processing on the input to-be-processed picture to obtain a corresponding picture processing result may include:

in step S201, the input to-be-processed picture is processed by the business processing component.

Optionally, after the service processing component receives the picture to be processed, the corresponding service processing task is started, and the corresponding service processing task can be executed according to the obtained service processing parameter. The service processing parameter includes service processing parameter information, service processing object information, and the like.

For example only, the business process parameter information is used to indicate the content of the parameter that needs to be executed on the object to be processed, and may include a business process size, a business process location coordinate, and the like. And performing corresponding service processing tasks on the pictures to be processed according to the service processing parameter information.

The business process object information is used to indicate a target object that needs to be processed, and the target object may be, for example, a whole body image of a person, an avatar of a person, a body part of a person (e.g., a hand, an eye, etc.), or the like. And identifying the target object in the picture to be processed through the service processing object information, and further executing a corresponding service processing task on the identified target object.

For example, in a case that the business process includes a cropping process, the business process performed on the input to-be-processed picture by the business process component may include: acquiring picture cutting parameter information of the picture to be processed, wherein the picture cutting parameter information comprises a target cutting size and a cutting starting point coordinate; and drawing the picture to be processed to a canvas label for cutting according to the cutting start point coordinate, wherein the size of the canvas corresponding to the canvas label is the same as the target cutting size.

The target cutting size comprises information such as width, height, shape and pixel of the cut picture. For different pictures to be processed, the corresponding target cropping sizes can be the same or different.

The clipping start point coordinate may be a position coordinate of a pixel point of the clipped picture, and may be, for example but not limited to, a position coordinate corresponding to an upper left corner, a position coordinate corresponding to an upper right corner, a position coordinate corresponding to a lower left corner, a position coordinate corresponding to a lower right corner, a position coordinate corresponding to a picture center point, and the like.

The Canvas tag is used for performing clipping processing on the picture to be processed, and can be, but is not limited to, a Canvas tag. Among them, the Canvas tag is a tag in the HTML5 standard, and a drawing Application Programming Interface (API) provided by the Canvas tag can directly call resources in the picture processing unit. The Canvas label is a container for drawing the image, can read the picture content therein, and can achieve the requirements of operating the width and the height or the definition of the picture by operating each pixel point in the picture, and finally output a new image.

In practical application, taking a Canvas tag as an example, after obtaining the picture cutting parameter information of the picture to be processed, the picture cutting parameter information comprises a target cutting size and a cutting start point coordinate; and drawing the picture to be processed to a Canvas label according to the cutting start point coordinates (x, y), wherein the Canvas size corresponding to the Canvas label is the same as the target cutting size, and the picture to be processed is drawn to the Canvas label, namely the cutting processing of the picture to be processed is executed.

In step S202, when a service processing exception is detected, an exception to-be-processed picture corresponding to the occurrence of the service processing exception is captured, and corresponding exception processing is performed according to a preset exception processing policy, so as to obtain a corresponding picture processing result.

The exception handling policy may be a customized policy executed by a developer on an exception. As shown in fig. 4, according to the difference of the exception handling policy, the corresponding exception handling is performed according to the preset exception handling policy, and obtaining the corresponding picture processing result may include the following two processing manners:

in a first processing manner, the performing corresponding exception handling according to a preset exception handling policy to obtain a corresponding picture handling result may include:

in step S2021, service processing exception information is thrown out, where the service processing exception information includes an exception identifier of an exception to-be-processed picture corresponding to the occurrence of the service processing exception;

in step S2022, the subsequent picture processing step is stopped, and the prompt information carrying the abnormal identifier is sent to the user.

In practical application, under the condition that the abnormal business processing is detected, the abnormal business processing information can be thrown out, so that developers can intercept and capture the abnormal information. And then, executing a first exception handling strategy, namely stopping the subsequent picture processing steps, and sending an exception identifier carrying an exception to-be-processed picture corresponding to the abnormal service handling to the user, wherein the exception identifier can correspond to the picture identifier of the to-be-processed picture, so that the user can quickly know which to-be-processed picture in the picture data is the exception to-be-processed picture according to the exception identifier, and further, corresponding remedial measures can be conveniently executed, such as re-uploading the exception to-be-processed picture, replacing the exception to-be-processed picture and the like.

In a second processing manner, the performing corresponding exception handling according to the preset exception handling policy to obtain the corresponding picture processing result may include:

in step S2021', throw out service processing exception information, where the service processing exception information includes an exception identifier of an exception to-be-processed picture corresponding to the occurrence of the service processing exception;

in step S2022', an abnormal flag corresponding to the abnormal to-be-processed picture is generated, and the abnormal flag is used as the corresponding picture processing result.

In practical application, under the condition that the abnormal business processing is detected, the abnormal business processing information can be thrown out, so that developers can intercept and capture the abnormal information. Then, a second exception handling policy may be executed, that is, an exception flag corresponding to the exception to-be-handled picture is generated, and the exception flag is used as the corresponding picture handling result. Illustratively, the exception marker may be a placeholder.

In step S203, in the case that it is detected that the service processing is normal, the picture after the service processing is taken as the corresponding picture processing result.

Optionally, when it is detected that the service processing is normal, the image after the service processing may be used as the corresponding image processing result and output.

In practical applications, the foregoing corresponding exception handling according to the preset exception handling policy may be implemented by a callback function, and the pseudo code of the callback function may be as follows:

according to the embodiment, the to-be-processed pictures can be subjected to one-piece business processing through the business processing assembly, abnormity occurs in the business processing process, abnormity corresponding to the to-be-processed pictures can be captured in time, and then follow-up pertinence abnormity can be conveniently and timely solved. In addition, under the condition that the abnormal business processing is detected, corresponding abnormal processing is carried out according to a preset abnormal processing strategy, customized abnormal processing can be realized, the picture processing process is flexible, and different application scene requirements can be met.

Reading a preset number of pictures to be processed in the queue to be processed after the execution is finished, inputting the pictures to be processed into the service processing assembly, carrying out service processing on the input pictures to be processed through the service processing assembly to obtain a corresponding picture processing result, and continuously monitoring whether the state information of the queue to be processed and the service processing assembly meets a service processing condition or not after the step of updating the state information of the service processing assembly after the service processing; and if the condition that the state information of the queue to be processed and the service processing assembly meets the service processing condition is monitored, the step of inputting the state information to the service processing assembly and the step of obtaining the picture processing result and updating the state information of the service processing assembly are repeatedly executed until the picture processing end condition is reached.

The picture processing end condition comprises at least one of the pictures to be processed in the queue to be processed executing service processing, abnormal service processing and interrupted picture processing.

Optionally, in case of obtaining the picture processing result, the listening thread may be triggered to start working. Under the condition that a monitoring thread monitors that the state information of the queue to be processed and the service processing assembly meets a preset service processing condition, the queue to be processed is continuously informed to input a preset number of pictures to be processed to the service processing assembly, the input pictures to be processed are processed through the service processing assembly to obtain a corresponding picture processing result, the state information of the service processing assembly is updated after service processing, namely, the step of inputting the pictures to the service processing assembly is repeatedly executed, the processing step of obtaining the picture processing result and updating the state information of the service processing assembly is executed, and the next picture processing process is realized until the picture processing end condition is reached.

In step S105, the picture processing result is output.

It should be noted that, in the step of outputting the picture processing result, the picture processing result may be output after each round of the picture processing process in step S103 is executed, that is, the picture processing result corresponding to each round of the processed picture may be sequentially output, and it is not necessary to output all the picture processing results after the picture processing end condition is reached.

In an alternative embodiment, as shown in fig. 3, the outputting the picture processing result may include:

in step S301, the picture processing result is stored in a result queue according to the arrangement order of the pictures to be processed.

The result queue is used for storing the picture processing result, namely, the cut picture, the special-effect picture, the beautified picture and the like. The result queue is also a data structure having a first-in-first-out characteristic. The pictures to be processed in the result queue are arranged according to the sequence of the picture processing results output from the service processing component, that is, the result queue is a queue in which the picture processing results are arranged according to the first-in first-out sequence.

Optionally, in the process of processing the pictures, for the pictures to be processed without abnormal service processing, the picture processing results (e.g., imgDate1(from img1), imgDate2(from img2), and imgDate3(from img 3)) may be stored in the corresponding queue positions in the result queue according to the arrangement order of the pictures to be processed, that is, the output order of the picture processing results corresponding to the service processing component. For a to-be-processed picture with abnormal service processing, an abnormal mark (e.g., a placeholder) may be recorded at a queue position corresponding to the abnormal to-be-processed picture.

In step S302, the picture processing result read from the result queue is output.

Optionally, the picture processing result may be read from the result queue by an onSuccess () function and output.

According to the embodiment, the result queue is arranged to store the picture processing results in sequence, and the to-be-processed queue is matched to store the to-be-processed pictures in sequence, so that the pictures can be output in sequence, the subsequent further processing steps can be directly performed according to the sequentially processed pictures, the reordering steps are reduced, especially under the condition that the number of the to-be-processed pictures is large, the workload of the picture processing process is greatly reduced, and the picture processing efficiency is improved.

According to the image processing method and device, the image data to be processed are obtained, and the image data comprise a plurality of images to be processed; uploading the pictures to be processed to a queue to be processed according to the arrangement sequence of the pictures to be processed in the picture data; under the condition that the state information of the queue to be processed and the service processing assembly is monitored to meet the preset service processing condition, informing the queue to be processed to input a preset number of pictures to be processed to the service processing assembly; performing service processing on the input picture to be processed through the service processing component to obtain a corresponding picture processing result, and updating the state information of the service processing component after the service processing; repeatedly executing the input step and the service processing step until the picture processing end condition is reached; and outputting a picture processing result corresponding to the picture data. Therefore, the whole picture processing process can be executed at a web end, the picture processing is not required to be carried out by depending on a server, the processing pressure of the server is reduced, and the time difference and the low delay of the picture transmission of a server interface do not exist. In addition, by setting the queue to be processed and updating the state information of the business processing assembly after the business processing assembly executes the business processing once, only one registration of the business processing assembly is needed in the whole image processing process, the performance consumption of the browser is reduced, the problem of page blocking does not exist during batch picture processing, and the picture processing effect is high.

In an optional embodiment, the picture processing method may further include:

and synthesizing the output picture processing result according to the task type to obtain synthesized picture processing data.

The task types may include emoticon making, special effects processing, and the like.

In practical application, for example, the emotion bag system is used, and after the to-be-processed picture data uploaded to the web end by the user is processed, a picture processing result is obtained. Then, according to the attribute of the expression package, synthesizing the picture processing results corresponding to each output picture to be processed to obtain synthesized picture processing data, that is, to obtain the produced expression package.

According to the embodiment, the picture processing results are output in sequence, and the output sequence has certainty, so that the output picture processing results can be directly subjected to one-key production of the expression package, additional sequencing is not needed, the processing steps for producing the expression package are reduced, the use is convenient, and the overall picture processing efficiency is improved.

Fig. 5 is a block diagram illustrating a picture processing apparatus according to an exemplary embodiment. Referring to fig. 5, the apparatus is applied to an electronic device, and includes:

an upload module 510 configured to upload the to-be-processed pictures to a to-be-processed queue according to the arrangement order of the to-be-processed pictures;

the processing module 520 is configured to read a preset number of pictures to be processed from the queue to be processed and input the pictures to be processed to the service processing component when it is monitored that the status information of the queue to be processed and the service processing component meets the service processing condition; performing service processing on the input picture to be processed through the service processing component to obtain a corresponding picture processing result, and updating the state information of the service processing component after the service processing;

a result output module 530 configured to perform outputting the picture processing result.

As an alternative implementation, as shown in fig. 6, the result output module 530 includes:

a storage unit 531 configured to store the picture processing result to a result queue according to the arrangement order of the pictures to be processed;

an output unit 532 configured to perform outputting the picture processing result read from the result queue.

As an optional implementation, the processing module 520 includes:

As an optional implementation, the root fourth processing submodule includes:

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

FIG. 7 is a block diagram illustrating an electronic device in accordance with an example embodiment. Referring to fig. 7, an electronic device includes a processor; a memory for storing processor-executable instructions; the processor is configured to implement the steps of any of the image processing methods in the above embodiments when executing the instructions stored in the memory.

The electronic device may be a terminal, a server or a similar computing device, taking the electronic device as an example of a terminal, and fig. 7 is a block diagram of an electronic device for picture processing according to an exemplary embodiment, specifically:

the terminal may include RF (Radio Frequency) circuitry 710, memory 720 including one or more computer-readable storage media, input unit 730, display unit 740, sensor 750, audio circuitry 760, WiFi (wireless fidelity) module 770, processor 780 including one or more processing cores, and power supply 790. Those skilled in the art will appreciate that the terminal structure shown in fig. 7 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:

RF circuit 710 may be used for receiving and transmitting signals during a message transmission or call, and in particular, for receiving downlink information from a base station and processing the received downlink information by one or more processors 780; in addition, data relating to uplink is transmitted to the base station. In general, RF circuit 710 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like. In addition, the RF circuit 710 may also communicate with a network and other terminals through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), and the like.

The memory 720 may be used to store software programs and modules, and the processor 780 performs various functional applications and data processing by operating the software programs and modules stored in the memory 720. The memory 720 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, application programs required for functions, and the like; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 720 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, memory 720 may also include a memory controller to provide access to memory 720 by processor 780 and input unit 730.

The input unit 730 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, the input unit 730 may include a touch-sensitive surface 731 as well as other input devices 732. Touch-sensitive surface 731, also referred to as a touch display screen or touch pad, can collect touch operations by a user on or near touch-sensitive surface 731 (e.g., operations by a user on or near touch-sensitive surface 731 using a finger, stylus, or any other suitable object or attachment) and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface 731 may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts it to touch point coordinates, and sends the touch point coordinates to the processor 780, and can receive and execute commands from the processor 780. In addition, the touch-sensitive surface 731 can be implemented in a variety of types, including resistive, capacitive, infrared, and surface acoustic wave. The input unit 730 may also include other input devices 732 in addition to the touch-sensitive surface 731. In particular, other input devices 732 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 740 may be used to display information input by or provided to the user and various graphic user interfaces of the terminal, which may be configured by graphics, text, icons, video, and any combination thereof. The Display unit 740 may include a Display panel 741, and optionally, the Display panel 741 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, touch-sensitive surface 731 can overlay display panel 741, such that when touch-sensitive surface 731 detects a touch event thereon or nearby, processor 780 can determine the type of touch event, and processor 780 can then provide a corresponding visual output on display panel 741 based on the type of touch event. Where the touch-sensitive surface 731 and the display panel 741 may be implemented as two separate components, input and output functions, but in some embodiments the touch-sensitive surface 731 and the display panel 741 may be integrated to implement input and output functions.

The terminal may also include at least one sensor 750, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel 741 according to the brightness of ambient light, and a proximity sensor that may turn off the display panel 741 and/or a backlight when the terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when the terminal is stationary, and can be used for applications of recognizing terminal gestures (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal, detailed description is omitted here.

Audio circuitry 760, speaker 761, and microphone 762 may provide an audio interface between a user and the terminal. The audio circuit 760 can transmit the electrical signal converted from the received audio data to the speaker 761, and the electrical signal is converted into a sound signal by the speaker 761 and output; on the other hand, the microphone 762 converts the collected sound signal into an electric signal, converts the electric signal into audio data after being received by the audio circuit 760, processes the audio data by the audio data output processor 780, and transmits the processed audio data to, for example, another terminal via the RF circuit 710, or outputs the audio data to the memory 720 for further processing. The audio circuitry 760 may also include an earbud jack to provide communication of peripheral headphones with the terminal.

WiFi belongs to short distance wireless transmission technology, the terminal can help user send and receive e-mail, browse web page and access stream media etc. through WiFi module 770, it provides wireless broadband internet access for user. Although fig. 7 shows the WiFi module 770, it is understood that it does not belong to the essential constitution of the terminal, and can be omitted entirely as needed within the scope not changing the essence of the invention.

The processor 780 is a control center of the terminal, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the terminal and processes data by operating or executing software programs and/or modules stored in the memory 720 and calling data stored in the memory 720, thereby integrally monitoring the terminal. Optionally, processor 780 may include one or more processing cores; preferably, the processor 780 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 780.

The terminal also includes a power supply 790 (e.g., a battery) for powering the various components, which may preferably be logically coupled to the processor 780 via a power management system to manage charging, discharging, and power consumption management functions via the power management system. The power supply 790 may also include any component including one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

Although not shown, the terminal may further include a camera, a bluetooth module, and the like, which are not described herein again. In this embodiment, the terminal further includes a memory and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the one or more processors. The one or more programs include instructions for performing the virtual resource procurement methods provided by the method embodiments described above.

In an exemplary embodiment, a computer storage medium is also provided, in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform the steps of the method provided in any one of the above-described embodiments.

In an exemplary embodiment, there is also provided a computer program product comprising computer programs/instructions which, when executed by a processor, implement the method provided in any of the above embodiments. Optionally, the computer program is stored in a computer readable storage medium. The processor of the electronic device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the electronic device executes the method provided in any one of the above embodiments.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An image processing method, comprising:

and outputting the picture processing result.

2. The method according to claim 1, wherein the outputting the picture processing result comprises:

and outputting the picture processing result read from the result queue.

3. The method according to claim 1, wherein the reading a preset number of pictures to be processed from the queue to be processed and inputting the pictures to the service processing component comprises:

4. The picture processing method according to any one of claims 1 to 3, wherein the performing, by the service processing component, service processing on the input picture to be processed to obtain a corresponding picture processing result comprises:

5. The method according to claim 4, wherein in a case that the business process includes a cropping process, the business process, by the business process component, of the input picture to be processed includes:

6. The method according to claim 4, wherein the performing corresponding exception handling according to a preset exception handling policy to obtain a corresponding picture handling result comprises:

7. A picture processing apparatus, comprising:

8. An electronic device, comprising:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the picture processing method of any one of claims 1 to 6.

9. A computer-readable storage medium, wherein instructions, when executed by a processor of an electronic device, enable the electronic device to perform the picture processing method of any of claims 1 to 6.

10. A computer program product comprising a computer program, characterized in that the computer program realizes the picture processing method of any one of claims 1 to 6 when executed by a processor.