CN116939181A

CN116939181A - Image processing method, device, system, storage medium and electronic equipment

Info

Publication number: CN116939181A
Application number: CN202310998843.4A
Authority: CN
Inventors: 许俊文; 朱增
Original assignee: ONYX INTERNATIONAL Inc
Current assignee: ONYX INTERNATIONAL Inc
Priority date: 2023-08-08
Filing date: 2023-08-08
Publication date: 2023-10-24
Anticipated expiration: 2043-08-08
Also published as: CN116939181B

Abstract

The application discloses an image processing method, an image processing device, a storage medium and electronic equipment of an ink screen, wherein the method comprises the steps of obtaining frame picture data to be displayed and parameter information of the ink screen, and judging the type of the ink screen according to the parameter information, wherein the type of the ink screen comprises a black-and-white ink screen and a color ink screen; if the ink screen is a black-and-white ink screen, processing the frame picture data to obtain first intermediate image data, wherein the first intermediate image data is gray picture data; and if the ink screen is a color ink screen, processing the frame picture data to obtain second intermediate image data, wherein the second intermediate image data is color format image data. That is, the application solves the problems of single image processing function and low universality in the prior art.

Description

Image processing method, device, system, storage medium and electronic equipment

Technical Field

The embodiment of the application relates to the technical field of display, in particular to an image processing method and device of an ink screen, a storage medium and electronic equipment.

Background

The ink screen achieves a display effect close to that of conventional paper by using an electrophoresis technology, and is therefore also called "electronic paper". The ink screen generally displays pictures through electronic ink, the electronic ink is usually manufactured into an electronic ink film, the electronic ink film is composed of a large number of microcapsules, and pigment particles with different charges are arranged in the microcapsules. In the initial state, pigment particles are suspended in the microcapsules, and when an electric field in a certain direction is applied, the corresponding pigment particles are pushed to the top, the microcapsules can display different colors, and the microcapsules in different colors form various characters and patterns.

The existing Ink screen comprises a color Ink screen and a black-and-white Ink screen, and the color Ink screen mainly comprises two types, namely an Ink screen which is provided with at least two pigment particles with non-black-and-white colors in microcapsules, such as an E Ink Gallery series Ink screen developed based on an advanced color electronic paper (Advanced Color ePaper, ACeP) technical platform of the eink company; another type is an Ink screen based on a color filter array (color filter array, abbreviated as CFA), such as the E Ink Kaleido series Ink screen developed based on the technical platform of color printing electronic paper (Print Color ePaper Technology) of the eink company. The technical principles of ink screens of different hardware types are different, so that the corresponding image processing processes of the ink screens are different.

The existing image color modes comprise a gray level mode, a CMYK mode, an RGB mode, an HSB mode, a Lab mode, a bitmap mode, a prime color mode, a double-tone mode and a multi-channel mode, and in addition, as the display principle of the ink screen is different from that of other display screens, the ink screen is required to process the image before displaying the image, so that the format parameters of the image are more matched with the ink screen, and the image display effect of the ink screen is better. However, the existing image processing module can only be matched with one type of ink screen, that is, the existing image processing module can only be used on one of a black ink screen and a color ink screen, and cannot be used in both the black ink screen and the color ink screen, and the existing image processing module has the problems of single function and low universality.

Disclosure of Invention

Based on the above, the embodiment of the application provides an image processing method, an image processing device, an image processing system, a storage medium and electronic equipment of an ink screen, which solve the problems of single function and low universality of the existing image processing technology.

In a first aspect, an embodiment of the present application provides an image processing method for an ink screen, including the steps of:

Acquiring frame picture data to be displayed and parameter information of an ink screen, and judging the type of the ink screen according to the parameter information, wherein the type of the ink screen comprises a black-and-white ink screen and a color ink screen;

if the ink screen is a black-and-white ink screen, processing the frame picture data to obtain first intermediate image data, wherein the first intermediate image data is gray picture data;

and if the ink screen is a color ink screen, processing the frame picture data to obtain second intermediate image data, wherein the second intermediate image data is color format image data.

In some embodiments, the step of processing the frame image data to obtain first intermediate image data, where the first intermediate image data is gray scale image data includes:

determining whether the frame picture data is gray scale picture data,

if yes, the first intermediate image data comprises gray scale picture data of the frame picture data;

and if not, carrying out gray processing on the frame picture data to obtain the first intermediate image data, wherein the first intermediate image data is gray picture data.

In some embodiments, the image processing method further comprises the steps of:

And dithering the first intermediate image data to obtain first target image data.

In some embodiments, the step of processing the frame image data to obtain second intermediate image data, where the second intermediate image data is color format image data includes:

determining whether the frame picture data is color format image data,

if yes, the second target image data comprises color format image data of the frame picture data;

and if not, performing color conversion processing on the frame picture data to obtain second intermediate image data, wherein the second target image data is color format image data.

In some embodiments, after the step of processing the frame image data to obtain second intermediate image data if the ink screen is a color ink screen, the step of the image processing method further includes:

acquiring display mode information of the color ink screen, wherein the display modes comprise a color display mode and an achromatic display mode, judging whether the display mode information is the color display mode,

If yes, outputting the second intermediate image data;

and if not, processing the second intermediate image data to obtain third target image data, wherein the third target image data is gray scale picture data, and outputting the third target image data.

In some embodiments, the second intermediate image data includes a red component value, a green component value, and a blue component value for each pixel, the steps of the image processing method further comprising:

and mapping the red component value, the green component value and the blue component value of each pixel in the second intermediate image data according to a preset sub-pixel mapping relation to obtain second mapping image data, wherein the second mapping image data comprises the red mapping component value, the green mapping component value and the blue mapping component value of each pixel.

judging whether the color gradation value of the pixels of the second mapping image data is larger than the highest color gradation which can be displayed by the color ink screen;

if so, performing reduced-order processing on the red mapping component value, the green mapping component value and the blue mapping component value of each pixel in the second mapping image data according to a color level conversion rule to obtain second quantized image data;

If not, the second quantized image data is the second mapped image data.

and dithering the second quantized image data to obtain second target image data.

In a second aspect, the present application provides an image processing apparatus of an ink screen, comprising: the system comprises a signal distribution module, a gray-scale image processing module and a color image processing module, wherein the signal distribution module is respectively connected with the gray-scale image processing module and the color image processing module;

the signal distribution module is used for acquiring frame picture data and parameter information of an ink screen, judging the type of the ink screen according to the parameter information, wherein the type of the ink screen comprises a black-and-white ink screen and a color ink screen, and conveying the frame picture data to one of the gray-scale image processing module and the color image processing module according to the type of the ink screen;

the gray-scale image processing module is used for processing the frame picture data to obtain first intermediate image data, wherein the first intermediate image data is gray-scale picture data;

The color image processing module is used for processing the frame picture data to obtain second intermediate image data, and the second intermediate image data is color format image data.

In some embodiments, the gray scale image processing module is configured to determine whether the frame picture data is gray scale picture data,

In some embodiments, the image processing apparatus further includes a first dithering module, the first dithering module being coupled to the grayscale image processing module;

the first dithering module is used for obtaining the first intermediate image data and dithering the first intermediate image data to obtain first target image data.

In some embodiments, the image processing apparatus further includes a first shake control module connected to the first shake module, the first shake control module configured to control the first shake module and adjust shake processing parameters of the first shake module.

In some embodiments, the color image processing module is configured to determine whether the frame image data is color format image data,

In some embodiments, the image processing apparatus further comprises a display mode switching module connected to the color image processing module, the display mode switching module configured to obtain display mode information of the color ink screen, the display mode including a color display mode and an achromatic display mode, determine whether the display mode information is a color display mode,

if yes, outputting the second intermediate image data;

In some embodiments, the second intermediate image data comprises a red component value, a green component value, and a blue component value for each pixel, the image processing apparatus further comprising a pixel mapping module, the pixel mapping module being coupled to the color image processing module;

The pixel mapping module is configured to obtain the second intermediate image data, and map the red component value, the green component value, and the blue component value of each pixel in the second intermediate image data according to a preset sub-pixel mapping relationship to obtain second mapped image data, where the second mapped image data includes a red mapping component value, a green mapping component value, and a blue mapping component value of each pixel.

In some embodiments, the image processing apparatus further comprises a pixel quantization module, the pixel quantization module being connected with the pixel mapping module;

the pixel quantization module is used for acquiring the second mapping image data and judging whether the color gradation value of the pixels of the second mapping image data is larger than the highest color gradation which can be displayed by the color ink screen,

if not, the second quantized image data is the second mapped image data.

In some embodiments, the image processing apparatus further comprises a second dithering module, the second dithering module being coupled to the pixel quantization module;

The second dithering module is used for obtaining the second quantized image data and dithering the second quantized image data to obtain second target image data.

In some embodiments, the image processing apparatus further includes a second dithering control module, the second dithering control module being connected to the second dithering module, the second dithering control module being configured to control the second dithering module and adjust dithering process parameters of the second dithering module.

In a third aspect, the present application also provides a system comprising:

command analysis conversion device, video conversion device, image extraction device, image processing device, image buffer device, waveform data device, ink screen driving device, power supply control device and control processing device;

the video conversion device, the image extraction device, the image processing device, the picture caching device, the waveform data device and the ink screen driving device are sequentially connected, the control processing device is respectively connected with the command analysis conversion device, the image extraction device, the image processing device, the picture caching device, the waveform data device, the ink screen driving device and the power control device, and the power control device is connected with the ink screen driving device;

The video conversion device is used for receiving the video signal and converting the video signal into video data with a set video format;

the image extraction device is used for receiving the video data and extracting frame picture data to be displayed from the video data;

the image processing device is used for acquiring frame picture data to be displayed and parameter information of the ink screen, and processing the frame picture data based on the parameter information of the ink screen to obtain processed image data;

the picture caching device is used for storing the processed image data;

the waveform data device is used for acquiring the processed image data and generating a driving waveform sequence of the processed image data according to the processed image data;

the ink screen driving device is used for acquiring the driving waveform sequence, obtaining a screen driving signal according to the driving waveform sequence, and controlling the real-time power supply control device to output driving voltage according to the real-time driving waveform sequence;

the control processing device is used for controlling the image extracting device, the image processing device, the picture caching device, the waveform data device, the ink screen driving device and the power supply control device;

The command analysis and conversion device is used for acquiring a control signal, converting the control signal into a control command and then sending the control command to the control processing device.

In some embodiments, the waveform data device includes a waveform data generating module, a waveform data buffering module and a dynamic adjusting module, where the waveform data generating module is connected with the frame buffering device, the waveform data buffering module and the dynamic adjusting module, and the waveform data buffering module is connected with the ink screen driving device;

the waveform data generation module is used for acquiring the processed image data, generating a driving waveform sequence of the processed image data according to the processed image data, and transmitting the driving waveform sequence to the waveform data buffer module, and the ink screen driving device acquires the driving waveform sequence from the waveform data buffer module;

the dynamic adjustment module is used for acquiring equipment information and an input instruction of the ink screen and determining a target refreshing mode of the ink screen according to the equipment information and the input instruction, analyzing the equipment information or the input instruction to determine an optimization type of the ink screen, and transmitting the target refreshing mode and the optimization type to the waveform data generation module;

The waveform data generation module is used for obtaining a first driving waveform sequence of at least one pixel according to the target refreshing mode and the processed image data in a matching mode;

the waveform data generation module is used for processing the first driving waveform sequence of at least one pixel by using an optimization strategy corresponding to the optimization type of the ink screen to obtain a second driving waveform sequence of at least one pixel, and the waveform data generation module is used for conveying the second driving waveform sequence to the waveform data buffer module.

In a fourth aspect, the present application also provides an electronic device, including:

one or more processors;

a memory for storing one or more programs; the one or more programs, when executed by the one or more processors, cause the electronic device to implement the image processing method of the ink screen as described above.

In a fifth aspect, the present application also provides a readable storage medium having stored thereon a program or instructions to be executed by a processor to perform the image processing method as described above.

The application provides an image processing method, an image processing device, a storage medium and electronic equipment of an ink screen, wherein the method comprises the steps of obtaining frame picture data to be displayed and parameter information of the ink screen, and obtaining the type of the ink screen according to the parameter information, wherein the type of the ink screen comprises a black-and-white ink screen and a color ink screen; if the ink screen is a black-and-white ink screen, processing the frame picture data to obtain first intermediate image data, wherein the first intermediate image data is gray picture data; and if the ink screen is a color ink screen, processing the frame picture data to obtain second intermediate image data, wherein the second intermediate image data is color format image data. The application judges the type of the ink screen and processes the frame image data based on the type of the ink screen, thereby outputting the image data which meets the display requirement of the black-and-white ink screen and the image data which meets the display requirement of the color ink screen, and therefore, the application can be matched with the black-and-white ink screen or the color ink screen for use, and solves the problems of single image processing function and low universality in the prior art.

Drawings

FIG. 1 is a flowchart of an embodiment of an image processing method according to the present application;

fig. 2 is a flowchart of step S20 of the image processing method provided by the present application;

fig. 3 is a flowchart of step S30 of the image processing method provided by the present application;

FIG. 4 is a flowchart of a second embodiment of an image processing method according to the present application;

fig. 5 is a flowchart of a third embodiment of an image processing method according to the present application;

fig. 6 is a flowchart of a fourth embodiment of an image processing method provided by the present application;

fig. 7 is a flowchart of a fifth embodiment of an image processing method provided by the present application;

FIG. 8 is a schematic diagram of an image processing apparatus according to the present application;

FIG. 9 is a schematic diagram of a system according to the present application;

FIG. 10 is a schematic diagram of a waveform data apparatus of the system provided by the present application;

fig. 11 is a schematic structural diagram of an electronic device provided by the present application.

Description of the embodiments

Embodiments of the present application will be described in further detail below with reference to the drawings and examples. It should be understood that the particular embodiments described herein are illustrative only and are not limiting of embodiments of the application. It should be further noted that, for convenience of description, only some, but not all of the structures related to the embodiments of the present application are shown in the drawings.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, where appropriate, such that embodiments of the application may be practiced in sequences other than those illustrated and described herein, and that the objects identified by "first," "second," etc. are generally of a type not limited to the number of objects, such as the first object may be one or more, or may not be construed as indicating or implying a relative importance. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship. Furthermore, unless explicitly stated and limited otherwise, the terms "disposed," "mounted," "connected," and "in series" are to be construed broadly, as they may be fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present application will be understood in specific cases by those of ordinary skill in the art.

The image processing method of the ink screen provided by the embodiment of the application can be used for a display device carrying a handwriting input device, wherein the display device can be electronic devices such as a tablet computer, a mobile phone and an electronic reader, the handwriting input device can be a combination of a touch display screen, an ink screen and the like and a handwriting pen, and can also be a combination of an external digital board, a common display screen and the handwriting pen, and the application is not limited. Specifically, the handwriting pen can be an electronic device based on a capacitance, magnetic induction or pressure sensor, the handwriting pen can form handwriting on a touch display screen or a common display screen through an external digital board, and specific handwriting patterns such as color, thickness, shade, style and the like can be set by a user according to personal habits. The above-listed application scenarios are merely exemplary and explanatory, and in practical application, the handwriting output method can also be used in handwriting output under other scenarios.

Fig. 1 is a flowchart of an embodiment of an image processing method according to the present application, where the image processing method according to the embodiment of the present application may be performed by an image processing apparatus, and the image processing apparatus may be implemented by hardware and/or software and integrated in a display device on which a display control apparatus is mounted.

Referring to fig. 1, an image processing method includes:

step S10, acquiring frame image data to be displayed and parameter information of an ink screen, and judging the type of the ink screen according to the parameter information, wherein the type of the ink screen comprises a black-and-white ink screen and a color ink screen.

The existing Ink screen comprises a color Ink screen and a black-and-white Ink screen, and the color Ink screen mainly comprises two types, wherein one type is an Ink screen provided with at least two pigment particles with non-black-and-white colors in microcapsules, such as E Ink Gallery series Ink screens developed based on an advanced color electronic paper (Advanced Color ePaper, ACeP) technical platform of the eink company; another type is an Ink screen based on a color filter array (color filter array, abbreviated as CFA), such as the E Ink Kaleido series Ink screen developed based on the technical platform of color printing electronic paper (Print Color ePaper Technology) of the eink company. The technical principles of ink screens of different hardware types are different, so that the corresponding image processing processes of the ink screens are different. The CFA color ink screen is a color electronic ink technology based on a color filter, specifically, a layer of RGB filter array is covered on a black-and-white electronic ink screen, the positions of the pixels of the filter array and the black-and-white capsules below are in a one-to-one correspondence relationship, it can be understood that the CFA color ink screen is composed of a plurality of screen pixels corresponding to only one color, the composition of the screen pixels comprises a single filter sub-pixel and a single black-and-white ink screen pixel, the type of the color which can be displayed by the screen pixels is determined by the type of the light which can be transmitted by the filter sub-pixel, and the color brightness (namely the color value of the sub-pixel) which can be displayed by the screen pixels is determined by the gray value which can be displayed by the black-and-white ink screen pixels. Different R, G and B brightness is displayed by controlling different gray levels of the ink screen capsules, and the effect of displaying different colors is achieved based on the RGB color mixing principle.

In order to enable the image processing technology to be simultaneously suitable for an ACeP color ink screen, a CFA color ink screen and a black-and-white ink screen, the type of the ink screen is judged according to the parameter information, and then a specific processing mode is carried out on frame picture data to be displayed based on the type of the ink screen, wherein the parameter information comprises hardware type information of the ink screen and also can comprise other information of the ink screen. Optionally, the present application does not need to determine the type of the ink screen according to the hardware type information of the ink screen, but may also determine the type of the ink screen according to other parameter information that may reflect the type of the ink screen, which is not limited herein.

And step S20, if the ink screen is a black-and-white ink screen, processing the frame picture data to obtain first intermediate image data, wherein the first intermediate image data is gray picture data.

It will be appreciated that, when it is known in step S10 that the ink screen is a black-and-white ink screen, the frame image data is processed to obtain first intermediate image data, where the first intermediate image data includes gray scale image data of the frame image data. In addition, in order to make the first intermediate image data have better display effect in the ink screen, the frame image data may be processed in other manners, for example, a series of processes such as color-to-gray scale, gray-scale conversion, brightness/contrast/saturation adjustment, color enhancement/filtering, image smoothing/sharpening, clipping and scaling are performed on the frame image data to obtain the first intermediate image data.

Further, referring to fig. 2, fig. 2 is a flowchart of a step S20 of the image processing method provided by the present application, where the step S20 includes:

s21, judging whether the frame picture data is gray picture data,

s22, if so, the first intermediate image data comprise gray scale picture data of the frame picture data;

s23, if not, carrying out gray scale processing on the frame picture data to obtain the first intermediate image data, wherein the first intermediate image data is gray scale picture data.

That is, in step S20, the data type of the frame image data is determined, and then the first intermediate image data is obtained, which is favorable for reducing the data processing process and improving the working efficiency. Specifically, in the above embodiment, if the frame image data is gray scale image data, a series of processes such as gray scale conversion, brightness/contrast/saturation adjustment, color enhancement/filtering, image smoothing/sharpening, clipping and scaling may be performed on the frame image data to obtain first intermediate image data, so that the first intermediate image data has a better display effect in the ink screen. Similarly, if the frame image data is not gray scale image data, a series of processes such as gray scale processing, gray scale conversion, brightness/contrast/saturation adjustment, color enhancement/filtering, image smoothing/sharpening, clipping and scaling can be performed on the frame image data to obtain the first intermediate image data, so that the first intermediate image data has a better display effect in the ink screen.

And step S30, if the ink screen is a color ink screen, processing the frame picture data to obtain second intermediate image data, wherein the second intermediate image data is color format image data.

It will be appreciated that when it is known in step S10 that the ink screen is a color ink screen, the frame image data is processed to obtain second intermediate image data, where the second intermediate image data is color format image data, and in order to make the second intermediate image data have a better display effect in the ink screen, the frame image data may be processed in other manners, for example, a series of processing such as gray-scale conversion, brightness/contrast/saturation adjustment, color enhancement/filtering, image smoothing/sharpening, clipping and scaling is performed on the frame image data to obtain second intermediate image data. Wherein the color format image data includes RGB format image data and other color format image data, such as CMYK format image data.

Further, referring to fig. 3, fig. 3 is a flowchart of a step S30 of the image processing method provided by the present application, where the step S30 includes:

s31, judging whether the frame picture data is color format image data,

S32, if so, the second target image data comprises color format image data of the frame picture data;

and S33, if not, performing color conversion processing on the frame picture data to obtain second intermediate image data, wherein the second target image data is color format image data.

In step S30, the second intermediate image data is obtained after the data type of the frame image data is determined, which is favorable for reducing the data processing process, and the second intermediate image data can be obtained by performing color conversion processing on the frame image data even if the frame image data is gray image data or other achromatic format image data, so that more types of frame image data can be displayed on a color ink screen.

Specifically, in the above embodiment, if the frame image data is color format image data, a series of processes such as color space conversion, brightness/contrast/saturation adjustment, color enhancement/filtering, image smoothing/sharpening, cropping and scaling may be further performed on the frame image data to obtain second intermediate image data, so that the second intermediate image data has a better display effect in the ink screen. Similarly, if the frame image data is achromatic format image data, a series of processes such as color space conversion, brightness/contrast/saturation adjustment, color enhancement/filtering, image smoothing/sharpening, clipping and scaling can be performed on the frame image data to obtain the second intermediate image data, so that the first intermediate image data has a better display effect in the ink screen.

Further, referring to fig. 4, fig. 4 is a flowchart of a second embodiment of an image processing method provided by the present application, and the difference between the present embodiment and the image processing method provided by fig. 1 is that the steps of the image processing method further include:

s40, dithering is carried out on the first intermediate image data to obtain first target image data.

That is, in this embodiment, a step of dithering the first intermediate image data is added to the image processing method provided in fig. 1, where the basic idea of the image dithering algorithm is to keep the visual information of the original image as much as possible when the color level or the gray level is reduced, which generally involves a method called "error diffusion" that quantizes each pixel value from its original color level to the nearest available color level and distributes the resulting error to surrounding pixels, that is, the present application obtains the first target image data by dithering the first intermediate image data, thereby improving the display effect of the image.

Referring to fig. 5 in addition, fig. 5 is a flowchart of a third embodiment of the image processing method provided by the present application, and the difference between the present embodiment and the image processing method provided by fig. 1 is that, after the step S30, the steps of the image processing method further include:

S51, acquiring display mode information of the color ink screen, wherein the display modes comprise a color display mode and an achromatic display mode, judging whether the display mode information is the color display mode,

s52, if yes, outputting the second intermediate image data;

and S53, if not, processing the second intermediate image data to obtain third target image data, wherein the third target image data is gray scale picture data, and outputting the third target image data.

When a user does not meet the requirement of displaying a color picture on a color ink screen, and also hopes to display a black-and-white picture on the color display screen, the black-and-white color switching function is configured for the color ink screen so as to meet the requirement of displaying the black-and-white picture on the color ink screen, and therefore user experience is improved. When the display mode of the color ink screen is a color display mode, directly outputting the second intermediate image data without conversion; when the display mode of the color ink screen is an achromatic display mode, gray processing is required to be performed on the second intermediate image data to obtain third target image data, wherein the third target image data is gray picture data.

Referring to fig. 6, fig. 6 is a flowchart of a fourth embodiment of the image processing method provided by the present application, which is different from the image processing method provided by fig. 1 in that, based on the image processing method provided by fig. 1, the second intermediate image data includes a red component value, a green component value and a blue component value of each pixel, and the steps of the image processing method further include:

s60, mapping the red component value, the green component value and the blue component value of each pixel in the second intermediate image data according to a preset sub-pixel mapping relation to obtain second mapping image data, wherein the second mapping image data comprises the red mapping component value, the green mapping component value and the blue mapping component value of each pixel. Wherein the second intermediate image data is obtained by step S30. That is, in the present embodiment, step S60 is directly performed after step S30 is performed.

Each pixel in the second intermediate image data is mapped into a brightness value of R, G, B sub-pixels of a corresponding area of the color electronic ink screen according to R, G, B channels through a preset sub-pixel mapping relation, one pixel in a sub-picture after mapping only needs one brightness value, the problem of resolution reduction caused by the fact that an original picture before mapping needs 3 physical pixels to display one pixel is solved, the picture display effect of the color electronic ink screen is further improved, and therefore the technical problems that the screen resolution is reduced, the screen color is insufficient and the picture display effect is poor in the existing color electronic ink screen are solved.

Further, in this embodiment, the steps of the image processing method further include:

s71, judging whether the color gradation value of the pixel of the second mapping image data is larger than the highest color gradation which can be displayed by the color ink screen;

s72, if so, performing reduced processing on the red mapping component value, the green mapping component value and the blue mapping component value of each pixel in the second mapping image data according to a color gradation conversion rule to obtain second quantized image data;

s73, if not, the second quantized image data is the second mapping image data.

In order to solve the problem, when the tone scale value of the pixel of the second mapping image data is greater than the highest tone scale which can be displayed by the color ink screen, the red mapping component value, the green mapping component value and the blue mapping component value of each pixel in the second mapping image data are subjected to tone scale reduction according to a tone scale conversion rule to obtain second quantized image data, so that the display effect of an image on the color ink screen is improved and the user experience is improved.

s80, dithering the second quantized image data to obtain second target image data.

The gray frame data dithering method is different from the RGB format image data dithering method in that the error diffusion filter involved in the RGB format image data dithering method is related to the color arrangement of the CFA color ink screen. The dithering processing method of the RGB format image data is as follows: the CFA color arrangement information refers to the CFA color arrangement format type, and a preset error diffusion filter is directly configured according to the CFA color arrangement format type; another method for processing the dithering of the image data in the RGB format is as follows: and according to the CFA color arrangement information, the display color corresponding to each screen pixel is included, and according to the CFA color arrangement information, pixels with the same display color and adjacent to the periphery of the traversed pixel can be obtained. Each pixel value is quantized from its original tone scale to the nearest available tone scale using a dithering process and the resulting error is dispersed to surrounding pixels, thereby improving the display effect.

In addition, referring to fig. 7, fig. 7 is a flowchart of a fifth embodiment of the image processing method provided by the present application, and the difference between the present embodiment and the image processing method provided by fig. 5 is that, based on the image processing method provided by fig. 5, the second intermediate image data includes a red component value, a green component value and a blue component value of each pixel, and the steps of the image processing method further include:

S60, mapping the red component value, the green component value and the blue component value of each pixel in the second intermediate image data according to a preset sub-pixel mapping relation to obtain second mapping image data, wherein the second mapping image data comprises the red mapping component value, the green mapping component value and the blue mapping component value of each pixel. In this embodiment, after step S30 is performed, steps S51 to S53 are performed, and step S60 is performed.

s73, if not, the second quantized image data is the second mapping image data.

The gray scale picture data dithering method is different from the RGB format image data dithering method in that an error diffusion filter related to the RGB format image data dithering method is related to the color arrangement of the CFA color ink screen. The dithering processing method of the RGB format image data is as follows: the CFA color arrangement information refers to the CFA color arrangement format type, and a preset error diffusion filter is directly configured according to the CFA color arrangement format type; another method for processing the dithering of the image data in the RGB format is as follows: and according to the CFA color arrangement information, the display color corresponding to each screen pixel is included, and according to the CFA color arrangement information, pixels with the same display color and adjacent to the periphery of the traversed pixel can be obtained. Each pixel value is quantized from its original tone scale to the nearest available tone scale using a dithering process and the resulting error is dispersed to surrounding pixels, thereby improving the display effect.

Correspondingly, an embodiment of the present application further provides an image processing apparatus, and fig. 8 is a schematic structural diagram of the image processing apparatus provided by the present application, and referring to fig. 8, the image processing apparatus 103 includes a signal distribution module 11, a gray-scale image processing module 12, and a color image processing module 13, where the signal distribution module 11 is connected to the gray-scale image processing module 12 and the color image processing module 13, respectively.

The signal distribution module 11 is configured to obtain frame image data and parameter information of an ink screen, the signal distribution module 11 is configured to determine a type of the ink screen according to the parameter information, the type of the ink screen includes a black-and-white ink screen and a color ink screen, and the signal distribution module 11 is configured to convey the frame image data to one of the grayscale image processing module 12 and the color image processing module 13 according to the type of the ink screen;

the gray-scale image processing module 11 is configured to process the frame image data to obtain first intermediate image data, where the first intermediate image data is gray-scale image data;

the color image processing module 12 is configured to process the frame image data to obtain second intermediate image data, where the second intermediate image data is color format image data.

In order to enable the image processing technology to be applicable to the CFA color ink screen and the black-and-white ink screen at the same time, the application judges the type of the ink screen according to the parameter information, and then carries out a specific processing mode on frame picture data to be displayed based on the type of the ink screen, wherein the parameter information comprises hardware type information of the ink screen and also can comprise other information of the ink screen. Optionally, the present application does not need to determine the type of the ink screen according to the hardware type information of the ink screen, but may also determine the type of the ink screen according to other parameter information that may reflect the type of the ink screen, which is not limited herein.

It will be appreciated that when the ink screen is a black-and-white ink screen, the frame image data is processed to obtain first intermediate image data, where the first intermediate image data includes grayscale image data of the frame image data. In addition, in order to make the first intermediate image data have better display effect in the ink screen, the frame image data may be processed in other manners, for example, a series of processes such as color-to-gray scale, gray-scale conversion, brightness/contrast/saturation adjustment, color enhancement/filtering, image smoothing/sharpening, clipping and scaling are performed on the frame image data to obtain the first intermediate image data. It will be appreciated that when the ink screen is a color ink screen, the frame image data is processed to obtain second intermediate image data, where the second intermediate image data is color format image data, and in order to make the second intermediate image data have a better display effect in the ink screen, the frame image data may also be processed in other manners, for example, a series of processing such as gray-scale conversion, brightness/contrast/saturation adjustment, color enhancement/filtering, image smoothing/sharpening, clipping and scaling is performed on the frame image data to obtain second intermediate image data.

In actual use, the grayscale image processing module 11 and the color image processing module 12 of the image processing apparatus 103 may be directly connected to a screen buffer, so as to store the first intermediate image data and the second intermediate image data.

Further, in one embodiment of the present application, the gray scale image processing module 11 is configured to determine whether the frame picture data is gray scale picture data,

That is, the application obtains the first intermediate image data after judging the data type of the frame image data, thereby being beneficial to reducing the data processing process and improving the working efficiency. Specifically, in the above embodiment, if the frame image data is gray scale image data, a series of processes such as gray scale conversion, brightness/contrast/saturation adjustment, color enhancement/filtering, image smoothing/sharpening, clipping and scaling may be performed on the frame image data to obtain first intermediate image data, so that the first intermediate image data has a better display effect in the ink screen. Similarly, if the frame image data is not gray scale image data, a series of processes such as gray scale processing, gray scale conversion, brightness/contrast/saturation adjustment, color enhancement/filtering, image smoothing/sharpening, clipping and scaling can be performed on the frame image data to obtain the first intermediate image data, so that the first intermediate image data has a better display effect in the ink screen.

Further, the image processing apparatus 103 further includes a first dithering module 21, and the first dithering module 14 is connected to the grayscale image processing module 12;

the first dithering module 14 is configured to obtain the first intermediate image data, and dither the first intermediate image data to obtain first target image data.

The basic idea of the image dithering algorithm is to keep the visual information of the original image as much as possible while reducing the color level or gray level, which is generally referred to as an "error diffusion" method, where each pixel value is quantized from its original color level to the nearest available color level, and the resulting error is dispersed to surrounding pixels, that is, the present application obtains the first target image data by dithering the first intermediate image data, thereby improving the display effect.

On the basis of the above, the image processing apparatus 103 further includes a first shake control module 21, where the first shake control module 21 is connected to the first shake module 14, and the first shake control module 21 is configured to control the first shake module 14 and adjust shake processing parameters of the first shake module 14.

Specifically, the first dithering control module may turn on or off the first dithering module to implement control, and when the first dithering control module turns on the first dithering module, the first dithering module may perform dithering processing on the first intermediate image data; when the first dithering control module closes the first dithering module, the first dithering module does not dither the first intermediate image data at the moment; in addition, the first dithering control module may switch the dithering algorithm or the error diffusion filter of the first dithering module, adjust the number of neighboring pixels (pixels to which the error component is transferred), adjust the error distribution ratio of the neighboring pixels, etc., thereby adjusting the dithering process parameters of the first dithering module, wherein the dithering algorithm and the error diffusion filter are prior art and are not further described herein.

Further, in one embodiment of the present application, the color image processing module 13 is configured to determine whether the frame data is color format image data,

The application is beneficial to reducing the data processing process by judging the data type of the frame picture data and then obtaining the second intermediate image data, and meanwhile, even if the frame picture data is gray picture data or other achromatic format image data, the second intermediate image data can be obtained by carrying out color conversion processing on the frame picture data, so that more types of frame picture data can be displayed on a color ink screen.

On the basis of the above, the image processing apparatus 103 further comprises a display mode switching module 15, the display mode switching module 15 is connected with the color image processing module 13, the display mode switching module 15 is configured to obtain display mode information of the color ink screen, the display mode includes a color display mode and an achromatic display mode, determine whether the display mode information is the color display mode,

if yes, outputting the second intermediate image data;

In actual use, the first dithering module 14 and the display mode switching module 15 of the image processing apparatus 103 may be directly connected to the picture caching apparatus 104, so as to transfer the first target image data and the second intermediate image data or the third target image data to the picture caching apparatus 104.

Further, in an embodiment of the present application, the second intermediate image data includes a red component value, a green component value, and a blue component value of each pixel, and the image processing apparatus 103 further includes a pixel mapping module 16, where the pixel mapping module 16 is connected to the color image processing module 13 or the display mode switching module 15, that is, the pixel mapping module 16 may be connected to one of the color image processing module 13 and the display mode switching module 15, and in this embodiment, the pixel mapping module 163 and the display mode switching module 15 are connected for illustration;

the pixel mapping module 16 is configured to obtain the second intermediate image data, and map the red component value, the green component value, and the blue component value of each pixel in the second intermediate image data according to a preset sub-pixel mapping relationship to obtain second mapped image data, where the second mapped image data includes a red mapping component value, a green mapping component value, and a blue mapping component value of each pixel.

That is, the pixel mapping module of the present application may obtain the second intermediate image data from the color image processing module or the display mode switching module, and then perform mapping processing on the red component value, the green component value, and the blue component value of each pixel in the second intermediate image data according to a preset sub-pixel mapping relationship to obtain second mapped image data.

According to the application, each pixel in the second intermediate image data is mapped into the brightness value of R, G, B sub-pixels of the corresponding area of the color electronic ink screen according to the R, G, B channel respectively through the preset sub-pixel mapping relation, and only one brightness value is needed for one pixel in the sub-picture after mapping, so that the problem of resolution reduction caused by the fact that the original picture before mapping can display one pixel only by 3 physical pixels is solved, the picture display effect of the color electronic ink screen is further improved, and the technical problems of reduced screen resolution, insufficient screen colors and poor picture display effect of the conventional color electronic ink screen are solved.

Further, in an embodiment of the present application, the image processing apparatus 103 further includes a pixel quantization module 17, and the pixel quantization module 17 is connected to the pixel mapping module 16;

The pixel quantization module 17 is configured to obtain the second mapped image data, and determine whether a tone scale value of a pixel of the second mapped image data is greater than a highest tone scale that can be displayed by the color ink screen,

if not, the second quantized image data is the second mapped image data.

Further, in an embodiment of the present application, the image processing apparatus 103 further includes a second dithering module 18, and the second dithering module 18 is connected to the pixel quantization module 17;

the second dithering module 18 is configured to obtain the second quantized image data, and dither the second quantized image data to obtain second target image data.

The gray scale picture data dithering method is different from the RGB format image data dithering method in that an error diffusion filter related to the RGB format image data dithering method is related to the color arrangement of the CFA color ink screen. The dithering processing method of the RGB format image data is as follows: the CFA color arrangement information refers to the CFA color arrangement format type, and a preset error diffusion filter is directly configured according to the CFA color arrangement format type; another method for processing the dithering of the image data in the RGB format is as follows: and according to the CFA color arrangement information, the display color corresponding to each screen pixel is included, and according to the CFA color arrangement information, pixels with the same display color and adjacent to the periphery of the traversed pixel can be obtained. Each pixel value is quantized from the original color level to the nearest available color level by using dithering, and the caused error is dispersed to surrounding pixels.

On the basis of the above, the image processing apparatus 103 further includes a second shake control module 19, where the second shake control module 19 is connected to the second shake module 18, and the second shake control module 19 is configured to control the second shake module 18 and adjust shake processing parameters of the second shake module 18.

Specifically, the second dithering control module may turn on or off the second dithering module to implement control, and when the second dithering control module turns on the second dithering module, the second dithering module may perform dithering processing on the second quantized image data; when the second dithering control module closes the second dithering module, the second dithering module does not dither the second quantized image data at the moment; in addition, the second dithering control module may switch the dithering algorithm or the error diffusion filter of the second dithering module, adjust the number of neighboring pixels (pixels to which the error component is transferred), adjust the error distribution ratio of the neighboring pixels, etc., thereby adjusting the dithering process parameters of the first dithering module, wherein the dithering algorithm and the error diffusion filter are prior art and are not further described herein.

In actual use, the first dithering module 14, the second dithering module 18, and the display mode switching module 15 of the image processing apparatus 103 may be directly connected to the screen buffer apparatus 104, so as to transfer the first target image data or the third intermediate image data or the third target image data to the screen buffer apparatus 104.

Correspondingly, the embodiment of the present application further provides a system 100, fig. 9 is a schematic structural diagram of the system provided by the present application, and referring to fig. 9, the system 100 includes:

command analysis conversion means 107, video conversion means 101, image extraction means 102, and the above-described image processing means 103, screen buffer means 104, waveform data means 105, ink screen driving means 106, power supply control means 108, and control processing means 109;

the video conversion device 101, the image extraction device 102, the image processing device 103, the screen buffer device 104, the waveform data device 105, and the ink screen driving device 106 are sequentially connected, the control processing device 109 is connected to a command analysis conversion device 107, the image extraction device 102, the image processing device 103, the screen buffer device 104, the waveform data device 105, the ink screen driving device 106, and the power control device 108 is connected to the ink screen driving device 106;

The video conversion device 101 is configured to receive a video signal and convert the video signal into video data in a set video format;

the image extracting device 102 is configured to receive the video data, and extract frame image data to be displayed from the video data;

the image processing device 103 is configured to obtain frame image data to be displayed and parameter information of an ink screen, and process the frame image data based on the parameter information of the ink screen to obtain processed image data; the processed image data may be any one of first intermediate image data, second intermediate image data, first target image data, third target image data, second mapped image data, second quantized image data, and second target image data, which are obtained by processing the frame image data by the image processing apparatus.

The picture buffer 104 is configured to store the processed image data;

the waveform data device 105 is configured to acquire the processed image data, and generate a driving waveform sequence of the processed image data according to the processed image data;

the ink screen driving device 106 is configured to obtain the driving waveform sequence, obtain a screen driving signal according to the driving waveform sequence, and control the real-time power supply control device to output a driving voltage according to the real-time driving waveform sequence;

The control processing means 109 is configured to control the image extracting means 102, the image processing means 103, the screen buffer means 104, the waveform data means 105, the ink screen driving means 106, and the power supply control means 108.

The command parsing and converting device 107 is configured to obtain a control signal, convert the control signal into a control command, and send the control command to the control processing device.

The above-described system includes an image processing apparatus, and thus the system of the present application has functions and advantageous effects corresponding to the image processing apparatus, and a description thereof will not be repeated.

On the basis of the above, the system further comprises: the signal conversion device 110 is respectively connected with the ink screen driving device 106 and the control processing device 109, the control processing device 109 is used for controlling the signal conversion device 110, and the signal conversion device 110 is provided with a plurality of signal output interfaces for accessing ink screens with different interface types. Specifically, the interface type corresponding to the signal output interface may be a TTL interface and/or an LVDS interface, and the signal output interface of which the interface type is the TTL interface and/or the LVDS interface in the signal conversion module may be used to access the ink screen 200 of which the interface type is the TTL interface and/or the LVDS interface, respectively.

In actual use, the signal conversion device 110 and the power supply control device 108 are respectively connected to the ink screen 200, the signal conversion device 110 outputs a screen driving signal to the ink screen 200, and the power supply control device 108 outputs a driving voltage to the ink screen 200.

Fig. 10 is a schematic structural diagram of a waveform data device of the system according to the present application, referring to fig. 10, further, in an embodiment of the present application, the waveform data device 105 includes a waveform data generating module 51, a waveform data buffering module 52, and a dynamic adjustment module 53, where the waveform data generating module 51 is connected to the picture buffering device 104, the waveform data buffering module 52, and the dynamic adjustment module 53, and the waveform data buffering module 52 is connected to the ink screen driving device 106;

the waveform data generating module 51 is configured to obtain the processed image data, generate a driving waveform sequence of the processed image data according to the processed image data, and send the driving waveform sequence to the waveform data buffer module 52, where the ink screen driving device 106 obtains the driving waveform sequence from the waveform data buffer module 52;

The dynamic adjustment module 53 is configured to acquire device information and an input instruction of an ink screen and determine a target refresh mode of the ink screen according to the device information and the input instruction, and the dynamic adjustment module 53 is configured to analyze the device information or the input instruction to determine an optimization type of the ink screen and transmit the target refresh mode and the optimization type to the waveform data generation module 51;

the waveform data generating module 51 is configured to obtain a first driving waveform sequence of at least one pixel according to the target refresh mode and the processed image data;

the waveform data generating module 51 is configured to process the first driving waveform sequence of at least one pixel by using an optimization strategy corresponding to the optimization type of the ink screen to obtain a second driving waveform sequence of at least one pixel, and the waveform data generating module 51 sends the second driving waveform sequence to the waveform data buffering module 52.

According to the technical scheme, the waveform data device provided by the application has the advantages of good use experience, wide application range and good flexibility, and the display effect of the ink screen is automatically optimized in real time by reading equipment information and monitoring input instructions, so that manual operation is reduced, and the use experience of a user can be effectively improved; further, for applications or scenes lacking in adaptive screen refreshing configuration, the waveform data device provided by the application can also optimize through the images of the equipment and the user input data, and determine the optimization type according to the images of the equipment and the user input data, so that the application range is enlarged, and the adaptation difficulty of developers is reduced; in addition, the waveform data device can directly process the waveform sequence of the screen and can dynamically process the driving frame of the waveform sequence of the ink screen, so that the waveform data device can still exert the optimization effect under the condition of not changing the refreshing mode of the ink screen, is particularly suitable for scenes such as mixed and arranged images and texts of webpages, can reduce the switching of the refreshing mode of the ink screen, improves the refreshing flexibility of the ink screen, and overcomes the defects of poor use experience, narrow application range and poor flexibility of the refreshing of the existing ink screen.

Further, the dynamic adjustment module 53 is configured to determine a target refresh mode of the ink screen according to the device information and the input instruction, including:

the dynamic adjustment module 53 sets a target refresh mode of the ink screen according to the device information;

the dynamic adjustment module 53 continuously detects the device information or the input instruction, and determines whether the device information or the input instruction is changed;

if it is determined that the device information or the input command is changed, the dynamic adjustment module 53 modifies the target refresh mode set by the ink screen according to the changed device information or the input command.

Specifically, in the practical application process, the refresh mode of the ink screen is related to the signal input to the ink screen and the related device information of the ink screen. For example, a signal input to the ink screen, a configuration file of the ink screen, or information related to an application program started in the ink screen may also affect the refresh mode of the ink screen, and ultimately affect the waveform sequence of the ink screen and the final display effect of the ink screen. Therefore, after the relevant device information of the ink screen is determined, the target refresh mode of the ink screen can be set further according to the device information of the ink screen. When the ink screen is refreshed in the currently set refresh mode, the refresh mode of the ink screen may need to be adaptively modified if a new input instruction is input. For example, if an ink screen has been refreshed in the fast refresh mode currently, when a new signal is input, the original fast refresh mode of the ink screen may need to be changed to the global refresh mode according to the relevant device information of the ink screen after the new signal is input and the input new signal. Therefore, after the target refresh mode of the ink screen is set according to the device information of the ink screen, the device information and the input command of the ink screen may be continuously detected, whether the device information or the input command of the ink screen is changed is determined, and if it is determined that the device information or the input command is changed, the dynamic adjustment module 53 modifies the target refresh mode set by the ink screen according to the changed device information or the changed input command.

Further, the dynamic adjustment module 53 is configured to analyze the device information or the input instruction to determine an optimization type of the ink screen includes:

the dynamic adjustment module 53 analyzes the device information, if the device information includes a configuration file of the ink screen, determines a preset optimization type recorded in the configuration file, and sets the preset optimization type as an optimization type of the ink screen;

or alternatively, the first and second heat exchangers may be,

the dynamic adjustment module 53 analyzes the input instruction, if the input instruction is an optimization type switching instruction generated according to an optimization type switching event triggered by a user, determines an optimization type selected by the user and corresponding to the optimization type switching instruction, and sets the optimization type selected by the user and corresponding to the optimization type switching instruction as the optimization type of the ink screen.

Specifically, as can be seen from the above description, the device information of the ink screen may include device information of the ink screen including, but not limited to: the ink screen type, the ink screen equipment state, the configuration file of the ink screen, the application information of the ink screen and the ink screen picture information. The configuration file of the ink screen generally comprises a plurality of preset optimization type information, and if the configuration file of the device records the related information of the optimization type, the optimization type of the device can be set through the record of the configuration file. Therefore, when the device information of the ink screen includes a profile, it is possible to determine a preset optimization type recorded in the target display profile, and set the preset optimization type recorded in the profile as the optimization type of the ink screen.

In particular, as can be seen from the above description, the input instructions of the ink screen may include user input data, instructions initiated by the application through the system interface. Therefore, after the input instruction of the ink screen is read, the input instruction of the ink screen can be analyzed, and if the input instruction of the ink screen is the optimization type switching instruction generated according to the optimization type switching event triggered by the user. In the actual application process, a user can select different optimization types according to the actual application scene, when the input instruction is the optimization type for switching the ink screen, the optimization type selected by the user and corresponding to the optimization type switching instruction of the ink screen can be determined, and the optimization type selected by the user and corresponding to the optimization type switching instruction is set as the optimization type of the ink screen.

Further, the waveform data generating module 51 is configured to process the first driving waveform sequence of at least one pixel by using an optimization strategy corresponding to the optimization type of the ink screen, to obtain a second driving waveform sequence of at least one pixel, including:

the waveform data generation module 51 determines a target optimized amplitude of the ink screen according to the device information and the input instruction;

The waveform data generation module 51 adjusts the first driving waveform sequence of at least one pixel according to the target optimized amplitude value so that the number of frames of the second driving waveform sequence of at least one pixel is smaller than the number of frames of the first driving waveform sequence.

Specifically, as can be seen from the above description, the waveform data generation module 51 of the present application can read the device information of the ink screen and the instructions for inputting the ink screen. The device information of the ink screen and the instructions input into the ink screen can feed back the optimization type of the ink screen. The optimization magnitudes of the different optimization types are different, and the optimization strategies are also different. In the actual application process, the optimization strategy and the optimization amplitude can be determined according to the equipment information of the equipment and the input instruction. Therefore, after the device information and the input instruction of the ink screen are read, the target optimization amplitude of the ink screen can be determined according to the device information and the input instruction of the ink screen, so that the optimization strategy of the ink screen can be determined according to the device information and the input instruction of the ink screen.

Further, the waveform data generation module 51 determining a target optimized amplitude of the ink screen according to the device information and the input instruction includes:

the waveform data generating module 51 is configured to obtain an optimized amplitude setting instruction included in the input instruction of the ink screen, determine an optimized amplitude selected by a user and corresponding to the optimized amplitude setting instruction, and set the optimized amplitude selected by the user as a target optimized amplitude of the ink screen.

Still further, the first driving waveform sequence includes at least two driving frames, and the waveform data generating module 51 adjusts the first driving waveform sequence of at least one pixel according to the target optimized amplitude, so that the number of frames of the second driving waveform sequence of at least one pixel is smaller than the number of frames of the first driving waveform sequence thereof includes:

the waveform data generating module 51 is configured to confirm a preset number of intervals matching the target optimized amplitude, and select at least two driving frames as reserved frames in the first driving waveform sequence at intervals according to the preset number of intervals;

the waveform data generating module 51 is configured to delete other driving frames between adjacent reserved frames in the first driving waveform sequence, so as to obtain a second driving waveform sequence.

Specifically, during practical application, the waveform sequence of the ink screen is typically a plurality of consecutive driving frames. When the fluency of the ink screen needs to be optimized, a part of the driving frames can be considered to be discarded without processing, so that the driving frames which need to be discarded in the waveform sequence of the ink screen need to be determined. Therefore, after determining the target optimized amplitude of the ink screen, the preset interval number matched with the target optimized amplitude can be further confirmed, and at least two driving frames are selected from the first driving waveform sequence at intervals according to the preset interval number to serve as reserved frames; and deleting other driving frames between adjacent reserved frames in the first driving waveform sequence to obtain a second driving waveform sequence, so that the ink screen can be optimized by the obtained second driving frame waveform sequence. The preset interval number can be set by referring to the ratio of the target optimized amplitude of the ink screen to the original waveform sequence of the ink screen.

FIG. 11 is a schematic diagram of an electronic device according to the present application, as shown in FIG. 11, the electronic device includes one or more processors; a memory for storing one or more programs; when the one or more programs are executed by the one or more processors, the electronic device implements the image processing method of the ink screen as described above, and one processor 201 is exemplified in fig. 11.

The memory 202 is a computer-readable storage medium that can be used to store software programs, computer-executable programs, and modules, and the processor 201 executes various functional applications of the electronic device and data processing, i.e., implements the above-described image processing, by running the software programs, instructions, and modules stored in the memory 202.

The memory 202 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application program required for functions; the storage data area may store data created according to the use of the electronic device, etc. In addition, memory 202 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, memory 202 may further include memory located remotely from processor 201, which may be connected to the electronic device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The electronic equipment comprises the image processing device, can be used for executing any handwriting adjusting method, and has corresponding functions and beneficial effects.

Embodiments of the present application also provide a storage medium containing computer-executable instructions for performing an image processing method when executed by a computer processor. The computer program, when executed by the processor, can also implement related operations in other image processing methods provided in any embodiment of the present application, and has corresponding functions and beneficial effects.

It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product.

Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein. The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory. The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.

Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.

Claims

1. An image processing method of an ink screen, comprising the steps of:

2. The image processing method according to claim 1, wherein the step of processing the frame picture data to obtain first intermediate image data, the first intermediate image data being grayscale picture data, comprises:

determining whether the frame picture data is gray scale picture data,

3. The image processing method according to claim 1, characterized in that the step of the image processing method further comprises:

4. The image processing method according to claim 1, wherein the step of processing the frame image data to obtain second intermediate image data, the second intermediate image data being color format image data, comprises:

determining whether the frame picture data is color format image data,

5. The image processing method according to claim 1, wherein after the step of processing the frame image data to obtain second intermediate image data if the ink screen is a color ink screen, the step of image processing method further comprises:

if yes, outputting the second intermediate image data;

6. The image processing method according to claim 1 or 5, wherein the second intermediate image data includes a red component value, a green component value, and a blue component value for each pixel, the image processing method further comprising the step of:

7. The image processing method according to claim 6, characterized in that the step of the image processing method further comprises:

if not, the second quantized image data is the second mapped image data.

8. The image processing method according to claim 7, characterized in that the step of the image processing method further comprises:

9. An image processing apparatus of an ink screen, characterized by comprising: the system comprises a signal distribution module, a gray-scale image processing module and a color image processing module, wherein the signal distribution module is respectively connected with the gray-scale image processing module and the color image processing module;

10. The image processing apparatus according to claim 9, wherein the grayscale image processing module is configured to determine whether the frame picture data is grayscale picture data,

11. The image processing apparatus of claim 9, further comprising a first dithering module, the first dithering module being coupled to the grayscale image processing module;

12. The image processing apparatus of claim 11, further comprising a first dithering control module coupled to the first dithering module, the first dithering control module configured to control the first dithering module and adjust a dithering process parameter of the first dithering module.

13. The image processing apparatus according to claim 9, wherein said color image processing module is configured to determine whether said frame picture data is color format image data,

14. The image processing apparatus according to claim 9, further comprising a display mode switching module connected to the color image processing module, the display mode switching module configured to acquire display mode information of the color ink screen, the display mode including a color display mode and an achromatic display mode, determine whether the display mode information is a color display mode,

If yes, outputting the second intermediate image data;

15. The image processing apparatus according to claim 9 or 14, wherein the second intermediate image data includes a red component value, a green component value, and a blue component value for each pixel, the image processing apparatus further comprising a pixel mapping module connected to the color image processing module;

16. The image processing apparatus of claim 15, further comprising a pixel quantization module coupled to the pixel mapping module;

if not, the second quantized image data is the second mapped image data.

17. The image processing apparatus of claim 16, further comprising a second dithering module coupled to the pixel quantization module;

18. The image processing apparatus of claim 17, further comprising a second dithering control module coupled to the second dithering module, the second dithering control module configured to control the second dithering module and adjust a dithering process parameter of the second dithering module.

19. A system, comprising:

command analysis conversion means, video conversion means, image extraction means, image processing means, picture buffering means, waveform data means, ink screen driving means, power supply control means, and control processing means according to any one of claims 9 to 18;

The picture caching device is used for storing the processed image data;

20. The image processing apparatus according to claim 19, wherein the waveform data apparatus includes a waveform data generation module, a waveform data buffer module, and a dynamic adjustment module, the waveform data generation module being connected to the screen buffer apparatus, the waveform data buffer module, and the dynamic adjustment module, respectively, the waveform data buffer module being connected to the ink screen driving apparatus;

the dynamic adjustment module is used for acquiring equipment information and an input instruction of the ink screen, determining a target refreshing mode of the ink screen according to the equipment information and the input instruction, analyzing the equipment information or the input instruction to determine an optimization type of the ink screen, and transmitting the target refreshing mode and the optimization type to the waveform data generation module;

21. An electronic device, comprising:

one or more processors;

a memory for storing one or more programs; when executed by the one or more processors, causes the electronic device to implement the image processing method of any one of claims 1 to 8.

22. A readable storage medium, wherein a program or instructions is stored on the readable storage medium, the program or instructions being executed by a processor to perform the image processing method according to any one of claims 1 to 8.