WO2015117345A1

WO2015117345A1 - Method and device for displaying background

Info

Publication number: WO2015117345A1
Application number: PCT/CN2014/087846
Authority: WO
Inventors: 孙凯将; 高鹏程; 秦刘涛; 王力
Original assignee: 中兴通讯股份有限公司
Priority date: 2014-08-25
Filing date: 2014-09-29
Publication date: 2015-08-13
Also published as: CN105472106A

Abstract

Provided are a method and device for displaying a background. The method comprises: image data of a terminal upper layer application is transferred to a specified memory, the positions of the specified memory and a default display memory buffer of the terminal being different, the image data is mixed with a user-selected background image within the specified memory, and a mixed image is obtained, the mixed image being an image taking the background image as a background; the mixed image is returned to the display memory buffer for display. The present technical solution solves the problem in the relevant prior art that display of a user-customised background is not yet implemented on all interfaces of a mobile phone. Implementing display of a user-customised background on all interfaces of a mobile phone solves the problem that there are too few user-customised display style elements on a current mobile phone. User experience is improved, and the commercial value is high.

Description

Background display method and device

Technical field

The present invention relates to the field of communications, and more particularly to a display method and apparatus for a background.

Background technique

At present, the beautiful interface elements of mobile phones are only reflected in a limited number of places such as wallpapers and lock screens. Others such as the call interface and setting interface are unchanged, and the user experience is very poor, that is, there is no method in the prior art for the user. The background is freely customizable on all screens displayed on the phone.

For the related technology, there is no problem of displaying the customized background of all the interfaces of the mobile phone, and no effective solution has been proposed yet.

Summary of the invention

The present invention provides a background display method and apparatus to solve at least the above problems.

According to an embodiment of the present invention, a display method of a background is provided, the method comprising: transmitting image data of an upper layer application of a terminal to a specified memory, wherein the specified memory and a default memory buffer of the terminal are The image data is mixed with the background image selected by the user in the specified memory to obtain a mixed image, and the mixed image is an image with the background image as a background; The subsequent image is sent back to the memory buffer for display.

Preferably, transmitting the image data of the upper layer application of the terminal to the specified memory, comprising: modifying a first mapping relationship of the frame buffer device corresponding to the memory buffer to a second mapping relationship of the frame buffer device corresponding to the specified memory; And transmitting the image data to the designated memory according to the second mapping relationship.

Preferably, sending the mixed image back to the memory buffer for display comprises: writing the mixed image to the memory buffer in the form of an image data format corresponding to the memory buffer In the area; reading image data from the memory buffer and displaying the image data.

Preferably, reading image data from the memory buffer and displaying the image data comprises: reading image data written to the memory buffer according to a predetermined period.

Preferably, the image data is mixed with the background image selected by the user in the specified memory, including: configuring the image data into a first pixel matrix form; and configuring the user-specified background image into a first a two-pixel matrix form; the first pixel matrix form and the second pixel matrix form are processed by a hybrid algorithm.

Preferably, performing the hybrid algorithm processing on the first pixel matrix form and the second pixel matrix form, comprising: reading a first color in a form of the first pixel matrix and a second color in a second pixel matrix form a color; decomposing the first color and the second color into a ternary color RGB; respectively multiplying each of the color colors of the first color R, G, B by X to obtain a first result, The second color of each of the second colors R, G, B is multiplied by (1-X) to obtain a second result, wherein X represents opacity; the RGB value of the first result and the second result R, GB value, according to each color in RGB corresponding to add a third result, the third result of the RGB three color is the value of the mixed algorithm processing.

Preferably, the method further includes: receiving an operation instruction of the user through the interaction interface, and setting at least one of the following according to the operation instruction: when the terminal is full screen, masking the mixed background image for the specified application Display; configure the opening key for the mixed background image; set the transparency parameter of the mixed background image.

Preferably, the specified memory is the same size as the memory buffer.

According to another embodiment of the present invention, there is further provided a display device of a background, the device comprising: a transfer module configured to transfer image data of an upper layer application of the terminal to a designated memory, wherein the specified memory and the The location of the default memory buffer is different; the hybrid processing module is configured to mix the image data with the background image selected by the user in the specified memory to obtain a mixed image, where the mixed image is The background image is an image of the background; the display module is configured to send the mixed image back to the memory buffer for display.

Preferably, the transmitting module includes: a modifying unit, configured to modify a first mapping relationship of the frame buffer device corresponding to the memory buffer to a second mapping relationship of the frame buffer device corresponding to the specified memory; The image data is transferred to the designated memory according to a second mapping relationship.

According to the present invention, the image data required for the application of the upper layer of the terminal is transmitted to the designated memory, and the specified memory is different from the technical solution of the memory buffer for storing the data required by the terminal to display the image by default, and the related art has not been solved in the mobile phone. All the interfaces realize the problem of displaying the user's customized background, and realize the user customized background on all the interfaces on the mobile phone, which can greatly solve the problem that the user has too few custom display style elements on the mobile phone, and improves the user experience, and has high commercialization. value.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:

1 is a flow chart showing a display method of a background according to an embodiment of the present invention;

2 is a flow chart of the operation of the system in accordance with a preferred embodiment of the present invention;

3 is a flow chart showing a display method of a background according to a preferred embodiment of the present invention;

4 is a block diagram showing the structure of a display device according to an embodiment of the present invention;

FIG. 5 is a block diagram showing another structure of a display device according to a background of an embodiment of the present invention; FIG.

6 is a block diagram showing the structure of a display system in accordance with a preferred embodiment of the present invention.

Detailed ways

The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

Other features and advantages of the invention will be set forth in the description which follows, The objectives and other advantages of the invention may be realized and obtained by means of the structure particularly pointed in the appended claims.

It should be noted that the following technical solutions of the embodiments of the present invention are applicable to at least one of the following scenarios: a Linux terminal and an Android system.

The embodiment of the present invention provides a background display method. FIG. 1 is a flowchart of a background display method according to an embodiment of the present invention. As shown in FIG. 1 , the method includes the following steps:

Step S102: transmitting image data of the upper layer application of the terminal to the designated memory, wherein the specified memory is different from the location of the default memory buffer of the terminal;

Step S104: mixing the image data and the background image selected by the user in the specified memory to obtain a mixed background image, wherein the mixed image is an image with the background image as a background;

Step S106: The above mixed image is sent back to the above memory buffer for display.

Through the above various steps, the image data required for the upper layer application of the terminal is transmitted to the designated memory, and the specified memory is different from the technical solution of the memory buffer of the data required by the terminal to save the display image of the terminal by default, and the related art has not been solved yet. All the interfaces of the mobile phone realize the problem of displaying the customized background of the user, and realize the customized background of all the interfaces on the mobile phone, which can greatly solve the problem that the user has too few custom display style elements on the mobile phone, and improves the user experience, and has a high degree. Commercial value.

In a specific implementation, in step S102, the image data of the upper layer application of the terminal is transmitted to the specified memory, including: modifying the first mapping relationship of the frame buffer device corresponding to the memory buffer to the second corresponding to the specified memory of the frame buffer device. Mapping relationship; transmitting the image data to the specified memory according to the second mapping relationship.

Step S106 may include the following steps: writing the mixed background image to the display memory buffer in the form of an image data format corresponding to the display buffer; reading the image data from the display buffer and the image data. Displayed and displayed in the format converted image, optionally, the image data written to the above-mentioned memory buffer is read in accordance with a predetermined period.

In an optional embodiment of the present invention, the image data and the background image selected by the user are mixed in the specified memory, including: configuring the image data into a first pixel matrix form; The background image is configured in a second pixel matrix form; the first pixel matrix form and the second pixel matrix form are mixed and processed.

In another optional embodiment, performing the hybrid algorithm processing on the first pixel matrix form and the second pixel matrix form, comprising: reading the first color in the form of the first pixel matrix and the second pixel matrix form a second color; respectively decomposing the first color and the second color into a ternary color RGB (ie, a short for Red Green Blue red, green, and blue); and each of the first color of R, G, and B The primary color is multiplied by X to obtain a first result, and each of the primary colors of R, G, and B of the second color is multiplied by (1-X) to obtain a second result, wherein X can represent a pre-set blend of the user. The opacity of the picture; the RGB value of the first result and the R and GB values of the second result are respectively added according to each color of the RGB to obtain a third result, and the RGB three colors of the third result are restored. The value to be processed by the blending algorithm.

In order to avoid affecting the visual effect when watching a movie or a game, the embodiment of the present invention further includes: receiving an operation instruction of the user through the interaction interface, and setting at least one of the following according to the operation instruction: when the terminal is full screen, the user may specify the application. When these applications are running, the mask display is performed, that is, for the specified application, the mixed background image is shielded and displayed; the mixed background image is configured with the key; the transparency parameter of the mixed background image is set.

It should be noted that the image data of the upper layer application of the terminal referred to in the embodiment of the present invention may include, but is not limited to, “initial interface image data” or “application image data”, which refers to the technical solution that the mobile phone does not use the embodiment of the present invention. The image that was previously displayed on the screen.

A further improvement of the above technical solution in the embodiment of the present invention is that the size of the specified memory and the memory buffer are the same.

In summary, the embodiment of the present invention displays an image that should be directly displayed on the display screen after being processed by the algorithm selected by the user, thereby displaying an effect of displaying a beautiful background on any interface of the mobile phone.

Related art used in the embodiments of the present invention includes a FrameBuffer (frame buffer device) and image processing. FrameBuffer is the abstraction of the upper layer of the display device. It provides the mapping of the memory buffer for the upper layer application. The upper layer completes the operation of the memory buffer by reading and writing to the FrameBuffer. When the image data is written to the memory buffer, the underlying display driver automatically reads the data in the memory buffer and displays it on the display. Therefore, the embodiment of the present invention can intercept and modify the image information to be written on the screen here. When the image information to be displayed and the background image are processed by an algorithm and then displayed on the screen, a translucent background effect is displayed.

In order to better understand the display process of the above background, the following description will be made in conjunction with the preferred embodiments, without limiting the invention.

Preferred embodiment 1

The technical solution adopted by the embodiment of the present invention is: intercepting image data to be displayed on the screen, performing a hybrid algorithm processing with the background icon, and displaying the processed image information on the screen. The implementation process is as follows:

Step 1: FIG. 2 is a flow chart of the system according to a preferred embodiment of the present invention, as shown in FIG. 2, wherein the LCD is an abbreviation of Liquid Crystal Display, and the FrameBuffer and the memory buffer M _{IO are} disconnected (equivalent to the above implementation). The direct mapping relationship of the memory buffer in the example, so that the upper layer image data is no longer directly written to M _IO . At the same time, a memory area M _L (corresponding to the specified memory in the above embodiment) which is the same size as the M _IO is customized, and the FrameBuffer is mapped to the memory M _L . In this way, the image data of the upper layer is not directly transmitted to the display device, but is passed to the customized memory M _{L of} the system.

This process is implemented on the Andorid platform: the display device registers register_FrameBuffer(struct fb_info*fb_info) to register itself into a global variable struct fb_info*registered_fb[FB_MAX] when the kernel is initialized. This global variable can be accessed and matched by fb_info. .modename gets the fb_info structure fb0 corresponding to the display device. The value of fb0->fix.mmio_start is the initial address of the memory buffer M _IO obtained by the display device during initialization. Save it and record it as M _IO _Start. The value of fb0->fix.mmio_len is the size of the memory buffer, which is represented as M _IO _L. We allocate a space ML of size M _IO _L in memory, the initial address is recorded as MMS_Start, the value of fb0->fix.mmio_start is assigned to MMS_Start, and then defined in fb_mmap() (linux/drivers/video/fbmem.c In the corresponding processing. At this time, the mapping area of FrameBuffer is no longer the memory buffer M _IO , but M _L , and the upper layer data image data will not be directly transmitted to the display controller, but will be passed to M _L .

Step 2: Parse the image data in the memory M _L and construct it into a disposable pixel matrix form P-1. The background image to be set is P-2. P-1 and P-2 are processed by a hybrid algorithm to obtain a processed image PF. Restore the PF to the image format in memory and write it to M _IO so that the screen driver can read the processed image and display it on the screen. Set a listener when the FrameBuffer performs a write operation, and repeat the process each time it is written.

The above process is implemented on the Android platform: the correspondence between the memory data and the image pixels can be obtained from fb0->fix.type, and the bit value of the pixel can be obtained from fb0->var.bits_per_pixel, and the number of pixels on the screen is Fb0->var.xres (width) *fb0->var.yres (height). Therefore, according to this relationship, the mutual conversion relationship between the memory data and the pixel matrix can be handled. The mixed processing algorithm of P-1 and P-2 is simply described as follows: assuming that the opacity is x, the colors of each point of P-1 and P-2 are respectively read, and each is decomposed into a ternary color, and the color of P-1 is made. Multiply x, the color of P-2 is multiplied by (1-x), and then add their values to get the corresponding pixel value of the new image PF, and PF has the desired translucent background effect.

Step 3: Establish interface interaction, so that the user can switch the function, and also set the background, transparency and other parameters. And you can set the full screen masking function, which can avoid affecting the visual effects when watching movies or games.

Preferred embodiment two

3 is a flow chart of a display method of a background according to a preferred embodiment of the present invention, as shown in FIG. 3:

S302, S304 are user operations, S306, S308, S310 are Android terminal system native processes, S312, S314, S316, S318 are part of the implementation of the system.

Step S302: When the user selects to open the service, the system changes the mapping relationship of the FrameBuffer to the memory area, as shown in S312 of FIG. 3, and modifies it to be mapped to the system-defined memory M _L . When the image data to be displayed by the Android frame is written to the FrameBuffer (S312), the actually written memory becomes M _L .

Step S316: After the M _L obtains the image data, the image data on the M _L needs to be parsed into an image format that is easy to process by the algorithm, and mixed with the background image set by the user to obtain the image information PF with the background (S316). Restore PF to memory format and write to the memory buffer M _{IO that was} originally obtained. The display reads the data and displays it on the screen.

Steps S314, S316, and S318 are continuously repeated, and the repetition timing is after the FrameBuffer is written.

In the embodiment, a background display device is provided for implementing the above-mentioned embodiments and preferred embodiments. The descriptions of the modules and the preferred embodiments have been omitted. The modules involved in the devices are described below. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated. 4 is a block diagram showing the structure of a display device according to a background of an embodiment of the present invention. As shown in Figure 4, the device comprises:

The transmitting module 40 is configured to transmit the image data of the upper layer application of the terminal to the designated memory, wherein the specified memory is different from the location of the default memory buffer of the terminal;

The mixing processing module 42 is connected to the transmitting module 40, and is configured to mix the image data and the background image selected by the user in the specified memory to obtain a mixed background image, wherein the mixed image is the background image. Background image

The display module 44 is connected to the mixing processing module 42 and is configured to send the mixed image back to the display buffer for display.

Through the comprehensive function of the above-mentioned modules, the image data required for the upper layer application of the terminal is transmitted to the designated memory, and the specified memory is different from the technical solution of the memory buffer of the data required for the terminal to save the display image of the terminal by default, and the related art is solved. The problem of displaying the user's customized background has not been realized in all the interfaces of the mobile phone, and the user customized background is displayed on all the interfaces on the mobile phone, which can greatly solve the problem that the user has less custom display style elements on the mobile phone, and improves the user experience. Higher commercial value.

Optionally, as shown in FIG. 5, the transmitting module 40 includes: a modifying unit 400, configured to modify a first mapping relationship of the frame buffering device corresponding to the memory buffer to a second mapping of the frame buffering device corresponding to the specified memory. The transfer unit 402 is connected to the modification unit 400 and configured to transfer the image data to the specified memory according to the second mapping relationship.

In order to better understand the structural block diagram of the display device of the above background and the workflow thereof, the following is described in conjunction with a preferred embodiment. FIG. 6 is a structural block diagram of a display system according to a preferred embodiment of the present invention, as shown in FIG. :

The main modules of the system include: a system function module 60, a user interaction module 62, and an image processing module 64. The function of each module is described as follows:

The system function module 60 (corresponding to the transmission module 40 in the above embodiment): The function of the module is to complete the initialization work when the system function is turned on, and complete the finishing work when the system function is turned off. The initial work includes allocating the memory M _L that is consistent with the M _IO size, and transferring the mapping of the FrameBuffer from the M _IO to the M _L while saving the information of the M _IO for use by the image processing module 64. It also includes some optimization features, such as blocking when displaying in full screen. The finishing work includes restoring the initial mapping of FrameBuffer and memory reclamation.

User interaction module 62: This module provides the user with the switch of the system. When the user opens the function defined by the system, the module will call the module 60 to change the memory mapping relationship of the FrameBuffer. When the user closes the function, the original mapping relationship is restored. The module also provides the user with an interface to select a background image that will be used by the image processing module 64 as a hybrid algorithm operation. This module also provides users with some settings, including background transparency, which programs are blocked when the program is running.

The image processing module 64 (corresponding to the functions performed by the mixing processing module 42 and the display module 44 of the above embodiment): the function of the module parses the image data in the memory M _L into a format that is easy to process by the algorithm, and according to the background selected by the user. The image is mixed to obtain an image PF with a background image, and the PF is restored to the in-memory data format and filled into the initial memory buffer M _IO . After the processed data is filled into M _IO , the processing in one cycle is completed, and then the display driver reads the image data in the M _IO and displays it on the screen. When the Frabuffer is written again, the data will be Repeat this process.

In summary, the embodiments of the present invention achieve the following beneficial effects: the problem of displaying the customized background of all interfaces in the mobile phone is not solved in the related art, and the user customized background is displayed on all interfaces of the mobile phone, which can greatly solve the problem. At present, the problem of too few user-defined display style elements on the mobile phone improves the user experience and has high commercial value.

It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across multiple computing devices. Optionally, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from this The steps shown or described are performed sequentially, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated into a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.

The above are only the preferred embodiments of the present invention, and are not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Industrial applicability

According to the above technical solution provided by the embodiment of the present invention, the image data required by the upper layer application of the terminal is transmitted to the designated memory, and the specified memory is different from the technical solution of the memory buffer of the data required by the terminal to save the display image of the terminal by default, and the solution is solved. In the related art, the problem of displaying the customized background of all the interfaces of the mobile phone is not realized, and the user customized background is displayed on all the interfaces on the mobile phone, which can greatly solve the problem that the user has less custom display style elements on the mobile phone, and improves the user experience. Degree, with high commercial value.

Claims

A display method of a background, the method comprising:

And transmitting the image data of the upper layer application of the terminal to the specified memory, wherein the specified memory is different from the location of the default memory buffer of the terminal;

And mixing the image data with the background image selected by the user in the designated memory to obtain a mixed image, wherein the mixed image is an image with the background image as a background;

The mixed image is sent back to the memory buffer for display.
The method according to claim 1, wherein the image data of the upper layer application of the terminal is transmitted to the designated memory, including:

And modifying, by the frame buffer device, the first mapping relationship corresponding to the memory buffer to a second mapping relationship of the frame buffer device corresponding to the specified memory;

And transmitting the image data to the designated memory according to the second mapping relationship.
The method of claim 2, wherein the displaying the mixed image back to the memory buffer for display comprises:

Writing the mixed image into the memory buffer in the form of an image data format corresponding to the memory buffer;

Image data is read from the memory buffer and the image data is displayed.
The method of claim 3, wherein reading image data from the memory buffer comprises:

The image data written to the memory buffer is read in accordance with a predetermined period.
The method of claim 1, wherein mixing the image data with a background image selected by a user in the specified memory comprises:

Arranging the image data into a first pixel matrix form;

Configuring the user-specified background image into a second pixel matrix form;

The first pixel matrix form and the second pixel matrix form are subjected to a hybrid algorithm process.
The method according to claim 5, wherein the first pixel matrix form and the second pixel matrix form are subjected to a hybrid algorithm process, including:

Reading a first color in the form of the first pixel matrix and a second color in the form of the second pixel matrix;

Decomposing the first color and the second color into a ternary color RGB;

Multiplying each of the color colors of R, G, and B of the first color by X to obtain a first result, and each of the color colors of R, G, and B of the second color is multiplied by (1-X) Obtaining a second result, wherein X represents opacity;

And RGB values of the first result and RGB values of the second result are respectively added according to each color in RGB to obtain a third result, and the RGB three colors of the third result are restored to be processed by the hybrid algorithm. Value.
The method of any of claims 1-6, further comprising:

Receiving an operation instruction of the user through the interaction interface, and setting at least one of the following according to the operation instruction:

When the terminal is full screen, the mixed background image is shielded and displayed for the specified application; the open key is configured for the mixed background image; and the transparency parameter of the mixed background image is set.
The method of any of claims 1-6, wherein the specified memory is the same size as the memory buffer.
A background display device comprising:

a transmitting module, configured to transfer image data of the upper layer application of the terminal to the specified memory, wherein the specified memory is different from the location of the default memory buffer of the terminal;

a mixing processing module, configured to mix the image data with a background image selected by a user in the specified memory to obtain a mixed image, wherein the mixed image is an image with the background image as a background;

And a display module configured to send the mixed image back to the memory buffer for display.
The apparatus of claim 9, wherein the transmitting module comprises:

a modifying unit, configured to modify a first mapping relationship of the frame buffer device corresponding to the memory buffer to a second mapping relationship of the frame buffer device corresponding to the specified memory;

And a transmitting unit configured to transfer the image data to the designated memory according to the second mapping relationship.