CN113010135B

CN113010135B - Data processing method and device, display terminal and storage medium

Info

Publication number: CN113010135B
Application number: CN202110475066.6A
Authority: CN
Inventors: 崔楠
Original assignee: Shenzhen TCL New Technology Co Ltd
Current assignee: Shenzhen TCL New Technology Co Ltd
Priority date: 2021-04-29
Filing date: 2021-04-29
Publication date: 2024-03-12
Anticipated expiration: 2041-04-29
Also published as: CN113010135A

Abstract

The application discloses a data processing method, a device, a display terminal and a storage medium, comprising the following steps: when a screen projection scene in a screen splitting mode is detected, screen projection data transmitted by a screen projection terminal are acquired, an effective display picture in a first screen projection picture is extracted to form a target screen projection picture, a screen projection area is determined according to the target screen projection picture, and the target screen projection picture is displayed through the screen projection area. According to the technical scheme, the occupancy rate of the effective screen throwing picture to the display area of the display terminal can be improved in the split screen mode of the display terminal, and the watching experience of a user to the display terminal is improved.

Description

Data processing method and device, display terminal and storage medium

Technical Field

The embodiment of the application relates to the technical field of screen projection, in particular to a data processing method, a device, a display terminal and a storage medium.

Background

Currently, for a large-screen television, a user can select to set a working mode to a split screen mode, and the television screen is split into two parts to realize that two application programs are simultaneously operated on the television screen. The split screen mode can fully apply the television characteristic of a large screen on the premise of not influencing the watching experience of a user, and more information elements are conveyed to the user. In addition, the user can also select to set the television working mode to be a screen throwing mode, and the content displayed by the screen throwing terminal (such as a mobile phone, a tablet personal computer and the like) can be watched on the television screen by throwing the picture on the screen throwing terminal to the television screen.

The split screen mode refers to dividing a television screen into two or more windows, and the windows independently operate without interference. In split screen mode, the user may run different applications under each window, for example, video playing software viewing video on one window and chat software sending messages on another window. The screen-throwing mode is to establish a point-to-point (P2P) direct communication path between the screen-throwing terminal and the television terminal through a screen-throwing protocol, the screen-throwing terminal records the screen of the interface, then codes the screen, and sends the screen-throwing terminal to the television terminal for decoding and playing, so that the television terminal can synchronously display the content of the screen-throwing terminal in real time.

The existing television screen is divided into two parts, the screen projection display area is halved, and the television can acquire a screen projection picture to be transmitted by a screen projection terminal and directly display the screen projection picture in the screen projection area. Because the aspect ratio of the screen-throwing display area is changed after the screen separation, the screen to be thrown can be preferentially adapted to the width of the screen-throwing display area, and the obtained effective screen can be very small after the screen is compressed according to the aspect ratio of the screen-throwing display area, so that the use experience of a user is influenced.

Disclosure of Invention

The embodiment of the application provides a data processing method, a data processing device, a display terminal and a storage medium, which can improve the occupancy rate of an effective screen projection picture to a display area of the display terminal in a split screen mode of the display terminal and improve the watching experience of a user to the display terminal.

In a first aspect, an embodiment of the present application provides a data processing method, where the method includes:

when a screen projection scene entering a screen splitting mode is detected, screen projection data transmitted by a screen projection terminal are acquired, wherein the screen projection data comprise at least one frame of screen to be projected;

extracting an effective display picture in a first to-be-projected picture to form a target to-be-projected picture, wherein the first to-be-projected picture is any frame in the at least one frame to-be-projected picture;

determining a screen throwing area according to the target screen throwing picture, wherein the target screen throwing picture is matched with the screen throwing area;

and displaying the target screen-throwing picture through the screen-throwing area.

Optionally, the extracting an effective display picture in the first to-be-projected screen picture to form a target to-be-projected screen picture includes;

determining a first brightness reference line of the first screen to be projected according to the size of the first screen to be projected and the pixel brightness information, wherein the first brightness reference line is used for indicating a boundary line of the effective display picture in the first screen to be projected;

and extracting the effective display picture from the first picture to be projected according to the first brightness reference line so as to obtain the target picture to be projected.

Optionally, before extracting the effective display picture from the first screen to be projected picture according to the first brightness reference line to obtain the target screen to be projected picture, the method further includes:

judging whether the first brightness datum line is correct or not;

correspondingly, the extracting the effective display picture from the first to-be-projected picture according to the first brightness reference line to obtain the target to-be-projected picture includes:

and when the first brightness reference line is correct, extracting the effective display picture from the first picture to be projected according to the first brightness reference line so as to obtain the target picture to be projected.

Optionally, the determining whether the first luminance reference line is correct includes:

acquiring a second brightness reference line in a second screen to be projected, wherein the second brightness reference line is used for indicating a boundary line of an effective display picture in the second screen to be projected, the second screen to be projected belongs to the at least one frame of screen to be projected, and the second screen to be projected is different from the first screen to be projected;

calculating an average gradient threshold value of the first brightness datum line and the second brightness datum line, wherein the average gradient threshold value is determined according to the longitudinal pixel brightness sum corresponding to the first brightness datum line and the longitudinal pixel brightness sum corresponding to the second brightness datum line;

And when the average gradient threshold meets a preset condition, determining that the first brightness datum line is correct.

Optionally, the determining, according to the size of the first to-be-projected screen frame and the pixel brightness information, a first brightness reference line of the first to-be-projected screen frame includes:

determining a preset vertical line in the effective display picture;

and calculating an average pixel brightness value corresponding to each longitudinal line in a plurality of target longitudinal lines on one side of the preset longitudinal line by taking the preset longitudinal line as a starting point according to the size of the first screen to be projected and the pixel brightness information, so as to determine the first brightness reference line, wherein the first brightness reference line is a longitudinal line, the average pixel brightness value in the plurality of target longitudinal lines is smaller than a preset threshold value, and the longitudinal line is nearest to the preset longitudinal line.

Optionally, the determining the screen-throwing area according to the target screen-throwing picture includes:

determining the stretching proportion of the target screen projection picture according to a target adaptation value, wherein the target adaptation value is the size of the fixed height of the screen projection area;

and determining the screen throwing area according to the stretching proportion and the target screen throwing picture.

Optionally, the detecting the screen-throwing scene in the screen-splitting mode includes:

When the screen splitting mode is detected to be entered, checking whether the current application stack is associated with the screen throwing mode;

if yes, confirming a screen throwing scene in a split screen mode; or,

when the screen-throwing mode is detected to be entered, checking whether the current display interface is associated with the split screen mode;

if yes, confirming the screen scene entering the split screen mode.

In a second aspect, embodiments of the present application further provide a data processing apparatus, including:

the screen-throwing data acquisition module is used for acquiring screen-throwing data transmitted by a screen-throwing terminal when a screen-throwing scene entering a screen-splitting mode is detected, wherein the screen-throwing data comprises at least one frame of screen to be thrown;

the picture extraction module is used for extracting an effective display picture in a first to-be-projected picture to form a target to-be-projected picture, wherein the first to-be-projected picture is any frame in the at least one frame of to-be-projected picture;

the screen-throwing area determining module is used for determining a screen-throwing area according to the target screen-throwing picture, and the target screen-throwing picture is matched with the screen-throwing area;

and the screen-throwing picture display module is used for displaying the target screen-throwing picture through the screen-throwing area.

In a third aspect, an embodiment of the present application further provides a display terminal, including:

One or more processors;

a storage means for storing one or more programs;

the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the data processing methods provided by any of the embodiments of the present application.

In a fourth aspect, embodiments of the present application further provide a computer readable storage medium having a computer program stored thereon, which when executed by a processor, implements the data processing method provided by any embodiment of the present application.

According to the technical scheme, when the screen throwing scene in the split screen mode is detected, the screen throwing data transmitted by the screen throwing terminal are acquired through the display terminal, the effective display picture in the first screen throwing picture is extracted to form the target screen throwing picture, the screen throwing area is determined according to the target screen throwing picture, the technical means of displaying the target screen throwing picture through the screen throwing area can be realized, the screen on the screen throwing terminal is thrown into the display area simultaneously in the split screen mode of the display terminal, the occupancy rate of the effective screen throwing picture to the display area of the display terminal in the split screen mode of the display terminal can be improved, and the watching experience of a user to the display terminal is improved.

Drawings

Fig. 1 is a system architecture diagram of a screen projection system according to an embodiment of the present application;

fig. 2 is a schematic diagram of an embodiment of a data transmission method according to an embodiment of the present application;

fig. 3 (a) is a schematic diagram of a screen to be projected sent by a projection terminal;

fig. 3 (b) is a schematic diagram showing a screen to be projected in a split screen mode of a display terminal in the prior art;

fig. 4 is a schematic diagram of another embodiment of a data transmission method according to an embodiment of the present application;

fig. 5 is a schematic diagram of another embodiment of a data transmission method according to an embodiment of the present application;

fig. 6 (a) is a schematic diagram of a display area of a display terminal according to an embodiment of the present application;

fig. 6 (b) is another schematic diagram of a display area of the display terminal according to the embodiment of the present application;

fig. 6 (c) is another schematic diagram of a display area of the display terminal according to the embodiment of the present application;

FIG. 7 is a block diagram of a data processing apparatus according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a display terminal according to an embodiment of the present application.

Detailed Description

The application provides a data processing method, a data processing device and a storage medium, which can improve the occupancy rate of an effective screen projection picture to a display area of a display terminal in a split screen mode of the display terminal and improve the viewing experience of a user to the display terminal.

The present application is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present application are shown in the drawings. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.

The terms first, second and the like in the description and in the claims of the present application and in the above-described figures, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments described herein may be implemented in other sequences than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Fig. 1 is a system architecture diagram of a projection system 10 according to an embodiment of the present application. The screen projection system 10 includes a display terminal 101 and one or more screen projection terminals 102. It should be noted that, fig. 1 illustrates only one screen terminal 102, and a plurality of screen terminals 102 may be further included in practical applications, and the example of fig. 1 should not be construed as limiting the application.

In this embodiment of the present application, the display terminal 101 may be a device having at least a function of playing/displaying streaming media data. Alternatively, the display terminal 101 may be an electronic device with a display function, such as a television, a conference display screen, a tablet computer, or a desktop computer. In the embodiment of the present application, the screen capturing terminal 102 may be a device at least having a screen capturing data sending capability. Alternatively, the screen-cast terminal 102 may be a User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), or the like. Currently, some examples of the screen-projection terminal 102 are: electronic devices such as mobile phones, tablet computers, notebook computers, personal digital assistants (Personal Digital Assistant, PDA) or desktop computers.

In this embodiment, the screen projection terminal 102 is capable of transmitting screen projection data such as display content (including desktop, video, audio, etc. data) of the screen projection terminal 102 to the display terminal 101 through a wireless screen projection technology, so that the display terminal 101 is capable of displaying relevant content according to the screen projection data. The Wireless screen-throwing technology may be Miracast, DLNA, airPlay, WIDI, WHDI, wireless HD, and some custom protocols, for example, short-distance communication technologies based on bluetooth, wi-Fi, or ultra wideband UWB (Ultra WideBand), which are not limited in this embodiment of the present application.

Example 1

Based on the system architecture in fig. 1, fig. 2 is a schematic diagram of an embodiment of a data transmission method according to an embodiment of the present application.

Referring to fig. 2, an embodiment of a data transmission method provided in the embodiments of the present application may include the following contents of steps 210 to 240. The method comprises the following steps:

step 210, when the display terminal detects a screen projection scene in a screen splitting mode, screen projection data transmitted by the screen projection terminal are obtained, wherein the screen projection data comprise at least one frame of screen to be projected.

The method and the device are applied to the screen throwing scene of the display terminal in the split screen mode. In the scene, if the user needs to perform screen projection display on the display terminal through the screen projection terminal, the display terminal receives screen projection data sent by the screen projection terminal, wherein the screen projection data can comprise at least one frame of screen to be projected.

In the embodiment of the application, when a user needs to throw a screen in a split screen mode of a display terminal, or needs to adopt a split screen mode in the screen throwing process, the display terminal can judge whether to enter a screen throwing scene in the split screen mode by detecting whether the split screen mode and the screen throwing mode are both triggered, the user sends a screen throwing request to the display terminal by triggering the screen throwing function of the screen throwing terminal, the display terminal identifies the screen throwing terminal corresponding to the screen throwing request according to the screen throwing request, then a P2P direct communication channel between the display terminal and the screen throwing terminal is established, and screen throwing data sent by the screen throwing terminal is acquired in the screen throwing scene in the split screen mode through the P2P direct communication channel.

Optionally, in a specific embodiment, the display terminal may establish a P2P direct communication path between the display terminal and the screen-throwing terminal according to the identification information of the screen-throwing terminal included in the screen-throwing request.

And 220, the display terminal extracts an effective display picture in the first to-be-projected picture to form a target to-be-projected picture.

In the embodiment of the application, after acquiring the screen projection data transmitted by the screen projection terminal, the display terminal extracts an effective display picture in a first screen projection picture so as to generate a target screen projection picture corresponding to the first screen projection picture.

The first screen to be projected in the embodiment of the present application refers to any one frame of one or more frames of screen to be projected in the screen projection data. In this embodiment of the present application, the first screen to be projected includes an effective display screen and an ineffective screen. In this embodiment of the present application, the effective display screen in the first screen to be projected specifically refers to the screen content having the information that the user may be interested in, and the ineffective screen specifically refers to the screen content that the user cannot acquire meaningful information. For example, when the screen-throwing terminal is a mobile phone and the display terminal is a television, the user wants to throw the content such as a mobile phone desktop, a photo or a video of the mobile phone onto the television for display, and in the screen-throwing data sent to the television by the mobile phone, the screen to be thrown of each frame may include some ineffective content, such as surrounding filling content, for adapting to the television display interface, besides the content of the mobile phone desktop, the photo or the video. The mobile phone desktop picture is often positioned in the middle of the screen projection picture, black edges are filled at two sides of the screen projection picture, and the black edges are generated by the mobile phone desktop picture when the screen projection terminal generates screen projection data. The embodiment of the application shows a schematic diagram of a screen to be projected sent by a screen projection terminal, as shown in fig. 3 (a). In fig. 3 (a), the desktop screen 302 of the mobile phone in the screen to be projected 301 is the screen content that the user wants to see, i.e. the active display screen, and the black edge filling on both sides is not able to acquire any meaningful screen content for the user, thus is the inactive screen. The embodiment of the application also shows a schematic diagram for displaying the screen projection picture in fig. 3 (a) in the split screen mode of the display terminal in the prior art, as shown in fig. 3 (b). The display area 303 of the display terminal is split, the left split screen is an application screen display area 304, the right split screen is a screen throwing area 305, and the screen throwing area 305 displays a screen to be thrown 306 (i.e. 301 in fig. 3 (a)), wherein the screen to be thrown 306 is adapted to the width of the screen throwing area 305. However, after the screen to be projected 306 is adapted to the width of the screen projection area 305, the effective display 307 (i.e., 302 in fig. 3 (a)) in the screen to be projected 306 is very small.

It should be noted that, the screen to be displayed in fig. 3 (a) and 3 (b) is only one example of the form of the valid display screen and the invalid screen in the screen to be displayed in the embodiment of the present application. In the practical application process, the invalid screen may be any other form of screen content that cannot be acquired by the user, and the relative positions of the valid display screen and the invalid screen may also be other cases, where the invalid content is taken as a black edge, and the black edge exists on at least one side of the upper side or the lower side of the valid display screen, or the black edge exists around the valid display screen, which is not limited in this embodiment of the present application.

It should be noted that, in the embodiment of the present application, a manner in which the display terminal extracts an effective display screen from the screen to be projected is not specifically limited. The number of the to-be-screen-projected pictures processed by the display terminal at the same time and the processing sequence are not particularly limited.

Optionally, in this embodiment of the present application, after the display terminal acquires the screen projection data transmitted by the screen projection terminal, each frame of screen projection images to be projected is sequentially acquired, and an effective display image of each frame of screen projection images to be projected is sequentially extracted, and the extracted effective display image is taken as the target screen projection image.

Optionally, in this embodiment of the present application, after the display terminal obtains the screen projection data transmitted by the screen projection terminal, the display terminal may also process multiple frames of to-be-projected screen images simultaneously, for example, process two frames of to-be-projected screen images simultaneously, and extract an effective display image of each frame of to-be-projected screen image.

And 230, the display terminal determines a screen throwing area according to a target screen throwing picture, wherein the target screen throwing picture is matched with the screen throwing area.

In the embodiment of the application, in a screen-throwing scene in a screen-splitting mode, a display area of a display terminal is divided into a plurality of screen-splitting modes, wherein one screen-splitting mode can display a desktop or corresponding application of the display terminal, and the other screen-splitting mode or the screen-splitting modes are used for displaying target screen-throwing pictures respectively corresponding to one or more screen-throwing terminals.

In the embodiment of the application, after the display terminal acquires the target screen-throwing picture, the size and the screen-throwing position of the screen-throwing area matched with the target screen-throwing picture are determined according to the target screen-throwing picture, and the screen-throwing picture is used for screen-throwing display of the target screen-throwing picture.

Optionally, in the embodiment of the present application, if only one screen-throwing terminal performs screen-throwing currently, the display terminal may divide the display area into two split screens, where the first split screen displays a desktop or a corresponding application of the display terminal, and the second split screen displays a target screen-throwing picture. The specific position and the specific size of the second split screen are determined by the display terminal according to the target screen after the target screen is acquired, namely the screen-throwing area matched with the target screen. The second split screen only displays the content of the target projection screen. After the display terminal determines the screen-throwing area matched with the target screen-throwing picture, namely, the size and the specific position of the second split screen, the size and the position of the first split screen are correspondingly determined.

Optionally, if there are two screen terminals (screen terminal a and screen terminal B) for screen casting, the display terminal may divide the display area into three separate screens, where the first separate screen displays the desktop or corresponding application screen of the display terminal, the second separate screen displays the target screen of the screen terminal a, and the third separate screen displays the target screen of the screen terminal B. The specific positions and the specific sizes of the second split screen and the third split screen are determined according to the target screen projection picture corresponding to the screen projection terminal A and the target screen projection picture corresponding to the screen projection terminal B after the display terminal respectively acquires the target screen projection picture corresponding to the screen projection terminal A and the target screen projection picture corresponding to the screen projection terminal B, only the content of the target screen projection picture of the screen projection terminal A is displayed in the second split screen, and only the content of the target screen projection picture of the screen projection terminal B is displayed in the third split screen. Optionally, in the actual application process, the determination of the display terminal on the second split screen and the third split screen needs to be determined according to information such as specific typesetting of the split screens (for example, the relative positions of the split screens) besides the determination according to the target screen-throwing picture of the screen-throwing terminal a and the target screen-throwing picture of the screen-throwing terminal B, which is not particularly limited herein.

In the embodiment of the application, under the condition of determining information such as the number of split screens and typesetting, the display terminal can stretch the target screen projection screen according to a preset proportion according to the size of the target screen projection screen, and the size of the stretched target screen projection screen is used as the target size of the screen projection area. After the display terminal calculates the target size of the screen throwing area, an area matched with the target size can be divided in the display area of the display terminal to be used as the screen throwing area.

The advantages of this arrangement are that: the aspect ratio of the target screen projection picture can be ensured to be equal to the aspect ratio of the screen projection area, and further the viewing experience of a user on the display terminal is improved.

Step 240, the display terminal displays the target screen projection picture in the screen projection area matched with the target screen projection picture.

In this embodiment, after determining a screen-throwing area corresponding to a target screen-throwing picture, the display terminal displays the target screen-throwing picture in the screen-throwing area.

In a specific embodiment, assuming that the user triggers the screen-throwing mode only on the display terminal, the display terminal may directly take the first screen-throwing picture as the target screen-throwing picture and display the target screen-throwing picture in the display area of the display terminal, after that, if the user triggers the screen-splitting mode on the display terminal, the display terminal may extract the effective display picture in the first screen-throwing picture according to the above method to form the target screen-throwing picture, display the target screen-throwing picture in the screen-throwing area and display the application picture in the application picture display area, thereby realizing that the display terminal simultaneously throws the picture on the screen-throwing terminal into the display area in the screen-splitting mode.

In another specific embodiment, if the user triggers the split screen mode only on the display terminal, the display terminal may display a plurality of different application screens selected by the user in the display area of the display terminal, after that, if the user also triggers the split screen mode on the display terminal, the display terminal may extract an effective display screen in the first screen to be projected according to the above method to form a target screen, display the target screen in the projection area, and display the plurality of application screens in the application screen display area, thereby implementing that the display terminal simultaneously projects the screen on the screen projection terminal in the display area in the split screen mode.

According to the technical scheme, when the screen projection scene in the split screen mode is detected, the screen projection data transmitted by the screen projection terminal are acquired through the display terminal, the effective display picture in the first screen projection picture is extracted to form the target screen projection picture, the screen projection area is determined according to the target screen projection picture, the technical means of displaying the target screen projection picture in the screen projection area matched with the target screen projection picture can be realized, the screen on the screen projection terminal is projected into the display area simultaneously in the split screen mode of the display terminal, the occupancy rate of the effective screen projection picture to the display area of the display terminal in the split screen mode of the display terminal is improved, and the viewing experience of a user to the display terminal is improved.

In a specific embodiment, assuming that the display terminal is a television, the screen-throwing terminal is a mobile phone, and the current application scene is a mobile phone live broadcast scene, the live broadcast picture of the mobile phone of the user can be displayed in the screen-throwing area of the television by the method, and the user can use the television to carry out live broadcast and can also use the picture of television application (such as music playing software and a text prompter) to carry out auxiliary live broadcast.

Example two

The present embodiment is a further refinement of the first embodiment, and the same or corresponding terms as those of the first embodiment are explained, and the description of the present embodiment is omitted. Fig. 4 is a schematic diagram of an embodiment of a data transmission method provided in the embodiment of the present application, where the technical solution of the embodiment may be combined with one or more methods in the solution of the foregoing embodiment, and in this embodiment, as shown in fig. 4, the method provided in the embodiment of the present application may include:

step 410, when the display terminal detects a screen projection scene in a screen splitting mode, screen projection data transmitted by the screen projection terminal are obtained, wherein the screen projection data comprise at least one frame of screen to be projected.

Embodiments of the present application may also be understood with reference to the relevant content in step 210 of fig. 2, which is not described herein.

Optionally, in the embodiment of the present application, a specific manner that the display terminal detects a screen-throwing scene in the screen-splitting mode may be: when the screen splitting mode is detected to be entered, checking whether the current application stack is associated with the screen throwing mode; if yes, confirming a screen throwing scene in a split screen mode; or when the screen-throwing mode is detected to be entered, checking whether the current display interface is associated with the split screen mode; if yes, confirming the screen scene entering the split screen mode.

When the display terminal detects that the user triggers the split screen mode, whether a current application stack (top package) corresponding to the display terminal is a screen projection package or not can be checked, and if yes, the display terminal is confirmed to enter a screen projection scene in the split screen mode. When the screen-throwing mode triggered by the user is detected, whether the activity started by the display terminal belongs to a split screen package or not can be checked, and if yes, the display terminal is confirmed to enter a screen-throwing scene in the split screen mode.

Step 420, the display terminal determines a first luminance reference line of the first screen to be projected according to the size of the first screen to be projected and the pixel luminance information.

In this embodiment, the first luminance reference line refers to a boundary line between an effective display screen and an ineffective screen in the first screen to be projected. Taking the first to-be-projected screen in fig. 3 (a) as an example, the first brightness reference line is two boundary lines of the effective display screen and the left black or the right black in the first to-be-projected screen. The display terminal determines a first brightness reference line, and aims to cut a first screen to be displayed according to the first brightness reference line, so that an effective display picture is extracted from the first screen to be displayed.

In this embodiment of the present application, the display terminal determines, according to the size of the first screen to be projected and the pixel brightness information, a first brightness reference line of the first screen to be projected. Taking the to-be-projected screen shown in fig. 3 (a) as an example, a specific implementation manner of determining the first brightness reference line by the display terminal provided in the embodiment of the present application may include the following contents of step (1) and step (2).

And (1) the display terminal firstly determines a preset longitudinal line positioned in the effective display picture according to the size of the first screen picture to be thrown.

In this embodiment of the present application, the display terminal may use a boundary point at the lower left corner of the first screen to be projected (i.e., the first screen to be projected is rectangular, and an intersection point between the left side and the lower side) as an origin, and establish a rectangular coordinate system according to the origin. In the rectangular coordinate system, a longitudinal straight line with an abscissa as a preset value is selected as a preset longitudinal line. Taking an example that an effective display screen in the first screen to be cast is located at the middle position of the first screen to be cast, the preset value may be set to be half of the width of the upper side (or the lower side) of the screen to be cast, that is, assuming that the width of the screen to be cast is W1, the preset value may be 0.5W1. The height of the preset longitudinal line is equal to the height of the first screen to be projected. Alternatively, the preset value may be set to another value, which is only required to ensure that the preset vertical line is located inside the effective display screen.

And (2) the display terminal calculates an average pixel brightness value corresponding to each longitudinal line in a plurality of target longitudinal lines on one side of the preset longitudinal line according to the pixel brightness information of the first screen to be shot by taking the preset longitudinal line as a starting point to determine a first brightness reference line, wherein the first brightness reference line is a longitudinal line, the average pixel brightness value in the plurality of target longitudinal lines is smaller than a preset threshold value, and the longitudinal line is nearest to the preset longitudinal line.

In this embodiment of the present application, after determining a preset longitudinal line, the display terminal calculates, according to pixel brightness information of the first screen to be thrown, an average pixel brightness value corresponding to each longitudinal line of a plurality of target longitudinal lines on one side of the preset longitudinal line. Specifically, in the embodiment of the present application, after determining the preset longitudinal line, the display terminal sequentially calculates the average pixel brightness value of each longitudinal line on the left side or the right side with the preset longitudinal line as a starting point. Specifically, taking the left side as an example, the display terminal may move leftwards by a unit distance value with a preset longitudinal line as a starting point, thereby determining a first longitudinal line on the left side of the preset longitudinal line, calculating an average pixel brightness value of the first longitudinal line, and judging whether the average pixel brightness value corresponding to the first longitudinal line is greater than or equal to a preset threshold value; if so, moving the unit distance value leftwards by taking the first longitudinal line as a starting point, thereby determining a second longitudinal line on the left side of the preset longitudinal line, calculating the average pixel brightness value of the second longitudinal line, judging whether the average pixel brightness value corresponding to the second longitudinal line is larger than or equal to a preset threshold …, and the like, and determining the X longitudinal line as a first brightness datum line until the average pixel brightness value of the X longitudinal line is smaller than the preset threshold.

In this embodiment of the present application, for any one vertical line, the specific manner in which the display terminal calculates the average pixel brightness value of the vertical line may use the following calculation method: the display terminal firstly acquires the number N of the pixel points on the longitudinal line and the brightness sum S of each pixel point on the longitudinal line. The display terminal can calculate the Y component of each pixel point on the longitudinal line based on the YUV coding format of the color coding method, and then add the Y components of each pixel point, thereby obtaining the brightness and S of each pixel point on the longitudinal line. Wherein the Y component is the luminance (bright) specification. After the above procedure, the display terminal may calculate an average pixel luminance value P corresponding to a preset vertical line according to the number N of pixel points on the vertical line and the luminance sum S, where p=s/N.

And 430, the display terminal extracts an effective display picture from the first picture to be projected according to the first brightness reference line so as to obtain a target picture to be projected.

In the embodiment of the application, after determining the first brightness reference line, the display terminal determines a cutting area according to the position coordinate of the first brightness reference line and the size of the first screen to be projected, cuts the first screen to be projected according to the cutting area, so as to obtain an effective display screen, and generates a target screen to be projected according to the effective display screen.

Taking the form of the effective display screen shown in fig. 3 (a) as an example, the effective display screen is located in the middle of the first screen to be projected, the height of the effective display screen is consistent with the height of the screen to be projected, and when only the left side and the right side have black edges, the height of the clipping area is equal to the height of the first screen to be projected. After the display terminal determines the first brightness reference line in the first screen to be projected, the width of the effective display screen can be determined as W according to the abscissa Bw of the first brightness reference line ₁ -2Bw, when Bw is smaller than the abscissa of the preset longitudinal line, the abscissa interval corresponding to the clipping region is [ Bw, W ₁ -Bw]When Bw is larger than the abscissa of the preset longitudinal line, the abscissa interval of the clipping region is [ W ] ₁ -Bw，Bw]。

In practical application, when the brightness of the actual effective display screen in the first screen to be displayed is low, the first brightness reference line determined in the above manner may be located in the effective display screen, and if the screen to be displayed is cut according to the first brightness reference line, the situation that the target screen obtained by cutting is inconsistent with the actual effective display screen is likely to occur.

In order to solve the above-mentioned problem, the display terminal may further verify the position of the first luminance reference line before extracting the effective display screen from the first screen to be placed according to the first luminance reference line, so as to prevent the first luminance reference line from being not the boundary line of the effective display screen and the ineffective display screen based on the above-mentioned determination. Specifically, the embodiment in which the display terminal verifies the position of the first luminance reference line may include the following contents of steps (1) to (3).

(1) And the display terminal acquires a second brightness reference line in a second screen to be projected.

In this embodiment of the present application, the second screen to be projected is another frame of screen to be projected, which is different from the first frame of screen to be projected, of the multiple frames of screen to be projected included in the screen projection data. In this embodiment of the present application, the second screen to be projected may be a screen to be projected spaced apart from the first screen to be projected by a preset value, for example, when the preset value is 0, the second screen to be projected may be two frames of screen to be projected adjacent to the first screen to be projected, and when the preset value is 1, one frame of screen to be projected is spaced apart between the first screen to be projected and the second screen to be projected.

In this embodiment of the present application, the second luminance reference line in the second screen to be projected is used to indicate a boundary line between the effective display screen and the ineffective screen in the second screen to be projected. After the display terminal obtains the second screen to be projected, the method for obtaining the second brightness reference line in the second screen to be projected can be understood by referring to the manner of determining the first brightness reference line by the display terminal in step 420, which is not described herein.

(2) An average gradient threshold value of the first luminance reference line and the second luminance reference line is calculated.

In this embodiment of the present application, the average gradient threshold is determined according to a sum of longitudinal pixel intensities corresponding to the first luminance reference line and a sum of longitudinal pixel intensities corresponding to the second luminance reference line.

For example, when the number of pixels on the first luminance reference line and the second luminance reference line is N, the sum of the vertical pixel luminances corresponding to the first luminance reference line is L1, and the sum of the vertical pixel luminances corresponding to the second luminance reference line is L2, the average gradient threshold of the first luminance reference line and the second luminance reference line is D, and d= (l1+l2)/2N.

(3) And when the average gradient threshold meets a preset condition, the display terminal determines that the first brightness datum line is correct.

In this embodiment of the present application, the display terminal determines whether the first luminance datum line and the second luminance datum line meet a preset condition, where the preset condition refers to whether an average gradient threshold is less than or equal to a preset threshold. When the average gradient threshold value is smaller than or equal to the preset threshold value, the average gradient threshold value can be considered to meet the preset condition, and at the moment, the display terminal determines that the first brightness datum line is correct. If the average gradient threshold is greater than the preset threshold, the first brightness reference line is in error, that is, the first brightness line is not the real boundary line of the effective display picture and the ineffective content, at this time, the display terminal will redetermine the first brightness reference line and the second brightness reference line in the first to-be-displayed picture and the second to-be-displayed picture respectively until the average gradient threshold of the first brightness reference line and the second brightness reference line is less than or equal to the preset threshold.

Step 440, the display terminal determines a screen projection area according to a target screen projection picture, wherein the target screen projection picture is matched with the screen projection area.

Embodiments of the present application may be understood with reference to step 230 in fig. 2, and will not be described herein.

And 450, displaying the target screen projection picture in the screen projection area matched with the target screen projection picture by the display terminal.

Embodiments of the present application may be understood by referring to step 240 in fig. 2, and will not be described herein.

According to the technical scheme, when the screen projection scene in the split screen mode is detected by the display terminal, screen projection data transmitted by the screen projection terminal are obtained, a first brightness reference line is determined according to the size of a first screen projection picture and pixel brightness information, then an effective display picture is extracted from the first screen projection picture according to the first brightness reference line, so that a target screen projection picture is obtained, finally a screen projection area is determined according to the target screen projection picture, the effective display picture can be accurately extracted from the first screen projection picture through the technical means of displaying the target screen projection picture in the screen projection area, the picture content which is possibly interesting to a user can be furthest displayed in the display area of the display terminal, and the viewing experience of the user to the display terminal is improved.

Example III

The present embodiment is a further refinement of the foregoing embodiments, and the same or corresponding terms as those of the foregoing embodiments are explained, which are not repeated herein. Fig. 5 is a schematic diagram of another embodiment of a data transmission method provided in the embodiment of the present application, where the technical solution of the present embodiment may be combined with one or more methods in the foregoing embodiment, and in this embodiment, as shown in fig. 5, the method provided in the embodiment of the present application may further include:

step 510, when the display terminal detects a screen projection scene in the screen splitting mode, screen projection data transmitted by the screen projection terminal are obtained, wherein the screen projection data comprise at least one frame of screen to be projected.

The embodiment of the present application may be understood with reference to step 210 of fig. 2, and will not be described herein.

Step 520, the display terminal extracts an effective display picture in the first to-be-projected picture to form a target to-be-projected picture, where the first to-be-projected picture is any frame in the at least one frame to-be-projected picture.

Embodiments of the present application may be understood with reference to step 220 of fig. 2, and will not be described herein.

And 530, the display terminal determines the stretching proportion of the target screen projection picture according to a target adaptation value, wherein the target adaptation value is the size of the fixed height of the screen projection area.

In this embodiment of the present application, the target adaptation value is related to the number and typesetting of the split screens of the display terminal, where the target adaptation value refers to an adaptation size of a split screen area corresponding to the target screen-throwing picture, and the adaptation size may be one of a height size or a width size of the split screen area. After the display terminal generates the target screen projection picture, the stretching proportion of the target screen projection picture can be determined according to the target adaptation value.

Optionally, in a specific embodiment, if the number of the current screen projection terminals corresponding to the display terminal is one, that is, when the display terminal only needs to display a target screen projection picture corresponding to the screen projection terminal at the current time, the fixed height of the preset screen projection area of the display terminal is equal to the height of the display area of the display terminal. For example, if only one screen-throwing terminal is currently throwing a screen, the number of the split screens of the display interface 601 of the display terminal is 2, and when the typesetting of the split screens is left split screen and right split screen, as shown in fig. 6 (a), the left split screen 603 is an application screen display area, and the right split screen 602 is a screen-throwing area. The target adaptation value refers to a height value of the right split screen 602 where the target screen is to be projected, that is, the height of the right split screen 602 is determined, and after the display terminal generates the target screen, the stretching ratio of the target screen is determined according to the height of the right split screen 602.

Optionally, in a specific embodiment, if the number of the current screen-throwing terminals corresponding to the display terminal is multiple, that is, when the display terminal needs to display the target screen-throwing pictures corresponding to the multiple screen-throwing terminals at the same time at the current moment, the target adaptation value of the screen-throwing area corresponding to each target screen-throwing picture needs to be determined according to the screen division number and typesetting of the display terminal.

For example, if there are two screen terminals (screen terminal a and screen terminal B) currently performing screen projection, the number of split screens of the display interface 601 of the display terminal is 3, and when the typesetting of the split screens is left, middle and right typesets, as shown in fig. 6 (B), the right split screen 604 is a screen projection area of the screen projection terminal a, the middle split screen 605 is a screen projection area of the screen projection terminal B, and the left split screen 606 is an application screen display area. For the screen-throwing terminal a, the target adaptation value refers to a height value of a right split screen 604 of the screen to be thrown on by the target screen-throwing screen corresponding to the screen-throwing terminal a, namely, the height of the right split screen 604 is determined, and after the display terminal generates the target screen-throwing screen, the stretching proportion of the target screen-throwing screen is determined according to the height of the right split screen 604. For the screen-throwing terminal B, the target adaptation value refers to a height value of the middle split screen 605 of the screen to be thrown on by the target screen-throwing picture corresponding to the screen-throwing terminal B, that is, the height of the middle split screen 605 is determined, and after the display terminal generates the target screen-throwing picture, the stretching proportion of the target screen-throwing picture is determined according to the height of the middle split screen 605.

For example, if there are two screen terminals (screen terminal a and screen terminal B) currently performing screen projection, the number of split screens of the display interface 601 of the display terminal is 3, and when the typesetting of the split screens is left, right upper, and right lower, as shown in fig. 6 (c), the upper right split screen 607 is the screen projection area of the screen projection terminal a, the lower right split screen 608 is the screen projection area of the screen projection terminal B, and the left split screen 609 is the application screen display area. For the screen-throwing terminal a, the target adaptation value refers to a height value of an upper right split screen 607 of the screen-throwing screen to be thrown on by the target screen-throwing terminal a, namely, the height of the upper right split screen 607 is determined, and after the target screen-throwing screen is generated by the display terminal, the stretching proportion of the target screen-throwing screen is determined according to the height of the upper right split screen 607. For the screen projection terminal B, the target adaptation value refers to a height value of a lower right split screen 608 of the screen to be projected by the target screen projection screen corresponding to the screen projection terminal B, that is, the height of the lower right split screen 608 is determined, and after the display terminal generates the target screen projection screen, the stretching ratio of the target screen projection screen is determined according to the height of the lower right split screen 608.

It should be noted that, in the embodiment of the present application, the number and the typesetting of the split screens of the display terminal are not limited, and in the process of practical application, the target adaptation value of the target screen-throwing picture corresponding to each screen-throwing terminal may be determined according to the specific number and typesetting of the split screens.

After determining the target adaptation value of the screen throwing area corresponding to the target screen throwing picture, the display terminal can calculate the stretching proportion of the target screen throwing picture according to the target adaptation value of the screen throwing area. Taking the scenario shown in fig. 6 (a) as an example, assuming that the target adaptation value of the screen-throwing area is the height H2 of the screen-throwing area 602 and the height of the target screen-throwing picture is H1, the stretching ratio of the calculated target screen-throwing picture is P, p=h2/H1.

And 540, the display terminal determines a screen throwing area according to the stretching proportion and the target screen throwing picture.

In the embodiment of the application, after the display terminal calculates the stretching ratio of the target screen-throwing picture, the screen-throwing area matched with the target screen-throwing picture is determined according to the stretching ratio of the target screen-throwing picture and the size of the target screen-throwing picture.

Taking the scenario shown in fig. 6 (a) as an example, assuming that the target adaptation value of the screen-throwing area is the height H2 of the screen-throwing area 602 and the height of the target screen-throwing picture is H1, the stretching ratio of the calculated target screen-throwing picture is P, p=h2/H1. And according to the width of the target screen projection picture being W1-2Bw, the calculated width of the screen projection area 602 corresponding to the target screen projection picture is P× (W1-2 Bw).

And 550, displaying the target screen projection picture in the screen projection area matched with the target screen projection picture by the display terminal.

According to the technical scheme, when the screen projection scene in the split screen mode is detected by the display terminal, screen projection data transmitted by the screen projection terminal are acquired, an effective display picture in a first screen projection picture is extracted to form a target screen projection picture, then the stretching proportion of the target screen projection picture is determined according to the target adaptation value, the screen projection area is determined according to the stretching proportion and the target screen projection picture, and finally the technical means of displaying the target screen projection picture through the screen projection area can be ensured, so that the size of the target screen projection picture is matched with the size of the screen projection area, and the viewing experience of a user on the display terminal is improved.

Example IV

Fig. 7 is a block diagram of a data processing apparatus according to a fourth embodiment of the present application, where the apparatus includes: a screen data acquisition module 710, a screen extraction module 720, a screen region determination module 730, and a screen display module 740.

The screen-throwing data acquisition module 710 is configured to acquire screen-throwing data transmitted by a screen-throwing terminal when a screen-throwing scene entering a screen splitting mode is detected, where the screen-throwing data includes at least one frame of screen to be thrown;

The picture extraction module 720 is configured to extract an effective display picture in a first to-be-projected picture to form a target to-be-projected picture, where the first to-be-projected picture is any frame in the at least one frame to-be-projected picture;

the screen-throwing area determining module 730 is configured to determine a screen-throwing area according to the target screen-throwing picture, where the target screen-throwing picture is matched with the screen-throwing area;

and a screen display module 740, configured to display the target screen through the screen-throwing area.

Based on the above embodiments, the screen data acquisition module 710 may include:

The application stack checking unit is used for checking whether the current application stack is associated with the screen throwing mode when the screen splitting mode is detected to be entered, and if yes, confirming the screen throwing scene in the screen splitting mode;

the display interface checking unit is used for checking whether the current display interface is associated with the split screen mode when the screen entering mode is detected, and if yes, confirming the screen entering scene in the split screen mode.

The picture extraction module 720 may include:

a first luminance reference line determining unit, configured to determine a first luminance reference line of the first screen to be projected according to the size of the first screen to be projected and pixel luminance information, where the first luminance reference line is used to indicate a boundary line of the effective display screen in the first screen to be projected;

the first brightness reference line processing unit is used for extracting the effective display picture from the first picture to be projected according to the first brightness reference line so as to obtain the target picture to be projected;

a first luminance reference line judging unit configured to judge whether the first luminance reference line is correct;

an effective display screen extracting unit, configured to extract, when the first luminance reference line is correct, the effective display screen from the first screen to be projected according to the first luminance reference line, so as to obtain the target screen to be projected;

A second luminance reference line obtaining unit, configured to obtain a second luminance reference line in a second screen to be projected, where the second luminance reference line is used to indicate a boundary line of an effective display screen in the second screen to be projected, where the second screen to be projected belongs to the at least one frame of screen to be projected, and the second screen to be projected is different from the first screen to be projected;

an average gradient threshold calculating unit, configured to calculate an average gradient threshold of the first luminance reference line and the second luminance reference line, where the average gradient threshold is determined according to a longitudinal pixel luminance sum corresponding to the first luminance reference line and a longitudinal pixel luminance sum corresponding to the second luminance reference line;

an average gradient threshold judging unit, configured to determine that the first luminance reference line is correct when the average gradient threshold meets a preset condition;

a preset longitudinal line determining unit, configured to determine a preset longitudinal line located in the effective display screen;

and the average pixel brightness value calculating unit is used for calculating the average pixel brightness value corresponding to each longitudinal line in a plurality of target longitudinal lines at one side of the preset longitudinal line by taking the preset longitudinal line as a starting point according to the size of the first screen to be projected and the pixel brightness information so as to determine the first brightness reference line, wherein the first brightness reference line is a longitudinal line, which is closest to the preset longitudinal line, and is smaller than a preset threshold value in the average pixel brightness values in the plurality of target longitudinal lines.

The screen region determining module 730 may include:

the stretching ratio determining unit is used for determining the stretching ratio of the target screen projection picture according to a target adaptation value, wherein the target adaptation value is the size of the fixed height of the screen projection area;

and the area determining unit is used for determining the screen throwing area according to the stretching proportion and the target screen throwing picture.

The data processing device provided by the embodiment of the application can execute the data processing method provided by any embodiment of the application, and has the corresponding functional modules and beneficial effects of the execution method.

Example five

Fig. 8 is a schematic structural diagram of a display terminal provided in a fifth embodiment of the present application, and as shown in fig. 8, the display terminal includes a processor 810, a memory 820, an input device 830 and an output device 840; the number of processors 810 in the display terminal may be one or more, and one processor 810 is taken as an example in fig. 8; the processor 810, memory 820, input device 830, and output device 840 in the display terminal may be connected by a bus or other means, for example in fig. 8. The memory 820 is a computer readable storage medium, and may be used to store software programs, computer executable programs, and modules, such as program instructions/modules corresponding to a data processing method in any embodiment of the present application (e.g., a screen data acquisition module 710, a screen extraction module 720, a screen region determination module 730, and a screen display module 740 in a data processing device). The processor 810 performs various functional applications of the display terminal and data processing, i.e., implements one of the data processing methods described above, by running software programs, instructions, and modules stored in the memory 820. That is, the program, when executed by the processor, implements:

Memory 820 may include primarily a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application program required for functionality; the storage data area may store data created according to the use of the terminal, etc. In addition, memory 820 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, memory 820 may further include memory remotely located relative to processor 810, which may be connected to the display terminal via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. The input device 830 may be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the display terminal, and may include a keyboard, a mouse, and the like. The output device 840 may include a display terminal such as a display screen.

Example six

The sixth embodiment of the present application further provides a computer readable storage medium having a computer program stored thereon, where the computer program is executed by a processor to implement the method described in any embodiment of the present application. Of course, a computer-readable storage medium provided in an embodiment of the present application may perform the relevant operations in a data processing method provided in any embodiment of the present application. That is, the program, when executed by the processor, implements:

From the above description of embodiments, it will be clear to a person skilled in the art that the present application may be implemented by means of software and necessary general purpose hardware, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a FLASH Memory (FLASH), a hard disk, or an optical disk of a computer, etc., including several instructions for causing a display terminal (which may be a personal computer, a server, or a network device, etc.) to perform the method described in the embodiments of the present application.

It should be noted that, in the embodiment of the data processing apparatus, each unit and module included are only divided according to the functional logic, but not limited to the above-mentioned division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present application.

Note that the above is only a preferred embodiment of the present application and the technical principle applied. Those skilled in the art will appreciate that the present application is not limited to the particular embodiments described herein, but is capable of numerous obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the present application. Therefore, while the present application has been described in connection with the above embodiments, the present application is not limited to the above embodiments, but may include many other equivalent embodiments without departing from the spirit of the present application, the scope of which is defined by the scope of the appended claims.

Claims

1. A method of data processing, comprising:

displaying the target screen projection picture through the screen projection area;

before forming the target projection screen, the method further comprises the following steps:

judging whether a first brightness reference line used for extracting the first screen to be projected is correct or not, wherein the first brightness reference line is used for indicating a boundary line of the effective display picture in the first screen to be projected and extracting the effective display picture from the first screen to be projected so as to obtain the target screen to be projected;

the judging whether the first brightness reference line for extracting the first screen to be projected is correct or not includes:

2. The method of claim 1, wherein the determining of the first luminance reference line comprises:

and determining a first brightness reference line of the first screen to be projected according to the size of the first screen to be projected and the pixel brightness information.

3. The method according to claim 2, characterized in that the method further comprises:

4. A method according to any one of claims 2-3, wherein determining the first luminance reference line of the first screen to be projected according to the size of the first screen to be projected and the pixel luminance information comprises:

Determining a preset vertical line in the effective display picture;

5. A method according to any one of claims 1-3, wherein said determining a screen-drop region from said target screen-drop comprises:

6. A method according to any one of claims 1-3, wherein detecting a screen scene entering a split-screen mode comprises:

If yes, confirming a screen throwing scene in a split screen mode; or,

if yes, confirming the screen scene entering the split screen mode.

7. A data processing apparatus, comprising:

the screen-throwing picture display module is used for displaying the target screen-throwing picture through the screen-throwing area;

a picture extraction module comprising:

a first luminance reference line judging unit configured to judge whether a first luminance reference line for extracting the first screen to be projected is correct or not before the target screen is projected; the first brightness reference line is used for indicating a boundary line of the effective display picture in the first screen to be projected, and extracting the effective display picture from the first screen to be projected according to the first brightness reference line so as to obtain the target screen to be projected;

and the average gradient threshold judging unit is used for determining that the first brightness datum line is correct when the average gradient threshold meets a preset condition.

8. A display terminal, characterized by comprising:

one or more processors;

a storage means for storing one or more programs;

the data processing method according to any one of claims 1-6, when said one or more programs are executed by said one or more processors, such that said one or more processors execute said programs.

9. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements a data processing method as claimed in any one of claims 1-6.