CN113010135A - Data processing method and device, display terminal and storage medium - Google Patents

Data processing method and device, display terminal and storage medium Download PDF

Info

Publication number
CN113010135A
CN113010135A CN202110475066.6A CN202110475066A CN113010135A CN 113010135 A CN113010135 A CN 113010135A CN 202110475066 A CN202110475066 A CN 202110475066A CN 113010135 A CN113010135 A CN 113010135A
Authority
CN
China
Prior art keywords
screen
screen projection
picture
projected
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110475066.6A
Other languages
Chinese (zh)
Other versions
CN113010135B (en
Inventor
崔楠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen TCL New Technology Co Ltd
Original Assignee
Shenzhen TCL New Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen TCL New Technology Co Ltd filed Critical Shenzhen TCL New Technology Co Ltd
Priority to CN202110475066.6A priority Critical patent/CN113010135B/en
Publication of CN113010135A publication Critical patent/CN113010135A/en
Application granted granted Critical
Publication of CN113010135B publication Critical patent/CN113010135B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application discloses a data processing method, a device, a display terminal and a storage medium, comprising the following steps: when a screen projection scene in a split screen mode is detected, screen projection data transmitted by a screen projection terminal are acquired, effective display pictures in first to-be-projected pictures are extracted to form target screen projection pictures, a screen projection area is determined according to the target screen projection pictures, and the target screen projection pictures are displayed through the screen projection area. According to the technical scheme, the occupancy rate of the screen projection picture to the display area of the display terminal can be effectively improved in the split screen mode of the display terminal, and the watching experience of a user to the display terminal is improved.

Description

Data processing method and device, display terminal and storage medium
Technical Field
The embodiment of the application relates to the technical field of screen projection, in particular to a data processing method and device, a display terminal and a storage medium.
Background
At present, for a large-screen television, a user can select to set a working mode to a split-screen mode, and the television screen is divided into two, so that the television screen can run two application programs simultaneously. The split screen mode can fully apply the television characteristic of a large screen on the premise of not influencing the watching experience of a user, and conveys more information elements for the user. In addition, the user can also select to set the television working mode to the screen projection mode, and by projecting the picture on the screen projection terminal (such as a mobile phone, a tablet computer and the like) to the television screen, the content displayed by the screen projection terminal can be watched on the television screen.
The split screen mode is to divide the television screen into two or more windows, and the windows operate independently without interference. In the split screen mode, the user may run different applications under each window, such as opening a video playing software to watch a video in one window and opening a chat software to send a message in another window. The screen projection mode is that a Peer-to-Peer (P2P) direct connection path is established between a screen projection terminal and a television terminal through a screen projection protocol, the screen projection terminal records a screen of an interface, encodes the screen and sends the screen to the television terminal for decoding and playing, and therefore the television terminal can synchronously display the content of the screen projection terminal in real time.
The existing television screen is divided into two parts, the screen projection display area is halved, and the television can acquire a screen to be projected picture transmitted by a screen projection terminal and directly display the screen to be projected picture in the screen projection area. Because the aspect ratio of the split screen projection display area is changed, the width of the screen to be projected can be preferentially adapted to the width of the projection screen display area, and the obtained effective picture can be very small after the picture is compressed according to the aspect ratio of the projection screen display area, so that the use experience of a user is influenced.
Disclosure of Invention
The embodiment of the application provides a data processing method and device, a display terminal and a storage medium, which can improve the occupancy rate of a screen projection picture to a display area of the display terminal effectively in a split-screen mode of the display terminal and improve the viewing experience of a user to the display terminal.
In a first aspect, an embodiment of the present application provides a data processing method, where the method includes:
when a screen projection scene in a split screen mode is detected, screen projection data transmitted by a screen projection terminal are obtained, wherein the screen projection data comprise at least one frame of screen to be projected;
extracting an effective display picture in a first picture to be projected to form a target screen projection picture, wherein the first picture to be projected is any one of the at least one picture to be projected;
determining a screen projection area according to the target screen projection picture, wherein the target screen projection picture is matched with the screen projection area;
and displaying the target screen projection picture through the screen projection area.
Optionally, the extracting of the effective display picture in the first to-be-projected picture to form a target projection picture includes;
determining a first brightness reference line of the first to-be-projected picture according to the size of the first to-be-projected picture and the pixel brightness information, wherein the first brightness reference line is used for indicating a boundary line of the effective display picture in the first to-be-projected picture;
and extracting the effective display picture from the first to-be-projected picture according to the first brightness reference line so as to obtain the target screen projection picture.
Optionally, before the extracting the effective display frame from the first to-be-projected frame according to the first brightness reference line to obtain the target screen projection frame, the method further includes:
judging whether the first brightness reference line is correct or not;
correspondingly, the extracting the effective display picture from the first to-be-projected picture according to the first brightness reference line to obtain the target screen projection picture includes:
and when the first brightness reference line is correct, extracting the effective display picture from the first to-be-projected picture according to the first brightness reference line so as to obtain the target screen projection picture.
Optionally, the determining whether the first luminance reference line is correct includes:
acquiring a second brightness reference line in a second to-be-projected picture, wherein the second brightness reference line is used for indicating a boundary line of an effective display picture in the second to-be-projected picture, the second to-be-projected picture belongs to the at least one to-be-projected picture, and the second to-be-projected picture is different from the first to-be-projected picture;
calculating an average gradient threshold value of the first brightness reference line and the second brightness reference line, wherein the average gradient threshold value is determined according to a longitudinal pixel brightness sum corresponding to the first brightness reference line and a longitudinal pixel brightness sum corresponding to the second brightness reference line;
and when the average gradient threshold value meets a preset condition, determining that the first brightness datum line is correct.
Optionally, the determining a first brightness reference line of the first to-be-projected picture according to the size of the first to-be-projected picture and the pixel brightness information includes:
determining a preset longitudinal line in the effective display picture;
and calculating an average pixel brightness value corresponding to each longitudinal line of a plurality of target longitudinal lines on one side of the preset longitudinal line according to the size of the first to-be-projected screen picture and the pixel brightness information by taking the preset longitudinal line as a starting point to determine the first brightness reference line, wherein the first brightness reference line is the longitudinal line which is closest to the preset longitudinal line and has the average pixel brightness value smaller than a preset threshold value in the plurality of target longitudinal lines.
Optionally, the determining a screen projection area according to the target screen projection picture includes:
determining the stretching proportion of the target screen projection picture according to a target adaptation value, wherein the target adaptation value is the size of the fixed height of the screen projection area;
and determining the screen projection area according to the stretching ratio and the target screen projection picture.
Optionally, the detecting of the screen projection scene entering the split-screen mode includes:
when the screen splitting mode is detected to enter, checking whether the current application stack is associated with the screen projecting mode;
if so, confirming a screen projection scene under a split screen mode; alternatively, the first and second electrodes may be,
when the screen projection mode is detected to be entered, checking whether a current display interface is associated with the split screen mode;
and if so, confirming the screen projection scene under the split screen mode.
In a second aspect, an embodiment of the present application further provides a data processing apparatus, where the apparatus includes:
the screen projection data acquisition module is used for acquiring screen projection data transmitted by a screen projection terminal when detecting that a screen projection scene in a split screen mode is entered, wherein the screen projection data comprises at least one frame of screen to be projected;
the screen extraction module is used for extracting an effective display screen in a first screen to be projected to form a target screen to be projected, wherein the first screen to be projected is any one frame of the at least one frame of screen to be projected;
the screen projection area determining module is used for determining a screen projection area according to the target screen projection picture, and the target screen projection picture is matched with the screen projection area;
and the screen projection picture display module is used for displaying the target screen projection picture through the screen projection area.
In a third aspect, an embodiment of the present application further provides a display terminal, where the display terminal includes:
one or more processors;
storage means for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors are caused to execute the data processing method provided by any embodiment of the present application.
In a fourth aspect, the present application further provides a computer-readable storage medium, where a computer program is stored on the storage medium, and when the computer program is executed by a processor, the computer program implements the data processing method provided in any embodiment of the present application.
According to the technical scheme, when the display terminal detects that a screen projection scene in a split screen mode is entered, screen projection data transmitted by the screen projection terminal are obtained, effective display pictures in first screen pictures to be projected are extracted to form target screen projection pictures, a screen projection area is determined according to the target screen projection pictures, and the screen projection pictures are displayed in the screen projection area.
Drawings
Fig. 1 is a system architecture diagram of a projection system according to an embodiment of the present application;
fig. 2 is a schematic diagram of an embodiment of a data transmission method provided in an embodiment of the present application;
fig. 3(a) is a schematic diagram of a screen to be projected sent by a screen projection terminal;
fig. 3(b) is a schematic diagram illustrating a screen to be projected when the display terminal is in a split-screen mode in the prior art;
fig. 4 is a schematic diagram of another embodiment of a data transmission method provided in an embodiment of the present application;
fig. 5 is a schematic diagram of another embodiment of a data transmission method provided in an embodiment of the present application;
fig. 6(a) is a schematic diagram of a display area of a display terminal according to an embodiment of the present application;
fig. 6(b) is another schematic diagram of a display area of a display terminal according to an embodiment of the present application;
fig. 6(c) is another schematic diagram of a display area of a display terminal according to an embodiment of the present application;
fig. 7 is a block diagram of a data processing apparatus according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a display terminal according to an embodiment of the present application.
Detailed Description
The application provides a data processing method, a data processing device and a storage medium, which can improve the occupancy rate of effective screen projection pictures to a display area of a display terminal in a split-screen mode of the display terminal and improve the watching experience of a user to the display terminal.
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," and the like in the description and in the claims of the present application and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Fig. 1 is a system architecture diagram of a projection system 10 according to an exemplary embodiment of the present application. The screen projection system 10 includes a display terminal 101 and one or more screen projection terminals 102. It should be noted that fig. 1 only illustrates one screen projection terminal 102, and in practical applications, a plurality of screen projection terminals 102 may also be included, and the example of fig. 1 should not be construed as limiting the present application.
In this embodiment, the display terminal 101 may be a device at least having a function of playing/displaying streaming media data. Alternatively, the display terminal 101 may be an electronic device with a display function, such as a television, a conference display screen, a tablet computer, or a desktop computer. In the embodiment of the present application, the screen projection terminal 102 may be a device at least having a screen projection data transmission capability. Alternatively, the screen projection terminal 102 may be a User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), or the like. Currently, some examples of the screen projection terminal 102 are: electronic devices such as mobile phones, tablet computers, notebook computers, Personal Digital Assistants (PDAs), and desktop computers.
In the embodiment of the application, the screen projection terminal 102 can send screen projection data such as display contents (including desktop, video, audio and other data) of the screen projection terminal 102 to the display terminal 101 through a wireless screen projection technology, so that the display terminal 101 can display related contents according to the screen projection data. The Wireless screen projection technology may be Miracast, DLNA, AirPlay, WIDI, WHDI, Wireless HD, and some custom protocols, such as short-distance communication technologies based on bluetooth, Wi-Fi, or ultra wideband uwb (ultra wideband), and the like, which is not limited in the embodiment of the present application.
Example one
Based on the system architecture in fig. 1, fig. 2 is a schematic diagram of an embodiment of a data transmission method provided in the present application.
Referring to fig. 2, an embodiment of a data transmission method provided in the embodiment of the present application may include the following steps 210 to 240. The method comprises the following specific steps:
step 210, when detecting that a screen projection scene in the split screen mode is entered, the display terminal acquires screen projection data transmitted by the screen projection terminal, wherein the screen projection data includes at least one frame of screen to be projected.
The embodiment of the application is applied to the screen projection scene when the display terminal enters the split screen mode. In the scene, if a user needs to perform screen projection display on a display terminal through a screen projection terminal, the display terminal receives screen projection data sent by the screen projection terminal, and the screen projection data can include at least one frame of screen to be projected.
In the embodiment of the application, when a user needs to throw a screen in a split screen mode of a display terminal, or needs to adopt the split screen mode when throwing the screen, the display terminal can judge whether to enter a screen throwing scene in the split screen mode by detecting whether the split screen mode and the screen throwing mode are both triggered, the user can send a screen throwing request to the display terminal by triggering the screen throwing function of the screen throwing terminal, the display terminal identifies the screen throwing terminal corresponding to the screen throwing request according to the screen throwing request, then a P2P direct connection path between the screen throwing terminals is established, and screen throwing data sent by the screen throwing terminal is obtained in the screen throwing scene in the split screen mode through the P2P direct connection path.
Optionally, in a specific embodiment, the display terminal may establish a P2P direct path between the display terminal and the screen projection terminal according to the identification information of the screen projection terminal included in the screen projection request.
And step 220, the display terminal extracts an effective display picture in the first to-be-projected picture to form a target screen projection picture.
In the embodiment of the application, after the display terminal acquires the screen projection data transmitted by the screen projection terminal, the display terminal extracts an effective display picture in a first screen to be projected so as to generate a target screen projection picture corresponding to the first screen to be projected.
The first to-be-projected picture in the embodiment of the present application refers to any one of one or more frames of to-be-projected pictures included in the projection data. In the embodiment of the application, the first screen to be projected includes an effective display screen and an ineffective screen. In the embodiment of the present application, the valid display frame in the first screen to be projected specifically refers to a frame content having information that may be interested by the user, and the invalid frame specifically refers to a frame content in which the user cannot obtain meaningful information. For example, when the screen projection terminal is a mobile phone and the display terminal is a television, and a user wants to vertically project contents such as a mobile phone desktop, a photo or a video of the mobile phone onto the television for display, the mobile phone sends screen projection data to the television, and a to-be-projected screen of each frame may include some invalid contents, such as peripheral filling contents, for adapting to a display interface of the television, in addition to the contents of the mobile phone desktop, the photo or the video. The mobile phone desktop picture is usually located in the middle of the screen projection picture, black edges are filled at two sides of the screen projection picture, and the black edges are black edges generated by the screen projection terminal when screen projection data are generated by the screen projection terminal. The embodiment of the application shows a schematic diagram of a to-be-projected screen sent by a projection terminal, as shown in fig. 3 (a). In fig. 3(a), the cell phone desktop screen 302 in the screen to be projected 301 is the screen content that the user wants to see, i.e. is a valid display screen, and the black border filling on both sides is an invalid screen because it is impossible for the user to obtain any meaningful screen content. The embodiment of the present application further illustrates a schematic diagram of a display terminal in the prior art displaying a screen projection picture to be displayed in fig. 3(a) in a split screen mode, as shown in fig. 3 (b). The display area 303 of the display terminal is split, the left split screen is an application picture display area 304, the right split screen is a screen projection area 305, and the screen projection area 305 displays a picture 306 to be projected (i.e. 301 in fig. 3 (a)), wherein the width of the picture 306 to be projected is adapted to the width of the screen projection area 305. However, after the screen to be projected 306 is adapted to the width of the projection area 305, the effective display screen 307 (i.e. 302 in fig. 3 (a)) in the screen to be projected 306 is very small.
It should be noted that, the screens to be projected shown in fig. 3(a) and 3(b) are only one example of the forms of the effective display screen and the ineffective screen in the screens to be projected in the embodiment of the present application. In the practical application process, the invalid picture may also be another form of picture content that is not able to obtain any meaning for the user, and there may also be other situations in the relative position of the valid display picture and the invalid picture, and taking the invalid content as a black border as an example, the black border exists on at least one of the upper side or the lower side of the valid display picture, or the black border exists around the valid display picture, and the like, which are not limited in the embodiments of the present application.
It should be noted that, in the embodiment of the present application, a manner of extracting an effective display screen from a screen to be projected by a display terminal is not specifically limited. The embodiment of the application does not specifically limit the number and the processing sequence of the to-be-projected pictures processed by the display terminal at the same time.
Optionally, in this embodiment of the application, after the display terminal acquires the screen projection data transmitted by the screen projection terminal, each frame of the to-be-projected screen image is sequentially acquired, the effective display image of each frame of the to-be-projected screen image is sequentially extracted, and the extracted effective display image is used as the target screen projection image.
Optionally, in this embodiment of the application, after the display terminal acquires the screen projection data transmitted by the screen projection terminal, it may also be configured to process multiple frames of the to-be-projected screen images at the same time, for example, process two frames of the to-be-projected screen images at the same time, and extract an effective display image of each frame of the to-be-projected screen image.
And step 230, the display terminal determines a screen projection area according to a target screen projection picture, and the target screen projection picture is matched with the screen projection area.
In the embodiment of the application, in a screen projection scene in a split screen mode, a display area of a display terminal is divided into a plurality of split screens, one of the split screens can display a desktop or a corresponding application of the display terminal, and the other one or more split screens are used for displaying target screen projection pictures respectively corresponding to one or more screen projection terminals.
In the embodiment of the application, after the display terminal obtains the target screen projection picture, the size and the screen projection position of the screen projection area matched with the target screen projection picture are determined according to the target screen projection picture, and the screen projection display is used for screen projection display of the target screen projection picture.
Optionally, in this embodiment of the application, if only one screen projection terminal projects a screen at present, the display terminal may divide the display area into two split screens, where the first split screen displays a desktop or a corresponding application of the display terminal, and the second split screen displays a target screen projection picture. The specific position and size of the second split screen are determined according to the target screen projection picture after the display terminal acquires the target screen projection picture, namely, the screen projection area matched with the target screen projection picture. And the second split screen only displays the content of the target screen projection picture. And after the display terminal determines the screen projection area matched with the target screen projection picture, namely the size and the specific position of the second split screen, the size and the position of the first split screen are correspondingly determined.
Optionally, if two screen projection terminals (screen projection terminal a and screen projection terminal B) perform screen projection at present, the display terminal may divide the display area into three split screens, where the first split screen displays the desktop or corresponding application picture of the display terminal itself, the second split screen displays the target screen projection picture of screen projection terminal a, and the third split screen displays the target screen projection picture of screen projection terminal B. The specific positions and sizes of the second split screen and the third split screen are determined according to the target screen projection picture corresponding to the screen projection terminal A and the target screen projection picture corresponding to the screen projection terminal B after the display terminal respectively acquires the target screen projection picture corresponding to the screen projection terminal A and the target screen projection picture corresponding to the screen projection terminal B, only the content of the target screen projection picture of the screen projection terminal A is displayed in the second split screen, and only the content of the target screen projection picture of the screen projection terminal B is displayed in the third split screen. Optionally, in an actual application process, the determination of the second split screen and the third split screen by the display terminal needs to be determined according to information such as a specific composition of the split screens (for example, a relative position of each split screen) in addition to the determination of the target screen projection screen of the screen projection terminal a and the target screen projection screen of the screen projection terminal B, and is not specifically limited herein.
In the embodiment of the application, under the condition that information such as the number of split screens and the type setting is determined, the display terminal can specifically stretch the target screen projection picture according to the size of the target screen projection picture and a preset proportion, and the size of the stretched target screen projection picture is used as the target size of the screen projection area. After the target size of the screen projection area is calculated by the display terminal, an area matched with the target size can be divided in the display area of the display terminal to be used as the screen projection area.
The advantages of such an arrangement are: the aspect ratio of the target screen projection picture is equal to that of the screen projection area, and therefore the watching experience of a user on the display terminal is improved.
And 240, displaying the target screen projection picture in the screen projection area matched with the target screen projection picture by the display terminal.
In this embodiment, after the display terminal determines the screen projection area corresponding to the target screen projection picture, the target screen projection picture is displayed in the screen projection area.
In a specific embodiment, assuming that the user only triggers the screen projecting mode to the display terminal, the display terminal may directly take the first screen to be projected as a target screen projecting picture and display the target screen projecting picture in the display area of the display terminal, and after that, if the user also triggers the split screen mode to the display terminal, the display terminal may extract an effective display picture in the first screen to be projected according to the above method to form the target screen projecting picture, display the target screen projecting picture in the screen projecting area, and display the application picture in the application picture display area, thereby implementing that the display terminal simultaneously projects the picture on the screen projecting terminal to the display area in the split screen mode.
In another specific embodiment, if the user only triggers the split screen mode for the display terminal, the display terminal may display a plurality of different application pictures selected by the user in a display area of the display terminal, and then, if the user also triggers the screen projection mode for the display terminal, the display terminal may extract an effective display picture in the first screen to be projected according to the above method to form a target screen projection picture, display the target screen projection picture in the screen projection area, and display the plurality of application pictures in the application picture display area, thereby implementing that the display terminal simultaneously projects pictures on the screen projection terminal to the display area in the split screen mode.
According to the technical scheme, when the display terminal detects that a screen projection scene in a split screen mode is entered, screen projection data transmitted by the screen projection terminal are obtained, effective display pictures in first screen projection pictures to be projected are extracted to form target screen projection pictures, a screen projection area is determined according to the target screen projection pictures, and the target screen projection pictures are displayed in the screen projection area matched with the target screen projection pictures.
In a specific embodiment, it is assumed that the display terminal is a television, the screen projection terminal is a mobile phone, and the current application scene is a live broadcast scene of the mobile phone, by the above method, a live broadcast picture of the mobile phone of a user can be displayed in a screen projection area of the television, and the user can use a picture of a television application (e.g., music playing software, text prompter) to assist in live broadcast while using the television to perform live broadcast.
Example two
This embodiment is a further refinement of the first embodiment, and the same or corresponding terms as those in the first embodiment are explained, and this embodiment is not repeated. Fig. 4 is a schematic diagram of an embodiment of a data transmission method provided in an embodiment of the present application, and a technical solution of the present embodiment may be combined with one or more methods in the solutions of the foregoing embodiments, and in the present embodiment, as shown in fig. 4, the method provided in the embodiment of the present application may include:
step 410, when detecting that a screen projection scene in the split screen mode is entered, the display terminal acquires screen projection data transmitted by the screen projection terminal, wherein the screen projection data includes at least one frame of screen to be projected.
The embodiment of the present application can also be understood with reference to relevant contents in step 210 of fig. 2, which are not described herein again.
Optionally, in this embodiment of the present application, a specific manner in which the display terminal detects that the screen-projection scene in the split-screen mode is entered may be: when the screen splitting mode is detected to enter, checking whether the current application stack is associated with the screen projecting mode; if so, confirming a screen projection scene under a split screen mode; or when the screen projection mode is detected to be entered, checking whether the current display interface is associated with the split screen mode; and if so, confirming the screen projection scene under the split screen mode.
When the display terminal detects that a user triggers the split screen mode, whether a current application stack (top package) corresponding to the display terminal is a screen projection package can be checked, and if yes, the display terminal is confirmed to enter a screen projection scene in the split screen mode. When it is detected that the user triggers the screen projection mode, whether the activity started by the display terminal belongs to the split screen package can be checked, and if yes, it is determined that the display terminal enters a screen projection scene in the split screen mode.
And step 420, the display terminal determines a first brightness reference line of the first screen to be projected according to the size of the first screen to be projected and the pixel brightness information.
In this embodiment, the first brightness reference line refers to a boundary line of the effective display frame and the ineffective frame in the first to-be-projected frame. Taking the first screen to be projected in fig. 3(a) as an example, the first luminance reference line is two boundary lines of the effective display frame and the left black edge or the right black edge in the first screen to be projected. The display terminal determines the first brightness reference line, and aims to cut the first screen to be projected according to the first brightness reference line, so that an effective display picture is extracted from the first screen to be projected.
In the embodiment of the application, the display terminal determines a first brightness reference line of the first screen to be projected according to the size of the first screen to be projected and the pixel brightness information. Taking the screen to be projected shown in fig. 3(a) as an example, a specific implementation manner of determining the first brightness reference line by the display terminal according to the embodiment of the present application may include the following contents of step (1) and step (2).
And (1) the display terminal firstly determines a preset longitudinal line in the effective display picture according to the size of the first screen picture to be projected.
In this embodiment of the application, the display terminal may use a boundary point of a lower left corner of the first screen to be projected (i.e., the first screen to be projected is rectangular, and an intersection point of the left side and the lower side) as an origin, and establish a rectangular coordinate system according to the origin. And in the rectangular coordinate system, selecting a longitudinal straight line with a horizontal coordinate as a preset value as a preset longitudinal line. Taking the effective display frame in the first to-be-projected frame at the middle position of the first to-be-projected frame as an example, the preset value may be set to be half of the width of the upper side (or the lower side) of the to-be-projected frame, that is, assuming that the width of the to-be-projected frame is W1, the preset value may be 0.5W 1. The height of the preset longitudinal line is equal to that of the first screen to be projected. Optionally, the preset value may also be set to other values, and it is only necessary to ensure that the preset vertical line is located inside the effective display screen.
And (2) calculating an average pixel brightness value corresponding to each longitudinal line in a plurality of target longitudinal lines on one side of the preset longitudinal line by the display terminal by taking the preset longitudinal line as a starting point according to the pixel brightness information of the first to-be-projected screen picture to determine a first brightness reference line, wherein the first brightness reference line is the longitudinal line which is closest to the preset longitudinal line and has an average pixel brightness value smaller than a preset threshold value in the plurality of target longitudinal lines.
In the embodiment of the application, after the preset longitudinal line is determined, the display terminal calculates, according to the pixel brightness information of the first screen to be projected, an average pixel brightness value corresponding to each longitudinal line of a plurality of target longitudinal lines on one side of the preset longitudinal line. Specifically, in this embodiment of the application, after determining the preset longitudinal line, the display terminal sequentially calculates an average pixel brightness value of each longitudinal line on the left side or the right side, using the preset longitudinal line as a starting point. Specifically, taking the left side as an example, the display terminal may use a preset longitudinal line as a starting point, move the unit distance value to the left, thereby determining a first longitudinal line on the left side of the preset longitudinal line, calculate an average pixel brightness value of the first longitudinal line, and determine whether an average pixel brightness value corresponding to the first longitudinal line is greater than or equal to a preset threshold; if so, moving the unit distance value to the left by taking the first longitudinal line as a starting point, so as to determine a second longitudinal line on the left side of the preset longitudinal line, calculating the average pixel brightness value of the second longitudinal line, judging whether the average pixel brightness value corresponding to the second longitudinal line is greater than or equal to a preset threshold value …, and so on, and determining the X-th longitudinal line as a first brightness datum line when the average pixel brightness value of the X-th longitudinal line is less than the preset threshold value.
In the embodiment of the present application, for any one of the vertical lines, the specific way for the display terminal to calculate the average pixel brightness value of the vertical line may be as follows: the display terminal firstly obtains the number N of pixel points on the longitudinal line and the brightness and S of each pixel point on the longitudinal line. The display terminal can calculate the Y component of each pixel point on the longitudinal line based on a color coding method YUV coding format, and then add the Y components of each pixel point, so that the brightness and S of each pixel point on the longitudinal line are obtained. Wherein the Y component is brightness (brightness). After the above process, the display terminal may calculate an average pixel brightness value P corresponding to a preset vertical line according to the number N of pixels on the vertical line and the brightness sum S, where P is S/N.
And 430, the display terminal extracts an effective display picture from the first to-be-projected picture according to the first brightness reference line to obtain a target screen projection picture.
In the embodiment of the application, after the first brightness reference line is determined, the display terminal determines a cutting area according to the position coordinate of the first brightness reference line and the size of the first screen to be projected, cuts the first screen to be projected according to the cutting area, so as to obtain an effective display picture, and generates a target screen projection picture according to the effective display picture.
Taking the form of the effective display frame shown in fig. 3(a) as an example, when the effective display frame is located on the first to-be-projected frameThe height of the cutting area is equal to the height of the first screen to be projected when the height of the cutting area is consistent with the height of the screen to be projected and only the left side and the right side of the cutting area have black edges. After the display terminal determines a first brightness reference line in a first screen to be projected, according to the abscissa Bw of the first brightness reference line, the width of an effective display picture can be determined to be W12Bw, when Bw is less than the abscissa of the preset longitudinal line, the abscissa interval corresponding to the cutting area is [ Bw, W1-Bw]When Bw is larger than the abscissa of the preset longitudinal line, the abscissa interval of the cutting area is [ W ]1-Bw，Bw]。
In practical application, when the brightness of an actual effective display picture in a first screen projection picture is low, the first brightness reference line determined in the above manner may be located in the effective display picture, and if the screen projection picture is cut according to the first brightness reference line, a situation that a target screen projection picture obtained by cutting is inconsistent with the actual effective display picture is likely to occur.
In order to solve the above problem, before the display terminal extracts the valid display frame from the first to-be-projected-screen frame according to the first brightness reference line, the display terminal may further verify the position of the first brightness reference line to prevent the first brightness reference line determined based on the above from not being the boundary line between the valid display frame and the invalid frame. Specifically, the embodiment that the display terminal verifies the position of the first brightness reference line may include the following steps (1) - (3).
(1) And the display terminal acquires a second brightness reference line in a second screen to be projected.
In the embodiment of the application, the second to-be-projected picture is another to-be-projected picture different from the first to-be-projected picture in the multiple frames of to-be-projected pictures included in the projection data. In this embodiment of the application, the second to-be-projected-screen picture may be a to-be-projected-screen picture separated from the first to-be-projected-screen picture by a preset value, for example, when the preset value is 0, the second to-be-projected-screen picture may be two frames of to-be-projected-screen pictures adjacent to the first to-be-projected-screen picture, and when the preset value is 1, a frame of to-be-projected-screen picture is separated between the first to-be-projected-screen picture and the second to-be-projected-screen picture.
In the embodiment of the application, the second brightness reference line in the second screen to be projected is used for indicating the boundary line of the effective display picture and the invalid picture in the second screen to be projected. After the display terminal acquires the second to-be-projected picture, the method for acquiring the second brightness reference line in the second to-be-projected picture can be understood by referring to the manner in which the display terminal determines the first brightness reference line in step 420, which is not described herein again.
(2) And calculating the average gradient threshold of the first brightness reference line and the second brightness reference line.
In this embodiment of the application, the average gradient threshold is determined according to the vertical pixel luminance sum corresponding to the first luminance reference line and the vertical pixel luminance sum corresponding to the second luminance reference line.
For example, when the number of the pixels on the first luminance reference line and the second luminance reference line is N, the sum of the vertical pixel luminance corresponding to the first luminance reference line is L1, and the sum of the vertical pixel luminance corresponding to the second luminance reference line is L2, the average gradient threshold of the first luminance reference line and the second luminance reference line is D, and D is (L1+ L2)/2N.
(3) And when the average gradient threshold value meets the preset condition, the display terminal determines that the first brightness datum line is correct.
In the embodiment of the application, the display terminal determines whether the first brightness reference line and the second brightness reference line meet a preset condition, where the preset condition is whether the average gradient threshold is less than or equal to a preset threshold. When the average gradient threshold is smaller than or equal to the preset threshold, the average gradient threshold can be considered to meet the preset condition, and at this time, the display terminal determines that the first brightness reference line is correct. If the average gradient threshold is greater than the preset threshold, the first brightness reference line is wrong, that is, the first brightness line is not a true boundary line of the effective display picture and the invalid content, at this time, the display terminal re-determines the first brightness reference line and the second brightness reference line respectively in the first picture to be projected and the second picture to be projected again until the average gradient threshold of the first brightness reference line and the second brightness reference line is less than or equal to the preset threshold.
And 440, the display terminal determines a screen projection area according to a target screen projection picture, and the target screen projection picture is matched with the screen projection area.
The embodiment of the present application can be understood with reference to step 230 in fig. 2, which is not described herein again.
And step 450, the display terminal displays the target screen projection picture in the screen projection area matched with the target screen projection picture.
The embodiment of the present application can be understood with reference to step 240 in fig. 2, which is not described herein again.
According to the technical scheme, when the display terminal detects that a screen projection scene in a split screen mode is entered, screen projection data transmitted by the screen projection terminal are obtained, a first brightness reference line is determined according to the size of a first screen to be projected and pixel brightness information, an effective display picture is extracted from the first screen to be projected according to the first brightness reference line to obtain a target screen projection picture, a screen projection area is determined according to the target screen projection picture, the effective display picture can be accurately extracted from the first screen to be projected through the technical means that the target screen projection picture is displayed in the screen projection area, picture contents possibly interested by a user can be displayed in the display area of the display terminal to the greatest extent, and the viewing experience of the user on the display terminal is improved.
EXAMPLE III
This embodiment is a further refinement of the above embodiment, and the same or corresponding terms as those of the above embodiment are explained, and this embodiment is not described again. Fig. 5 is a schematic diagram of another embodiment of a data transmission method provided in an embodiment of the present application, where a technical solution of this embodiment may be combined with one or more methods in the solutions of the foregoing embodiments, and in this embodiment, as shown in fig. 5, the method provided in the embodiment of the present application may further include:
step 510, when the display terminal detects that a screen projection scene in the split screen mode is entered, screen projection data transmitted by the screen projection terminal is acquired, wherein the screen projection data comprises at least one frame of screen to be projected.
The embodiment of the present application can be understood with reference to step 210 of fig. 2, which is not described herein again.
And step 520, the display terminal extracts an effective display picture in a first picture to be projected to form a target screen projection picture, wherein the first picture to be projected is any one of the at least one picture to be projected.
The embodiment of the present application can be understood with reference to step 220 of fig. 2, which is not described herein again.
And step 530, the display terminal determines the stretching ratio of the target screen projection picture according to the target adaptation value, wherein the target adaptation value is the size of the fixed height of the screen projection area.
In the embodiment of the application, the target adaptation value is related to the number of split screens and the type of the display terminal, the target adaptation value refers to an adaptation size of a split screen area corresponding to a target screen projection picture, and the adaptation size may be one of a height size or a width size of the split screen area. And after the display terminal generates the target screen projection picture, determining the stretching proportion of the target screen projection picture according to the target adaptation value.
Optionally, in a specific embodiment, if the number of the current screen projection terminals corresponding to the display terminal is one, that is, at the current time, when the display terminal only needs to display a target screen projection screen corresponding to one screen projection terminal, the fixed height of the screen projection area preset by the display terminal is equal to the height of the display area of the display terminal. For example, if only one screen projection terminal projects a screen currently, the number of split screens of the display interface 601 of the display terminal is 2, and when the layout of the split screens is left split screen and right split screen, as shown in fig. 6(a), the left split screen 603 is an application screen display area, and the right split screen 602 is a screen projection area. The target adaptation value is a height value of the right split screen 602 to be projected by the target screen projection picture, that is, the height of the right split screen 602 is determined, and after the target screen projection picture is generated by the display terminal, the stretching ratio of the target screen projection picture is determined according to the height of the right split screen 602.
Optionally, in a specific embodiment, if the number of the current screen projection terminals corresponding to the display terminal is multiple, that is, when the display terminal needs to simultaneously display target screen projection images corresponding to multiple screen projection terminals at the current time, the target adaptation value of the screen projection area corresponding to each target screen projection image needs to be determined according to the number of the split screens and the type of the display terminal.
For example, if two screen projection terminals (screen projection terminal a and screen projection terminal B) perform screen projection currently, the number of split screens of the display interface 601 of the display terminal is 3, and when the layout of the split screens is left, middle and right, as shown in fig. 6(B), the right split screen 604 is the screen projection area of the screen projection terminal a, the middle split screen 605 is the screen projection area of the screen projection terminal B, and the left split screen 606 is the application screen display area. For the screen projection terminal a, the target adaptation value refers to a height value of a right split screen 604 to be projected by a target screen projection picture corresponding to the screen projection terminal a, that is, the height of the right split screen 604 is determined, and after the target screen projection picture is generated by the display terminal, the stretching ratio of the target screen projection picture is determined according to the height of the right split screen 604. For the screen projection terminal B, the target adaptation value refers to a height value of the mid-split screen 605 to be projected by the target screen projection picture corresponding to the screen projection terminal B, that is, the height of the mid-split screen 605 is determined, and after the target screen projection picture is generated by the display terminal, the stretching ratio of the target screen projection picture is determined according to the height of the mid-split screen 605.
For example, if two screen projection terminals (screen projection terminal a and screen projection terminal B) perform screen projection currently, the number of split screens of the display interface 601 of the display terminal is 3, and when the layout of the split screens is a left, right, top, and right-bottom layout, as shown in fig. 6(c), the top right split screen 607 is the screen projection area of the screen projection terminal a, the bottom right split screen 608 is the screen projection area of the screen projection terminal B, and the left split screen 609 is the application screen display area. For the screen projection terminal a, the target adaptation value refers to a height value of an upper right split screen 607 to be projected by a target screen projection picture corresponding to the screen projection terminal a, that is, the height of the upper right split screen 607 is determined, and after the target screen projection picture is generated by the display terminal, the stretching ratio of the target screen projection picture is determined according to the height of the upper right split screen 607. For the screen projection terminal B, the target adaptation value refers to a height value of a right lower split screen 608 to be projected by a target screen projection picture corresponding to the screen projection terminal B, that is, the height of the right lower split screen 608 is determined, and after the target screen projection picture is generated by the display terminal, the stretching ratio of the target screen projection picture is determined according to the height of the right lower split screen 608.
It should be noted that, in the embodiment of the present application, the number and the type of the split screens of the display terminals are not limited, and in the process of practical application, the target adaptation value of the target screen projection picture corresponding to each screen projection terminal may be determined according to the specific number and type of the split screens.
After determining the target adaptation value of the screen projection area corresponding to the target screen projection picture, the display terminal can calculate the stretching proportion of the target screen projection picture according to the target adaptation value of the screen projection area. Taking the scene shown in fig. 6(a) as an example, assuming that the target adaptation value of the projection area is the height H2 of the projection area 602 and the height of the target projection screen is H1, the calculated stretch ratio of the target projection screen is P, which is H2/H1.
And 540, the display terminal determines a screen projection area according to the stretching ratio and the target screen projection picture.
In the embodiment of the application, after the display terminal calculates the stretching ratio of the target screen projection picture, the screen projection area matched with the target screen projection picture is determined according to the stretching ratio of the target screen projection picture and the size of the target screen projection picture.
Taking the scene shown in fig. 6(a) as an example, assuming that the target adaptation value of the projection area is the height H2 of the projection area 602 and the height of the target projection screen is H1, the calculated stretch ratio of the target projection screen is P, which is H2/H1. Then, according to the width W1-2Bw of the target screen projection picture, the calculated width of the screen projection area 602 corresponding to the target screen projection picture is P x (W1-2 Bw).
And 550, displaying the target screen projection picture in the screen projection area matched with the target screen projection picture by the display terminal.
The embodiment of the present application can be understood with reference to step 240 in fig. 2, which is not described herein again.
According to the technical scheme, when the display terminal detects that a screen projection scene in a split screen mode is entered, screen projection data transmitted by the screen projection terminal are acquired, effective display pictures in first to-be-projected pictures are extracted to form target screen projection pictures, the stretching proportion of the target screen projection pictures is determined according to the target adaptation value, a screen projection area is determined according to the stretching proportion and the target screen projection pictures, and finally the target screen projection pictures are displayed through the screen projection area.
Example four
Fig. 7 is a structural diagram of a data processing apparatus according to a fourth embodiment of the present application, where the apparatus includes: a screen projection data acquisition module 710, a screen extraction module 720, a screen projection area determination module 730 and a screen projection display module 740.
The screen projection data acquisition module 710 is configured to acquire screen projection data transmitted by a screen projection terminal when a screen projection scene entering a split screen mode is detected, where the screen projection data includes at least one frame of picture to be projected;
the picture extraction module 720 is configured to extract an effective display picture in a first to-be-projected picture to form a target to-be-projected picture, where the first to-be-projected picture is any one of the at least one to-be-projected picture;
a screen projection area determining module 730, configured to determine a screen projection area according to the target screen projection picture, where the target screen projection picture matches the screen projection area;
and a screen projection picture display module 740, configured to display the target screen projection picture through the screen projection area.
According to the technical scheme, when the display terminal detects that a screen projection scene in a split screen mode is entered, screen projection data transmitted by the screen projection terminal are obtained, effective display pictures in first screen pictures to be projected are extracted to form target screen projection pictures, a screen projection area is determined according to the target screen projection pictures, and the screen projection pictures are displayed in the screen projection area.
On the basis of the foregoing embodiments, the screen projection data obtaining module 710 may include:
the application stack checking unit is used for checking whether the current application stack is related to the screen projection mode or not when the split screen mode is detected to be entered, and if so, confirming the screen projection scene in the split screen mode to be entered;
and the display interface checking unit is used for checking whether the current display interface is associated with the split screen mode when the screen projection mode is detected to be entered, and if so, confirming the screen projection scene in the split screen mode.
The picture extracting module 720 may include:
the first brightness reference line determining unit is used for determining a first brightness reference line of the first screen to be projected according to the size of the first screen to be projected and the pixel brightness information, wherein the first brightness reference line is used for indicating a boundary line of the effective display picture in the first screen to be projected;
the first brightness reference line processing unit is used for extracting the effective display picture from the first screen to be projected according to the first brightness reference line so as to obtain the target screen projection picture;
the first brightness reference line judging unit is used for judging whether the first brightness reference line is correct or not;
the effective display picture extracting unit is used for extracting the effective display picture from the first screen picture to be projected according to the first brightness reference line when the first brightness reference line is correct so as to obtain the target screen projection picture;
the second brightness reference line acquiring unit is used for acquiring a second brightness reference line in a second to-be-projected picture, wherein the second brightness reference line is used for indicating a boundary line of an effective display picture in the second to-be-projected picture, the second to-be-projected picture belongs to the at least one frame of to-be-projected picture, and the second to-be-projected picture is different from the first to-be-projected picture;
an average gradient threshold calculation unit, configured to calculate an average gradient threshold of the first luminance reference line and the second luminance reference line, where the average gradient threshold is determined according to a luminance sum of vertical pixels corresponding to the first luminance reference line and a luminance sum of vertical pixels corresponding to the second luminance reference line;
the average gradient threshold value judging unit is used for determining that the first brightness datum line is correct when the average gradient threshold value meets a preset condition;
a preset longitudinal line determining unit, configured to determine a preset longitudinal line located in the effective display screen;
and an average pixel brightness value calculating unit, configured to calculate, with the preset longitudinal line as a starting point, an average pixel brightness value corresponding to each of a plurality of target longitudinal lines on one side of the preset longitudinal line according to the size of the first screen to be projected and the pixel brightness information, so as to determine the first brightness reference line, where the first brightness reference line is a longitudinal line which is closest to the preset longitudinal line and has an average pixel brightness value smaller than a preset threshold value in the plurality of target longitudinal lines.
The screen projection area determination module 730 may include:
the stretching ratio determining unit is used for determining the stretching ratio of the target screen projection picture according to a target adaptation value, wherein the target adaptation value is the size of the fixed height of the screen projection area;
and the area determining unit is used for determining the screen projection area according to the stretching ratio and the target screen projection picture.
The data processing device provided by the embodiment of the application can execute the data processing method provided by any embodiment of the application, and has corresponding functional modules and beneficial effects of the execution method.
EXAMPLE five
Fig. 8 is a schematic structural diagram of a display terminal according to a fifth embodiment of the present application, as shown in fig. 8, the display terminal includes a processor 810, a memory 820, an input device 830, and an output device 840; the number of the processors 810 in the display terminal may be one or more, and one processor 810 is taken as an example in fig. 8; the processor 810, the memory 820, the input device 830 and the output device 840 in the display terminal may be connected by a bus or other means, and are exemplified by being connected by a bus in fig. 8. The memory 820 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to a data processing method in any embodiment of the present application (for example, the screen projection data acquisition module 710, the screen extraction module 720, the screen projection area determination module 730, and the screen projection display module 740 in a data processing apparatus). The processor 810 executes various functional applications of the display terminal and data processing by executing software programs, instructions, and modules stored in the memory 820, that is, implements one of the data processing methods described above. That is, the program when executed by the processor implements:
when a screen projection scene in a split screen mode is detected, screen projection data transmitted by a screen projection terminal are obtained, wherein the screen projection data comprise at least one frame of screen to be projected;
extracting an effective display picture in a first picture to be projected to form a target screen projection picture, wherein the first picture to be projected is any one of the at least one picture to be projected;
determining a screen projection area according to the target screen projection picture, wherein the target screen projection picture is matched with the screen projection area;
and displaying the target screen projection picture through the screen projection area.
The memory 820 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 820 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 820 may further include memory located remotely from the processor 810, which may be connected to a display terminal via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. The input device 830 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the display terminal, and may include a keyboard and a mouse, etc. The output device 840 may include a display terminal such as a display screen.
EXAMPLE six
A sixth embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method according to any embodiment of the present application. Of course, a computer-readable storage medium provided in this embodiment of the present application may perform related operations in a data processing method provided in any embodiment of the present application. That is, the program when executed by the processor implements:
when a screen projection scene in a split screen mode is detected, screen projection data transmitted by a screen projection terminal are obtained, wherein the screen projection data comprise at least one frame of screen to be projected;
extracting an effective display picture in a first picture to be projected to form a target screen projection picture, wherein the first picture to be projected is any one of the at least one picture to be projected;
determining a screen projection area according to the target screen projection picture, wherein the target screen projection picture is matched with the screen projection area;
and displaying the target screen projection picture through the screen projection area.
From the above description of the embodiments, it is obvious for those skilled in the art that the present application can be implemented by software and necessary general hardware, and certainly can be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a display terminal (which may be a personal computer, a server, or a network device) to execute the methods described in the embodiments of the present application.
It should be noted that, in the above embodiment of the data processing apparatus, the included units and modules are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only used for distinguishing one functional unit from another, and are not used for limiting the protection scope of the application.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present application and the technical principles employed. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims (10)

1. A data processing method, comprising:
when a screen projection scene in a split screen mode is detected, screen projection data transmitted by a screen projection terminal are obtained, wherein the screen projection data comprise at least one frame of screen to be projected;
extracting an effective display picture in a first picture to be projected to form a target screen projection picture, wherein the first picture to be projected is any one of the at least one picture to be projected;
determining a screen projection area according to the target screen projection picture, wherein the target screen projection picture is matched with the screen projection area;
and displaying the target screen projection picture through the screen projection area.
2. The method according to claim 1, wherein the extracting the effective display frame in the first to-be-projected frame to form a target projected frame comprises;
determining a first brightness reference line of the first to-be-projected picture according to the size of the first to-be-projected picture and the pixel brightness information, wherein the first brightness reference line is used for indicating a boundary line of the effective display picture in the first to-be-projected picture;
and extracting the effective display picture from the first to-be-projected picture according to the first brightness reference line so as to obtain the target screen projection picture.
3. The method according to claim 2, wherein before extracting the effective display frame from the first to-be-projected frame according to the first brightness reference line to obtain the target projected frame, the method further comprises:
judging whether the first brightness reference line is correct or not;
correspondingly, the extracting the effective display picture from the first to-be-projected picture according to the first brightness reference line to obtain the target screen projection picture includes:
and when the first brightness reference line is correct, extracting the effective display picture from the first to-be-projected picture according to the first brightness reference line so as to obtain the target screen projection picture.
4. The method according to claim 3, wherein the determining whether the first luminance reference line is correct comprises:
acquiring a second brightness reference line in a second to-be-projected picture, wherein the second brightness reference line is used for indicating a boundary line of an effective display picture in the second to-be-projected picture, the second to-be-projected picture belongs to the at least one to-be-projected picture, and the second to-be-projected picture is different from the first to-be-projected picture;
calculating an average gradient threshold value of the first brightness reference line and the second brightness reference line, wherein the average gradient threshold value is determined according to a longitudinal pixel brightness sum corresponding to the first brightness reference line and a longitudinal pixel brightness sum corresponding to the second brightness reference line;
and when the average gradient threshold value meets a preset condition, determining that the first brightness datum line is correct.
5. The method according to any one of claims 2 to 4, wherein the determining a first luminance reference line of the first to-be-projected picture according to the size of the first to-be-projected picture and the pixel luminance information comprises:
determining a preset longitudinal line in the effective display picture;
and calculating an average pixel brightness value corresponding to each longitudinal line of a plurality of target longitudinal lines on one side of the preset longitudinal line according to the size of the first to-be-projected screen picture and the pixel brightness information by taking the preset longitudinal line as a starting point to determine the first brightness reference line, wherein the first brightness reference line is the longitudinal line which is closest to the preset longitudinal line and has the average pixel brightness value smaller than a preset threshold value in the plurality of target longitudinal lines.
6. The method according to any one of claims 1-4, wherein the determining a screen projection area according to the target screen projection picture comprises:
determining the stretching proportion of the target screen projection picture according to a target adaptation value, wherein the target adaptation value is the size of the fixed height of the screen projection area;
and determining the screen projection area according to the stretching ratio and the target screen projection picture.
7. The method according to any one of claims 1-4, wherein the detecting of the screen-shot scene entering the split-screen mode comprises:
when the screen splitting mode is detected to enter, checking whether the current application stack is associated with the screen projecting mode;
if so, confirming a screen projection scene under a split screen mode; alternatively, the first and second electrodes may be,
when the screen projection mode is detected to be entered, checking whether a current display interface is associated with the split screen mode;
and if so, confirming the screen projection scene under the split screen mode.
8. A data processing apparatus, comprising:
the screen projection data acquisition module is used for acquiring screen projection data transmitted by a screen projection terminal when detecting that a screen projection scene in a split screen mode is entered, wherein the screen projection data comprises at least one frame of screen to be projected;
the screen extraction module is used for extracting an effective display screen in a first screen to be projected to form a target screen to be projected, wherein the first screen to be projected is any one frame of the at least one frame of screen to be projected;
the screen projection area determining module is used for determining a screen projection area according to the target screen projection picture, and the target screen projection picture is matched with the screen projection area;
and the screen projection picture display module is used for displaying the target screen projection picture through the screen projection area.
9. A display terminal, comprising:
one or more processors;
storage means for storing one or more programs;
the one or more programs when executed by the one or more processors cause the one or more processors to perform the data processing method of any of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the data processing method of any one of claims 1 to 7.
CN202110475066.6A 2021-04-29 2021-04-29 Data processing method and device, display terminal and storage medium Active CN113010135B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110475066.6A CN113010135B (en) 2021-04-29 2021-04-29 Data processing method and device, display terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110475066.6A CN113010135B (en) 2021-04-29 2021-04-29 Data processing method and device, display terminal and storage medium

Publications (2)

Publication Number Publication Date
CN113010135A true CN113010135A (en) 2021-06-22
CN113010135B CN113010135B (en) 2024-03-12

Family

ID=76380683

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110475066.6A Active CN113010135B (en) 2021-04-29 2021-04-29 Data processing method and device, display terminal and storage medium

Country Status (1)

Country Link
CN (1) CN113010135B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113473196A (en) * 2021-07-21 2021-10-01 青岛海信传媒网络技术有限公司 Screen projection data processing method and display device
CN114428597A (en) * 2022-01-30 2022-05-03 深圳创维－Rgb电子有限公司 Multi-channel terminal screen projection control method and device, screen projector and storage medium

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008103974A (en) * 2006-10-19 2008-05-01 Funai Electric Co Ltd Video scaling system, and television receiver
US20080278628A1 (en) * 2006-10-06 2008-11-13 Sharp Kabushiki Kaisha Content display device, content display method, content display system, content display program, and recording medium
JP2013125426A (en) * 2011-12-15 2013-06-24 Fujifilm Corp Content display device, method, and program
CN106227458A (en) * 2016-08-05 2016-12-14 深圳市金立通信设备有限公司 A kind of method of Data inputing and terminal
CN107273123A (en) * 2017-06-12 2017-10-20 维沃移动通信有限公司 The method and mobile terminal of application interface are shown under split screen display available state
CN108845778A (en) * 2018-06-15 2018-11-20 广州视源电子科技股份有限公司 Layout adjustment method, device, display equipment and the storage medium of split screen
KR20190092354A (en) * 2019-07-29 2019-08-07 에스케이텔레콤 주식회사 Method for communicating using image in messenger, apparatus and system for the same
CN110708086A (en) * 2019-08-26 2020-01-17 华为技术有限公司 Split-screen display method and electronic equipment
CN112118475A (en) * 2020-08-13 2020-12-22 视联动力信息技术股份有限公司 Cross-screen window display method and device, terminal equipment and storage medium
CN112306442A (en) * 2020-11-20 2021-02-02 Oppo广东移动通信有限公司 Cross-device content screen projection method, device, equipment and storage medium
CN112383820A (en) * 2020-11-09 2021-02-19 深圳康佳电子科技有限公司 Method for identifying horizontal and vertical screens of screen projection equipment, storage medium and terminal equipment
CN112667184A (en) * 2021-01-28 2021-04-16 青岛海信传媒网络技术有限公司 Display device

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080278628A1 (en) * 2006-10-06 2008-11-13 Sharp Kabushiki Kaisha Content display device, content display method, content display system, content display program, and recording medium
JP2008103974A (en) * 2006-10-19 2008-05-01 Funai Electric Co Ltd Video scaling system, and television receiver
JP2013125426A (en) * 2011-12-15 2013-06-24 Fujifilm Corp Content display device, method, and program
CN106227458A (en) * 2016-08-05 2016-12-14 深圳市金立通信设备有限公司 A kind of method of Data inputing and terminal
CN107273123A (en) * 2017-06-12 2017-10-20 维沃移动通信有限公司 The method and mobile terminal of application interface are shown under split screen display available state
CN108845778A (en) * 2018-06-15 2018-11-20 广州视源电子科技股份有限公司 Layout adjustment method, device, display equipment and the storage medium of split screen
KR20190092354A (en) * 2019-07-29 2019-08-07 에스케이텔레콤 주식회사 Method for communicating using image in messenger, apparatus and system for the same
CN110708086A (en) * 2019-08-26 2020-01-17 华为技术有限公司 Split-screen display method and electronic equipment
CN112118475A (en) * 2020-08-13 2020-12-22 视联动力信息技术股份有限公司 Cross-screen window display method and device, terminal equipment and storage medium
CN112383820A (en) * 2020-11-09 2021-02-19 深圳康佳电子科技有限公司 Method for identifying horizontal and vertical screens of screen projection equipment, storage medium and terminal equipment
CN112306442A (en) * 2020-11-20 2021-02-02 Oppo广东移动通信有限公司 Cross-device content screen projection method, device, equipment and storage medium
CN112667184A (en) * 2021-01-28 2021-04-16 青岛海信传媒网络技术有限公司 Display device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
汪宏毅;张森;杨知文;戴晓华;: "一种应用于DCS系统的计算机多屏幕管理和大屏幕投屏方案", 工业控制计算机, no. 08 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113473196A (en) * 2021-07-21 2021-10-01 青岛海信传媒网络技术有限公司 Screen projection data processing method and display device
CN114428597A (en) * 2022-01-30 2022-05-03 深圳创维－Rgb电子有限公司 Multi-channel terminal screen projection control method and device, screen projector and storage medium

Also Published As

Publication number Publication date
CN113010135B (en) 2024-03-12

Similar Documents

Publication Publication Date Title
US9124766B2 (en) Video conference apparatus, method, and storage medium
US20220312049A1 (en) Method for processing live-streaming interaction video and server
CN108737882B (en) Image display method, image display device, storage medium and electronic device
US20170324573A1 (en) Information presentation method, apparatus and system
US20180262793A1 (en) Reverse Casting from a First Screen Device to a Second Screen Device
EP3002905B1 (en) Unified communication-based video conference call method, device and system
CN106454407A (en) Video live broadcast method and device
CN111897507B (en) Screen projection method and device, second terminal and storage medium
WO2022089330A1 (en) Method for taking screenshot, apparatus, electronic device, and readable storage medium
RU2609147C2 (en) Method and device for transmitting images
CN113010135B (en) Data processing method and device, display terminal and storage medium
CN109085950B (en) Multi-screen interaction method and device based on electronic whiteboard and electronic whiteboard
CN113206964B (en) Screen projection data display processing method and device, terminal equipment and storage medium
EP4376423A1 (en) Virtual object interaction method and device, and storage medium and computer program product
US20230333803A1 (en) Enhanced Screen Sharing Method and System, and Electronic Device
CN113905268A (en) Black edge removing method for screen projection display of mobile terminal
CN106412617B (en) Remote debugging control method and device
CN110737638A (en) data sharing method, device, electronic equipment and storage medium
WO2017080191A1 (en) Multi-screen interaction-based picture processing method and system
CN111835988B (en) Subtitle generation method, server, terminal equipment and system
CN108833825B (en) Method, device, equipment and storage medium for determining speaker terminal in video conference
CN107612881B (en) Method, device, terminal and storage medium for transmitting picture during file transmission
CN111327863A (en) Video call processing method and device
CN115278332A (en) Display device, playing device and data transmission method
JP2014236336A (en) Information sharing system, image sharing device, terminal device, program, and information sharing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant