CN108845778B

CN108845778B - Layout adjustment method and device for split screen picture, display device and storage medium

Info

Publication number: CN108845778B
Application number: CN201810620897.6A
Authority: CN
Inventors: 杨锁锁
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shizhen Information Technology Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shizhen Information Technology Co Ltd
Priority date: 2018-06-15
Filing date: 2018-06-15
Publication date: 2021-09-24
Anticipated expiration: 2038-06-15
Also published as: CN108845778A

Abstract

The invention discloses a layout adjustment method and device for split screen pictures, display equipment and a storage medium. The method comprises the following steps: after triggering and entering a layout adjustment mode, determining an adjustment direction information set of each split screen picture according to the currently acquired original display parameter information of each split screen picture; according to each adjustment direction information set, obtaining corresponding adjustment path information when each split screen picture is taken as an adjustment starting point, and determining the adjustment optimization rate of each adjustment path information; and determining the adjustment path information corresponding to the highest adjustment optimization rate as target adjustment path information, and adjusting the display layout of each split screen picture according to the target adjustment path information and each original display parameter information. By the method, each split screen picture can be displayed to the maximum extent by adjusting the display layout of each split screen picture when split screen display is carried out, so that the display space of the screen of the display equipment is fully utilized, the advantage of a large screen is further exerted when split screen display is carried out, and the user experience of the display function of the display equipment is improved.

Description

Layout adjustment method and device for split screen picture, display device and storage medium

Technical Field

The embodiment of the invention relates to the technical field of screen transmission, in particular to a layout adjustment method and device of a split screen picture, display equipment and a storage medium.

Background

The screen transfer refers to displaying contents on one screen onto another screen. For example, the content displayed on the screen of the mobile phone is displayed on the screen of the television, and at this time, the mobile phone is the source device, and the television is the display device. Generally, the pass screen includes a wired pass screen and a wireless pass screen. The wired screen transmission is realized by connecting a device needing screen transmission through a data line, for example, when the content on the screen of a mobile phone is required to be displayed on the screen of a television, the mobile phone and the television are connected through the data line; the wireless screen transmission technology is used for transmitting multimedia information such as video and audio of source equipment to display equipment through a wireless network, so that content sharing and multi-screen interaction are realized.

In the screen transmission process, the screen of the display device can be divided according to the following screen division reference, namely, when one source device is projected, the screen of the source device monopolizes the whole display device to display according to the actual screen aspect ratio; when 2 source devices project screens, the screen of the display device is uniformly divided into 2 equal parts along the vertical direction, and the 2 source devices are projected to 2 screen-dividing positions of the display device to be displayed according to the actual screen width-to-height ratio; when 3 or 4 source devices project screens, the screens of the display devices are uniformly divided into 4 equal parts, and the source devices are respectively projected to corresponding screen splitting positions to be displayed.

However, in the process of split-screen display of the conventional screen, due to a single and fixed layout mode, the display space of the screen of the display device cannot be fully utilized, and the user experience is reduced.

Disclosure of Invention

The invention provides a layout adjustment method and device of split screen pictures, a display device and a storage medium, which are used for improving the utilization rate of a screen of the display device during screen transmission display.

In one aspect, an embodiment of the present invention provides a method for adjusting a layout of a split screen image, including:

after triggering and entering a layout adjustment mode, determining an adjustment direction information set of each split screen picture according to the currently acquired original display parameter information of each split screen picture;

according to each adjustment direction information set, obtaining corresponding adjustment path information when each split screen picture is taken as a starting split screen picture, and determining the adjustment optimization rate of each adjustment path information;

and determining the adjustment path information corresponding to the highest adjustment optimization rate as target adjustment path information, and adjusting the display layout of each split screen picture according to the target adjustment path information and each original display parameter information.

On the other hand, an embodiment of the present invention provides a layout adjustment apparatus for split screens, including:

the information set determining module is used for determining an adjusting direction information set of each split screen picture according to the currently acquired original display parameter information of each split screen picture after triggering to enter a layout adjusting mode;

the optimization rate determining module is used for obtaining corresponding adjustment path information when each split screen picture is taken as a starting split screen picture according to each adjustment direction information set, and determining the adjustment optimization rate of each adjustment path information;

and the display layout adjusting module is used for determining the adjustment path information corresponding to the highest adjustment optimization rate as target adjustment path information, and adjusting the display layout of each split screen picture according to the target adjustment path information and each piece of original display parameter information.

In another aspect, an embodiment of the present invention provides a display device, including: the display screen still includes:

one or more processors;

storage means for storing one or more programs;

the one or more programs are executed by the one or more processors, so that the one or more processors implement the layout adjustment method of the split screen provided by the embodiment of the invention.

In another aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method for adjusting a layout of a split screen image according to an embodiment of the present invention.

In the method, the device, the display equipment and the storage medium for adjusting the layout of the split screen images, firstly, after the split screen images are triggered to enter a layout adjustment mode, an adjustment direction information set of each split screen image is determined according to the currently acquired original display parameter information of each split screen image; then according to each adjustment direction information set, obtaining corresponding adjustment path information when each split screen picture is taken as a starting split screen picture, and determining the adjustment optimization rate of each adjustment path information; and finally, determining the adjustment path information corresponding to the highest adjustment optimization rate as target adjustment path information, and adjusting the display layout of each split screen picture according to the target adjustment path information and each original display parameter information. According to the method and the device for adjusting the layout of the split screen pictures, the display equipment and the storage medium, when split screen display is carried out, each split screen picture can be displayed to the maximum extent by adjusting the display layout of each split screen picture, so that the display space of the screen of the display equipment is fully utilized, the advantage of a large screen is further played when the split screen display is carried out, and the user experience of the display function of the display equipment is improved.

Drawings

Fig. 1 is a schematic flowchart of a method for adjusting a layout of a split screen according to an embodiment of the present invention;

fig. 2a is a schematic flowchart of a layout adjustment method for a split screen image according to a second embodiment of the present invention;

FIG. 2b is a diagram illustrating a display layout effect of a split-screen display on a display device in a source device according to the prior art;

FIG. 2c is a flowchart illustrating an implementation of determining two pairs of translational direction sets and vertex angle extension direction sets according to an embodiment of the present invention;

FIG. 2d is a diagram showing a display effect after adjustment of the display layout of the split screen image is performed according to the method of the second embodiment of the present invention;

fig. 3a is a schematic flowchart of a method for adjusting a layout of a split screen image according to a third embodiment of the present invention;

fig. 3b is a flowchart illustrating an implementation of determining current adjustment path information when there is a hindrance to another split-screen picture according to a third embodiment of the present invention;

fig. 4 is a block diagram of a layout adjustment apparatus for split screens according to a fourth embodiment of the present invention;

fig. 5 is a schematic diagram of a hardware structure of a display device according to a fifth embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.

It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.

Example one

Fig. 1 is a schematic flow chart of a method for adjusting a layout of a split screen image according to an embodiment of the present invention, where the method is suitable for adjusting the layout of the split screen image during split screen display, and the method can be executed by a device for adjusting the layout of the split screen image, where the device can be implemented by software and/or hardware and is generally integrated on a display device having a display screen.

In this embodiment, the display device may be a computer, a television, a projector, an intelligent tablet, or the like.

As shown in fig. 1, a method for adjusting a layout of a split screen according to an embodiment of the present invention includes the following operations:

s101, after the mode of entering the layout adjustment mode is triggered, according to the original display parameter information of each split screen image obtained currently, an adjustment direction information set of each split screen image is determined.

In the present embodiment, the layout adjustment mode may be understood as a mode of adjusting the display layout of each split screen. Split screen is understood to mean splitting the display screen to form sub-display screens. A split screen picture may be understood as a picture displayed on a sub-display. The original display parameter information may be understood as corresponding position information in each split screen before display layout adjustment is not performed on each split screen. The adjustment direction information set can be understood as a direction set capable of adjusting the corresponding split screen picture.

Specifically, the layout adjustment mode may have a variety of trigger conditions. For example, when a user presses the trigger key, the display layout of each split screen image can be adjusted by entering a layout adjustment mode through a special trigger key of the device; or a timer can be set, and when the timer reaches the preset time, the layout adjustment mode is automatically triggered to enter; the screen projection state of the display equipment can be monitored, and when a new split screen picture is accessed or a split screen picture exits, the layout adjustment mode is triggered to enter.

Generally, each split screen image has corresponding original display parameter information before screen projection display, and for example, after the display screen is divided according to the existing split screen reference, the split screen image is projected to the central position of each split screen according to the actual screen aspect ratio. It is understood that the original display parameter information may be used to identify the position information of each split screen in the display screen, and thus, the original display parameter information may be coordinate information. Specifically, the storage mode of each original display parameter information may be to store coordinates of a split screen picture boundary; or storing the coordinates of the vertices of the split screen. The number of the stored coordinate points can be specifically selected according to the actual situation, and the position of the split screen picture in the display screen can be uniquely determined.

In this embodiment, the adjustment direction in which each split screen image can be extended or translated may be determined based on the original display parameter information of each split screen image, and the adjustment direction determined corresponding to each split screen image constitutes a corresponding adjustment direction information set. The determined adjustment direction information set can be regarded as a key for adjusting the display layout of each split screen picture, and finally the purpose of fully utilizing the display space of the display screen can be achieved.

It can be understood that, when the split screens are adjusted, in order to actually show the actual scene, the aspect ratio of each split screen needs to be consistent with the aspect ratio of the source device. Therefore, the adjustment direction information set of each split screen image can determine the translation adjustment direction or the extension adjustment direction supported by each split screen image, and can also determine the maximum allowable adjustment distance of each adjustment direction, so that the display space of the display screen can be fully utilized by performing appropriate position adjustment and extension amplification adjustment on each split screen image.

S102, obtaining corresponding adjustment path information when each split screen picture is taken as a starting split screen picture according to each adjustment direction information set, and determining the adjustment optimization rate of each adjustment path information.

In this embodiment, the starting-point split screen may be understood as a split screen that is a starting point of adjustment when the adjustment path information is acquired. For example, according to the layout of each split screen image before adjustment, a certain sequence, such as a "Z" font, a "V" font, or an "S" font, may be selected to select the split screen image as a starting point, and thereby obtain at least one adjustment path information corresponding to each split screen image as the starting split screen image. The adjustment path information can be understood as summary information of adjustment direction information and adjustment distance information corresponding to each split screen image when performing corresponding adjustment during layout adjustment, and based on the determined adjustment path information, one adjustment of the display layout of the split screen images can be realized; any kind of determined adjustment path information corresponds to an adjustment optimization rate, and the adjustment optimization rate can be understood as the magnification of the effective picture increased before and after the display layout is adjusted based on the corresponding adjustment path information.

Specifically, in order to improve the utilization rate of the display space of the display screen, the adjustment optimization rate of each adjustment path information corresponding to each split screen image as the initial split screen image needs to be calculated in a traversal manner, so the key of this step is to determine the adjustment path information corresponding to each split screen image as the initial split screen image.

It is understood that the adjustment path information is determined according to the adjustment direction information set of each split screen picture. In the process of determining the adjustment path information, only the starting split screen image can be amplified, and the rest split screen images can be translated. Generally, after the adjustment path information is determined, the correspondingly obtained optimized adjustment rate may be used as a comparison condition to compare adjustment schemes corresponding to the adjustment direction information, so as to select an optimal adjustment scheme for display layout adjustment.

S103, determining the adjustment path information corresponding to the highest adjustment optimization rate as target adjustment path information, and adjusting the display layout of each split screen picture according to the target adjustment path information and each original display parameter information.

In this embodiment, the highest adjustment optimization rate may be understood as a maximum value of the adjustment optimization rates corresponding to the adjustment path information. The target adjustment path information may be understood as adjustment path information corresponding to the determined final required adjustment scheme. The display layout can be understood as the arrangement of each split screen image when the display screen displays.

It can be understood that, the higher the adjustment optimization rate is, the larger the magnification of each split-screen display picture is, the larger the used area of the display space of the current display screen is. Therefore, the adjustment path corresponding to the highest adjustment optimization rate is selected as target adjustment path information to adjust each split screen picture.

In the present embodiment, the adjustment priority of each split screen is preferably set, and for example, the priority of the split screen arranged in the order of the "Z" shape in the display screen may be set to be lower in order. In this embodiment, the optimization level of the adjustment directions that may correspond to the split screens may also be preferably set, and for example, the priority of each adjustment direction corresponding to each split screen may be set to decrease sequentially in the clockwise direction.

Specifically, in the process of selecting the highest adjustment and optimization rate, a situation that all pieces of adjustment path information have the highest adjustment and optimization rate may be encountered, in this situation, if the initial split-screen pictures corresponding to the pieces of adjustment path information corresponding to the highest adjustment and optimization rate are different, the adjustment path information corresponding to the initial split-screen picture with the highest priority may be preferentially selected as the target adjustment path information, and if the pieces of adjustment path information corresponding to the highest adjustment and optimization rate belong to the same initial split-screen picture, the adjustment path information corresponding to the adjustment direction with the highest priority in the initial split-screen pictures may be selected as the target adjustment path information according to the priority of the adjustment direction.

In a specific adjusting process, the target adjusting path information and the original display parameter information corresponding to each split screen picture can be combined to determine the display position of each split screen picture in the display device and display each split screen picture to a corresponding position, so that the display layout of each split screen picture is adjusted, and the utilization rate of the display space of the display screen of the display device is increased.

Obviously, the layout adjustment of each split screen image may be performed more than once, and once the split screen image enters the layout adjustment mode, the triggering of the layout adjustment mode may have various forms. After the layout adjustment is performed once, whether the adjustment of each split screen picture can be continued or not can be continuously judged based on the position after the adjustment until the display space of the display equipment is fully utilized.

The layout adjustment method for split screen images provided by the embodiment of the invention comprises the steps of firstly triggering to enter a layout adjustment mode, and then determining an adjustment direction information set of each split screen image according to the currently acquired original display parameter information of each split screen image; then according to each adjustment direction information set, obtaining corresponding adjustment path information when each split screen picture is taken as a starting split screen picture, and determining the adjustment optimization rate of each adjustment path information; and finally, determining the adjustment path information corresponding to the highest adjustment optimization rate as target adjustment path information, and adjusting the display layout of each split screen picture according to the target adjustment path information and each original display parameter information. By the method, each split screen picture can be displayed to the maximum extent by adjusting the display layout of each split screen picture when split screen display is carried out, so that the display space of the screen of the display equipment is fully utilized, the advantage of a large screen is further exerted when split screen display is carried out, and the user experience of the display function of the display equipment is improved.

Example two

Fig. 2a is a schematic flowchart of a layout adjustment method for a split screen image according to a second embodiment of the present invention. The embodiment of the invention is optimized on the basis of the above embodiments. In this embodiment, the original display parameter information of the split screen image is embodied as: original position information of each picture boundary in the split screen picture in the display equipment; correspondingly, determining an adjustment direction information set of each split screen image according to the currently acquired original display parameter information of each split screen image, specifically as follows: according to screen boundary position information of display equipment and original position information of each picture boundary in each split screen picture, determining a translation direction set and a vertex angle extension direction set of each split screen picture, and recording the translation direction set and the vertex angle extension direction set as adjustment direction information sets of the corresponding split screen pictures.

Further, in this embodiment, the adjustment path information corresponding to the highest adjustment optimization rate is determined as target adjustment path information, and the display layout of each split screen image is adjusted according to the target adjustment path information and each piece of original display parameter information, which is further optimized as follows: determining the highest adjustment optimization rate from the adjustment optimization rates of the adjustment path information, and acquiring target adjustment path information corresponding to the highest adjustment optimization rate; determining extension information or translation information of each split screen picture according to the target adjustment path information; determining the current display parameter information of each split screen picture on the display equipment according to the original display parameter information of each split screen picture and corresponding extension information or translation information; and adjusting the display layout of each split screen picture based on each current display parameter information.

On the basis of the above optimization, before determining the adjustment direction information set of each split screen image according to the currently acquired original display parameter information of each split screen image, the present embodiment further optimizes and increases: if the situation that split screen pictures to be accessed are triggered to enter the layout adjustment mode and the current access total number is smaller than the access threshold value is monitored, accessing new split screen pictures and determining the original display parameter information of each split screen picture based on the current display layout of each split screen picture in display equipment; and if the layout adjustment mode is triggered to enter according to an optimization adjustment instruction triggered by a user, determining the original display parameter information of each split screen picture directly based on the current display layout of each split screen picture in the display equipment.

On the basis of the optimization, the optimization of the embodiment further increases after the display layout of each split screen is adjusted: and decoding video data sent by source equipment corresponding to each split screen picture, and refreshing and displaying each video data in the corresponding split screen picture.

As shown in fig. 2a, a method for adjusting a layout of a split screen image according to a second embodiment of the present invention specifically includes the following operations:

and S201, triggering to enter a layout adjustment mode.

In this embodiment, based on the above S101, the layout adjustment mode may have a plurality of triggering manners. After the triggering of entering the layout adjustment mode, corresponding layout adjustment operation can be performed.

S202, judging whether a split screen image to be accessed is triggered to enter a layout adjustment mode and the current access total number is smaller than an access threshold value or not, if so, executing S203; if not, go to S204.

In this embodiment, the split screen picture to be accessed may be understood as a split screen picture to be accessed. The current access total number can be understood as the sum of the number of split screens already existing in the current display screen and the number of split screens to be accessed. The access threshold may be understood as the number of split screens that the display screen has the maximum allowed access to.

Specifically, after entering the layout adjustment mode, it may be further determined which means is adopted to trigger the entry into the layout adjustment mode. There may be different processing operations for different trigger conditions. If the split screen picture to be accessed is triggered to enter the layout adjustment mode, the method can be used for judging whether the split screen picture to be accessed is triggered to enter the layout adjustment mode. It can be understood that, in the existing split screen technology, at most 4 split screens are supported, so when a split screen picture to be accessed is accessed, it is further required to determine whether the current access total number is smaller than an access threshold. If the value is less than the access threshold, executing S203; and if the split screen picture to be accessed does not exist or the current access total number is not less than the access threshold value, executing S204.

S203, accessing a new split screen picture and determining the original display parameter information of each split screen picture based on the current display layout of each split screen picture in the display equipment.

In this embodiment, the new split screen image may be understood as a split screen image formed after the split screen image to be accessed is accessed. The current display layout can be understood as a corresponding display layout when the split-screen display is performed on each split-screen picture by using the existing display distribution standard.

Specifically, when a split screen image to be accessed is triggered to enter a layout adjustment mode and the current access total number is smaller than an access threshold value, the split screen image to be accessed is accessed to form a new split screen image. And after a new split screen picture is accessed, determining the original display parameter information corresponding to each split screen picture based on the current display layout of each split screen picture in the display equipment.

Generally, when a new split screen is accessed, a preset sequence may be set to place the new split screen at a specified position. Illustratively, when a new split screen picture is accessed, the split screens can be arranged in sequence along the sequence of the Z shape. If a split screen image exists in the display device and a split screen image to be accessed is accessed, the display device can be uniformly divided into 2 equal parts along the vertical direction, and a new split screen image is placed at the split screen position on the right side of the display device.

S204, determining the original display parameter information of each split screen picture directly based on the current display layout of each split screen picture in the display equipment.

In this embodiment, when there is no split screen image to be accessed to enter the layout adjustment mode or the current access total is not less than the access threshold value and enters the layout adjustment mode, it may be understood that the split screen image enters the layout adjustment mode according to the optimization adjustment instruction triggered by the user, it may be understood that there is no new split screen image currently, and the original display parameter information of each split screen image may be determined directly based on the current display layout of each split screen image in the display device.

S205, according to the screen boundary position information of the display device and the original position information of each picture boundary in each split screen picture, determining a translation direction set and a vertex angle extension direction set of each split screen picture, and recording the translation direction set and the vertex angle extension direction set as adjustment direction information sets of the corresponding split screen pictures.

In the present embodiment, the screen boundary position information may be understood as position information of each boundary of the screen in the display device. In general, the screen boundary position information may include position information of four screen boundaries of the display device. The picture boundary can be understood as position information corresponding to each boundary constituting the split screen picture. The panning direction set can be understood as a direction set in which panning adjustment can be performed on a split screen picture. The vertex angle extension direction set can be understood as a direction set of a split screen picture capable of extension adjustment based on a vertex angle.

Specifically, each split screen picture can correspond to four vertex angle extending directions while maintaining the aspect ratio, that is: the left upper vertex angle direction extends, the right upper vertex angle direction extends, the left lower vertex angle direction extends and the right lower vertex angle direction extends. When determining the adjustment direction information set once, an extending direction of a vertex angle of the split screen picture may be one of the extending directions. Accordingly, the panning direction of each split screen picture may include at least one of: up translation, down translation, left translation, and right translation.

In general, when the panning direction set and the vertex extending direction set are determined, the determination may be made based on screen boundary position information of the display device and original position information of each picture boundary in each split screen picture. Specifically, when the other split screen images obstruct or reach the screen boundary in the process of translating or extending the split screen images, it may be considered that the corresponding directions cannot be adjusted.

In this embodiment, after the translation direction set and the vertex angle extension direction set of each split screen image are determined, the translation direction set and the vertex angle extension direction set are recorded as adjustment direction information sets corresponding to the corresponding split screen images, so as to facilitate processing of subsequent adjustment operations.

Fig. 2b is a diagram showing the display layout effect of split-screen display on the display device in the source device in the prior art. Specifically, as shown in fig. 2b, when performing split-screen based on the existing display distribution reference, the display apparatus 1 has 4 split-screen pictures: a first split screen picture 2, a second split screen picture 3, a third split screen picture 4 and a fourth split screen picture 5. The display device 1 performs 4 split screens, each split screen is distributed in a shape like a Chinese character 'tian', each split screen performs screen display according to the actual screen width-height ratio on the source device, and the dotted lines in the figure represent the split screen positions of the display device.

Illustratively, in making the adjustment direction information set determination, with respect to the fourth split screen picture 5, the lower side thereof has touched the boundary of the display device 1, so panning in the lower direction cannot be made. I.e. cannot be translated downwards in the direction of translation. Cannot extend towards the left lower vertex angle and cannot extend towards the right lower vertex angle in the vertex angle extending direction. But may be translated upward, leftward and rightward, extending in the upward left vertex angle direction and extending in the upward right vertex angle direction. Therefore, the adjustment direction information set of the fourth split screen frame 5 may include: upwards translate, leftwards translate and rightwards translate, extend towards the upper left vertex angle and extend towards the upper right vertex angle.

Further, fig. 2c shows a flowchart of an implementation of determining two pairs of translation direction sets and vertex angle extension direction sets according to the embodiment of the present invention. Specifically, as shown in fig. 2c, the determination of the set of translation directions and the set of vertex angle extension directions includes the following operations:

and S2051, comparing the original position information of each picture boundary in each split screen picture with the position information of the screen boundary.

In this embodiment, in the process of determining the panning direction set and the vertex extending direction set of each split screen picture, the original position information of each picture boundary in each split screen picture may be compared with the position information of each boundary of the screen to determine. Specifically, the boundary of the split screen image in the same direction and the coordinate information of the screen boundary may be compared to determine whether the adjustment is possible in the direction.

Illustratively, as shown in fig. 2b, the upper left corner of the display device 1 may be selected as a coordinate starting point (00), an x direction along a horizontal direction, and a y direction along a vertical direction. If the coordinate corresponding to the lower left corner of the display device 1 is (02), the coordinate of the lower boundary of the fourth screenshot 5 is y-2; the coordinate of the lower border of the display device 1 is also y-2. It can be seen that the lower boundary of the fourth screenshot 5 coincides with the lower boundary of the display device 1. It is explained that the fourth screenshot 5 cannot be adjusted in the downward direction. And further, comparing the rest boundaries of each split screen picture based on the same method.

And S2052, determining the translatable direction along the picture boundary and the extendable direction along the picture vertex angle in each split-screen picture according to the comparison result.

In this embodiment, after comparing each boundary in each split screen image with the screen boundary position information in sequence, the translatable direction along the image boundary and the extendable direction along the image vertex angle of each split screen image can be selected.

For example, as can be seen from the analysis in S2051, after the comparison of the boundaries of the fourth split screen frame 5, the obtaining of the translatable direction of the fourth split screen frame 5 includes: up translation, left translation, and right translation. The extendable direction includes: extending towards the left upper vertex angle direction and extending towards the right upper vertex angle direction. It is understood that after the translatable direction and the extendable direction of the fourth split screen frame 5 are determined, the translatable direction and the extendable direction of the remaining split screen frames are determined in turn by the same means. The split screen images can be selected according to a preset sequence or randomly when the translatable direction and the extendable direction are determined.

And S2053, forming a translation direction set containing a corresponding translatable direction and a vertex angle extending direction set containing a corresponding extendable direction of each split screen picture.

In this embodiment, after obtaining the translatable direction and the extendable direction of each split screen image, summarizing each corresponding translatable direction of each split screen image to form a set of translatable directions; and summarizing the corresponding extensible directions of the split screens to form a vertex angle extending direction set. The translation direction set and the vertex angle extension direction set can form an adjustment direction information set of each split screen picture.

S206, according to each adjustment direction information set, obtaining corresponding adjustment path information when each split screen picture is taken as a starting split screen picture, and determining the adjustment optimization rate of each adjustment path information.

In this embodiment, after obtaining the adjustment direction information set, the adjustment path information and the adjustment optimization rate corresponding to the starting split screen image may be determined based on the adjustment direction information set. And selecting target adjustment path information to adjust the display layout of each split screen picture based on the adjustment optimization rate.

S207, determining the highest adjustment optimization rate from the adjustment optimization rates of the adjustment path information, and acquiring target adjustment path information corresponding to the highest adjustment optimization rate.

In this embodiment, after the information of each adjustment path and the corresponding adjustment optimization rate are obtained, the maximum value is selected from the adjustment optimization rates as the highest adjustment optimization rate. And obtaining the adjustment path information corresponding to the highest adjustment optimization rate as target adjustment path information. The display layout of each split screen can be adjusted based on the target adjustment path information.

And S208, determining extension information or translation information of each split screen picture according to the target adjustment path information.

In this embodiment, extension information or panning information of each split screen may be acquired based on the target adjustment path information. It is understood that, in one piece of target adjustment path information, extension information of a starting split screen picture is specifically included, and translation information of other split screen pictures may also be included, where the extension information may include extension direction information and extension distance information. The translation information may include translation direction information and translation distance information. According to the obtained extension information or translation information of each split screen picture, the display layout can be adjusted.

S209, determining the current display parameter information of each split screen picture on the display equipment according to the original display parameter information of each split screen picture and the corresponding extension information or translation information.

In this embodiment, after the extension information or the translation information of each split screen image is obtained, the current display parameter information of each split screen image on the display device can be uniquely determined based on the original display parameter information of each split screen image.

Specifically, the extending direction of the initial split screen picture and the extending distance in the extending direction can be determined according to the target adjusting path information, and when other split screen pictures which need to be translated exist, the translating direction of the other split screen pictures and the translating distance corresponding to the translating direction can also be determined, so that the current display parameter information of each split screen picture on the display equipment can be effectively obtained by combining the given extending direction, extending distance, translating direction and translating distance on the premise that the original display parameter information of each split screen picture is known.

And S210, adjusting the display layout of each split screen picture based on each current display parameter information.

In this embodiment, after the current display parameter information is obtained, each split screen image is displayed, so that the display layout of each split screen image is adjusted. It can be understood that the display layout is adjusted by adjusting the position parameters of the split screens on the display device to realize the equal-ratio amplification or translation of the split screens.

Fig. 2d shows a display effect diagram after the split screen display layout is adjusted based on the method of the second embodiment of the invention. Specifically, it can be considered that fig. 2d is a display effect diagram given after the display layout adjustment is performed on the basis of the above fig. 2b, and as shown in fig. 2d, in the display device 6, there are 4 split screens, which are the first split screen 7, the second split screen 8, the third split screen 9 and the fourth split screen 10, respectively, and when the layout adjustment is performed based on the layout adjustment method provided in the embodiment of the present invention, it can be found that, compared with the above fig. 2b, the first split screen 7 and the second split screen 8 are respectively performed with the operation of translating to the left, and the fourth split screen 10 is performed with the operation of extending along the top left corner.

Thus, it is considered that the one piece of target adjustment path information determined in the present embodiment includes a split screen image with the fourth split screen image as a starting point, and the extension information of the starting split screen image is information such as an extension distance related to extension along the top left corner, translation information existing in the second split screen image is a first translation distance related to leftward translation, and translation information existing in the third split screen image is a second translation distance related to leftward translation, and finally the layout adjustment shown in fig. 2d is realized based on the target adjustment path information. It can be seen that the display screen of the display device is more efficiently used after the layout adjustment.

S211, decoding video data sent by source equipment corresponding to each split screen picture, and refreshing and displaying each video data in the corresponding split screen picture.

In this embodiment, in the screen projection process, each split screen image corresponds to one view component, and when video data is received, the video data is decoded and refreshed in real time and displayed on the display device. And when the layout of the split screen picture is adjusted, reserving the picture frame before the video data is adjusted for operation. When video data is received in the process of adjusting the display layout, the video data is directly discarded without decoding and refreshing. After the display layout of each split screen picture is adjusted, the trying assembly corresponding to each split screen picture continuously decodes and refreshes the video data sent by the source equipment corresponding to each split screen picture, and therefore the video data of each source equipment is displayed in real time.

The layout adjustment method for the split screen picture provided by the second embodiment of the invention embodies the original display parameter information of the split screen picture; correspondingly, the adjustment direction information set for determining each split screen picture is embodied; meanwhile, the operation of adjusting the display layout of each split screen picture is embodied; on the basis, when different trigger layout adjustment modes are added, the operation of the determining method of the original display parameter information of each split screen picture and the operation of refreshing and displaying each video data after the layout adjustment are optimized. By using the method, different determination methods of the original display parameter information of each split screen picture can be selected according to different trigger conditions after entering the layout adjustment mode. And the display layout of each split screen picture can be adjusted according to the determined target adjustment path information and the original display parameter information, and the video data sent by each source device corresponding to each split screen picture is decoded and displayed in real time after the adjustment is finished. Therefore, each split screen picture is displayed in a maximized mode when split screen display is carried out, and the effect of fully utilizing the display space of the screen of the display equipment is achieved. And then the advantage of large screen is fully exerted when split screen display is carried out, and the user experience of the display function of the display equipment is improved.

EXAMPLE III

Fig. 3a is a schematic flowchart of a layout adjustment method for a split screen image according to a third embodiment of the present invention. The embodiment of the invention is optimized on the basis of the above embodiments. In this embodiment, the obtaining, according to each adjustment direction information set, adjustment path information corresponding to each split-screen picture as a starting split-screen picture, and determining an adjustment optimization rate of each adjustment path information are embodied as: sequentially selecting a split screen picture as a starting split screen picture according to a set first selection sequence; determining a current adjustment direction from the adjustment direction information sets of the starting point split screen pictures in sequence according to a set second selection sequence; sequentially determining the current amplification amplitude according to a preset step length in the current adjustment direction; if the extended distance adjusted based on the current amplification amplitude in the current adjustment direction is smaller than or equal to the maximum allowable distance, forming current adjustment path information of the starting point split screen picture based on the current adjustment direction and the current amplification amplitude, and determining the adjustment optimization rate of the current adjustment path information according to the current adjustment path information and a set optimization rate formula; if the current adjustment direction is blocked by other split screen pictures during adjustment based on the current amplification degree, determining current adjustment path information of the starting split screen picture for performing the current amplification degree adjustment in the current adjustment direction based on a path adjustment strategy, and determining the adjustment optimization rate of the current adjustment path information according to the current adjustment path information and a set optimization rate formula; and if the screen boundary of the display device is reached when the current magnification adjustment is carried out in the current adjustment direction, ending the determination of the adjustment path of the starting point split screen picture in the current adjustment direction.

As shown in fig. 3a, a method for adjusting a layout of a split screen image according to a third embodiment of the present invention specifically includes the following operations:

s301, after the mode of entering the layout adjustment is triggered, the adjustment direction information set of each split screen picture is determined according to the currently acquired original display parameter information of each split screen picture.

S302, selecting a split screen picture as a starting split screen picture according to a set first selection sequence.

In this embodiment, the first selection order may be understood as a selection order set when the starting split screen is selected. The first selection sequence can be set arbitrarily according to any sequence, as long as the selection is performed according to the first selection sequence when the layout adjustment is performed. The setting of the specific first selection order may be referred to the selection of the order in S102.

Specifically, in the process of determining the adjustment path information of each split screen picture, a split screen picture is selected from each split screen picture as a starting split screen picture according to a first selection sequence. After the adjustment path information and the corresponding adjustment optimization rate are determined according to the first starting split screen picture selected according to the first selection sequence, the next split screen picture is selected according to the first selection sequence to serve as a new starting split screen picture to continue determining the adjustment path information and the adjustment optimization rate until all split screen pictures serve as the starting split screen pictures to complete determining the adjustment path information and the corresponding adjustment optimization rate.

S303, determining a current adjusting direction from the adjusting direction information set of the starting split screen picture according to a set second selecting sequence.

In this embodiment, the second selection order may be understood as a selection order set by selecting the current adjustment direction in the adjustment direction information set. The current adjustment direction may be understood as an adjustment direction selected when the adjustment path information is determined this time. It can be understood that, in the process of determining the adjustment path information of each split screen image, there may be a plurality of directions that can be extended in one starting split screen image, and thus there may be a plurality of adjustment path information, so that the selection is performed according to the second selection sequence when the adjustment directions are selected.

The second selection sequence may be set according to any sequence, as long as the selection is performed according to the second selection sequence when the current adjustment direction is determined. The specific second selection sequence may be set in a counterclockwise direction from the left end of the display device or in a clockwise direction.

Specifically, in the process of determining the current adjustment direction, one adjustment direction is selected from the adjustment direction information set as the current adjustment direction according to a second selection sequence. It is to be understood that the current adjustment direction may be understood as selecting an extension direction in the adjustment direction information set as the current adjustment direction. After the adjustment path information is determined based on the adjustment direction, the next adjustment direction is selected according to a second selection sequence to serve as the current adjustment direction to continue determining the adjustment path information until the adjustment direction in the adjustment direction information set is selected.

S304, determining the current amplification amplitude according to the preset step length in the current adjustment direction.

In the present embodiment, the preset step size can be understood as the preset amplification magnitude of each increment. The current amplification degree can be understood as the amplification degree selected when the adjustment path information is determined. It will be appreciated that the current amplification level may be adjusted by a preset step size. In general, the preset step size may be set by default, such as 0.1 times per increment. The preset step size may also be set manually by the user. It can be understood that the difference of the preset step sizes may cause the difference of the current amplification amplitude obtained by the starting split screen along the current adjustment direction.

Obviously, there can be multiple adjustment directions for one split screen picture. There may be multiple amplification levels for one adjustment direction. Therefore, when determining the adjustment path information, a three-layer nested loop needs to be performed to determine the adjustment path information. The first is to cycle through the amplification amplitudes as in S304, the second is to cycle through the adjustment directions as in S303, and the last is to cycle through the split screens. And finally, determining the adjustment path information of different amplification ranges in different adjustment directions for different split screen images.

S305, judging whether the extension distance adjusted based on the current amplification amplitude in the current adjustment direction is smaller than or equal to the maximum allowable distance, if so, executing S306; if not, go to step S307.

In this embodiment, the maximum allowable distance may be understood as a maximum adjustment distance allowed by the starting split screen image when the starting split screen image extends along the current adjustment direction (generally, the maximum adjustment distance may be set based on distances from two corresponding boundaries of the split screen image in the current adjustment direction to boundaries of adjacent split screen images or to boundaries of adjacent screens). The extending distance may be understood as a distance that two boundaries of the top angle constituting the current adjustment direction in the starting split screen picture expand outward when extending.

It can be understood that when the starting split screen frame extends along the current adjustment direction, the starting split screen frame may encounter the obstruction of the rest split screen frames and may also reach the boundary of the display device. As an example, as shown in fig. 2b, when the fourth split screen 5 extends in the top left corner direction, an obstruction of the second split screen in that direction is encountered. The fourth screenshot 5 may reach the right border of the display device 1 after extending a certain distance along the top right corner.

Specifically, as shown in fig. 2b, if the fourth split screen picture 5 is not present in the current display apparatus 1, the second split screen picture 3 can be directly extended in the left and right bottom corner directions. Assuming that the second split screen picture extends 2cm to the right boundary of the third split screen picture 4 from the left lower vertex angle and extends 2.5cm to the lower boundary of the display device 1, the maximum allowable distance of the second split screen picture in the adjustment direction of the left lower vertex angle is 2 cm.

Generally, if the extension distance adjusted based on the current amplification degree in the current adjustment direction is less than or equal to the maximum allowable distance, it indicates that the extension can be directly performed according to the current amplification degree, and then S306 may be performed; otherwise, it indicates that the current amplification range cannot be directly extended when the current adjustment direction is enlarged, and it needs to further determine the blocking factor that the current amplification range cannot be enlarged when the starting split screen image is extended along the current adjustment direction, and then S307 may be executed.

S306, forming current adjustment path information of the starting point split screen picture based on the current adjustment direction and the current amplification amplitude, and executing S309.

In this embodiment, when the extension distance extending the current amplification degree in the current adjustment direction is less than or equal to the maximum allowable distance, which indicates that the current amplification degree can be directly amplified in the current adjustment direction, the current adjustment direction and the current amplification degree are recorded to form the current adjustment path information of the starting point split screen picture.

S307, judging whether other blocked split screen images exist in the current adjustment direction based on the current amplification amplitude adjustment, if so, executing S308; if not, go to S310.

In this embodiment, when the extension distance extending the current zoom size in the current adjustment direction is greater than the maximum allowable distance, a situation that the current zoom size is obstructed by other split-screen pictures may occur, and it needs to be determined whether there is an obstruction of other split-screen pictures when adjusting based on the current zoom size in the current adjustment direction. Specifically, the determination may be performed through the original display parameter information, the current adjustment direction, and the current magnification amplitude of each split screen image.

Generally, if there is an obstruction of other split screens, the current magnification level may be enlarged by translating the other split screens to cause the starting split screen to zoom in. Specifically, S308 may be performed; otherwise, it indicates that there is no obstacle of other split screen pictures, then S310 is executed.

And S308, determining current adjustment path information for current amplification amplitude adjustment of the starting point split screen picture in the current adjustment direction based on the path adjustment strategy.

In this embodiment, the path adjustment policy may be understood as a policy for adjusting a path taken when there is another split screen that obstructs the starting split screen. When the current amplification degree is adjusted along the current adjustment direction, other split screen image obstacles exist, and the current adjustment path information of the starting split screen image for adjusting the current amplification degree in the current adjustment direction can be determined through the path adjustment strategy.

Further, fig. 3b shows a flow chart of determining current adjustment path information when there is another blocked split screen image according to a third embodiment of the present invention. Specifically, as shown in fig. 3b, the determination of the current adjustment path information when there is an obstruction of other split screens includes the following operations:

and S3081, marking the split screen picture which obstructs the adjustment based on the current amplification degree in the current adjustment direction as an obstructing split screen picture.

In this embodiment, when there is another split screen image that obstructs the split screen image from the starting point to enlarge the current enlargement amount, the split screen image that obstructs the adjustment based on the current enlargement amount in the current adjustment direction may be regarded as an obstructed split screen image.

It can be understood that when there may be more than one split screen image based on the current magnification in the current blocking adjustment direction, one of the split screen images may be sequentially selected as a blocking split screen image according to the first selection order.

S3082, a candidate translation direction set of the blocking split screen image is determined from the adjustment direction information set of the blocking split screen image.

In this embodiment, the set of candidate panning directions may be understood as culling panning directions that conflict with the current adjustment direction. Exemplarily, as shown in fig. 2b, when the fourth split screen picture 5 extends towards the top left corner direction, and there is the second split screen picture 3 above it, the set of candidate panning directions of the second split screen picture 3 needs to be determined. Specifically, the panning directions of the second split screen 3 collectively include: left translation, right translation, and down translation. And the current adjusting direction determined by the downward translation and the starting point split screen picture is as follows: extending the conflict to the upper left vertex angle. The set of candidate panning directions for the second split screen 3 comprises: left translation and right translation.

Generally, after the candidate translation direction set is determined, whether the starting point split screen picture can be enlarged by the current enlargement amplitude in the current adjustment direction through the translation blocking split screen picture can be sequentially determined according to a preset translation sequence.

S3083, sequentially selecting a candidate translation direction as the current translation direction according to a set third selection sequence.

In this embodiment, the third selection order may be understood as an order to be followed when the candidate panning direction selection is performed. The third selection order may be set arbitrarily, as long as the third selection order is followed when the candidate translation direction is selected. Specifically, the third selection sequence may be in a counterclockwise direction or a clockwise direction. The current translation direction may be understood as a translation direction selected in the determining process of the adjustment path information determined this time.

Illustratively, based on S3082, the candidate panning directions of the second split screen 3 include: left translation and right translation. The panning direction may be selected in a clockwise manner starting from the left end, i.e. the left panning is preferably selected as the current panning direction. And after the left translation is selected, determining the right translation as the current translation direction.

And S3084, determining the current translation distance required for preventing the split screen picture from moving in the current translation direction.

In this embodiment, after the current translation direction is determined, it needs to be further determined that when the starting split screen image is enlarged in the current enlargement range along the current adjustment direction, the distance that the split screen image needs to be translated along the current translation direction is blocked, that is: the current translation distance.

S3085, judging whether the current translation distance is smaller than or equal to the maximum allowable translation distance in the current translation direction, if so, executing S3086; if not, then go to S3087 or S3088.

In this embodiment, the maximum allowable translation distance may be understood as a maximum translation distance that is allowed in the current translation direction to prevent the split screen from extending. It will be appreciated that the maximum allowable translation distance may be determined by means of the maximum allowable translation distance. In the process of translation, the situation that the boundary of the display device is reached and other split screen image obstacles exist can be understood as that translation cannot be carried out. Therefore, the maximum allowable translation distance can be further understood as the maximum translation distance corresponding to the situation that the boundary of the display device and the obstacles of other split screens are not met in the process of hindering the split screen from translating.

Generally, after the current translation distance is determined, the current translation distance needs to be compared with the maximum allowable translation distance in the current translation direction. If the translation distance is smaller than or equal to the maximum allowable translation distance, the starting point split screen picture can be enlarged by the current enlargement amplitude in the current adjustment direction through the translation prevention split screen picture along the current translation direction, and S3086 is executed; otherwise, it indicates that the starting point split screen cannot be enlarged in the current adjustment direction by the current enlargement rate, S3087 is executed or S3088 is executed.

S3086, forming current adjustment path information of the starting point split screen picture based on the current adjustment direction, the current amplification amplitude and the current translation distance of each obstacle split screen picture in each current translation direction.

In this embodiment, when the current translation distance is less than or equal to the maximum allowable translation distance in the current translation direction, the current adjustment direction, the current amplification degree, and the current translation distance of each currently determined blocked split screen picture in each current translation direction are recorded to form current adjustment path information of the starting split screen picture.

S3087, whether the translation of the split screen picture in the current translation direction reaches the screen boundary of the display device is hindered, and if yes, S3089 is executed.

In this embodiment, when the current panning distance is greater than the maximum allowable panning distance of the current panning direction, it is necessary to further determine whether the current panning distance is due to reaching the screen boundary of the display device. If reaching the screen boundary of the display device can be understood as that the starting split screen picture cannot be enlarged any more along the current adjustment direction, the determination in the current adjustment direction needs to be ended. Namely: s3089 is performed.

Specifically, whether the translation of the blocked split screen picture in the current translation direction reaches the screen boundary of the display device may be determined based on the original display parameter information, the screen boundary position information, the current translation direction, and the current magnification magnitude of the blocked split screen picture.

S3088, whether other screen splitting picture obstacles exist in the process of hindering the screen splitting picture to translate in the current translation direction, and if yes, S3090 is executed.

In this embodiment, when the current panning distance is greater than the maximum allowable panning distance of the current panning direction, it needs to further determine whether panning of the split screen picture is hindered due to the presence of other split screen pictures. If there is another split screen that obstructs the panning of the split screen, S3090 needs to be performed.

Specifically, whether other split screen image obstacles exist to hinder the split screen image from translating in the current translation direction may be determined based on the original display parameter information, the screen boundary position information, the current translation direction, and the current magnification amplitude of each split screen image.

And S3089, determining the adjustment path of the starting point split screen picture in the current adjustment direction.

In this embodiment, when the split screen image is prevented from being translated in the current translation direction to reach the screen boundary of the display device, which indicates that the current adjustment direction may not be capable of performing the extended adjustment, the determination of the starting split screen image in the current adjustment direction is finished, and S311 is continuously performed.

S3090, the split screen in which the obstructing split screen is translated in the current translation direction is determined as a new obstructing split screen, and S3082 is performed.

In this embodiment, when there is a barrier to other split-screen images in the barrier to the split-screen image from translating in the current translation direction, it needs to be further determined whether the other split-screen images can be translated, so that the start split-screen image can enlarge the current enlargement range along the current adjustment direction. Specifically, a split screen in which the obstructing split screen is translated in the current translation direction is determined as a new obstructing split screen, and S3082 is performed.

S309, determining the adjustment optimization rate of the current adjustment path information according to the current adjustment path information and the set optimization rate formula, and executing S304.

In this embodiment, after determining the current adjustment path information, the adjustment optimization rate needs to be determined according to a set optimization rate formula, so as to select the target adjustment path information. The set optimization rate formula can be as follows:

the current extension amplitude of the initial split screen picture subjected to extension amplification can be reduced by 1.

And S310, determining an adjusting path of the starting point split screen picture in the current adjusting direction.

It is understood that after the start split screen picture, the current adjustment direction and the current zoom-in magnitude are selected, the executed S305, S307 and S310 can be understood as three nested layers of loops. It can be understood that, when the extended distance adjusted based on the current magnification in the current adjustment direction is greater than the maximum allowable distance and there is no obstacle of other split screens when adjusted based on the current magnification in the current adjustment direction, it can be understood that the screen boundary of the display device is reached when adjusted based on the current magnification in the current adjustment direction, and then the determination of the adjustment path of the starting split screen in the current adjustment direction is finished.

S311, judging whether the adjusting direction determined in the adjusting direction information set is the last adjusting direction in the second selection sequence, if so, executing S312; if not, go to S303.

In this embodiment, after the adjustment path of the starting point split screen image in the current adjustment direction is determined, it needs to be determined whether all the adjustment directions determined in the adjustment direction information set are selected completely. If all the selection is finished, S312 needs to be executed; otherwise, S303 is performed.

S312, judging whether the determined starting split screen picture in each split screen picture is the last starting split screen picture in the first selection sequence, if so, executing S313; if not, go to step S302.

In this embodiment, when the current adjustment direction is the last adjustment direction in the second selection order, it needs to further determine whether the starting split screen picture determined in each split screen picture is the last starting split screen picture in the first selection order, that is: and whether each split screen picture is selected and finished.

And S313, acquiring adjustment path information and adjustment optimization rate corresponding to each starting point split screen picture.

In this embodiment, if each split screen image is selected, the current adjustment path information and the corresponding adjustment optimization rate need to be summarized to obtain the adjustment path information and the adjustment optimization rate corresponding to each starting split screen image.

And S314, determining the adjustment path information corresponding to the highest adjustment optimization rate as target adjustment path information, and adjusting the display layout of each split screen picture according to the target adjustment path information and each original display parameter information.

The third method for adjusting the layout of split screens according to the embodiment of the present invention embodies obtaining, according to each set of adjustment direction information, adjustment path information corresponding to each split screen as a starting split screen, and determines an adjustment optimization rate of each adjustment path information. By using the method, the starting point split screen picture, the current adjusting direction and the current amplifying amplitude can be sequentially selected through multiple cycles to obtain the adjusting path information and the adjusting optimization rate corresponding to each starting point picture. Therefore, the display layout of each split screen picture can be adjusted according to the determined target adjustment path information and the determined original display parameter information, and each split screen picture is displayed in a maximized mode when being displayed in a split screen mode, so that the effect of fully utilizing the display space of the screen of the display equipment is achieved. And then the advantage of large screen is fully exerted when split screen display is carried out, and the user experience of the display function of the display equipment is improved.

Example four

Fig. 4 is a block diagram of a layout adjustment apparatus for split screens according to a fourth embodiment of the present invention. The device is suitable for adjusting the layout of the split screen picture during split screen display, wherein the device can be realized by software and/or hardware and is generally integrated on a display device with a display screen. As shown in fig. 4, the apparatus includes: an information set determination module 41, an optimization rate determination module 42, and a display layout adjustment module 43.

The information set determining module 41 is configured to determine, after triggering entry into a layout adjustment mode, an adjustment direction information set of each split screen image according to currently acquired original display parameter information of each split screen image;

an optimization rate determining module 42, configured to obtain, according to each adjustment direction information set, adjustment path information corresponding to each split-screen image as a starting split-screen image, and determine an adjustment optimization rate of each adjustment path information;

and a display layout adjusting module 43, configured to determine adjustment path information corresponding to the highest adjustment optimization rate as target adjustment path information, and adjust the display layout of each split screen image according to the target adjustment path information and each piece of original display parameter information.

In this embodiment, the apparatus first determines an adjustment direction information set of each of the split screens through the information set determining module 41; then, an optimization rate determining module 42 obtains corresponding adjustment path information when each split screen picture is taken as a starting split screen picture, and determines an adjustment optimization rate of each adjustment path information; finally, the display layout of each of the split screens is adjusted by the display layout adjusting module 43.

The layout adjusting device for split-screen pictures provided by the fourth embodiment of the invention can maximize the display of each split-screen picture by adjusting the display layout of each split-screen picture when split-screen display is performed, so as to fully utilize the display space of the screen of the display device, further exert the advantage of a large screen when split-screen display is performed, and improve the user experience of the display function of the display device.

Further, the device optimizes the original display parameter information of the split screen picture, including: original position information of each picture boundary in the split screen picture in the display equipment; correspondingly, the information set determining module 41 is specifically configured to: according to screen boundary position information of display equipment and original position information of each picture boundary in each split screen picture, determining a translation direction set and a vertex angle extension direction set of each split screen picture, and recording the translation direction set and the vertex angle extension direction set as adjustment direction information sets of the corresponding split screen pictures.

On the basis of the above optimization, the information set determining module 41 is further specifically configured to: comparing the original position information of each picture boundary in each split screen picture with the position information of the screen boundary; determining the translatable direction along the picture boundary and the extendable direction along the picture vertex angle in each split-screen picture according to the comparison result; and forming a translation direction set containing a corresponding translatable direction and a vertex extending direction set containing a corresponding extendable direction of each split screen picture.

Further, the optimization rate determining module 42 includes:

the starting point picture selecting unit is used for sequentially selecting one split screen picture as a starting point split screen picture according to a set first selecting sequence;

the current direction selection unit is used for sequentially determining a current adjustment direction from the adjustment direction information set of the starting point split screen picture according to a set second selection sequence;

a current amplitude selecting unit, configured to sequentially determine a current amplification amplitude according to a preset step length in the current adjustment direction;

a maximum distance determination unit, configured to form current adjustment path information of the starting point split screen image based on the current adjustment direction and the current amplification degree when an extension distance adjusted based on the current amplification degree in the current adjustment direction is less than or equal to a maximum allowable distance, and determine an adjustment optimization rate of the current adjustment path information according to the current adjustment path information and a set optimization rate formula;

an obstructed picture judging unit, configured to, when there is an obstruction of another split-screen picture during adjustment based on the current amplification degree in the current adjustment direction, determine, based on a path adjustment policy, current adjustment path information of the starting split-screen picture for performing the current amplification degree adjustment in the current adjustment direction, and determine an adjustment optimization rate of the current adjustment path information according to the current adjustment path information and a set optimization rate formula;

and the screen boundary judging unit is used for finishing the determination of the adjustment path of the starting point split screen picture in the current adjustment direction when the screen boundary of the display device is reached in the current adjustment direction based on the current amplification degree adjustment.

Further, the obstructed-screen determining unit is specifically configured to: recording a split screen picture which obstructs the adjustment based on the current amplification degree in the current adjustment direction as an obstructed split screen picture; determining a candidate translation direction set of the blocked split screen picture from the adjustment direction information set of the blocked split screen picture; sequentially selecting a candidate translation direction as a current translation direction according to a set third selection sequence; determining a current translation distance required by the blocked split screen picture in the current translation direction; if the current translation distance is smaller than or equal to the maximum allowed translation distance of the current translation direction, current adjustment path information of the starting point split screen picture is formed on the basis of the current adjustment direction, the current amplification amplitude and the current translation distance of each blocked split screen picture in each current translation direction; otherwise, when the blocked split screen picture is translated in the current translation direction and other split screen picture blocks exist, determining the split screen picture blocking the blocked split screen picture to be translated in the current translation direction as a new blocked split screen picture, and returning to the determination operation of the candidate translation direction set for re-execution; or, when the hindered split screen picture is translated in the current translation direction to reach the screen boundary of the display device, ending the determination of the adjustment path of the starting split screen picture in the current adjustment direction.

On the basis of the above optimization, the display layout adjustment module 43 is specifically configured to: determining the highest adjustment optimization rate from the adjustment optimization rates of the adjustment path information, and acquiring target adjustment path information corresponding to the highest adjustment optimization rate; determining extension information or translation information of each split screen picture according to the target adjustment path information; determining the current display parameter information of each split screen picture on the display equipment according to the original display parameter information of each split screen picture and corresponding extension information or translation information; and adjusting the display layout of each split screen picture based on each current display parameter information.

Further, the device also optimally comprises: a to-be-accessed picture processing module 44 and an instruction triggering processing module 45;

the to-be-accessed picture processing module 44 is configured to access a new split screen picture and determine original display parameter information of each split screen picture based on a current display layout of each split screen picture in the display device when it is monitored that there is a split screen picture to be accessed that triggers the entry into the layout adjustment mode and the current access total is smaller than an access threshold.

And the instruction triggering processing module 45 is configured to determine, when entering the layout adjustment mode according to an optimization adjustment instruction triggered by a user, original display parameter information of each split screen image directly based on a current display layout of each split screen image in the display device.

Further, the device also optimally comprises: and a split-screen picture display module 46, configured to decode video data sent by the source device corresponding to each split-screen picture, and refresh and display each video data in a corresponding split-screen picture.

The product can execute the method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.

EXAMPLE five

Fig. 5 is a schematic diagram of a hardware structure of a display device according to a fifth embodiment of the present invention, and as shown in fig. 5, the display device according to the fifth embodiment of the present invention includes: a display screen 51, a processor 52 and a storage device 53. The number of the processors 52 in the display device may be one or more, one processor 52 is taken as an example in fig. 5, the display screen 51 in the display device may be connected to the processor 52 and the storage device 53 through a bus or in another way, respectively, and the processor 52 and the storage device 53 are also connected through a bus or in another way, which is taken as an example in fig. 5.

In the present embodiment, the processor 52 in the display device may control the display screen 51 to display the split screen, and the content displayed on the display screen 51 may be stored in the storage device 53.

The storage device 53 in the display apparatus, which is a computer-readable storage medium, can be used to store one or more programs, such as software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the layout adjustment method of the split screen in the embodiment of the present invention (for example, the modules in the layout adjustment device of the split screen shown in fig. 4 include the information set determination module 41, the optimization rate determination module 42, and the display layout adjustment module 43). The processor 52 executes various functional applications and data processing of the display device by running software programs, instructions and modules stored in the storage device 53, that is, implements the layout adjustment method of the split screen in the above-described method embodiment.

The storage device 53 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the device, and the like. Further, the storage 53 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the storage 53 may further include memory located remotely from the processor 52, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

And, when one or more programs included in the above-described display device are executed by the one or more processors 52, the programs perform the following operations:

after triggering and entering a layout adjustment mode, determining an adjustment direction information set of each split screen picture according to the currently acquired original display parameter information of each split screen picture; according to each adjustment direction information set, obtaining corresponding adjustment path information when each split screen picture is taken as a starting split screen picture, and determining the adjustment optimization rate of each adjustment path information; and determining the adjustment path information corresponding to the highest adjustment optimization rate as target adjustment path information, and adjusting the display layout of each split screen picture according to the target adjustment path information and each original display parameter information.

Furthermore, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a control device, implements a method for adjusting a layout of a split screen image according to the first, second, or third embodiment of the present invention, where the method includes: after triggering and entering a layout adjustment mode, determining an adjustment direction information set of each split screen picture according to the currently acquired original display parameter information of each split screen picture; according to each adjustment direction information set, obtaining corresponding adjustment path information when each split screen picture is taken as a starting split screen picture, and determining the adjustment optimization rate of each adjustment path information; and determining the adjustment path information corresponding to the highest adjustment optimization rate as target adjustment path information, and adjusting the display layout of each split screen picture according to the target adjustment path information and each original display parameter information.

From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A layout adjustment method for a split screen image is characterized by comprising the following steps:

2. The method of claim 1, wherein the original display parameter information of the split screen comprises: original position information of each picture boundary in the split screen picture in the display equipment;

correspondingly, the determining an adjustment direction information set of each split screen image according to the currently acquired original display parameter information of each split screen image includes:

according to screen boundary position information of display equipment and original position information of each picture boundary in each split screen picture, determining a translation direction set and a vertex angle extension direction set of each split screen picture, and recording the translation direction set and the vertex angle extension direction set as adjustment direction information sets of the corresponding split screen pictures.

3. The method according to claim 2, wherein the determining the panning direction set and the vertex extending direction set of each split screen picture according to the screen boundary position information of the display device and the original position information of each picture boundary in each split screen picture comprises:

comparing the original position information of each picture boundary in each split screen picture with the position information of the screen boundary;

determining the translatable direction along the picture boundary and the extendable direction along the picture vertex angle in each split-screen picture according to the comparison result;

and forming a translation direction set containing a corresponding translatable direction and a vertex extending direction set containing a corresponding extendable direction of each split screen picture.

4. The method of claim 1, wherein the obtaining adjustment path information corresponding to each split screen image as a starting split screen image according to each adjustment direction information set, and determining an adjustment optimization rate of each adjustment path information comprises:

sequentially selecting a split screen picture as a starting split screen picture according to a set first selection sequence;

determining a current adjustment direction from the adjustment direction information sets of the starting point split screen pictures in sequence according to a set second selection sequence;

sequentially determining the current amplification amplitude according to a preset step length in the current adjustment direction;

if the extended distance adjusted based on the current amplification amplitude in the current adjustment direction is smaller than or equal to the maximum allowable distance, forming current adjustment path information of the starting point split screen picture based on the current adjustment direction and the current amplification amplitude, and determining the adjustment optimization rate of the current adjustment path information according to the current adjustment path information and a set optimization rate formula;

if the current adjustment direction is blocked by other split screen pictures during adjustment based on the current amplification degree, determining current adjustment path information of the starting split screen picture for performing the current amplification degree adjustment in the current adjustment direction based on a path adjustment strategy, and determining the adjustment optimization rate of the current adjustment path information according to the current adjustment path information and a set optimization rate formula;

and if the screen boundary of the display device is reached when the current magnification adjustment is carried out in the current adjustment direction, ending the determination of the adjustment path of the starting point split screen picture in the current adjustment direction.

5. The method of claim 4, wherein determining current adjustment path information for the current magnification adjustment of the starting split screen in the current adjustment direction based on a path adjustment policy comprises:

recording a split screen picture which obstructs the adjustment based on the current amplification degree in the current adjustment direction as an obstructed split screen picture;

determining a candidate translation direction set of the blocked split screen picture from the adjustment direction information set of the blocked split screen picture;

sequentially selecting a candidate translation direction as a current translation direction according to a set third selection sequence;

determining a current translation distance required by the blocked split screen picture in the current translation direction;

if the current translation distance is smaller than or equal to the maximum allowed translation distance of the current translation direction, current adjustment path information of the starting point split screen picture is formed on the basis of the current adjustment direction, the current amplification amplitude and the current translation distance of each blocked split screen picture in each current translation direction; if not, then,

when the blocked split screen picture is translated in the current translation direction and other split screen picture blocks exist, determining the split screen picture blocking the blocked split screen picture to be translated in the current translation direction as a new blocked split screen picture, and returning to the determination operation of the candidate translation direction set for re-execution; alternatively, the first and second electrodes may be,

and when the translation of the blocked split screen picture in the current translation direction reaches the screen boundary of the display device, finishing the determination of the adjustment path of the starting split screen picture in the current adjustment direction.

6. The method according to claim 1, wherein the determining adjustment path information corresponding to the highest adjustment optimization rate as target adjustment path information, and adjusting the display layout of each split screen image according to the target adjustment path information and each piece of original display parameter information includes:

determining the highest adjustment optimization rate from the adjustment optimization rates of the adjustment path information, and acquiring target adjustment path information corresponding to the highest adjustment optimization rate;

determining extension information or translation information of each split screen picture according to the target adjustment path information;

determining the current display parameter information of each split screen picture on display equipment according to the original display parameter information of each split screen picture and corresponding extension information or translation information;

and adjusting the display layout of each split screen picture based on each current display parameter information.

7. The method according to claim 1, before determining the adjustment direction information set of each split screen image according to the original display parameter information of each split screen image currently acquired, further comprising:

if the situation that split screen pictures to be accessed are triggered to enter the layout adjustment mode and the current access total number is smaller than the access threshold value is monitored, accessing new split screen pictures and determining the original display parameter information of each split screen picture based on the current display layout of each split screen picture in display equipment;

and if the layout adjustment mode is triggered to enter according to an optimization adjustment instruction triggered by a user, determining the original display parameter information of each split screen picture directly based on the current display layout of each split screen picture in the display equipment.

8. The method according to claim 1, further comprising, after the adjusting the display layout of each of the split screens:

and decoding video data sent by source equipment corresponding to each split screen picture, and refreshing and displaying each video data in the corresponding split screen picture.

9. A layout adjustment device for split screen images, comprising:

10. A display device, comprising: display screen, its characterized in that still includes:

one or more processors;

storage means for storing one or more programs;

the one or more programs are executed by the one or more processors to cause the one or more processors to implement the layout adjustment method of the split screen as recited in any one of claims 1 to 8.

11. A computer-readable storage medium on which a computer program is stored, the program, when executed by a processor, implementing a method of adjusting a layout of a split screen according to any one of claims 1 to 8.