CN114222188A - Full-screen display method, device and equipment based on rotary screen and storage medium - Google Patents
Full-screen display method, device and equipment based on rotary screen and storage medium Download PDFInfo
- Publication number
- CN114222188A CN114222188A CN202111638170.9A CN202111638170A CN114222188A CN 114222188 A CN114222188 A CN 114222188A CN 202111638170 A CN202111638170 A CN 202111638170A CN 114222188 A CN114222188 A CN 114222188A
- Authority
- CN
- China
- Prior art keywords
- video
- screen
- full
- display
- user side
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000005520 cutting process Methods 0.000 claims abstract description 49
- 238000012545 processing Methods 0.000 claims abstract description 33
- 238000012163 sequencing technique Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 abstract description 19
- 230000006870 function Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000009365 direct transmission Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N21/4438—Window management, e.g. event handling following interaction with the user interface
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention belongs to the technical field of equipment display, and discloses a full-screen display method, a full-screen display device, full-screen display equipment and a storage medium based on a rotary screen. The method comprises the steps that when a user side is in a vertical screen projection state, video data sent by the user side are received; decoding the video data to obtain decoded video data; cutting the decoded video data to obtain a video to be rotated; obtaining a video to be played according to the rotation angle of the display equipment and the video to be rotated; and displaying the video to be played in a full screen mode according to the video to be played. By the mode, the vertical screen video of the user side is projected to the display device to be played in a full screen mode, the part of the display image in the source video is stripped to be played in the full screen mode on the rotatable display device through a cutting and rotating means, the watching experience of a user is improved, and the display device side completes all processing processes, so that the requirements on the device of the user side where the video source is located are lowered, and the adaptability of the display device is improved.
Description
Technical Field
The invention relates to the technical field of equipment display, in particular to a full-screen display method, a full-screen display device, full-screen display equipment and a storage medium based on a rotary screen.
Background
Along with the continuous development of equipment display technology, rotatable display device steps into the scene of daily use gradually, for example in the domestic TV field, rotatable TV possesses very big advantage in short video display scene, this is because along with the popularization of vertical video such as short video in the mobile display terminal, when mobile display terminal with vertical video projection to traditional TV in, thereby traditional TV can't rotate and lead to the unable vertical video of adaptation of screen to lead to a large amount of whiteouts, influence and watch experience, and rotatable TV passes through the rotatory screen and lets vertical video also can have fine broadcast effect.
However, in the video processing process, if the mobile phone is mirrored in the vertical screen, the effective range of the video on the horizontal screen display device is only the middle part, and both sides are black edges. Therefore, how to still display the video on the mobile terminal in a full screen mode without considering the rotation state of the mobile phone becomes a problem to be solved urgently.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a full-screen display method, a full-screen display device, full-screen display equipment and a full-screen display storage medium based on a rotary screen, and aims to solve the technical problem that in the prior art, a video on a mobile terminal is still displayed in a full-screen mode under the condition that the rotary state of a mobile phone is not considered.
In order to achieve the above object, the present invention provides a full screen display method based on a rotary screen, comprising the following steps:
when the user side is in a vertical screen projection state, receiving video data sent by the user side;
decoding the video data to obtain decoded video data;
cutting the decoded video data to obtain a video to be rotated;
acquiring a rotation angle of the current display equipment;
obtaining a video to be played according to the rotation angle of the display equipment and the video to be rotated;
and displaying the video to be played in a full screen mode according to the video to be played.
Optionally, the cutting the decoded video data to obtain a video to be rotated includes:
determining pixel information of a video frame according to the decoded video data;
determining a clipping column of the video frame according to the pixel information;
and cutting the video frame according to the cutting column to obtain a video to be rotated.
Optionally, the determining the clipping column of the video frame according to the pixel information includes:
calculating a first non-full black column in a first preset direction and a first non-full black column in a second preset direction;
and determining a cutting column according to the first non-full black column in the first preset direction and the first non-full black column in the second preset direction.
Optionally, the determining a clipping column according to the first non-full black column in the first preset direction and the first non-full black column in the second preset direction includes:
sequencing pixel columns from small to large along a first preset direction to obtain the serial number of each pixel column;
if the serial number of the pixel row where the first non-full black row in the first preset direction is located is larger than a first preset serial number and the first non-full black row in the second preset direction is smaller than a second preset serial number, generating a cutting area according to the first non-full black row in the first preset direction and the first non-full black row in the second preset direction, wherein the first preset serial number is smaller than the second preset serial number;
and if the proportion of the black pixel points in the cutting area is greater than the preset proportion, generating a cutting line according to a first non-full black line in a first preset direction and a first non-full black line in a second preset direction.
Optionally, the obtaining the video to be played according to the rotation angle of the display device and the video data to be rotated includes:
determining the rotation angle of the video to be rotated according to the rotation angle of the display equipment;
and when the rotation angle of the display equipment is a preset angle, performing rotation processing on the video to be rotated according to the rotation angle of the video to be rotated to obtain the video to be played.
Optionally, when the user side is in the vertical screen projection state, before receiving the video data sent by the user side, the method further includes:
detecting the video type of a user side when the user side performs projection;
when the video type of the user side is a vertical screen video, generating a screen rotation instruction;
and finishing the vertical screen operation according to the screen rotation instruction and judging that the user side is in a vertical screen projection state.
Optionally, when the user side is in the vertical screen projection state, before receiving the video data sent by the user side, the method further includes:
when a user side performs projection, acquiring current memory information of the user;
identifying the current application information of the user side according to the memory information;
sending the current application information to a cloud server so that the cloud server feeds back a program type corresponding to the current application information;
when the program type is a vertical screen video type, generating a screen rotation instruction;
and finishing the vertical screen operation according to the screen rotation instruction and judging that the user side is in a vertical screen projection state.
In addition, in order to achieve the above object, the present invention further provides a full screen display device based on a rotary screen, including:
the acquisition module is used for receiving video data sent by a user side when the user side is in a vertical screen projection state;
the processing module is used for decoding the video data to obtain decoded video data;
the processing module is further used for cutting the decoded video data to obtain a video to be rotated;
the acquisition module is also used for acquiring the rotation angle of the current display equipment;
the processing module is further used for obtaining a video to be played according to the rotation angle of the display device and the video to be rotated;
and the control module is used for carrying out full-screen display according to the video to be played.
In addition, in order to achieve the above object, the present invention further provides a full screen display device based on a rotary screen, including: memory, a processor and a full screen rotary screen based display program stored on the memory and executable on the processor, the full screen rotary screen based display program being configured to implement the steps of the full screen rotary screen based display method as described above.
In addition, in order to achieve the above object, the present invention further provides a storage medium, where a full-screen display program based on a rotary screen is stored, and the full-screen display program based on a rotary screen, when executed by a processor, implements the steps of the full-screen display method based on a rotary screen as described above.
When a user side is in a vertical screen projection state, receiving video data sent by the user side; decoding the video data to obtain decoded video data; cutting the decoded video data to obtain a video to be rotated; acquiring a rotation angle of the current display equipment; obtaining a video to be played according to the rotation angle of the display equipment and the video to be rotated; and displaying the video to be played in a full screen mode according to the video to be played. By the mode, the vertical screen video of the user side is projected to the display device to be played in a full screen mode, the part of the display image in the source video is stripped to be played in the full screen mode on the rotatable display device through a cutting and rotating means, the watching experience of a user is improved, and the display device side completes all processing processes, so that the requirements on the device of the user side where the video source is located are lowered, and the adaptability of the display device is improved.
Drawings
FIG. 1 is a schematic diagram of a full screen display device based on a rotary screen in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a full screen display method based on a rotary screen according to a first embodiment of the present invention;
FIG. 3 is a schematic diagram of a horizontal screen displaying vertical screen image according to an embodiment of a full-screen display method based on a rotary screen;
FIG. 4 is a schematic diagram of a vertical screen image display method according to an embodiment of the full-screen display method based on a rotating screen;
FIG. 5 is a flowchart illustrating a full screen display method based on a rotary screen according to a second embodiment of the present invention;
FIG. 6 is a block diagram of a full-screen display device based on a rotary screen according to a first embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a full-screen display device based on a rotary screen in a hardware operating environment according to an embodiment of the present invention.
As shown in fig. 1, the full screen display device based on a rotary screen may include: a processor 1001, such as a Central Processing Unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (Wi-Fi) interface). The Memory 1005 may be a Random Access Memory (RAM) Memory, or may be a Non-Volatile Memory (NVM), such as a disk Memory. The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the configuration shown in FIG. 1 does not constitute a limitation of a full screen rotary screen-based display device, and may include more or fewer components than shown, or some components in combination, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a storage medium, may include therein an operating system, a network communication module, a user interface module, and a full screen display program based on a rotary screen.
In the full screen rotary screen-based display device shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 of the full-screen display device based on the rotary screen can be arranged in the full-screen display device based on the rotary screen, and the full-screen display device based on the rotary screen calls a full-screen display program based on the rotary screen stored in the memory 1005 through the processor 1001 and executes the full-screen display method based on the rotary screen provided by the embodiment of the invention.
An embodiment of the present invention provides a full screen display method based on a rotary screen, and referring to fig. 2, fig. 2 is a flowchart illustrating a full screen display method based on a rotary screen according to a first embodiment of the present invention.
In this embodiment, the full-screen display method based on the rotary screen includes the following steps:
step S10: and when the user side is in a vertical screen projection state, receiving video data sent by the user side.
It should be noted that the execution main body of this embodiment is a rotatable display device, the rotatable display device may be a rotatable display, or may be other rotatable display devices having the same or similar functions as the rotatable display, and the representation form of the rotatable display device is not limited in this embodiment. The rotatable display can be an intelligent television integrating display and decoding, and can also be a device group consisting of a display device only used for playing videos and an intelligent box.
It should be noted that, in the process of projecting the vertical screen video to the display device when the user terminal (e.g. mobile phone) plays the vertical screen video, because the traditional display device is limited by the screen size, the vertical screen video on the user terminal cannot be normally displayed in full screen, and the full screen video is intelligently displayed by means of sacrificing the viewing effect through tiling or stretching, and nowadays when the mobile terminal uses a heavier and heavier specific gravity, the display terminal often needs to be compatible with the function of the mobile terminal, so the full screen video can be displayed in full screen by rotating the display device to rotate the screen to the vertical screen state, in this scenario, after the transmitted video data is decoded for the vertical screen video, the rotation and cutting processing are performed, the processing flow computation is small and fast, and all the processes are implemented on the display device, the compatibility to the device at the user terminal is high, and the mobile terminal does not need to have decoding or video processing capability, only a data source is provided. For example: the user wants to send the short video on the mobile phone to the television or project the short video on the television, the television detects that the video needs to be played in a vertical screen mode, namely the state of the television is adjusted to be in a vertical state, and the short video is played in a full screen mode. Similarly, the video shot by the mobile phone is played on the television only by sending the video to the television and playing the video on the vertical screen. In order to solve the full screen experience of mirroring the vertical screen content on the vertical screen display device, the embodiment aims to provide a scheme for full screen display on a platform, which is adapted to the screen ratio of the user side interface, so that the picture can occupy the whole screen, and a better picture effect experience is brought.
It can be understood that the user end may be a mobile phone, a notebook computer, a tablet computer, a wearable display device, and the like, and the device represented by the user end is not limited in this embodiment. Wherein, the judgment process of user side video projection function can be for a plurality of, can regard the user side as the projection of erecting the screen according to video content, for example: when the sent video is a short video or a vertical screen display video, the user terminal is determined to project on the vertical screen, and when a specific vertical screen function instruction sent by the user terminal is received, the user terminal is determined to enter a vertical screen projection state.
In this embodiment, the manner of identifying the vertical screen projection of the user side may be as follows, for example: detecting the video type of a user side when the user side performs projection; when the video type of the user side is a vertical screen video, generating a screen rotation instruction; and finishing the vertical screen operation according to the screen rotation instruction and judging that the user side is in a vertical screen projection state.
Specifically, in the actual use process, the size of the display area of many videos is consistent with that of the vertical screen display, for example, 9: 16, the whole picture is a horizontal screen picture, for example, as shown in fig. 3, because the video is set or changed in the process of generation or transmission for more equipment to watch, so the optimal display mode in this case is to display the image display area in fig. 3 on the vertical screen in full screen, and therefore it is more reasonable to determine whether to enter the vertical screen projection mode according to the video type, and the video is automatically played to the most appropriate effect.
In this embodiment, the method for identifying the vertical screen projection of the user side may further include: when a user side performs projection, acquiring current memory information of the user; identifying the current application information of the user side according to the memory information; sending the current application information to a cloud server so that the cloud server feeds back a program type corresponding to the current application information; when the program type is a vertical screen video type, generating a screen rotation instruction; and finishing the vertical screen operation according to the screen rotation instruction and judging that the user side is in a vertical screen projection state.
It should be noted that, by obtaining the current memory information of the user side, the use information of the user side can be obtained, and then the current foreground or background running program information of the user can be obtained, and according to the foreground or background running program information, what kind of line programs or pictures the user needs to screen can be obtained, for example: the short video program can be regarded as a program of a vertical screen display type, or some programs have functions of horizontal screen display and types of vertical screen display, so that the program can be judged in which function type according to the memory information, and then the user side is regarded as a projection state of the vertical screen, and the display device can be controlled to enter the projection function of the vertical screen.
In addition, since the local storage program type consumes resources, data of various program types can be stored in the cloud server, and when the device needs to query the program type, a request is sent to the cloud server.
Step S20: and decoding the video data to obtain decoded video data.
It can be understood that the process of mirror image screen projection is a process in which a user terminal (a mobile phone or a notebook) encodes video data and then transmits the video data to a receiving terminal (a rotatable television, a television box, a rotatable display and the like) for decoding and displaying. Therefore, it is necessary to decode the video data to obtain decoded video data.
Step S30: and cutting the decoded video data to obtain a video to be rotated.
It should be noted that, as shown in fig. 3, the video of the portrait orientation is displayed in the landscape state, such as the image area 9: 16, both sides have a large amount of black screen regions, if direct transmission to rotatable display device and show on the screen, because both sides itself have black screen region 1, then the condition in figure 4 can appear, also can appear black screen region 2 about promptly, consequently need cut off both sides black screen image and let the image display region can adapt to the vertical screen, carry out full screen display. Because the cutting process is carried out on the display equipment, the sending end of the equipment is not required to carry out any processing before encoding, and the proper image can be generated and displayed in a self-adaptive manner only by transmitting the original video to the rotary display equipment.
Step S40: and acquiring the rotation angle of the current display equipment.
It can be understood that most rotatable display devices at present rotate the display module through a combination of a motor and a transmission, so that the rotation angle of the display device can be obtained according to the rotation number of the motor and the transmission ratio of the transmission device.
Step S50: and obtaining the video to be played according to the rotation angle of the display equipment and the video to be rotated.
It should be noted that, the video should be kept in the same direction as the display when the video is not rotated during normal playing, but the display can reach the vertical screen state through rotation (rotation by plus 90 ° or minus 90 °), so that the playing video is tilted at this time, and the video to be displayed needs to be rotated in the opposite direction by a certain degree to meet the viewing requirement of the current user. For example: when the display device is rotated 90 ° clockwise to achieve the vertical screen state, the original image needs to be rotated 90 ° counterclockwise to meet the viewing requirements of the viewer.
In the embodiment, the rotation angle of the video to be rotated is determined according to the rotation angle of the display device; and when the rotation angle of the display equipment is a preset angle, performing rotation processing on the video to be rotated according to the rotation angle of the video to be rotated to obtain the video to be played.
In concrete implementation, the preset angle is generally plus 90 degrees or minus 90 degrees, namely when the rotary display reaches the designated vertical playing position, the rotary video can be rotated, and then played, so that the watching experience of the user is prevented from being influenced by playing without rotating to the right position.
Step S60: and displaying the video to be played in a full screen mode according to the video to be played.
It can be understood that after the video is cut and played, the video to be played can be displayed in a full screen, and at the moment, the user can obtain a complete and comfortable viewing experience.
In this embodiment, when a user side is in a vertical screen projection state, video data sent by the user side is received; decoding the video data to obtain decoded video data; cutting the decoded video data to obtain a video to be rotated; acquiring a rotation angle of the current display equipment; obtaining a video to be played according to the rotation angle of the display equipment and the video to be rotated; and displaying the video to be played in a full screen mode according to the video to be played. By the mode, the vertical screen video of the user side is projected to the display device to be played in a full screen mode, the part of the display image in the source video is stripped to be played in the full screen mode on the rotatable display device through a cutting and rotating means, the watching experience of a user is improved, and the display device side completes all processing processes, so that the requirements on the device of the user side where the video source is located are lowered, and the adaptability of the display device is improved.
Referring to fig. 5, fig. 5 is a flowchart illustrating a full screen display method based on a rotary screen according to a second embodiment of the present invention.
Based on the first embodiment, in the step S30, the full-screen display method based on the rotary screen in this embodiment specifically includes:
step S31: pixel information of a video frame is determined from the decoded video data.
It should be understood that when the mobile phone is also used for erecting the screen and the display device is used for erecting the screen, the effective area also needs to be rotated, and under the condition that no processing is performed, the mirror image display only has a middle area, the experience is poor, and the utilization rate of the screen is too low. If nothing is done, it is as shown in figure 4. The clipping process is located after decoding and before displaying, and on the premise of not influencing the display speed and effect, the scheme requires small calculation amount and is compatible with mobile phone scenes (a night mode and a day mode).
It is understood that each frame of video data is composed of a matrix of pixels, and the pixel information is color information included in each pixel, for example: the mobile phone is vertically screened to display the effect of a horizontal screen, as shown in fig. 3, the effective video area is 607 × 1080, that is, each column of 607 pixels and each row of 1080 pixels, and the format after decoding the video can be in NV21 format, and belongs to YUV420 format, and the storage mode is: store all Y first, then UV interleave store: NV21 is V first and U second. The color of each pixel can be calculated through the above information, for example, how to distinguish a black pixel is calculated by using a conversion formula of RGB and YUV420SP, and Y is 0.299 × B +0.587 × G +0.114 × R +16, so Y is 16, which means that the pixel is black. In this way, pixel information for each video frame can be obtained.
Step S32: and determining a clipping column of the video frame according to the pixel information.
As shown in fig. 3, the clipping column is a pixel column demarcated between the image display area and the black screen area 1, and the pixel column is identified, so that accurate clipping can be performed to obtain an intermediate image display area.
In this embodiment, a preferred scheme for determining a clipping column of a video frame is provided, for example: calculating a first non-full black column in a first preset direction and a first non-full black column in a second preset direction; and determining a cutting column according to the first non-full black column in the first preset direction and the first non-full black column in the second preset direction.
The first preset direction and the second preset direction are the right direction from the left side of the screen and the left direction from the right side of the screen, and the reverse direction is also applicable. The first non-full black column, that is, the first column appearing in the specified direction is not the pixel column of the full black pixel, and the optimization can be performed on the basis, and the first non-full black column is defined as the pixel column in which the proportion of the black pixel appearing in the column for the first time is smaller than the preset proportion, for example: the proportion of the black pixel points in the row is less than 85%.
In a specific implementation, a Y component (with a size w × h — 1920 × 1080) of the decoded frame is obtained, where Y — 16 means that the pixel is black; calculating the number of black pixels in each column, wherein the number of the black pixels is count [ w ]; calculating a first non-all black pixel column in each column, and recording as a cropping column abscissa as cropx; and acquiring [ cropx, 0 ]. U [ w-cropx, w ], wherein w is the image width (unit: pixel) including an image display area and a black screen area, and the pixel columns of all the all-black pixels are collected into an area to be cut for the subsequent cutting step to identify.
In this embodiment, the pixel columns are sorted from small to large along a first preset direction to obtain the serial number of each pixel column; if the serial number of the pixel row where the first non-full black row in the first preset direction is located is larger than a first preset serial number and the first non-full black row in the second preset direction is smaller than a second preset serial number, generating a cutting area according to the first non-full black row in the first preset direction and the first non-full black row in the second preset direction, wherein the first preset serial number is smaller than the second preset serial number; and if the proportion of the black pixel points in the cutting area is greater than the preset proportion, generating a cutting line according to a first non-full black line in a first preset direction and a first non-full black line in a second preset direction. The first preset sequence number refers to a preset sequence number, for example: the 720 th column of pixels.
It should be noted that, the correction cutting can be performed on the basis of the cutting process, so as to improve the accuracy of the cutting process, for example: judging whether the serial number of the pixel column where the first non-full black column in the first preset direction is located is greater than the first preset serial number and whether the first non-full black column in the second preset direction is less than the second preset serial number, such as cropx < (width-height)/2, wherein width and height are respectively the width and height (unit: pixel) of the original picture, cropx is the first non-full black column, and meanwhile, whether the proportion of black pixel points in the clipping column is greater than a preset proportion is determined, for example: the black pixel point in the area is lower than 85%, and the cutting cannot be carried out if the two conditions are met, so that the black part of the effective content is prevented from being cut by system misjudgment; this process of correction is mainly to avoid cropping out the active area, such as in a night mode.
Step S33: and cutting the video frame according to the cutting column to obtain a video to be rotated.
In specific implementation, the video frame is cut according to the cutting column, so that an area to be cut can be accurately cut, and a complete image display area, namely a video with rotation, is obtained.
The embodiment determines pixel information of a video frame according to the decoded video data; determining a clipping column of the video frame according to the pixel information; and cutting the video frame according to the cutting column to obtain a video to be rotated. By the aid of the mode, the video frame is automatically judged according to the pixel information of the video data, an effective image display area is extracted, the cutting area is determined according to the black pixel proportion, accuracy of area identification is improved, the identification mode is simple, the calculation process is quick and effective, and identification efficiency of the display area is improved.
In addition, an embodiment of the present invention further provides a storage medium, where a full-screen display program based on a rotary screen is stored on the storage medium, and when the full-screen display program based on the rotary screen is executed by a processor, the steps of the full-screen display method based on the rotary screen are implemented as described above.
Since the storage medium adopts all technical solutions of all the embodiments described above, at least all the beneficial effects brought by the technical solutions of the embodiments described above are achieved, and are not described in detail herein.
Referring to fig. 6, fig. 6 is a block diagram of a full screen display device based on a rotary screen according to a first embodiment of the present invention.
As shown in fig. 6, the full-screen display device based on a rotary screen according to an embodiment of the present invention includes:
the acquisition module 10 is configured to receive video data sent by a user side when the user side is in a vertical screen projection state;
a processing module 20, configured to decode the video data to obtain decoded video data;
the processing module 20 is further configured to perform clipping processing on the decoded video data to obtain a video to be rotated;
the obtaining module 10 is further configured to obtain a rotation angle of the current display device;
the processing module 20 is further configured to obtain a video to be played according to the rotation angle of the display device and the video to be rotated;
and the control module 30 is used for displaying the full screen according to the video to be played.
It should be understood that the above is only an example, and the technical solution of the present invention is not limited in any way, and in a specific application, a person skilled in the art may set the technical solution as needed, and the present invention is not limited thereto.
The embodiment of the present invention includes that when a user side is in a vertical screen projection state, an obtaining module 10 receives video data sent by the user side; the processing module 20 decodes the video data to obtain decoded video data; the processing module 20 performs cutting processing on the decoded video data to obtain a video to be rotated; the obtaining module 10 obtains a rotation angle of the current display device; the processing module 20 obtains a video to be played according to the rotation angle of the display device and the video to be rotated; the control module 30 performs full-screen display according to the video to be played. By the mode, the vertical screen video of the user side is projected to the display device to be played in a full screen mode, the part of the display image in the source video is stripped to be played in the full screen mode on the rotatable display device through a cutting and rotating means, the watching experience of a user is improved, and the display device side completes all processing processes, so that the requirements on the device of the user side where the video source is located are lowered, and the adaptability of the display device is improved.
In an embodiment, the processing module 20 is further configured to determine pixel information of a video frame according to the decoded video data;
determining a clipping column of the video frame according to the pixel information;
and cutting the video frame according to the cutting column to obtain a video to be rotated.
In an embodiment, the processing module 20 is further configured to calculate a first non-full black column in a first preset direction and a first non-full black column in a second preset direction;
and determining a cutting column according to the first non-full black column in the first preset direction and the first non-full black column in the second preset direction.
In an embodiment, the processing module 20 is further configured to sort the pixel columns from small to large along a first preset direction to obtain sequence numbers of the pixel columns;
if the serial number of the pixel row where the first non-full black row in the first preset direction is located is larger than a first preset serial number and the first non-full black row in the second preset direction is smaller than a second preset serial number, generating a cutting area according to the first non-full black row in the first preset direction and the first non-full black row in the second preset direction, wherein the first preset serial number is smaller than the second preset serial number;
and if the proportion of the black pixel points in the cutting area is greater than the preset proportion, generating a cutting line according to a first non-full black line in a first preset direction and a first non-full black line in a second preset direction.
In an embodiment, the processing module 20 is further configured to determine a rotation angle of the video to be rotated according to the rotation angle of the display device;
and when the rotation angle of the display equipment is a preset angle, performing rotation processing on the video to be rotated according to the rotation angle of the video to be rotated to obtain the video to be played.
In an embodiment, the control module 30 is further configured to detect a video type of a user side when the user side performs projection;
when the video type of the user side is a vertical screen video, generating a screen rotation instruction;
and finishing the vertical screen operation according to the screen rotation instruction and judging that the user side is in a vertical screen projection state.
In an embodiment, the control module 30 is further configured to obtain current memory information of the user when the user performs projection;
identifying the current application information of the user side according to the memory information;
sending the current application information to a cloud server so that the cloud server feeds back a program type corresponding to the current application information;
when the program type is a vertical screen video type, generating a screen rotation instruction;
and finishing the vertical screen operation according to the screen rotation instruction and judging that the user side is in a vertical screen projection state.
Since the present apparatus employs all technical solutions of all the above embodiments, at least all the beneficial effects brought by the technical solutions of the above embodiments are achieved, and are not described in detail herein.
It should be noted that the above-described work flows are only exemplary, and do not limit the scope of the present invention, and in practical applications, a person skilled in the art may select some or all of them to achieve the purpose of the solution of the embodiment according to actual needs, and the present invention is not limited herein.
In addition, the technical details that are not elaborated in this embodiment may refer to a full-screen display method based on a rotary screen provided in any embodiment of the present invention, and are not described herein again.
Further, it is to be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention or portions thereof that contribute to the prior art may be embodied in the form of a software product, where the computer software product is stored in a storage medium (e.g. Read Only Memory (ROM)/RAM, magnetic disk, optical disk), and includes several instructions for enabling a terminal device (e.g. a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A full screen display method based on a rotary screen is characterized in that the full screen display method based on the rotary screen comprises the following steps:
when the user side is in a vertical screen projection state, receiving video data sent by the user side;
decoding the video data to obtain decoded video data;
cutting the decoded video data to obtain a video to be rotated;
acquiring a rotation angle of the current display equipment;
obtaining a video to be played according to the rotation angle of the display equipment and the video to be rotated;
and displaying the video to be played in a full screen mode according to the video to be played.
2. The method of claim 1, wherein the cropping the decoded video data to obtain the video to be rotated comprises:
determining pixel information of a video frame according to the decoded video data;
determining a clipping column of the video frame according to the pixel information;
and cutting the video frame according to the cutting column to obtain a video to be rotated.
3. The method of claim 2, wherein said determining a cropped column of the video frame based on the pixel information comprises:
calculating a first non-full black column in a first preset direction and a first non-full black column in a second preset direction;
and determining a cutting column according to the first non-full black column in the first preset direction and the first non-full black column in the second preset direction.
4. The method of claim 3, wherein determining the clipped column according to the first non-all black column of the first preset direction and the first non-all black column of the second preset direction comprises:
sequencing pixel columns from small to large along a first preset direction to obtain the serial number of each pixel column;
if the serial number of the pixel row where the first non-full black row in the first preset direction is located is larger than a first preset serial number and the first non-full black row in the second preset direction is smaller than a second preset serial number, generating a cutting area according to the first non-full black row in the first preset direction and the first non-full black row in the second preset direction, wherein the first preset serial number is smaller than the second preset serial number;
and if the proportion of the black pixel points in the cutting area is greater than the preset proportion, generating a cutting line according to a first non-full black line in a first preset direction and a first non-full black line in a second preset direction.
5. The method of claim 1, wherein the obtaining the video to be played according to the rotation angle and the video data to be rotated of the display device comprises:
determining the rotation angle of the video to be rotated according to the rotation angle of the display equipment;
and when the rotation angle of the display equipment is a preset angle, performing rotation processing on the video to be rotated according to the rotation angle of the video to be rotated to obtain the video to be played.
6. The method according to any one of claims 1 to 5, wherein before receiving the video data sent by the user terminal when the user terminal is in the portrait projection state, the method further comprises:
detecting the video type of a user side when the user side performs projection;
when the video type of the user side is a vertical screen video, generating a screen rotation instruction;
and finishing the vertical screen operation according to the screen rotation instruction and judging that the user side is in a vertical screen projection state.
7. The method according to any one of claims 1 to 5, wherein before receiving the video data sent by the user terminal when the user terminal is in the portrait projection state, the method further comprises:
when a user side performs projection, acquiring current memory information of the user;
identifying the current application information of the user side according to the memory information;
sending the current application information to a cloud server so that the cloud server feeds back a program type corresponding to the current application information;
when the program type is a vertical screen video type, generating a screen rotation instruction;
and finishing the vertical screen operation according to the screen rotation instruction and judging that the user side is in a vertical screen projection state.
8. A full screen display device based on a rotary screen, characterized in that it comprises:
the acquisition module is used for receiving video data sent by a user side when the user side is in a vertical screen projection state;
the processing module is used for decoding the video data to obtain decoded video data;
the processing module is further used for cutting the decoded video data to obtain a video to be rotated;
the acquisition module is also used for acquiring the rotation angle of the current display equipment;
the processing module is further used for obtaining a video to be played according to the rotation angle of the display device and the video to be rotated;
and the control module is used for carrying out full-screen display according to the video to be played.
9. A full screen display device based on a rotating screen, the device comprising: memory, a processor and a full screen rotary screen-based display program stored on the memory and executable on the processor, the full screen rotary screen-based display program being configured to implement a full screen rotary screen-based display method according to any one of claims 1 to 7.
10. A storage medium having stored thereon a full screen rotary screen-based display program which, when executed by a processor, implements a full screen rotary screen-based display method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111638170.9A CN114222188A (en) | 2021-12-28 | 2021-12-28 | Full-screen display method, device and equipment based on rotary screen and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111638170.9A CN114222188A (en) | 2021-12-28 | 2021-12-28 | Full-screen display method, device and equipment based on rotary screen and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114222188A true CN114222188A (en) | 2022-03-22 |
Family
ID=80706678
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111638170.9A Pending CN114222188A (en) | 2021-12-28 | 2021-12-28 | Full-screen display method, device and equipment based on rotary screen and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114222188A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114938469A (en) * | 2022-05-16 | 2022-08-23 | 深圳康佳电子科技有限公司 | Image processing method and device for camera, camera and display system |
| CN115113838A (en) * | 2022-07-15 | 2022-09-27 | 北京字跳网络技术有限公司 | Display method, device, equipment and medium for screen projection picture |
Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1799252A (en) * | 2003-06-02 | 2006-07-05 | 卡西欧计算机株式会社 | Captured image projection apparatus and captured image correction method |
| CN101277381A (en) * | 2008-04-15 | 2008-10-01 | 北京中星微电子有限公司 | Method and apparatus for processing video image |
| WO2012134352A2 (en) * | 2011-03-28 | 2012-10-04 | Arsenich Svyatoslav Ivanovich | Matrix display, variants thereof and method for manufacturing same |
| CN106454407A (en) * | 2016-10-25 | 2017-02-22 | 广州华多网络科技有限公司 | Video live broadcast method and device |
| US20170249925A1 (en) * | 2014-05-30 | 2017-08-31 | Guangzhou Ucweb Computer Technology Co., Ltd. | Method and device for switching playing mode of a mobile terminal, storage medium and program |
| WO2017185645A1 (en) * | 2016-04-29 | 2017-11-02 | 乐视控股（北京）有限公司 | Portrait full screen playback method, apparatus and mobile playback terminal thereof |
| CN108650542A (en) * | 2018-05-09 | 2018-10-12 | 腾讯科技（深圳）有限公司 | Generate vertical screen video flowing, the method for image procossing, electronic equipment and video system |
| JP2019139697A (en) * | 2018-02-15 | 2019-08-22 | パナソニックＩｐマネジメント株式会社 | Display device, video display system, and video display method |
| CN110267085A (en) * | 2018-03-12 | 2019-09-20 | 青岛海信电器股份有限公司 | A kind of method and device of video processing |
| CN111147911A (en) * | 2019-12-27 | 2020-05-12 | 北京达佳互联信息技术有限公司 | Video clipping method and device, electronic equipment and storage medium |
| CN112887768A (en) * | 2021-01-12 | 2021-06-01 | 京东方科技集团股份有限公司 | Screen projection display method and device, electronic equipment and storage medium |
| CN112995535A (en) * | 2021-02-05 | 2021-06-18 | 北京百度网讯科技有限公司 | Method, apparatus, device and storage medium for processing video |
| CN113206964A (en) * | 2021-04-29 | 2021-08-03 | 深圳康佳电子科技有限公司 | Screen projection data display processing method and device, terminal equipment and storage medium |
| WO2021179359A1 (en) * | 2020-03-13 | 2021-09-16 | 海信视像科技股份有限公司 | Display device and display picture rotation adaptation method |
| CN113408380A (en) * | 2021-06-07 | 2021-09-17 | 深圳小湃科技有限公司 | Video image adjusting method, device and storage medium |
| CN113453050A (en) * | 2021-06-24 | 2021-09-28 | 深圳康佳电子科技有限公司 | Play mode adjusting method based on rotary screen, intelligent terminal and storage medium |
| CN113473196A (en) * | 2021-07-21 | 2021-10-01 | 青岛海信传媒网络技术有限公司 | Screen projection data processing method and display device |
| WO2021212463A1 (en) * | 2020-04-24 | 2021-10-28 | 海信视像科技股份有限公司 | Display device and screen projection method |
| WO2021238454A1 (en) * | 2020-05-29 | 2021-12-02 | 广州华多网络科技有限公司 | Method and apparatus for displaying live video, and terminal and readable storage medium |
-
2021
- 2021-12-28 CN CN202111638170.9A patent/CN114222188A/en active Pending
Patent Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1799252A (en) * | 2003-06-02 | 2006-07-05 | 卡西欧计算机株式会社 | Captured image projection apparatus and captured image correction method |
| CN101277381A (en) * | 2008-04-15 | 2008-10-01 | 北京中星微电子有限公司 | Method and apparatus for processing video image |
| WO2012134352A2 (en) * | 2011-03-28 | 2012-10-04 | Arsenich Svyatoslav Ivanovich | Matrix display, variants thereof and method for manufacturing same |
| US20170249925A1 (en) * | 2014-05-30 | 2017-08-31 | Guangzhou Ucweb Computer Technology Co., Ltd. | Method and device for switching playing mode of a mobile terminal, storage medium and program |
| WO2017185645A1 (en) * | 2016-04-29 | 2017-11-02 | 乐视控股（北京）有限公司 | Portrait full screen playback method, apparatus and mobile playback terminal thereof |
| CN106454407A (en) * | 2016-10-25 | 2017-02-22 | 广州华多网络科技有限公司 | Video live broadcast method and device |
| JP2019139697A (en) * | 2018-02-15 | 2019-08-22 | パナソニックＩｐマネジメント株式会社 | Display device, video display system, and video display method |
| CN110267085A (en) * | 2018-03-12 | 2019-09-20 | 青岛海信电器股份有限公司 | A kind of method and device of video processing |
| CN108650542A (en) * | 2018-05-09 | 2018-10-12 | 腾讯科技（深圳）有限公司 | Generate vertical screen video flowing, the method for image procossing, electronic equipment and video system |
| CN111147911A (en) * | 2019-12-27 | 2020-05-12 | 北京达佳互联信息技术有限公司 | Video clipping method and device, electronic equipment and storage medium |
| WO2021179359A1 (en) * | 2020-03-13 | 2021-09-16 | 海信视像科技股份有限公司 | Display device and display picture rotation adaptation method |
| WO2021212463A1 (en) * | 2020-04-24 | 2021-10-28 | 海信视像科技股份有限公司 | Display device and screen projection method |
| WO2021238454A1 (en) * | 2020-05-29 | 2021-12-02 | 广州华多网络科技有限公司 | Method and apparatus for displaying live video, and terminal and readable storage medium |
| CN112887768A (en) * | 2021-01-12 | 2021-06-01 | 京东方科技集团股份有限公司 | Screen projection display method and device, electronic equipment and storage medium |
| CN112995535A (en) * | 2021-02-05 | 2021-06-18 | 北京百度网讯科技有限公司 | Method, apparatus, device and storage medium for processing video |
| CN113206964A (en) * | 2021-04-29 | 2021-08-03 | 深圳康佳电子科技有限公司 | Screen projection data display processing method and device, terminal equipment and storage medium |
| CN113408380A (en) * | 2021-06-07 | 2021-09-17 | 深圳小湃科技有限公司 | Video image adjusting method, device and storage medium |
| CN113453050A (en) * | 2021-06-24 | 2021-09-28 | 深圳康佳电子科技有限公司 | Play mode adjusting method based on rotary screen, intelligent terminal and storage medium |
| CN113473196A (en) * | 2021-07-21 | 2021-10-01 | 青岛海信传媒网络技术有限公司 | Screen projection data processing method and display device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114938469A (en) * | 2022-05-16 | 2022-08-23 | 深圳康佳电子科技有限公司 | Image processing method and device for camera, camera and display system |
| CN115113838A (en) * | 2022-07-15 | 2022-09-27 | 北京字跳网络技术有限公司 | Display method, device, equipment and medium for screen projection picture |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11303881B2 (en) | Method and client for playing back panoramic video | |
| CN109120984B (en) | Barrage display method and device, terminal and server | |
| CN114222188A (en) | Full-screen display method, device and equipment based on rotary screen and storage medium | |
| EP3913924B1 (en) | 360-degree panoramic video playing method, apparatus, and system | |
| CN113126937B (en) | Display terminal adjusting method and display terminal | |
| WO2007016318A2 (en) | Real-time preview for panoramic images | |
| CN113329252B (en) | Live broadcast-based face processing method, device, equipment and storage medium | |
| CN113196785B (en) | Live video interaction method, device, equipment and storage medium | |
| WO2022161260A1 (en) | Focusing method and apparatus, electronic device, and medium | |
| CN111641871A (en) | Live video display method and device, terminal and readable storage medium | |
| CN102265607A (en) | image scaling curve generation | |
| CN103019537A (en) | Image preview method and image preview device | |
| CN106303571A (en) | Image acquisition process realizes the method and system of self adaptation screen rotation | |
| CN104363400A (en) | Method and device for scanning local two-dimensional codes | |
| WO2023005050A1 (en) | Fully automatic multi-screen splicing method, device, and storage medium | |
| CN113905268A (en) | Black edge removing method for screen projection display of mobile terminal | |
| CN111787230A (en) | Image display method and device and electronic equipment | |
| CN110602410B (en) | Image processing method and device, aerial camera and storage medium | |
| CN111835972B (en) | Shooting method and device and electronic equipment | |
| JP2019149785A (en) | Video conversion device and program | |
| US20230084031A1 (en) | Image-processing device and display-control method for use in display-wall system | |
| CN112672057B (en) | Shooting method and device | |
| CN111857350A (en) | Method, device and equipment for rotating display equipment | |
| CN113126942A (en) | Display method and device of cover picture, electronic equipment and storage medium | |
| CN113126836B (en) | Picture display method, storage medium and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |